2024-09-14T10:45:04.481 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-14T10:45:04.502 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T10:45:04.592 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141 branch: main description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: ceph-qa@ceph.com first_in_suite: false job_id: '7904141' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: main ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw max chunk size: 4194304 rgw obj stripe size: 6291456 rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 rgw override bucket index max shards: 1 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 compression type: random ec-data-pool: false frontend: beast inline data: false storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 s3 tenant: RGW33333333333333333 force-branch: ceph-master storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded owner: scheduled_teuthology@teuthology priority: 950 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 9419 sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 sleep_before_teardown: 0 subset: 0/1 suite: rgw suite_branch: main suite_path: /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 1c941a66c1b420259b8fc5ac19e792dbbf60aded targets: smithi002.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVuEMpULaiItpQi0c4ffW6zR5BAD+tb9GZRM1EKuVhipQ8/z7Vh3lp4OsoZkGXrqK562SUVx/ENDY6ia+GcU0w= smithi086.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKkDDkKdsXSOOf5ShFDQAj53HhwcKeoBeys8TAE4SnDPUckY9gEAp/sfaRdUs4jMsZ2QtPEWb4sJ7wij97OFQgQ= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_20:40:18 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-14T10:45:04.592 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa; will attempt to use it 2024-09-14T10:45:04.593 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa/tasks 2024-09-14T10:45:04.593 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-14T10:45:04.595 INFO:teuthology.task.internal:Checking packages... 2024-09-14T10:45:04.616 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8' 2024-09-14T10:45:04.616 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-14T10:45:04.617 INFO:teuthology.packaging:ref: None 2024-09-14T10:45:04.617 INFO:teuthology.packaging:tag: None 2024-09-14T10:45:04.617 INFO:teuthology.packaging:branch: main 2024-09-14T10:45:04.617 INFO:teuthology.packaging:sha1: a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:45:04.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=main 2024-09-14T10:45:04.827 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4926.g1c941a66 2024-09-14T10:45:04.829 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-14T10:45:04.835 INFO:teuthology.task.internal:no buildpackages task found 2024-09-14T10:45:04.835 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-14T10:45:04.842 INFO:teuthology.task.internal:Saving configuration 2024-09-14T10:45:04.858 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-14T10:45:04.866 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-14T10:45:04.885 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi002.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:40:09.609432', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVuEMpULaiItpQi0c4ffW6zR5BAD+tb9GZRM1EKuVhipQ8/z7Vh3lp4OsoZkGXrqK562SUVx/ENDY6ia+GcU0w='} 2024-09-14T10:45:04.905 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi086.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-14 10:40:09.610992', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKkDDkKdsXSOOf5ShFDQAj53HhwcKeoBeys8TAE4SnDPUckY9gEAp/sfaRdUs4jMsZ2QtPEWb4sJ7wij97OFQgQ='} 2024-09-14T10:45:04.905 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-14T10:45:04.913 INFO:teuthology.task.internal:roles: ubuntu@smithi002.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T10:45:04.913 INFO:teuthology.task.internal:roles: ubuntu@smithi086.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T10:45:04.913 INFO:teuthology.run_tasks:Running task console_log... 2024-09-14T10:45:04.965 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f074fb70a60>, signals=[15]) 2024-09-14T10:45:04.965 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-14T10:45:04.973 INFO:teuthology.task.internal:Opening connections... 2024-09-14T10:45:04.973 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T10:45:04.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:45:05.053 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T10:45:05.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:45:05.130 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-14T10:45:05.137 DEBUG:teuthology.orchestra.run.smithi002:> uname -m 2024-09-14T10:45:05.156 INFO:teuthology.orchestra.run.smithi002.stdout:x86_64 2024-09-14T10:45:05.156 DEBUG:teuthology.orchestra.run.smithi002:> cat /etc/os-release 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:NAME="CentOS Stream" 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION="9" 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:ID="centos" 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:VERSION_ID="9" 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:45:05.214 INFO:teuthology.orchestra.run.smithi002.stdout:ANSI_COLOR="0;31" 2024-09-14T10:45:05.215 INFO:teuthology.orchestra.run.smithi002.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:45:05.215 INFO:teuthology.orchestra.run.smithi002.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:45:05.215 INFO:teuthology.orchestra.run.smithi002.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:45:05.215 INFO:teuthology.orchestra.run.smithi002.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:45:05.215 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:45:05.215 INFO:teuthology.orchestra.run.smithi002.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:45:05.216 INFO:teuthology.lock.ops:Updating smithi002.front.sepia.ceph.com on lock server 2024-09-14T10:45:05.238 DEBUG:teuthology.orchestra.run.smithi086:> uname -m 2024-09-14T10:45:05.256 INFO:teuthology.orchestra.run.smithi086.stdout:x86_64 2024-09-14T10:45:05.256 DEBUG:teuthology.orchestra.run.smithi086:> cat /etc/os-release 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:NAME="CentOS Stream" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION="9" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:ID="centos" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:ID_LIKE="rhel fedora" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:VERSION_ID="9" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:PLATFORM_ID="platform:el9" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:ANSI_COLOR="0;31" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:LOGO="fedora-logo-icon" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-14T10:45:05.313 INFO:teuthology.orchestra.run.smithi086.stdout:HOME_URL="https://centos.org/" 2024-09-14T10:45:05.314 INFO:teuthology.orchestra.run.smithi086.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-14T10:45:05.314 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-14T10:45:05.314 INFO:teuthology.orchestra.run.smithi086.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-14T10:45:05.314 INFO:teuthology.lock.ops:Updating smithi086.front.sepia.ceph.com on lock server 2024-09-14T10:45:05.338 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-14T10:45:05.350 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-14T10:45:05.364 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-14T10:45:05.364 DEBUG:teuthology.orchestra.run.smithi002:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:45:05.367 DEBUG:teuthology.orchestra.run.smithi086:> test '!' -e /home/ubuntu/cephtest 2024-09-14T10:45:05.383 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-14T10:45:05.391 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-14T10:45:05.391 DEBUG:teuthology.orchestra.run.smithi002:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:45:05.424 DEBUG:teuthology.orchestra.run.smithi086:> test -z $(ls -A /var/lib/ceph) 2024-09-14T10:45:05.449 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-14T10:45:05.499 INFO:teuthology.run_tasks:Running task kernel... 2024-09-14T10:45:05.520 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-14T10:45:05.520 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-14T10:45:05.520 DEBUG:teuthology.orchestra.run.smithi002:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:45:05.521 DEBUG:teuthology.orchestra.run.smithi086:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-14T10:45:05.536 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:45:05.537 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-14T10:45:05.538 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:45:05.538 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-14T10:45:05.593 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:45:05.594 INFO:teuthology.task.kernel:Running kernel on smithi086: 5.14.0-503.el9.x86_64 2024-09-14T10:45:05.594 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum install -y kernel 2024-09-14T10:45:05.595 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-503.el9.x86_64 2024-09-14T10:45:05.596 INFO:teuthology.task.kernel:Running kernel on smithi002: 5.14.0-503.el9.x86_64 2024-09-14T10:45:05.596 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum install -y kernel 2024-09-14T10:45:07.811 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 18 MB/s | 8.2 MB 00:00 2024-09-14T10:45:10.434 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 2.7 MB/s | 8.2 MB 00:03 2024-09-14T10:45:11.195 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 9.2 MB/s | 20 MB 00:02 2024-09-14T10:45:12.235 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-14T10:45:15.754 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-14T10:45:16.611 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-14T10:45:17.196 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 105 kB/s | 19 kB 00:00 2024-09-14T10:45:18.120 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 19 kB 00:00 2024-09-14T10:45:18.141 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-14T10:45:19.099 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 26 MB/s | 23 MB 00:00 2024-09-14T10:45:23.689 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T10:45:24.547 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 36 kB/s | 1.7 kB 00:00 2024-09-14T10:45:25.779 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:45:25.779 INFO:teuthology.orchestra.run.smithi002.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:45:25.871 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-14T10:45:25.878 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-14T10:45:25.878 INFO:teuthology.orchestra.run.smithi002.stdout: Package Architecture Version Repository Size 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout:Install 4 Packages 2024-09-14T10:45:25.879 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:45:25.880 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 79 M 2024-09-14T10:45:25.880 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 126 M 2024-09-14T10:45:25.880 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-14T10:45:26.007 INFO:teuthology.orchestra.run.smithi002.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 271 kB/s | 23 kB 00:00 2024-09-14T10:45:26.536 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-14T10:45:26.537 INFO:teuthology.orchestra.run.smithi086.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-14T10:45:26.627 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: Package Architecture Version Repository Size 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:45:26.639 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T10:45:26.640 INFO:teuthology.orchestra.run.smithi086.stdout:================================================================================ 2024-09-14T10:45:26.640 INFO:teuthology.orchestra.run.smithi086.stdout:Install 4 Packages 2024-09-14T10:45:26.640 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:45:26.640 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 79 M 2024-09-14T10:45:26.641 INFO:teuthology.orchestra.run.smithi086.stdout:Installed size: 126 M 2024-09-14T10:45:26.641 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T10:45:26.882 INFO:teuthology.orchestra.run.smithi086.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 201 kB/s | 23 kB 00:00 2024-09-14T10:45:27.507 INFO:teuthology.orchestra.run.smithi086.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-14T10:45:28.082 INFO:teuthology.orchestra.run.smithi086.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 26 MB/s | 35 MB 00:01 2024-09-14T10:45:28.541 INFO:teuthology.orchestra.run.smithi086.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 17 MB/s | 29 MB 00:01 2024-09-14T10:45:28.541 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:45:28.541 INFO:teuthology.orchestra.run.smithi086.stdout:Total 41 MB/s | 79 MB 00:01 2024-09-14T10:45:28.740 INFO:teuthology.orchestra.run.smithi002.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.6 MB/s | 16 MB 00:02 2024-09-14T10:45:29.230 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T10:45:29.583 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T10:45:30.549 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T10:45:30.549 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T10:45:30.690 INFO:teuthology.orchestra.run.smithi002.stdout:(3/4): kernel-modules-core-5.14.0-505.el9.x86_6 6.1 MB/s | 29 MB 00:04 2024-09-14T10:45:32.741 INFO:teuthology.orchestra.run.smithi002.stdout:(4/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.1 MB/s | 35 MB 00:06 2024-09-14T10:45:32.741 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:45:32.741 INFO:teuthology.orchestra.run.smithi002.stdout:Total 11 MB/s | 79 MB 00:06 2024-09-14T10:45:32.996 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T10:45:33.455 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-14T10:45:33.665 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:45:33.757 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:33.835 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-14T10:45:33.835 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-14T10:45:34.813 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-14T10:45:34.814 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-14T10:45:36.575 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:36.700 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:45:37.365 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-14T10:45:38.050 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:45:38.140 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:40.912 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:45:41.035 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:45:41.499 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:45:41.544 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:46.156 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:45:46.202 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:46.389 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:45:51.344 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:24.628 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:24.668 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:24.999 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:24.999 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:46:24.999 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:24.999 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:25.889 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:25.889 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:46:25.889 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T10:46:25.889 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:25.889 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:25.890 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:46:25.890 INFO:teuthology.orchestra.run.smithi086.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:25.890 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:46:25.890 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T10:46:26.213 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:26.285 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:26.285 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:26.285 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:46:26.285 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:46:26.285 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:46:26.285 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-14T10:46:26.286 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi086.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:46:26.286 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:26.344 INFO:teuthology.orchestra.run.smithi086.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:26.345 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:26.345 DEBUG:teuthology.orchestra.run.smithi086:> sudo rpm -qi grub2-tools 2024-09-14T10:46:26.390 INFO:teuthology.orchestra.run.smithi086.stdout:Name : grub2-tools 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Epoch : 1 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Version : 2.06 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Release : 82.el9 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Architecture: x86_64 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Group : Unspecified 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Size : 8274670 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:License : GPLv3+ 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:46:26.391 INFO:teuthology.orchestra.run.smithi086.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:Packager : builder@centos.org 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:Vendor : CentOS 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:Summary : Support tools for GRUB. 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:Description : 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:hardware devices. 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:46:26.392 INFO:teuthology.orchestra.run.smithi086.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:46:26.393 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:46:26.393 INFO:teuthology.task.kernel:Updating grub on smithi086 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:46:26.393 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:46:27.036 INFO:teuthology.orchestra.run.smithi086.stderr:Generating grub configuration file ... 2024-09-14T10:46:28.336 INFO:teuthology.orchestra.run.smithi086.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:46:28.370 INFO:teuthology.orchestra.run.smithi086.stderr:done 2024-09-14T10:46:28.372 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-14T10:46:28.387 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.nwq2qaPmKo 2024-09-14T10:46:28.388 DEBUG:teuthology.orchestra.run.smithi086:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nwq2qaPmKo 2024-09-14T10:46:28.454 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.nwq2qaPmKo 2024-09-14T10:46:28.588 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.nwq2qaPmKo is 6KB 2024-09-14T10:46:28.636 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.nwq2qaPmKo 2024-09-14T10:46:28.651 DEBUG:teuthology.orchestra.run.smithi086:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:46:28.715 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:46:28.715 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:46:28.715 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:46:28.716 INFO:teuthology.orchestra.run.smithi086.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:46:28.717 DEBUG:teuthology.orchestra.run.smithi086:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:46:28.854 DEBUG:teuthology.orchestra.run.smithi086:> sudo shutdown -r now 2024-09-14T10:46:30.306 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:30.347 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:30.707 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-14T10:46:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-14T10:46:30.708 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-14T10:46:31.569 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:46:31.570 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-14T10:46:31.894 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:31.997 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:31.998 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:31.998 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-14T10:46:31.998 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-14T10:46:31.998 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-14T10:46:31.998 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-14T10:46:31.998 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi002.front.sepia.ceph.com, path=None, version=distro) 2024-09-14T10:46:31.998 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q kernel | sort -rV | head -n 1 2024-09-14T10:46:32.057 INFO:teuthology.orchestra.run.smithi002.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-14T10:46:32.057 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-14T10:46:32.057 DEBUG:teuthology.orchestra.run.smithi002:> sudo rpm -qi grub2-tools 2024-09-14T10:46:32.090 INFO:teuthology.orchestra.run.smithi002.stdout:Name : grub2-tools 2024-09-14T10:46:32.090 INFO:teuthology.orchestra.run.smithi002.stdout:Epoch : 1 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Version : 2.06 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Release : 82.el9 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Architecture: x86_64 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Group : Unspecified 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Size : 8274670 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:License : GPLv3+ 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Packager : builder@centos.org 2024-09-14T10:46:32.091 INFO:teuthology.orchestra.run.smithi002.stdout:Vendor : CentOS 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:Summary : Support tools for GRUB. 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:Description : 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:hardware devices. 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:46:32.092 INFO:teuthology.orchestra.run.smithi002.stdout:This subpackage provides tools for support of all platforms. 2024-09-14T10:46:32.093 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-14T10:46:32.093 INFO:teuthology.task.kernel:Updating grub on smithi002 to boot 5.14.0-505.el9.x86_64 2024-09-14T10:46:32.093 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-14T10:46:32.751 INFO:teuthology.orchestra.run.smithi002.stderr:Generating grub configuration file ... 2024-09-14T10:46:34.035 INFO:teuthology.orchestra.run.smithi002.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-14T10:46:34.068 INFO:teuthology.orchestra.run.smithi002.stderr:done 2024-09-14T10:46:34.070 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-14T10:46:34.085 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.3Vih9aNQAU 2024-09-14T10:46:34.086 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3Vih9aNQAU 2024-09-14T10:46:34.158 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.3Vih9aNQAU 2024-09-14T10:46:34.298 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.3Vih9aNQAU is 6KB 2024-09-14T10:46:34.346 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.3Vih9aNQAU 2024-09-14T10:46:34.361 DEBUG:teuthology.orchestra.run.smithi002:> sudo /bin/ls /boot/loader/entries || true 2024-09-14T10:46:34.424 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-14T10:46:34.424 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-14T10:46:34.424 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-14T10:46:34.424 INFO:teuthology.orchestra.run.smithi002.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-14T10:46:34.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-14T10:46:34.593 DEBUG:teuthology.orchestra.run.smithi002:> sudo shutdown -r now 2024-09-14T10:46:58.881 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-14T10:46:58.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T10:46:58.882 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:47:04.601 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-14T10:47:04.601 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-14T10:47:04.601 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:47:58.937 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:48:04.609 DEBUG:teuthology.orchestra.remote:timed out 2024-09-14T10:48:07.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T10:48:07.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:48:08.697 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-14T10:48:09.119 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T10:48:09.119 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:48:09.119 DEBUG:teuthology.orchestra.run.smithi086:> uname -r 2024-09-14T10:48:09.136 INFO:teuthology.orchestra.run.smithi086.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:48:09.136 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:48:09.137 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:48:09.137 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:48:10.138 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-14T10:48:10.138 DEBUG:teuthology.orchestra.run.smithi086:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:48:10.229 INFO:teuthology.orchestra.run.smithi086.stdout:ttyS1 2024-09-14T10:48:10.261 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:13.610 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-14T10:48:13.610 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:48:14.254 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-14T10:48:14.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-14T10:48:14.633 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-14T10:48:14.633 DEBUG:teuthology.orchestra.run.smithi002:> uname -r 2024-09-14T10:48:14.649 INFO:teuthology.orchestra.run.smithi002.stdout:5.14.0-505.el9.x86_64 2024-09-14T10:48:14.650 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-14T10:48:14.650 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-14T10:48:14.650 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-14T10:48:15.651 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-14T10:48:15.651 DEBUG:teuthology.orchestra.run.smithi002:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-14T10:48:15.743 INFO:teuthology.orchestra.run.smithi002.stdout:ttyS1 2024-09-14T10:48:15.787 DEBUG:teuthology.parallel:result is None 2024-09-14T10:48:15.787 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-14T10:48:15.798 INFO:teuthology.task.internal:Creating test directory... 2024-09-14T10:48:15.799 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:48:15.801 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-14T10:48:15.818 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-14T10:48:15.824 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-14T10:48:15.833 INFO:teuthology.task.internal:Creating archive directory... 2024-09-14T10:48:15.833 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:48:15.857 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-14T10:48:15.882 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-14T10:48:15.888 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-14T10:48:15.889 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:48:15.914 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-14T10:48:15.945 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:15.947 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:15.955 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:15.957 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-14T10:48:15.959 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-14T10:48:15.965 INFO:teuthology.task.internal:Configuring sudo... 2024-09-14T10:48:15.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:48:16.000 DEBUG:teuthology.orchestra.run.smithi086:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-14T10:48:16.028 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-14T10:48:16.037 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-14T10:48:16.037 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:48:16.067 DEBUG:teuthology.orchestra.run.smithi086:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-14T10:48:16.087 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:16.160 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:16.212 DEBUG:teuthology.orchestra.run.smithi002:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:16.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:16.337 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:48:16.338 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:48:16.404 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:16.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-14T10:48:16.494 DEBUG:teuthology.orchestra.run.smithi086:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:16.574 DEBUG:teuthology.orchestra.run.smithi086:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-14T10:48:16.618 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:48:16.619 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-14T10:48:16.683 DEBUG:teuthology.orchestra.run.smithi002:> sudo service rsyslog restart 2024-09-14T10:48:16.686 DEBUG:teuthology.orchestra.run.smithi086:> sudo service rsyslog restart 2024-09-14T10:48:16.738 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:48:16.834 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T10:48:17.068 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-14T10:48:17.076 INFO:teuthology.task.internal:Starting timer... 2024-09-14T10:48:17.076 INFO:teuthology.run_tasks:Running task pcp... 2024-09-14T10:48:17.086 INFO:teuthology.run_tasks:Running task selinux... 2024-09-14T10:48:17.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo service auditd rotate 2024-09-14T10:48:17.167 INFO:teuthology.orchestra.run.smithi002.stdout:Rotating logs: 2024-09-14T10:48:17.168 DEBUG:teuthology.orchestra.run.smithi086:> sudo service auditd rotate 2024-09-14T10:48:17.270 INFO:teuthology.orchestra.run.smithi086.stdout:Rotating logs: 2024-09-14T10:48:17.274 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-14T10:48:17.274 DEBUG:teuthology.orchestra.run.smithi002:> /usr/sbin/getenforce 2024-09-14T10:48:17.311 INFO:teuthology.orchestra.run.smithi002.stdout:Permissive 2024-09-14T10:48:17.311 DEBUG:teuthology.orchestra.run.smithi086:> /usr/sbin/getenforce 2024-09-14T10:48:17.349 INFO:teuthology.orchestra.run.smithi086.stdout:Permissive 2024-09-14T10:48:17.349 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi002.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi086.front.sepia.ceph.com': 'permissive'} 2024-09-14T10:48:17.349 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:48:17.384 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:17.384 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T10:48:17.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:48:17.454 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-14T10:48:17.454 DEBUG:teuthology.orchestra.run.smithi002:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:48:17.484 DEBUG:teuthology.orchestra.run.smithi086:> sudo /usr/sbin/setenforce permissive 2024-09-14T10:48:17.578 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-14T10:48:17.587 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-14T10:48:17.590 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-14T10:48:17.717 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-14T10:48:17.728 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-14T10:48:17.729 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi002.front.sepia.ceph.com,smithi086.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-14T10:52:07.430 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi002.front.sepia.ceph.com'), Remote(name='ubuntu@smithi086.front.sepia.ceph.com')] 2024-09-14T10:52:07.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-14T10:52:07.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi002.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:52:07.511 DEBUG:teuthology.orchestra.run.smithi002:> true 2024-09-14T10:52:07.593 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi002.front.sepia.ceph.com' 2024-09-14T10:52:07.593 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T10:52:07.594 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi086.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-14T10:52:07.666 DEBUG:teuthology.orchestra.run.smithi086:> true 2024-09-14T10:52:07.745 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi086.front.sepia.ceph.com' 2024-09-14T10:52:07.745 INFO:teuthology.run_tasks:Running task clock... 2024-09-14T10:52:07.756 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-14T10:52:07.756 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:52:07.757 DEBUG:teuthology.orchestra.run.smithi002:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:52:07.759 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-14T10:52:07.759 DEBUG:teuthology.orchestra.run.smithi086:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T10:52:07.789 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:52:07.805 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:52:07.816 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-14T10:52:07.831 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-14T10:52:07.831 INFO:teuthology.orchestra.run.smithi002.stderr:sudo: ntpd: command not found 2024-09-14T10:52:07.844 INFO:teuthology.orchestra.run.smithi002.stdout:506 Cannot talk to daemon 2024-09-14T10:52:07.856 INFO:teuthology.orchestra.run.smithi086.stderr:sudo: ntpd: command not found 2024-09-14T10:52:07.858 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:52:07.867 INFO:teuthology.orchestra.run.smithi086.stdout:506 Cannot talk to daemon 2024-09-14T10:52:07.873 INFO:teuthology.orchestra.run.smithi002.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:52:07.883 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-14T10:52:07.896 INFO:teuthology.orchestra.run.smithi086.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-14T10:52:07.939 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:52:07.943 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:52:07.943 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-14T10:52:07.943 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.943 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.943 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.943 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.966 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-14T10:52:07.970 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T10:52:07.970 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-14T10:52:07.970 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.970 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.970 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.970 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T10:52:07.971 INFO:teuthology.run_tasks:Running task install... 2024-09-14T10:52:07.980 DEBUG:teuthology.task.install:project ceph 2024-09-14T10:52:07.980 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}} 2024-09-14T10:52:07.980 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'} 2024-09-14T10:52:07.980 INFO:teuthology.task.install:Using flavor: default 2024-09-14T10:52:07.985 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-14T10:52:07.985 INFO:teuthology.task.install:extra packages: [] 2024-09-14T10:52:07.986 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:52:07.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:52:07.988 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'tag': None, 'wait_for_package': False} 2024-09-14T10:52:07.988 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:52:08.144 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:52:08.144 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:52:08.147 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/ 2024-09-14T10:52:08.148 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4907.ga2782315 2024-09-14T10:52:08.252 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:52:08.252 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:52:08.252 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:52:08.260 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/main/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-14T10:52:08.260 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:52:08.260 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-14T10:52:08.280 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:52:08.280 DEBUG:teuthology.orchestra.run.smithi002:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:52:08.286 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-14T10:52:08.286 DEBUG:teuthology.orchestra.run.smithi086:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a2782315255a3e7d5f6cdc9eb35785187ff6ddf8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-14T10:52:08.348 DEBUG:teuthology.orchestra.run.smithi002:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:52:08.351 DEBUG:teuthology.orchestra.run.smithi086:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-14T10:52:08.426 DEBUG:teuthology.orchestra.run.smithi086:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:52:08.427 DEBUG:teuthology.orchestra.run.smithi002:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-14T10:52:08.491 INFO:teuthology.orchestra.run.smithi086.stdout:check_obsoletes = 1 2024-09-14T10:52:08.493 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum clean all 2024-09-14T10:52:08.493 INFO:teuthology.orchestra.run.smithi002.stdout:check_obsoletes = 1 2024-09-14T10:52:08.495 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum clean all 2024-09-14T10:52:08.725 INFO:teuthology.orchestra.run.smithi086.stdout:45 files removed 2024-09-14T10:52:08.733 INFO:teuthology.orchestra.run.smithi002.stdout:45 files removed 2024-09-14T10:52:08.751 DEBUG:teuthology.orchestra.run.smithi086:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:52:08.760 DEBUG:teuthology.orchestra.run.smithi002:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-14T10:52:09.301 INFO:teuthology.orchestra.run.smithi086.stdout:ceph packages for x86_64 316 kB/s | 84 kB 00:00 2024-09-14T10:52:09.336 INFO:teuthology.orchestra.run.smithi002.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-14T10:52:09.601 INFO:teuthology.orchestra.run.smithi086.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-14T10:52:09.637 INFO:teuthology.orchestra.run.smithi002.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-14T10:52:09.860 INFO:teuthology.orchestra.run.smithi086.stdout:ceph source packages 8.8 kB/s | 1.9 kB 00:00 2024-09-14T10:52:09.912 INFO:teuthology.orchestra.run.smithi002.stdout:ceph source packages 8.2 kB/s | 1.9 kB 00:00 2024-09-14T10:52:10.310 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - BaseOS 20 MB/s | 8.2 MB 00:00 2024-09-14T10:52:11.770 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.2 MB 00:01 2024-09-14T10:52:12.336 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-14T10:52:13.722 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - AppStream 25 MB/s | 20 MB 00:00 2024-09-14T10:52:18.179 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.5 MB 00:02 2024-09-14T10:52:18.356 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-14T10:52:19.863 INFO:teuthology.orchestra.run.smithi086.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-14T10:52:19.889 INFO:teuthology.orchestra.run.smithi002.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-14T10:52:20.884 INFO:teuthology.orchestra.run.smithi086.stdout:Extra Packages for Enterprise Linux 25 MB/s | 23 MB 00:00 2024-09-14T10:52:20.960 INFO:teuthology.orchestra.run.smithi002.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-14T10:52:26.323 INFO:teuthology.orchestra.run.smithi086.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T10:52:26.566 INFO:teuthology.orchestra.run.smithi002.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-14T10:52:28.677 INFO:teuthology.orchestra.run.smithi086.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:52:28.678 INFO:teuthology.orchestra.run.smithi086.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:52:28.769 INFO:teuthology.orchestra.run.smithi086.stdout:Dependencies resolved. 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================================== 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: Package Arch Version Repository Size 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================================== 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout:Installing: 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:52:28.799 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:52:28.800 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrading: 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout:Installing dependencies: 2024-09-14T10:52:28.801 INFO:teuthology.orchestra.run.smithi086.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:52:28.802 INFO:teuthology.orchestra.run.smithi086.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:52:28.803 INFO:teuthology.orchestra.run.smithi086.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:52:28.804 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:52:28.805 INFO:teuthology.orchestra.run.smithi086.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:52:28.806 INFO:teuthology.orchestra.run.smithi086.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:52:28.807 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:52:28.808 INFO:teuthology.orchestra.run.smithi086.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:52:28.809 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:52:28.810 INFO:teuthology.orchestra.run.smithi086.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:52:28.811 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:52:28.812 INFO:teuthology.orchestra.run.smithi086.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:52:28.813 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:52:28.814 INFO:teuthology.orchestra.run.smithi086.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:52:28.815 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:52:28.816 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:52:28.817 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:52:28.818 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:52:28.819 INFO:teuthology.orchestra.run.smithi086.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:52:28.820 INFO:teuthology.orchestra.run.smithi086.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout:Installing weak dependencies: 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:52:28.821 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction Summary 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout:====================================================================================================== 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout:Install 284 Packages 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout:Upgrade 2 Packages 2024-09-14T10:52:28.822 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:52:28.823 INFO:teuthology.orchestra.run.smithi086.stdout:Total download size: 327 M 2024-09-14T10:52:28.823 INFO:teuthology.orchestra.run.smithi086.stdout:Downloading Packages: 2024-09-14T10:52:29.004 INFO:teuthology.orchestra.run.smithi002.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:52:29.005 INFO:teuthology.orchestra.run.smithi002.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-14T10:52:29.104 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-14T10:52:29.136 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================================== 2024-09-14T10:52:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-14T10:52:29.136 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================================== 2024-09-14T10:52:29.136 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-14T10:52:29.136 INFO:teuthology.orchestra.run.smithi002.stdout: ceph x86_64 2:19.3.0-4907.ga2782315.el9 ceph 6.6 k 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 900 k 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4907.ga2782315.el9 ceph 145 k 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr x86_64 2:19.3.0-4907.ga2782315.el9 ceph 1.5 M 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 154 k 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 14 M 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 7.4 M 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 49 k 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 11 M 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test x86_64 2:19.3.0-4907.ga2782315.el9 ceph 50 M 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 285 k 2024-09-14T10:52:29.137 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 784 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 32 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 756 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel x86_64 2:19.3.0-4907.ga2782315.el9 ceph 127 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados x86_64 2:19.3.0-4907.ga2782315.el9 ceph 320 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 305 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw x86_64 2:19.3.0-4907.ga2782315.el9 ceph 99 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 85 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 171 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-14T10:52:29.138 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrading: 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: librados2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.5 M 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 3.2 M 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-14T10:52:29.139 INFO:teuthology.orchestra.run.smithi002.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 22 M 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 34 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds x86_64 2:19.3.0-4907.ga2782315.el9 ceph 2.4 M 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 291 k 2024-09-14T10:52:29.140 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon x86_64 2:19.3.0-4907.ga2782315.el9 ceph 4.8 M 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd x86_64 2:19.3.0-4907.ga2782315.el9 ceph 17 M 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4907.ga2782315.el9 ceph-noarch 16 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux x86_64 2:19.3.0-4907.ga2782315.el9 ceph 25 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-14T10:52:29.141 INFO:teuthology.orchestra.run.smithi002.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-14T10:52:29.142 INFO:teuthology.orchestra.run.smithi002.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-14T10:52:29.143 INFO:teuthology.orchestra.run.smithi002.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-14T10:52:29.144 INFO:teuthology.orchestra.run.smithi002.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite x86_64 2:19.3.0-4907.ga2782315.el9 ceph 161 k 2024-09-14T10:52:29.145 INFO:teuthology.orchestra.run.smithi002.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-14T10:52:29.146 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 508 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2 x86_64 2:19.3.0-4907.ga2782315.el9 ceph 5.5 M 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-14T10:52:29.147 INFO:teuthology.orchestra.run.smithi002.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-14T10:52:29.148 INFO:teuthology.orchestra.run.smithi002.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-14T10:52:29.149 INFO:teuthology.orchestra.run.smithi002.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-14T10:52:29.150 INFO:teuthology.orchestra.run.smithi002.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-14T10:52:29.151 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse x86_64 2:19.3.0-4907.ga2782315.el9 ceph 45 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common x86_64 2:19.3.0-4907.ga2782315.el9 ceph 143 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-14T10:52:29.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-14T10:52:29.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-14T10:52:29.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-14T10:52:29.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-14T10:52:29.156 INFO:teuthology.orchestra.run.smithi002.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-14T10:52:29.157 INFO:teuthology.orchestra.run.smithi002.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-14T10:52:29.158 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout:====================================================================================================== 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout:Install 284 Packages 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout:Upgrade 2 Packages 2024-09-14T10:52:29.159 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:52:29.160 INFO:teuthology.orchestra.run.smithi086.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 51 kB/s | 6.6 kB 00:00 2024-09-14T10:52:29.160 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 327 M 2024-09-14T10:52:29.160 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-14T10:52:29.427 INFO:teuthology.orchestra.run.smithi086.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 3.2 MB/s | 900 kB 00:00 2024-09-14T10:52:29.502 INFO:teuthology.orchestra.run.smithi086.stdout:(3/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 12 MB/s | 5.5 MB 00:00 2024-09-14T10:52:29.528 INFO:teuthology.orchestra.run.smithi086.stdout:(4/286): ceph-immutable-object-cache-19.3.0-490 1.4 MB/s | 145 kB 00:00 2024-09-14T10:52:29.644 INFO:teuthology.orchestra.run.smithi086.stdout:(5/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 17 MB/s | 2.4 MB 00:00 2024-09-14T10:52:29.770 INFO:teuthology.orchestra.run.smithi086.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 6.3 MB/s | 1.5 MB 00:00 2024-09-14T10:52:29.886 INFO:teuthology.orchestra.run.smithi086.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 20 MB/s | 4.8 MB 00:00 2024-09-14T10:52:29.901 INFO:teuthology.orchestra.run.smithi002.stdout:(1/286): ceph-19.3.0-4907.ga2782315.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-09-14T10:52:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:(2/286): ceph-fuse-19.3.0-4907.ga2782315.el9.x8 2.5 MB/s | 900 kB 00:00 2024-09-14T10:52:30.295 INFO:teuthology.orchestra.run.smithi086.stdout:(8/286): ceph-radosgw-19.3.0-4907.ga2782315.el9 27 MB/s | 11 MB 00:00 2024-09-14T10:52:30.318 INFO:teuthology.orchestra.run.smithi002.stdout:(3/286): ceph-immutable-object-cache-19.3.0-490 2.4 MB/s | 145 kB 00:00 2024-09-14T10:52:30.337 INFO:teuthology.orchestra.run.smithi086.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 606 kB/s | 25 kB 00:00 2024-09-14T10:52:30.896 INFO:teuthology.orchestra.run.smithi086.stdout:(10/286): ceph-common-19.3.0-4907.ga2782315.el9 12 MB/s | 22 MB 00:01 2024-09-14T10:52:30.946 INFO:teuthology.orchestra.run.smithi086.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 638 kB/s | 32 kB 00:00 2024-09-14T10:52:30.960 INFO:teuthology.orchestra.run.smithi002.stdout:(4/286): ceph-mds-19.3.0-4907.ga2782315.el9.x86 3.7 MB/s | 2.4 MB 00:00 2024-09-14T10:52:31.046 INFO:teuthology.orchestra.run.smithi086.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 7.4 MB/s | 756 kB 00:00 2024-09-14T10:52:31.146 INFO:teuthology.orchestra.run.smithi086.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 1.6 MB/s | 161 kB 00:00 2024-09-14T10:52:31.222 INFO:teuthology.orchestra.run.smithi086.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.7 MB/s | 127 kB 00:00 2024-09-14T10:52:31.310 INFO:teuthology.orchestra.run.smithi002.stdout:(5/286): ceph-base-19.3.0-4907.ga2782315.el9.x8 3.3 MB/s | 5.5 MB 00:01 2024-09-14T10:52:31.313 INFO:teuthology.orchestra.run.smithi086.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 5.4 MB/s | 508 kB 00:00 2024-09-14T10:52:31.497 INFO:teuthology.orchestra.run.smithi086.stdout:(16/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 9.9 MB/s | 17 MB 00:01 2024-09-14T10:52:31.535 INFO:teuthology.orchestra.run.smithi002.stdout:(6/286): ceph-mgr-19.3.0-4907.ga2782315.el9.x86 2.7 MB/s | 1.5 MB 00:00 2024-09-14T10:52:31.547 INFO:teuthology.orchestra.run.smithi086.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 907 kB/s | 45 kB 00:00 2024-09-14T10:52:31.690 INFO:teuthology.orchestra.run.smithi086.stdout:(18/286): librgw2-19.3.0-4907.ga2782315.el9.x86 15 MB/s | 5.5 MB 00:00 2024-09-14T10:52:31.714 INFO:teuthology.orchestra.run.smithi086.stdout:(19/286): python3-ceph-common-19.3.0-4907.ga278 858 kB/s | 143 kB 00:00 2024-09-14T10:52:31.773 INFO:teuthology.orchestra.run.smithi086.stdout:(20/286): python3-cephfs-19.3.0-4907.ga2782315. 1.9 MB/s | 161 kB 00:00 2024-09-14T10:52:31.798 INFO:teuthology.orchestra.run.smithi086.stdout:(21/286): python3-rados-19.3.0-4907.ga2782315.e 3.7 MB/s | 320 kB 00:00 2024-09-14T10:52:31.857 INFO:teuthology.orchestra.run.smithi086.stdout:(22/286): python3-rbd-19.3.0-4907.ga2782315.el9 3.6 MB/s | 305 kB 00:00 2024-09-14T10:52:31.877 INFO:teuthology.orchestra.run.smithi002.stdout:(7/286): ceph-mon-19.3.0-4907.ga2782315.el9.x86 8.5 MB/s | 4.8 MB 00:00 2024-09-14T10:52:31.882 INFO:teuthology.orchestra.run.smithi086.stdout:(23/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.2 MB/s | 99 kB 00:00 2024-09-14T10:52:31.933 INFO:teuthology.orchestra.run.smithi086.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 1.1 MB/s | 85 kB 00:00 2024-09-14T10:52:32.033 INFO:teuthology.orchestra.run.smithi086.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 1.7 MB/s | 171 kB 00:00 2024-09-14T10:52:32.133 INFO:teuthology.orchestra.run.smithi086.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 343 kB/s | 34 kB 00:00 2024-09-14T10:52:32.250 INFO:teuthology.orchestra.run.smithi086.stdout:(27/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 1.3 MB/s | 154 kB 00:00 2024-09-14T10:52:32.553 INFO:teuthology.orchestra.run.smithi002.stdout:(8/286): ceph-common-19.3.0-4907.ga2782315.el9. 7.4 MB/s | 22 MB 00:02 2024-09-14T10:52:32.620 INFO:teuthology.orchestra.run.smithi002.stdout:(9/286): ceph-selinux-19.3.0-4907.ga2782315.el9 379 kB/s | 25 kB 00:00 2024-09-14T10:52:32.759 INFO:teuthology.orchestra.run.smithi086.stdout:(28/286): ceph-test-19.3.0-4907.ga2782315.el9.x 21 MB/s | 50 MB 00:02 2024-09-14T10:52:32.818 INFO:teuthology.orchestra.run.smithi086.stdout:(29/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 3.4 MB/s | 3.2 MB 00:00 2024-09-14T10:52:32.993 INFO:teuthology.orchestra.run.smithi086.stdout:(30/286): ceph-mgr-modules-core-19.3.0-4907.ga2 1.6 MB/s | 291 kB 00:00 2024-09-14T10:52:33.093 INFO:teuthology.orchestra.run.smithi086.stdout:(31/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 493 kB/s | 49 kB 00:00 2024-09-14T10:52:33.185 INFO:teuthology.orchestra.run.smithi086.stdout:(32/286): ceph-prometheus-alerts-19.3.0-4907.ga 180 kB/s | 16 kB 00:00 2024-09-14T10:52:33.294 INFO:teuthology.orchestra.run.smithi086.stdout:(33/286): ceph-volume-19.3.0-4907.ga2782315.el9 2.6 MB/s | 285 kB 00:00 2024-09-14T10:52:33.545 INFO:teuthology.orchestra.run.smithi002.stdout:(10/286): ceph-radosgw-19.3.0-4907.ga2782315.el 6.6 MB/s | 11 MB 00:01 2024-09-14T10:52:33.586 INFO:teuthology.orchestra.run.smithi086.stdout:(34/286): ceph-mgr-diskprediction-local-19.3.0- 8.9 MB/s | 7.4 MB 00:00 2024-09-14T10:52:33.603 INFO:teuthology.orchestra.run.smithi002.stdout:(11/286): libcephfs-devel-19.3.0-4907.ga2782315 548 kB/s | 32 kB 00:00 2024-09-14T10:52:33.611 INFO:teuthology.orchestra.run.smithi086.stdout:(35/286): cephadm-19.3.0-4907.ga2782315.el9.noa 2.4 MB/s | 784 kB 00:00 2024-09-14T10:52:33.711 INFO:teuthology.orchestra.run.smithi086.stdout:(36/286): bluez-libs-5.56-6.el9.x86_64.rpm 849 kB/s | 85 kB 00:00 2024-09-14T10:52:33.728 INFO:teuthology.orchestra.run.smithi002.stdout:(12/286): libcephfs2-19.3.0-4907.ga2782315.el9. 5.9 MB/s | 756 kB 00:00 2024-09-14T10:52:33.761 INFO:teuthology.orchestra.run.smithi086.stdout:(37/286): ModemManager-glib-1.20.2-1.el9.x86_64 1.9 MB/s | 335 kB 00:00 2024-09-14T10:52:33.787 INFO:teuthology.orchestra.run.smithi086.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 656 kB/s | 49 kB 00:00 2024-09-14T10:52:33.804 INFO:teuthology.orchestra.run.smithi002.stdout:(13/286): libcephsqlite-19.3.0-4907.ga2782315.e 2.1 MB/s | 161 kB 00:00 2024-09-14T10:52:33.820 INFO:teuthology.orchestra.run.smithi086.stdout:(39/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 4.4 MB/s | 262 kB 00:00 2024-09-14T10:52:33.846 INFO:teuthology.orchestra.run.smithi086.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.3 MB/s | 80 kB 00:00 2024-09-14T10:52:33.871 INFO:teuthology.orchestra.run.smithi002.stdout:(14/286): librados-devel-19.3.0-4907.ga2782315. 1.9 MB/s | 127 kB 00:00 2024-09-14T10:52:33.887 INFO:teuthology.orchestra.run.smithi086.stdout:(41/286): libgfortran-11.5.0-2.el9.x86_64.rpm 12 MB/s | 801 kB 00:00 2024-09-14T10:52:33.913 INFO:teuthology.orchestra.run.smithi086.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 403 kB/s | 27 kB 00:00 2024-09-14T10:52:33.938 INFO:teuthology.orchestra.run.smithi086.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T10:52:33.963 INFO:teuthology.orchestra.run.smithi086.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-14T10:52:33.989 INFO:teuthology.orchestra.run.smithi086.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-14T10:52:33.996 INFO:teuthology.orchestra.run.smithi002.stdout:(15/286): libradosstriper1-19.3.0-4907.ga278231 4.0 MB/s | 508 kB 00:00 2024-09-14T10:52:34.039 INFO:teuthology.orchestra.run.smithi086.stdout:(46/286): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-14T10:52:34.081 INFO:teuthology.orchestra.run.smithi086.stdout:(47/286): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.2 MB 00:00 2024-09-14T10:52:34.106 INFO:teuthology.orchestra.run.smithi086.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-14T10:52:34.132 INFO:teuthology.orchestra.run.smithi086.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-14T10:52:34.157 INFO:teuthology.orchestra.run.smithi086.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-14T10:52:34.191 INFO:teuthology.orchestra.run.smithi086.stdout:(51/286): adwaita-cursor-theme-40.1.1-3.el9.noa 11 MB/s | 650 kB 00:00 2024-09-14T10:52:34.241 INFO:teuthology.orchestra.run.smithi086.stdout:(52/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 10 MB/s | 523 kB 00:00 2024-09-14T10:52:34.271 INFO:teuthology.orchestra.run.smithi002.stdout:(16/286): ceph-osd-19.3.0-4907.ga2782315.el9.x8 6.3 MB/s | 17 MB 00:02 2024-09-14T10:52:34.283 INFO:teuthology.orchestra.run.smithi086.stdout:(53/286): apache-commons-cli-1.4-17.el9.noarch. 1.7 MB/s | 71 kB 00:00 2024-09-14T10:52:34.333 INFO:teuthology.orchestra.run.smithi086.stdout:(54/286): apache-commons-codec-1.15-7.el9.noarc 5.9 MB/s | 302 kB 00:00 2024-09-14T10:52:34.346 INFO:teuthology.orchestra.run.smithi002.stdout:(17/286): python3-ceph-argparse-19.3.0-4907.ga2 603 kB/s | 45 kB 00:00 2024-09-14T10:52:34.430 INFO:teuthology.orchestra.run.smithi002.stdout:(18/286): python3-ceph-common-19.3.0-4907.ga278 1.7 MB/s | 143 kB 00:00 2024-09-14T10:52:34.467 INFO:teuthology.orchestra.run.smithi086.stdout:(55/286): adwaita-icon-theme-40.1.1-3.el9.noarc 38 MB/s | 12 MB 00:00 2024-09-14T10:52:34.492 INFO:teuthology.orchestra.run.smithi086.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 1.7 MB/s | 283 kB 00:00 2024-09-14T10:52:34.505 INFO:teuthology.orchestra.run.smithi002.stdout:(19/286): python3-cephfs-19.3.0-4907.ga2782315. 2.1 MB/s | 161 kB 00:00 2024-09-14T10:52:34.534 INFO:teuthology.orchestra.run.smithi086.stdout:(57/286): apache-commons-lang3-3.12.0-6.el9.noa 8.2 MB/s | 559 kB 00:00 2024-09-14T10:52:34.559 INFO:teuthology.orchestra.run.smithi086.stdout:(58/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-14T10:52:34.580 INFO:teuthology.orchestra.run.smithi002.stdout:(20/286): python3-rados-19.3.0-4907.ga2782315.e 4.2 MB/s | 320 kB 00:00 2024-09-14T10:52:34.584 INFO:teuthology.orchestra.run.smithi086.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.8 MB/s | 195 kB 00:00 2024-09-14T10:52:34.610 INFO:teuthology.orchestra.run.smithi086.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 464 kB/s | 23 kB 00:00 2024-09-14T10:52:34.656 INFO:teuthology.orchestra.run.smithi002.stdout:(21/286): python3-rbd-19.3.0-4907.ga2782315.el9 4.0 MB/s | 305 kB 00:00 2024-09-14T10:52:34.723 INFO:teuthology.orchestra.run.smithi002.stdout:(22/286): python3-rgw-19.3.0-4907.ga2782315.el9 1.5 MB/s | 99 kB 00:00 2024-09-14T10:52:34.752 INFO:teuthology.orchestra.run.smithi086.stdout:(61/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 5.7 MB/s | 14 MB 00:02 2024-09-14T10:52:34.777 INFO:teuthology.orchestra.run.smithi086.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 89 kB/s | 15 kB 00:00 2024-09-14T10:52:34.802 INFO:teuthology.orchestra.run.smithi086.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-14T10:52:34.828 INFO:teuthology.orchestra.run.smithi086.stdout:(64/286): atk-2.36.0-5.el9.x86_64.rpm 1.2 MB/s | 292 kB 00:00 2024-09-14T10:52:34.831 INFO:teuthology.orchestra.run.smithi002.stdout:(23/286): librgw2-19.3.0-4907.ga2782315.el9.x86 6.6 MB/s | 5.5 MB 00:00 2024-09-14T10:52:34.853 INFO:teuthology.orchestra.run.smithi086.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2024-09-14T10:52:34.856 INFO:teuthology.orchestra.run.smithi002.stdout:(24/286): rbd-fuse-19.3.0-4907.ga2782315.el9.x8 638 kB/s | 85 kB 00:00 2024-09-14T10:52:34.878 INFO:teuthology.orchestra.run.smithi086.stdout:(66/286): cdi-api-2.0.2-6.el9.noarch.rpm 531 kB/s | 53 kB 00:00 2024-09-14T10:52:34.903 INFO:teuthology.orchestra.run.smithi086.stdout:(67/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 810 kB/s | 61 kB 00:00 2024-09-14T10:52:34.923 INFO:teuthology.orchestra.run.smithi002.stdout:(25/286): rbd-nbd-19.3.0-4907.ga2782315.el9.x86 2.5 MB/s | 171 kB 00:00 2024-09-14T10:52:34.928 INFO:teuthology.orchestra.run.smithi086.stdout:(68/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 374 kB/s | 28 kB 00:00 2024-09-14T10:52:34.954 INFO:teuthology.orchestra.run.smithi086.stdout:(69/286): dconf-0.40.0-6.el9.x86_64.rpm 1.5 MB/s | 113 kB 00:00 2024-09-14T10:52:34.987 INFO:teuthology.orchestra.run.smithi086.stdout:(70/286): exempi-2.6.0-0.2.20211007gite23c213.e 6.1 MB/s | 525 kB 00:00 2024-09-14T10:52:34.990 INFO:teuthology.orchestra.run.smithi002.stdout:(26/286): ceph-grafana-dashboards-19.3.0-4907.g 513 kB/s | 34 kB 00:00 2024-09-14T10:52:35.030 INFO:teuthology.orchestra.run.smithi086.stdout:(71/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 10 MB/s | 781 kB 00:00 2024-09-14T10:52:35.055 INFO:teuthology.orchestra.run.smithi086.stdout:(72/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 4.8 MB/s | 325 kB 00:00 2024-09-14T10:52:35.065 INFO:teuthology.orchestra.run.smithi002.stdout:(27/286): ceph-mgr-cephadm-19.3.0-4907.ga278231 2.0 MB/s | 154 kB 00:00 2024-09-14T10:52:35.080 INFO:teuthology.orchestra.run.smithi086.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 4.3 MB/s | 218 kB 00:00 2024-09-14T10:52:35.122 INFO:teuthology.orchestra.run.smithi086.stdout:(74/286): exiv2-0.27.5-2.el9.x86_64.rpm 5.0 MB/s | 980 kB 00:00 2024-09-14T10:52:35.147 INFO:teuthology.orchestra.run.smithi086.stdout:(75/286): flatpak-selinux-1.12.9-1.el9.noarch.r 323 kB/s | 22 kB 00:00 2024-09-14T10:52:35.172 INFO:teuthology.orchestra.run.smithi086.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 1.4 MB/s | 73 kB 00:00 2024-09-14T10:52:35.198 INFO:teuthology.orchestra.run.smithi086.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 653 kB/s | 33 kB 00:00 2024-09-14T10:52:35.248 INFO:teuthology.orchestra.run.smithi086.stdout:(78/286): flatpak-1.12.9-1.el9.x86_64.rpm 8.9 MB/s | 1.7 MB 00:00 2024-09-14T10:52:35.249 INFO:teuthology.orchestra.run.smithi002.stdout:(28/286): rbd-mirror-19.3.0-4907.ga2782315.el9. 7.6 MB/s | 3.2 MB 00:00 2024-09-14T10:52:35.273 INFO:teuthology.orchestra.run.smithi086.stdout:(79/286): flexiblas-openblas-openmp-3.0.4-8.el9 242 kB/s | 18 kB 00:00 2024-09-14T10:52:35.299 INFO:teuthology.orchestra.run.smithi086.stdout:(80/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.7 MB/s | 89 kB 00:00 2024-09-14T10:52:35.342 INFO:teuthology.orchestra.run.smithi086.stdout:(81/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.8 MB/s | 124 kB 00:00 2024-09-14T10:52:35.366 INFO:teuthology.orchestra.run.smithi086.stdout:(82/286): giflib-5.2.1-9.el9.x86_64.rpm 726 kB/s | 49 kB 00:00 2024-09-14T10:52:35.391 INFO:teuthology.orchestra.run.smithi086.stdout:(83/286): google-guice-4.2.3-9.el9.noarch.rpm 9.6 MB/s | 473 kB 00:00 2024-09-14T10:52:35.416 INFO:teuthology.orchestra.run.smithi086.stdout:(84/286): graphene-1.10.6-2.el9.x86_64.rpm 1.3 MB/s | 64 kB 00:00 2024-09-14T10:52:35.442 INFO:teuthology.orchestra.run.smithi086.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 679 kB/s | 34 kB 00:00 2024-09-14T10:52:35.509 INFO:teuthology.orchestra.run.smithi086.stdout:(86/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.9 MB/s | 3.0 MB 00:00 2024-09-14T10:52:35.542 INFO:teuthology.orchestra.run.smithi086.stdout:(87/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-14T10:52:35.576 INFO:teuthology.orchestra.run.smithi086.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 494 kB/s | 33 kB 00:00 2024-09-14T10:52:35.643 INFO:teuthology.orchestra.run.smithi086.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 11 MB/s | 2.2 MB 00:00 2024-09-14T10:52:35.693 INFO:teuthology.orchestra.run.smithi086.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 20 MB/s | 2.3 MB 00:00 2024-09-14T10:52:35.718 INFO:teuthology.orchestra.run.smithi086.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 2.8 MB/s | 219 kB 00:00 2024-09-14T10:52:35.786 INFO:teuthology.orchestra.run.smithi086.stdout:(92/286): gtk3-3.24.31-5.el9.x86_64.rpm 20 MB/s | 4.9 MB 00:00 2024-09-14T10:52:35.811 INFO:teuthology.orchestra.run.smithi086.stdout:(93/286): httpcomponents-client-4.5.13-3.el9.no 5.5 MB/s | 657 kB 00:00 2024-09-14T10:52:35.845 INFO:teuthology.orchestra.run.smithi086.stdout:(94/286): httpcomponents-core-4.4.13-7.el9.noar 4.9 MB/s | 632 kB 00:00 2024-09-14T10:52:35.870 INFO:teuthology.orchestra.run.smithi086.stdout:(95/286): jakarta-annotations-1.3.5-13.el9.noar 772 kB/s | 45 kB 00:00 2024-09-14T10:52:35.895 INFO:teuthology.orchestra.run.smithi086.stdout:(96/286): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-14T10:52:35.920 INFO:teuthology.orchestra.run.smithi086.stdout:(97/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 8.0 MB/s | 413 kB 00:00 2024-09-14T10:52:35.987 INFO:teuthology.orchestra.run.smithi086.stdout:(98/286): iso-codes-4.6.0-3.el9.noarch.rpm 18 MB/s | 3.5 MB 00:00 2024-09-14T10:52:36.046 INFO:teuthology.orchestra.run.smithi086.stdout:(99/286): java-11-openjdk-devel-11.0.20.1.1-2.e 22 MB/s | 3.3 MB 00:00 2024-09-14T10:52:36.071 INFO:teuthology.orchestra.run.smithi086.stdout:(100/286): javapackages-filesystem-6.0.0-4.el9. 156 kB/s | 13 kB 00:00 2024-09-14T10:52:36.096 INFO:teuthology.orchestra.run.smithi086.stdout:(101/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 1.0 MB/s | 53 kB 00:00 2024-09-14T10:52:36.121 INFO:teuthology.orchestra.run.smithi086.stdout:(102/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 478 kB/s | 24 kB 00:00 2024-09-14T10:52:36.147 INFO:teuthology.orchestra.run.smithi086.stdout:(103/286): jsoup-1.13.1-10.el9.noarch.rpm 7.3 MB/s | 377 kB 00:00 2024-09-14T10:52:36.172 INFO:teuthology.orchestra.run.smithi086.stdout:(104/286): jsr-305-3.0.2-6.el9.noarch.rpm 709 kB/s | 35 kB 00:00 2024-09-14T10:52:36.197 INFO:teuthology.orchestra.run.smithi086.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 3.3 MB/s | 168 kB 00:00 2024-09-14T10:52:36.199 INFO:teuthology.orchestra.run.smithi002.stdout:(29/286): ceph-mgr-diskprediction-local-19.3.0- 7.8 MB/s | 7.4 MB 00:00 2024-09-14T10:52:36.223 INFO:teuthology.orchestra.run.smithi086.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 221 kB/s | 11 kB 00:00 2024-09-14T10:52:36.248 INFO:teuthology.orchestra.run.smithi086.stdout:(107/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 481 kB/s | 24 kB 00:00 2024-09-14T10:52:36.273 INFO:teuthology.orchestra.run.smithi086.stdout:(108/286): libXcursor-1.2.0-7.el9.x86_64.rpm 612 kB/s | 31 kB 00:00 2024-09-14T10:52:36.299 INFO:teuthology.orchestra.run.smithi086.stdout:(109/286): libXdamage-1.1.5-7.el9.x86_64.rpm 455 kB/s | 23 kB 00:00 2024-09-14T10:52:36.324 INFO:teuthology.orchestra.run.smithi086.stdout:(110/286): libXfixes-5.0.3-16.el9.x86_64.rpm 394 kB/s | 20 kB 00:00 2024-09-14T10:52:36.349 INFO:teuthology.orchestra.run.smithi086.stdout:(111/286): libXi-1.7.10-8.el9.x86_64.rpm 792 kB/s | 40 kB 00:00 2024-09-14T10:52:36.374 INFO:teuthology.orchestra.run.smithi086.stdout:(112/286): libXinerama-1.1.4-10.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-14T10:52:36.399 INFO:teuthology.orchestra.run.smithi086.stdout:(113/286): libXrandr-1.5.2-8.el9.x86_64.rpm 567 kB/s | 28 kB 00:00 2024-09-14T10:52:36.425 INFO:teuthology.orchestra.run.smithi086.stdout:(114/286): libXtst-1.2.3-16.el9.x86_64.rpm 429 kB/s | 21 kB 00:00 2024-09-14T10:52:36.450 INFO:teuthology.orchestra.run.smithi086.stdout:(115/286): libXv-1.0.11-16.el9.x86_64.rpm 381 kB/s | 19 kB 00:00 2024-09-14T10:52:36.475 INFO:teuthology.orchestra.run.smithi086.stdout:(116/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-09-14T10:52:36.501 INFO:teuthology.orchestra.run.smithi086.stdout:(117/286): libasyncns-0.8-22.el9.x86_64.rpm 605 kB/s | 30 kB 00:00 2024-09-14T10:52:36.526 INFO:teuthology.orchestra.run.smithi086.stdout:(118/286): libcanberra-0.30-27.el9.x86_64.rpm 1.7 MB/s | 86 kB 00:00 2024-09-14T10:52:36.551 INFO:teuthology.orchestra.run.smithi086.stdout:(119/286): libcanberra-gtk3-0.30-27.el9.x86_64. 631 kB/s | 32 kB 00:00 2024-09-14T10:52:36.577 INFO:teuthology.orchestra.run.smithi086.stdout:(120/286): libdrm-2.4.121-1.el9.x86_64.rpm 3.1 MB/s | 161 kB 00:00 2024-09-14T10:52:36.602 INFO:teuthology.orchestra.run.smithi086.stdout:(121/286): libepoxy-1.5.5-4.el9.x86_64.rpm 4.7 MB/s | 241 kB 00:00 2024-09-14T10:52:36.627 INFO:teuthology.orchestra.run.smithi086.stdout:(122/286): libexif-0.6.22-6.el9.x86_64.rpm 8.5 MB/s | 435 kB 00:00 2024-09-14T10:52:36.653 INFO:teuthology.orchestra.run.smithi086.stdout:(123/286): libfontenc-1.1.3-17.el9.x86_64.rpm 617 kB/s | 31 kB 00:00 2024-09-14T10:52:36.666 INFO:teuthology.orchestra.run.smithi002.stdout:(30/286): ceph-test-19.3.0-4907.ga2782315.el9.x 12 MB/s | 50 MB 00:04 2024-09-14T10:52:36.678 INFO:teuthology.orchestra.run.smithi086.stdout:(124/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2024-09-14T10:52:36.691 INFO:teuthology.orchestra.run.smithi002.stdout:(31/286): ceph-mgr-modules-core-19.3.0-4907.ga2 591 kB/s | 291 kB 00:00 2024-09-14T10:52:36.703 INFO:teuthology.orchestra.run.smithi086.stdout:(125/286): libglvnd-1.3.4-1.el9.x86_64.rpm 2.6 MB/s | 135 kB 00:00 2024-09-14T10:52:36.725 INFO:teuthology.orchestra.run.smithi002.stdout:(32/286): ceph-mgr-rook-19.3.0-4907.ga2782315.e 847 kB/s | 49 kB 00:00 2024-09-14T10:52:36.728 INFO:teuthology.orchestra.run.smithi086.stdout:(126/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 733 kB/s | 37 kB 00:00 2024-09-14T10:52:36.753 INFO:teuthology.orchestra.run.smithi002.stdout:(33/286): ceph-prometheus-alerts-19.3.0-4907.ga 271 kB/s | 16 kB 00:00 2024-09-14T10:52:36.754 INFO:teuthology.orchestra.run.smithi086.stdout:(127/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 2.8 MB/s | 142 kB 00:00 2024-09-14T10:52:36.778 INFO:teuthology.orchestra.run.smithi002.stdout:(34/286): ceph-volume-19.3.0-4907.ga2782315.el9 5.3 MB/s | 285 kB 00:00 2024-09-14T10:52:36.779 INFO:teuthology.orchestra.run.smithi086.stdout:(128/286): libgsf-1.14.47-5.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-09-14T10:52:36.804 INFO:teuthology.orchestra.run.smithi086.stdout:(129/286): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-14T10:52:36.829 INFO:teuthology.orchestra.run.smithi086.stdout:(130/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-14T10:52:36.855 INFO:teuthology.orchestra.run.smithi086.stdout:(131/286): libldac-2.0.2.3-10.el9.x86_64.rpm 824 kB/s | 41 kB 00:00 2024-09-14T10:52:36.880 INFO:teuthology.orchestra.run.smithi086.stdout:(132/286): libnbd-1.20.2-2.el9.x86_64.rpm 3.3 MB/s | 171 kB 00:00 2024-09-14T10:52:36.905 INFO:teuthology.orchestra.run.smithi086.stdout:(133/286): libnotify-0.7.9-8.el9.x86_64.rpm 866 kB/s | 44 kB 00:00 2024-09-14T10:52:36.931 INFO:teuthology.orchestra.run.smithi086.stdout:(134/286): libogg-1.3.4-6.el9.x86_64.rpm 669 kB/s | 34 kB 00:00 2024-09-14T10:52:36.936 INFO:teuthology.orchestra.run.smithi002.stdout:(35/286): ceph-mgr-dashboard-19.3.0-4907.ga2782 7.6 MB/s | 14 MB 00:01 2024-09-14T10:52:36.964 INFO:teuthology.orchestra.run.smithi086.stdout:(135/286): libosinfo-1.10.0-1.el9.x86_64.rpm 5.3 MB/s | 319 kB 00:00 2024-09-14T10:52:36.978 INFO:teuthology.orchestra.run.smithi002.stdout:(36/286): cephadm-19.3.0-4907.ga2782315.el9.noa 3.4 MB/s | 784 kB 00:00 2024-09-14T10:52:36.990 INFO:teuthology.orchestra.run.smithi086.stdout:(136/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-14T10:52:37.015 INFO:teuthology.orchestra.run.smithi086.stdout:(137/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-09-14T10:52:37.048 INFO:teuthology.orchestra.run.smithi086.stdout:(138/286): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-09-14T10:52:37.071 INFO:teuthology.orchestra.run.smithi002.stdout:(37/286): bluez-libs-5.56-6.el9.x86_64.rpm 635 kB/s | 85 kB 00:00 2024-09-14T10:52:37.073 INFO:teuthology.orchestra.run.smithi086.stdout:(139/286): libsbc-1.4-9.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-09-14T10:52:37.095 INFO:teuthology.orchestra.run.smithi002.stdout:(38/286): bubblewrap-0.4.1-7.el9.x86_64.rpm 423 kB/s | 49 kB 00:00 2024-09-14T10:52:37.099 INFO:teuthology.orchestra.run.smithi086.stdout:(140/286): libsndfile-1.0.31-8.el9.x86_64.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T10:52:37.121 INFO:teuthology.orchestra.run.smithi002.stdout:(39/286): ModemManager-glib-1.20.2-1.el9.x86_64 979 kB/s | 335 kB 00:00 2024-09-14T10:52:37.124 INFO:teuthology.orchestra.run.smithi086.stdout:(141/286): libtheora-1.1.1-31.el9.x86_64.rpm 3.2 MB/s | 164 kB 00:00 2024-09-14T10:52:37.146 INFO:teuthology.orchestra.run.smithi002.stdout:(40/286): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-14T10:52:37.156 INFO:teuthology.orchestra.run.smithi086.stdout:(142/286): libtiff-4.4.0-13.el9.x86_64.rpm 3.4 MB/s | 198 kB 00:00 2024-09-14T10:52:37.171 INFO:teuthology.orchestra.run.smithi002.stdout:(41/286): cups-libs-2.3.3op2-30.el9.x86_64.rpm 3.4 MB/s | 262 kB 00:00 2024-09-14T10:52:37.182 INFO:teuthology.orchestra.run.smithi086.stdout:(143/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 625 kB/s | 36 kB 00:00 2024-09-14T10:52:37.196 INFO:teuthology.orchestra.run.smithi002.stdout:(42/286): libpciaccess-0.16-7.el9.x86_64.rpm 539 kB/s | 27 kB 00:00 2024-09-14T10:52:37.207 INFO:teuthology.orchestra.run.smithi086.stdout:(144/286): libtracker-sparql-3.1.2-3.el9.x86_64 6.3 MB/s | 324 kB 00:00 2024-09-14T10:52:37.222 INFO:teuthology.orchestra.run.smithi002.stdout:(43/286): libquadmath-11.5.0-2.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-14T10:52:37.232 INFO:teuthology.orchestra.run.smithi086.stdout:(145/286): libvisual-0.4.0-34.el9.x86_64.rpm 2.8 MB/s | 144 kB 00:00 2024-09-14T10:52:37.247 INFO:teuthology.orchestra.run.smithi002.stdout:(44/286): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.8 MB/s | 94 kB 00:00 2024-09-14T10:52:37.258 INFO:teuthology.orchestra.run.smithi086.stdout:(146/286): libvorbis-1.3.7-5.el9.x86_64.rpm 3.8 MB/s | 193 kB 00:00 2024-09-14T10:52:37.272 INFO:teuthology.orchestra.run.smithi002.stdout:(45/286): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-09-14T10:52:37.283 INFO:teuthology.orchestra.run.smithi086.stdout:(147/286): libwayland-client-1.21.0-1.el9.x86_6 665 kB/s | 33 kB 00:00 2024-09-14T10:52:37.297 INFO:teuthology.orchestra.run.smithi002.stdout:(46/286): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-14T10:52:37.308 INFO:teuthology.orchestra.run.smithi086.stdout:(148/286): libwayland-cursor-1.21.0-1.el9.x86_6 387 kB/s | 19 kB 00:00 2024-09-14T10:52:37.323 INFO:teuthology.orchestra.run.smithi002.stdout:(47/286): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-14T10:52:37.333 INFO:teuthology.orchestra.run.smithi086.stdout:(149/286): libwayland-egl-1.21.0-1.el9.x86_64.r 256 kB/s | 13 kB 00:00 2024-09-14T10:52:37.348 INFO:teuthology.orchestra.run.smithi002.stdout:(48/286): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-14T10:52:37.358 INFO:teuthology.orchestra.run.smithi086.stdout:(150/286): libwayland-server-1.21.0-1.el9.x86_6 837 kB/s | 42 kB 00:00 2024-09-14T10:52:37.365 INFO:teuthology.orchestra.run.smithi002.stdout:(49/286): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-14T10:52:37.384 INFO:teuthology.orchestra.run.smithi086.stdout:(151/286): libwebp-1.2.0-8.el9.x86_64.rpm 5.4 MB/s | 277 kB 00:00 2024-09-14T10:52:37.390 INFO:teuthology.orchestra.run.smithi002.stdout:(50/286): python3-urllib3-1.26.5-6.el9.noarch.r 5.0 MB/s | 215 kB 00:00 2024-09-14T10:52:37.409 INFO:teuthology.orchestra.run.smithi086.stdout:(152/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 2.6 MB/s | 133 kB 00:00 2024-09-14T10:52:37.434 INFO:teuthology.orchestra.run.smithi086.stdout:(153/286): libxshmfence-1.3-10.el9.x86_64.rpm 251 kB/s | 13 kB 00:00 2024-09-14T10:52:37.440 INFO:teuthology.orchestra.run.smithi002.stdout:(51/286): python3-cryptography-36.0.1-4.el9.x86 6.3 MB/s | 1.2 MB 00:00 2024-09-14T10:52:37.460 INFO:teuthology.orchestra.run.smithi086.stdout:(154/286): low-memory-monitor-2.1-4.el9.x86_64. 718 kB/s | 36 kB 00:00 2024-09-14T10:52:37.493 INFO:teuthology.orchestra.run.smithi086.stdout:(155/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-14T10:52:37.519 INFO:teuthology.orchestra.run.smithi086.stdout:(156/286): lua-5.4.4-4.el9.x86_64.rpm 3.1 MB/s | 188 kB 00:00 2024-09-14T10:52:37.544 INFO:teuthology.orchestra.run.smithi086.stdout:(157/286): lua-posix-35.0-8.el9.x86_64.rpm 2.9 MB/s | 151 kB 00:00 2024-09-14T10:52:37.570 INFO:teuthology.orchestra.run.smithi086.stdout:(158/286): maven-3.6.3-15.el9.noarch.rpm 351 kB/s | 18 kB 00:00 2024-09-14T10:52:37.620 INFO:teuthology.orchestra.run.smithi086.stdout:(159/286): maven-lib-3.6.3-15.el9.noarch.rpm 20 MB/s | 1.5 MB 00:00 2024-09-14T10:52:37.645 INFO:teuthology.orchestra.run.smithi086.stdout:(160/286): maven-openjdk11-3.6.3-15.el9.noarch. 120 kB/s | 9.0 kB 00:00 2024-09-14T10:52:37.670 INFO:teuthology.orchestra.run.smithi086.stdout:(161/286): maven-resolver-1.6.1-10.el9.noarch.r 10 MB/s | 517 kB 00:00 2024-09-14T10:52:37.696 INFO:teuthology.orchestra.run.smithi086.stdout:(162/286): maven-shared-utils-3.3.4-3.el9.noarc 2.9 MB/s | 151 kB 00:00 2024-09-14T10:52:37.721 INFO:teuthology.orchestra.run.smithi086.stdout:(163/286): maven-wagon-3.4.2-7.el9.noarch.rpm 2.2 MB/s | 112 kB 00:00 2024-09-14T10:52:37.763 INFO:teuthology.orchestra.run.smithi086.stdout:(164/286): mesa-filesystem-24.1.2-3.el9.x86_64. 270 kB/s | 11 kB 00:00 2024-09-14T10:52:37.822 INFO:teuthology.orchestra.run.smithi086.stdout:(165/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.3 MB/s | 139 kB 00:00 2024-09-14T10:52:37.872 INFO:teuthology.orchestra.run.smithi086.stdout:(166/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 3.4 MB/s | 171 kB 00:00 2024-09-14T10:52:37.922 INFO:teuthology.orchestra.run.smithi086.stdout:(167/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 726 kB/s | 36 kB 00:00 2024-09-14T10:52:38.023 INFO:teuthology.orchestra.run.smithi086.stdout:(168/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 27 MB/s | 8.8 MB 00:00 2024-09-14T10:52:38.047 INFO:teuthology.orchestra.run.smithi086.stdout:(169/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 366 kB/s | 46 kB 00:00 2024-09-14T10:52:38.073 INFO:teuthology.orchestra.run.smithi086.stdout:(170/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 646 kB/s | 32 kB 00:00 2024-09-14T10:52:38.098 INFO:teuthology.orchestra.run.smithi086.stdout:(171/286): openblas-0.3.26-2.el9.x86_64.rpm 766 kB/s | 38 kB 00:00 2024-09-14T10:52:38.157 INFO:teuthology.orchestra.run.smithi086.stdout:(172/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 2.7 MB/s | 163 kB 00:00 2024-09-14T10:52:38.233 INFO:teuthology.orchestra.run.smithi002.stdout:(52/286): alsa-lib-1.2.12-1.el9.x86_64.rpm 661 kB/s | 523 kB 00:00 2024-09-14T10:52:38.240 INFO:teuthology.orchestra.run.smithi086.stdout:(173/286): openblas-openmp-0.3.26-2.el9.x86_64. 30 MB/s | 4.9 MB 00:00 2024-09-14T10:52:38.258 INFO:teuthology.orchestra.run.smithi002.stdout:(53/286): adwaita-cursor-theme-40.1.1-3.el9.noa 729 kB/s | 650 kB 00:00 2024-09-14T10:52:38.265 INFO:teuthology.orchestra.run.smithi086.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 1.8 MB/s | 200 kB 00:00 2024-09-14T10:52:38.291 INFO:teuthology.orchestra.run.smithi086.stdout:(175/286): orc-0.4.31-8.el9.x86_64.rpm 3.6 MB/s | 183 kB 00:00 2024-09-14T10:52:38.316 INFO:teuthology.orchestra.run.smithi086.stdout:(176/286): osinfo-db-20240701-2.el9.noarch.rpm 10 MB/s | 531 kB 00:00 2024-09-14T10:52:38.341 INFO:teuthology.orchestra.run.smithi002.stdout:(54/286): apache-commons-cli-1.4-17.el9.noarch. 653 kB/s | 71 kB 00:00 2024-09-14T10:52:38.342 INFO:teuthology.orchestra.run.smithi086.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.4 MB/s | 74 kB 00:00 2024-09-14T10:52:38.375 INFO:teuthology.orchestra.run.smithi002.stdout:(55/286): apache-commons-codec-1.15-7.el9.noarc 2.5 MB/s | 302 kB 00:00 2024-09-14T10:52:38.375 INFO:teuthology.orchestra.run.smithi086.stdout:(178/286): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-14T10:52:38.400 INFO:teuthology.orchestra.run.smithi086.stdout:(179/286): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-14T10:52:38.425 INFO:teuthology.orchestra.run.smithi086.stdout:(180/286): pipewire-1.0.1-1.el9.x86_64.rpm 2.1 MB/s | 107 kB 00:00 2024-09-14T10:52:38.451 INFO:teuthology.orchestra.run.smithi086.stdout:(181/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 1.1 MB/s | 57 kB 00:00 2024-09-14T10:52:38.458 INFO:teuthology.orchestra.run.smithi002.stdout:(56/286): apache-commons-io-2.8.0-8.el9.noarch. 2.4 MB/s | 283 kB 00:00 2024-09-14T10:52:38.476 INFO:teuthology.orchestra.run.smithi086.stdout:(182/286): pipewire-jack-audio-connection-kit-1 181 kB/s | 9.1 kB 00:00 2024-09-14T10:52:38.501 INFO:teuthology.orchestra.run.smithi086.stdout:(183/286): pipewire-jack-audio-connection-kit-l 2.6 MB/s | 135 kB 00:00 2024-09-14T10:52:38.552 INFO:teuthology.orchestra.run.smithi086.stdout:(184/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-09-14T10:52:38.575 INFO:teuthology.orchestra.run.smithi002.stdout:(57/286): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 745 kB/s | 87 kB 00:00 2024-09-14T10:52:38.577 INFO:teuthology.orchestra.run.smithi086.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.5 MB/s | 192 kB 00:00 2024-09-14T10:52:38.600 INFO:teuthology.orchestra.run.smithi002.stdout:(58/286): apache-commons-lang3-3.12.0-6.el9.noa 2.4 MB/s | 559 kB 00:00 2024-09-14T10:52:38.603 INFO:teuthology.orchestra.run.smithi086.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 510 kB/s | 26 kB 00:00 2024-09-14T10:52:38.628 INFO:teuthology.orchestra.run.smithi086.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 1.2 MB/s | 60 kB 00:00 2024-09-14T10:52:38.653 INFO:teuthology.orchestra.run.smithi086.stdout:(188/286): plexus-containers-component-annotati 367 kB/s | 18 kB 00:00 2024-09-14T10:52:38.687 INFO:teuthology.orchestra.run.smithi086.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 1.3 MB/s | 80 kB 00:00 2024-09-14T10:52:38.701 INFO:teuthology.orchestra.run.smithi002.stdout:(59/286): at-spi2-core-2.40.3-1.el9.x86_64.rpm 1.5 MB/s | 195 kB 00:00 2024-09-14T10:52:38.712 INFO:teuthology.orchestra.run.smithi086.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 572 kB/s | 34 kB 00:00 2024-09-14T10:52:38.726 INFO:teuthology.orchestra.run.smithi002.stdout:(60/286): atinject-1.0.3-6.el9.noarch.rpm 185 kB/s | 23 kB 00:00 2024-09-14T10:52:38.762 INFO:teuthology.orchestra.run.smithi086.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 3.3 MB/s | 254 kB 00:00 2024-09-14T10:52:38.796 INFO:teuthology.orchestra.run.smithi086.stdout:(192/286): poppler-21.01.0-21.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-09-14T10:52:38.826 INFO:teuthology.orchestra.run.smithi002.stdout:(61/286): atk-2.36.0-5.el9.x86_64.rpm 2.3 MB/s | 292 kB 00:00 2024-09-14T10:52:38.851 INFO:teuthology.orchestra.run.smithi002.stdout:(62/286): avahi-glib-0.8-21.el9.x86_64.rpm 119 kB/s | 15 kB 00:00 2024-09-14T10:52:38.935 INFO:teuthology.orchestra.run.smithi002.stdout:(63/286): boost-program-options-1.75.0-8.el9.x8 985 kB/s | 107 kB 00:00 2024-09-14T10:52:38.985 INFO:teuthology.orchestra.run.smithi002.stdout:(64/286): cdi-api-2.0.2-6.el9.noarch.rpm 399 kB/s | 53 kB 00:00 2024-09-14T10:52:39.053 INFO:teuthology.orchestra.run.smithi002.stdout:(65/286): colord-libs-1.4.5-4.el9.x86_64.rpm 1.9 MB/s | 229 kB 00:00 2024-09-14T10:52:39.094 INFO:teuthology.orchestra.run.smithi002.stdout:(66/286): composefs-libs-1.0.5-1.el9.x86_64.rpm 561 kB/s | 61 kB 00:00 2024-09-14T10:52:39.162 INFO:teuthology.orchestra.run.smithi002.stdout:(67/286): copy-jdk-configs-4.0-3.el9.noarch.rpm 260 kB/s | 28 kB 00:00 2024-09-14T10:52:39.180 INFO:teuthology.orchestra.run.smithi086.stdout:(193/286): java-11-openjdk-headless-11.0.20.1.1 12 MB/s | 39 MB 00:03 2024-09-14T10:52:39.205 INFO:teuthology.orchestra.run.smithi086.stdout:(194/286): poppler-glib-21.01.0-21.el9.x86_64.r 372 kB/s | 152 kB 00:00 2024-09-14T10:52:39.247 INFO:teuthology.orchestra.run.smithi086.stdout:(195/286): poppler-data-0.4.9-9.el9.noarch.rpm 3.9 MB/s | 1.9 MB 00:00 2024-09-14T10:52:39.272 INFO:teuthology.orchestra.run.smithi086.stdout:(196/286): publicsuffix-list-20210518-3.el9.noa 1.2 MB/s | 83 kB 00:00 2024-09-14T10:52:39.320 INFO:teuthology.orchestra.run.smithi002.stdout:(68/286): dconf-0.40.0-6.el9.x86_64.rpm 499 kB/s | 113 kB 00:00 2024-09-14T10:52:39.331 INFO:teuthology.orchestra.run.smithi086.stdout:(197/286): protobuf-3.14.0-13.el9.x86_64.rpm 6.7 MB/s | 1.0 MB 00:00 2024-09-14T10:52:39.345 INFO:teuthology.orchestra.run.smithi002.stdout:(69/286): exempi-2.6.0-0.2.20211007gite23c213.e 2.8 MB/s | 525 kB 00:00 2024-09-14T10:52:39.373 INFO:teuthology.orchestra.run.smithi086.stdout:(198/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.3 MB/s | 679 kB 00:00 2024-09-14T10:52:39.398 INFO:teuthology.orchestra.run.smithi086.stdout:(199/286): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-14T10:52:39.423 INFO:teuthology.orchestra.run.smithi086.stdout:(200/286): python3-jinja2-2.11.3-6.el9.noarch.r 4.8 MB/s | 248 kB 00:00 2024-09-14T10:52:39.448 INFO:teuthology.orchestra.run.smithi086.stdout:(201/286): python3-jsonpatch-1.21-16.el9.noarch 511 kB/s | 26 kB 00:00 2024-09-14T10:52:39.471 INFO:teuthology.orchestra.run.smithi002.stdout:(70/286): exiv2-libs-0.27.5-2.el9.x86_64.rpm 6.1 MB/s | 781 kB 00:00 2024-09-14T10:52:39.473 INFO:teuthology.orchestra.run.smithi086.stdout:(202/286): python3-jsonpointer-2.0-4.el9.noarch 382 kB/s | 19 kB 00:00 2024-09-14T10:52:39.499 INFO:teuthology.orchestra.run.smithi086.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-14T10:52:39.524 INFO:teuthology.orchestra.run.smithi086.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 693 kB/s | 35 kB 00:00 2024-09-14T10:52:39.574 INFO:teuthology.orchestra.run.smithi086.stdout:(205/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.9 MB/s | 250 kB 00:00 2024-09-14T10:52:39.604 INFO:teuthology.orchestra.run.smithi002.stdout:(71/286): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 2.4 MB/s | 325 kB 00:00 2024-09-14T10:52:39.646 INFO:teuthology.orchestra.run.smithi002.stdout:(72/286): exiv2-0.27.5-2.el9.x86_64.rpm 2.9 MB/s | 980 kB 00:00 2024-09-14T10:52:39.650 INFO:teuthology.orchestra.run.smithi086.stdout:(206/286): python3-babel-2.9.1-2.el9.noarch.rpm 16 MB/s | 6.0 MB 00:00 2024-09-14T10:52:39.675 INFO:teuthology.orchestra.run.smithi086.stdout:(207/286): python3-oauthlib-3.1.1-5.el9.noarch. 2.2 MB/s | 222 kB 00:00 2024-09-14T10:52:39.700 INFO:teuthology.orchestra.run.smithi086.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 1.5 MB/s | 77 kB 00:00 2024-09-14T10:52:39.721 INFO:teuthology.orchestra.run.smithi002.stdout:(73/286): flac-libs-1.3.3-12.el9.x86_64.rpm 1.8 MB/s | 218 kB 00:00 2024-09-14T10:52:39.725 INFO:teuthology.orchestra.run.smithi086.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 843 kB/s | 42 kB 00:00 2024-09-14T10:52:39.751 INFO:teuthology.orchestra.run.smithi086.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 5.2 MB/s | 269 kB 00:00 2024-09-14T10:52:39.776 INFO:teuthology.orchestra.run.smithi086.stdout:(211/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 3.1 MB/s | 159 kB 00:00 2024-09-14T10:52:39.801 INFO:teuthology.orchestra.run.smithi086.stdout:(212/286): python3-pyasn1-modules-0.4.8-6.el9.n 5.4 MB/s | 279 kB 00:00 2024-09-14T10:52:39.826 INFO:teuthology.orchestra.run.smithi086.stdout:(213/286): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-14T10:52:39.830 INFO:teuthology.orchestra.run.smithi002.stdout:(74/286): flatpak-selinux-1.12.9-1.el9.noarch.r 199 kB/s | 22 kB 00:00 2024-09-14T10:52:39.852 INFO:teuthology.orchestra.run.smithi086.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 1.0 MB/s | 54 kB 00:00 2024-09-14T10:52:39.872 INFO:teuthology.orchestra.run.smithi002.stdout:(75/286): flatpak-1.12.9-1.el9.x86_64.rpm 7.6 MB/s | 1.7 MB 00:00 2024-09-14T10:52:39.919 INFO:teuthology.orchestra.run.smithi086.stdout:(215/286): python3-numpy-1.20.1-5.el9.x86_64.rp 12 MB/s | 5.1 MB 00:00 2024-09-14T10:52:39.939 INFO:teuthology.orchestra.run.smithi002.stdout:(76/286): flatpak-session-helper-1.12.9-1.el9.x 672 kB/s | 73 kB 00:00 2024-09-14T10:52:39.944 INFO:teuthology.orchestra.run.smithi086.stdout:(216/286): python3-toml-0.10.2-6.el9.noarch.rpm 455 kB/s | 42 kB 00:00 2024-09-14T10:52:39.981 INFO:teuthology.orchestra.run.smithi002.stdout:(77/286): flexiblas-3.0.4-8.el9.x86_64.rpm 301 kB/s | 33 kB 00:00 2024-09-14T10:52:39.986 INFO:teuthology.orchestra.run.smithi086.stdout:(217/286): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-09-14T10:52:40.011 INFO:teuthology.orchestra.run.smithi086.stdout:(218/286): qatlib-service-24.02.0-1.el9.x86_64. 534 kB/s | 36 kB 00:00 2024-09-14T10:52:40.037 INFO:teuthology.orchestra.run.smithi086.stdout:(219/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-09-14T10:52:40.062 INFO:teuthology.orchestra.run.smithi086.stdout:(220/286): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-14T10:52:40.095 INFO:teuthology.orchestra.run.smithi086.stdout:(221/286): sisu-0.3.4-10.el9.noarch.rpm 8.5 MB/s | 510 kB 00:00 2024-09-14T10:52:40.106 INFO:teuthology.orchestra.run.smithi002.stdout:(78/286): flexiblas-openblas-openmp-3.0.4-8.el9 146 kB/s | 18 kB 00:00 2024-09-14T10:52:40.121 INFO:teuthology.orchestra.run.smithi086.stdout:(222/286): slf4j-1.7.30-13.el9.noarch.rpm 1.1 MB/s | 69 kB 00:00 2024-09-14T10:52:40.146 INFO:teuthology.orchestra.run.smithi086.stdout:(223/286): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-14T10:52:40.172 INFO:teuthology.orchestra.run.smithi086.stdout:(224/286): sound-theme-freedesktop-0.8-17.el9.n 7.5 MB/s | 383 kB 00:00 2024-09-14T10:52:40.197 INFO:teuthology.orchestra.run.smithi086.stdout:(225/286): totem-pl-parser-3.26.6-2.el9.x86_64. 3.0 MB/s | 152 kB 00:00 2024-09-14T10:52:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:(79/286): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 763 kB/s | 89 kB 00:00 2024-09-14T10:52:40.230 INFO:teuthology.orchestra.run.smithi086.stdout:(226/286): tracker-3.1.2-3.el9.x86_64.rpm 9.3 MB/s | 555 kB 00:00 2024-09-14T10:52:40.272 INFO:teuthology.orchestra.run.smithi086.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-14T10:52:40.297 INFO:teuthology.orchestra.run.smithi086.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 797 kB/s | 53 kB 00:00 2024-09-14T10:52:40.331 INFO:teuthology.orchestra.run.smithi086.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-14T10:52:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:(80/286): geoclue2-2.6.0-7.el9.x86_64.rpm 1.0 MB/s | 124 kB 00:00 2024-09-14T10:52:40.356 INFO:teuthology.orchestra.run.smithi086.stdout:(230/286): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-14T10:52:40.390 INFO:teuthology.orchestra.run.smithi086.stdout:(231/286): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-14T10:52:40.415 INFO:teuthology.orchestra.run.smithi086.stdout:(232/286): wireplumber-0.4.14-1.el9.x86_64.rpm 1.6 MB/s | 96 kB 00:00 2024-09-14T10:52:40.449 INFO:teuthology.orchestra.run.smithi086.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 6.0 MB/s | 358 kB 00:00 2024-09-14T10:52:40.457 INFO:teuthology.orchestra.run.smithi002.stdout:(81/286): giflib-5.2.1-9.el9.x86_64.rpm 416 kB/s | 49 kB 00:00 2024-09-14T10:52:40.474 INFO:teuthology.orchestra.run.smithi086.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 724 kB/s | 42 kB 00:00 2024-09-14T10:52:40.499 INFO:teuthology.orchestra.run.smithi086.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 7.5 MB/s | 385 kB 00:00 2024-09-14T10:52:40.525 INFO:teuthology.orchestra.run.smithi086.stdout:(236/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 2.6 MB/s | 134 kB 00:00 2024-09-14T10:52:40.567 INFO:teuthology.orchestra.run.smithi086.stdout:(237/286): xkeyboard-config-2.33-2.el9.noarch.r 13 MB/s | 859 kB 00:00 2024-09-14T10:52:40.591 INFO:teuthology.orchestra.run.smithi002.stdout:(82/286): google-guice-4.2.3-9.el9.noarch.rpm 3.5 MB/s | 473 kB 00:00 2024-09-14T10:52:40.592 INFO:teuthology.orchestra.run.smithi086.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 951 kB/s | 64 kB 00:00 2024-09-14T10:52:40.617 INFO:teuthology.orchestra.run.smithi086.stdout:(239/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 9.8 MB/s | 505 kB 00:00 2024-09-14T10:52:40.741 INFO:teuthology.orchestra.run.smithi002.stdout:(83/286): graphene-1.10.6-2.el9.x86_64.rpm 430 kB/s | 64 kB 00:00 2024-09-14T10:52:40.858 INFO:teuthology.orchestra.run.smithi002.stdout:(84/286): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-14T10:52:40.859 INFO:teuthology.orchestra.run.smithi086.stdout:(240/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 16 MB/s | 16 MB 00:01 2024-09-14T10:52:40.883 INFO:teuthology.orchestra.run.smithi002.stdout:(85/286): gsm-1.0.19-6.el9.x86_64.rpm 239 kB/s | 34 kB 00:00 2024-09-14T10:52:40.909 INFO:teuthology.orchestra.run.smithi086.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-14T10:52:40.934 INFO:teuthology.orchestra.run.smithi086.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-14T10:52:40.977 INFO:teuthology.orchestra.run.smithi086.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 565 kB/s | 19 kB 00:00 2024-09-14T10:52:40.992 INFO:teuthology.orchestra.run.smithi002.stdout:(86/286): gstreamer1-1.22.1-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-09-14T10:52:41.094 INFO:teuthology.orchestra.run.smithi086.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 38 MB/s | 4.4 MB 00:00 2024-09-14T10:52:41.109 INFO:teuthology.orchestra.run.smithi002.stdout:(87/286): adwaita-icon-theme-40.1.1-3.el9.noarc 3.2 MB/s | 12 MB 00:03 2024-09-14T10:52:41.119 INFO:teuthology.orchestra.run.smithi086.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.1 MB/s | 26 kB 00:00 2024-09-14T10:52:41.134 INFO:teuthology.orchestra.run.smithi002.stdout:(88/286): gtk-update-icon-cache-3.24.31-5.el9.x 233 kB/s | 33 kB 00:00 2024-09-14T10:52:41.144 INFO:teuthology.orchestra.run.smithi086.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T10:52:41.169 INFO:teuthology.orchestra.run.smithi086.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T10:52:41.195 INFO:teuthology.orchestra.run.smithi086.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-14T10:52:41.237 INFO:teuthology.orchestra.run.smithi086.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-14T10:52:41.270 INFO:teuthology.orchestra.run.smithi086.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-14T10:52:41.295 INFO:teuthology.orchestra.run.smithi086.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T10:52:41.321 INFO:teuthology.orchestra.run.smithi086.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T10:52:41.346 INFO:teuthology.orchestra.run.smithi086.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 568 kB/s | 14 kB 00:00 2024-09-14T10:52:41.380 INFO:teuthology.orchestra.run.smithi086.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 5.1 MB/s | 172 kB 00:00 2024-09-14T10:52:41.405 INFO:teuthology.orchestra.run.smithi086.stdout:(255/286): lua-devel-5.4.4-4.el9.x86_64.rpm 27 kB/s | 22 kB 00:00 2024-09-14T10:52:41.438 INFO:teuthology.orchestra.run.smithi086.stdout:(256/286): python3-cherrypy-18.6.1-2.el9.noarch 6.1 MB/s | 358 kB 00:00 2024-09-14T10:52:41.480 INFO:teuthology.orchestra.run.smithi086.stdout:(257/286): python3-google-auth-2.34.0-1.el9.noa 2.9 MB/s | 220 kB 00:00 2024-09-14T10:52:41.514 INFO:teuthology.orchestra.run.smithi086.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 4.2 MB/s | 144 kB 00:00 2024-09-14T10:52:41.539 INFO:teuthology.orchestra.run.smithi086.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 431 kB/s | 11 kB 00:00 2024-09-14T10:52:41.564 INFO:teuthology.orchestra.run.smithi086.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 712 kB/s | 18 kB 00:00 2024-09-14T10:52:41.590 INFO:teuthology.orchestra.run.smithi086.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 930 kB/s | 23 kB 00:00 2024-09-14T10:52:41.615 INFO:teuthology.orchestra.run.smithi086.stdout:(262/286): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-14T10:52:41.665 INFO:teuthology.orchestra.run.smithi086.stdout:(263/286): python3-grpcio-1.46.7-10.el9.x86_64. 9.1 MB/s | 2.0 MB 00:00 2024-09-14T10:52:41.667 INFO:teuthology.orchestra.run.smithi002.stdout:(89/286): gstreamer1-plugins-base-1.22.1-2.el9. 2.9 MB/s | 2.2 MB 00:00 2024-09-14T10:52:41.691 INFO:teuthology.orchestra.run.smithi086.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-09-14T10:52:41.733 INFO:teuthology.orchestra.run.smithi086.stdout:(265/286): protobuf-compiler-3.14.0-13.el9.x86_ 774 kB/s | 863 kB 00:01 2024-09-14T10:52:41.758 INFO:teuthology.orchestra.run.smithi086.stdout:(266/286): python3-logutils-0.3.5-21.el9.noarch 709 kB/s | 46 kB 00:00 2024-09-14T10:52:41.792 INFO:teuthology.orchestra.run.smithi086.stdout:(267/286): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-09-14T10:52:41.825 INFO:teuthology.orchestra.run.smithi086.stdout:(268/286): python3-more-itertools-8.12.0-2.el9. 857 kB/s | 79 kB 00:00 2024-09-14T10:52:41.850 INFO:teuthology.orchestra.run.smithi086.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-14T10:52:41.875 INFO:teuthology.orchestra.run.smithi086.stdout:(270/286): python3-pecan-1.4.2-3.el9.noarch.rpm 3.3 MB/s | 272 kB 00:00 2024-09-14T10:52:41.892 INFO:teuthology.orchestra.run.smithi086.stdout:(271/286): python3-repoze-lru-0.7-16.el9.noarch 1.8 MB/s | 31 kB 00:00 2024-09-14T10:52:41.918 INFO:teuthology.orchestra.run.smithi086.stdout:(272/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-14T10:52:41.935 INFO:teuthology.orchestra.run.smithi086.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 3.5 MB/s | 59 kB 00:00 2024-09-14T10:52:41.960 INFO:teuthology.orchestra.run.smithi086.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.7 MB/s | 188 kB 00:00 2024-09-14T10:52:41.976 INFO:teuthology.orchestra.run.smithi002.stdout:(90/286): guava-30.1-6.el9.noarch.rpm 2.7 MB/s | 2.3 MB 00:00 2024-09-14T10:52:41.977 INFO:teuthology.orchestra.run.smithi086.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 857 kB/s | 36 kB 00:00 2024-09-14T10:52:42.002 INFO:teuthology.orchestra.run.smithi086.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.7 MB/s | 74 kB 00:00 2024-09-14T10:52:42.036 INFO:teuthology.orchestra.run.smithi086.stdout:(277/286): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-09-14T10:52:42.043 INFO:teuthology.orchestra.run.smithi002.stdout:(91/286): hicolor-icon-theme-0.17-13.el9.noarch 583 kB/s | 219 kB 00:00 2024-09-14T10:52:42.070 INFO:teuthology.orchestra.run.smithi086.stdout:(278/286): python3-websocket-client-1.2.3-2.el9 1.3 MB/s | 90 kB 00:00 2024-09-14T10:52:42.121 INFO:teuthology.orchestra.run.smithi086.stdout:(279/286): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-14T10:52:42.302 INFO:teuthology.orchestra.run.smithi086.stdout:(280/286): python3-zc-lockfile-2.0-10.el9.noarc 86 kB/s | 20 kB 00:00 2024-09-14T10:52:42.329 INFO:teuthology.orchestra.run.smithi086.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 922 kB/s | 191 kB 00:00 2024-09-14T10:52:42.354 INFO:teuthology.orchestra.run.smithi086.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 3.9 MB/s | 206 kB 00:00 2024-09-14T10:52:42.379 INFO:teuthology.orchestra.run.smithi086.stdout:(283/286): python3-werkzeug-2.0.3-3.el9.1.noarc 1.2 MB/s | 427 kB 00:00 2024-09-14T10:52:42.430 INFO:teuthology.orchestra.run.smithi086.stdout:(284/286): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-14T10:52:42.663 INFO:teuthology.orchestra.run.smithi086.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-14T10:52:42.796 INFO:teuthology.orchestra.run.smithi086.stdout:(286/286): librados2-19.3.0-4907.ga2782315.el9. 7.8 MB/s | 3.5 MB 00:00 2024-09-14T10:52:42.804 INFO:teuthology.orchestra.run.smithi086.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:52:42.804 INFO:teuthology.orchestra.run.smithi086.stdout:Total 23 MB/s | 327 MB 00:13 2024-09-14T10:52:42.951 INFO:teuthology.orchestra.run.smithi002.stdout:(92/286): httpcomponents-client-4.5.13-3.el9.no 673 kB/s | 657 kB 00:00 2024-09-14T10:52:43.035 INFO:teuthology.orchestra.run.smithi002.stdout:(93/286): httpcomponents-core-4.4.13-7.el9.noar 637 kB/s | 632 kB 00:00 2024-09-14T10:52:43.144 INFO:teuthology.orchestra.run.smithi002.stdout:(94/286): jakarta-annotations-1.3.5-13.el9.noar 415 kB/s | 45 kB 00:00 2024-09-14T10:52:43.352 INFO:teuthology.orchestra.run.smithi002.stdout:(95/286): jansi-2.3.3-6.el9.x86_64.rpm 527 kB/s | 110 kB 00:00 2024-09-14T10:52:43.986 INFO:teuthology.orchestra.run.smithi002.stdout:(96/286): java-11-openjdk-11.0.20.1.1-2.el9.x86 652 kB/s | 413 kB 00:00 2024-09-14T10:52:45.981 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction check 2024-09-14T10:52:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction check succeeded. 2024-09-14T10:52:46.166 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction test 2024-09-14T10:52:47.886 INFO:teuthology.orchestra.run.smithi002.stdout:(97/286): iso-codes-4.6.0-3.el9.noarch.rpm 731 kB/s | 3.5 MB 00:04 2024-09-14T10:52:48.211 INFO:teuthology.orchestra.run.smithi002.stdout:(98/286): gtk3-3.24.31-5.el9.x86_64.rpm 704 kB/s | 4.9 MB 00:07 2024-09-14T10:52:48.319 INFO:teuthology.orchestra.run.smithi002.stdout:(99/286): javapackages-filesystem-6.0.0-4.el9.n 120 kB/s | 13 kB 00:00 2024-09-14T10:52:48.437 INFO:teuthology.orchestra.run.smithi002.stdout:(100/286): jbigkit-libs-2.1-23.el9.x86_64.rpm 454 kB/s | 53 kB 00:00 2024-09-14T10:52:48.545 INFO:teuthology.orchestra.run.smithi002.stdout:(101/286): jcl-over-slf4j-1.7.30-13.el9.noarch. 222 kB/s | 24 kB 00:00 2024-09-14T10:52:48.804 INFO:teuthology.orchestra.run.smithi002.stdout:(102/286): java-11-openjdk-devel-11.0.20.1.1-2. 705 kB/s | 3.3 MB 00:04 2024-09-14T10:52:48.920 INFO:teuthology.orchestra.run.smithi002.stdout:(103/286): jsr-305-3.0.2-6.el9.noarch.rpm 305 kB/s | 35 kB 00:00 2024-09-14T10:52:49.404 INFO:teuthology.orchestra.run.smithi002.stdout:(104/286): java-11-openjdk-headless-11.0.20.1.1 26 MB/s | 39 MB 00:01 2024-09-14T10:52:49.542 INFO:teuthology.orchestra.run.smithi086.stdout:Transaction test succeeded. 2024-09-14T10:52:49.542 INFO:teuthology.orchestra.run.smithi086.stdout:Running transaction 2024-09-14T10:52:49.638 INFO:teuthology.orchestra.run.smithi002.stdout:(105/286): lcms2-2.12-3.el9.x86_64.rpm 234 kB/s | 168 kB 00:00 2024-09-14T10:52:49.663 INFO:teuthology.orchestra.run.smithi002.stdout:(106/286): libX11-xcb-1.7.0-9.el9.x86_64.rpm 43 kB/s | 11 kB 00:00 2024-09-14T10:52:49.688 INFO:teuthology.orchestra.run.smithi002.stdout:(107/286): jsoup-1.13.1-10.el9.noarch.rpm 330 kB/s | 377 kB 00:01 2024-09-14T10:52:49.747 INFO:teuthology.orchestra.run.smithi002.stdout:(108/286): libXcomposite-0.4.5-7.el9.x86_64.rpm 222 kB/s | 24 kB 00:00 2024-09-14T10:52:49.772 INFO:teuthology.orchestra.run.smithi002.stdout:(109/286): libXcursor-1.2.0-7.el9.x86_64.rpm 282 kB/s | 31 kB 00:00 2024-09-14T10:52:49.797 INFO:teuthology.orchestra.run.smithi002.stdout:(110/286): libXdamage-1.1.5-7.el9.x86_64.rpm 209 kB/s | 23 kB 00:00 2024-09-14T10:52:49.856 INFO:teuthology.orchestra.run.smithi002.stdout:(111/286): libXfixes-5.0.3-16.el9.x86_64.rpm 182 kB/s | 20 kB 00:00 2024-09-14T10:52:49.881 INFO:teuthology.orchestra.run.smithi002.stdout:(112/286): libXi-1.7.10-8.el9.x86_64.rpm 364 kB/s | 40 kB 00:00 2024-09-14T10:52:49.907 INFO:teuthology.orchestra.run.smithi002.stdout:(113/286): libXinerama-1.1.4-10.el9.x86_64.rpm 138 kB/s | 15 kB 00:00 2024-09-14T10:52:49.965 INFO:teuthology.orchestra.run.smithi002.stdout:(114/286): libXrandr-1.5.2-8.el9.x86_64.rpm 261 kB/s | 28 kB 00:00 2024-09-14T10:52:49.991 INFO:teuthology.orchestra.run.smithi002.stdout:(115/286): libXtst-1.2.3-16.el9.x86_64.rpm 197 kB/s | 21 kB 00:00 2024-09-14T10:52:50.024 INFO:teuthology.orchestra.run.smithi002.stdout:(116/286): libXv-1.0.11-16.el9.x86_64.rpm 163 kB/s | 19 kB 00:00 2024-09-14T10:52:50.074 INFO:teuthology.orchestra.run.smithi002.stdout:(117/286): libXxf86vm-1.1.4-18.el9.x86_64.rpm 173 kB/s | 19 kB 00:00 2024-09-14T10:52:50.100 INFO:teuthology.orchestra.run.smithi002.stdout:(118/286): libasyncns-0.8-22.el9.x86_64.rpm 280 kB/s | 30 kB 00:00 2024-09-14T10:52:50.125 INFO:teuthology.orchestra.run.smithi002.stdout:(119/286): libcanberra-0.30-27.el9.x86_64.rpm 858 kB/s | 86 kB 00:00 2024-09-14T10:52:50.184 INFO:teuthology.orchestra.run.smithi002.stdout:(120/286): libcanberra-gtk3-0.30-27.el9.x86_64. 292 kB/s | 32 kB 00:00 2024-09-14T10:52:50.209 INFO:teuthology.orchestra.run.smithi002.stdout:(121/286): libdrm-2.4.121-1.el9.x86_64.rpm 1.4 MB/s | 161 kB 00:00 2024-09-14T10:52:50.242 INFO:teuthology.orchestra.run.smithi002.stdout:(122/286): libepoxy-1.5.5-4.el9.x86_64.rpm 2.0 MB/s | 241 kB 00:00 2024-09-14T10:52:50.301 INFO:teuthology.orchestra.run.smithi002.stdout:(123/286): libexif-0.6.22-6.el9.x86_64.rpm 3.6 MB/s | 435 kB 00:00 2024-09-14T10:52:50.327 INFO:teuthology.orchestra.run.smithi002.stdout:(124/286): libfontenc-1.1.3-17.el9.x86_64.rpm 263 kB/s | 31 kB 00:00 2024-09-14T10:52:50.352 INFO:teuthology.orchestra.run.smithi002.stdout:(125/286): libgexiv2-0.12.3-1.el9.x86_64.rpm 757 kB/s | 83 kB 00:00 2024-09-14T10:52:50.419 INFO:teuthology.orchestra.run.smithi002.stdout:(126/286): libglvnd-1.3.4-1.el9.x86_64.rpm 1.1 MB/s | 135 kB 00:00 2024-09-14T10:52:50.461 INFO:teuthology.orchestra.run.smithi002.stdout:(127/286): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 274 kB/s | 37 kB 00:00 2024-09-14T10:52:50.486 INFO:teuthology.orchestra.run.smithi002.stdout:(128/286): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.0 MB/s | 142 kB 00:00 2024-09-14T10:52:50.536 INFO:teuthology.orchestra.run.smithi002.stdout:(129/286): libgsf-1.14.47-5.el9.x86_64.rpm 2.1 MB/s | 256 kB 00:00 2024-09-14T10:52:50.570 INFO:teuthology.orchestra.run.smithi002.stdout:(130/286): libgxps-0.3.2-3.el9.x86_64.rpm 725 kB/s | 79 kB 00:00 2024-09-14T10:52:50.595 INFO:teuthology.orchestra.run.smithi002.stdout:(131/286): libiptcdata-1.0.5-10.el9.x86_64.rpm 562 kB/s | 61 kB 00:00 2024-09-14T10:52:50.645 INFO:teuthology.orchestra.run.smithi002.stdout:(132/286): libldac-2.0.2.3-10.el9.x86_64.rpm 379 kB/s | 41 kB 00:00 2024-09-14T10:52:50.679 INFO:teuthology.orchestra.run.smithi002.stdout:(133/286): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-14T10:52:50.704 INFO:teuthology.orchestra.run.smithi002.stdout:(134/286): libnotify-0.7.9-8.el9.x86_64.rpm 401 kB/s | 44 kB 00:00 2024-09-14T10:52:50.754 INFO:teuthology.orchestra.run.smithi002.stdout:(135/286): libogg-1.3.4-6.el9.x86_64.rpm 308 kB/s | 34 kB 00:00 2024-09-14T10:52:50.797 INFO:teuthology.orchestra.run.smithi002.stdout:(136/286): libosinfo-1.10.0-1.el9.x86_64.rpm 2.7 MB/s | 319 kB 00:00 2024-09-14T10:52:50.822 INFO:teuthology.orchestra.run.smithi002.stdout:(137/286): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-14T10:52:50.864 INFO:teuthology.orchestra.run.smithi002.stdout:(138/286): librabbitmq-0.11.0-7.el9.x86_64.rpm 415 kB/s | 45 kB 00:00 2024-09-14T10:52:50.922 INFO:teuthology.orchestra.run.smithi002.stdout:(139/286): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-14T10:52:50.947 INFO:teuthology.orchestra.run.smithi002.stdout:(140/286): libsbc-1.4-9.el9.x86_64.rpm 357 kB/s | 45 kB 00:00 2024-09-14T10:52:50.973 INFO:teuthology.orchestra.run.smithi002.stdout:(141/286): libsndfile-1.0.31-8.el9.x86_64.rpm 1.9 MB/s | 206 kB 00:00 2024-09-14T10:52:51.031 INFO:teuthology.orchestra.run.smithi002.stdout:(142/286): libtheora-1.1.1-31.el9.x86_64.rpm 1.5 MB/s | 164 kB 00:00 2024-09-14T10:52:51.065 INFO:teuthology.orchestra.run.smithi002.stdout:(143/286): libtiff-4.4.0-13.el9.x86_64.rpm 1.6 MB/s | 198 kB 00:00 2024-09-14T10:52:51.090 INFO:teuthology.orchestra.run.smithi002.stdout:(144/286): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 304 kB/s | 36 kB 00:00 2024-09-14T10:52:51.149 INFO:teuthology.orchestra.run.smithi002.stdout:(145/286): libtracker-sparql-3.1.2-3.el9.x86_64 2.7 MB/s | 324 kB 00:00 2024-09-14T10:52:51.174 INFO:teuthology.orchestra.run.smithi002.stdout:(146/286): libvisual-0.4.0-34.el9.x86_64.rpm 1.3 MB/s | 144 kB 00:00 2024-09-14T10:52:51.200 INFO:teuthology.orchestra.run.smithi002.stdout:(147/286): libvorbis-1.3.7-5.el9.x86_64.rpm 1.7 MB/s | 193 kB 00:00 2024-09-14T10:52:51.258 INFO:teuthology.orchestra.run.smithi002.stdout:(148/286): libwayland-client-1.21.0-1.el9.x86_6 306 kB/s | 33 kB 00:00 2024-09-14T10:52:51.283 INFO:teuthology.orchestra.run.smithi002.stdout:(149/286): libwayland-cursor-1.21.0-1.el9.x86_6 178 kB/s | 19 kB 00:00 2024-09-14T10:52:51.309 INFO:teuthology.orchestra.run.smithi002.stdout:(150/286): libwayland-egl-1.21.0-1.el9.x86_64.r 118 kB/s | 13 kB 00:00 2024-09-14T10:52:51.367 INFO:teuthology.orchestra.run.smithi002.stdout:(151/286): libwayland-server-1.21.0-1.el9.x86_6 383 kB/s | 42 kB 00:00 2024-09-14T10:52:51.401 INFO:teuthology.orchestra.run.smithi002.stdout:(152/286): libwebp-1.2.0-8.el9.x86_64.rpm 2.3 MB/s | 277 kB 00:00 2024-09-14T10:52:51.426 INFO:teuthology.orchestra.run.smithi002.stdout:(153/286): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.1 MB/s | 133 kB 00:00 2024-09-14T10:52:51.476 INFO:teuthology.orchestra.run.smithi002.stdout:(154/286): libxshmfence-1.3-10.el9.x86_64.rpm 116 kB/s | 13 kB 00:00 2024-09-14T10:52:51.510 INFO:teuthology.orchestra.run.smithi002.stdout:(155/286): low-memory-monitor-2.1-4.el9.x86_64. 329 kB/s | 36 kB 00:00 2024-09-14T10:52:51.544 INFO:teuthology.orchestra.run.smithi002.stdout:(156/286): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-14T10:52:51.577 INFO:teuthology.orchestra.run.smithi002.stdout:(157/286): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-09-14T10:52:51.619 INFO:teuthology.orchestra.run.smithi002.stdout:(158/286): lua-posix-35.0-8.el9.x86_64.rpm 1.4 MB/s | 151 kB 00:00 2024-09-14T10:52:51.653 INFO:teuthology.orchestra.run.smithi002.stdout:(159/286): maven-3.6.3-15.el9.noarch.rpm 162 kB/s | 18 kB 00:00 2024-09-14T10:52:51.711 INFO:teuthology.orchestra.run.smithi002.stdout:(160/286): maven-lib-3.6.3-15.el9.noarch.rpm 11 MB/s | 1.5 MB 00:00 2024-09-14T10:52:51.736 INFO:teuthology.orchestra.run.smithi002.stdout:(161/286): maven-openjdk11-3.6.3-15.el9.noarch. 77 kB/s | 9.0 kB 00:00 2024-09-14T10:52:51.778 INFO:teuthology.orchestra.run.smithi002.stdout:(162/286): maven-resolver-1.6.1-10.el9.noarch.r 4.0 MB/s | 517 kB 00:00 2024-09-14T10:52:51.829 INFO:teuthology.orchestra.run.smithi002.stdout:(163/286): maven-shared-utils-3.3.4-3.el9.noarc 1.3 MB/s | 151 kB 00:00 2024-09-14T10:52:51.854 INFO:teuthology.orchestra.run.smithi002.stdout:(164/286): maven-wagon-3.4.2-7.el9.noarch.rpm 958 kB/s | 112 kB 00:00 2024-09-14T10:52:51.946 INFO:teuthology.orchestra.run.smithi002.stdout:(165/286): mesa-filesystem-24.1.2-3.el9.x86_64. 96 kB/s | 11 kB 00:00 2024-09-14T10:52:51.971 INFO:teuthology.orchestra.run.smithi002.stdout:(166/286): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.2 MB/s | 139 kB 00:00 2024-09-14T10:52:52.063 INFO:teuthology.orchestra.run.smithi002.stdout:(167/286): mesa-libGL-24.1.2-3.el9.x86_64.rpm 1.4 MB/s | 171 kB 00:00 2024-09-14T10:52:52.088 INFO:teuthology.orchestra.run.smithi002.stdout:(168/286): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 310 kB/s | 36 kB 00:00 2024-09-14T10:52:52.189 INFO:teuthology.orchestra.run.smithi002.stdout:(169/286): mesa-dri-drivers-24.1.2-3.el9.x86_64 21 MB/s | 8.8 MB 00:00 2024-09-14T10:52:52.214 INFO:teuthology.orchestra.run.smithi002.stdout:(170/286): mesa-libglapi-24.1.2-3.el9.x86_64.rp 305 kB/s | 46 kB 00:00 2024-09-14T10:52:52.239 INFO:teuthology.orchestra.run.smithi002.stdout:(171/286): mkfontscale-1.2.1-3.el9.x86_64.rpm 214 kB/s | 32 kB 00:00 2024-09-14T10:52:52.298 INFO:teuthology.orchestra.run.smithi002.stdout:(172/286): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-14T10:52:52.348 INFO:teuthology.orchestra.run.smithi002.stdout:(173/286): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.5 MB/s | 163 kB 00:00 2024-09-14T10:52:52.415 INFO:teuthology.orchestra.run.smithi002.stdout:(174/286): opus-1.3.1-10.el9.x86_64.rpm 1.7 MB/s | 200 kB 00:00 2024-09-14T10:52:52.540 INFO:teuthology.orchestra.run.smithi002.stdout:(175/286): osinfo-db-20240701-2.el9.noarch.rpm 4.1 MB/s | 531 kB 00:00 2024-09-14T10:52:52.657 INFO:teuthology.orchestra.run.smithi002.stdout:(176/286): orc-0.4.31-8.el9.x86_64.rpm 594 kB/s | 183 kB 00:00 2024-09-14T10:52:52.682 INFO:teuthology.orchestra.run.smithi002.stdout:(177/286): osinfo-db-tools-1.10.0-1.el9.x86_64. 520 kB/s | 74 kB 00:00 2024-09-14T10:52:52.808 INFO:teuthology.orchestra.run.smithi002.stdout:(178/286): p11-kit-server-0.25.3-2.el9.x86_64.r 1.9 MB/s | 246 kB 00:00 2024-09-14T10:52:52.916 INFO:teuthology.orchestra.run.smithi002.stdout:(179/286): pipewire-1.0.1-1.el9.x86_64.rpm 983 kB/s | 107 kB 00:00 2024-09-14T10:52:53.025 INFO:teuthology.orchestra.run.smithi002.stdout:(180/286): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 529 kB/s | 57 kB 00:00 2024-09-14T10:52:53.134 INFO:teuthology.orchestra.run.smithi002.stdout:(181/286): pipewire-jack-audio-connection-kit-1 84 kB/s | 9.1 kB 00:00 2024-09-14T10:52:53.251 INFO:teuthology.orchestra.run.smithi002.stdout:(182/286): pipewire-jack-audio-connection-kit-l 1.1 MB/s | 135 kB 00:00 2024-09-14T10:52:53.401 INFO:teuthology.orchestra.run.smithi002.stdout:(183/286): pipewire-libs-1.0.1-1.el9.x86_64.rpm 13 MB/s | 1.9 MB 00:00 2024-09-14T10:52:53.426 INFO:teuthology.orchestra.run.smithi002.stdout:(184/286): ostree-libs-2024.7-2.el9.x86_64.rpm 609 kB/s | 468 kB 00:00 2024-09-14T10:52:53.518 INFO:teuthology.orchestra.run.smithi002.stdout:(185/286): pipewire-pulseaudio-1.0.1-1.el9.x86_ 1.6 MB/s | 192 kB 00:00 2024-09-14T10:52:53.544 INFO:teuthology.orchestra.run.smithi002.stdout:(186/286): plexus-cipher-1.7-27.el9.noarch.rpm 221 kB/s | 26 kB 00:00 2024-09-14T10:52:53.627 INFO:teuthology.orchestra.run.smithi002.stdout:(187/286): plexus-classworlds-2.6.0-11.el9.noar 553 kB/s | 60 kB 00:00 2024-09-14T10:52:53.652 INFO:teuthology.orchestra.run.smithi002.stdout:(188/286): plexus-containers-component-annotati 169 kB/s | 18 kB 00:00 2024-09-14T10:52:53.736 INFO:teuthology.orchestra.run.smithi002.stdout:(189/286): plexus-interpolation-1.26-11.el9.noa 731 kB/s | 80 kB 00:00 2024-09-14T10:52:53.761 INFO:teuthology.orchestra.run.smithi002.stdout:(190/286): plexus-sec-dispatcher-1.4-37.el9.noa 309 kB/s | 34 kB 00:00 2024-09-14T10:52:53.854 INFO:teuthology.orchestra.run.smithi002.stdout:(191/286): plexus-utils-3.3.0-10.el9.noarch.rpm 2.1 MB/s | 254 kB 00:00 2024-09-14T10:52:53.995 INFO:teuthology.orchestra.run.smithi002.stdout:(192/286): poppler-data-0.4.9-9.el9.noarch.rpm 13 MB/s | 1.9 MB 00:00 2024-09-14T10:52:54.112 INFO:teuthology.orchestra.run.smithi002.stdout:(193/286): poppler-glib-21.01.0-21.el9.x86_64.r 1.3 MB/s | 152 kB 00:00 2024-09-14T10:52:54.238 INFO:teuthology.orchestra.run.smithi002.stdout:(194/286): protobuf-3.14.0-13.el9.x86_64.rpm 8.1 MB/s | 1.0 MB 00:00 2024-09-14T10:52:54.354 INFO:teuthology.orchestra.run.smithi002.stdout:(195/286): publicsuffix-list-20210518-3.el9.noa 710 kB/s | 83 kB 00:00 2024-09-14T10:52:54.471 INFO:teuthology.orchestra.run.smithi002.stdout:(196/286): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.7 MB/s | 679 kB 00:00 2024-09-14T10:52:54.755 INFO:teuthology.orchestra.run.smithi002.stdout:(197/286): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 6.0 MB 00:00 2024-09-14T10:52:54.872 INFO:teuthology.orchestra.run.smithi002.stdout:(198/286): python3-devel-3.9.19-8.el9.x86_64.rp 2.0 MB/s | 245 kB 00:00 2024-09-14T10:52:54.989 INFO:teuthology.orchestra.run.smithi002.stdout:(199/286): python3-jinja2-2.11.3-6.el9.noarch.r 2.1 MB/s | 248 kB 00:00 2024-09-14T10:52:55.239 INFO:teuthology.orchestra.run.smithi002.stdout:(200/286): python3-jsonpatch-1.21-16.el9.noarch 102 kB/s | 26 kB 00:00 2024-09-14T10:52:55.356 INFO:teuthology.orchestra.run.smithi002.stdout:(201/286): python3-jsonpointer-2.0-4.el9.noarch 164 kB/s | 19 kB 00:00 2024-09-14T10:52:55.440 INFO:teuthology.orchestra.run.smithi002.stdout:(202/286): poppler-21.01.0-21.el9.x86_64.rpm 648 kB/s | 1.1 MB 00:01 2024-09-14T10:52:55.465 INFO:teuthology.orchestra.run.smithi002.stdout:(203/286): python3-mako-1.1.4-6.el9.noarch.rpm 1.5 MB/s | 172 kB 00:00 2024-09-14T10:52:55.549 INFO:teuthology.orchestra.run.smithi002.stdout:(204/286): python3-markupsafe-1.1.1-12.el9.x86_ 319 kB/s | 35 kB 00:00 2024-09-14T10:52:55.741 INFO:teuthology.orchestra.run.smithi002.stdout:(205/286): python3-numpy-1.20.1-5.el9.x86_64.rp 19 MB/s | 5.1 MB 00:00 2024-09-14T10:52:55.858 INFO:teuthology.orchestra.run.smithi002.stdout:(206/286): python3-oauthlib-3.1.1-5.el9.noarch. 1.9 MB/s | 222 kB 00:00 2024-09-14T10:52:55.941 INFO:teuthology.orchestra.run.smithi002.stdout:(207/286): python3-numpy-f2py-1.20.1-5.el9.x86_ 639 kB/s | 250 kB 00:00 2024-09-14T10:52:55.966 INFO:teuthology.orchestra.run.smithi002.stdout:(208/286): python3-packaging-20.9-5.el9.noarch. 712 kB/s | 77 kB 00:00 2024-09-14T10:52:56.042 INFO:teuthology.orchestra.run.smithi002.stdout:(209/286): python3-prettytable-0.7.2-27.el9.noa 422 kB/s | 42 kB 00:00 2024-09-14T10:52:56.084 INFO:teuthology.orchestra.run.smithi002.stdout:(210/286): python3-protobuf-3.14.0-13.el9.noarc 2.2 MB/s | 269 kB 00:00 2024-09-14T10:52:56.201 INFO:teuthology.orchestra.run.smithi002.stdout:(211/286): python3-pyasn1-modules-0.4.8-6.el9.n 2.3 MB/s | 279 kB 00:00 2024-09-14T10:52:56.309 INFO:teuthology.orchestra.run.smithi002.stdout:(212/286): python3-pytz-2021.1-5.el9.noarch.rpm 472 kB/s | 51 kB 00:00 2024-09-14T10:52:56.334 INFO:teuthology.orchestra.run.smithi002.stdout:(213/286): python3-pyasn1-0.4.8-6.el9.noarch.rp 543 kB/s | 159 kB 00:00 2024-09-14T10:52:56.418 INFO:teuthology.orchestra.run.smithi002.stdout:(214/286): python3-requests-oauthlib-1.3.0-12.e 495 kB/s | 54 kB 00:00 2024-09-14T10:52:56.527 INFO:teuthology.orchestra.run.smithi002.stdout:(215/286): python3-toml-0.10.2-6.el9.noarch.rpm 384 kB/s | 42 kB 00:00 2024-09-14T10:52:56.643 INFO:teuthology.orchestra.run.smithi002.stdout:(216/286): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-09-14T10:52:56.752 INFO:teuthology.orchestra.run.smithi002.stdout:(217/286): qatlib-service-24.02.0-1.el9.x86_64. 330 kB/s | 36 kB 00:00 2024-09-14T10:52:56.861 INFO:teuthology.orchestra.run.smithi002.stdout:(218/286): qatzip-libs-1.2.0-1.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-14T10:52:56.970 INFO:teuthology.orchestra.run.smithi002.stdout:(219/286): rtkit-0.11-29.el9.x86_64.rpm 517 kB/s | 56 kB 00:00 2024-09-14T10:52:57.086 INFO:teuthology.orchestra.run.smithi002.stdout:(220/286): sisu-0.3.4-10.el9.noarch.rpm 4.3 MB/s | 510 kB 00:00 2024-09-14T10:52:57.195 INFO:teuthology.orchestra.run.smithi002.stdout:(221/286): slf4j-1.7.30-13.el9.noarch.rpm 636 kB/s | 69 kB 00:00 2024-09-14T10:52:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:(222/286): socat-1.7.4.1-6.el9.x86_64.rpm 2.5 MB/s | 304 kB 00:00 2024-09-14T10:52:57.429 INFO:teuthology.orchestra.run.smithi002.stdout:(223/286): sound-theme-freedesktop-0.8-17.el9.n 3.2 MB/s | 383 kB 00:00 2024-09-14T10:52:57.546 INFO:teuthology.orchestra.run.smithi002.stdout:(224/286): totem-pl-parser-3.26.6-2.el9.x86_64. 1.3 MB/s | 152 kB 00:00 2024-09-14T10:52:57.671 INFO:teuthology.orchestra.run.smithi002.stdout:(225/286): tracker-3.1.2-3.el9.x86_64.rpm 4.3 MB/s | 555 kB 00:00 2024-09-14T10:52:57.738 INFO:teuthology.orchestra.run.smithi002.stdout:(226/286): openblas-openmp-0.3.26-2.el9.x86_64. 920 kB/s | 4.9 MB 00:05 2024-09-14T10:52:57.805 INFO:teuthology.orchestra.run.smithi002.stdout:(227/286): tracker-miners-3.1.2-4.el9.x86_64.rp 6.9 MB/s | 944 kB 00:00 2024-09-14T10:52:57.847 INFO:teuthology.orchestra.run.smithi002.stdout:(228/286): ttmkfdir-3.0.9-65.el9.x86_64.rpm 489 kB/s | 53 kB 00:00 2024-09-14T10:52:57.922 INFO:teuthology.orchestra.run.smithi002.stdout:(229/286): tzdata-java-2024a-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-14T10:52:58.040 INFO:teuthology.orchestra.run.smithi002.stdout:(230/286): webrtc-audio-processing-0.3.1-8.el9. 2.6 MB/s | 306 kB 00:00 2024-09-14T10:52:58.148 INFO:teuthology.orchestra.run.smithi002.stdout:(231/286): wireplumber-0.4.14-1.el9.x86_64.rpm 893 kB/s | 96 kB 00:00 2024-09-14T10:52:58.173 INFO:teuthology.orchestra.run.smithi002.stdout:(232/286): upower-0.99.11-11.el9.x86_64.rpm 530 kB/s | 173 kB 00:00 2024-09-14T10:52:58.265 INFO:teuthology.orchestra.run.smithi002.stdout:(233/286): wireplumber-libs-0.4.14-1.el9.x86_64 3.0 MB/s | 358 kB 00:00 2024-09-14T10:52:58.290 INFO:teuthology.orchestra.run.smithi002.stdout:(234/286): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 363 kB/s | 42 kB 00:00 2024-09-14T10:52:58.382 INFO:teuthology.orchestra.run.smithi002.stdout:(235/286): xdg-desktop-portal-1.12.6-1.el9.x86_ 3.2 MB/s | 385 kB 00:00 2024-09-14T10:52:58.516 INFO:teuthology.orchestra.run.smithi002.stdout:(236/286): xkeyboard-config-2.33-2.el9.noarch.r 6.3 MB/s | 859 kB 00:00 2024-09-14T10:52:58.591 INFO:teuthology.orchestra.run.smithi002.stdout:(237/286): xdg-desktop-portal-gtk-1.12.0-3.el9. 447 kB/s | 134 kB 00:00 2024-09-14T10:52:58.616 INFO:teuthology.orchestra.run.smithi002.stdout:(238/286): xmlstarlet-1.6.1-20.el9.x86_64.rpm 635 kB/s | 64 kB 00:00 2024-09-14T10:52:58.658 INFO:teuthology.orchestra.run.smithi002.stdout:(239/286): lua-devel-5.4.4-4.el9.x86_64.rpm 534 kB/s | 22 kB 00:00 2024-09-14T10:52:58.775 INFO:teuthology.orchestra.run.smithi002.stdout:(240/286): protobuf-compiler-3.14.0-13.el9.x86_ 7.2 MB/s | 863 kB 00:00 2024-09-14T10:52:58.825 INFO:teuthology.orchestra.run.smithi002.stdout:(241/286): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-14T10:52:58.851 INFO:teuthology.orchestra.run.smithi002.stdout:(242/286): gperftools-libs-2.9.1-3.el9.x86_64.r 12 MB/s | 308 kB 00:00 2024-09-14T10:52:58.876 INFO:teuthology.orchestra.run.smithi002.stdout:(243/286): grpc-data-1.46.7-10.el9.noarch.rpm 776 kB/s | 19 kB 00:00 2024-09-14T10:52:58.985 INFO:teuthology.orchestra.run.smithi002.stdout:(244/286): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-09-14T10:52:59.018 INFO:teuthology.orchestra.run.smithi002.stdout:(245/286): libarrow-doc-9.0.0-11.el9.noarch.rpm 780 kB/s | 26 kB 00:00 2024-09-14T10:52:59.043 INFO:teuthology.orchestra.run.smithi002.stdout:(246/286): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-14T10:52:59.069 INFO:teuthology.orchestra.run.smithi002.stdout:(247/286): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-14T10:52:59.094 INFO:teuthology.orchestra.run.smithi002.stdout:(248/286): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-09-14T10:52:59.136 INFO:teuthology.orchestra.run.smithi002.stdout:(249/286): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-14T10:52:59.170 INFO:teuthology.orchestra.run.smithi002.stdout:(250/286): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-09-14T10:52:59.195 INFO:teuthology.orchestra.run.smithi002.stdout:(251/286): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-14T10:52:59.220 INFO:teuthology.orchestra.run.smithi002.stdout:(252/286): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-14T10:52:59.246 INFO:teuthology.orchestra.run.smithi002.stdout:(253/286): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-09-14T10:52:59.271 INFO:teuthology.orchestra.run.smithi002.stdout:(254/286): python3-cheroot-8.6.0-4.el9.noarch.r 6.8 MB/s | 172 kB 00:00 2024-09-14T10:52:59.304 INFO:teuthology.orchestra.run.smithi002.stdout:(255/286): python3-cherrypy-18.6.1-2.el9.noarch 10 MB/s | 358 kB 00:00 2024-09-14T10:52:59.330 INFO:teuthology.orchestra.run.smithi002.stdout:(256/286): python3-google-auth-2.34.0-1.el9.noa 8.7 MB/s | 220 kB 00:00 2024-09-14T10:52:59.397 INFO:teuthology.orchestra.run.smithi002.stdout:(257/286): python3-grpcio-1.46.7-10.el9.x86_64. 31 MB/s | 2.0 MB 00:00 2024-09-14T10:52:59.422 INFO:teuthology.orchestra.run.smithi002.stdout:(258/286): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-14T10:52:59.447 INFO:teuthology.orchestra.run.smithi002.stdout:(259/286): python3-jaraco-8.2.1-3.el9.noarch.rp 427 kB/s | 11 kB 00:00 2024-09-14T10:52:59.472 INFO:teuthology.orchestra.run.smithi002.stdout:(260/286): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-14T10:52:59.497 INFO:teuthology.orchestra.run.smithi002.stdout:(261/286): python3-jaraco-collections-3.0.0-8.e 929 kB/s | 23 kB 00:00 2024-09-14T10:52:59.531 INFO:teuthology.orchestra.run.smithi002.stdout:(262/286): xorg-x11-fonts-Type1-7.5-33.el9.noar 537 kB/s | 505 kB 00:00 2024-09-14T10:52:59.556 INFO:teuthology.orchestra.run.smithi002.stdout:(263/286): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2024-09-14T10:52:59.598 INFO:teuthology.orchestra.run.smithi002.stdout:(264/286): python3-jaraco-text-3.2.0-6.el9.noar 295 kB/s | 20 kB 00:00 2024-09-14T10:52:59.624 INFO:teuthology.orchestra.run.smithi002.stdout:(265/286): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-14T10:52:59.632 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:52:59.673 INFO:teuthology.orchestra.run.smithi002.stdout:(266/286): python3-kubernetes-26.1.0-2.el9.noar 9.4 MB/s | 1.0 MB 00:00 2024-09-14T10:52:59.699 INFO:teuthology.orchestra.run.smithi002.stdout:(267/286): python3-more-itertools-8.12.0-2.el9. 1.0 MB/s | 79 kB 00:00 2024-09-14T10:52:59.724 INFO:teuthology.orchestra.run.smithi002.stdout:(268/286): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-09-14T10:52:59.750 INFO:teuthology.orchestra.run.smithi002.stdout:(269/286): python3-portend-3.1.0-2.el9.noarch.r 657 kB/s | 16 kB 00:00 2024-09-14T10:52:59.775 INFO:teuthology.orchestra.run.smithi002.stdout:(270/286): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-14T10:52:59.793 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:52:59.800 INFO:teuthology.orchestra.run.smithi002.stdout:(271/286): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-09-14T10:52:59.826 INFO:teuthology.orchestra.run.smithi002.stdout:(272/286): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-14T10:52:59.851 INFO:teuthology.orchestra.run.smithi002.stdout:(273/286): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-14T10:52:59.876 INFO:teuthology.orchestra.run.smithi002.stdout:(274/286): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-14T10:52:59.902 INFO:teuthology.orchestra.run.smithi002.stdout:(275/286): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-14T10:52:59.927 INFO:teuthology.orchestra.run.smithi002.stdout:(276/286): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-14T10:52:59.948 INFO:teuthology.orchestra.run.smithi086.stdout: Preparing : 1/1 2024-09-14T10:52:59.952 INFO:teuthology.orchestra.run.smithi002.stdout:(277/286): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-14T10:52:59.977 INFO:teuthology.orchestra.run.smithi002.stdout:(278/286): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-14T10:52:59.994 INFO:teuthology.orchestra.run.smithi002.stdout:(279/286): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-14T10:53:00.019 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:53:00.028 INFO:teuthology.orchestra.run.smithi002.stdout:(280/286): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-14T10:53:00.053 INFO:teuthology.orchestra.run.smithi002.stdout:(281/286): re2-20211101-20.el9.x86_64.rpm 3.2 MB/s | 191 kB 00:00 2024-09-14T10:53:00.079 INFO:teuthology.orchestra.run.smithi002.stdout:(282/286): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-14T10:53:00.086 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:53:00.129 INFO:teuthology.orchestra.run.smithi002.stdout:(283/286): thrift-0.15.0-2.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-14T10:53:00.198 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:53:00.241 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:53:00.295 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:53:00.336 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:53:00.361 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:53:00.404 INFO:teuthology.orchestra.run.smithi002.stdout:(284/286): librados2-19.3.0-4907.ga2782315.el9. 11 MB/s | 3.5 MB 00:00 2024-09-14T10:53:00.407 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:53:00.480 INFO:teuthology.orchestra.run.smithi002.stdout:(285/286): librbd1-19.3.0-4907.ga2782315.el9.x8 9.3 MB/s | 3.2 MB 00:00 2024-09-14T10:53:00.747 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:53:00.845 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:00.968 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:00.996 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:01.087 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:01.117 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:53:01.155 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:53:01.193 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:53:01.219 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:53:01.244 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:53:01.276 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:53:01.317 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:53:01.353 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:53:01.381 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:53:01.510 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:53:01.651 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:53:01.690 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:53:01.726 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:53:01.754 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:01.859 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:01.888 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:01.943 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:01.967 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:53:01.981 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:02.003 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:02.209 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:02.240 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:02.348 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:53:02.378 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:53:02.414 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:53:02.487 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:53:02.533 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:53:02.572 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:53:02.615 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:53:02.640 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:53:02.667 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:53:02.692 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:53:02.717 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:53:02.737 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:53:02.770 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:53:02.795 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:53:02.844 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:53:02.885 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:02.953 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:03.021 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:53:03.056 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:53:03.100 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:53:03.127 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:53:03.163 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:53:03.271 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:53:03.311 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:53:03.355 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:53:03.396 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:53:03.473 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:53:03.635 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:53:03.692 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:53:04.233 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:53:04.311 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:53:04.339 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:53:04.419 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:53:04.461 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:53:04.497 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:53:04.526 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:53:04.597 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:53:04.634 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:53:04.662 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:53:04.696 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:53:04.735 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:53:04.767 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:53:04.799 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:53:04.852 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:53:04.907 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:53:04.943 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:53:04.979 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:53:05.072 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:53:05.144 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:53:05.217 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:53:05.256 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:53:05.292 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:53:05.340 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:53:05.384 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:53:05.427 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:53:05.566 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:53:05.611 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:53:05.652 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:53:05.765 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:53:05.803 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:53:05.852 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:53:05.884 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:53:05.909 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:53:05.994 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:53:06.120 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:53:06.161 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:53:06.375 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:53:06.412 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:53:06.443 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:53:06.472 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:53:06.514 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:53:06.542 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:53:06.556 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:53:06.557 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:53:06.557 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:06.747 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:53:06.817 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:53:06.874 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:53:06.898 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:53:06.924 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:53:06.950 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:53:07.391 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:07.420 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:07.434 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:53:07.434 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:07.478 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:53:07.505 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:53:07.538 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:53:07.579 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:53:07.613 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:53:07.703 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:53:07.778 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:53:07.808 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:53:07.917 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:53:07.969 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:53:08.722 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:53:08.764 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:53:08.798 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:53:08.901 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:53:08.943 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:53:09.133 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:53:09.179 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:53:09.223 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:53:09.744 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:53:09.813 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:53:09.848 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:53:09.883 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:53:09.915 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:53:10.107 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:53:10.138 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:53:10.221 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:53:10.933 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:53:11.047 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:53:12.354 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:53:12.439 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:53:12.491 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:53:12.525 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:53:12.552 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:53:12.590 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:53:12.602 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:53:12.602 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:53:12.602 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:12.649 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:53:12.677 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:53:12.705 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:53:13.027 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:53:13.068 INFO:teuthology.orchestra.run.smithi086.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:53:13.168 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:53:13.200 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:53:13.231 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:53:13.261 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:53:13.328 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:53:13.419 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:53:13.585 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:53:13.725 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:53:13.892 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:53:14.167 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:53:14.202 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:53:14.230 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:53:14.255 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:53:14.270 INFO:teuthology.orchestra.run.smithi002.stdout:(286/286): python3-scipy-1.6.2-8.el9.x86_64.rpm 928 kB/s | 16 MB 00:17 2024-09-14T10:53:14.275 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-14T10:53:14.275 INFO:teuthology.orchestra.run.smithi002.stdout:Total 7.2 MB/s | 327 MB 00:45 2024-09-14T10:53:14.281 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:53:14.306 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:53:14.331 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:53:14.359 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:53:14.394 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:53:14.441 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:53:14.470 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:53:14.518 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:53:14.553 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:53:15.001 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:53:15.130 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:53:15.184 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:53:15.217 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:53:15.245 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:53:15.325 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:53:15.370 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:53:15.402 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:53:15.422 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:53:15.448 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:53:15.474 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:53:15.514 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:53:15.537 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:53:17.379 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-14T10:53:17.586 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-14T10:53:17.587 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-14T10:53:21.037 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-14T10:53:21.038 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-14T10:53:26.852 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:53:26.902 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:53:26.930 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:53:26.973 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:53:27.004 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:53:27.040 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:53:27.563 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:53:27.595 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:53:27.680 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:53:27.705 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:53:30.094 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:53:30.129 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:53:30.683 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:53:30.725 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:53:30.817 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:53:30.817 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:53:30.817 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:53:30.818 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:30.850 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:53:31.229 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-14T10:53:31.441 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-14T10:53:31.605 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-14T10:53:31.692 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/288 2024-09-14T10:53:31.723 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/288 2024-09-14T10:53:31.798 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/288 2024-09-14T10:53:31.855 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/288 2024-09-14T10:53:31.919 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/288 2024-09-14T10:53:31.967 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/288 2024-09-14T10:53:31.993 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/288 2024-09-14T10:53:32.039 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/288 2024-09-14T10:53:32.448 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/288 2024-09-14T10:53:32.519 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:32.653 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:53:32.686 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:32.762 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:53:32.790 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:53:32.832 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/288 2024-09-14T10:53:32.866 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/288 2024-09-14T10:53:32.892 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/288 2024-09-14T10:53:32.918 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/288 2024-09-14T10:53:32.951 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/288 2024-09-14T10:53:32.983 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/288 2024-09-14T10:53:33.010 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 19/288 2024-09-14T10:53:33.055 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 20/288 2024-09-14T10:53:33.204 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lcms2-2.12-3.el9.x86_64 21/288 2024-09-14T10:53:33.332 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 22/288 2024-09-14T10:53:33.369 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : atk-2.36.0-5.el9.x86_64 23/288 2024-09-14T10:53:33.406 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 24/288 2024-09-14T10:53:33.434 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:33.541 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:53:33.568 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:33.631 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 26/288 2024-09-14T10:53:33.656 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 27/288 2024-09-14T10:53:33.687 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:33.706 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 28/288 2024-09-14T10:53:33.885 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:33.915 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 29/288 2024-09-14T10:53:34.035 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : re2-1:20211101-20.el9.x86_64 30/288 2024-09-14T10:53:34.071 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 31/288 2024-09-14T10:53:34.107 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : liboath-2.6.7-2.el9.x86_64 32/288 2024-09-14T10:53:34.184 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/288 2024-09-14T10:53:34.243 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/288 2024-09-14T10:53:34.282 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-packaging-20.9-5.el9.noarch 35/288 2024-09-14T10:53:34.325 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 36/288 2024-09-14T10:53:34.348 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 37/288 2024-09-14T10:53:34.376 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 38/288 2024-09-14T10:53:34.400 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 39/288 2024-09-14T10:53:34.426 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 40/288 2024-09-14T10:53:34.455 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 41/288 2024-09-14T10:53:34.487 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 42/288 2024-09-14T10:53:34.512 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 43/288 2024-09-14T10:53:34.556 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 44/288 2024-09-14T10:53:34.585 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:34.654 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 45/288 2024-09-14T10:53:34.713 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 46/288 2024-09-14T10:53:34.742 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 47/288 2024-09-14T10:53:34.786 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 48/288 2024-09-14T10:53:34.821 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 49/288 2024-09-14T10:53:34.854 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fuse-2.9.9-16.el9.x86_64 50/288 2024-09-14T10:53:34.934 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 51/288 2024-09-14T10:53:34.980 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 52/288 2024-09-14T10:53:35.025 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 53/288 2024-09-14T10:53:35.067 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 54/288 2024-09-14T10:53:35.146 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 55/288 2024-09-14T10:53:35.293 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 56/288 2024-09-14T10:53:35.363 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 57/288 2024-09-14T10:53:35.939 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rsa-4.9-2.el9.noarch 58/288 2024-09-14T10:53:36.027 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 59/288 2024-09-14T10:53:36.060 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 60/288 2024-09-14T10:53:36.132 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 61/288 2024-09-14T10:53:36.174 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 62/288 2024-09-14T10:53:36.211 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 63/288 2024-09-14T10:53:36.240 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 64/288 2024-09-14T10:53:36.315 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 65/288 2024-09-14T10:53:36.350 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : luarocks-3.9.2-5.el9.noarch 66/288 2024-09-14T10:53:36.392 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 67/288 2024-09-14T10:53:36.427 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 68/288 2024-09-14T10:53:36.466 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 69/288 2024-09-14T10:53:36.497 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 70/288 2024-09-14T10:53:36.552 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 71/288 2024-09-14T10:53:36.598 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 72/288 2024-09-14T10:53:36.657 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 73/288 2024-09-14T10:53:36.699 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 74/288 2024-09-14T10:53:36.736 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 75/288 2024-09-14T10:53:36.859 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 76/288 2024-09-14T10:53:36.928 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 77/288 2024-09-14T10:53:37.010 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 78/288 2024-09-14T10:53:37.063 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 79/288 2024-09-14T10:53:37.099 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 80/288 2024-09-14T10:53:37.147 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 81/288 2024-09-14T10:53:37.200 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 82/288 2024-09-14T10:53:37.242 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 83/288 2024-09-14T10:53:37.390 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 84/288 2024-09-14T10:53:37.435 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 85/288 2024-09-14T10:53:37.486 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 86/288 2024-09-14T10:53:37.594 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 87/288 2024-09-14T10:53:37.635 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 88/288 2024-09-14T10:53:37.676 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 89/288 2024-09-14T10:53:37.708 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 90/288 2024-09-14T10:53:37.733 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 91/288 2024-09-14T10:53:37.817 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 92/288 2024-09-14T10:53:37.950 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 93/288 2024-09-14T10:53:37.993 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 94/288 2024-09-14T10:53:38.218 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 95/288 2024-09-14T10:53:38.261 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 96/288 2024-09-14T10:53:38.293 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 97/288 2024-09-14T10:53:38.322 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 98/288 2024-09-14T10:53:38.366 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 99/288 2024-09-14T10:53:38.392 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:53:38.405 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 100/288 2024-09-14T10:53:38.405 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-14T10:53:38.405 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:53:38.613 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : tzdata-java-2024a-2.el9.noarch 101/288 2024-09-14T10:53:38.704 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 102/288 2024-09-14T10:53:38.766 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 103/288 2024-09-14T10:53:38.790 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:53:38.815 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 104/288 2024-09-14T10:53:38.842 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 105/288 2024-09-14T10:53:39.281 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:39.306 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 106/288 2024-09-14T10:53:39.323 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-14T10:53:39.323 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:53:39.385 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 107/288 2024-09-14T10:53:39.420 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 108/288 2024-09-14T10:53:39.461 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 109/288 2024-09-14T10:53:39.509 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 110/288 2024-09-14T10:53:39.553 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 111/288 2024-09-14T10:53:39.698 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 112/288 2024-09-14T10:53:39.768 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 113/288 2024-09-14T10:53:39.802 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 114/288 2024-09-14T10:53:39.913 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 115/288 2024-09-14T10:53:39.972 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 116/288 2024-09-14T10:53:40.195 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:53:40.195 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /sys 2024-09-14T10:53:40.196 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /proc 2024-09-14T10:53:40.196 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /mnt 2024-09-14T10:53:40.196 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /var/tmp 2024-09-14T10:53:40.196 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /home 2024-09-14T10:53:40.196 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /root 2024-09-14T10:53:40.196 INFO:teuthology.orchestra.run.smithi086.stdout:skipping the directory /tmp 2024-09-14T10:53:40.196 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:40.364 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:53:40.380 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:53:40.380 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:40.380 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:53:40.380 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:40.767 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 117/288 2024-09-14T10:53:40.817 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 118/288 2024-09-14T10:53:40.850 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 119/288 2024-09-14T10:53:40.961 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 120/288 2024-09-14T10:53:41.005 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 121/288 2024-09-14T10:53:41.207 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 122/288 2024-09-14T10:53:41.240 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 123/288 2024-09-14T10:53:41.290 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 124/288 2024-09-14T10:53:41.831 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:53:41.847 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 125/288 2024-09-14T10:53:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:53:41.859 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:41.859 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:53:41.859 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:53:41.859 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:53:41.859 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:41.908 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : osinfo-db-20240701-2.el9.noarch 126/288 2024-09-14T10:53:41.952 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 127/288 2024-09-14T10:53:41.986 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : orc-0.4.31-8.el9.x86_64 128/288 2024-09-14T10:53:42.019 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 129/288 2024-09-14T10:53:42.090 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:53:42.114 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:53:42.114 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:42.114 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:53:42.114 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:53:42.115 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:53:42.115 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:42.216 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-0.3.26-2.el9.x86_64 130/288 2024-09-14T10:53:42.449 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 131/288 2024-09-14T10:53:42.566 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:53:42.589 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:53:42.590 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:42.590 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:53:42.590 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:53:42.590 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:53:42.591 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:42.666 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 132/288 2024-09-14T10:53:42.693 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:53:43.406 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 133/288 2024-09-14T10:53:43.530 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 134/288 2024-09-14T10:53:44.896 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 135/288 2024-09-14T10:53:44.977 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 136/288 2024-09-14T10:53:45.030 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 137/288 2024-09-14T10:53:45.062 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lua-posix-35.0-8.el9.x86_64 138/288 2024-09-14T10:53:45.089 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 139/288 2024-09-14T10:53:45.111 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:53:45.122 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 140/288 2024-09-14T10:53:45.122 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-14T10:53:45.123 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:53:45.177 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 141/288 2024-09-14T10:53:45.215 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 142/288 2024-09-14T10:53:45.252 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libsbc-1.4-9.el9.x86_64 143/288 2024-09-14T10:53:45.555 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:53:45.591 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 144/288 2024-09-14T10:53:45.631 INFO:teuthology.orchestra.run.smithi002.stdout: Upgrading : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:53:45.665 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:53:45.722 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:53:45.732 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 145/288 2024-09-14T10:53:45.787 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:53:45.789 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 146/288 2024-09-14T10:53:45.820 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 147/288 2024-09-14T10:53:45.850 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 148/288 2024-09-14T10:53:45.913 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 149/288 2024-09-14T10:53:45.949 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 150/288 2024-09-14T10:53:45.972 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:53:45.974 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 151/288 2024-09-14T10:53:46.019 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:53:46.020 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 152/288 2024-09-14T10:53:46.047 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:53:46.096 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:53:46.185 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:53:46.323 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:53:46.325 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 153/288 2024-09-14T10:53:46.366 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libexif-0.6.22-6.el9.x86_64 154/288 2024-09-14T10:53:46.366 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:53:46.394 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 155/288 2024-09-14T10:53:46.402 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:53:46.419 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libasyncns-0.8-22.el9.x86_64 156/288 2024-09-14T10:53:46.445 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 157/288 2024-09-14T10:53:46.470 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXv-1.0.11-16.el9.x86_64 158/288 2024-09-14T10:53:46.504 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 159/288 2024-09-14T10:53:46.531 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 160/288 2024-09-14T10:53:46.568 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 161/288 2024-09-14T10:53:46.610 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 162/288 2024-09-14T10:53:46.644 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 163/288 2024-09-14T10:53:46.693 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 164/288 2024-09-14T10:53:46.727 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : poppler-21.01.0-21.el9.x86_64 165/288 2024-09-14T10:53:47.208 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 166/288 2024-09-14T10:53:47.270 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:53:47.325 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:53:47.365 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 167/288 2024-09-14T10:53:47.416 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 168/288 2024-09-14T10:53:47.450 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 169/288 2024-09-14T10:53:47.487 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gsm-1.0.19-6.el9.x86_64 170/288 2024-09-14T10:53:47.567 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 171/288 2024-09-14T10:53:47.619 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 172/288 2024-09-14T10:53:47.643 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:53:47.663 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 173/288 2024-09-14T10:53:47.673 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:53:47.689 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : graphene-1.10.6-2.el9.x86_64 174/288 2024-09-14T10:53:47.715 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:53:47.715 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : giflib-5.2.1-9.el9.x86_64 175/288 2024-09-14T10:53:47.752 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 176/288 2024-09-14T10:53:47.754 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:53:47.773 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:53:47.778 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:53:47.808 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:53:47.845 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:53:47.873 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:53:47.898 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:53:47.924 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:53:47.948 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:53:47.975 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:53:48.000 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:53:48.027 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:53:48.066 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:53:48.094 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:53:48.129 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:53:48.165 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:53:48.196 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:53:48.230 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:53:48.264 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:53:48.300 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:53:48.339 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:53:48.381 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:53:48.426 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:53:48.458 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:53:48.489 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:53:48.542 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:53:48.574 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:53:48.604 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:53:48.642 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:53:48.668 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:53:48.837 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:53:48.868 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:53:48.895 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:53:48.922 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:53:48.954 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:53:49.078 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:53:49.136 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:53:49.205 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:53:49.242 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:53:49.367 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:53:49.430 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:53:49.445 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:53:49.475 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:53:49.498 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:53:49.886 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:53:49.910 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:53:49.926 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:53:49.926 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:53:49.927 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:50.153 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:53:50.229 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:53:50.268 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:53:50.313 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:53:50.338 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:53:50.744 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:53:50.775 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:53:50.791 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:53:51.339 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:53:51.420 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:53:51.468 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:53:51.497 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:53:51.704 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:53:51.758 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:53:51.784 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:53:51.806 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:53:51.835 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:53:51.905 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:53:51.938 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:53:51.949 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:53:51.971 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:53:51.985 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:53:52.006 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:53:52.443 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:53:52.470 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:53:52.503 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:53:52.577 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:53:52.603 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:53:55.780 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:53:55.833 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:53:56.795 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:53:56.825 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:53:56.940 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:53:57.113 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:53:57.136 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:53:57.160 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:53:57.160 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:57.160 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:53:57.160 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:53:57.160 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:53:57.160 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:57.212 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:53:57.224 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:53:57.246 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:53:57.275 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:53:57.324 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:53:57.347 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:53:57.363 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:53:57.363 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:53:57.364 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:58.323 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:53:58.347 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:53:58.347 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:58.347 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:53:58.347 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:53:58.348 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:53:58.348 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:58.399 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:53:58.422 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:53:58.422 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:58.422 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:53:58.422 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:58.733 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:53:58.756 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:53:58.756 INFO:teuthology.orchestra.run.smithi086.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:53:58.757 INFO:teuthology.orchestra.run.smithi086.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:53:58.757 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:53:58.757 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:53:58.757 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:53:59.717 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 177/288 2024-09-14T10:53:59.762 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 178/288 2024-09-14T10:53:59.807 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 179/288 2024-09-14T10:53:59.853 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 180/288 2024-09-14T10:53:59.889 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 181/288 2024-09-14T10:53:59.926 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 182/288 2024-09-14T10:54:00.450 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 183/288 2024-09-14T10:54:00.479 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:54:00.563 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 184/288 2024-09-14T10:54:00.607 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 185/288 2024-09-14T10:54:03.005 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:03.047 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:03.464 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:54:03.502 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:54:03.534 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:54:03.633 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 186/288 2024-09-14T10:54:03.638 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:54:03.675 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:54:03.694 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:54:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:54:03.725 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:54:03.755 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 187/288 2024-09-14T10:54:03.755 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-14T10:54:03.755 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-14T10:54:03.755 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:03.784 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:54:03.818 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:54:03.818 INFO:teuthology.orchestra.run.smithi086.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:03.917 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:03.937 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:54:03.943 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:54:03.952 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:54:03.963 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:54:03.963 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:54:03.963 INFO:teuthology.orchestra.run.smithi086.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:54:03.963 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:04.028 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:54:04.097 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:54:13.569 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 188/288 2024-09-14T10:54:13.569 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /sys 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /proc 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /mnt 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /var/tmp 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /home 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /root 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi002.stdout:skipping the directory /tmp 2024-09-14T10:54:13.570 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:13.749 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:54:13.765 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 189/288 2024-09-14T10:54:13.765 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:13.766 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-14T10:54:13.766 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:14.136 INFO:teuthology.orchestra.run.smithi086.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:14.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:54:14.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:54:14.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:54:14.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:54:14.136 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:54:14.137 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:54:14.138 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:54:14.139 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:54:14.140 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:54:14.141 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:54:14.142 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:54:14.143 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:54:14.144 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:54:14.145 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:54:14.146 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:54:14.147 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:54:14.148 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:54:14.149 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:54:14.150 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:54:14.151 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:54:14.152 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:54:14.153 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:54:14.154 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:54:14.155 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:54:14.156 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:54:14.157 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:54:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:54:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:54:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:54:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:54:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:54:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:54:14.158 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:54:15.316 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:54:15.346 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 190/288 2024-09-14T10:54:15.346 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:15.346 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-14T10:54:15.346 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:54:15.346 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-14T10:54:15.346 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:15.583 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:54:15.608 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 191/288 2024-09-14T10:54:15.608 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:15.608 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-14T10:54:15.608 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:54:15.608 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-14T10:54:15.608 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:16.076 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:54:16.100 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 192/288 2024-09-14T10:54:16.100 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:16.101 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-14T10:54:16.101 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:54:16.101 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-14T10:54:16.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:16.209 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 193/288 2024-09-14T10:54:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:17.703 INFO:teuthology.orchestra.run.smithi086.stdout:Upgraded: 2024-09-14T10:54:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.703 INFO:teuthology.orchestra.run.smithi086.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout:Installed: 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:54:17.704 INFO:teuthology.orchestra.run.smithi086.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.705 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.706 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.707 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:54:17.708 INFO:teuthology.orchestra.run.smithi086.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:54:17.709 INFO:teuthology.orchestra.run.smithi086.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:54:17.710 INFO:teuthology.orchestra.run.smithi086.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:54:17.711 INFO:teuthology.orchestra.run.smithi086.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:54:17.712 INFO:teuthology.orchestra.run.smithi086.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:54:17.713 INFO:teuthology.orchestra.run.smithi086.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:54:17.714 INFO:teuthology.orchestra.run.smithi086.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:54:17.715 INFO:teuthology.orchestra.run.smithi086.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:54:17.716 INFO:teuthology.orchestra.run.smithi086.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:54:17.717 INFO:teuthology.orchestra.run.smithi086.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:54:17.718 INFO:teuthology.orchestra.run.smithi086.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:54:17.719 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:54:17.720 INFO:teuthology.orchestra.run.smithi086.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:54:17.721 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:54:17.722 INFO:teuthology.orchestra.run.smithi086.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:54:17.723 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:54:17.724 INFO:teuthology.orchestra.run.smithi086.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:54:17.725 INFO:teuthology.orchestra.run.smithi086.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:54:17.726 INFO:teuthology.orchestra.run.smithi086.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:54:17.727 INFO:teuthology.orchestra.run.smithi086.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:54:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:54:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:54:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:54:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:54:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:54:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:54:17.728 INFO:teuthology.orchestra.run.smithi086.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:54:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:54:17.729 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:17.729 INFO:teuthology.orchestra.run.smithi086.stdout:Complete! 2024-09-14T10:54:18.139 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:19.322 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 194/288 2024-09-14T10:54:19.427 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 195/288 2024-09-14T10:54:19.485 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-ply-3.11-14.el9.noarch 196/288 2024-09-14T10:54:19.559 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 197/288 2024-09-14T10:54:19.755 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 198/288 2024-09-14T10:54:19.797 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 199/288 2024-09-14T10:54:19.878 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 200/288 2024-09-14T10:54:19.976 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 201/288 2024-09-14T10:54:20.120 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 202/288 2024-09-14T10:54:20.171 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 203/288 2024-09-14T10:54:20.206 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 204/288 2024-09-14T10:54:21.136 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 205/288 2024-09-14T10:54:21.186 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:54:21.559 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 206/288 2024-09-14T10:54:21.593 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 207/288 2024-09-14T10:54:21.623 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : slf4j-1.7.30-13.el9.noarch 208/288 2024-09-14T10:54:21.651 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : atinject-1.0.3-6.el9.noarch 209/288 2024-09-14T10:54:21.686 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 210/288 2024-09-14T10:54:21.723 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 211/288 2024-09-14T10:54:21.750 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 212/288 2024-09-14T10:54:21.776 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 213/288 2024-09-14T10:54:21.802 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 214/288 2024-09-14T10:54:21.826 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 215/288 2024-09-14T10:54:21.853 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 216/288 2024-09-14T10:54:21.878 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 217/288 2024-09-14T10:54:21.906 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 218/288 2024-09-14T10:54:21.936 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 219/288 2024-09-14T10:54:21.963 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 220/288 2024-09-14T10:54:21.990 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 221/288 2024-09-14T10:54:22.018 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 222/288 2024-09-14T10:54:22.049 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 223/288 2024-09-14T10:54:22.083 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 224/288 2024-09-14T10:54:22.117 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jansi-2.3.3-6.el9.x86_64 225/288 2024-09-14T10:54:22.154 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jsoup-1.13.1-10.el9.noarch 226/288 2024-09-14T10:54:22.193 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 227/288 2024-09-14T10:54:22.235 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 228/288 2024-09-14T10:54:22.279 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 229/288 2024-09-14T10:54:22.312 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : guava-30.1-6.el9.noarch 230/288 2024-09-14T10:54:22.342 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : google-guice-4.2.3-9.el9.noarch 231/288 2024-09-14T10:54:22.397 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 232/288 2024-09-14T10:54:22.427 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 233/288 2024-09-14T10:54:22.458 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 234/288 2024-09-14T10:54:22.486 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 235/288 2024-09-14T10:54:22.512 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 236/288 2024-09-14T10:54:22.690 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 237/288 2024-09-14T10:54:22.729 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 238/288 2024-09-14T10:54:22.756 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 239/288 2024-09-14T10:54:22.783 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 240/288 2024-09-14T10:54:22.816 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 241/288 2024-09-14T10:54:22.939 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 242/288 2024-09-14T10:54:23.007 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 243/288 2024-09-14T10:54:23.077 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 244/288 2024-09-14T10:54:23.111 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:54:23.236 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 245/288 2024-09-14T10:54:23.275 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:54:23.297 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 246/288 2024-09-14T10:54:23.328 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 247/288 2024-09-14T10:54:23.343 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 248/288 2024-09-14T10:54:23.768 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:23.797 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 249/288 2024-09-14T10:54:23.813 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-14T10:54:23.813 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:24.051 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 250/288 2024-09-14T10:54:24.123 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 251/288 2024-09-14T10:54:24.166 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 252/288 2024-09-14T10:54:24.202 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 253/288 2024-09-14T10:54:24.227 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 254/288 2024-09-14T10:54:24.635 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:24.664 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:24.681 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 255/288 2024-09-14T10:54:25.217 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:54:25.305 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 256/288 2024-09-14T10:54:25.355 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:54:25.385 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 257/288 2024-09-14T10:54:25.602 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 258/288 2024-09-14T10:54:25.663 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 259/288 2024-09-14T10:54:25.696 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:54:25.718 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 260/288 2024-09-14T10:54:25.747 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:54:25.819 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 261/288 2024-09-14T10:54:25.850 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:54:25.861 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 262/288 2024-09-14T10:54:25.892 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:54:25.922 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 263/288 2024-09-14T10:54:25.951 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 264/288 2024-09-14T10:54:26.332 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:54:26.356 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 265/288 2024-09-14T10:54:26.393 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 266/288 2024-09-14T10:54:26.460 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 267/288 2024-09-14T10:54:26.489 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:54:29.908 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 268/288 2024-09-14T10:54:29.970 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:54:30.991 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 269/288 2024-09-14T10:54:31.020 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:54:31.144 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 270/288 2024-09-14T10:54:31.307 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 271/288 2024-09-14T10:54:31.339 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:54:31.363 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 272/288 2024-09-14T10:54:31.363 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:31.363 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-14T10:54:31.364 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:54:31.364 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-14T10:54:31.364 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:31.414 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:54:31.426 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 273/288 2024-09-14T10:54:31.449 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 274/288 2024-09-14T10:54:31.478 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 275/288 2024-09-14T10:54:31.528 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 276/288 2024-09-14T10:54:31.558 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:54:31.574 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 277/288 2024-09-14T10:54:31.574 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-14T10:54:31.574 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:32.600 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:54:32.625 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 278/288 2024-09-14T10:54:32.625 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:32.625 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-14T10:54:32.625 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:54:32.625 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-14T10:54:32.625 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:32.668 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:54:32.691 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4907.ga2782 279/288 2024-09-14T10:54:32.692 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:32.692 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-14T10:54:32.692 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:33.018 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:54:33.043 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 280/288 2024-09-14T10:54:33.043 INFO:teuthology.orchestra.run.smithi002.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-14T10:54:33.043 INFO:teuthology.orchestra.run.smithi002.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-14T10:54:33.043 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:33.043 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-14T10:54:33.043 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:38.056 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 281/288 2024-09-14T10:54:38.097 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 282/288 2024-09-14T10:54:38.128 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 283/288 2024-09-14T10:54:38.237 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 284/288 2024-09-14T10:54:38.298 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:54:38.327 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 286/288 2024-09-14T10:54:38.328 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:54:38.403 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 287/288 2024-09-14T10:54:38.403 INFO:teuthology.orchestra.run.smithi002.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:38.477 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:38.497 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 288/288 2024-09-14T10:54:38.503 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 288/288 2024-09-14T10:54:38.512 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 288/288 2024-09-14T10:54:38.522 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 288/288 2024-09-14T10:54:38.523 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:54:38.523 INFO:teuthology.orchestra.run.smithi002.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-14T10:54:38.523 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:38.593 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:54:38.666 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 288/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-2:19.3.0-4907.ga2782315.el9.x86_64 1/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 3/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 4/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4907.ga2782 5/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 6/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 7/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 8/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 9/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 10/288 2024-09-14T10:54:48.607 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 11/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 12/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_ 13/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 14/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 15/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados-devel-2:19.3.0-4907.ga2782315.el9.x86_6 16/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86 17/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 18/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4907.ga2782315.el 19/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ceph-common-2:19.3.0-4907.ga2782315.el9. 20/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_6 21/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 22/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 23/288 2024-09-14T10:54:48.608 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 24/288 2024-09-14T10:54:48.609 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 25/288 2024-09-14T10:54:48.609 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 26/288 2024-09-14T10:54:48.609 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 27/288 2024-09-14T10:54:48.609 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4907.ga2782315. 28/288 2024-09-14T10:54:48.609 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noa 29/288 2024-09-14T10:54:48.609 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.n 30/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4907.ga27 31/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el 32/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 33/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.e 34/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 35/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cephadm-2:19.3.0-4907.ga2782315.el9.noarch 36/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/288 2024-09-14T10:54:48.631 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/288 2024-09-14T10:54:48.632 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/288 2024-09-14T10:54:48.633 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/288 2024-09-14T10:54:48.634 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : guava-30.1-6.el9.noarch 91/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/288 2024-09-14T10:54:48.635 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/288 2024-09-14T10:54:48.636 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/288 2024-09-14T10:54:48.637 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 133/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 134/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 135/288 2024-09-14T10:54:48.638 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 136/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 137/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 138/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 139/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libsbc-1.4-9.el9.x86_64 140/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 141/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 142/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 143/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 144/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 145/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 146/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 147/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 148/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 149/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 150/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 151/288 2024-09-14T10:54:48.639 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 152/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 153/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 154/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 155/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 156/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-5.4.4-4.el9.x86_64 157/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 158/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 159/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 160/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 161/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 162/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 163/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 164/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 165/288 2024-09-14T10:54:48.640 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 166/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 167/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 168/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 169/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 170/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 171/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 172/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 173/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 174/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : opus-1.3.1-10.el9.x86_64 175/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : orc-0.4.31-8.el9.x86_64 176/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 177/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 178/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 179/288 2024-09-14T10:54:48.641 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 180/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 181/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 182/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 183/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 184/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 185/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 186/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 187/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 188/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 189/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 190/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 191/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 192/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 193/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 194/288 2024-09-14T10:54:48.642 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 195/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 196/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 197/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 198/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 199/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 200/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 201/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 202/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 203/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 204/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 205/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 206/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 207/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 208/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 209/288 2024-09-14T10:54:48.643 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 210/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 211/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 212/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 213/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 214/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 215/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 216/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 217/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 218/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 219/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 220/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : rtkit-0.11-29.el9.x86_64 221/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 222/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 223/288 2024-09-14T10:54:48.644 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 224/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 225/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 226/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 227/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 228/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 229/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 230/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : upower-0.99.11-11.el9.x86_64 231/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 232/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 233/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 234/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 235/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 236/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 237/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 238/288 2024-09-14T10:54:48.645 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 239/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 240/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 241/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 242/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 243/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 244/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 245/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 246/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 247/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 248/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 249/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 250/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 251/288 2024-09-14T10:54:48.646 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 252/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 253/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 254/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 255/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 256/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 257/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 258/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 259/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 260/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 261/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 262/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 263/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 264/288 2024-09-14T10:54:48.647 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 265/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 266/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 267/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 268/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 269/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 270/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 271/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 272/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 273/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 274/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 275/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 276/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 277/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 278/288 2024-09-14T10:54:48.648 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 279/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 280/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 281/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : re2-1:20211101-20.el9.x86_64 282/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 283/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 284/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:19.3.0-4907.ga2782315.el9.x86_64 285/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 286/288 2024-09-14T10:54:48.649 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 287/288 2024-09-14T10:54:52.135 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 288/288 2024-09-14T10:54:52.135 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:52.135 INFO:teuthology.orchestra.run.smithi002.stdout:Upgraded: 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: librados2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: librbd1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-14T10:54:52.136 INFO:teuthology.orchestra.run.smithi002.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: atinject-1.0.3-6.el9.noarch 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: atk-2.36.0-5.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-base-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.137 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-grafana-dashboards-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-immutable-object-cache-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mds-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-dashboard-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-modules-core-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mgr-rook-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-mon-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-osd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.138 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-prometheus-alerts-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-radosgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-selinux-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-test-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: ceph-volume-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: cephadm-2:19.3.0-4907.ga2782315.el9.noarch 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-14T10:54:52.139 INFO:teuthology.orchestra.run.smithi002.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-14T10:54:52.140 INFO:teuthology.orchestra.run.smithi002.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: guava-30.1-6.el9.noarch 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-14T10:54:52.141 INFO:teuthology.orchestra.run.smithi002.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: lcms2-2.12-3.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-14T10:54:52.142 INFO:teuthology.orchestra.run.smithi002.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-14T10:54:52.143 INFO:teuthology.orchestra.run.smithi002.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libcephfs2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libcephsqlite-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-14T10:54:52.144 INFO:teuthology.orchestra.run.smithi002.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-14T10:54:52.145 INFO:teuthology.orchestra.run.smithi002.stdout: librados-devel-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libradosstriper1-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: librgw2-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libsbc-1.4-9.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-14T10:54:52.146 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: lua-5.4.4-4.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-14T10:54:52.147 INFO:teuthology.orchestra.run.smithi002.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-14T10:54:52.148 INFO:teuthology.orchestra.run.smithi002.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: opus-1.3.1-10.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: orc-0.4.31-8.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-14T10:54:52.149 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-14T10:54:52.150 INFO:teuthology.orchestra.run.smithi002.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-argparse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ceph-common-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cephfs-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-14T10:54:52.151 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-14T10:54:52.152 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-14T10:54:52.153 INFO:teuthology.orchestra.run.smithi002.stdout: python3-ply-3.11-14.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rados-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-14T10:54:52.154 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rgw-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-14T10:54:52.155 INFO:teuthology.orchestra.run.smithi002.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-fuse-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-mirror-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: rbd-nbd-2:19.3.0-4907.ga2782315.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: re2-1:20211101-20.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: rtkit-0.11-29.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-14T10:54:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: upower-0.99.11-11.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-14T10:54:52.157 INFO:teuthology.orchestra.run.smithi002.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-14T10:54:52.158 INFO:teuthology.orchestra.run.smithi002.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-14T10:54:52.158 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:52.158 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-14T10:54:52.564 DEBUG:teuthology.parallel:result is None 2024-09-14T10:54:52.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:54:52.702 DEBUG:teuthology.orchestra.run.smithi002:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:54:52.765 INFO:teuthology.orchestra.run.smithi002.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:54:52.766 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:54:52.766 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:54:52.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a2782315255a3e7d5f6cdc9eb35785187ff6ddf8 2024-09-14T10:54:52.900 DEBUG:teuthology.orchestra.run.smithi086:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-14T10:54:52.981 INFO:teuthology.orchestra.run.smithi086.stdout:19.3.0-4907.ga2782315.el9 2024-09-14T10:54:52.981 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4907.ga2782315.el9 2024-09-14T10:54:52.981 INFO:teuthology.task.install:The correct ceph version 19.3.0-4907.ga2782315 is installed. 2024-09-14T10:54:52.983 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-14T10:54:52.983 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:52.983 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:54:53.027 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:54:53.027 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-14T10:54:53.073 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-14T10:54:53.073 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:53.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:54:53.114 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:54:53.195 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:54:53.195 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/daemon-helper 2024-09-14T10:54:53.238 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-14T10:54:53.318 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-14T10:54:53.319 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:53.319 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:54:53.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:54:53.440 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:54:53.440 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-14T10:54:53.479 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-14T10:54:53.557 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-14T10:54:53.558 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:53.558 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:54:53.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:54:53.678 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:54:53.678 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/usr/bin/stdin-killer 2024-09-14T10:54:53.716 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-14T10:54:53.794 INFO:teuthology.run_tasks:Running task ceph... 2024-09-14T10:54:53.868 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-14T10:54:53.868 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 777 /var/log/ceph 2024-09-14T10:54:53.870 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 777 /var/log/ceph 2024-09-14T10:54:53.908 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-14T10:54:53.909 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:54:53.950 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-14T10:54:53.988 INFO:tasks.ceph:Creating extra log directories... 2024-09-14T10:54:53.988 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:54:54.030 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-14T10:54:54.078 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-14T10:54:54.078 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-14T10:54:54.079 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141', 'branch': 'main', 'description': 'rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7904141', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0'}, 'compression type': 'random', 'ec-data-pool': False, 'frontend': 'beast', 'inline data': False, 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 950, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 9419, 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8', 'sleep_before_teardown': 0, 'subset': '0/1', 'suite': 'rgw', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_1c941a66c1b420259b8fc5ac19e792dbbf60aded/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': '1c941a66c1b420259b8fc5ac19e792dbbf60aded', 'targets': {'smithi002.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBAVuEMpULaiItpQi0c4ffW6zR5BAD+tb9GZRM1EKuVhipQ8/z7Vh3lp4OsoZkGXrqK562SUVx/ENDY6ia+GcU0w=', 'smithi086.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKkDDkKdsXSOOf5ShFDQAj53HhwcKeoBeys8TAE4SnDPUckY9gEAp/sfaRdUs4jMsZ2QtPEWb4sJ7wij97OFQgQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'a2782315255a3e7d5f6cdc9eb35785187ff6ddf8'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-13_20:40:18', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-14T10:54:54.079 DEBUG:teuthology.orchestra.run.smithi002:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:54:54.110 DEBUG:teuthology.orchestra.run.smithi086:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-14T10:54:54.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:54:54.181 DEBUG:teuthology.orchestra.run.smithi086:> sudo install -d -m0777 -- /var/run/ceph 2024-09-14T10:54:54.219 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:54.219 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:54:54.288 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:54:54.288 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_1 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-14 10:54:39.676147564 +0000 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-14 10:51:49.096802826 +0000 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-14 10:51:49.096802826 +0000 2024-09-14T10:54:54.358 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-14 10:51:49.096802826 +0000 2024-09-14T10:54:54.359 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:54:54.436 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-14T10:54:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-14T10:54:54.437 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 8.7679e-05 s, 5.8 MB/s 2024-09-14T10:54:54.438 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:54:54.509 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_2 2024-09-14T10:54:54.580 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:54:54.580 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:54.580 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-14T10:54:54.580 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:54.580 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:54.580 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-14 10:54:39.676147564 +0000 2024-09-14T10:54:54.581 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-14 10:51:49.405795810 +0000 2024-09-14T10:54:54.581 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-14 10:51:49.405795810 +0000 2024-09-14T10:54:54.581 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-14 10:51:49.405795810 +0000 2024-09-14T10:54:54.581 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:54:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-14T10:54:54.658 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-14T10:54:54.659 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000107427 s, 4.8 MB/s 2024-09-14T10:54:54.660 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:54:54.729 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_3 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-14 10:54:39.677147542 +0000 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-14 10:51:49.729788454 +0000 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-14 10:51:49.729788454 +0000 2024-09-14T10:54:54.799 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-14 10:51:49.729788454 +0000 2024-09-14T10:54:54.800 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:54:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-14T10:54:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-14T10:54:54.877 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000111188 s, 4.6 MB/s 2024-09-14T10:54:54.879 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:54:54.949 DEBUG:teuthology.orchestra.run.smithi002:> stat /dev/vg_nvme/lv_4 2024-09-14T10:54:55.017 INFO:teuthology.orchestra.run.smithi002.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:Access: 2024-09-14 10:54:39.677147542 +0000 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:Modify: 2024-09-14 10:51:50.056781029 +0000 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout:Change: 2024-09-14 10:51:50.056781029 +0000 2024-09-14T10:54:55.018 INFO:teuthology.orchestra.run.smithi002.stdout: Birth: 2024-09-14 10:51:50.056781029 +0000 2024-09-14T10:54:55.018 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:54:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records in 2024-09-14T10:54:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:1+0 records out 2024-09-14T10:54:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:512 bytes copied, 0.000104171 s, 4.9 MB/s 2024-09-14T10:54:55.097 DEBUG:teuthology.orchestra.run.smithi002:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:54:55.168 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:54:55.168 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:54:55.169 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/scratch_devs of=/dev/stdout 2024-09-14T10:54:55.203 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-14T10:54:55.203 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_1 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 10:54:05.127269835 +0000 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 10:51:44.857148826 +0000 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 10:51:44.857148826 +0000 2024-09-14T10:54:55.276 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 10:51:44.857148826 +0000 2024-09-14T10:54:55.276 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-14T10:54:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T10:54:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T10:54:55.356 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000301079 s, 1.7 MB/s 2024-09-14T10:54:55.358 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-14T10:54:55.428 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_2 2024-09-14T10:54:55.500 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 10:54:05.128269811 +0000 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 10:51:45.202140806 +0000 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 10:51:45.202140806 +0000 2024-09-14T10:54:55.501 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 10:51:45.202140806 +0000 2024-09-14T10:54:55.501 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-14T10:54:55.577 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T10:54:55.577 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T10:54:55.578 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000197289 s, 2.6 MB/s 2024-09-14T10:54:55.579 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-14T10:54:55.648 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_3 2024-09-14T10:54:55.717 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-14T10:54:55.717 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:55.717 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-14T10:54:55.717 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:55.718 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:55.718 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 10:54:05.128269811 +0000 2024-09-14T10:54:55.718 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 10:51:45.529133205 +0000 2024-09-14T10:54:55.718 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 10:51:45.529133205 +0000 2024-09-14T10:54:55.718 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 10:51:45.529133205 +0000 2024-09-14T10:54:55.718 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-14T10:54:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T10:54:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T10:54:55.794 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000275265 s, 1.9 MB/s 2024-09-14T10:54:55.795 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-14T10:54:55.865 DEBUG:teuthology.orchestra.run.smithi086:> stat /dev/vg_nvme/lv_4 2024-09-14T10:54:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-14T10:54:55.933 INFO:teuthology.orchestra.run.smithi086.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-14T10:54:55.933 INFO:teuthology.orchestra.run.smithi086.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-14T10:54:55.934 INFO:teuthology.orchestra.run.smithi086.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-14T10:54:55.934 INFO:teuthology.orchestra.run.smithi086.stdout:Context: system_u:object_r:device_t:s0 2024-09-14T10:54:55.934 INFO:teuthology.orchestra.run.smithi086.stdout:Access: 2024-09-14 10:54:05.128269811 +0000 2024-09-14T10:54:55.934 INFO:teuthology.orchestra.run.smithi086.stdout:Modify: 2024-09-14 10:51:45.854125651 +0000 2024-09-14T10:54:55.934 INFO:teuthology.orchestra.run.smithi086.stdout:Change: 2024-09-14 10:51:45.854125651 +0000 2024-09-14T10:54:55.934 INFO:teuthology.orchestra.run.smithi086.stdout: Birth: 2024-09-14 10:51:45.854125651 +0000 2024-09-14T10:54:55.934 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-14T10:54:56.010 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records in 2024-09-14T10:54:56.010 INFO:teuthology.orchestra.run.smithi086.stderr:1+0 records out 2024-09-14T10:54:56.010 INFO:teuthology.orchestra.run.smithi086.stderr:512 bytes copied, 0.000267019 s, 1.9 MB/s 2024-09-14T10:54:56.011 DEBUG:teuthology.orchestra.run.smithi086:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-14T10:54:56.082 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:54:56.082 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:54:56.082 INFO:tasks.ceph:Generating config... 2024-09-14T10:54:56.083 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-14T10:54:56.083 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-14T10:54:56.083 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-14T10:54:56.083 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-14T10:54:56.083 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw max chunk size = 4194304 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw obj stripe size = 6291456 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-14T10:54:56.084 INFO:tasks.ceph:[client] setuser = ceph 2024-09-14T10:54:56.084 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-14T10:54:56.084 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-14T10:54:56.084 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-14T10:54:56.084 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-14T10:54:56.085 INFO:tasks.ceph:[global] rgw override bucket index max shards = 1 2024-09-14T10:54:56.085 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-14T10:54:56.085 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-14T10:54:56.085 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-14T10:54:56.085 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-14T10:54:56.085 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-14T10:54:56.085 INFO:tasks.ceph:[mon] lockdep = True 2024-09-14T10:54:56.085 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-14T10:54:56.085 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-14T10:54:56.085 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-14T10:54:56.085 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-14T10:54:56.085 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-14T10:54:56.085 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] lockdep = True 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-14T10:54:56.086 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-14T10:54:56.088 INFO:tasks.ceph:Setting up mon.a... 2024-09-14T10:54:56.088 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-14T10:54:56.164 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.keyring 2024-09-14T10:54:56.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-14T10:54:56.229 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:54:56.270 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.2'), ('mon.c', '[v2:172.21.15.2:3301,v1:172.21.15.2:6790]'), ('mon.b', '172.21.15.86')] 2024-09-14T10:54:56.270 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.2,[v2:172.21.15.2:3301,v1:172.21.15.2:6790],172.21.15.86', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10, 'rgw override bucket index max shards': 1}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw max chunk size': 4194304, 'rgw obj stripe size': 6291456, 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-14T10:54:56.271 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:56.271 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:54:56.339 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.2 --addv c '[v2:172.21.15.2:3301,v1:172.21.15.2:6790]' --add b 172.21.15.86 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:56.440 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:54:56.440 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:54:56.441 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:56.441 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: generated fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T10:54:56.441 INFO:teuthology.orchestra.run.smithi002.stdout:setting min_mon_release = quincy 2024-09-14T10:54:56.441 INFO:teuthology.orchestra.run.smithi002.stdout:epoch 0 2024-09-14T10:54:56.441 INFO:teuthology.orchestra.run.smithi002.stdout:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T10:54:56.441 INFO:teuthology.orchestra.run.smithi002.stdout:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T10:54:56.441 INFO:teuthology.orchestra.run.smithi002.stdout:created 2024-09-14T10:54:56.444181+0000 2024-09-14T10:54:56.442 INFO:teuthology.orchestra.run.smithi002.stdout:min_mon_release 17 (quincy) 2024-09-14T10:54:56.442 INFO:teuthology.orchestra.run.smithi002.stdout:election_strategy: 1 2024-09-14T10:54:56.442 INFO:teuthology.orchestra.run.smithi002.stdout:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T10:54:56.442 INFO:teuthology.orchestra.run.smithi002.stdout:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T10:54:56.442 INFO:teuthology.orchestra.run.smithi002.stdout:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T10:54:56.442 INFO:teuthology.orchestra.run.smithi002.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-14T10:54:56.443 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-14T10:54:56.473 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 28256c28-b166-4632-9431-ec178da9e31e... 2024-09-14T10:54:56.474 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:54:56.516 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout:[global] 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: chdir = "" 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: auth supported = cephx 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: filestore xattr use omap = true 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: mon clock drift allowed = 1.000 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: osd crush chooseleaf type = 0 2024-09-14T10:54:56.572 INFO:teuthology.orchestra.run.smithi002.stdout: auth debug = true 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on old message = true 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: ms die on bug = true 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: mon pg warn max object skew = 0 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default size = 2 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.573 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow primary affinity = true 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd allow pg remap = true 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on no sortbitwise = false 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon warn on too few osds = false 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: mon_allow_pool_size_one = true 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.574 INFO:teuthology.orchestra.run.smithi002.stdout: osd default data pool replay window = 5 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: mon allow pool delete = true 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: mon cluster log file level = debug 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: debug asserts on shutdown = true 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: mon health detail to clog = false 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: mon host = "172.21.15.2,[v2:172.21.15.2:3301,v1:172.21.15.2:6790],172.21.15.86" 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: mon client directed command retry = 5 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: ms inject socket failures = 5000 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: rgw override bucket index max shards = 1 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: fsid = 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T10:54:56.575 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout:[osd] 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd journal size = 100 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub load threshold = 5.0 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd scrub max interval = 600 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd recover clone overlap = true 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd recovery max chunk = 1048576 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug shutdown = true 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug op order = true 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug verify stray on activate = true 2024-09-14T10:54:56.576 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug trim objects = true 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: osd open classes on start = true 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug pg log writeout = true 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: osd map max advance = 10 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: journal zero on create = true 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: filestore apply finisher threads = 3 2024-09-14T10:54:56.577 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: bdev debug aio = true 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: osd debug misdirected ops = true 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: bdev async discard = True 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: bdev enable discard = True 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore allocator = bitmap 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore block size = 96636764160 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: bluestore fsck on mount = True 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluefs = 1/20 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: debug bluestore = 1/20 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-14T10:54:56.578 INFO:teuthology.orchestra.run.smithi002.stdout: debug objclass = 20 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: debug osd = 20 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: debug rocksdb = 4/10 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: lockdep = True 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd full ratio = 0.9 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: osd objectstore = bluestore 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: osd shutdown pgref assert = True 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr] 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: debug mgr = 20 2024-09-14T10:54:56.579 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mgr/telemetry/nag = false 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout:[mon] 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: debug ms = 1 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: debug mon = 20 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: debug paxos = 20 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: debug auth = 20 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mon data avail warn = 5 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mon mgr mkfs grace = 240 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd reporter subtree level = osd 2024-09-14T10:54:56.580 INFO:teuthology.orchestra.run.smithi002.stdout: mon osd prime pg temp = true 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: # 1m isn't quite enough 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.581 INFO:teuthology.orchestra.run.smithi002.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: lockdep = True 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout:[client] 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: rgw cache enabled = true 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable ops log = true 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: rgw enable usage log = true 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: debug rgw = 20 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: debug rgw notification = 20 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: rgw bucket counters cache = True 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: rgw crypt require ssl = False 2024-09-14T10:54:56.582 INFO:teuthology.orchestra.run.smithi002.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw max chunk size = 4194304 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw obj stripe size = 6291456 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw s3 auth use sts = True 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw torrent flag = True 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: rgw user counters cache = True 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: setgroup = ceph 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout: setuser = ceph 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.a] 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.c] 2024-09-14T10:54:56.583 INFO:teuthology.orchestra.run.smithi002.stdout:[mon.b] 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout:[global] 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: chdir = "" 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: auth supported = cephx 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: filestore xattr use omap = true 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: mon clock drift allowed = 1.000 2024-09-14T10:54:56.585 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: osd crush chooseleaf type = 0 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: auth debug = true 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on old message = true 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: ms die on bug = true 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: mon pg warn max object skew = 0 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: # disable pg_autoscaler by default for new pools 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default size = 2 2024-09-14T10:54:56.586 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow primary affinity = true 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd allow pg remap = true 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on legacy crush tunables = false 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on crush straw calc version zero = false 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on no sortbitwise = false 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on osd down out interval zero = false 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon warn on too few osds = false 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: mon_allow_pool_size_one = true 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.587 INFO:teuthology.orchestra.run.smithi086.stdout: osd default data pool replay window = 5 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon allow pool delete = true 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon cluster log file level = debug 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: debug asserts on shutdown = true 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon health detail to clog = false 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon host = "172.21.15.2,[v2:172.21.15.2:3301,v1:172.21.15.2:6790],172.21.15.86" 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: mon client directed command retry = 5 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: ms inject socket failures = 5000 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: osd_max_pg_log_entries = 10 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: osd_min_pg_log_entries = 10 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: rgw override bucket index max shards = 1 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: fsid = 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T10:54:56.588 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout:[osd] 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd journal size = 100 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub load threshold = 5.0 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd scrub max interval = 600 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd mclock profile = high_recovery_ops 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd recover clone overlap = true 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd recovery max chunk = 1048576 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug shutdown = true 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug op order = true 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug verify stray on activate = true 2024-09-14T10:54:56.589 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug trim objects = true 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd open classes on start = true 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug pg log writeout = true 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd deep scrub update digest min age = 30 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd map max advance = 10 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: journal zero on create = true 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: filestore ondisk finisher threads = 3 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: filestore apply finisher threads = 3 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: bdev debug aio = true 2024-09-14T10:54:56.590 INFO:teuthology.orchestra.run.smithi086.stdout: osd debug misdirected ops = true 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: bdev async discard = True 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: bdev enable discard = True 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore allocator = bitmap 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore block size = 96636764160 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: bluestore fsck on mount = True 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluefs = 1/20 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: debug bluestore = 1/20 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: debug objclass = 20 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: debug osd = 20 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: debug rocksdb = 4/10 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: lockdep = True 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd backfillfull_ratio = 0.85 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd full ratio = 0.9 2024-09-14T10:54:56.591 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd nearfull ratio = 0.8 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd failsafe full ratio = 0.95 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd objectstore = bluestore 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: osd shutdown pgref assert = True 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr] 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug mgr = 20 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: mgr/telemetry/nag = false 2024-09-14T10:54:56.592 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout:[mon] 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug ms = 1 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug mon = 20 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug paxos = 20 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: debug auth = 20 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon data avail warn = 5 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon mgr mkfs grace = 240 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min pgs per osd = 4 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd reporter subtree level = osd 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon osd prime pg temp = true 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: mon reweight min bytes per osd = 10 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-14T10:54:56.593 INFO:teuthology.orchestra.run.smithi086.stdout: auth mon ticket ttl = 660 # 11m 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: auth service ticket ttl = 240 # 4m 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: # don't complain about insecure global_id in the test suite 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: # 1m isn't quite enough 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon_down_mkfs_grace = 2m 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: mon_warn_on_filestore_osds = false 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: lockdep = True 2024-09-14T10:54:56.594 INFO:teuthology.orchestra.run.smithi086.stdout: 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout:[client] 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw cache enabled = true 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable ops log = true 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw enable usage log = true 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: debug rgw = 20 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: debug rgw notification = 20 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw bucket counters cache = True 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw crypt require ssl = False 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw crypt s3 kms backend = testing 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw max chunk size = 4194304 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw obj stripe size = 6291456 2024-09-14T10:54:56.595 INFO:teuthology.orchestra.run.smithi086.stdout: rgw reshard progress judge interval = 10 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout: rgw s3 auth use sts = True 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout: rgw sts key = abcdefghijklmnop 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout: rgw torrent flag = True 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout: rgw user counters cache = True 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout: setgroup = ceph 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout: setuser = ceph 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.a] 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.c] 2024-09-14T10:54:56.596 INFO:teuthology.orchestra.run.smithi086.stdout:[mon.b] 2024-09-14T10:54:56.596 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-14T10:54:56.597 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-14T10:54:56.697 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-14T10:54:56.697 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:56.697 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-14T10:54:56.726 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:56.726 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-14T10:54:56.796 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T10:54:56.796 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:56.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:54:56.796 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:54:56.885 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:54:56.885 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:56.955 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T10:54:56.955 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:54:56.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-14T10:54:56.955 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-14T10:54:57.005 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:54:57.005 DEBUG:teuthology.orchestra.run.smithi086:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:57.074 INFO:tasks.ceph:Setting up mon nodes... 2024-09-14T10:54:57.074 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-14T10:54:57.074 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:54:57.141 INFO:teuthology.orchestra.run.smithi002.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-14T10:54:57.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:54:57.239 INFO:teuthology.orchestra.run.smithi086.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-14T10:54:57.242 INFO:tasks.ceph:Setting up mds nodes... 2024-09-14T10:54:57.242 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-14T10:54:57.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-14T10:54:57.298 INFO:teuthology.orchestra.run.smithi002.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-14T10:54:57.312 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-14T10:54:57.366 INFO:teuthology.orchestra.run.smithi086.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-14T10:54:57.379 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-14T10:54:57.380 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi002.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi086.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-14T10:54:57.380 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-14T10:54:57.419 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:54:57.419 INFO:tasks.ceph:role: osd.0 2024-09-14T10:54:57.419 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T10:54:57.420 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:54:57.498 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:57.498 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:57.498 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:57.499 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:57.499 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:57.499 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:57.499 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:57.534 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-14T10:54:57.536 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-14T10:54:57.536 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-14T10:54:57.620 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-14T10:54:57.704 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-14T10:54:57.743 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:54:57.743 INFO:tasks.ceph:role: osd.1 2024-09-14T10:54:57.743 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T10:54:57.743 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:57.822 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:57.823 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:57.823 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:57.857 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-14T10:54:57.859 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-14T10:54:57.859 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-14T10:54:57.943 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-14T10:54:58.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-14T10:54:58.106 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:54:58.107 INFO:tasks.ceph:role: osd.2 2024-09-14T10:54:58.107 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T10:54:58.107 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:58.186 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:58.223 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-14T10:54:58.225 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-14T10:54:58.225 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-14T10:54:58.309 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-14T10:54:58.391 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-14T10:54:58.470 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-14T10:54:58.471 INFO:tasks.ceph:role: osd.3 2024-09-14T10:54:58.471 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T10:54:58.471 DEBUG:teuthology.orchestra.run.smithi002:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:54:58.549 INFO:teuthology.orchestra.run.smithi002.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:54:58.549 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:54:58.550 INFO:teuthology.orchestra.run.smithi002.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:54:58.585 INFO:teuthology.orchestra.run.smithi002.stdout:Discarding blocks...Done. 2024-09-14T10:54:58.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi002.front.sepia.ceph.com -o noatime 2024-09-14T10:54:58.587 DEBUG:teuthology.orchestra.run.smithi002:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-14T10:54:58.671 DEBUG:teuthology.orchestra.run.smithi002:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-14T10:54:58.714 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:54:58.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:54:58.828+0000 7f149e00d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-14T10:54:58.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:54:58.828+0000 7f149e00d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-14T10:54:58.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:54:58.828+0000 7f149e00d640 -1 bdev(0x55909b09d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-14T10:54:58.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:54:58.828+0000 7f149e00d640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-14T10:55:01.749 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-14T10:55:01.795 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:01.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:01.861+0000 7f766501a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-14T10:55:01.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:01.861+0000 7f766501a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-14T10:55:01.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:01.861+0000 7f766501a640 -1 bdev(0x55c159be5800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:01.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:01.861+0000 7f766501a640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-14T10:55:05.287 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-14T10:55:05.334 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:05.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:05.400+0000 7f0acad45640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-14T10:55:05.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:05.401+0000 7f0acad45640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-14T10:55:05.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:05.401+0000 7f0acad45640 -1 bdev(0x560bacd01800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:05.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:05.401+0000 7f0acad45640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-14T10:55:08.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-14T10:55:08.609 DEBUG:teuthology.orchestra.run.smithi002:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:08.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:08.676+0000 7fa7a421f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-14T10:55:08.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:08.676+0000 7fa7a421f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-14T10:55:08.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:08.676+0000 7fa7a421f640 -1 bdev(0x5605cfbb7800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:08.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:55:08.676+0000 7fa7a421f640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-14T10:55:12.092 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-14T10:55:12.139 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:12.185 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:12.185 INFO:tasks.ceph:role: osd.4 2024-09-14T10:55:12.185 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T10:55:12.186 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:12.235 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:12.236 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:12.236 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:12.746 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T10:55:12.749 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T10:55:12.749 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:12.844 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:12.891 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-14T10:55:12.931 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:12.931 INFO:tasks.ceph:role: osd.5 2024-09-14T10:55:12.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T10:55:12.932 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-14T10:55:13.019 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:13.019 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:13.019 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:13.020 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:13.020 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:13.020 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:13.020 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:13.488 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T10:55:13.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T10:55:13.490 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-14T10:55:13.545 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-14T10:55:13.587 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-14T10:55:13.665 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:13.665 INFO:tasks.ceph:role: osd.6 2024-09-14T10:55:13.666 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T10:55:13.666 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:13.752 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:14.262 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T10:55:14.264 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T10:55:14.264 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-14T10:55:14.372 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-14T10:55:14.416 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-14T10:55:14.495 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-14T10:55:14.495 INFO:tasks.ceph:role: osd.7 2024-09-14T10:55:14.495 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T10:55:14.495 DEBUG:teuthology.orchestra.run.smithi086:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout: = sunit=0 swidth=0 blks 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-14T10:55:14.582 INFO:teuthology.orchestra.run.smithi086.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-14T10:55:15.058 INFO:teuthology.orchestra.run.smithi086.stdout:Discarding blocks...Done. 2024-09-14T10:55:15.060 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi086.front.sepia.ceph.com -o noatime 2024-09-14T10:55:15.060 DEBUG:teuthology.orchestra.run.smithi086:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-14T10:55:15.162 DEBUG:teuthology.orchestra.run.smithi086:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-14T10:55:15.207 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:15.285 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:15.287+0000 7f282a830640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-14T10:55:15.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:15.288+0000 7f282a830640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-14T10:55:15.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:15.288+0000 7f282a830640 -1 bdev(0x559f11a9d800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:15.286 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:15.288+0000 7f282a830640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-14T10:55:18.197 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-14T10:55:18.242 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:18.304 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:18.307+0000 7fb1edda4640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-14T10:55:18.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:18.307+0000 7fb1edda4640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-14T10:55:18.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:18.307+0000 7fb1edda4640 -1 bdev(0x565059cbd800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:18.305 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:18.307+0000 7fb1edda4640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-14T10:55:21.466 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-14T10:55:21.511 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:21.613 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:21.615+0000 7f4d0e789640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-14T10:55:21.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:21.616+0000 7f4d0e789640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-14T10:55:21.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:21.616+0000 7f4d0e789640 -1 bdev(0x55dd1cd27800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:21.614 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:21.616+0000 7f4d0e789640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-14T10:55:25.279 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-14T10:55:25.323 DEBUG:teuthology.orchestra.run.smithi086:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:25.428+0000 7f7a0e3a2640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:25.429+0000 7f7a0e3a2640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:25.429+0000 7f7a0e3a2640 -1 bdev(0x5597950cd800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-14T10:55:25.427 INFO:teuthology.orchestra.run.smithi086.stderr:2024-09-14T10:55:25.429+0000 7f7a0e3a2640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-14T10:55:28.582 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-14T10:55:28.627 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-14T10:55:28.627 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:28.627 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-14T10:55:28.675 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:28.675 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-14T10:55:28.761 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:28.761 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-14T10:55:28.845 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:28.845 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-14T10:55:28.929 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:28.929 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-14T10:55:29.011 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:29.011 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-14T10:55:29.056 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:29.056 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-14T10:55:29.137 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:29.137 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-14T10:55:29.218 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:29.218 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-14T10:55:29.298 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:29.298 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-14T10:55:29.378 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:29.378 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-14T10:55:29.413 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:29.413 DEBUG:teuthology.orchestra.run.smithi086:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-14T10:55:29.447 INFO:tasks.ceph:Adding keys to all mons... 2024-09-14T10:55:29.447 DEBUG:teuthology.orchestra.run.smithi002:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:55:29.456 DEBUG:teuthology.orchestra.run.smithi086:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-14T10:55:29.497 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.y] 2024-09-14T10:55:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCBa+VmRkucCBAA9tt0gHyhNB+gwRkh0sGB2A== 2024-09-14T10:55:29.497 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.0] 2024-09-14T10:55:29.497 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCCa+VmkBluMRAABz5pAGHvpiBOI/E/Gs323g== 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.1] 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCFa+Vmd0xlMxAAcXIHEwsIYWQ/ytc2DYEP5g== 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.2] 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCJa+VmaYnxFxAAunQE8OF0H3T9JU+jOgtjRQ== 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.3] 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCMa+VmHiNdKBAAK2DU0IGGVCxprOe30MpEeQ== 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout:[mgr.x] 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCBa+Vm0a11DhAAox8dzpe1bd4Ergl9Jb9zqw== 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.4] 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCTa+VmDcEyERAAXWbmC7etLjKIA5wiWWW6BA== 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.5] 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCWa+VmRRZdEhAAQWF2lfdIDZ+spqKVjcm3yw== 2024-09-14T10:55:29.498 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.6] 2024-09-14T10:55:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCZa+VmdjDBJBAAdxdI9x2qDw08p6SRd658QQ== 2024-09-14T10:55:29.499 INFO:teuthology.orchestra.run.smithi002.stdout:[osd.7] 2024-09-14T10:55:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCda+VmAz2eGRAAwGUXR9wjlFcu0j8+vSHfbA== 2024-09-14T10:55:29.499 INFO:teuthology.orchestra.run.smithi002.stdout:[client.0] 2024-09-14T10:55:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCBa+VmnOgAEhAAZaQXN8qm+2IG35WF2o05Aw== 2024-09-14T10:55:29.499 INFO:teuthology.orchestra.run.smithi002.stdout:[client.1] 2024-09-14T10:55:29.499 INFO:teuthology.orchestra.run.smithi002.stdout: key = AQCBa+VmF3YQFhAAlgKDYtgN4kba4MT47NxQsg== 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.y] 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCBa+VmRkucCBAA9tt0gHyhNB+gwRkh0sGB2A== 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.0] 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCCa+VmkBluMRAABz5pAGHvpiBOI/E/Gs323g== 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.1] 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCFa+Vmd0xlMxAAcXIHEwsIYWQ/ytc2DYEP5g== 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.2] 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCJa+VmaYnxFxAAunQE8OF0H3T9JU+jOgtjRQ== 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.3] 2024-09-14T10:55:29.524 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCMa+VmHiNdKBAAK2DU0IGGVCxprOe30MpEeQ== 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout:[mgr.x] 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCBa+Vm0a11DhAAox8dzpe1bd4Ergl9Jb9zqw== 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.4] 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCTa+VmDcEyERAAXWbmC7etLjKIA5wiWWW6BA== 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.5] 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCWa+VmRRZdEhAAQWF2lfdIDZ+spqKVjcm3yw== 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.6] 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCZa+VmdjDBJBAAdxdI9x2qDw08p6SRd658QQ== 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout:[osd.7] 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCda+VmAz2eGRAAwGUXR9wjlFcu0j8+vSHfbA== 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout:[client.0] 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCBa+VmnOgAEhAAZaQXN8qm+2IG35WF2o05Aw== 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout:[client.1] 2024-09-14T10:55:29.525 INFO:teuthology.orchestra.run.smithi086.stdout: key = AQCBa+VmF3YQFhAAlgKDYtgN4kba4MT47NxQsg== 2024-09-14T10:55:29.526 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:55:29.543 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:55:29.631 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.633 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.699 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.701 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.765 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.768 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.832 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.834 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.899 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:55:29.902 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-14T10:55:29.966 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:29.969 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:30.034 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:30.036 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:30.101 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:30.103 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:30.167 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:30.170 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-14T10:55:30.234 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:55:30.236 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:55:30.304 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:55:30.306 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-14T10:55:30.373 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-14T10:55:30.374 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-14T10:55:30.413 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:55:30.524 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-14T10:55:30.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-14T10:55:30.642 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:55:30.753 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-14T10:55:30.792 DEBUG:teuthology.orchestra.run.smithi086:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-14T10:55:30.831 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-14T10:55:30.942 DEBUG:teuthology.orchestra.run.smithi086:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-14T10:55:30.979 DEBUG:teuthology.orchestra.run.smithi002:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:30.982 DEBUG:teuthology.orchestra.run.smithi086:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-14T10:55:31.048 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-14T10:55:31.049 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-14T10:55:31.049 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-14T10:55:31.052 INFO:tasks.ceph.mon.a:Started 2024-09-14T10:55:31.052 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-14T10:55:31.052 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-14T10:55:31.054 INFO:tasks.ceph.mon.c:Started 2024-09-14T10:55:31.054 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-14T10:55:31.054 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-14T10:55:31.091 INFO:tasks.ceph.mon.b:Started 2024-09-14T10:55:31.091 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-14T10:55:31.091 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-14T10:55:31.091 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-14T10:55:31.093 INFO:tasks.ceph.mgr.y:Started 2024-09-14T10:55:31.094 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-14T10:55:31.094 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-14T10:55:31.095 INFO:tasks.ceph.mgr.x:Started 2024-09-14T10:55:31.096 DEBUG:tasks.ceph:set 0 configs 2024-09-14T10:55:31.096 INFO:tasks.ceph:Setting crush tunables to default 2024-09-14T10:55:31.096 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd crush tunables default 2024-09-14T10:55:37.293 INFO:teuthology.orchestra.run.smithi002.stderr:adjusted tunables profile to default 2024-09-14T10:55:37.305 INFO:tasks.ceph:check_enable_crimson: False 2024-09-14T10:55:37.305 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-14T10:55:37.305 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:37.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-14T10:55:37.345 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:37.345 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-14T10:55:37.425 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:37.425 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-14T10:55:37.506 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:55:37.507 DEBUG:teuthology.orchestra.run.smithi002:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-14T10:55:37.586 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:37.586 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-14T10:55:37.625 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:37.626 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-14T10:55:37.704 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:37.704 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-14T10:55:37.783 DEBUG:teuthology.orchestra.run.smithi086:> set -ex 2024-09-14T10:55:37.783 DEBUG:teuthology.orchestra.run.smithi086:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-14T10:55:37.861 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new b4b53255-9400-4141-ad4a-c46e2cdfde4b 0 2024-09-14T10:55:38.091 INFO:teuthology.orchestra.run.smithi086.stdout:0 2024-09-14T10:55:38.102 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 991f506b-2537-4722-a275-7f50d332f55a 1 2024-09-14T10:55:38.299 INFO:teuthology.orchestra.run.smithi086.stdout:1 2024-09-14T10:55:38.310 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 2f68b5f2-1578-4d1d-93be-150765c259cb 2 2024-09-14T10:55:38.508 INFO:teuthology.orchestra.run.smithi086.stdout:2 2024-09-14T10:55:38.519 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new c5a3a715-2f72-4bf3-9d0b-39337ea73022 3 2024-09-14T10:55:38.718 INFO:teuthology.orchestra.run.smithi086.stdout:3 2024-09-14T10:55:38.730 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new c239a70d-3015-44ba-803a-14bba1258aeb 4 2024-09-14T10:55:38.929 INFO:teuthology.orchestra.run.smithi086.stdout:4 2024-09-14T10:55:38.941 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 377ec39e-3741-43f5-a340-8b2b8aea8920 5 2024-09-14T10:55:39.133 INFO:teuthology.orchestra.run.smithi086.stdout:5 2024-09-14T10:55:39.144 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 2f1131b6-5c32-4ba0-8e35-657c0e00cb40 6 2024-09-14T10:55:39.343 INFO:teuthology.orchestra.run.smithi086.stdout:6 2024-09-14T10:55:39.354 DEBUG:teuthology.orchestra.run.smithi086:> sudo ceph --cluster ceph osd new 7708f30b-109d-45b7-a415-a291fab5185c 7 2024-09-14T10:55:39.550 INFO:teuthology.orchestra.run.smithi086.stdout:7 2024-09-14T10:55:39.561 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-14T10:55:39.561 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-14T10:55:39.563 INFO:tasks.ceph.osd.0:Started 2024-09-14T10:55:39.563 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-14T10:55:39.564 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-14T10:55:39.566 INFO:tasks.ceph.osd.1:Started 2024-09-14T10:55:39.566 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-14T10:55:39.566 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-14T10:55:39.568 INFO:tasks.ceph.osd.2:Started 2024-09-14T10:55:39.568 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-14T10:55:39.568 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-14T10:55:39.570 INFO:tasks.ceph.osd.3:Started 2024-09-14T10:55:39.570 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-14T10:55:39.571 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-14T10:55:39.573 INFO:tasks.ceph.osd.4:Started 2024-09-14T10:55:39.573 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-14T10:55:39.573 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-14T10:55:39.575 INFO:tasks.ceph.osd.5:Started 2024-09-14T10:55:39.575 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-14T10:55:39.575 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-14T10:55:39.579 INFO:tasks.ceph.osd.6:Started 2024-09-14T10:55:39.579 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-14T10:55:39.580 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-14T10:55:39.582 INFO:tasks.ceph.osd.7:Started 2024-09-14T10:55:39.582 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:55:39.807 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:55:39.807 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":10,"fsid":"28256c28-b166-4632-9431-ec178da9e31e","created":"2024-09-14T10:55:36.371959+0000","modified":"2024-09-14T10:55:39.551307+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:55:39.551307+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4b53255-9400-4141-ad4a-c46e2cdfde4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"991f506b-2537-4722-a275-7f50d332f55a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2f68b5f2-1578-4d1d-93be-150765c259cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c5a3a715-2f72-4bf3-9d0b-39337ea73022","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c239a70d-3015-44ba-803a-14bba1258aeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"377ec39e-3741-43f5-a340-8b2b8aea8920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f1131b6-5c32-4ba0-8e35-657c0e00cb40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7708f30b-109d-45b7-a415-a291fab5185c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:55:39.818 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-14T10:55:39.819 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-14T10:55:40.625 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:55:40.801 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-14T10:55:40.802+0000 7effc7ced640 -1 Falling back to public interface 2024-09-14T10:55:40.809 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-14T10:55:40.809 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":10,"fsid":"28256c28-b166-4632-9431-ec178da9e31e","created":"2024-09-14T10:55:36.371959+0000","modified":"2024-09-14T10:55:39.551307+0000","last_up_change":"0.000000","last_in_change":"2024-09-14T10:55:39.551307+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4b53255-9400-4141-ad4a-c46e2cdfde4b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"991f506b-2537-4722-a275-7f50d332f55a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"2f68b5f2-1578-4d1d-93be-150765c259cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c5a3a715-2f72-4bf3-9d0b-39337ea73022","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c239a70d-3015-44ba-803a-14bba1258aeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"377ec39e-3741-43f5-a340-8b2b8aea8920","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2f1131b6-5c32-4ba0-8e35-657c0e00cb40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7708f30b-109d-45b7-a415-a291fab5185c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:55:40.818 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-14T10:55:40.829 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T10:55:40.831+0000 7fac5ac2e640 -1 Falling back to public interface 2024-09-14T10:55:41.031 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-14T10:55:41.032+0000 7fbe5b617640 -1 Falling back to public interface 2024-09-14T10:55:41.032 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T10:55:41.034+0000 7f0c2bfb2640 -1 Falling back to public interface 2024-09-14T10:55:41.039 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-14T10:55:41.040+0000 7efdde5cc640 -1 Falling back to public interface 2024-09-14T10:55:41.052 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-14T10:55:41.053+0000 7fa60e21d640 -1 Falling back to public interface 2024-09-14T10:55:41.058 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T10:55:41.060+0000 7fef96c39640 -1 Falling back to public interface 2024-09-14T10:55:41.084 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T10:55:41.086+0000 7f878ea0d640 -1 Falling back to public interface 2024-09-14T10:55:41.663 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-14T10:55:41.665+0000 7f50c5d9e640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-14T10:55:41.663 INFO:tasks.ceph.mgr.x.smithi086.stderr:2024-09-14T10:55:41.665+0000 7f50c5d9e640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-14T10:55:44.382 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-14T10:55:44.384+0000 7effc7ced640 -1 osd.1 0 log_to_monitors true 2024-09-14T10:55:44.556 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T10:55:44.557+0000 7f0c2bfb2640 -1 osd.5 0 log_to_monitors true 2024-09-14T10:55:44.576 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-14T10:55:44.578+0000 7fbe5b617640 -1 osd.0 0 log_to_monitors true 2024-09-14T10:55:44.808 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-14T10:55:44.810+0000 7efdde5cc640 -1 osd.3 0 log_to_monitors true 2024-09-14T10:55:44.883 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T10:55:44.884+0000 7fac5ac2e640 -1 osd.4 0 log_to_monitors true 2024-09-14T10:55:45.101 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T10:55:45.102+0000 7fef96c39640 -1 osd.7 0 log_to_monitors true 2024-09-14T10:55:45.125 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-14T10:55:45.128+0000 7fa60e21d640 -1 osd.2 0 log_to_monitors true 2024-09-14T10:55:45.394 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T10:55:45.395+0000 7f878ea0d640 -1 osd.6 0 log_to_monitors true 2024-09-14T10:55:46.566 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T10:55:46.567+0000 7f0c27f46640 -1 osd.5 0 waiting for initial osdmap 2024-09-14T10:55:46.580 INFO:tasks.ceph.osd.5.smithi086.stderr:2024-09-14T10:55:46.581+0000 7f0c1fd65640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:46.740 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-14T10:55:46.742+0000 7fbe57008640 -1 osd.0 0 waiting for initial osdmap 2024-09-14T10:55:46.758 INFO:tasks.ceph.osd.0.smithi002.stderr:2024-09-14T10:55:46.761+0000 7fbe4ee27640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:46.761 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-14T10:55:46.764+0000 7effc3c81640 -1 osd.1 0 waiting for initial osdmap 2024-09-14T10:55:46.790 INFO:tasks.ceph.osd.1.smithi002.stderr:2024-09-14T10:55:46.793+0000 7effbbaa0640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:47.625 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:55:47.731 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-14T10:55:47.733+0000 7fa609be8640 -1 osd.2 0 waiting for initial osdmap 2024-09-14T10:55:47.742 INFO:tasks.ceph.osd.2.smithi002.stderr:2024-09-14T10:55:47.744+0000 7fa601a18640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:47.751 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-14T10:55:47.753+0000 7efddad74640 -1 osd.3 0 waiting for initial osdmap 2024-09-14T10:55:47.761 INFO:tasks.ceph.osd.3.smithi002.stderr:2024-09-14T10:55:47.764+0000 7efdd237f640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:47.971 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-14T10:55:47.971 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":14,"fsid":"28256c28-b166-4632-9431-ec178da9e31e","created":"2024-09-14T10:55:36.371959+0000","modified":"2024-09-14T10:55:47.686056+0000","last_up_change":"2024-09-14T10:55:47.686056+0000","last_in_change":"2024-09-14T10:55:39.551307+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4b53255-9400-4141-ad4a-c46e2cdfde4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6809","nonce":4195093750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6811","nonce":4195093750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6815","nonce":4195093750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6813","nonce":4195093750}]},"public_addr":"172.21.15.2:6809/4195093750","cluster_addr":"172.21.15.2:6811/4195093750","heartbeat_back_addr":"172.21.15.2:6815/4195093750","heartbeat_front_addr":"172.21.15.2:6813/4195093750","state":["exists","up"]},{"osd":1,"uuid":"991f506b-2537-4722-a275-7f50d332f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6801","nonce":3069717018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6803","nonce":3069717018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6807","nonce":3069717018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6805","nonce":3069717018}]},"public_addr":"172.21.15.2:6801/3069717018","cluster_addr":"172.21.15.2:6803/3069717018","heartbeat_back_addr":"172.21.15.2:6807/3069717018","heartbeat_front_addr":"172.21.15.2:6805/3069717018","state":["exists","up"]},{"osd":2,"uuid":"2f68b5f2-1578-4d1d-93be-150765c259cb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c5a3a715-2f72-4bf3-9d0b-39337ea73022","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c239a70d-3015-44ba-803a-14bba1258aeb","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"377ec39e-3741-43f5-a340-8b2b8aea8920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6811","nonce":3386010674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6813","nonce":3386010674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6817","nonce":3386010674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6815","nonce":3386010674}]},"public_addr":"172.21.15.86:6811/3386010674","cluster_addr":"172.21.15.86:6813/3386010674","heartbeat_back_addr":"172.21.15.86:6817/3386010674","heartbeat_front_addr":"172.21.15.86:6815/3386010674","state":["exists","up"]},{"osd":6,"uuid":"2f1131b6-5c32-4ba0-8e35-657c0e00cb40","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"7708f30b-109d-45b7-a415-a291fab5185c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.574672+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:55:47.983 DEBUG:teuthology.misc:3 of 8 OSDs are up 2024-09-14T10:55:48.349 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T10:55:48.350+0000 7fef92bcd640 -1 osd.7 0 waiting for initial osdmap 2024-09-14T10:55:48.362 INFO:tasks.ceph.osd.7.smithi086.stderr:2024-09-14T10:55:48.363+0000 7fef8a9ec640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:48.362 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T10:55:48.363+0000 7fac56194640 -1 osd.4 0 waiting for initial osdmap 2024-09-14T10:55:48.371 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T10:55:48.372+0000 7f878ab48640 -1 osd.6 0 waiting for initial osdmap 2024-09-14T10:55:48.378 INFO:tasks.ceph.osd.4.smithi086.stderr:2024-09-14T10:55:48.381+0000 7fac4dfb3640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:48.382 INFO:tasks.ceph.osd.6.smithi086.stderr:2024-09-14T10:55:48.383+0000 7f8782153640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-14T10:55:54.790 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-14T10:55:55.107 INFO:teuthology.misc.health.smithi002.stdout: 2024-09-14T10:55:55.107 INFO:teuthology.misc.health.smithi002.stdout:{"epoch":17,"fsid":"28256c28-b166-4632-9431-ec178da9e31e","created":"2024-09-14T10:55:36.371959+0000","modified":"2024-09-14T10:55:50.757413+0000","last_up_change":"2024-09-14T10:55:48.742998+0000","last_in_change":"2024-09-14T10:55:39.551307+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:55:48.674884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4b53255-9400-4141-ad4a-c46e2cdfde4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6809","nonce":4195093750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6811","nonce":4195093750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6815","nonce":4195093750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6813","nonce":4195093750}]},"public_addr":"172.21.15.2:6809/4195093750","cluster_addr":"172.21.15.2:6811/4195093750","heartbeat_back_addr":"172.21.15.2:6815/4195093750","heartbeat_front_addr":"172.21.15.2:6813/4195093750","state":["exists","up"]},{"osd":1,"uuid":"991f506b-2537-4722-a275-7f50d332f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6801","nonce":3069717018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6803","nonce":3069717018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6807","nonce":3069717018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6805","nonce":3069717018}]},"public_addr":"172.21.15.2:6801/3069717018","cluster_addr":"172.21.15.2:6803/3069717018","heartbeat_back_addr":"172.21.15.2:6807/3069717018","heartbeat_front_addr":"172.21.15.2:6805/3069717018","state":["exists","up"]},{"osd":2,"uuid":"2f68b5f2-1578-4d1d-93be-150765c259cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6825","nonce":3479486070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6827","nonce":3479486070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6831","nonce":3479486070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6829","nonce":3479486070}]},"public_addr":"172.21.15.2:6825/3479486070","cluster_addr":"172.21.15.2:6827/3479486070","heartbeat_back_addr":"172.21.15.2:6831/3479486070","heartbeat_front_addr":"172.21.15.2:6829/3479486070","state":["exists","up"]},{"osd":3,"uuid":"c5a3a715-2f72-4bf3-9d0b-39337ea73022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6817","nonce":1337492648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6819","nonce":1337492648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6823","nonce":1337492648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6821","nonce":1337492648}]},"public_addr":"172.21.15.2:6817/1337492648","cluster_addr":"172.21.15.2:6819/1337492648","heartbeat_back_addr":"172.21.15.2:6823/1337492648","heartbeat_front_addr":"172.21.15.2:6821/1337492648","state":["exists","up"]},{"osd":4,"uuid":"c239a70d-3015-44ba-803a-14bba1258aeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6803","nonce":1990035204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6805","nonce":1990035204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6809","nonce":1990035204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6807","nonce":1990035204}]},"public_addr":"172.21.15.86:6803/1990035204","cluster_addr":"172.21.15.86:6805/1990035204","heartbeat_back_addr":"172.21.15.86:6809/1990035204","heartbeat_front_addr":"172.21.15.86:6807/1990035204","state":["exists","up"]},{"osd":5,"uuid":"377ec39e-3741-43f5-a340-8b2b8aea8920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6811","nonce":3386010674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6813","nonce":3386010674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6817","nonce":3386010674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6815","nonce":3386010674}]},"public_addr":"172.21.15.86:6811/3386010674","cluster_addr":"172.21.15.86:6813/3386010674","heartbeat_back_addr":"172.21.15.86:6817/3386010674","heartbeat_front_addr":"172.21.15.86:6815/3386010674","state":["exists","up"]},{"osd":6,"uuid":"2f1131b6-5c32-4ba0-8e35-657c0e00cb40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6827","nonce":3650976683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6829","nonce":3650976683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6833","nonce":3650976683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6831","nonce":3650976683}]},"public_addr":"172.21.15.86:6827/3650976683","cluster_addr":"172.21.15.86:6829/3650976683","heartbeat_back_addr":"172.21.15.86:6833/3650976683","heartbeat_front_addr":"172.21.15.86:6831/3650976683","state":["exists","up"]},{"osd":7,"uuid":"7708f30b-109d-45b7-a415-a291fab5185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6819","nonce":1094621518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6821","nonce":1094621518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6825","nonce":1094621518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6823","nonce":1094621518}]},"public_addr":"172.21.15.86:6819/1094621518","cluster_addr":"172.21.15.86:6821/1094621518","heartbeat_back_addr":"172.21.15.86:6825/1094621518","heartbeat_front_addr":"172.21.15.86:6823/1094621518","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.585960+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.395897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.114373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.814875+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.839191+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.574672+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.395989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.078476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:55:55.119 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-14T10:55:55.119 INFO:tasks.ceph:Creating RBD pool 2024-09-14T10:55:55.119 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-14T10:55:55.768 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'rbd' created 2024-09-14T10:55:55.783 DEBUG:teuthology.orchestra.run.smithi002:> rbd --cluster ceph pool init rbd 2024-09-14T10:55:55.856 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:55:55.856 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:55:58.797 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-14T10:55:58.797 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-14T10:55:58.798 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-14T10:55:59.125 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:55:59.139 INFO:teuthology.orchestra.run.smithi002.stdout:[{"version":9,"timestamp":"2024-09-14T10:55:48.374962+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5924.425528"}]}] 2024-09-14T10:55:59.139 INFO:tasks.ceph_manager:config epoch is 9 2024-09-14T10:55:59.139 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-14T10:55:59.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-14T10:55:59.140 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-14T10:55:59.506 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:55:59.517 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6800","nonce":3641925805},{"type":"v1","addr":"172.21.15.86:6801","nonce":3641925805}]},"active_addr":"172.21.15.86:6801/3641925805","active_change":"2024-09-14T10:55:40.652595+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4100,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":1094345579}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":586687989}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":2919627875}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.86:0","nonce":583455910}]}]} 2024-09-14T10:55:59.521 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-14T10:55:59.521 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-14T10:55:59.522 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:55:59.836 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:55:59.836 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"28256c28-b166-4632-9431-ec178da9e31e","created":"2024-09-14T10:55:36.371959+0000","modified":"2024-09-14T10:55:58.782384+0000","last_up_change":"2024-09-14T10:55:48.742998+0000","last_in_change":"2024-09-14T10:55:39.551307+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:55:48.674884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:55:55.435327+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4b53255-9400-4141-ad4a-c46e2cdfde4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6809","nonce":4195093750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6811","nonce":4195093750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6815","nonce":4195093750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6813","nonce":4195093750}]},"public_addr":"172.21.15.2:6809/4195093750","cluster_addr":"172.21.15.2:6811/4195093750","heartbeat_back_addr":"172.21.15.2:6815/4195093750","heartbeat_front_addr":"172.21.15.2:6813/4195093750","state":["exists","up"]},{"osd":1,"uuid":"991f506b-2537-4722-a275-7f50d332f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6801","nonce":3069717018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6803","nonce":3069717018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6807","nonce":3069717018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6805","nonce":3069717018}]},"public_addr":"172.21.15.2:6801/3069717018","cluster_addr":"172.21.15.2:6803/3069717018","heartbeat_back_addr":"172.21.15.2:6807/3069717018","heartbeat_front_addr":"172.21.15.2:6805/3069717018","state":["exists","up"]},{"osd":2,"uuid":"2f68b5f2-1578-4d1d-93be-150765c259cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6825","nonce":3479486070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6827","nonce":3479486070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6831","nonce":3479486070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6829","nonce":3479486070}]},"public_addr":"172.21.15.2:6825/3479486070","cluster_addr":"172.21.15.2:6827/3479486070","heartbeat_back_addr":"172.21.15.2:6831/3479486070","heartbeat_front_addr":"172.21.15.2:6829/3479486070","state":["exists","up"]},{"osd":3,"uuid":"c5a3a715-2f72-4bf3-9d0b-39337ea73022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6817","nonce":1337492648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6819","nonce":1337492648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6823","nonce":1337492648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6821","nonce":1337492648}]},"public_addr":"172.21.15.2:6817/1337492648","cluster_addr":"172.21.15.2:6819/1337492648","heartbeat_back_addr":"172.21.15.2:6823/1337492648","heartbeat_front_addr":"172.21.15.2:6821/1337492648","state":["exists","up"]},{"osd":4,"uuid":"c239a70d-3015-44ba-803a-14bba1258aeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6803","nonce":1990035204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6805","nonce":1990035204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6809","nonce":1990035204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6807","nonce":1990035204}]},"public_addr":"172.21.15.86:6803/1990035204","cluster_addr":"172.21.15.86:6805/1990035204","heartbeat_back_addr":"172.21.15.86:6809/1990035204","heartbeat_front_addr":"172.21.15.86:6807/1990035204","state":["exists","up"]},{"osd":5,"uuid":"377ec39e-3741-43f5-a340-8b2b8aea8920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6811","nonce":3386010674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6813","nonce":3386010674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6817","nonce":3386010674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6815","nonce":3386010674}]},"public_addr":"172.21.15.86:6811/3386010674","cluster_addr":"172.21.15.86:6813/3386010674","heartbeat_back_addr":"172.21.15.86:6817/3386010674","heartbeat_front_addr":"172.21.15.86:6815/3386010674","state":["exists","up"]},{"osd":6,"uuid":"2f1131b6-5c32-4ba0-8e35-657c0e00cb40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6827","nonce":3650976683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6829","nonce":3650976683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6833","nonce":3650976683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6831","nonce":3650976683}]},"public_addr":"172.21.15.86:6827/3650976683","cluster_addr":"172.21.15.86:6829/3650976683","heartbeat_back_addr":"172.21.15.86:6833/3650976683","heartbeat_front_addr":"172.21.15.86:6831/3650976683","state":["exists","up"]},{"osd":7,"uuid":"7708f30b-109d-45b7-a415-a291fab5185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6819","nonce":1094621518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6821","nonce":1094621518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6825","nonce":1094621518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6823","nonce":1094621518}]},"public_addr":"172.21.15.86:6819/1094621518","cluster_addr":"172.21.15.86:6821/1094621518","heartbeat_back_addr":"172.21.15.86:6825/1094621518","heartbeat_front_addr":"172.21.15.86:6823/1094621518","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.585960+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.395897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.114373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.814875+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.839191+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.574672+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.395989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.078476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:55:59.849 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-14T10:55:59.849 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T10:56:00.165 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:56:00.166 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":21,"fsid":"28256c28-b166-4632-9431-ec178da9e31e","created":"2024-09-14T10:55:36.371959+0000","modified":"2024-09-14T10:55:58.782384+0000","last_up_change":"2024-09-14T10:55:48.742998+0000","last_in_change":"2024-09-14T10:55:39.551307+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:55:48.674884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:55:55.435327+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4b53255-9400-4141-ad4a-c46e2cdfde4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6809","nonce":4195093750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6811","nonce":4195093750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6815","nonce":4195093750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6813","nonce":4195093750}]},"public_addr":"172.21.15.2:6809/4195093750","cluster_addr":"172.21.15.2:6811/4195093750","heartbeat_back_addr":"172.21.15.2:6815/4195093750","heartbeat_front_addr":"172.21.15.2:6813/4195093750","state":["exists","up"]},{"osd":1,"uuid":"991f506b-2537-4722-a275-7f50d332f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6801","nonce":3069717018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6803","nonce":3069717018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6807","nonce":3069717018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6805","nonce":3069717018}]},"public_addr":"172.21.15.2:6801/3069717018","cluster_addr":"172.21.15.2:6803/3069717018","heartbeat_back_addr":"172.21.15.2:6807/3069717018","heartbeat_front_addr":"172.21.15.2:6805/3069717018","state":["exists","up"]},{"osd":2,"uuid":"2f68b5f2-1578-4d1d-93be-150765c259cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6825","nonce":3479486070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6827","nonce":3479486070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6831","nonce":3479486070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6829","nonce":3479486070}]},"public_addr":"172.21.15.2:6825/3479486070","cluster_addr":"172.21.15.2:6827/3479486070","heartbeat_back_addr":"172.21.15.2:6831/3479486070","heartbeat_front_addr":"172.21.15.2:6829/3479486070","state":["exists","up"]},{"osd":3,"uuid":"c5a3a715-2f72-4bf3-9d0b-39337ea73022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6817","nonce":1337492648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6819","nonce":1337492648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6823","nonce":1337492648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6821","nonce":1337492648}]},"public_addr":"172.21.15.2:6817/1337492648","cluster_addr":"172.21.15.2:6819/1337492648","heartbeat_back_addr":"172.21.15.2:6823/1337492648","heartbeat_front_addr":"172.21.15.2:6821/1337492648","state":["exists","up"]},{"osd":4,"uuid":"c239a70d-3015-44ba-803a-14bba1258aeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6803","nonce":1990035204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6805","nonce":1990035204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6809","nonce":1990035204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6807","nonce":1990035204}]},"public_addr":"172.21.15.86:6803/1990035204","cluster_addr":"172.21.15.86:6805/1990035204","heartbeat_back_addr":"172.21.15.86:6809/1990035204","heartbeat_front_addr":"172.21.15.86:6807/1990035204","state":["exists","up"]},{"osd":5,"uuid":"377ec39e-3741-43f5-a340-8b2b8aea8920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6811","nonce":3386010674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6813","nonce":3386010674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6817","nonce":3386010674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6815","nonce":3386010674}]},"public_addr":"172.21.15.86:6811/3386010674","cluster_addr":"172.21.15.86:6813/3386010674","heartbeat_back_addr":"172.21.15.86:6817/3386010674","heartbeat_front_addr":"172.21.15.86:6815/3386010674","state":["exists","up"]},{"osd":6,"uuid":"2f1131b6-5c32-4ba0-8e35-657c0e00cb40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6827","nonce":3650976683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6829","nonce":3650976683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6833","nonce":3650976683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6831","nonce":3650976683}]},"public_addr":"172.21.15.86:6827/3650976683","cluster_addr":"172.21.15.86:6829/3650976683","heartbeat_back_addr":"172.21.15.86:6833/3650976683","heartbeat_front_addr":"172.21.15.86:6831/3650976683","state":["exists","up"]},{"osd":7,"uuid":"7708f30b-109d-45b7-a415-a291fab5185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6819","nonce":1094621518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6821","nonce":1094621518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6825","nonce":1094621518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6823","nonce":1094621518}]},"public_addr":"172.21.15.86:6819/1094621518","cluster_addr":"172.21.15.86:6821/1094621518","heartbeat_back_addr":"172.21.15.86:6825/1094621518","heartbeat_front_addr":"172.21.15.86:6823/1094621518","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.585960+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.395897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.114373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.814875+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.839191+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.574672+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.395989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.078476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T10:56:00.179 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-14T10:56:00.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-14T10:56:00.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-14T10:56:00.180 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-14T10:56:00.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-14T10:56:00.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-14T10:56:00.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-14T10:56:00.182 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-14T10:56:00.456 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2024-09-14T10:56:00.456 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-14T10:56:00.458 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2024-09-14T10:56:00.458 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-14T10:56:00.460 INFO:teuthology.orchestra.run.smithi002.stdout:60129542149 2024-09-14T10:56:00.461 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-14T10:56:00.462 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2024-09-14T10:56:00.463 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-14T10:56:00.464 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2024-09-14T10:56:00.464 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-14T10:56:00.465 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2024-09-14T10:56:00.465 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-14T10:56:00.466 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2024-09-14T10:56:00.466 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-14T10:56:00.467 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2024-09-14T10:56:00.467 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-14T10:56:01.069 INFO:teuthology.orchestra.run.smithi002.stdout:60129542151 2024-09-14T10:56:01.076 INFO:teuthology.orchestra.run.smithi002.stdout:55834574854 2024-09-14T10:56:01.090 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2024-09-14T10:56:01.091 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.097 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-14T10:56:01.097 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.124 INFO:teuthology.orchestra.run.smithi002.stdout:60129542149 2024-09-14T10:56:01.135 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2024-09-14T10:56:01.138 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2024-09-14T10:56:01.139 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542149 got 60129542149 for osd.0 2024-09-14T10:56:01.139 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-14T10:56:01.149 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.158 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.6 2024-09-14T10:56:01.159 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.162 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2024-09-14T10:56:01.164 INFO:teuthology.orchestra.run.smithi002.stdout:64424509446 2024-09-14T10:56:01.164 INFO:teuthology.orchestra.run.smithi002.stdout:64424509447 2024-09-14T10:56:01.178 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.4 2024-09-14T10:56:01.178 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.179 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-14T10:56:01.180 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-14T10:56:01.181 DEBUG:teuthology.parallel:result is None 2024-09-14T10:56:01.181 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T10:56:01.181 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:56:01.530 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:56:01.531 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T10:56:01.543 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T10:56:01.161006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252324,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722396,"statfs":{"total":773094113280,"available":772835733504,"internally_reserved":0,"allocated":2867200,"data_stored":1747038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.501566"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.387955+0000","last_change":"2024-09-14T10:55:59.387955+0000","last_active":"2024-09-14T10:55:59.387955+0000","last_peered":"2024-09-14T10:55:59.387955+0000","last_clean":"2024-09-14T10:55:59.387955+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T10:55:59.387955+0000","last_undegraded":"2024-09-14T10:55:59.387955+0000","last_fullsized":"2024-09-14T10:55:59.387955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:35.502046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.795096+0000","last_change":"2024-09-14T10:55:58.795304+0000","last_active":"2024-09-14T10:55:58.795096+0000","last_peered":"2024-09-14T10:55:58.795096+0000","last_clean":"2024-09-14T10:55:58.795096+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T10:55:58.795096+0000","last_undegraded":"2024-09-14T10:55:58.795096+0000","last_fullsized":"2024-09-14T10:55:58.795096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:07.609351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.204323+0000","last_change":"2024-09-14T10:55:59.204323+0000","last_active":"2024-09-14T10:55:59.204323+0000","last_peered":"2024-09-14T10:55:59.204323+0000","last_clean":"2024-09-14T10:55:59.204323+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T10:55:59.204323+0000","last_undegraded":"2024-09-14T10:55:59.204323+0000","last_fullsized":"2024-09-14T10:55:59.204323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:50.070588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.795041+0000","last_change":"2024-09-14T10:55:58.795298+0000","last_active":"2024-09-14T10:55:58.795041+0000","last_peered":"2024-09-14T10:55:58.795041+0000","last_clean":"2024-09-14T10:55:58.795041+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T10:55:58.795041+0000","last_undegraded":"2024-09-14T10:55:58.795041+0000","last_fullsized":"2024-09-14T10:55:58.795041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:33.298341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.793099+0000","last_change":"2024-09-14T10:55:58.793099+0000","last_active":"2024-09-14T10:55:58.793099+0000","last_peered":"2024-09-14T10:55:58.793099+0000","last_clean":"2024-09-14T10:55:58.793099+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T10:55:58.793099+0000","last_undegraded":"2024-09-14T10:55:58.793099+0000","last_fullsized":"2024-09-14T10:55:58.793099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:04.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.134312+0000","last_change":"2024-09-14T10:55:59.134312+0000","last_active":"2024-09-14T10:55:59.134312+0000","last_peered":"2024-09-14T10:55:59.134312+0000","last_clean":"2024-09-14T10:55:59.134312+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T10:55:59.134312+0000","last_undegraded":"2024-09-14T10:55:59.134312+0000","last_fullsized":"2024-09-14T10:55:59.134312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:08.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.204366+0000","last_change":"2024-09-14T10:55:59.204366+0000","last_active":"2024-09-14T10:55:59.204366+0000","last_peered":"2024-09-14T10:55:59.204366+0000","last_clean":"2024-09-14T10:55:59.204366+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T10:55:59.204366+0000","last_undegraded":"2024-09-14T10:55:59.204366+0000","last_fullsized":"2024-09-14T10:55:59.204366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:15.414745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.792229+0000","last_change":"2024-09-14T10:55:58.792442+0000","last_active":"2024-09-14T10:55:58.792229+0000","last_peered":"2024-09-14T10:55:58.792229+0000","last_clean":"2024-09-14T10:55:58.792229+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T10:55:58.792229+0000","last_undegraded":"2024-09-14T10:55:58.792229+0000","last_fullsized":"2024-09-14T10:55:58.792229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:23.936072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.203810+0000","last_change":"2024-09-14T10:55:50.534148+0000","last_active":"2024-09-14T10:55:59.203810+0000","last_peered":"2024-09-14T10:55:59.203810+0000","last_clean":"2024-09-14T10:55:59.203810+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T10:55:59.203810+0000","last_undegraded":"2024-09-14T10:55:59.203810+0000","last_fullsized":"2024-09-14T10:55:59.203810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_clean_scrub_stamp":"2024-09-14T10:55:48.742998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:03.355721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":212992,"data_stored":70802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":661151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":70802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:56:01.544 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T10:56:01.856 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:56:01.856 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T10:56:01.866 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2024-09-14T10:56:01.161006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":252324,"kb_used_data":2800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754722396,"statfs":{"total":773094113280,"available":772835733504,"internally_reserved":0,"allocated":2867200,"data_stored":1747038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.501566"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.387955+0000","last_change":"2024-09-14T10:55:59.387955+0000","last_active":"2024-09-14T10:55:59.387955+0000","last_peered":"2024-09-14T10:55:59.387955+0000","last_clean":"2024-09-14T10:55:59.387955+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T10:55:59.387955+0000","last_undegraded":"2024-09-14T10:55:59.387955+0000","last_fullsized":"2024-09-14T10:55:59.387955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:35.502046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.795096+0000","last_change":"2024-09-14T10:55:58.795304+0000","last_active":"2024-09-14T10:55:58.795096+0000","last_peered":"2024-09-14T10:55:58.795096+0000","last_clean":"2024-09-14T10:55:58.795096+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T10:55:58.795096+0000","last_undegraded":"2024-09-14T10:55:58.795096+0000","last_fullsized":"2024-09-14T10:55:58.795096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:07.609351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.204323+0000","last_change":"2024-09-14T10:55:59.204323+0000","last_active":"2024-09-14T10:55:59.204323+0000","last_peered":"2024-09-14T10:55:59.204323+0000","last_clean":"2024-09-14T10:55:59.204323+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T10:55:59.204323+0000","last_undegraded":"2024-09-14T10:55:59.204323+0000","last_fullsized":"2024-09-14T10:55:59.204323+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:50.070588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.795041+0000","last_change":"2024-09-14T10:55:58.795298+0000","last_active":"2024-09-14T10:55:58.795041+0000","last_peered":"2024-09-14T10:55:58.795041+0000","last_clean":"2024-09-14T10:55:58.795041+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T10:55:58.795041+0000","last_undegraded":"2024-09-14T10:55:58.795041+0000","last_fullsized":"2024-09-14T10:55:58.795041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:33.298341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"21'2","reported_seq":22,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.793099+0000","last_change":"2024-09-14T10:55:58.793099+0000","last_active":"2024-09-14T10:55:58.793099+0000","last_peered":"2024-09-14T10:55:58.793099+0000","last_clean":"2024-09-14T10:55:58.793099+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T10:55:58.793099+0000","last_undegraded":"2024-09-14T10:55:58.793099+0000","last_fullsized":"2024-09-14T10:55:58.793099+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:04.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.134312+0000","last_change":"2024-09-14T10:55:59.134312+0000","last_active":"2024-09-14T10:55:59.134312+0000","last_peered":"2024-09-14T10:55:59.134312+0000","last_clean":"2024-09-14T10:55:59.134312+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T10:55:59.134312+0000","last_undegraded":"2024-09-14T10:55:59.134312+0000","last_fullsized":"2024-09-14T10:55:59.134312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:08.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.204366+0000","last_change":"2024-09-14T10:55:59.204366+0000","last_active":"2024-09-14T10:55:59.204366+0000","last_peered":"2024-09-14T10:55:59.204366+0000","last_clean":"2024-09-14T10:55:59.204366+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T10:55:59.204366+0000","last_undegraded":"2024-09-14T10:55:59.204366+0000","last_fullsized":"2024-09-14T10:55:59.204366+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:15.414745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"19'1","reported_seq":21,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:58.792229+0000","last_change":"2024-09-14T10:55:58.792442+0000","last_active":"2024-09-14T10:55:58.792229+0000","last_peered":"2024-09-14T10:55:58.792229+0000","last_clean":"2024-09-14T10:55:58.792229+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T10:55:58.792229+0000","last_undegraded":"2024-09-14T10:55:58.792229+0000","last_fullsized":"2024-09-14T10:55:58.792229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:23.936072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"16'72","reported_seq":110,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-14T10:55:59.203810+0000","last_change":"2024-09-14T10:55:50.534148+0000","last_active":"2024-09-14T10:55:59.203810+0000","last_peered":"2024-09-14T10:55:59.203810+0000","last_clean":"2024-09-14T10:55:59.203810+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T10:55:59.203810+0000","last_undegraded":"2024-09-14T10:55:59.203810+0000","last_fullsized":"2024-09-14T10:55:59.203810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_clean_scrub_stamp":"2024-09-14T10:55:48.742998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:03.355721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509447,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509446,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27236,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":208896,"data_stored":70783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":35556,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94336284,"statfs":{"total":96636764160,"available":96600354816,"internally_reserved":0,"allocated":212992,"data_stored":70802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542149,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36136,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335704,"statfs":{"total":96636764160,"available":96599760896,"internally_reserved":0,"allocated":802816,"data_stored":661151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":212992,"data_stored":70802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T10:56:01.867 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T10:56:01.867 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-14T10:56:01.867 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-14T10:56:01.867 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-14T10:56:02.216 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T10:56:02.216 INFO:teuthology.orchestra.run.smithi002.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-14T10:56:02.229 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-14T10:56:02.229 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-14T10:56:02.242 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-14T10:56:02.243 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T10:56:02.273 DEBUG:teuthology.orchestra.run.smithi002:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-14T10:56:02.436 INFO:teuthology.orchestra.run.smithi002.stderr:..+..+.+++++++++++++++++++++++++++++++++++++++++++++*........+.....+.+...+.....+++++++++++++++++++++++++++++++++++++++++++++*....+...+....+.........+.....+....+...+...+..............+............+.........+.+.....+...+...+++++ 2024-09-14T10:56:02.744 INFO:teuthology.orchestra.run.smithi002.stderr:....+.......+++++++++++++++++++++++++++++++++++++++++++++*.+....+...+..+++++++++++++++++++++++++++++++++++++++++++++*.....+......+....+...+........+...........................+...+...............+.......+..+......+...+....+.....+.......+..................+...........+.........+.............+..+.............+........+....+..+....+.........+.....+..................+.............+..+.............+...........+................+..+......+.+...+..+...................+...............+....................+.+..............+.......+........+.+......+..+......+.+.....+...............+...+................+.................+....+........................+.....+.+...+..+.+..+.......+...+..+......+.......+......+..+.............+.....+............+..........+.........+........+......+.+...+........+...+....+...........................+..............+.+......+..+.+..+.......+...+++++ 2024-09-14T10:56:02.769 INFO:teuthology.orchestra.run.smithi002.stderr:----- 2024-09-14T10:56:02.778 DEBUG:teuthology.orchestra.run.smithi002:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T10:56:02.821 DEBUG:teuthology.orchestra.run.smithi002:> sudo update-ca-trust 2024-09-14T10:56:03.974 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-14T10:56:04.003 DEBUG:teuthology.orchestra.run.smithi002:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi002.front.sepia.ceph.com 2024-09-14T10:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:..+.+.....+....+.....+......+++++++++++++++++++++++++++++++++++++++*.....+++++++++++++++++++++++++++++++++++++++*...+.........+...+.....+...+.+.....+....+.........+...+............+........+..........+.....+....+.....+.........+.........+.......+.....+...+............+.+................................+...+.............+.....+.........+............+.........+.+...+.................+......+.......+...............+.....+.+..+...+.+.........+..+....+......+..+.....................+.+.....+......+...+......+....+.....+.........+.....................+....+.....+......+.......+...+.....................+........+............+......+..........+.........+...........+....+...+.....+.+..+.......+..+.........+.+.....+.........+....+..+.............+......+..+...................+.....+...+...+.............+.....+.+...+...+........+......+.+.....+...+.+......+.....+...+....+...........+......+..........+...+..+....+..+............+......+.......+..+.+............+.........+...+.....+......+..........+..+............+.+..+.......+..+......+...................+......+..............+.+...+............+.....+...+......................+...+......+........+...+.................................+......+....+..+...+....+..+.+..+.......+...+......+.....+......+.+...+..+....+...............+......+........+......+...+.......+......+.....+...+.........+.......+...+......+.........+..+....+..+....+.........+......+...+............+........+...............+.......+..............+..........+.....+......+.............+...........+.+...........+....+...+...+........+.+........+...+.......+...+.....+..........+.....+...+....+...+..+...+.......+..+....+..+....+.........+..+.......+.....+.+.....+......+..................+...+....+.....+.+...+..............+.......+.........+......+..............+.+.....+.+........+.........+..................+....+...+..+.........+....+..+....+...............+.........+.....+.+..+....+.....+....+............+...+......+...+..+.........+.+...+...+.....+............+...+....+........+...+...+.........+...+...+.......+..............+.+...+...........+.+..............+.+...+...........+...+...+....+...+..+...+.+......+........+.+.........+......+.....+.+..............++++++ 2024-09-14T10:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:..+.........+..........+++++++++++++++++++++++++++++++++++++++*...+.+...............+........+...+...+++++++++++++++++++++++++++++++++++++++*.+.+.....+.+..+......+.......+.....+..........+...+......+...+........+..................+......+.+..+...............+.+..+...+......+.+..+......+.+........................+..+.........+....+......+...+.....+.+..+...+..........+..............+......+.+.....+...+.......+.....+.+...+.....+....+...+..+................+..+....+...........+.......+......+.....+.........+...+...+....+...+........+..........+..+.........+.+..+.......+...+......+..+............+.+...........+.+...+.....+.+...............+...+...+....................+.........+.+...+..............+.+............+..+......+......................+.....+.........+...+......+......+.........+....+..+.+............+..+......+...+.......+............+.....+.............+...+..+....+...+.....+......+......+....+.........+..+.+..+.+..............+...+...............+....+...+.................+......+.........+...+...+...+.+.........+.....+......+...+.......+...+............+........+............+...+.+.....+.........+.+.....+......+.+..............+.+.....+.......+.....+.+......++++++ 2024-09-14T10:56:04.267 INFO:teuthology.orchestra.run.smithi002.stderr:----- 2024-09-14T10:56:04.267 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:56:04.267 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:56:04.336 DEBUG:teuthology.orchestra.run.smithi002:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:56:04.415 INFO:teuthology.orchestra.run.smithi002.stderr:Certificate request self-signature ok 2024-09-14T10:56:04.415 INFO:teuthology.orchestra.run.smithi002.stderr:subject=CN=smithi002.front.sepia.ceph.com 2024-09-14T10:56:04.425 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-14T10:56:04.494 DEBUG:teuthology.orchestra.run.smithi002:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T10:56:04.565 INFO:teuthology.orchestra.run.smithi002.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-14T10:56:04.565 DEBUG:teuthology.orchestra.run.smithi002:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-14T10:56:04.635 INFO:teuthology.run_tasks:Running task rgw... 2024-09-14T10:56:04.651 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0'}} 2024-09-14T10:56:04.651 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-14T10:56:04.651 INFO:tasks.rgw:Creating data pools 2024-09-14T10:56:04.651 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-14T10:56:04.651 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-09-14T10:56:05.808 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'default.rgw.buckets.data' created 2024-09-14T10:56:05.830 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-14T10:56:06.812 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-14T10:56:06.843 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-14T10:56:07.818 INFO:teuthology.orchestra.run.smithi002.stderr:pool 'default.rgw.buckets.index' created 2024-09-14T10:56:07.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-14T10:56:08.822 INFO:teuthology.orchestra.run.smithi002.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-14T10:56:08.858 DEBUG:tasks.rgw:Pools created 2024-09-14T10:56:08.858 INFO:tasks.rgw:Configuring compression type = random 2024-09-14T10:56:08.858 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:56:08.858 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:56:08.859 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:56:08.976 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:08.976 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:10.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:10.883+0000 7f6f8d487640 0 -- 172.21.15.2:0/2936844263 >> [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] conn(0x7f6e68077140 msgr2=0x7f6e68079600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:10.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:10.888+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:10.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:10.890+0000 7f6f8c485640 0 -- 172.21.15.2:0/2021781209 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x564461bb4e60 msgr2=0x564461bb72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:11.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.091+0000 7f6f90f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.091+0000 7f6f90f42800 20 realm 2024-09-14T10:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.091+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.092+0000 7f6f90f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.092+0000 7f6f90f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.092+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.092+0000 7f6f90f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:11.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.092+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.093+0000 7f6f90f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:11.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.093+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.094+0000 7f6f90f42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-14T10:56:11.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.094+0000 7f6f90f42800 20 searching for the correct realm 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:11.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.109+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 20 zone default found 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 4 Realm: () 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 20 zonegroup default 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.110+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.111+0000 7f6f90f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:11.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:11.111+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:12.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:12.853+0000 7f6f90f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:12.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:12.853+0000 7f6f90f42800 20 rados->read ofs=0 len=0 2024-09-14T10:56:12.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:12.854+0000 7f6f90f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:12.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:12.854+0000 7f6f90f42800 20 started sync module instance, tier type = 2024-09-14T10:56:12.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:12.854+0000 7f6f90f42800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:56:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.883+0000 7f6f90f42800 20 add_watcher() i=0 2024-09-14T10:56:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.883+0000 7f6f90f42800 20 add_watcher() i=1 2024-09-14T10:56:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.883+0000 7f6f90f42800 20 add_watcher() i=2 2024-09-14T10:56:14.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.883+0000 7f6f90f42800 20 add_watcher() i=3 2024-09-14T10:56:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.883+0000 7f6f90f42800 20 add_watcher() i=4 2024-09-14T10:56:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.883+0000 7f6f90f42800 20 add_watcher() i=5 2024-09-14T10:56:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.883+0000 7f6f90f42800 20 add_watcher() i=6 2024-09-14T10:56:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.884+0000 7f6f90f42800 20 add_watcher() i=7 2024-09-14T10:56:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.884+0000 7f6f90f42800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.885+0000 7f6f90f42800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-14T10:56:14.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.885+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-14T10:56:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.885+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.885+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-14T10:56:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.885+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-14T10:56:14.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.885+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-14T10:56:14.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-14T10:56:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-14T10:56:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.886+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.887+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-14T10:56:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.887+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-14T10:56:14.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.887+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.887+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-14T10:56:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.887+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-14T10:56:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.887+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-14T10:56:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-14T10:56:14.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.888+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-14T10:56:14.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.889+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-14T10:56:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-14T10:56:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.890+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-14T10:56:14.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.891+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-14T10:56:14.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.892+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.893+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.894+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-14T10:56:14.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.895+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.896+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-14T10:56:14.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.897+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.898+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-14T10:56:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-14T10:56:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-14T10:56:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-14T10:56:14.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.899+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-14T10:56:14.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.900+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.901+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.902+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-14T10:56:14.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.903+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-14T10:56:14.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-14T10:56:14.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.904+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-14T10:56:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-14T10:56:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-14T10:56:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-14T10:56:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.905+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.906+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-14T10:56:14.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.907+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.908+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-14T10:56:14.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.909+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-14T10:56:14.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.910+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-14T10:56:14.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-14T10:56:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-14T10:56:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-14T10:56:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-14T10:56:14.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.911+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-14T10:56:14.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-14T10:56:14.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-14T10:56:14.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.912+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.913+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-14T10:56:14.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.914+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.915+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.915+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.915+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.915+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.915+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.915+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-14T10:56:14.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.916+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-14T10:56:14.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.917+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.918+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.919+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.920+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-14T10:56:14.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-14T10:56:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-14T10:56:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-14T10:56:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-14T10:56:14.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.921+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-14T10:56:14.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.923+0000 7f6f90f42800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-14T10:56:14.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.926+0000 7f6e3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:14.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.926+0000 7f6f90f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:14.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:14.926+0000 7f6f90f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.862+0000 7f6f90f42800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-14T10:56:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.862+0000 7f6f90f42800 5 note: GC not initialized 2024-09-14T10:56:17.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.862+0000 7f6e3dfe3640 20 reqs_thread_entry: start 2024-09-14T10:56:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.863+0000 7f6f90f42800 20 init_complete bucket index max shards: 1 2024-09-14T10:56:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.863+0000 7f6f90f42800 20 Filter name: none 2024-09-14T10:56:17.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.863+0000 7f6d9f7fe640 20 reqs_thread_entry: start 2024-09-14T10:56:17.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.892+0000 7f6e3efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.895+0000 7f6f90f42800 20 remove_watcher() i=0 2024-09-14T10:56:17.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.895+0000 7f6f90f42800 2 removed watcher, disabling cache 2024-09-14T10:56:17.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.896+0000 7f6f90f42800 20 remove_watcher() i=1 2024-09-14T10:56:17.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.897+0000 7f6f90f42800 20 remove_watcher() i=2 2024-09-14T10:56:17.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.902+0000 7f6f90f42800 20 remove_watcher() i=3 2024-09-14T10:56:17.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.903+0000 7f6f90f42800 20 remove_watcher() i=4 2024-09-14T10:56:17.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.904+0000 7f6f90f42800 20 remove_watcher() i=5 2024-09-14T10:56:17.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.906+0000 7f6f90f42800 20 remove_watcher() i=6 2024-09-14T10:56:17.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:17.907+0000 7f6f90f42800 20 remove_watcher() i=7 2024-09-14T10:56:17.930 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-14T10:56:17.931 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:56:17.931 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:56:17.931 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-14T10:56:17.931 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-14T10:56:18.000 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:18.000 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:18.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.030+0000 7f565791f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:18.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.030+0000 7f565791f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:18.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.034+0000 7f54b1ffb640 20 reqs_thread_entry: start 2024-09-14T10:56:18.050 INFO:teuthology.orchestra.run.smithi002.stdout:{"id":"17edae97-cd6b-4c90-863d-862429a20cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-14T10:56:18.050 DEBUG:tasks.util.rgw: json result: {'id': '17edae97-cd6b-4c90-863d-862429a20cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-14T10:56:18.050 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:56:18.051 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:56:18.051 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:56:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:18.108 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:18.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.145+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 20 realm 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.147+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.148+0000 7f6e4bf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:18.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.148+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.148+0000 7f6e4bf26800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:56:18.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.148+0000 7f6e4bf26800 20 searching for the correct realm 2024-09-14T10:56:18.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.151+0000 7f6e4735c640 0 -- 172.21.15.2:0/3192728459 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f6e38018070 msgr2=0x7f6e3808ea90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:18.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.155+0000 7f6e47b5d640 0 -- 172.21.15.2:0/3192728459 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f6e3c0aace0 msgr2=0x7f6e3c0b4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:18.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.361+0000 7f6e4bf26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:18.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.361+0000 7f6e4bf26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.361+0000 7f6e4bf26800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:56:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.361+0000 7f6e4bf26800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:56:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.361+0000 7f6e4bf26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.361+0000 7f6e4bf26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.361+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:18.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:18.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 zone default found 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 4 Realm: () 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 zonegroup default 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.362+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.363+0000 7f6e4bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.363+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.363+0000 7f6e4bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.363+0000 7f6e4bf26800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.363+0000 7f6e4bf26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.363+0000 7f6e4bf26800 20 started sync module instance, tier type = 2024-09-14T10:56:18.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.363+0000 7f6e4bf26800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:56:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.374+0000 7f6e4bf26800 20 add_watcher() i=0 2024-09-14T10:56:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.374+0000 7f6e4bf26800 20 add_watcher() i=1 2024-09-14T10:56:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.374+0000 7f6e4bf26800 20 add_watcher() i=2 2024-09-14T10:56:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.374+0000 7f6e4bf26800 20 add_watcher() i=3 2024-09-14T10:56:18.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.374+0000 7f6e4bf26800 20 add_watcher() i=4 2024-09-14T10:56:18.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.374+0000 7f6e4bf26800 20 add_watcher() i=5 2024-09-14T10:56:18.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.374+0000 7f6e4bf26800 20 add_watcher() i=6 2024-09-14T10:56:18.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.375+0000 7f6e4bf26800 20 add_watcher() i=7 2024-09-14T10:56:18.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.375+0000 7f6e4bf26800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.376+0000 7f6cfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.377+0000 7f6e4bf26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.377+0000 7f6e4bf26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.377+0000 7f6e4bf26800 5 note: GC not initialized 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.377+0000 7f6cfcfe1640 20 reqs_thread_entry: start 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.377+0000 7f6e4bf26800 20 init_complete bucket index max shards: 1 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.377+0000 7f6e4bf26800 20 Filter name: none 2024-09-14T10:56:18.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.377+0000 7f6c767fc640 20 reqs_thread_entry: start 2024-09-14T10:56:18.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.387+0000 7f6cfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.390+0000 7f6e4bf26800 20 remove_watcher() i=0 2024-09-14T10:56:18.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.390+0000 7f6e4bf26800 2 removed watcher, disabling cache 2024-09-14T10:56:18.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.392+0000 7f6e4bf26800 20 remove_watcher() i=1 2024-09-14T10:56:18.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.393+0000 7f6e4bf26800 20 remove_watcher() i=2 2024-09-14T10:56:18.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.394+0000 7f6e4bf26800 20 remove_watcher() i=3 2024-09-14T10:56:18.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.395+0000 7f6e4bf26800 20 remove_watcher() i=4 2024-09-14T10:56:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.396+0000 7f6e4bf26800 20 remove_watcher() i=5 2024-09-14T10:56:18.395 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.397+0000 7f6e4bf26800 20 remove_watcher() i=6 2024-09-14T10:56:18.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.398+0000 7f6e4bf26800 20 remove_watcher() i=7 2024-09-14T10:56:18.408 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-14T10:56:18.408 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:56:18.409 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:56:18.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--placement-inline-data', 'false'] 2024-09-14T10:56:18.409 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --placement-inline-data false 2024-09-14T10:56:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:18.472 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:18.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.501+0000 7f75df923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:18.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.501+0000 7f75df923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:18.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.505+0000 7f7499ffb640 20 reqs_thread_entry: start 2024-09-14T10:56:18.521 INFO:teuthology.orchestra.run.smithi002.stdout:{"id":"17edae97-cd6b-4c90-863d-862429a20cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:56:18.521 DEBUG:tasks.util.rgw: json result: {'id': '17edae97-cd6b-4c90-863d-862429a20cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:56:18.521 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-14T10:56:18.521 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-14T10:56:18.522 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-14T10:56:18.579 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:18.579 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:18.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.615+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.617+0000 7f633920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.617+0000 7f633920f800 20 realm 2024-09-14T10:56:18.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.617+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.617+0000 7f633920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.617+0000 7f633920f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:56:18.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.617+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.618+0000 7f633920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.618+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.618+0000 7f633920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:18.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.618+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.619+0000 7f633920f800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-14T10:56:18.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.619+0000 7f633920f800 20 searching for the correct realm 2024-09-14T10:56:18.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.622+0000 7f63364f8640 0 -- 172.21.15.2:0/2680309922 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x564a14d2e7d0 msgr2=0x564a14d30c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:56:18.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.626+0000 7f6336cf9640 0 -- 172.21.15.2:0/2680309922 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f632c0398b0 msgr2=0x7f632c01c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:56:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:56:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:56:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:56:18.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:56:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:56:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:56:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:56:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-14T10:56:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 zone default found 2024-09-14T10:56:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 4 Realm: () 2024-09-14T10:56:18.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 zonegroup default 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.631+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.632+0000 7f633920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.632+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.632+0000 7f633920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.632+0000 7f633920f800 20 rados->read ofs=0 len=0 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.632+0000 7f633920f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.632+0000 7f633920f800 20 started sync module instance, tier type = 2024-09-14T10:56:18.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.632+0000 7f633920f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:56:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=0 2024-09-14T10:56:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=1 2024-09-14T10:56:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=2 2024-09-14T10:56:18.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=3 2024-09-14T10:56:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=4 2024-09-14T10:56:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=5 2024-09-14T10:56:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=6 2024-09-14T10:56:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.644+0000 7f633920f800 20 add_watcher() i=7 2024-09-14T10:56:18.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.645+0000 7f633920f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:56:18.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.646+0000 7f61ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.646+0000 7f633920f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.646+0000 7f633920f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.647+0000 7f633920f800 5 note: GC not initialized 2024-09-14T10:56:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.647+0000 7f6167fff640 20 reqs_thread_entry: start 2024-09-14T10:56:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.647+0000 7f633920f800 20 init_complete bucket index max shards: 1 2024-09-14T10:56:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.647+0000 7f633920f800 20 Filter name: none 2024-09-14T10:56:18.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.647+0000 7f6165ffb640 20 reqs_thread_entry: start 2024-09-14T10:56:18.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.656+0000 7f61ed7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:56:18.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.659+0000 7f633920f800 20 remove_watcher() i=0 2024-09-14T10:56:18.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.659+0000 7f633920f800 2 removed watcher, disabling cache 2024-09-14T10:56:18.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.660+0000 7f633920f800 20 remove_watcher() i=1 2024-09-14T10:56:18.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.661+0000 7f633920f800 20 remove_watcher() i=2 2024-09-14T10:56:18.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.662+0000 7f633920f800 20 remove_watcher() i=3 2024-09-14T10:56:18.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.663+0000 7f633920f800 20 remove_watcher() i=4 2024-09-14T10:56:18.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.664+0000 7f633920f800 20 remove_watcher() i=5 2024-09-14T10:56:18.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.665+0000 7f633920f800 20 remove_watcher() i=6 2024-09-14T10:56:18.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.666+0000 7f633920f800 20 remove_watcher() i=7 2024-09-14T10:56:18.677 INFO:teuthology.orchestra.run.smithi002.stdout:[] 2024-09-14T10:56:18.677 DEBUG:tasks.util.rgw: json result: [] 2024-09-14T10:56:18.677 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-14T10:56:18.677 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:56:18.677 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-14T10:56:18.678 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-14T10:56:18.741 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:18.741 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:18.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.769+0000 7f38aeb75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:18.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.769+0000 7f38aeb75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:18.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.773+0000 7f37227fc640 20 reqs_thread_entry: start 2024-09-14T10:56:18.787 INFO:teuthology.orchestra.run.smithi002.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-14T10:56:18.788 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-14T10:56:18.788 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:56:18.788 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-14T10:56:18.788 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-14T10:56:18.855 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:18.855 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.885+0000 7fd454939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:18.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.885+0000 7fd454939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:18.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.889+0000 7fd30effd640 20 reqs_thread_entry: start 2024-09-14T10:56:18.905 INFO:teuthology.orchestra.run.smithi002.stdout:{"id":"17edae97-cd6b-4c90-863d-862429a20cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:56:18.906 DEBUG:tasks.util.rgw: json result: {'id': '17edae97-cd6b-4c90-863d-862429a20cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:56:18.906 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-14T10:56:18.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:56:18.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-14T10:56:18.906 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-14T10:56:18.969 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:18.970 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.998+0000 7fb175139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:18.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:18.998+0000 7fb175139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:19.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:19.002+0000 7fafbeffd640 20 reqs_thread_entry: start 2024-09-14T10:56:19.016 INFO:teuthology.orchestra.run.smithi002.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-14T10:56:19.016 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-14T10:56:19.016 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:56:19.016 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-14T10:56:19.016 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-14T10:56:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:56:19.082 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:56:19.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:19.110+0000 7fc85e93e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:56:19.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:19.110+0000 7fc85e93e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:56:19.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T10:56:19.115+0000 7fc71cfe1640 20 reqs_thread_entry: start 2024-09-14T10:56:19.130 INFO:teuthology.orchestra.run.smithi002.stdout:{"id":"17edae97-cd6b-4c90-863d-862429a20cf3","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-14T10:56:19.131 DEBUG:tasks.util.rgw: json result: {'id': '17edae97-cd6b-4c90-863d-862429a20cf3', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-14T10:56:19.131 INFO:tasks.rgw:Starting rgw... 2024-09-14T10:56:19.131 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0'} 2024-09-14T10:56:19.131 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-14T10:56:19.131 DEBUG:teuthology.orchestra.run.smithi002:> sudo echo -n https://smithi002.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-14T10:56:19.173 INFO:teuthology.orchestra.run.smithi002.stdout:https://smithi002.front.sepia.ceph.com:443 2024-09-14T10:56:19.173 DEBUG:teuthology.orchestra.run.smithi002:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-14T10:56:19.253 DEBUG:teuthology.orchestra.run.smithi002:> sudo keytool -import -alias smithi002.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-14T10:56:19.464 INFO:teuthology.orchestra.run.smithi002.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-14T10:56:19.612 INFO:teuthology.orchestra.run.smithi002.stderr:Certificate was added to keystore 2024-09-14T10:56:19.637 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-14T10:56:19.637 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-14T10:56:19.639 INFO:tasks.rgw.client.0:Started 2024-09-14T10:56:19.639 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi002.front.sepia.ceph.com:443/ 2024-09-14T10:56:19.640 DEBUG:teuthology.orchestra.run.smithi002:> curl https://smithi002.front.sepia.ceph.com:443/ 2024-09-14T10:56:19.677 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-14T10:56:19.677 INFO:teuthology.orchestra.run.smithi002.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:56:19.677 INFO:teuthology.orchestra.run.smithi002.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:56:19.677 INFO:teuthology.orchestra.run.smithi002.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-14T10:56:19.677 INFO:teuthology.orchestra.run.smithi002.stderr:curl: (7) Failed to connect to smithi002.front.sepia.ceph.com port 443: Connection refused 2024-09-14T10:56:19.884 INFO:tasks.rgw.client.0.smithi002.stdout:2024-09-14T10:56:19.885+0000 7f0a40bf3880 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-14T10:56:20.678 DEBUG:teuthology.orchestra.run.smithi002:> curl https://smithi002.front.sepia.ceph.com:443/ 2024-09-14T10:56:20.715 INFO:teuthology.orchestra.run.smithi002.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-14T10:56:20.715 INFO:teuthology.orchestra.run.smithi002.stderr: Dload Upload Total Spent Left Speed 2024-09-14T10:56:20.768 INFO:teuthology.orchestra.run.smithi002.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 3528 0 --:--:-- --:--:-- --:--:-- 3528 2024-09-14T10:56:20.769 INFO:teuthology.orchestra.run.smithi002.stdout:anonymous 2024-09-14T10:56:20.769 INFO:teuthology.run_tasks:Running task tox... 2024-09-14T10:56:20.782 INFO:tasks.tox:Deploying tox from pip... 2024-09-14T10:56:20.782 DEBUG:teuthology.orchestra.run.smithi002:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-14T10:56:23.178 DEBUG:teuthology.orchestra.run.smithi002:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-14T10:56:23.713 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting tox==3.15.0 2024-09-14T10:56:23.775 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-14T10:56:23.921 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting packaging>=14 2024-09-14T10:56:23.935 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-14T10:56:24.012 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting toml>=0.9.4 2024-09-14T10:56:24.026 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-14T10:56:24.122 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting filelock<4,>=3.0.0 2024-09-14T10:56:24.136 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-14T10:56:24.389 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-14T10:56:24.405 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-14T10:56:24.621 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting six<2,>=1.14.0 2024-09-14T10:56:24.635 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:56:24.711 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting pluggy<1,>=0.12.0 2024-09-14T10:56:24.725 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-14T10:56:24.817 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting py<2,>=1.4.17 2024-09-14T10:56:24.831 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-14T10:56:24.953 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting distlib<1,>=0.3.7 2024-09-14T10:56:24.968 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-14T10:56:25.084 INFO:teuthology.orchestra.run.smithi002.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-14T10:56:25.098 INFO:teuthology.orchestra.run.smithi002.stdout: Downloading platformdirs-4.3.3-py3-none-any.whl (18 kB) 2024-09-14T10:56:25.216 INFO:teuthology.orchestra.run.smithi002.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-14T10:56:26.618 INFO:teuthology.orchestra.run.smithi002.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.3 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-14T10:56:26.824 INFO:teuthology.orchestra.run.smithi002.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-14T10:56:26.824 INFO:teuthology.orchestra.run.smithi002.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-14T10:56:26.889 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:56:26.904 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:56:26.904 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:56:26.905 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:56:26.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:56:26.935 INFO:teuthology.orchestra.run.smithi002.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:56:26.935 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:56:27.005 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:56:27.005 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:56:27.074 INFO:tasks.workunit:timeout=3h 2024-09-14T10:56:27.074 INFO:tasks.workunit:cleanup=True 2024-09-14T10:56:27.074 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:56:27.143 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:57:24.473 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 94% (12186/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T10:57:24.920 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:24.921 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-14T10:57:24.922 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:24.922 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-14T10:57:24.922 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:24.922 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:57:24.922 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:24.922 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:57:24.923 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:57:25.005 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:57:25.007 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:57:25.007 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:57:25.572 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:57:25.635 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:57:25.675 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:57:25.677 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:57:25.677 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:57:25.717 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:57:25.720 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:57:25.720 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:57:25.790 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-14T10:57:25.792 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-14T10:57:25.792 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:57:25.865 INFO:tasks.workunit.client.0.smithi002.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-14T10:57:25.865 INFO:tasks.workunit.client.0.smithi002.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:57:25.866 INFO:tasks.workunit.client.0.smithi002.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ deactivate nondestructive 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ hash -r 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset VIRTUAL_ENV 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T10:57:28.217 INFO:tasks.workunit.client.0.smithi002.stderr:++ export VIRTUAL_ENV 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ export PATH 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ PS1='(rgw) ' 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ export PS1 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:++ hash -r 2024-09-14T10:57:28.219 INFO:tasks.workunit.client.0.smithi002.stderr:+ pip install pip --upgrade 2024-09-14T10:57:28.457 INFO:tasks.workunit.client.0.smithi002.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T10:57:28.647 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting pip 2024-09-14T10:57:28.698 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T10:57:28.860 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: pip 2024-09-14T10:57:28.861 INFO:tasks.workunit.client.0.smithi002.stdout: Attempting uninstall: pip 2024-09-14T10:57:28.861 INFO:tasks.workunit.client.0.smithi002.stdout: Found existing installation: pip 21.3.1 2024-09-14T10:57:29.039 INFO:tasks.workunit.client.0.smithi002.stdout: Uninstalling pip-21.3.1: 2024-09-14T10:57:29.045 INFO:tasks.workunit.client.0.smithi002.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T10:57:29.819 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed pip-24.2 2024-09-14T10:57:30.063 INFO:tasks.workunit.client.0.smithi002.stderr:+ pip install boto3 2024-09-14T10:57:30.962 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting boto3 2024-09-14T10:57:31.008 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T10:57:31.643 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T10:57:31.658 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T10:57:31.897 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T10:57:31.912 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T10:57:32.028 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T10:57:32.043 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T10:57:32.156 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:57:32.170 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T10:57:32.320 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:57:32.333 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T10:57:32.562 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T10:57:32.576 INFO:tasks.workunit.client.0.smithi002.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T10:57:32.640 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T10:57:32.721 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T10:57:32.927 INFO:tasks.workunit.client.0.smithi002.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 64.1 MB/s eta 0:00:00 2024-09-14T10:57:32.942 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T10:57:33.005 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T10:57:33.072 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T10:57:33.149 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T10:57:33.215 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T10:57:33.346 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T10:57:34.373 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T10:57:34.491 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-14T10:57:34.629 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-14T10:57:34.665 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:34.665 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.707+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.708+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.708+0000 7fa1a6b0c800 20 realm 2024-09-14T10:57:34.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.708+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.708+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.708+0000 7fa1a6b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:34.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.708+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.709+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.709+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.710+0000 7fa1a6b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:34.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.710+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.710+0000 7fa1a6b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:34.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.710+0000 7fa1a6b0c800 20 searching for the correct realm 2024-09-14T10:57:34.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.714+0000 7fa1a4df7640 0 -- 172.21.15.2:0/2645433644 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55e3049d5f70 msgr2=0x55e3049d8360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:34.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.717+0000 7fa1a3df5640 0 -- 172.21.15.2:0/2645433644 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fa194087040 msgr2=0x7fa194060a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:34.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.721+0000 7fa1a6b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.721+0000 7fa1a6b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.721+0000 7fa1a6b0c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.721+0000 7fa1a6b0c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.721+0000 7fa1a6b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.721+0000 7fa1a6b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.721+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 zone default found 2024-09-14T10:57:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 4 Realm: () 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 zonegroup default 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.722+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.723+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.723+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.723+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.723+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.723+0000 7fa1a6b0c800 20 started sync module instance, tier type = 2024-09-14T10:57:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.723+0000 7fa1a6b0c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:34.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.736+0000 7fa1a6b0c800 20 add_watcher() i=0 2024-09-14T10:57:34.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.736+0000 7fa1a6b0c800 20 add_watcher() i=1 2024-09-14T10:57:34.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.736+0000 7fa1a6b0c800 20 add_watcher() i=2 2024-09-14T10:57:34.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.736+0000 7fa1a6b0c800 20 add_watcher() i=3 2024-09-14T10:57:34.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.736+0000 7fa1a6b0c800 20 add_watcher() i=4 2024-09-14T10:57:34.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.736+0000 7fa1a6b0c800 20 add_watcher() i=5 2024-09-14T10:57:34.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.736+0000 7fa1a6b0c800 20 add_watcher() i=6 2024-09-14T10:57:34.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.737+0000 7fa1a6b0c800 20 add_watcher() i=7 2024-09-14T10:57:34.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.737+0000 7fa1a6b0c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:34.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.739+0000 7fa05afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:34.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.739+0000 7fa1a6b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:34.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.739+0000 7fa1a6b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:34.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.739+0000 7fa1a6b0c800 5 note: GC not initialized 2024-09-14T10:57:34.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.739+0000 7fa059fdb640 20 reqs_thread_entry: start 2024-09-14T10:57:34.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.739+0000 7fa1a6b0c800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:34.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 20 Filter name: none 2024-09-14T10:57:34.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7f9fcb7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:34.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-14T10:57:34.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:57:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.740+0000 7fa1a6b0c800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-14T10:57:34.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.742+0000 7fa1a6b0c800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:57:34.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.742+0000 7fa1a6b0c800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:57:34.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.742+0000 7fa1a6b0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-14T10:57:34.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.743+0000 7fa07b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94433523413264 notifier 4659 bl.length()=593 2024-09-14T10:57:34.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.743+0000 7fa07b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-14T10:57:34.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.743+0000 7fa07b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-14T10:57:34.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.744+0000 7fa1a6b0c800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:57:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.744+0000 7fa1a6b0c800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:57:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.744+0000 7fa1a6b0c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-14T10:57:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.745+0000 7fa07b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789952 cookie 94433523365216 notifier 4659 bl.length()=186 2024-09-14T10:57:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.745+0000 7fa07b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-14T10:57:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.745+0000 7fa07b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-14T10:57:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.746+0000 7fa05afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:34.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.749+0000 7fa1a6b0c800 20 remove_watcher() i=0 2024-09-14T10:57:34.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.749+0000 7fa1a6b0c800 2 removed watcher, disabling cache 2024-09-14T10:57:34.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.750+0000 7fa1a6b0c800 20 remove_watcher() i=1 2024-09-14T10:57:34.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.751+0000 7fa1a6b0c800 20 remove_watcher() i=2 2024-09-14T10:57:34.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.753+0000 7fa1a6b0c800 20 remove_watcher() i=3 2024-09-14T10:57:34.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.754+0000 7fa1a6b0c800 20 remove_watcher() i=4 2024-09-14T10:57:34.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.755+0000 7fa1a6b0c800 20 remove_watcher() i=5 2024-09-14T10:57:34.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.756+0000 7fa1a6b0c800 20 remove_watcher() i=6 2024-09-14T10:57:34.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:34.757+0000 7fa1a6b0c800 20 remove_watcher() i=7 2024-09-14T10:57:34.931 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:34.931 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:34.978 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:34.978 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.023 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.023 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.035 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.035 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.047 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.047 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.052 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.052 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.058 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.058 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.062 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.062 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.066 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.066 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.080 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.080 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.083 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.083 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.097 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.097 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.100 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.100 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.114 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.114 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.117 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.117 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.131 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:35.131 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:35.133 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: recalculated bucket check stats are correct 2024-09-14T10:57:35.134 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:35.135 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:57:35.165 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:35.165 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:35.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.207+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 20 realm 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.208+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.209+0000 7fd0edb3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:35.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.209+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.209+0000 7fd0edb3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:35.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.209+0000 7fd0edb3e800 20 searching for the correct realm 2024-09-14T10:57:35.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.213+0000 7fd0ea0c1640 0 -- 172.21.15.2:0/1026635273 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x559d40c0fb90 msgr2=0x559d40c11f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:35.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.217+0000 7fd0e90bf640 0 -- 172.21.15.2:0/1026635273 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fd0dc026070 msgr2=0x7fd0dc037990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:35.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:35.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:35.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:35.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:35.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:35.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:35.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.220+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:35.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:35.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 20 zone default found 2024-09-14T10:57:35.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 4 Realm: () 2024-09-14T10:57:35.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:35.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 20 zonegroup default 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.221+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.222+0000 7fd0edb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.222+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.222+0000 7fd0edb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.222+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.222+0000 7fd0edb3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.222+0000 7fd0edb3e800 20 started sync module instance, tier type = 2024-09-14T10:57:35.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.222+0000 7fd0edb3e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:35.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.235+0000 7fd0edb3e800 20 add_watcher() i=0 2024-09-14T10:57:35.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.235+0000 7fd0edb3e800 20 add_watcher() i=1 2024-09-14T10:57:35.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.235+0000 7fd0edb3e800 20 add_watcher() i=2 2024-09-14T10:57:35.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.235+0000 7fd0edb3e800 20 add_watcher() i=3 2024-09-14T10:57:35.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.235+0000 7fd0edb3e800 20 add_watcher() i=4 2024-09-14T10:57:35.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.235+0000 7fd0edb3e800 20 add_watcher() i=5 2024-09-14T10:57:35.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.235+0000 7fd0edb3e800 20 add_watcher() i=6 2024-09-14T10:57:35.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.236+0000 7fd0edb3e800 20 add_watcher() i=7 2024-09-14T10:57:35.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.236+0000 7fd0edb3e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:35.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.237+0000 7fcf9bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 5 note: GC not initialized 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fcf9affd640 20 reqs_thread_entry: start 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 20 Filter name: none 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fcf98ff9640 20 reqs_thread_entry: start 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:35.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.238+0000 7fd0edb3e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:35.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:35.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:35.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:35.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.239+0000 7fd0edb3e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:35.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.243+0000 7fcf9bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:35.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.248+0000 7fd0edb3e800 20 remove_watcher() i=0 2024-09-14T10:57:35.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.248+0000 7fd0edb3e800 2 removed watcher, disabling cache 2024-09-14T10:57:35.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.249+0000 7fd0edb3e800 20 remove_watcher() i=1 2024-09-14T10:57:35.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.250+0000 7fd0edb3e800 20 remove_watcher() i=2 2024-09-14T10:57:35.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.252+0000 7fd0edb3e800 20 remove_watcher() i=3 2024-09-14T10:57:35.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.253+0000 7fd0edb3e800 20 remove_watcher() i=4 2024-09-14T10:57:35.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.254+0000 7fd0edb3e800 20 remove_watcher() i=5 2024-09-14T10:57:35.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.255+0000 7fd0edb3e800 20 remove_watcher() i=6 2024-09-14T10:57:35.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.256+0000 7fd0edb3e800 20 remove_watcher() i=7 2024-09-14T10:57:35.266 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:57:35.296 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:35.297 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:35.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.337+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.339+0000 7f6d09a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.339+0000 7f6d09a0e800 20 realm 2024-09-14T10:57:35.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.339+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.340+0000 7f6d09a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.340+0000 7f6d09a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.340+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.340+0000 7f6d09a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.340+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.341+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.341+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.341+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:35.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.341+0000 7f6d09a0e800 20 searching for the correct realm 2024-09-14T10:57:35.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.344+0000 7f6d0596c640 0 -- 172.21.15.2:0/2774244146 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55ad2fd0ade0 msgr2=0x55ad2fd0d1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:57:35.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.348+0000 7f6d0516b640 0 -- 172.21.15.2:0/2774244146 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f6cf0075230 msgr2=0x7f6cf0077920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:35.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:35.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:35.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:35.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 zone default found 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 4 Realm: () 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 zonegroup default 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.352+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.353+0000 7f6d09a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.353+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.353+0000 7f6d09a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.353+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.353+0000 7f6d09a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.353+0000 7f6d09a0e800 20 started sync module instance, tier type = 2024-09-14T10:57:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.353+0000 7f6d09a0e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:35.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.365+0000 7f6d09a0e800 20 add_watcher() i=0 2024-09-14T10:57:35.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.365+0000 7f6d09a0e800 20 add_watcher() i=1 2024-09-14T10:57:35.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.365+0000 7f6d09a0e800 20 add_watcher() i=2 2024-09-14T10:57:35.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.365+0000 7f6d09a0e800 20 add_watcher() i=3 2024-09-14T10:57:35.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.365+0000 7f6d09a0e800 20 add_watcher() i=4 2024-09-14T10:57:35.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.365+0000 7f6d09a0e800 20 add_watcher() i=5 2024-09-14T10:57:35.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.365+0000 7f6d09a0e800 20 add_watcher() i=6 2024-09-14T10:57:35.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.366+0000 7f6d09a0e800 20 add_watcher() i=7 2024-09-14T10:57:35.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.366+0000 7f6d09a0e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:35.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.368+0000 7f6bbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.368+0000 7f6d09a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.368+0000 7f6d09a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.368+0000 7f6d09a0e800 5 note: GC not initialized 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.369+0000 7f6bbafe5640 20 reqs_thread_entry: start 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.369+0000 7f6d09a0e800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.369+0000 7f6d09a0e800 20 Filter name: none 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.369+0000 7f6bb8fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.369+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.369+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:35.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.369+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.370+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.370+0000 7f6d09a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.370+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.370+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.370+0000 7f6d09a0e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.370+0000 7f6d09a0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.370+0000 7f6d09a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.371+0000 7f6bbbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:35.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.374+0000 7f6d09a0e800 20 remove_watcher() i=0 2024-09-14T10:57:35.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.374+0000 7f6d09a0e800 2 removed watcher, disabling cache 2024-09-14T10:57:35.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.376+0000 7f6d09a0e800 20 remove_watcher() i=1 2024-09-14T10:57:35.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.377+0000 7f6d09a0e800 20 remove_watcher() i=2 2024-09-14T10:57:35.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.378+0000 7f6d09a0e800 20 remove_watcher() i=3 2024-09-14T10:57:35.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.379+0000 7f6d09a0e800 20 remove_watcher() i=4 2024-09-14T10:57:35.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.380+0000 7f6d09a0e800 20 remove_watcher() i=5 2024-09-14T10:57:35.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.381+0000 7f6d09a0e800 20 remove_watcher() i=6 2024-09-14T10:57:35.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.382+0000 7f6d09a0e800 20 remove_watcher() i=7 2024-09-14T10:57:35.391 INFO:tasks.workunit.client.0.smithi002.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 74, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-14T10:57:35.392 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-14T10:57:35.392 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:35.393 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:57:35.426 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:35.427 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:35.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.468+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.469+0000 7ff640ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.469+0000 7ff640ebb800 20 realm 2024-09-14T10:57:35.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.469+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.469+0000 7ff640ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.469+0000 7ff640ebb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:35.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.469+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.470+0000 7ff640ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.470+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.470+0000 7ff640ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:35.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.470+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.471+0000 7ff640ebb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:35.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.471+0000 7ff640ebb800 20 searching for the correct realm 2024-09-14T10:57:35.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.474+0000 7ff63f1a6640 0 -- 172.21.15.2:0/2108386107 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55e5067d93d0 msgr2=0x55e5067db860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:57:35.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.477+0000 7ff63e9a5640 0 -- 172.21.15.2:0/2108386107 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ff63406d3c0 msgr2=0x7ff634071db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.481+0000 7ff640ebb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.481+0000 7ff640ebb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.481+0000 7ff640ebb800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.481+0000 7ff640ebb800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.481+0000 7ff640ebb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.481+0000 7ff640ebb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.481+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 zone default found 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 4 Realm: () 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:35.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 zonegroup default 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.482+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.483+0000 7ff640ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.483+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.483+0000 7ff640ebb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.483+0000 7ff640ebb800 20 started sync module instance, tier type = 2024-09-14T10:57:35.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.483+0000 7ff640ebb800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:35.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.492+0000 7ff640ebb800 20 add_watcher() i=0 2024-09-14T10:57:35.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.492+0000 7ff640ebb800 20 add_watcher() i=1 2024-09-14T10:57:35.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.492+0000 7ff640ebb800 20 add_watcher() i=2 2024-09-14T10:57:35.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.492+0000 7ff640ebb800 20 add_watcher() i=3 2024-09-14T10:57:35.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.492+0000 7ff640ebb800 20 add_watcher() i=4 2024-09-14T10:57:35.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.492+0000 7ff640ebb800 20 add_watcher() i=5 2024-09-14T10:57:35.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.492+0000 7ff640ebb800 20 add_watcher() i=6 2024-09-14T10:57:35.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.493+0000 7ff640ebb800 20 add_watcher() i=7 2024-09-14T10:57:35.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.493+0000 7ff640ebb800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:35.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.495+0000 7ff4f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:35.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.495+0000 7ff640ebb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:35.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.495+0000 7ff640ebb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:35.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.495+0000 7ff640ebb800 5 note: GC not initialized 2024-09-14T10:57:35.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff46ffff640 20 reqs_thread_entry: start 2024-09-14T10:57:35.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:35.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 20 Filter name: none 2024-09-14T10:57:35.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff46dffb640 20 reqs_thread_entry: start 2024-09-14T10:57:35.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:35.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.496+0000 7ff640ebb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:35.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.497+0000 7ff640ebb800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:57:35.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.498+0000 7ff4f57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:35.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.500+0000 7ff640ebb800 20 remove_watcher() i=0 2024-09-14T10:57:35.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.500+0000 7ff640ebb800 2 removed watcher, disabling cache 2024-09-14T10:57:35.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.502+0000 7ff640ebb800 20 remove_watcher() i=1 2024-09-14T10:57:35.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.503+0000 7ff640ebb800 20 remove_watcher() i=2 2024-09-14T10:57:35.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.504+0000 7ff640ebb800 20 remove_watcher() i=3 2024-09-14T10:57:35.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.505+0000 7ff640ebb800 20 remove_watcher() i=4 2024-09-14T10:57:35.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.506+0000 7ff640ebb800 20 remove_watcher() i=5 2024-09-14T10:57:35.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.507+0000 7ff640ebb800 20 remove_watcher() i=6 2024-09-14T10:57:35.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:35.508+0000 7ff640ebb800 20 remove_watcher() i=7 2024-09-14T10:57:35.518 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:57:35.926 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:57:37.333 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:37.333 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:37.386 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:37.388 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:57:37.423 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:37.423 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:37.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.469+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 20 realm 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.471+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.472+0000 7f58eea2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:37.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.472+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.473+0000 7f58eea2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:37.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.473+0000 7f58eea2f800 20 searching for the correct realm 2024-09-14T10:57:37.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.476+0000 7f58ecd1a640 0 -- 172.21.15.2:0/2093711908 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f58e006d040 msgr2=0x7f58e0079920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:37.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.480+0000 7f58ec519640 0 -- 172.21.15.2:0/2093711908 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f58e00a0410 msgr2=0x7f58e00a0870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:37.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.687+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:37.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 zone default found 2024-09-14T10:57:37.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 4 Realm: () 2024-09-14T10:57:37.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:37.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:37.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:37.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 zonegroup default 2024-09-14T10:57:37.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.688+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.689+0000 7f58eea2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.689+0000 7f58eea2f800 20 started sync module instance, tier type = 2024-09-14T10:57:37.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.689+0000 7f58eea2f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:37.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.701+0000 7f58eea2f800 20 add_watcher() i=0 2024-09-14T10:57:37.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.701+0000 7f58eea2f800 20 add_watcher() i=1 2024-09-14T10:57:37.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.701+0000 7f58eea2f800 20 add_watcher() i=2 2024-09-14T10:57:37.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.701+0000 7f58eea2f800 20 add_watcher() i=3 2024-09-14T10:57:37.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.701+0000 7f58eea2f800 20 add_watcher() i=4 2024-09-14T10:57:37.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.701+0000 7f58eea2f800 20 add_watcher() i=5 2024-09-14T10:57:37.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.701+0000 7f58eea2f800 20 add_watcher() i=6 2024-09-14T10:57:37.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.703+0000 7f58eea2f800 20 add_watcher() i=7 2024-09-14T10:57:37.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.703+0000 7f58eea2f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:37.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.705+0000 7f57a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:37.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.705+0000 7f58eea2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:37.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.705+0000 7f58eea2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:37.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.705+0000 7f58eea2f800 5 note: GC not initialized 2024-09-14T10:57:37.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.705+0000 7f57a1fdb640 20 reqs_thread_entry: start 2024-09-14T10:57:37.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.706+0000 7f58eea2f800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:37.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.706+0000 7f58eea2f800 20 Filter name: none 2024-09-14T10:57:37.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.706+0000 7f57137fe640 20 reqs_thread_entry: start 2024-09-14T10:57:37.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.706+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.706+0000 7f58eea2f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:37.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.706+0000 7f58eea2f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.707+0000 7f58eea2f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:37.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.707+0000 7f58eea2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:37.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.707+0000 7f58eea2f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:37.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.707+0000 7f58eea2f800 20 INFO: main: starting shard=0 2024-09-14T10:57:37.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.707+0000 7f58eea2f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:37.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.707+0000 7f58eea2f800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:57:37.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.707+0000 7f58eea2f800 20 INFO: main: done 2024-09-14T10:57:37.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.708+0000 7f57a2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:37.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.711+0000 7f58eea2f800 20 remove_watcher() i=0 2024-09-14T10:57:37.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.711+0000 7f58eea2f800 2 removed watcher, disabling cache 2024-09-14T10:57:37.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.712+0000 7f58eea2f800 20 remove_watcher() i=1 2024-09-14T10:57:37.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.714+0000 7f58eea2f800 20 remove_watcher() i=2 2024-09-14T10:57:37.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.715+0000 7f58eea2f800 20 remove_watcher() i=3 2024-09-14T10:57:37.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.716+0000 7f58eea2f800 20 remove_watcher() i=4 2024-09-14T10:57:37.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.717+0000 7f58eea2f800 20 remove_watcher() i=5 2024-09-14T10:57:37.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.718+0000 7f58eea2f800 20 remove_watcher() i=6 2024-09-14T10:57:37.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.720+0000 7f58eea2f800 20 remove_watcher() i=7 2024-09-14T10:57:37.732 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:37.732 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:37.736 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:37.736 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:37.739 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:37.739 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:37.790 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:37.791 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:57:37.825 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:37.825 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:37.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.867+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.869+0000 7fb5acd2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.869+0000 7fb5acd2a800 20 realm 2024-09-14T10:57:37.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.869+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.869+0000 7fb5acd2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.869+0000 7fb5acd2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:37.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.869+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.870+0000 7fb5acd2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.870+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.871+0000 7fb5acd2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:37.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.871+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.871+0000 7fb5acd2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:37.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.871+0000 7fb5acd2a800 20 searching for the correct realm 2024-09-14T10:57:37.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.875+0000 7fb5a3fff640 0 -- 172.21.15.2:0/1576153015 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x555d09aabce0 msgr2=0x555d09aae110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:37.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.879+0000 7fb5a3fff640 0 -- 172.21.15.2:0/1576153015 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fb59c09d040 msgr2=0x7fb59c089420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.883+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:37.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 zone default found 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 4 Realm: () 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 zonegroup default 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.884+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.885+0000 7fb5acd2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.885+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.885+0000 7fb5acd2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:37.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.885+0000 7fb5acd2a800 20 started sync module instance, tier type = 2024-09-14T10:57:37.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.885+0000 7fb5acd2a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:37.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.896+0000 7fb5acd2a800 20 add_watcher() i=0 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.896+0000 7fb5acd2a800 20 add_watcher() i=1 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.896+0000 7fb5acd2a800 20 add_watcher() i=2 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.896+0000 7fb5acd2a800 20 add_watcher() i=3 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.896+0000 7fb5acd2a800 20 add_watcher() i=4 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.896+0000 7fb5acd2a800 20 add_watcher() i=5 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.896+0000 7fb5acd2a800 20 add_watcher() i=6 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.897+0000 7fb5acd2a800 20 add_watcher() i=7 2024-09-14T10:57:37.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.897+0000 7fb5acd2a800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:37.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb45efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:37.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb5acd2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:37.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb5acd2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:37.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb5acd2a800 5 note: GC not initialized 2024-09-14T10:57:37.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb45dfe3640 20 reqs_thread_entry: start 2024-09-14T10:57:37.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb5acd2a800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:37.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb5acd2a800 20 Filter name: none 2024-09-14T10:57:37.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.899+0000 7fb3cf7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:37.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 rados->read ofs=0 len=0 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 INFO: main: starting shard=0 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.900+0000 7fb5acd2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.901+0000 7fb5acd2a800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:57:37.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.901+0000 7fb5acd2a800 20 INFO: main: done 2024-09-14T10:57:37.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.902+0000 7fb45efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:37.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.904+0000 7fb5acd2a800 20 remove_watcher() i=0 2024-09-14T10:57:37.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.904+0000 7fb5acd2a800 2 removed watcher, disabling cache 2024-09-14T10:57:37.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.905+0000 7fb5acd2a800 20 remove_watcher() i=1 2024-09-14T10:57:37.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.907+0000 7fb5acd2a800 20 remove_watcher() i=2 2024-09-14T10:57:37.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.908+0000 7fb5acd2a800 20 remove_watcher() i=3 2024-09-14T10:57:37.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.909+0000 7fb5acd2a800 20 remove_watcher() i=4 2024-09-14T10:57:37.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.910+0000 7fb5acd2a800 20 remove_watcher() i=5 2024-09-14T10:57:37.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.911+0000 7fb5acd2a800 20 remove_watcher() i=6 2024-09-14T10:57:37.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:37.912+0000 7fb5acd2a800 20 remove_watcher() i=7 2024-09-14T10:57:37.924 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:37.924 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:37.927 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:37.927 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:37.930 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:37.930 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:37.981 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:37.982 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:57:38.014 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:38.014 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:38.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.056+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 20 realm 2024-09-14T10:57:38.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:38.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.058+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.059+0000 7fa12772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:38.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.059+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.059+0000 7fa12772c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:38.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.059+0000 7fa12772c800 20 searching for the correct realm 2024-09-14T10:57:38.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.063+0000 7fa123cae640 0 -- 172.21.15.2:0/1139182610 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x5592036d2ff0 msgr2=0x5592036d53e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:38.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.066+0000 7fa1234ad640 0 -- 172.21.15.2:0/1139182610 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa118079980 msgr2=0x7fa1180a5400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:38.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:38.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:38.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:38.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:38.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:38.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:38.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.070+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 zone default found 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 4 Realm: () 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 zonegroup default 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.071+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.072+0000 7fa12772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.072+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.072+0000 7fa12772c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.072+0000 7fa12772c800 20 started sync module instance, tier type = 2024-09-14T10:57:38.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.072+0000 7fa12772c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:38.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.085+0000 7fa12772c800 20 add_watcher() i=0 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.085+0000 7fa12772c800 20 add_watcher() i=1 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.085+0000 7fa12772c800 20 add_watcher() i=2 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.085+0000 7fa12772c800 20 add_watcher() i=3 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.085+0000 7fa12772c800 20 add_watcher() i=4 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.085+0000 7fa12772c800 20 add_watcher() i=5 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.085+0000 7fa12772c800 20 add_watcher() i=6 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.086+0000 7fa12772c800 20 add_watcher() i=7 2024-09-14T10:57:38.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.086+0000 7fa12772c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:38.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.087+0000 7f9fd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7fa12772c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7fa12772c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7fa12772c800 5 note: GC not initialized 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7f9fd8fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7fa12772c800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7fa12772c800 20 Filter name: none 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7f9f527fc640 20 reqs_thread_entry: start 2024-09-14T10:57:38.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.088+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.089+0000 7fa12772c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:38.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.089+0000 7fa12772c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.089+0000 7fa12772c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:38.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.089+0000 7fa12772c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:38.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.089+0000 7fa12772c800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:38.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.089+0000 7fa12772c800 20 INFO: main: starting shard=0 2024-09-14T10:57:38.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.089+0000 7fa12772c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:38.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.090+0000 7fa12772c800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:57:38.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.090+0000 7fa12772c800 20 INFO: main: done 2024-09-14T10:57:38.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.090+0000 7f9fd9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:38.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.093+0000 7fa12772c800 20 remove_watcher() i=0 2024-09-14T10:57:38.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.093+0000 7fa12772c800 2 removed watcher, disabling cache 2024-09-14T10:57:38.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.095+0000 7fa12772c800 20 remove_watcher() i=1 2024-09-14T10:57:38.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.096+0000 7fa12772c800 20 remove_watcher() i=2 2024-09-14T10:57:38.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.098+0000 7fa12772c800 20 remove_watcher() i=3 2024-09-14T10:57:38.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.099+0000 7fa12772c800 20 remove_watcher() i=4 2024-09-14T10:57:38.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.100+0000 7fa12772c800 20 remove_watcher() i=5 2024-09-14T10:57:38.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.101+0000 7fa12772c800 20 remove_watcher() i=6 2024-09-14T10:57:38.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.102+0000 7fa12772c800 20 remove_watcher() i=7 2024-09-14T10:57:38.113 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:38.113 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:38.117 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:38.117 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:38.167 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:38.168 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:57:38.200 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:38.201 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:38.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.242+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 20 realm 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.244+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.245+0000 7fe1fba10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:38.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.245+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.245+0000 7fe1fba10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:38.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.245+0000 7fe1fba10800 20 searching for the correct realm 2024-09-14T10:57:38.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.248+0000 7fe1f69bb640 0 -- 172.21.15.2:0/4249460729 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fe1e80741d0 msgr2=0x7fe1e8069a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:38.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.252+0000 7fe1f71bc640 0 -- 172.21.15.2:0/4249460729 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fe1ec0b8cb0 msgr2=0x7fe1ec091440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:38.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:38.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:38.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:38.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:38.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:38.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:38.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.459+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 zone default found 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 4 Realm: () 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:38.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 zonegroup default 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.460+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.461+0000 7fe1fba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.461+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.461+0000 7fe1fba10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.461+0000 7fe1fba10800 20 started sync module instance, tier type = 2024-09-14T10:57:38.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.461+0000 7fe1fba10800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.474+0000 7fe1fba10800 20 add_watcher() i=0 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.474+0000 7fe1fba10800 20 add_watcher() i=1 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.474+0000 7fe1fba10800 20 add_watcher() i=2 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.474+0000 7fe1fba10800 20 add_watcher() i=3 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.474+0000 7fe1fba10800 20 add_watcher() i=4 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.474+0000 7fe1fba10800 20 add_watcher() i=5 2024-09-14T10:57:38.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.474+0000 7fe1fba10800 20 add_watcher() i=6 2024-09-14T10:57:38.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.476+0000 7fe1fba10800 20 add_watcher() i=7 2024-09-14T10:57:38.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.476+0000 7fe1fba10800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:38.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.477+0000 7fe0adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe1fba10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe1fba10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe1fba10800 5 note: GC not initialized 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe0acfe1640 20 reqs_thread_entry: start 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe1fba10800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe1fba10800 20 Filter name: none 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe0267fc640 20 reqs_thread_entry: start 2024-09-14T10:57:38.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.478+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.479+0000 7fe1fba10800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:38.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.479+0000 7fe1fba10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:38.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.479+0000 7fe1fba10800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:38.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.479+0000 7fe1fba10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:38.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.479+0000 7fe1fba10800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:38.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.479+0000 7fe1fba10800 20 INFO: main: starting shard=0 2024-09-14T10:57:38.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.479+0000 7fe1fba10800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:38.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.480+0000 7fe1fba10800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:57:38.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.480+0000 7fe1fba10800 20 INFO: main: done 2024-09-14T10:57:38.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.480+0000 7fe0adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:38.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.685+0000 7fe1fba10800 20 remove_watcher() i=0 2024-09-14T10:57:38.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.685+0000 7fe1fba10800 2 removed watcher, disabling cache 2024-09-14T10:57:38.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.686+0000 7fe1fba10800 20 remove_watcher() i=1 2024-09-14T10:57:38.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.687+0000 7fe1fba10800 20 remove_watcher() i=2 2024-09-14T10:57:38.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.689+0000 7fe1fba10800 20 remove_watcher() i=3 2024-09-14T10:57:38.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.690+0000 7fe1fba10800 20 remove_watcher() i=4 2024-09-14T10:57:38.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.691+0000 7fe1fba10800 20 remove_watcher() i=5 2024-09-14T10:57:38.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.692+0000 7fe1fba10800 20 remove_watcher() i=6 2024-09-14T10:57:38.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:38.693+0000 7fe1fba10800 20 remove_watcher() i=7 2024-09-14T10:57:38.707 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:38.707 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:38.711 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:57:39.123 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:57:39.533 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-14T10:57:39.533 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:39.535 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:57:39.568 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:39.568 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:39.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.609+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 20 realm 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.611+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.612+0000 7fe7bb52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:39.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.612+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.613+0000 7fe7bb52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:39.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.613+0000 7fe7bb52c800 20 searching for the correct realm 2024-09-14T10:57:39.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.617+0000 7fe7b7a50640 0 -- 172.21.15.2:0/2527921165 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55c9cd7b3010 msgr2=0x55c9cd7b54d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:39.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.620+0000 7fe7b6a4e640 0 -- 172.21.15.2:0/2527921165 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fe7a807b070 msgr2=0x7fe7a80037c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:39.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:39.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:39.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:39.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:39.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:39.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:39.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:39.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:39.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 zone default found 2024-09-14T10:57:39.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 4 Realm: () 2024-09-14T10:57:39.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:39.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 zonegroup default 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.625+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.626+0000 7fe7bb52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.626+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.626+0000 7fe7bb52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.626+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.626+0000 7fe7bb52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.626+0000 7fe7bb52c800 20 started sync module instance, tier type = 2024-09-14T10:57:39.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.626+0000 7fe7bb52c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:39.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.638+0000 7fe7bb52c800 20 add_watcher() i=0 2024-09-14T10:57:39.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.638+0000 7fe7bb52c800 20 add_watcher() i=1 2024-09-14T10:57:39.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.638+0000 7fe7bb52c800 20 add_watcher() i=2 2024-09-14T10:57:39.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.638+0000 7fe7bb52c800 20 add_watcher() i=3 2024-09-14T10:57:39.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.638+0000 7fe7bb52c800 20 add_watcher() i=4 2024-09-14T10:57:39.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.638+0000 7fe7bb52c800 20 add_watcher() i=5 2024-09-14T10:57:39.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.638+0000 7fe7bb52c800 20 add_watcher() i=6 2024-09-14T10:57:39.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.639+0000 7fe7bb52c800 20 add_watcher() i=7 2024-09-14T10:57:39.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.639+0000 7fe7bb52c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:39.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe66dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe7bb52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe7bb52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe7bb52c800 5 note: GC not initialized 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe66cfe1640 20 reqs_thread_entry: start 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe7bb52c800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe7bb52c800 20 Filter name: none 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.641+0000 7fe5e67fc640 20 reqs_thread_entry: start 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:39.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:39.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:39.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:39.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.642+0000 7fe7bb52c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.644+0000 7fe7bb52c800 1 NOTICE: finished shard 0 (4 entries found) 2024-09-14T10:57:39.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.644+0000 7fe7bb52c800 1 NOTICE: finished all shards (4 entries found) 2024-09-14T10:57:39.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.645+0000 7fe66dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:39.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.648+0000 7fe7bb52c800 20 remove_watcher() i=0 2024-09-14T10:57:39.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.648+0000 7fe7bb52c800 2 removed watcher, disabling cache 2024-09-14T10:57:39.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.649+0000 7fe7bb52c800 20 remove_watcher() i=1 2024-09-14T10:57:39.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.650+0000 7fe7bb52c800 20 remove_watcher() i=2 2024-09-14T10:57:39.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.651+0000 7fe7bb52c800 20 remove_watcher() i=3 2024-09-14T10:57:39.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.652+0000 7fe7bb52c800 20 remove_watcher() i=4 2024-09-14T10:57:39.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.653+0000 7fe7bb52c800 20 remove_watcher() i=5 2024-09-14T10:57:39.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.654+0000 7fe7bb52c800 20 remove_watcher() i=6 2024-09-14T10:57:39.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.655+0000 7fe7bb52c800 20 remove_watcher() i=7 2024-09-14T10:57:39.663 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: unlinked entries are not listable 2024-09-14T10:57:39.664 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:39.666 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.666 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:39.671 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-14T10:57:39.671 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:39.673 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.673 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:39.718 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.719 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:39.761 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-14T10:57:39.761 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:39.762 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:57:39.799 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:39.799 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:39.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.840+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.841+0000 7f556032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.841+0000 7f556032e800 20 realm 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.841+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.842+0000 7f556032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.842+0000 7f556032e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.842+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.842+0000 7f556032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.842+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.843+0000 7f556032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:39.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.843+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.843+0000 7f556032e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:39.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.843+0000 7f556032e800 20 searching for the correct realm 2024-09-14T10:57:39.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.846+0000 7f555c8de640 0 -- 172.21.15.2:0/2275397020 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f555008a050 msgr2=0x7f5550070ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:39.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.850+0000 7f555c0dd640 0 -- 172.21.15.2:0/2275397020 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f555008a5e0 msgr2=0x7f555008aa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:39.852 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:39.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.855+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:39.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 zone default found 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 4 Realm: () 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 zonegroup default 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 started sync module instance, tier type = 2024-09-14T10:57:39.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.856+0000 7f556032e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:39.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.866+0000 7f556032e800 20 add_watcher() i=0 2024-09-14T10:57:39.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.866+0000 7f556032e800 20 add_watcher() i=1 2024-09-14T10:57:39.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.866+0000 7f556032e800 20 add_watcher() i=2 2024-09-14T10:57:39.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.866+0000 7f556032e800 20 add_watcher() i=3 2024-09-14T10:57:39.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.866+0000 7f556032e800 20 add_watcher() i=4 2024-09-14T10:57:39.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.866+0000 7f556032e800 20 add_watcher() i=5 2024-09-14T10:57:39.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.866+0000 7f556032e800 20 add_watcher() i=6 2024-09-14T10:57:39.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.867+0000 7f556032e800 20 add_watcher() i=7 2024-09-14T10:57:39.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.867+0000 7f556032e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:39.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.869+0000 7f5412fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:39.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.869+0000 7f556032e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:39.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.869+0000 7f556032e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:39.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.869+0000 7f556032e800 5 note: GC not initialized 2024-09-14T10:57:39.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f5411fdb640 20 reqs_thread_entry: start 2024-09-14T10:57:39.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:39.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 20 Filter name: none 2024-09-14T10:57:39.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f53837fe640 20 reqs_thread_entry: start 2024-09-14T10:57:39.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:39.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.870+0000 7f556032e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.871+0000 7f556032e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.871+0000 7f556032e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.871+0000 7f556032e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.871+0000 7f556032e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.871+0000 7f556032e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:39.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.871+0000 7f556032e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:39.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.871+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.872+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.872+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:c state=0x563881fc2408 s->prefetch_data=0 2024-09-14T10:57:39.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.873+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to uh3j5vmal8102oxghbdema8j9gwhzf7m 2024-09-14T10:57:39.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.873+0000 7f556032e800 20 get_obj_state_impl: setting s->olh_tag to 8zxwvmv2qz1azumz4f00kyx0xqn175md 2024-09-14T10:57:39.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.873+0000 7f556032e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8zxwvmv2qz1azumz4f00kyx0xqn175md 2024-09-14T10:57:39.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.874+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.875+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.876+0000 7f556032e800 20 olh_log_entry: epoch=3 op=3 key=c[rOZnW86wzB.TM6cvdHxE8VY-EANQRL6] 2024-09-14T10:57:39.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.876+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:rOZnW86wzB.TM6cvdHxE8VY-EANQRL6_c state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.876+0000 7f556032e800 10 manifest: total_size = 12 2024-09-14T10:57:39.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.876+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5015496349265620811 2024-09-14T10:57:39.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.876+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:rOZnW86wzB.TM6cvdHxE8VY-EANQRL6_c state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.876+0000 7f556032e800 20 prepare_atomic_modification: state is not atomic. state=0x563881ffdd48 2024-09-14T10:57:39.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.876+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.879+0000 7f556032e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:39.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.879+0000 7f556032e800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T10:57:39.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.879+0000 7f556032e800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:39.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.879+0000 7f556032e800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:rOZnW86wzB.TM6cvdHxE8VY-EANQRL6_.dJiyofUFTrK3dTYUmU_dCqalsoFI9IU_0 2024-09-14T10:57:39.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.880+0000 7f54337fe640 20 handle_completion(): completion ok for obj=c[rOZnW86wzB.TM6cvdHxE8VY-EANQRL6] 2024-09-14T10:57:39.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.880+0000 7f556032e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:39.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.882+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.882+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.883+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.883+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.883+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:d state=0x563881fc2408 s->prefetch_data=0 2024-09-14T10:57:39.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.884+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to 29z0dk68iwf4hj55h9bpjro897v5vu49 2024-09-14T10:57:39.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.884+0000 7f556032e800 20 get_obj_state_impl: setting s->olh_tag to byi5rg5s2xnpu92od1s5zrka2tfdts33 2024-09-14T10:57:39.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.884+0000 7f556032e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=byi5rg5s2xnpu92od1s5zrka2tfdts33 2024-09-14T10:57:39.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.888+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.889+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.889+0000 7f556032e800 20 olh_log_entry: epoch=3 op=3 key=d[ZAuoqaYrf77M72hJrtcR7BgG.iRPibY] 2024-09-14T10:57:39.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.889+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:ZAuoqaYrf77M72hJrtcR7BgG.iRPibY_d state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.890+0000 7f556032e800 10 manifest: total_size = 22 2024-09-14T10:57:39.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.890+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1701385471476920503 2024-09-14T10:57:39.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.890+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:ZAuoqaYrf77M72hJrtcR7BgG.iRPibY_d state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.890+0000 7f556032e800 20 prepare_atomic_modification: state is not atomic. state=0x563881ffdd48 2024-09-14T10:57:39.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.890+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.892+0000 7f556032e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:39.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.892+0000 7f556032e800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:57:39.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.892+0000 7f556032e800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:39.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.892+0000 7f556032e800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:ZAuoqaYrf77M72hJrtcR7BgG.iRPibY_.e6m7f179W17T407ocyCKVy63dS0_D8E_0 2024-09-14T10:57:39.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.893+0000 7f556032e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:39.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.894+0000 7f5432ffd640 20 handle_completion(): completion ok for obj=d[ZAuoqaYrf77M72hJrtcR7BgG.iRPibY] 2024-09-14T10:57:39.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.895+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.895+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.896+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.896+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.897+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:e state=0x563881fc2408 s->prefetch_data=0 2024-09-14T10:57:39.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.897+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to s8p5wlbbg5l4p217bkl9a1kads190274 2024-09-14T10:57:39.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.897+0000 7f556032e800 20 get_obj_state_impl: setting s->olh_tag to 8011v6htd7009q24oyxt9bdbsi6l4gmw 2024-09-14T10:57:39.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.897+0000 7f556032e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8011v6htd7009q24oyxt9bdbsi6l4gmw 2024-09-14T10:57:39.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.898+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.899+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:57:39.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 20 olh_log_entry: epoch=2 op=3 key=e[tK4Y1IyllagsyAxILzelJ63RxTDPahM] 2024-09-14T10:57:39.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:tK4Y1IyllagsyAxILzelJ63RxTDPahM_e state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 10 manifest: total_size = 12 2024-09-14T10:57:39.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12506214068938253298 2024-09-14T10:57:39.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:tK4Y1IyllagsyAxILzelJ63RxTDPahM_e state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 20 prepare_atomic_modification: state is not atomic. state=0x563881ffdd48 2024-09-14T10:57:39.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.900+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.902+0000 7f556032e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:39.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.902+0000 7f556032e800 20 RGWObjManifest::operator++(): result: ofs=12 stripe_ofs=12 part_ofs=0 rule->part_size=0 2024-09-14T10:57:39.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.902+0000 7f556032e800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:39.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.902+0000 7f556032e800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:tK4Y1IyllagsyAxILzelJ63RxTDPahM_.Cr5a2BkBeDyoOfZqk-_3asblS57KY0c_0 2024-09-14T10:57:39.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.903+0000 7f54337fe640 20 handle_completion(): completion ok for obj=e[tK4Y1IyllagsyAxILzelJ63RxTDPahM] 2024-09-14T10:57:39.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.904+0000 7f556032e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:39.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.905+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:e state=0x563881fc2408 s->prefetch_data=0 2024-09-14T10:57:39.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.905+0000 7f556032e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8011v6htd7009q24oyxt9bdbsi6l4gmw 2024-09-14T10:57:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.907+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.908+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.908+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.909+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:f state=0x563881fbd6b8 s->prefetch_data=0 2024-09-14T10:57:39.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.909+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to m0b83j5h229wpnxpdfr1mosccgkkkxf9 2024-09-14T10:57:39.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.909+0000 7f556032e800 20 get_obj_state_impl: setting s->olh_tag to g0tgwsxcg8clt4f7vj0xz7417da27iun 2024-09-14T10:57:39.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.909+0000 7f556032e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g0tgwsxcg8clt4f7vj0xz7417da27iun 2024-09-14T10:57:39.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.910+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.911+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:57:39.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 20 olh_log_entry: epoch=2 op=3 key=f[vjVGcmPTgideb3FZ02yWK5XW3yxhlnf] 2024-09-14T10:57:39.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:vjVGcmPTgideb3FZ02yWK5XW3yxhlnf_f state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 10 manifest: total_size = 11 2024-09-14T10:57:39.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4508368977052121655 2024-09-14T10:57:39.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:_:vjVGcmPTgideb3FZ02yWK5XW3yxhlnf_f state=0x563881ffdd48 s->prefetch_data=0 2024-09-14T10:57:39.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 20 prepare_atomic_modification: state is not atomic. state=0x563881ffdd48 2024-09-14T10:57:39.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.912+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.915+0000 7f556032e800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:39.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.915+0000 7f556032e800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T10:57:39.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.915+0000 7f556032e800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:39.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.915+0000 7f556032e800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:vjVGcmPTgideb3FZ02yWK5XW3yxhlnf_.aTuabVqWqdr8KW5J8H8yDzk11_S9I6r_0 2024-09-14T10:57:39.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.916+0000 7f54337fe640 20 handle_completion(): completion ok for obj=f[vjVGcmPTgideb3FZ02yWK5XW3yxhlnf] 2024-09-14T10:57:39.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.916+0000 7f556032e800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:39.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.920+0000 7f556032e800 20 get_obj_state: octx=0x563881d108a0 obj=check-bucket:f state=0x563881fbd6b8 s->prefetch_data=0 2024-09-14T10:57:39.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.920+0000 7f556032e800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=g0tgwsxcg8clt4f7vj0xz7417da27iun 2024-09-14T10:57:39.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.924+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.925+0000 7f556032e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:39.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.925+0000 7f556032e800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-14T10:57:39.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.925+0000 7f556032e800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:57:39.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.927+0000 7f5412fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:39.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.929+0000 7f556032e800 20 remove_watcher() i=0 2024-09-14T10:57:39.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.929+0000 7f556032e800 2 removed watcher, disabling cache 2024-09-14T10:57:39.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.930+0000 7f556032e800 20 remove_watcher() i=1 2024-09-14T10:57:39.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.931+0000 7f556032e800 20 remove_watcher() i=2 2024-09-14T10:57:39.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.932+0000 7f556032e800 20 remove_watcher() i=3 2024-09-14T10:57:39.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.933+0000 7f556032e800 20 remove_watcher() i=4 2024-09-14T10:57:39.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.934+0000 7f556032e800 20 remove_watcher() i=5 2024-09-14T10:57:39.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.935+0000 7f556032e800 20 remove_watcher() i=6 2024-09-14T10:57:39.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:39.936+0000 7f556032e800 20 remove_watcher() i=7 2024-09-14T10:57:39.948 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.948 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:39.951 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.951 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:39.953 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.953 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:39.956 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.956 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:39.957 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-14T10:57:39.957 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:39.958 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:39.958 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:40.003 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:40.003 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:40.006 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:40.006 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:40.009 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:40.009 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:40.011 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:40.012 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:40.013 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-14T10:57:40.013 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:40.015 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-14T10:57:40.049 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:40.049 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:40.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.091+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.092+0000 7f387c725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.092+0000 7f387c725800 20 realm 2024-09-14T10:57:40.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.092+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.093+0000 7f387c725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.093+0000 7f387c725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:40.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.093+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.093+0000 7f387c725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.093+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.094+0000 7f387c725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:40.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.094+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.094+0000 7f387c725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:40.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.094+0000 7f387c725800 20 searching for the correct realm 2024-09-14T10:57:40.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.097+0000 7f3877bad640 0 -- 172.21.15.2:0/65588697 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f386809a040 msgr2=0x7f386801cb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:40.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.100+0000 7f38783ae640 0 -- 172.21.15.2:0/65588697 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f386c0b5b70 msgr2=0x7f386c0e27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:40.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:40.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:40.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:40.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:40.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:40.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:40.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:40.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:40.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 zone default found 2024-09-14T10:57:40.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 4 Realm: () 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 zonegroup default 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.307+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.308+0000 7f387c725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.308+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.308+0000 7f387c725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.308+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.308+0000 7f387c725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.308+0000 7f387c725800 20 started sync module instance, tier type = 2024-09-14T10:57:40.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.308+0000 7f387c725800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:40.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.318+0000 7f387c725800 20 add_watcher() i=0 2024-09-14T10:57:40.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.318+0000 7f387c725800 20 add_watcher() i=1 2024-09-14T10:57:40.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.318+0000 7f387c725800 20 add_watcher() i=2 2024-09-14T10:57:40.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.318+0000 7f387c725800 20 add_watcher() i=3 2024-09-14T10:57:40.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.318+0000 7f387c725800 20 add_watcher() i=4 2024-09-14T10:57:40.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.318+0000 7f387c725800 20 add_watcher() i=5 2024-09-14T10:57:40.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.318+0000 7f387c725800 20 add_watcher() i=6 2024-09-14T10:57:40.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.319+0000 7f387c725800 20 add_watcher() i=7 2024-09-14T10:57:40.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.319+0000 7f387c725800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:40.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.321+0000 7f372efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:40.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.321+0000 7f387c725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:40.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.321+0000 7f387c725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:40.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.321+0000 7f387c725800 5 note: GC not initialized 2024-09-14T10:57:40.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.321+0000 7f372dfdb640 20 reqs_thread_entry: start 2024-09-14T10:57:40.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:40.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 20 Filter name: none 2024-09-14T10:57:40.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f369f7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:40.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.322+0000 7f387c725800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:40.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:40.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:57:40.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.323+0000 7f387c725800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:57:40.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.324+0000 7f372efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:40.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.326+0000 7f387c725800 20 remove_watcher() i=0 2024-09-14T10:57:40.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.326+0000 7f387c725800 2 removed watcher, disabling cache 2024-09-14T10:57:40.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.327+0000 7f387c725800 20 remove_watcher() i=1 2024-09-14T10:57:40.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.328+0000 7f387c725800 20 remove_watcher() i=2 2024-09-14T10:57:40.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.330+0000 7f387c725800 20 remove_watcher() i=3 2024-09-14T10:57:40.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.331+0000 7f387c725800 20 remove_watcher() i=4 2024-09-14T10:57:40.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.332+0000 7f387c725800 20 remove_watcher() i=5 2024-09-14T10:57:40.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.333+0000 7f387c725800 20 remove_watcher() i=6 2024-09-14T10:57:40.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.334+0000 7f387c725800 20 remove_watcher() i=7 2024-09-14T10:57:40.347 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:40.347 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:40.361 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:40.361 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:40.376 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:57:40.407 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:40.407 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:40.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.448+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 20 realm 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.451+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.452+0000 7f4bbd12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:40.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.452+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.452+0000 7f4bbd12f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:40.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.452+0000 7f4bbd12f800 20 searching for the correct realm 2024-09-14T10:57:40.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.455+0000 7f4bb9677640 0 -- 172.21.15.2:0/855908217 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f4bac062400 msgr2=0x7f4bac060e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:40.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.458+0000 7f4bb8e76640 0 -- 172.21.15.2:0/855908217 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f4bac061400 msgr2=0x7f4bac06afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:40.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.664+0000 7f4bbd12f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.664+0000 7f4bbd12f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.664+0000 7f4bbd12f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.664+0000 7f4bbd12f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.664+0000 7f4bbd12f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.664+0000 7f4bbd12f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.664+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:40.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 zone default found 2024-09-14T10:57:40.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 4 Realm: () 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 zonegroup default 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.665+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.666+0000 7f4bbd12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.666+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.666+0000 7f4bbd12f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.666+0000 7f4bbd12f800 20 started sync module instance, tier type = 2024-09-14T10:57:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.666+0000 7f4bbd12f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:40.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.677+0000 7f4bbd12f800 20 add_watcher() i=0 2024-09-14T10:57:40.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.677+0000 7f4bbd12f800 20 add_watcher() i=1 2024-09-14T10:57:40.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.677+0000 7f4bbd12f800 20 add_watcher() i=2 2024-09-14T10:57:40.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.677+0000 7f4bbd12f800 20 add_watcher() i=3 2024-09-14T10:57:40.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.677+0000 7f4bbd12f800 20 add_watcher() i=4 2024-09-14T10:57:40.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.677+0000 7f4bbd12f800 20 add_watcher() i=5 2024-09-14T10:57:40.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.677+0000 7f4bbd12f800 20 add_watcher() i=6 2024-09-14T10:57:40.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.678+0000 7f4bbd12f800 20 add_watcher() i=7 2024-09-14T10:57:40.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.678+0000 7f4bbd12f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:40.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.680+0000 7f4a6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:40.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.680+0000 7f4bbd12f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:40.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.680+0000 7f4bbd12f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.680+0000 7f4bbd12f800 5 note: GC not initialized 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.680+0000 7f4a6dfe3640 20 reqs_thread_entry: start 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.680+0000 7f4bbd12f800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.680+0000 7f4bbd12f800 20 Filter name: none 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f49df7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:40.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:40.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:40.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:40.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 INFO: main: starting shard=0 2024-09-14T10:57:40.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.681+0000 7f4bbd12f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:40.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.682+0000 7f4bbd12f800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:57:40.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.682+0000 7f4bbd12f800 20 INFO: main: done 2024-09-14T10:57:40.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.683+0000 7f4a6efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:40.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.685+0000 7f4bbd12f800 20 remove_watcher() i=0 2024-09-14T10:57:40.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.685+0000 7f4bbd12f800 2 removed watcher, disabling cache 2024-09-14T10:57:40.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.686+0000 7f4bbd12f800 20 remove_watcher() i=1 2024-09-14T10:57:40.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.687+0000 7f4bbd12f800 20 remove_watcher() i=2 2024-09-14T10:57:40.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.689+0000 7f4bbd12f800 20 remove_watcher() i=3 2024-09-14T10:57:40.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.690+0000 7f4bbd12f800 20 remove_watcher() i=4 2024-09-14T10:57:40.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.691+0000 7f4bbd12f800 20 remove_watcher() i=5 2024-09-14T10:57:40.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.692+0000 7f4bbd12f800 20 remove_watcher() i=6 2024-09-14T10:57:40.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.693+0000 7f4bbd12f800 20 remove_watcher() i=7 2024-09-14T10:57:40.704 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:57:40.735 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:40.735 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:40.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.776+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 20 realm 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.778+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.779+0000 7f99c4f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:40.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.779+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.780+0000 7f99c4f3e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:40.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.780+0000 7f99c4f3e800 20 searching for the correct realm 2024-09-14T10:57:40.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.783+0000 7f99c14c1640 0 -- 172.21.15.2:0/500908802 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f99b400b040 msgr2=0x7f99b4068250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:40.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.786+0000 7f99c0cc0640 0 -- 172.21.15.2:0/500908802 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f99b40701c0 msgr2=0x7f99b40309d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:40.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.992+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 zone default found 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 4 Realm: () 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 zonegroup default 2024-09-14T10:57:40.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.993+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:40.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.994+0000 7f99c4f3e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:40.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.994+0000 7f99c4f3e800 20 started sync module instance, tier type = 2024-09-14T10:57:40.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:40.994+0000 7f99c4f3e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.004+0000 7f99c4f3e800 20 add_watcher() i=0 2024-09-14T10:57:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.004+0000 7f99c4f3e800 20 add_watcher() i=1 2024-09-14T10:57:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.004+0000 7f99c4f3e800 20 add_watcher() i=2 2024-09-14T10:57:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.004+0000 7f99c4f3e800 20 add_watcher() i=3 2024-09-14T10:57:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.004+0000 7f99c4f3e800 20 add_watcher() i=4 2024-09-14T10:57:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.004+0000 7f99c4f3e800 20 add_watcher() i=5 2024-09-14T10:57:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.004+0000 7f99c4f3e800 20 add_watcher() i=6 2024-09-14T10:57:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.005+0000 7f99c4f3e800 20 add_watcher() i=7 2024-09-14T10:57:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.005+0000 7f99c4f3e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.007+0000 7f9876fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f99c4f3e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f99c4f3e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f99c4f3e800 5 note: GC not initialized 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f9875fe3640 20 reqs_thread_entry: start 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f99c4f3e800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f99c4f3e800 20 Filter name: none 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f97e77fe640 20 reqs_thread_entry: start 2024-09-14T10:57:41.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.008+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.009+0000 7f99c4f3e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:41.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.009+0000 7f99c4f3e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.009+0000 7f99c4f3e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:41.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.009+0000 7f99c4f3e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:41.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.009+0000 7f99c4f3e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:41.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.009+0000 7f99c4f3e800 20 INFO: main: starting shard=0 2024-09-14T10:57:41.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.009+0000 7f99c4f3e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:41.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.010+0000 7f99c4f3e800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-14T10:57:41.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.010+0000 7f99c4f3e800 20 INFO: main: done 2024-09-14T10:57:41.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.011+0000 7f9876fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.013+0000 7f99c4f3e800 20 remove_watcher() i=0 2024-09-14T10:57:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.013+0000 7f99c4f3e800 2 removed watcher, disabling cache 2024-09-14T10:57:41.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.014+0000 7f99c4f3e800 20 remove_watcher() i=1 2024-09-14T10:57:41.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.015+0000 7f99c4f3e800 20 remove_watcher() i=2 2024-09-14T10:57:41.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.016+0000 7f99c4f3e800 20 remove_watcher() i=3 2024-09-14T10:57:41.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.017+0000 7f99c4f3e800 20 remove_watcher() i=4 2024-09-14T10:57:41.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.019+0000 7f99c4f3e800 20 remove_watcher() i=5 2024-09-14T10:57:41.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.020+0000 7f99c4f3e800 20 remove_watcher() i=6 2024-09-14T10:57:41.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.021+0000 7f99c4f3e800 20 remove_watcher() i=7 2024-09-14T10:57:41.029 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-14T10:57:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:57:41.063 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:41.063 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:41.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.308+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:41.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 20 realm 2024-09-14T10:57:41.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:41.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:41.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:41.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.310+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.311+0000 7f5631faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:41.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.311+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.311+0000 7f5631faf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:41.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.311+0000 7f5631faf800 20 searching for the correct realm 2024-09-14T10:57:41.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.314+0000 7f562f298640 0 -- 172.21.15.2:0/3967224898 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f56200d9070 msgr2=0x7f562006b050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:41.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.519+0000 7f562fa99640 0 -- 172.21.15.2:0/3967224898 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f5624071650 msgr2=0x7f5624082190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:41.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:41.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.726+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 zone default found 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 4 Realm: () 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 zonegroup default 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:41.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.727+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.728+0000 7f5631faf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:41.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.728+0000 7f5631faf800 20 started sync module instance, tier type = 2024-09-14T10:57:41.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.728+0000 7f5631faf800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:41.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.738+0000 7f5631faf800 20 add_watcher() i=0 2024-09-14T10:57:41.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.738+0000 7f5631faf800 20 add_watcher() i=1 2024-09-14T10:57:41.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.738+0000 7f5631faf800 20 add_watcher() i=2 2024-09-14T10:57:41.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.738+0000 7f5631faf800 20 add_watcher() i=3 2024-09-14T10:57:41.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.738+0000 7f5631faf800 20 add_watcher() i=4 2024-09-14T10:57:41.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.738+0000 7f5631faf800 20 add_watcher() i=5 2024-09-14T10:57:41.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.738+0000 7f5631faf800 20 add_watcher() i=6 2024-09-14T10:57:41.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.739+0000 7f5631faf800 20 add_watcher() i=7 2024-09-14T10:57:41.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.739+0000 7f5631faf800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:41.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.741+0000 7f54e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:41.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f5631faf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:41.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f5631faf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:41.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f5631faf800 5 note: GC not initialized 2024-09-14T10:57:41.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f54e4fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:41.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f5631faf800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:41.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f5631faf800 20 Filter name: none 2024-09-14T10:57:41.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f545e7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:41.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f5631faf800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:41.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.742+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 20 rados->read ofs=0 len=0 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:41.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:41.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:41.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.743+0000 7f5631faf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:41.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.744+0000 7f5631faf800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:41.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.744+0000 7f5631faf800 1 NOTICE: finished shard 0 (2 entries found) 2024-09-14T10:57:41.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.744+0000 7f5631faf800 1 NOTICE: finished all shards (2 entries found) 2024-09-14T10:57:41.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.745+0000 7f54e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:41.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.747+0000 7f5631faf800 20 remove_watcher() i=0 2024-09-14T10:57:41.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.747+0000 7f5631faf800 2 removed watcher, disabling cache 2024-09-14T10:57:41.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.749+0000 7f5631faf800 20 remove_watcher() i=1 2024-09-14T10:57:41.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.750+0000 7f5631faf800 20 remove_watcher() i=2 2024-09-14T10:57:41.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.751+0000 7f5631faf800 20 remove_watcher() i=3 2024-09-14T10:57:41.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.752+0000 7f5631faf800 20 remove_watcher() i=4 2024-09-14T10:57:41.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.754+0000 7f5631faf800 20 remove_watcher() i=5 2024-09-14T10:57:41.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.755+0000 7f5631faf800 20 remove_watcher() i=6 2024-09-14T10:57:41.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.756+0000 7f5631faf800 20 remove_watcher() i=7 2024-09-14T10:57:41.765 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-14T10:57:41.766 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:41.767 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:57:41.802 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:41.802 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:41.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:41.844+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.046+0000 7f602a6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.046+0000 7f602a6bb800 20 realm 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.046+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.046+0000 7f602a6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.046+0000 7f602a6bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.046+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.047+0000 7f602a6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.047+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.048+0000 7f602a6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:42.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.048+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.048+0000 7f602a6bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:42.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.048+0000 7f602a6bb800 20 searching for the correct realm 2024-09-14T10:57:42.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.051+0000 7f60279a4640 0 -- 172.21.15.2:0/206500450 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f6018017070 msgr2=0x7f6018075430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:42.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.258+0000 7f60281a5640 0 -- 172.21.15.2:0/206500450 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f601c0798c0 msgr2=0x7f601c06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:42.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:42.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:42.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:42.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:42.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:42.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:42.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.465+0000 7f602a6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.466+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.466+0000 7f602a6bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.466+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 zone default found 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 4 Realm: () 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 zonegroup default 2024-09-14T10:57:42.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.467+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.468+0000 7f602a6bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.468+0000 7f602a6bb800 20 started sync module instance, tier type = 2024-09-14T10:57:42.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.468+0000 7f602a6bb800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:42.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.479+0000 7f602a6bb800 20 add_watcher() i=0 2024-09-14T10:57:42.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.479+0000 7f602a6bb800 20 add_watcher() i=1 2024-09-14T10:57:42.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.479+0000 7f602a6bb800 20 add_watcher() i=2 2024-09-14T10:57:42.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.479+0000 7f602a6bb800 20 add_watcher() i=3 2024-09-14T10:57:42.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.479+0000 7f602a6bb800 20 add_watcher() i=4 2024-09-14T10:57:42.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.479+0000 7f602a6bb800 20 add_watcher() i=5 2024-09-14T10:57:42.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.479+0000 7f602a6bb800 20 add_watcher() i=6 2024-09-14T10:57:42.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.480+0000 7f602a6bb800 20 add_watcher() i=7 2024-09-14T10:57:42.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.480+0000 7f602a6bb800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:42.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.482+0000 7f5edefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:42.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f602a6bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:42.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f602a6bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:42.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f602a6bb800 5 note: GC not initialized 2024-09-14T10:57:42.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f5eddfdb640 20 reqs_thread_entry: start 2024-09-14T10:57:42.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f602a6bb800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:42.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f602a6bb800 20 Filter name: none 2024-09-14T10:57:42.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f5e4f7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:42.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f602a6bb800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:42.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.483+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:42.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:42.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:42.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:42.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:42.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:42.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:42.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:42.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:42.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:42.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.484+0000 7f602a6bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:42.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.485+0000 7f602a6bb800 20 get_obj_state: octx=0x561a34959880 obj=check-bucket:c state=0x561a34c11518 s->prefetch_data=0 2024-09-14T10:57:42.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.486+0000 7f602a6bb800 20 get_obj_state: setting s->obj_tag to uh3j5vmal8102oxghbdema8j9gwhzf7m 2024-09-14T10:57:42.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.486+0000 7f602a6bb800 20 get_obj_state_impl: setting s->olh_tag to 8zxwvmv2qz1azumz4f00kyx0xqn175md 2024-09-14T10:57:42.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.486+0000 7f602a6bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:42.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.486+0000 7f602a6bb800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-14T10:57:42.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.486+0000 7f602a6bb800 20 olh_log_entry: epoch=4 op=3 key=c[5jST.hW7UNS8wIvyQ63oSlUzkObPJoI] 2024-09-14T10:57:42.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.486+0000 7f602a6bb800 20 get_obj_state: octx=0x561a34c45fb0 obj=check-bucket:_:5jST.hW7UNS8wIvyQ63oSlUzkObPJoI_c state=0x561a34c0b2b8 s->prefetch_data=0 2024-09-14T10:57:42.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.488+0000 7f602a6bb800 20 get_obj_state: octx=0x561a34c45fb0 obj=check-bucket:c state=0x561a34c07278 s->prefetch_data=0 2024-09-14T10:57:42.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.489+0000 7f602a6bb800 20 get_obj_state: setting s->obj_tag to uh3j5vmal8102oxghbdema8j9gwhzf7m 2024-09-14T10:57:42.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.489+0000 7f602a6bb800 20 get_obj_state_impl: setting s->olh_tag to 8zxwvmv2qz1azumz4f00kyx0xqn175md 2024-09-14T10:57:42.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.489+0000 7f602a6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=8zxwvmv2qz1azumz4f00kyx0xqn175md 2024-09-14T10:57:42.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.491+0000 7f602a6bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:42.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.493+0000 7f602a6bb800 20 get_obj_state: octx=0x561a34959880 obj=check-bucket:d state=0x561a34c11518 s->prefetch_data=0 2024-09-14T10:57:42.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.494+0000 7f602a6bb800 20 get_obj_state: setting s->obj_tag to 29z0dk68iwf4hj55h9bpjro897v5vu49 2024-09-14T10:57:42.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.494+0000 7f602a6bb800 20 get_obj_state_impl: setting s->olh_tag to byi5rg5s2xnpu92od1s5zrka2tfdts33 2024-09-14T10:57:42.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.494+0000 7f602a6bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:42.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.494+0000 7f602a6bb800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-14T10:57:42.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.494+0000 7f602a6bb800 20 olh_log_entry: epoch=4 op=3 key=d[1HRTS2jgr4N1pCa4Y0mI6UPIbJNliV.] 2024-09-14T10:57:42.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.494+0000 7f602a6bb800 20 get_obj_state: octx=0x561a34c45fb0 obj=check-bucket:_:1HRTS2jgr4N1pCa4Y0mI6UPIbJNliV._d state=0x561a34c4a688 s->prefetch_data=0 2024-09-14T10:57:42.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.496+0000 7f602a6bb800 20 get_obj_state: octx=0x561a34c45fb0 obj=check-bucket:d state=0x561a34c0d438 s->prefetch_data=0 2024-09-14T10:57:42.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.496+0000 7f602a6bb800 20 get_obj_state: setting s->obj_tag to 29z0dk68iwf4hj55h9bpjro897v5vu49 2024-09-14T10:57:42.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.496+0000 7f602a6bb800 20 get_obj_state_impl: setting s->olh_tag to byi5rg5s2xnpu92od1s5zrka2tfdts33 2024-09-14T10:57:42.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.496+0000 7f602a6bb800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=byi5rg5s2xnpu92od1s5zrka2tfdts33 2024-09-14T10:57:42.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.499+0000 7f602a6bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:42.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.500+0000 7f602a6bb800 1 NOTICE: finished shard 0 (2 entries removed) 2024-09-14T10:57:42.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.500+0000 7f602a6bb800 1 NOTICE: finished all shards (2 entries removed) 2024-09-14T10:57:42.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.501+0000 7f5edefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:42.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.504+0000 7f602a6bb800 20 remove_watcher() i=0 2024-09-14T10:57:42.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.504+0000 7f602a6bb800 2 removed watcher, disabling cache 2024-09-14T10:57:42.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.505+0000 7f602a6bb800 20 remove_watcher() i=1 2024-09-14T10:57:42.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.507+0000 7f602a6bb800 20 remove_watcher() i=2 2024-09-14T10:57:42.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.508+0000 7f602a6bb800 20 remove_watcher() i=3 2024-09-14T10:57:42.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.510+0000 7f602a6bb800 20 remove_watcher() i=4 2024-09-14T10:57:42.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.511+0000 7f602a6bb800 20 remove_watcher() i=5 2024-09-14T10:57:42.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.512+0000 7f602a6bb800 20 remove_watcher() i=6 2024-09-14T10:57:42.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.513+0000 7f602a6bb800 20 remove_watcher() i=7 2024-09-14T10:57:42.526 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:57:42.558 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:42.558 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:42.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.601+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 20 realm 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.603+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.604+0000 7f8f5ac13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:42.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.604+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.604+0000 7f8f5ac13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:42.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.604+0000 7f8f5ac13800 20 searching for the correct realm 2024-09-14T10:57:42.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.608+0000 7f8f56b49640 0 -- 172.21.15.2:0/91921524 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f8f4c081040 msgr2=0x7f8f4c074410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:42.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.611+0000 7f8f56348640 0 -- 172.21.15.2:0/91921524 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f8f4c08f960 msgr2=0x7f8f4c08e3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:42.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:42.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:42.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:42.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:42.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:42.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:42.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.817+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 20 zone default found 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 4 Realm: () 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:42.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 20 zonegroup default 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.818+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.819+0000 7f8f5ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.819+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.819+0000 7f8f5ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.819+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.819+0000 7f8f5ac13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.819+0000 7f8f5ac13800 20 started sync module instance, tier type = 2024-09-14T10:57:42.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.819+0000 7f8f5ac13800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:42.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.830+0000 7f8f5ac13800 20 add_watcher() i=0 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.830+0000 7f8f5ac13800 20 add_watcher() i=1 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.830+0000 7f8f5ac13800 20 add_watcher() i=2 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.830+0000 7f8f5ac13800 20 add_watcher() i=3 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.830+0000 7f8f5ac13800 20 add_watcher() i=4 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.830+0000 7f8f5ac13800 20 add_watcher() i=5 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.830+0000 7f8f5ac13800 20 add_watcher() i=6 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.831+0000 7f8f5ac13800 20 add_watcher() i=7 2024-09-14T10:57:42.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.831+0000 7f8f5ac13800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:42.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.833+0000 7f8e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:42.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.833+0000 7f8f5ac13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:42.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.833+0000 7f8f5ac13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:42.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.833+0000 7f8f5ac13800 5 note: GC not initialized 2024-09-14T10:57:42.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.833+0000 7f8d877fe640 20 reqs_thread_entry: start 2024-09-14T10:57:42.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.833+0000 7f8f5ac13800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:42.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.834+0000 7f8f5ac13800 20 Filter name: none 2024-09-14T10:57:42.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.834+0000 7f8d857fa640 20 reqs_thread_entry: start 2024-09-14T10:57:42.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.834+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.834+0000 7f8f5ac13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:42.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.834+0000 7f8f5ac13800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.835+0000 7f8f5ac13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.835+0000 7f8f5ac13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.835+0000 7f8f5ac13800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.835+0000 7f8f5ac13800 20 INFO: main: starting shard=0 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.835+0000 7f8f5ac13800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.835+0000 7f8f5ac13800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.835+0000 7f8f5ac13800 20 INFO: main: done 2024-09-14T10:57:42.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.836+0000 7f8e0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:42.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.838+0000 7f8f5ac13800 20 remove_watcher() i=0 2024-09-14T10:57:42.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.838+0000 7f8f5ac13800 2 removed watcher, disabling cache 2024-09-14T10:57:42.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.840+0000 7f8f5ac13800 20 remove_watcher() i=1 2024-09-14T10:57:42.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.841+0000 7f8f5ac13800 20 remove_watcher() i=2 2024-09-14T10:57:42.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.842+0000 7f8f5ac13800 20 remove_watcher() i=3 2024-09-14T10:57:42.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.843+0000 7f8f5ac13800 20 remove_watcher() i=4 2024-09-14T10:57:42.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.844+0000 7f8f5ac13800 20 remove_watcher() i=5 2024-09-14T10:57:42.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.846+0000 7f8f5ac13800 20 remove_watcher() i=6 2024-09-14T10:57:42.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.847+0000 7f8f5ac13800 20 remove_watcher() i=7 2024-09-14T10:57:42.857 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:57:42.890 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:42.890 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:42.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.932+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 20 realm 2024-09-14T10:57:42.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:42.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:42.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.934+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.935+0000 7f2a8f340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:42.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.935+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:42.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.935+0000 7f2a8f340800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:42.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.935+0000 7f2a8f340800 20 searching for the correct realm 2024-09-14T10:57:42.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.938+0000 7f2a8b8ee640 0 -- 172.21.15.2:0/3552120053 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f2a74025040 msgr2=0x7f2a74044570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:42.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:42.942+0000 7f2a8b0ed640 0 -- 172.21.15.2:0/3552120053 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2a740a2be0 msgr2=0x7f2a74044570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.149+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 zone default found 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 4 Realm: () 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 zonegroup default 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.150+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.151+0000 7f2a8f340800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.151+0000 7f2a8f340800 20 started sync module instance, tier type = 2024-09-14T10:57:43.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.151+0000 7f2a8f340800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:43.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.163+0000 7f2a8f340800 20 add_watcher() i=0 2024-09-14T10:57:43.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.163+0000 7f2a8f340800 20 add_watcher() i=1 2024-09-14T10:57:43.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.163+0000 7f2a8f340800 20 add_watcher() i=2 2024-09-14T10:57:43.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.163+0000 7f2a8f340800 20 add_watcher() i=3 2024-09-14T10:57:43.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.163+0000 7f2a8f340800 20 add_watcher() i=4 2024-09-14T10:57:43.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.163+0000 7f2a8f340800 20 add_watcher() i=5 2024-09-14T10:57:43.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.163+0000 7f2a8f340800 20 add_watcher() i=6 2024-09-14T10:57:43.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.164+0000 7f2a8f340800 20 add_watcher() i=7 2024-09-14T10:57:43.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.164+0000 7f2a8f340800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.165+0000 7f2941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f2a8f340800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f2a8f340800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f2a8f340800 5 note: GC not initialized 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f2940fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f2a8f340800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f2a8f340800 20 Filter name: none 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f28ba7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.166+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.167+0000 7f2a8f340800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:43.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.167+0000 7f2a8f340800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.167+0000 7f2a8f340800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:43.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.167+0000 7f2a8f340800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:43.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.167+0000 7f2a8f340800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:43.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.167+0000 7f2a8f340800 20 INFO: main: starting shard=0 2024-09-14T10:57:43.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.167+0000 7f2a8f340800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:43.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.168+0000 7f2a8f340800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T10:57:43.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.168+0000 7f2a8f340800 20 INFO: main: done 2024-09-14T10:57:43.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.168+0000 7f2941fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:43.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.171+0000 7f2a8f340800 20 remove_watcher() i=0 2024-09-14T10:57:43.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.171+0000 7f2a8f340800 2 removed watcher, disabling cache 2024-09-14T10:57:43.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.172+0000 7f2a8f340800 20 remove_watcher() i=1 2024-09-14T10:57:43.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.174+0000 7f2a8f340800 20 remove_watcher() i=2 2024-09-14T10:57:43.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.175+0000 7f2a8f340800 20 remove_watcher() i=3 2024-09-14T10:57:43.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.177+0000 7f2a8f340800 20 remove_watcher() i=4 2024-09-14T10:57:43.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.178+0000 7f2a8f340800 20 remove_watcher() i=5 2024-09-14T10:57:43.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.179+0000 7f2a8f340800 20 remove_watcher() i=6 2024-09-14T10:57:43.177 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.180+0000 7f2a8f340800 20 remove_watcher() i=7 2024-09-14T10:57:43.189 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-14T10:57:43.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:43.190 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-14T10:57:43.222 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:43.222 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:43.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.266+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 20 realm 2024-09-14T10:57:43.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:43.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.268+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.269+0000 7fd05561d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:43.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.269+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.270+0000 7fd05561d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:43.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.270+0000 7fd05561d800 20 searching for the correct realm 2024-09-14T10:57:43.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.273+0000 7fd0505ea640 0 -- 172.21.15.2:0/3927569706 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fd04001d040 msgr2=0x7fd04001c410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:43.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.276+0000 7fd050deb640 0 -- 172.21.15.2:0/3927569706 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd0440b4e10 msgr2=0x7fd0440c1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.483+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 zone default found 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 4 Realm: () 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 zonegroup default 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.484+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.485+0000 7fd05561d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:43.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.485+0000 7fd05561d800 20 started sync module instance, tier type = 2024-09-14T10:57:43.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.485+0000 7fd05561d800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:43.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.497+0000 7fd05561d800 20 add_watcher() i=0 2024-09-14T10:57:43.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.497+0000 7fd05561d800 20 add_watcher() i=1 2024-09-14T10:57:43.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.497+0000 7fd05561d800 20 add_watcher() i=2 2024-09-14T10:57:43.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.497+0000 7fd05561d800 20 add_watcher() i=3 2024-09-14T10:57:43.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.497+0000 7fd05561d800 20 add_watcher() i=4 2024-09-14T10:57:43.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.497+0000 7fd05561d800 20 add_watcher() i=5 2024-09-14T10:57:43.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.497+0000 7fd05561d800 20 add_watcher() i=6 2024-09-14T10:57:43.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.498+0000 7fd05561d800 20 add_watcher() i=7 2024-09-14T10:57:43.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.498+0000 7fd05561d800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:43.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.499+0000 7fcf077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fd05561d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fd05561d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fd05561d800 5 note: GC not initialized 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fcf067e4640 20 reqs_thread_entry: start 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fd05561d800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fd05561d800 20 Filter name: none 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fceff7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fd05561d800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:43.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.500+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 20 rados->read ofs=0 len=0 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.501+0000 7fd05561d800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.502+0000 7fd05561d800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T10:57:43.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.502+0000 7fd05561d800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T10:57:43.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.503+0000 7fcf077e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:43.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.505+0000 7fd05561d800 20 remove_watcher() i=0 2024-09-14T10:57:43.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.505+0000 7fd05561d800 2 removed watcher, disabling cache 2024-09-14T10:57:43.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.507+0000 7fd05561d800 20 remove_watcher() i=1 2024-09-14T10:57:43.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.508+0000 7fd05561d800 20 remove_watcher() i=2 2024-09-14T10:57:43.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.509+0000 7fd05561d800 20 remove_watcher() i=3 2024-09-14T10:57:43.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.510+0000 7fd05561d800 20 remove_watcher() i=4 2024-09-14T10:57:43.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.512+0000 7fd05561d800 20 remove_watcher() i=5 2024-09-14T10:57:43.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.513+0000 7fd05561d800 20 remove_watcher() i=6 2024-09-14T10:57:43.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:43.514+0000 7fd05561d800 20 remove_watcher() i=7 2024-09-14T10:57:43.522 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-14T10:57:43.522 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:43.525 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.525 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.529 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.529 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.532 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.532 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.576 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-14T10:57:43.576 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:57:43.577 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.577 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.622 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.664 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.665 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.677 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.677 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.681 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.681 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.694 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.694 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.697 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.697 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.711 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.711 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.714 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.714 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.726 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.727 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.730 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.730 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.743 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.743 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.746 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.746 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.759 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:43.759 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:43.763 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T10:57:44.168 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T10:57:45.579 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:45.579 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:45.632 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:45.634 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-14T10:57:45.672 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:45.672 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:45.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.718+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.720+0000 7f0ace40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:45.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.720+0000 7f0ace40e800 20 realm 2024-09-14T10:57:45.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.720+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.720+0000 7f0ace40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:45.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.720+0000 7f0ace40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:45.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.720+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.721+0000 7f0ace40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:45.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.721+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.722+0000 7f0ace40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:45.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.722+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.722+0000 7f0ace40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:45.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.722+0000 7f0ace40e800 20 searching for the correct realm 2024-09-14T10:57:45.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.725+0000 7f0ac936a640 0 -- 172.21.15.2:0/863947256 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f0abc088b90 msgr2=0x7f0abc061390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:45.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.730+0000 7f0ac9b6b640 0 -- 172.21.15.2:0/863947256 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f0ac0072730 msgr2=0x7f0ac002b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:45.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:45.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:45.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:45.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:45.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:45.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:45.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:45.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.937+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:45.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:45.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 20 zone default found 2024-09-14T10:57:45.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 4 Realm: () 2024-09-14T10:57:45.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 20 zonegroup default 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.938+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.939+0000 7f0ace40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.939+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.939+0000 7f0ace40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.939+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.939+0000 7f0ace40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.939+0000 7f0ace40e800 20 started sync module instance, tier type = 2024-09-14T10:57:45.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.939+0000 7f0ace40e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:45.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.951+0000 7f0ace40e800 20 add_watcher() i=0 2024-09-14T10:57:45.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.951+0000 7f0ace40e800 20 add_watcher() i=1 2024-09-14T10:57:45.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.951+0000 7f0ace40e800 20 add_watcher() i=2 2024-09-14T10:57:45.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.951+0000 7f0ace40e800 20 add_watcher() i=3 2024-09-14T10:57:45.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.951+0000 7f0ace40e800 20 add_watcher() i=4 2024-09-14T10:57:45.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.951+0000 7f0ace40e800 20 add_watcher() i=5 2024-09-14T10:57:45.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.951+0000 7f0ace40e800 20 add_watcher() i=6 2024-09-14T10:57:45.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.952+0000 7f0ace40e800 20 add_watcher() i=7 2024-09-14T10:57:45.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.952+0000 7f0ace40e800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:45.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.954+0000 7f097b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:45.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.954+0000 7f0ace40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:45.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.954+0000 7f0ace40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:45.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.954+0000 7f0ace40e800 5 note: GC not initialized 2024-09-14T10:57:45.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.955+0000 7f097a7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:45.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.955+0000 7f0ace40e800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:45.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.955+0000 7f0ace40e800 20 Filter name: none 2024-09-14T10:57:45.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.955+0000 7f08ebfff640 20 reqs_thread_entry: start 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.955+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.955+0000 7f0ace40e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.955+0000 7f0ace40e800 20 rados->read ofs=0 len=0 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.956+0000 7f0ace40e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.956+0000 7f0ace40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.956+0000 7f0ace40e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.956+0000 7f0ace40e800 20 INFO: main: starting shard=0 2024-09-14T10:57:45.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.956+0000 7f0ace40e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:45.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.956+0000 7f0ace40e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:57:45.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.957+0000 7f0ace40e800 20 INFO: main: done 2024-09-14T10:57:45.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.958+0000 7f097b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:45.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.960+0000 7f0ace40e800 20 remove_watcher() i=0 2024-09-14T10:57:45.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.960+0000 7f0ace40e800 2 removed watcher, disabling cache 2024-09-14T10:57:45.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.962+0000 7f0ace40e800 20 remove_watcher() i=1 2024-09-14T10:57:45.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.964+0000 7f0ace40e800 20 remove_watcher() i=2 2024-09-14T10:57:45.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.965+0000 7f0ace40e800 20 remove_watcher() i=3 2024-09-14T10:57:45.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.966+0000 7f0ace40e800 20 remove_watcher() i=4 2024-09-14T10:57:45.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.967+0000 7f0ace40e800 20 remove_watcher() i=5 2024-09-14T10:57:45.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.968+0000 7f0ace40e800 20 remove_watcher() i=6 2024-09-14T10:57:45.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:45.970+0000 7f0ace40e800 20 remove_watcher() i=7 2024-09-14T10:57:45.984 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:45.984 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:45.988 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:45.988 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:46.038 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:46.039 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-14T10:57:46.072 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:46.072 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:46.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.114+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 20 realm 2024-09-14T10:57:46.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:46.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.116+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.117+0000 7f14dde12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:46.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.118+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.118+0000 7f14dde12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:46.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.118+0000 7f14dde12800 20 searching for the correct realm 2024-09-14T10:57:46.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.121+0000 7f14d9ccc640 0 -- 172.21.15.2:0/4096683699 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f14d0017070 msgr2=0x7f14d005ff70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:57:46.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.125+0000 7f14d94cb640 0 -- 172.21.15.2:0/4096683699 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f14d0097210 msgr2=0x7f14d0067e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:57:46.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.331+0000 7f14dde12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:46.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.331+0000 7f14dde12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:46.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.331+0000 7f14dde12800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:46.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.331+0000 7f14dde12800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:46.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.331+0000 7f14dde12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:46.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.331+0000 7f14dde12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.331+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 zone default found 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 4 Realm: () 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 zonegroup default 2024-09-14T10:57:46.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.332+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.333+0000 7f14dde12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.333+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.333+0000 7f14dde12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.333+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.333+0000 7f14dde12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.333+0000 7f14dde12800 20 started sync module instance, tier type = 2024-09-14T10:57:46.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.333+0000 7f14dde12800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:46.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.344+0000 7f14dde12800 20 add_watcher() i=0 2024-09-14T10:57:46.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.344+0000 7f14dde12800 20 add_watcher() i=1 2024-09-14T10:57:46.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.344+0000 7f14dde12800 20 add_watcher() i=2 2024-09-14T10:57:46.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.344+0000 7f14dde12800 20 add_watcher() i=3 2024-09-14T10:57:46.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.344+0000 7f14dde12800 20 add_watcher() i=4 2024-09-14T10:57:46.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.344+0000 7f14dde12800 20 add_watcher() i=5 2024-09-14T10:57:46.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.344+0000 7f14dde12800 20 add_watcher() i=6 2024-09-14T10:57:46.344 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.345+0000 7f14dde12800 20 add_watcher() i=7 2024-09-14T10:57:46.344 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.345+0000 7f14dde12800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:46.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.347+0000 7f138ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:46.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.347+0000 7f14dde12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:46.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.347+0000 7f14dde12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:46.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.347+0000 7f14dde12800 5 note: GC not initialized 2024-09-14T10:57:46.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.347+0000 7f138efe5640 20 reqs_thread_entry: start 2024-09-14T10:57:46.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.347+0000 7f14dde12800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:46.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.348+0000 7f14dde12800 20 Filter name: none 2024-09-14T10:57:46.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.348+0000 7f138cfe1640 20 reqs_thread_entry: start 2024-09-14T10:57:46.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.348+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.348+0000 7f14dde12800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.348+0000 7f14dde12800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.349+0000 7f14dde12800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.349+0000 7f14dde12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.349+0000 7f14dde12800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.349+0000 7f14dde12800 20 INFO: main: starting shard=0 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.349+0000 7f14dde12800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.349+0000 7f14dde12800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-14T10:57:46.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.349+0000 7f14dde12800 20 INFO: main: done 2024-09-14T10:57:46.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.350+0000 7f138ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:46.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.353+0000 7f14dde12800 20 remove_watcher() i=0 2024-09-14T10:57:46.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.353+0000 7f14dde12800 2 removed watcher, disabling cache 2024-09-14T10:57:46.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.354+0000 7f14dde12800 20 remove_watcher() i=1 2024-09-14T10:57:46.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.355+0000 7f14dde12800 20 remove_watcher() i=2 2024-09-14T10:57:46.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.356+0000 7f14dde12800 20 remove_watcher() i=3 2024-09-14T10:57:46.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.357+0000 7f14dde12800 20 remove_watcher() i=4 2024-09-14T10:57:46.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.358+0000 7f14dde12800 20 remove_watcher() i=5 2024-09-14T10:57:46.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.359+0000 7f14dde12800 20 remove_watcher() i=6 2024-09-14T10:57:46.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.360+0000 7f14dde12800 20 remove_watcher() i=7 2024-09-14T10:57:46.373 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:46.373 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:46.377 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:46.377 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:46.427 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:46.428 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-14T10:57:46.462 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:46.462 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:46.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.502+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 20 realm 2024-09-14T10:57:46.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:46.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.504+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.505+0000 7f3be0a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:46.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.505+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.506+0000 7f3be0a40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:46.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.506+0000 7f3be0a40800 20 searching for the correct realm 2024-09-14T10:57:46.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.510+0000 7f3bddd29640 0 -- 172.21.15.2:0/2144078451 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55a42749b4f0 msgr2=0x55a42749d960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:46.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.513+0000 7f3bde52a640 0 -- 172.21.15.2:0/2144078451 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3bd4045540 msgr2=0x7f3bd40870c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:46.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:46.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:46.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:46.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:46.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:46.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:46.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:46.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:46.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 zone default found 2024-09-14T10:57:46.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 4 Realm: () 2024-09-14T10:57:46.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:46.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:46.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:46.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 zonegroup default 2024-09-14T10:57:46.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.518+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.519+0000 7f3be0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.519+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.519+0000 7f3be0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.519+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.519+0000 7f3be0a40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.519+0000 7f3be0a40800 20 started sync module instance, tier type = 2024-09-14T10:57:46.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.519+0000 7f3be0a40800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:46.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.529+0000 7f3be0a40800 20 add_watcher() i=0 2024-09-14T10:57:46.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.529+0000 7f3be0a40800 20 add_watcher() i=1 2024-09-14T10:57:46.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.529+0000 7f3be0a40800 20 add_watcher() i=2 2024-09-14T10:57:46.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.529+0000 7f3be0a40800 20 add_watcher() i=3 2024-09-14T10:57:46.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.529+0000 7f3be0a40800 20 add_watcher() i=4 2024-09-14T10:57:46.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.529+0000 7f3be0a40800 20 add_watcher() i=5 2024-09-14T10:57:46.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.529+0000 7f3be0a40800 20 add_watcher() i=6 2024-09-14T10:57:46.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.530+0000 7f3be0a40800 20 add_watcher() i=7 2024-09-14T10:57:46.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.530+0000 7f3be0a40800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:46.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.532+0000 7f3a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.532+0000 7f3be0a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.532+0000 7f3be0a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.532+0000 7f3be0a40800 5 note: GC not initialized 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.533+0000 7f3a0f7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.533+0000 7f3be0a40800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.533+0000 7f3be0a40800 20 Filter name: none 2024-09-14T10:57:46.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.533+0000 7f3a0d7fa640 20 reqs_thread_entry: start 2024-09-14T10:57:46.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.533+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.533+0000 7f3be0a40800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:46.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.533+0000 7f3be0a40800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.534+0000 7f3be0a40800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:46.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.534+0000 7f3be0a40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:46.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.534+0000 7f3be0a40800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:46.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.534+0000 7f3be0a40800 20 INFO: main: starting shard=0 2024-09-14T10:57:46.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.534+0000 7f3be0a40800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:46.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.534+0000 7f3be0a40800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:57:46.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.534+0000 7f3be0a40800 20 INFO: main: done 2024-09-14T10:57:46.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.535+0000 7f3a94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:46.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.538+0000 7f3be0a40800 20 remove_watcher() i=0 2024-09-14T10:57:46.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.538+0000 7f3be0a40800 2 removed watcher, disabling cache 2024-09-14T10:57:46.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.539+0000 7f3be0a40800 20 remove_watcher() i=1 2024-09-14T10:57:46.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.540+0000 7f3be0a40800 20 remove_watcher() i=2 2024-09-14T10:57:46.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.541+0000 7f3be0a40800 20 remove_watcher() i=3 2024-09-14T10:57:46.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.543+0000 7f3be0a40800 20 remove_watcher() i=4 2024-09-14T10:57:46.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.544+0000 7f3be0a40800 20 remove_watcher() i=5 2024-09-14T10:57:46.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.545+0000 7f3be0a40800 20 remove_watcher() i=6 2024-09-14T10:57:46.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.546+0000 7f3be0a40800 20 remove_watcher() i=7 2024-09-14T10:57:46.558 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:46.559 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:46.562 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:46.562 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:46.612 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T10:57:46.613 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-14T10:57:46.645 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:46.645 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:46.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.685+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.687+0000 7f4bb9c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.687+0000 7f4bb9c0f800 20 realm 2024-09-14T10:57:46.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.687+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.687+0000 7f4bb9c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.687+0000 7f4bb9c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:46.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.687+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.688+0000 7f4bb9c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.688+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.688+0000 7f4bb9c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:46.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.688+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.689+0000 7f4bb9c0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:46.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.689+0000 7f4bb9c0f800 20 searching for the correct realm 2024-09-14T10:57:46.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.692+0000 7f4bb7efa640 0 -- 172.21.15.2:0/1495375171 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f4bac093060 msgr2=0x7f4bac03a330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:46.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.695+0000 7f4bb76f9640 0 -- 172.21.15.2:0/1495375171 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f4bac001c20 msgr2=0x7f4bac0859a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:46.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:46.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:46.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.901+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:46.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:46.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 zone default found 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 4 Realm: () 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 zonegroup default 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.902+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.903+0000 7f4bb9c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.903+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.903+0000 7f4bb9c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:46.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.903+0000 7f4bb9c0f800 20 started sync module instance, tier type = 2024-09-14T10:57:46.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.903+0000 7f4bb9c0f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:46.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=0 2024-09-14T10:57:46.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=1 2024-09-14T10:57:46.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=2 2024-09-14T10:57:46.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=3 2024-09-14T10:57:46.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=4 2024-09-14T10:57:46.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=5 2024-09-14T10:57:46.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=6 2024-09-14T10:57:46.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 20 add_watcher() i=7 2024-09-14T10:57:46.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.913+0000 7f4bb9c0f800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:46.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.915+0000 7f4a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.915+0000 7f4bb9c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.915+0000 7f4bb9c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.915+0000 7f4bb9c0f800 5 note: GC not initialized 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.916+0000 7f4a6cfe1640 20 reqs_thread_entry: start 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.916+0000 7f4bb9c0f800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.916+0000 7f4bb9c0f800 20 Filter name: none 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.916+0000 7f49e67fc640 20 reqs_thread_entry: start 2024-09-14T10:57:46.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.916+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.917+0000 7f4bb9c0f800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:46.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.917+0000 7f4bb9c0f800 20 rados->read ofs=0 len=0 2024-09-14T10:57:46.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.917+0000 7f4bb9c0f800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:46.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.917+0000 7f4bb9c0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:46.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.917+0000 7f4bb9c0f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T10:57:46.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.917+0000 7f4bb9c0f800 20 INFO: main: starting shard=0 2024-09-14T10:57:46.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.917+0000 7f4bb9c0f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:46.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.918+0000 7f4bb9c0f800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T10:57:46.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.918+0000 7f4bb9c0f800 20 INFO: main: done 2024-09-14T10:57:46.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.919+0000 7f4a6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:46.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.922+0000 7f4bb9c0f800 20 remove_watcher() i=0 2024-09-14T10:57:46.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.922+0000 7f4bb9c0f800 2 removed watcher, disabling cache 2024-09-14T10:57:46.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.923+0000 7f4bb9c0f800 20 remove_watcher() i=1 2024-09-14T10:57:46.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.924+0000 7f4bb9c0f800 20 remove_watcher() i=2 2024-09-14T10:57:46.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.925+0000 7f4bb9c0f800 20 remove_watcher() i=3 2024-09-14T10:57:46.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.926+0000 7f4bb9c0f800 20 remove_watcher() i=4 2024-09-14T10:57:46.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.927+0000 7f4bb9c0f800 20 remove_watcher() i=5 2024-09-14T10:57:46.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.928+0000 7f4bb9c0f800 20 remove_watcher() i=6 2024-09-14T10:57:46.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:46.929+0000 7f4bb9c0f800 20 remove_watcher() i=7 2024-09-14T10:57:46.942 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:46.942 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:46.946 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T10:57:47.353 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T10:57:47.762 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-14T10:57:47.792 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:47.792 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:47.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.833+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:47.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:47.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 20 realm 2024-09-14T10:57:47.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:47.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:47.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:47.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:47.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:47.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.834+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:47.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.835+0000 7fb538a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:47.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.835+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:47.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.836+0000 7fb538a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:47.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.836+0000 7fb538a10800 20 searching for the correct realm 2024-09-14T10:57:47.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.839+0000 7fb533a19640 0 -- 172.21.15.2:0/2523803333 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fb524027040 msgr2=0x7fb524019920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:47.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:47.843+0000 7fb53421a640 0 -- 172.21.15.2:0/2523803333 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fb5280c9c30 msgr2=0x7fb5280b5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:48.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:48.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:48.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:48.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:48.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:48.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:48.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.049+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 zone default found 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 4 Realm: () 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:48.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 zonegroup default 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.050+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.051+0000 7fb538a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.051+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.051+0000 7fb538a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.051+0000 7fb538a10800 20 started sync module instance, tier type = 2024-09-14T10:57:48.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.051+0000 7fb538a10800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:48.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.062+0000 7fb538a10800 20 add_watcher() i=0 2024-09-14T10:57:48.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.062+0000 7fb538a10800 20 add_watcher() i=1 2024-09-14T10:57:48.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.062+0000 7fb538a10800 20 add_watcher() i=2 2024-09-14T10:57:48.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.062+0000 7fb538a10800 20 add_watcher() i=3 2024-09-14T10:57:48.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.062+0000 7fb538a10800 20 add_watcher() i=4 2024-09-14T10:57:48.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.062+0000 7fb538a10800 20 add_watcher() i=5 2024-09-14T10:57:48.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.062+0000 7fb538a10800 20 add_watcher() i=6 2024-09-14T10:57:48.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.063+0000 7fb538a10800 20 add_watcher() i=7 2024-09-14T10:57:48.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.063+0000 7fb538a10800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:48.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb3eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:48.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb538a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:48.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb538a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:48.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb538a10800 5 note: GC not initialized 2024-09-14T10:57:48.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb3e9fdb640 20 reqs_thread_entry: start 2024-09-14T10:57:48.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb538a10800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:48.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb538a10800 20 Filter name: none 2024-09-14T10:57:48.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.065+0000 7fb35b7fe640 20 reqs_thread_entry: start 2024-09-14T10:57:48.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:48.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:48.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:48.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:48.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.066+0000 7fb538a10800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.070+0000 7fb3eafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:48.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.073+0000 7fb538a10800 20 remove_watcher() i=0 2024-09-14T10:57:48.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.073+0000 7fb538a10800 2 removed watcher, disabling cache 2024-09-14T10:57:48.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.074+0000 7fb538a10800 20 remove_watcher() i=1 2024-09-14T10:57:48.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.075+0000 7fb538a10800 20 remove_watcher() i=2 2024-09-14T10:57:48.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.077+0000 7fb538a10800 20 remove_watcher() i=3 2024-09-14T10:57:48.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.078+0000 7fb538a10800 20 remove_watcher() i=4 2024-09-14T10:57:48.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.079+0000 7fb538a10800 20 remove_watcher() i=5 2024-09-14T10:57:48.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.080+0000 7fb538a10800 20 remove_watcher() i=6 2024-09-14T10:57:48.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.081+0000 7fb538a10800 20 remove_watcher() i=7 2024-09-14T10:57:48.093 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T10:57:48.129 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:48.129 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:48.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.170+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.171+0000 7fdbf2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.171+0000 7fdbf2d39800 20 realm 2024-09-14T10:57:48.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.171+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.172+0000 7fdbf2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.172+0000 7fdbf2d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:48.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.172+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.172+0000 7fdbf2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.172+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.173+0000 7fdbf2d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:48.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.173+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.173+0000 7fdbf2d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:48.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.173+0000 7fdbf2d39800 20 searching for the correct realm 2024-09-14T10:57:48.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.176+0000 7fdbee1c6640 0 -- 172.21.15.2:0/673734919 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fdbe008cb80 msgr2=0x7fdbe007e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:48.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.180+0000 7fdbee9c7640 0 -- 172.21.15.2:0/673734919 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fdbe403bf70 msgr2=0x7fdbe4043a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:48.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.386+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 zone default found 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 4 Realm: () 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 zonegroup default 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.387+0000 7fdbf2d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.388+0000 7fdbf2d39800 20 started sync module instance, tier type = 2024-09-14T10:57:48.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.388+0000 7fdbf2d39800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:48.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.398+0000 7fdbf2d39800 20 add_watcher() i=0 2024-09-14T10:57:48.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.398+0000 7fdbf2d39800 20 add_watcher() i=1 2024-09-14T10:57:48.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.398+0000 7fdbf2d39800 20 add_watcher() i=2 2024-09-14T10:57:48.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.398+0000 7fdbf2d39800 20 add_watcher() i=3 2024-09-14T10:57:48.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.398+0000 7fdbf2d39800 20 add_watcher() i=4 2024-09-14T10:57:48.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.398+0000 7fdbf2d39800 20 add_watcher() i=5 2024-09-14T10:57:48.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.398+0000 7fdbf2d39800 20 add_watcher() i=6 2024-09-14T10:57:48.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.399+0000 7fdbf2d39800 20 add_watcher() i=7 2024-09-14T10:57:48.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.399+0000 7fdbf2d39800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:48.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.401+0000 7fdaa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:48.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.401+0000 7fdbf2d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:48.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.401+0000 7fdbf2d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:48.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.401+0000 7fdbf2d39800 5 note: GC not initialized 2024-09-14T10:57:48.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.401+0000 7fda1ffff640 20 reqs_thread_entry: start 2024-09-14T10:57:48.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.401+0000 7fdbf2d39800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:48.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 20 Filter name: none 2024-09-14T10:57:48.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fda1dffb640 20 reqs_thread_entry: start 2024-09-14T10:57:48.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-14T10:57:48.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:48.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-14T10:57:48.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-14T10:57:48.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 : miss 2024-09-14T10:57:48.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:48.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 info.flags=0x17 2024-09-14T10:57:48.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 to cache LRU end 2024-09-14T10:57:48.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T10:57:48.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-14T10:57:48.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.402+0000 7fdbf2d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1 2024-09-14T10:57:48.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.403+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.404+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.404+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:c state=0x563d693762b8 s->prefetch_data=0 2024-09-14T10:57:48.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.405+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to wrjn0g35l725sds5r79gpxe5j14qo719 2024-09-14T10:57:48.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.405+0000 7fdbf2d39800 20 get_obj_state_impl: setting s->olh_tag to khwm1b05ksa3ks7haghkppao3upnlev9 2024-09-14T10:57:48.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.405+0000 7fdbf2d39800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=khwm1b05ksa3ks7haghkppao3upnlev9 2024-09-14T10:57:48.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.406+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 20 olh_log_entry: epoch=3 op=3 key=c[PoddJgt0QWr5O4UfM2Q2sRGObT.aBXg] 2024-09-14T10:57:48.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:PoddJgt0QWr5O4UfM2Q2sRGObT.aBXg_c state=0x563d69370068 s->prefetch_data=0 2024-09-14T10:57:48.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 10 manifest: total_size = 22 2024-09-14T10:57:48.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1784236077613744069 2024-09-14T10:57:48.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:PoddJgt0QWr5O4UfM2Q2sRGObT.aBXg_c state=0x563d69370068 s->prefetch_data=0 2024-09-14T10:57:48.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 20 prepare_atomic_modification: state is not atomic. state=0x563d69370068 2024-09-14T10:57:48.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.408+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.411+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:48.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.411+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T10:57:48.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.411+0000 7fdbf2d39800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:48.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.411+0000 7fdbf2d39800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:PoddJgt0QWr5O4UfM2Q2sRGObT.aBXg_.A26_u0zpr27byWPzhznFCu-FrdBcGKC_0 2024-09-14T10:57:48.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.412+0000 7fdad27fc640 20 handle_completion(): completion ok for obj=c[PoddJgt0QWr5O4UfM2Q2sRGObT.aBXg] 2024-09-14T10:57:48.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.412+0000 7fdbf2d39800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:48.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.413+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.413+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.416+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.416+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.416+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:d state=0x563d693762b8 s->prefetch_data=0 2024-09-14T10:57:48.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.417+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to 9t4flmbb8n430b0x1d4fld4g1ra3pwzg 2024-09-14T10:57:48.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.417+0000 7fdbf2d39800 20 get_obj_state_impl: setting s->olh_tag to zsgvlmk1j5o0boy14rsgzu9fei2l811v 2024-09-14T10:57:48.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.417+0000 7fdbf2d39800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zsgvlmk1j5o0boy14rsgzu9fei2l811v 2024-09-14T10:57:48.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.419+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.420+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.420+0000 7fdbf2d39800 20 olh_log_entry: epoch=3 op=3 key=d[0zTxVtm3SLx0kNFDkn6cVHWrXvw-XgR] 2024-09-14T10:57:48.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.420+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:0zTxVtm3SLx0kNFDkn6cVHWrXvw-XgR_d state=0x563d6936d4f8 s->prefetch_data=0 2024-09-14T10:57:48.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.421+0000 7fdbf2d39800 10 manifest: total_size = 9 2024-09-14T10:57:48.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.421+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.9317908928137595504 2024-09-14T10:57:48.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.421+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:0zTxVtm3SLx0kNFDkn6cVHWrXvw-XgR_d state=0x563d6936d4f8 s->prefetch_data=0 2024-09-14T10:57:48.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.421+0000 7fdbf2d39800 20 prepare_atomic_modification: state is not atomic. state=0x563d6936d4f8 2024-09-14T10:57:48.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.421+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.423+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:48.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.423+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T10:57:48.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.423+0000 7fdbf2d39800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:48.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.423+0000 7fdbf2d39800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:0zTxVtm3SLx0kNFDkn6cVHWrXvw-XgR_.qCZ2n71SgSqS1EizY69q0S8XdCL-yBo_0 2024-09-14T10:57:48.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.424+0000 7fdad27fc640 20 handle_completion(): completion ok for obj=d[0zTxVtm3SLx0kNFDkn6cVHWrXvw-XgR] 2024-09-14T10:57:48.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.424+0000 7fdbf2d39800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:48.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.426+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.426+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.427+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.427+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.427+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:e state=0x563d693762b8 s->prefetch_data=0 2024-09-14T10:57:48.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.428+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to bb4xxg5yb6rz1k1b5mqlj761q08t5xlk 2024-09-14T10:57:48.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.428+0000 7fdbf2d39800 20 get_obj_state_impl: setting s->olh_tag to 2eel5ox86gp6pwk5f5pj7kxjd5tomurt 2024-09-14T10:57:48.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.428+0000 7fdbf2d39800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2eel5ox86gp6pwk5f5pj7kxjd5tomurt 2024-09-14T10:57:48.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.429+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.430+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.430+0000 7fdbf2d39800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-14T10:57:48.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.430+0000 7fdbf2d39800 20 olh_log_entry: epoch=2 op=3 key=e[o.dt5VQOZbYArYR.nHh8N4Y7sT.fNxb] 2024-09-14T10:57:48.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.430+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:o.dt5VQOZbYArYR.nHh8N4Y7sT.fNxb_e state=0x563d6936e508 s->prefetch_data=0 2024-09-14T10:57:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.431+0000 7fdbf2d39800 10 manifest: total_size = 9 2024-09-14T10:57:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.431+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13898142281263401120 2024-09-14T10:57:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.431+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:o.dt5VQOZbYArYR.nHh8N4Y7sT.fNxb_e state=0x563d6936e508 s->prefetch_data=0 2024-09-14T10:57:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.431+0000 7fdbf2d39800 20 prepare_atomic_modification: state is not atomic. state=0x563d6936e508 2024-09-14T10:57:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.431+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.433+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:48.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.433+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T10:57:48.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.433+0000 7fdbf2d39800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:48.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.433+0000 7fdbf2d39800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:o.dt5VQOZbYArYR.nHh8N4Y7sT.fNxb_.5VYHEKZ9TXCy3Clr_pvXB5flNBs1T0F_0 2024-09-14T10:57:48.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.435+0000 7fdbf2d39800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:48.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.435+0000 7fdad1ffb640 20 handle_completion(): completion ok for obj=e[o.dt5VQOZbYArYR.nHh8N4Y7sT.fNxb] 2024-09-14T10:57:48.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.436+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:e state=0x563d693762b8 s->prefetch_data=0 2024-09-14T10:57:48.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.436+0000 7fdbf2d39800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2eel5ox86gp6pwk5f5pj7kxjd5tomurt 2024-09-14T10:57:48.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.438+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.439+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.439+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.440+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:f state=0x563d693762b8 s->prefetch_data=0 2024-09-14T10:57:48.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.440+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to 28zo07fa3nn01kb88h55ylxwf409yo0r 2024-09-14T10:57:48.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.440+0000 7fdbf2d39800 20 get_obj_state_impl: setting s->olh_tag to lht1hdpmj3p0rbsk3nhik5tmul3welj0 2024-09-14T10:57:48.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.440+0000 7fdbf2d39800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lht1hdpmj3p0rbsk3nhik5tmul3welj0 2024-09-14T10:57:48.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.441+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.442+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 20 olh_log_entry: epoch=2 op=3 key=f[SU.XavebuiaGZ-efpJa6sP4ncN7FX5S] 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:SU.XavebuiaGZ-efpJa6sP4ncN7FX5S_f state=0x563d6936e508 s->prefetch_data=0 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 10 manifest: total_size = 11 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12281027502137945334 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:_:SU.XavebuiaGZ-efpJa6sP4ncN7FX5S_f state=0x563d6936e508 s->prefetch_data=0 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 20 prepare_atomic_modification: state is not atomic. state=0x563d6936e508 2024-09-14T10:57:48.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.443+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.446+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T10:57:48.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.446+0000 7fdbf2d39800 20 RGWObjManifest::operator++(): result: ofs=11 stripe_ofs=11 part_ofs=0 rule->part_size=0 2024-09-14T10:57:48.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.446+0000 7fdbf2d39800 0 deleting objects inline since gc isn't initialized 2024-09-14T10:57:48.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.446+0000 7fdbf2d39800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.1__shadow:SU.XavebuiaGZ-efpJa6sP4ncN7FX5S_.uSL7eokbuZFQTxPIGXnHYW1DoGuHO5F_0 2024-09-14T10:57:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.447+0000 7fdbf2d39800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T10:57:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.447+0000 7fdad1ffb640 20 handle_completion(): completion ok for obj=f[SU.XavebuiaGZ-efpJa6sP4ncN7FX5S] 2024-09-14T10:57:48.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.448+0000 7fdbf2d39800 20 get_obj_state: octx=0x563d690bf8a0 obj=check-bucket:f state=0x563d693762b8 s->prefetch_data=0 2024-09-14T10:57:48.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.448+0000 7fdbf2d39800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=lht1hdpmj3p0rbsk3nhik5tmul3welj0 2024-09-14T10:57:48.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.450+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.451+0000 7fdbf2d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.1.0 2024-09-14T10:57:48.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.451+0000 7fdbf2d39800 1 NOTICE: finished shard 0 (4 entries removed) 2024-09-14T10:57:48.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.451+0000 7fdbf2d39800 1 NOTICE: finished all shards (4 entries removed) 2024-09-14T10:57:48.451 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.452+0000 7fdaa57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:48.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.455+0000 7fdbf2d39800 20 remove_watcher() i=0 2024-09-14T10:57:48.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.455+0000 7fdbf2d39800 2 removed watcher, disabling cache 2024-09-14T10:57:48.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.456+0000 7fdbf2d39800 20 remove_watcher() i=1 2024-09-14T10:57:48.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.457+0000 7fdbf2d39800 20 remove_watcher() i=2 2024-09-14T10:57:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.458+0000 7fdbf2d39800 20 remove_watcher() i=3 2024-09-14T10:57:48.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.459+0000 7fdbf2d39800 20 remove_watcher() i=4 2024-09-14T10:57:48.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.460+0000 7fdbf2d39800 20 remove_watcher() i=5 2024-09-14T10:57:48.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.461+0000 7fdbf2d39800 20 remove_watcher() i=6 2024-09-14T10:57:48.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.462+0000 7fdbf2d39800 20 remove_watcher() i=7 2024-09-14T10:57:48.474 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:48.474 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:48.479 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:48.479 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:48.523 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-14T10:57:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T10:57:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T10:57:48.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.592+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 20 realm 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.594+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.595+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:48.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.595+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.595+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T10:57:48.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.595+0000 7ff8e3b2c800 20 searching for the correct realm 2024-09-14T10:57:48.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.598+0000 7ff8df0ac640 0 -- 172.21.15.2:0/4263956369 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7ff8d0038030 msgr2=0x7ff8d0046420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:48.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.602+0000 7ff8df8ad640 0 -- 172.21.15.2:0/4263956369 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ff8d40cdbe0 msgr2=0x7ff8d40cece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T10:57:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T10:57:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T10:57:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T10:57:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T10:57:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T10:57:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T10:57:48.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T10:57:48.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.809+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 zone default found 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 4 Realm: () 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 zonegroup default 2024-09-14T10:57:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.810+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.811+0000 7ff8e3b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.811+0000 7ff8e3b2c800 20 started sync module instance, tier type = 2024-09-14T10:57:48.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.811+0000 7ff8e3b2c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T10:57:48.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.820+0000 7ff8e3b2c800 20 add_watcher() i=0 2024-09-14T10:57:48.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.820+0000 7ff8e3b2c800 20 add_watcher() i=1 2024-09-14T10:57:48.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.820+0000 7ff8e3b2c800 20 add_watcher() i=2 2024-09-14T10:57:48.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.820+0000 7ff8e3b2c800 20 add_watcher() i=3 2024-09-14T10:57:48.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.820+0000 7ff8e3b2c800 20 add_watcher() i=4 2024-09-14T10:57:48.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.820+0000 7ff8e3b2c800 20 add_watcher() i=5 2024-09-14T10:57:48.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.820+0000 7ff8e3b2c800 20 add_watcher() i=6 2024-09-14T10:57:48.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.821+0000 7ff8e3b2c800 20 add_watcher() i=7 2024-09-14T10:57:48.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.821+0000 7ff8e3b2c800 2 all 8 watchers are set, enabling cache 2024-09-14T10:57:48.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.823+0000 7ff795fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:48.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.823+0000 7ff8e3b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T10:57:48.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.823+0000 7ff8e3b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T10:57:48.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.823+0000 7ff8e3b2c800 5 note: GC not initialized 2024-09-14T10:57:48.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.824+0000 7ff794fe1640 20 reqs_thread_entry: start 2024-09-14T10:57:48.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.824+0000 7ff8e3b2c800 20 init_complete bucket index max shards: 1 2024-09-14T10:57:48.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.824+0000 7ff8e3b2c800 20 Filter name: none 2024-09-14T10:57:48.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.824+0000 7ff70e7fc640 20 reqs_thread_entry: start 2024-09-14T10:57:48.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.824+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.824+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.824+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.825+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.825+0000 7ff8e3b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.825+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.825+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=190 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.825+0000 7ff8e3b2c800 20 rados->read ofs=0 len=0 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.825+0000 7ff8e3b2c800 20 rados_obj.operate() r=0 bl.length=412 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.825+0000 7ff8e3b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T10:57:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.827+0000 7ff795fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T10:57:48.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.829+0000 7ff8e3b2c800 20 remove_watcher() i=0 2024-09-14T10:57:48.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.829+0000 7ff8e3b2c800 2 removed watcher, disabling cache 2024-09-14T10:57:48.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.830+0000 7ff8e3b2c800 20 remove_watcher() i=1 2024-09-14T10:57:48.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.831+0000 7ff8e3b2c800 20 remove_watcher() i=2 2024-09-14T10:57:48.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.832+0000 7ff8e3b2c800 20 remove_watcher() i=3 2024-09-14T10:57:48.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.833+0000 7ff8e3b2c800 20 remove_watcher() i=4 2024-09-14T10:57:48.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.834+0000 7ff8e3b2c800 20 remove_watcher() i=5 2024-09-14T10:57:48.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.835+0000 7ff8e3b2c800 20 remove_watcher() i=6 2024-09-14T10:57:48.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T10:57:48.836+0000 7ff8e3b2c800 20 remove_watcher() i=7 2024-09-14T10:57:48.846 INFO:tasks.workunit.client.0.smithi002.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T10:57:48.846 INFO:tasks.workunit.client.0.smithi002.stderr:Deleting bucket check-bucket 2024-09-14T10:57:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:48.848 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:48.853 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T10:57:48.853 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T10:57:48.867 INFO:tasks.workunit.client.0.smithi002.stderr:Completed bucket check tests 2024-09-14T10:57:48.867 INFO:tasks.workunit.client.0.smithi002.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T10:57:48.868 INFO:tasks.workunit.client.0.smithi002.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T10:57:48.868 INFO:tasks.workunit.client.0.smithi002.stdout:connected to https://localhost:443 2024-09-14T10:57:48.932 INFO:tasks.workunit.client.0.smithi002.stderr:+ deactivate 2024-09-14T10:57:48.932 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T10:57:48.932 INFO:tasks.workunit.client.0.smithi002.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T10:57:48.932 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-14T10:57:48.932 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n '' ']' 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ hash -r 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n '' ']' 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset VIRTUAL_ENV 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset -f deactivate 2024-09-14T10:57:48.933 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo OK. 2024-09-14T10:57:48.935 INFO:tasks.workunit.client.0.smithi002.stdout:OK. 2024-09-14T10:57:48.935 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:57:48.935 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:57:49.015 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-14T10:57:49.015 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T10:57:49.427 DEBUG:teuthology.parallel:result is None 2024-09-14T10:57:49.428 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:57:49.468 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:57:49.468 DEBUG:teuthology.orchestra.run.smithi002:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:57:49.541 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T10:57:49.541 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T10:57:49.551 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:57:49.551 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T10:57:49.551 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:57:49.610 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T10:57:49.610 INFO:teuthology.orchestra.run.smithi002.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T10:57:49.610 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T10:57:49.685 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T10:57:49.685 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T10:57:49.755 INFO:tasks.workunit:timeout=3h 2024-09-14T10:57:49.755 INFO:tasks.workunit:cleanup=True 2024-09-14T10:57:49.756 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T10:57:49.826 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T10:58:47.546 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 93% (12082/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-14T10:58:48.032 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:58:48.033 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-14T10:58:48.033 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:58:48.033 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-14T10:58:48.033 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:58:48.033 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T10:58:48.033 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T10:58:48.033 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T10:58:48.033 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T10:58:48.102 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T10:58:48.104 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:58:48.104 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T10:58:48.154 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T10:58:48.204 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T10:58:48.244 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T10:58:48.246 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:58:48.246 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T10:58:48.286 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T10:58:48.289 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T10:58:48.289 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T10:58:48.362 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-14T10:58:48.364 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-14T10:58:48.365 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-14T10:58:48.448 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T10:58:48.448 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T10:58:48.448 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T10:58:48.448 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 11 tests from ClsLock 2024-09-14T10:58:48.448 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-14T10:58:49.857 INFO:tasks.workunit.client.0.smithi002.stdout:lock: mylock 2024-09-14T10:58:49.857 INFO:tasks.workunit.client.0.smithi002.stdout: lock_type: exclusive 2024-09-14T10:58:49.857 INFO:tasks.workunit.client.0.smithi002.stdout: tag: 2024-09-14T10:58:49.857 INFO:tasks.workunit.client.0.smithi002.stdout: lockers: 2024-09-14T10:58:49.857 INFO:tasks.workunit.client.0.smithi002.stdout: client.5169 expiration=2024-09-14T11:00:49.855815+0000 addr=v1:172.21.15.2:0/2769372428 cookie= 2024-09-14T10:58:49.862 INFO:tasks.workunit.client.0.smithi002.stdout:lock: mylock 2024-09-14T10:58:49.862 INFO:tasks.workunit.client.0.smithi002.stdout: lock_type: shared 2024-09-14T10:58:49.862 INFO:tasks.workunit.client.0.smithi002.stdout: tag: 2024-09-14T10:58:49.862 INFO:tasks.workunit.client.0.smithi002.stdout: lockers: 2024-09-14T10:58:49.862 INFO:tasks.workunit.client.0.smithi002.stdout: client.5000 expiration=0.000000 addr=v1:172.21.15.2:0/3878852133 cookie= 2024-09-14T10:58:49.862 INFO:tasks.workunit.client.0.smithi002.stdout: client.5169 expiration=2024-09-14T11:00:49.863432+0000 addr=v1:172.21.15.2:0/2769372428 cookie= 2024-09-14T10:58:49.863 INFO:tasks.workunit.client.0.smithi002.stdout:lock: mylock 2024-09-14T10:58:49.863 INFO:tasks.workunit.client.0.smithi002.stdout: lock_type: shared 2024-09-14T10:58:49.863 INFO:tasks.workunit.client.0.smithi002.stdout: tag: 2024-09-14T10:58:49.863 INFO:tasks.workunit.client.0.smithi002.stdout: lockers: 2024-09-14T10:58:49.863 INFO:tasks.workunit.client.0.smithi002.stdout: client.5000 expiration=0.000000 addr=v1:172.21.15.2:0/3878852133 cookie= 2024-09-14T10:58:50.828 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestMultiLocking (2380 ms) 2024-09-14T10:58:50.828 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestMeta 2024-09-14T10:58:52.875 INFO:tasks.workunit.client.0.smithi002.stdout:lock: mylock 2024-09-14T10:58:52.875 INFO:tasks.workunit.client.0.smithi002.stdout: lock_type: shared 2024-09-14T10:58:52.875 INFO:tasks.workunit.client.0.smithi002.stdout: tag: 2024-09-14T10:58:52.875 INFO:tasks.workunit.client.0.smithi002.stdout: lockers: 2024-09-14T10:58:52.875 INFO:tasks.workunit.client.0.smithi002.stdout: client.5187 expiration=0.000000 addr=v1:172.21.15.2:0/901408014 cookie= 2024-09-14T10:58:52.877 INFO:tasks.workunit.client.0.smithi002.stdout:lock: mylock 2024-09-14T10:58:52.877 INFO:tasks.workunit.client.0.smithi002.stdout: lock_type: exclusive 2024-09-14T10:58:52.878 INFO:tasks.workunit.client.0.smithi002.stdout: tag: new_tag 2024-09-14T10:58:52.878 INFO:tasks.workunit.client.0.smithi002.stdout: lockers: 2024-09-14T10:58:52.878 INFO:tasks.workunit.client.0.smithi002.stdout: client.5181 expiration=0.000000 addr=v1:172.21.15.2:0/625061684 cookie= 2024-09-14T10:58:53.844 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestMeta (3016 ms) 2024-09-14T10:58:53.844 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestCookie 2024-09-14T10:58:55.873 INFO:tasks.workunit.client.0.smithi002.stdout:lock: mylock 2024-09-14T10:58:55.873 INFO:tasks.workunit.client.0.smithi002.stdout: lock_type: exclusive 2024-09-14T10:58:55.873 INFO:tasks.workunit.client.0.smithi002.stdout: tag: 2024-09-14T10:58:55.873 INFO:tasks.workunit.client.0.smithi002.stdout: lockers: 2024-09-14T10:58:55.876 INFO:tasks.workunit.client.0.smithi002.stdout:lock: mylock 2024-09-14T10:58:55.876 INFO:tasks.workunit.client.0.smithi002.stdout: lock_type: shared 2024-09-14T10:58:55.876 INFO:tasks.workunit.client.0.smithi002.stdout: tag: 2024-09-14T10:58:55.876 INFO:tasks.workunit.client.0.smithi002.stdout: lockers: 2024-09-14T10:58:55.876 INFO:tasks.workunit.client.0.smithi002.stdout: client.5015 expiration=0.000000 addr=v1:172.21.15.2:0/898284932 cookie= 2024-09-14T10:58:55.876 INFO:tasks.workunit.client.0.smithi002.stdout: client.5015 expiration=0.000000 addr=v1:172.21.15.2:0/898284932 cookie=new cookie 2024-09-14T10:58:56.860 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestCookie (3016 ms) 2024-09-14T10:58:56.860 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-14T10:58:59.873 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestMultipleLocks (3012 ms) 2024-09-14T10:58:59.873 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-14T10:59:07.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestLockDuration (8033 ms) 2024-09-14T10:59:07.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-14T10:59:10.930 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestAssertLocked (3025 ms) 2024-09-14T10:59:10.930 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-14T10:59:13.946 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestSetCookie (3016 ms) 2024-09-14T10:59:13.946 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestRenew 2024-09-14T10:59:34.989 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestRenew (21043 ms) 2024-09-14T10:59:34.989 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-14T10:59:42.016 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7027 ms) 2024-09-14T10:59:42.016 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-14T10:59:50.048 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8032 ms) 2024-09-14T10:59:50.048 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-14T10:59:58.077 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8029 ms) 2024-09-14T10:59:58.078 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 11 tests from ClsLock (69629 ms total) 2024-09-14T10:59:58.078 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T10:59:58.078 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T10:59:58.078 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 11 tests from 1 test suite ran. (69629 ms total) 2024-09-14T10:59:58.078 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 11 tests. 2024-09-14T10:59:58.081 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T10:59:58.081 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T10:59:58.125 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-14T10:59:58.127 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-14T10:59:58.127 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-14T10:59:58.214 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T10:59:58.214 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T10:59:58.214 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T10:59:58.214 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 4 tests from cls_log 2024-09-14T10:59:58.214 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-14T11:00:01.101 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_log.test_log_add_same_time (2887 ms) 2024-09-14T11:00:01.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-14T11:00:04.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_log.test_log_add_different_time (3017 ms) 2024-09-14T11:00:04.119 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_log.trim_by_time 2024-09-14T11:00:07.134 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_log.trim_by_time (3015 ms) 2024-09-14T11:00:07.134 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-14T11:00:10.149 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_log.trim_by_marker (3013 ms) 2024-09-14T11:00:10.149 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 4 tests from cls_log (11933 ms total) 2024-09-14T11:00:10.149 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:00:10.149 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:00:10.149 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 4 tests from 1 test suite ran. (11933 ms total) 2024-09-14T11:00:10.150 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 4 tests. 2024-09-14T11:00:10.151 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:00:10.151 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:00:10.196 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-14T11:00:10.198 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-14T11:00:10.198 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-14T11:00:10.284 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T11:00:10.284 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:00:10.284 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:00:10.284 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 10 tests from cls_refcount 2024-09-14T11:00:10.284 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-14T11:00:13.165 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_implicit (2880 ms) 2024-09-14T11:00:13.165 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-14T11:00:16.182 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3017 ms) 2024-09-14T11:00:16.182 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-14T11:00:26.234 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_put_snap (10053 ms) 2024-09-14T11:00:26.235 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-14T11:00:29.258 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_explicit (3024 ms) 2024-09-14T11:00:29.258 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.set 2024-09-14T11:00:32.275 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.set (3016 ms) 2024-09-14T11:00:32.275 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-14T11:00:39.290 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_implicit_ec (7016 ms) 2024-09-14T11:00:39.291 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-14T11:00:46.327 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7037 ms) 2024-09-14T11:00:46.328 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-14T11:00:59.388 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_put_snap_ec (13061 ms) 2024-09-14T11:00:59.388 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-14T11:01:06.417 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.test_explicit_ec (7029 ms) 2024-09-14T11:01:06.418 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_refcount.set_ec 2024-09-14T11:01:13.475 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_refcount.set_ec (7058 ms) 2024-09-14T11:01:13.475 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 10 tests from cls_refcount (63191 ms total) 2024-09-14T11:01:13.475 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:01:13.475 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:13.475 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 10 tests from 1 test suite ran. (63191 ms total) 2024-09-14T11:01:13.475 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 10 tests. 2024-09-14T11:01:13.478 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:01:13.478 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:01:13.526 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-14T11:01:13.527 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-14T11:01:13.527 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-14T11:01:13.576 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T11:01:13.576 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 18 tests from 1 test suite. 2024-09-14T11:01:13.576 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:13.576 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 18 tests from cls_rgw 2024-09-14T11:01:15.486 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_basic 2024-09-14T11:01:15.536 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_basic (48 ms) 2024-09-14T11:01:15.536 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-14T11:01:15.570 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (35 ms) 2024-09-14T11:01:15.570 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-14T11:01:15.617 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_remove_object (47 ms) 2024-09-14T11:01:15.617 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-14T11:01:17.065 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_suggest (1449 ms) 2024-09-14T11:01:17.065 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-14T11:01:17.071 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_suggest_complete (6 ms) 2024-09-14T11:01:17.071 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_list 2024-09-14T11:01:17.093 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_list (22 ms) 2024-09-14T11:01:17.093 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-14T11:01:37.142 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_list_delimited (20049 ms) 2024-09-14T11:01:37.143 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.bi_list 2024-09-14T11:01:37.213 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.bi_list (71 ms) 2024-09-14T11:01:37.213 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.gc_set 2024-09-14T11:01:37.223 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.gc_set (10 ms) 2024-09-14T11:01:37.224 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.gc_list 2024-09-14T11:01:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-14T11:01:37.234 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-14T11:01:44.866 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.gc_defer (7631 ms) 2024-09-14T11:01:44.866 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-14T11:01:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.usage_basic (97 ms) 2024-09-14T11:01:44.962 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-14T11:01:44.963 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.usage_clear_no_obj (1 ms) 2024-09-14T11:01:44.963 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-14T11:01:45.060 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.usage_clear (97 ms) 2024-09-14T11:01:45.060 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-14T11:01:45.104 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.bi_log_trim (44 ms) 2024-09-14T11:01:45.104 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-14T11:01:45.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.index_racing_removes (14 ms) 2024-09-14T11:01:45.119 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-14T11:01:45.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.reshardlog_list (15 ms) 2024-09-14T11:01:45.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-14T11:01:45.142 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw.reshardlog_num (9 ms) 2024-09-14T11:01:45.869 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 18 tests from cls_rgw (29656 ms total) 2024-09-14T11:01:45.869 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:01:45.870 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:45.870 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 18 tests from 1 test suite ran. (32293 ms total) 2024-09-14T11:01:45.870 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 18 tests. 2024-09-14T11:01:45.873 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:01:45.873 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:01:45.918 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-14T11:01:45.919 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-14T11:01:45.919 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-14T11:01:46.006 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T11:01:46.006 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:01:46.006 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:46.006 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-14T11:01:46.006 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.init 2024-09-14T11:01:47.880 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.init (1875 ms) 2024-09-14T11:01:47.880 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-14T11:01:47.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (21 ms) 2024-09-14T11:01:47.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-14T11:01:47.905 INFO:tasks.workunit.client.0.smithi002.stderr:[ ] list info tag = chain-0 2024-09-14T11:01:47.907 INFO:tasks.workunit.client.0.smithi002.stderr:[ ] next_marker is: = 0/4263 2024-09-14T11:01:47.907 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (6 ms) 2024-09-14T11:01:47.907 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-14T11:01:47.915 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (8 ms) 2024-09-14T11:01:47.915 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-14T11:01:48.024 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (109 ms) 2024-09-14T11:01:48.024 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-14T11:01:48.168 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (143 ms) 2024-09-14T11:01:48.168 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-14T11:01:48.175 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-14T11:01:48.176 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-14T11:01:48.187 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (11 ms) 2024-09-14T11:01:48.187 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-14T11:01:48.891 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_gc.finalize (705 ms) 2024-09-14T11:01:48.891 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 9 tests from cls_rgw_gc (2886 ms total) 2024-09-14T11:01:48.891 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:01:48.891 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:48.891 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 9 tests from 1 test suite ran. (2886 ms total) 2024-09-14T11:01:48.892 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 9 tests. 2024-09-14T11:01:48.894 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:01:48.894 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:01:48.939 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-14T11:01:48.941 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-14T11:01:48.941 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-14T11:01:48.998 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:01:48.998 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:01:48.998 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 1 test from 1 test suite. 2024-09-14T11:01:48.998 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:01:50.894 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 1 test from cls_rgw_stats 2024-09-14T11:01:50.895 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-14T11:01:50.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.917+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=36ZUS1584K3J type=del size=2928957 2024-09-14T11:01:50.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.918+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=8V6ROMYDYCDG type=write size=587589 2024-09-14T11:01:50.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.920+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=VA4TDFXQWYPZ type=del size=1073438 2024-09-14T11:01:50.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.923+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~2D0UZ1A789VC.0 size=1048576 2024-09-14T11:01:50.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.924+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~2D0UZ1A789VC.1 size=5943 2024-09-14T11:01:50.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.924+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=2D0UZ1A789VC tag=LX1L6SJ090BP type=write size=2103095 2024-09-14T11:01:50.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.926+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~6E92V1MO654C.0 size=278078 2024-09-14T11:01:50.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.926+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=6E92V1MO654C tag=IQ3S69YURR50 type=write size=1326654 2024-09-14T11:01:50.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.928+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=T3K4R6N7L6BH type=del size=2044882 2024-09-14T11:01:50.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.930+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~D4OVI4MTCHEC.0 size=752707 2024-09-14T11:01:50.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.930+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=D4OVI4MTCHEC tag=P6GSZFXHXVBW type=write size=1801283 2024-09-14T11:01:50.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.933+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~CPSQLY7H3G3G.0 size=1048576 2024-09-14T11:01:50.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.934+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~CPSQLY7H3G3G.1 size=1048576 2024-09-14T11:01:50.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.935+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~CPSQLY7H3G3G.2 size=218969 2024-09-14T11:01:50.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.935+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=CPSQLY7H3G3G tag=E4UUHD575X2M type=write size=3364697 2024-09-14T11:01:50.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.937+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=UUFO1B0UFGOD type=del size=1941867 2024-09-14T11:01:50.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.940+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~8L6NCWQQNSCZ.0 size=1048576 2024-09-14T11:01:50.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.941+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~8L6NCWQQNSCZ.1 size=1048576 2024-09-14T11:01:50.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.942+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~8L6NCWQQNSCZ.2 size=648473 2024-09-14T11:01:50.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.942+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=8L6NCWQQNSCZ tag=H40BSC50VDFY type=write size=3794201 2024-09-14T11:01:50.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.944+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=6B8MJX9TWOM9 type=write size=15355 2024-09-14T11:01:50.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.946+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~F8Y582TEOGJK.0 size=1048576 2024-09-14T11:01:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.947+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~F8Y582TEOGJK.1 size=57274 2024-09-14T11:01:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.947+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=F8Y582TEOGJK tag=17DYKMKHWA0M type=write size=2154426 2024-09-14T11:01:50.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.949+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=DFAQEDN1Y9B3 type=del size=225356 2024-09-14T11:01:50.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.950+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=37H2KSCZPF0I type=write size=219183 2024-09-14T11:01:50.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.951+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=FACBHUYNFGWC type=del size=105764 2024-09-14T11:01:50.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.953+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=E60DFG1JRQDJ type=write size=334989 2024-09-14T11:01:50.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.954+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=36ZUS1584K3J type=del 2024-09-14T11:01:50.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.955+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=A85HCVZHEDLW type=del size=2848282 2024-09-14T11:01:50.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.957+0000 7fe3dd11f780 1 < canceled operation key=UYZGHGZR74HQ tag=8V6ROMYDYCDG type=write size=587589 2024-09-14T11:01:50.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.959+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~A1GHZS5Z285J.0 size=1048576 2024-09-14T11:01:50.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.960+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~A1GHZS5Z285J.1 size=959133 2024-09-14T11:01:50.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.960+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=A1GHZS5Z285J tag=CIEC3GXSWVL1 type=write size=3056285 2024-09-14T11:01:50.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.962+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=VA4TDFXQWYPZ type=del 2024-09-14T11:01:50.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.964+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~MRPYGJSSVKTL.0 size=1048576 2024-09-14T11:01:50.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.965+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~MRPYGJSSVKTL.1 size=1048576 2024-09-14T11:01:50.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.966+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~MRPYGJSSVKTL.2 size=928527 2024-09-14T11:01:50.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.966+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=MRPYGJSSVKTL tag=RAMZEK04WVYZ type=write size=4074255 2024-09-14T11:01:50.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.966+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~2D0UZ1A789VC.0 size=1048576 2024-09-14T11:01:50.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.967+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~2D0UZ1A789VC.1 size=5943 2024-09-14T11:01:50.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.970+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=2D0UZ1A789VC tag=LX1L6SJ090BP type=write size=2103095 2024-09-14T11:01:50.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.971+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=3ZN20UER293T type=del size=3622589 2024-09-14T11:01:50.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.972+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~6E92V1MO654C.0 size=278078 2024-09-14T11:01:50.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.974+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=6E92V1MO654C tag=IQ3S69YURR50 type=write size=1326654 2024-09-14T11:01:50.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.976+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=WYZUWQ9UD0L0 type=del size=664983 2024-09-14T11:01:50.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.977+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=T3K4R6N7L6BH type=del 2024-09-14T11:01:50.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.979+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~8U1ZW81CIDS4.0 size=1048576 2024-09-14T11:01:50.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.980+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~8U1ZW81CIDS4.1 size=1048576 2024-09-14T11:01:50.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.982+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~8U1ZW81CIDS4.2 size=622916 2024-09-14T11:01:50.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.982+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=8U1ZW81CIDS4 tag=77TFKMN1IB0D type=write size=3768644 2024-09-14T11:01:50.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.983+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~D4OVI4MTCHEC.0 size=752707 2024-09-14T11:01:50.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.985+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=D4OVI4MTCHEC tag=P6GSZFXHXVBW type=write size=1801283 2024-09-14T11:01:50.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.988+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~3IQCOEIQBLGV.0 size=1048576 2024-09-14T11:01:50.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.988+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~3IQCOEIQBLGV.1 size=683653 2024-09-14T11:01:50.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.988+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=3IQCOEIQBLGV tag=5NFPQXIS132R type=write size=2780805 2024-09-14T11:01:50.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.990+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~CPSQLY7H3G3G.0 size=1048576 2024-09-14T11:01:50.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.991+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~CPSQLY7H3G3G.1 size=1048576 2024-09-14T11:01:50.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.991+0000 7fe3dd11f780 1 < canceled part key=_multipart_LDILBET1CMYY.2~CPSQLY7H3G3G.2 size=218969 2024-09-14T11:01:50.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.993+0000 7fe3dd11f780 1 < canceled multipart upload key=LDILBET1CMYY upload=CPSQLY7H3G3G tag=E4UUHD575X2M type=write size=3364697 2024-09-14T11:01:50.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.995+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~QHVLYOXDGOJY.0 size=1048576 2024-09-14T11:01:50.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.996+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~QHVLYOXDGOJY.1 size=1048576 2024-09-14T11:01:50.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.997+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~QHVLYOXDGOJY.2 size=1043359 2024-09-14T11:01:50.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.997+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=QHVLYOXDGOJY tag=4PM2WTEPB5KJ type=write size=4189087 2024-09-14T11:01:50.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:50.999+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=UUFO1B0UFGOD type=del 2024-09-14T11:01:50.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.001+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FMQSNZ5186ID.0 size=1048576 2024-09-14T11:01:51.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.002+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FMQSNZ5186ID.1 size=1048576 2024-09-14T11:01:51.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.003+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FMQSNZ5186ID.2 size=721140 2024-09-14T11:01:51.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.003+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=FMQSNZ5186ID tag=THPF9MNUFWT8 type=write size=3866868 2024-09-14T11:01:51.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.005+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~8L6NCWQQNSCZ.0 size=1048576 2024-09-14T11:01:51.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.006+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~8L6NCWQQNSCZ.1 size=1048576 2024-09-14T11:01:51.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.007+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~8L6NCWQQNSCZ.2 size=648473 2024-09-14T11:01:51.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.009+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=8L6NCWQQNSCZ tag=H40BSC50VDFY type=write size=3794201 2024-09-14T11:01:51.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.010+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=JY3LKJWSHZ8D type=del size=3292111 2024-09-14T11:01:51.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.012+0000 7fe3dd11f780 1 < canceled operation key=GQEFQ1UD6QCJ tag=6B8MJX9TWOM9 type=write size=15355 2024-09-14T11:01:51.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.013+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=UDEAGO68C3T1 type=write size=1000100 2024-09-14T11:01:51.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.015+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~F8Y582TEOGJK.0 size=1048576 2024-09-14T11:01:51.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.016+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~F8Y582TEOGJK.1 size=57274 2024-09-14T11:01:51.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.018+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=F8Y582TEOGJK tag=17DYKMKHWA0M type=write size=2154426 2024-09-14T11:01:51.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.020+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~6NEP3WY92RNW.0 size=1048576 2024-09-14T11:01:51.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.021+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~6NEP3WY92RNW.1 size=1048576 2024-09-14T11:01:51.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.022+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~6NEP3WY92RNW.2 size=1016366 2024-09-14T11:01:51.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.022+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=6NEP3WY92RNW tag=AZXP2G0VXY1S type=write size=4162094 2024-09-14T11:01:51.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.023+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=DFAQEDN1Y9B3 type=del 2024-09-14T11:01:51.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.024+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=UBGTR8QWPF41 type=write size=482849 2024-09-14T11:01:51.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.026+0000 7fe3dd11f780 1 < canceled operation key=JG1RZQD4J2EB tag=37H2KSCZPF0I type=write size=219183 2024-09-14T11:01:51.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.027+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=IFB36HC9Y88Z type=del size=356304 2024-09-14T11:01:51.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.028+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=FACBHUYNFGWC type=del 2024-09-14T11:01:51.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.030+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~KJVIAUJ1FXBX.0 size=1048576 2024-09-14T11:01:51.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.031+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~KJVIAUJ1FXBX.1 size=448489 2024-09-14T11:01:51.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.031+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=KJVIAUJ1FXBX tag=IS60OBVKNBBL type=write size=2545641 2024-09-14T11:01:51.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.033+0000 7fe3dd11f780 1 < completed write operation key=0PT98N1VBWAG tag=E60DFG1JRQDJ type=write size=334989 2024-09-14T11:01:51.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.035+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QCVSVJS8E0F3.0 size=1048576 2024-09-14T11:01:51.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.036+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QCVSVJS8E0F3.1 size=1048576 2024-09-14T11:01:51.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.037+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QCVSVJS8E0F3.2 size=865756 2024-09-14T11:01:51.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.037+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=QCVSVJS8E0F3 tag=RI0BRE4ECM0J type=write size=4011484 2024-09-14T11:01:51.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.038+0000 7fe3dd11f780 1 < canceled operation key=A89YQO40BHUS tag=A85HCVZHEDLW type=del size=2848282 2024-09-14T11:01:51.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.039+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=GITX0PQYG3GZ type=del size=2028131 2024-09-14T11:01:51.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.039+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~A1GHZS5Z285J.0 size=1048576 2024-09-14T11:01:51.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.040+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~A1GHZS5Z285J.1 size=959133 2024-09-14T11:01:51.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.042+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=A1GHZS5Z285J tag=CIEC3GXSWVL1 type=write size=3056285 2024-09-14T11:01:51.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.044+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=DGI91PISVMHI type=del size=502576 2024-09-14T11:01:51.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.045+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~MRPYGJSSVKTL.0 size=1048576 2024-09-14T11:01:51.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.046+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~MRPYGJSSVKTL.1 size=1048576 2024-09-14T11:01:51.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.047+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~MRPYGJSSVKTL.2 size=928527 2024-09-14T11:01:51.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.050+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=MRPYGJSSVKTL tag=RAMZEK04WVYZ type=write size=4074255 2024-09-14T11:01:51.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.052+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~LQ7AK143JZO9.0 size=1048576 2024-09-14T11:01:51.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.053+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~LQ7AK143JZO9.1 size=1048576 2024-09-14T11:01:51.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.054+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~LQ7AK143JZO9.2 size=460606 2024-09-14T11:01:51.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.054+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=LQ7AK143JZO9 tag=EQKI195CXP36 type=write size=3606334 2024-09-14T11:01:51.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.055+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=3ZN20UER293T type=del 2024-09-14T11:01:51.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.057+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~JNQXPRDMTSCT.0 size=325406 2024-09-14T11:01:51.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.057+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=JNQXPRDMTSCT tag=7JJWQ3L17OG4 type=write size=1373982 2024-09-14T11:01:51.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.059+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=WYZUWQ9UD0L0 type=del 2024-09-14T11:01:51.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.061+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~IYJG8L91E6LL.0 size=497840 2024-09-14T11:01:51.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.061+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=IYJG8L91E6LL tag=81B6JHSX8N6T type=write size=1546416 2024-09-14T11:01:51.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.062+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~8U1ZW81CIDS4.0 size=1048576 2024-09-14T11:01:51.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.063+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~8U1ZW81CIDS4.1 size=1048576 2024-09-14T11:01:51.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.064+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~8U1ZW81CIDS4.2 size=622916 2024-09-14T11:01:51.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.066+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=8U1ZW81CIDS4 tag=77TFKMN1IB0D type=write size=3768644 2024-09-14T11:01:51.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.068+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~0616400HSB73.0 size=1048576 2024-09-14T11:01:51.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.069+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~0616400HSB73.1 size=1048576 2024-09-14T11:01:51.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.070+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~0616400HSB73.2 size=709843 2024-09-14T11:01:51.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.070+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=0616400HSB73 tag=V8VRY4K6VX0X type=write size=3855571 2024-09-14T11:01:51.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.071+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~3IQCOEIQBLGV.0 size=1048576 2024-09-14T11:01:51.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.072+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~3IQCOEIQBLGV.1 size=683653 2024-09-14T11:01:51.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.074+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=3IQCOEIQBLGV tag=5NFPQXIS132R type=write size=2780805 2024-09-14T11:01:51.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.075+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=ZYYJW6TQWJRL type=write size=333720 2024-09-14T11:01:51.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.076+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~QHVLYOXDGOJY.0 size=1048576 2024-09-14T11:01:51.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.077+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~QHVLYOXDGOJY.1 size=1048576 2024-09-14T11:01:51.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.078+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~QHVLYOXDGOJY.2 size=1043359 2024-09-14T11:01:51.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.080+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=QHVLYOXDGOJY tag=4PM2WTEPB5KJ type=write size=4189087 2024-09-14T11:01:51.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.081+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=S5JSWA5KN642 type=del size=1927667 2024-09-14T11:01:51.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.082+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~FMQSNZ5186ID.0 size=1048576 2024-09-14T11:01:51.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.082+0000 7fe3dd11f780 1 < canceled part key=_multipart_NHKCRGX10WBM.2~FMQSNZ5186ID.1 size=1048576 2024-09-14T11:01:51.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.083+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~FMQSNZ5186ID.2 size=721140 2024-09-14T11:01:51.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.085+0000 7fe3dd11f780 1 < canceled multipart upload key=NHKCRGX10WBM upload=FMQSNZ5186ID tag=THPF9MNUFWT8 type=write size=3866868 2024-09-14T11:01:51.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.086+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=J1O1AW3R29Q7 type=del size=1534359 2024-09-14T11:01:51.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.088+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=JY3LKJWSHZ8D type=del 2024-09-14T11:01:51.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.089+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=ETVNEN2MSW8M type=del size=1696719 2024-09-14T11:01:51.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.090+0000 7fe3dd11f780 1 < completed write operation key=0PT98N1VBWAG tag=UDEAGO68C3T1 type=write size=1000100 2024-09-14T11:01:51.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.091+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=7X7XD2EWGDPO type=write size=1047971 2024-09-14T11:01:51.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.093+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~6NEP3WY92RNW.0 size=1048576 2024-09-14T11:01:51.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.093+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~6NEP3WY92RNW.1 size=1048576 2024-09-14T11:01:51.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.094+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~6NEP3WY92RNW.2 size=1016366 2024-09-14T11:01:51.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.096+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=6NEP3WY92RNW tag=AZXP2G0VXY1S type=write size=4162094 2024-09-14T11:01:51.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.098+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~D85QGPDEFB85.0 size=1048576 2024-09-14T11:01:51.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.099+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~D85QGPDEFB85.1 size=126631 2024-09-14T11:01:51.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.099+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=D85QGPDEFB85 tag=H46S2BLD7Y4F type=write size=2223783 2024-09-14T11:01:51.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.101+0000 7fe3dd11f780 1 < completed write operation key=4JTN39NIB2UE tag=UBGTR8QWPF41 type=write size=482849 2024-09-14T11:01:51.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.103+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~FW8ESS2O8FLX.0 size=1048576 2024-09-14T11:01:51.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.104+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~FW8ESS2O8FLX.1 size=1048576 2024-09-14T11:01:51.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.105+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~FW8ESS2O8FLX.2 size=423329 2024-09-14T11:01:51.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.105+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=FW8ESS2O8FLX tag=KFA6SB4E8KLH type=write size=3569057 2024-09-14T11:01:51.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.106+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=IFB36HC9Y88Z type=del 2024-09-14T11:01:51.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.107+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=3G6VH9X41DKP type=del size=2480829 2024-09-14T11:01:51.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.108+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~KJVIAUJ1FXBX.0 size=1048576 2024-09-14T11:01:51.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.109+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~KJVIAUJ1FXBX.1 size=448489 2024-09-14T11:01:51.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.111+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=KJVIAUJ1FXBX tag=IS60OBVKNBBL type=write size=2545641 2024-09-14T11:01:51.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.112+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=JMDA5JFCEPRU type=del size=308612 2024-09-14T11:01:51.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.113+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QCVSVJS8E0F3.0 size=1048576 2024-09-14T11:01:51.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.114+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QCVSVJS8E0F3.1 size=1048576 2024-09-14T11:01:51.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.115+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QCVSVJS8E0F3.2 size=865756 2024-09-14T11:01:51.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.117+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=QCVSVJS8E0F3 tag=RI0BRE4ECM0J type=write size=4011484 2024-09-14T11:01:51.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.119+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TWV14TJALUZZ.0 size=1048576 2024-09-14T11:01:51.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.120+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TWV14TJALUZZ.1 size=1048576 2024-09-14T11:01:51.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.120+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TWV14TJALUZZ.2 size=823855 2024-09-14T11:01:51.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.120+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=TWV14TJALUZZ tag=CD0PMFMPMRQP type=write size=3969583 2024-09-14T11:01:51.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.121+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=GITX0PQYG3GZ type=del 2024-09-14T11:01:51.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.123+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=Z7BG850NVAZM type=write size=427075 2024-09-14T11:01:51.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.124+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=DGI91PISVMHI type=del 2024-09-14T11:01:51.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.125+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=ZQ9H9FFSC0QO type=del size=343194 2024-09-14T11:01:51.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.126+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~LQ7AK143JZO9.0 size=1048576 2024-09-14T11:01:51.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.127+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~LQ7AK143JZO9.1 size=1048576 2024-09-14T11:01:51.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.128+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~LQ7AK143JZO9.2 size=460606 2024-09-14T11:01:51.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.130+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=LQ7AK143JZO9 tag=EQKI195CXP36 type=write size=3606334 2024-09-14T11:01:51.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.131+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=XSDNVPSY3UT3 type=write size=886536 2024-09-14T11:01:51.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.132+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~JNQXPRDMTSCT.0 size=325406 2024-09-14T11:01:51.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.134+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=JNQXPRDMTSCT tag=7JJWQ3L17OG4 type=write size=1373982 2024-09-14T11:01:51.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.136+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~ZF71Y3321B0J.0 size=1048576 2024-09-14T11:01:51.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.137+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~ZF71Y3321B0J.1 size=30952 2024-09-14T11:01:51.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.137+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=ZF71Y3321B0J tag=RE4J4DKG54RX type=write size=2128104 2024-09-14T11:01:51.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.138+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~IYJG8L91E6LL.0 size=497840 2024-09-14T11:01:51.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.140+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=IYJG8L91E6LL tag=81B6JHSX8N6T type=write size=1546416 2024-09-14T11:01:51.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.142+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~ETKALQN8RI4K.0 size=1048576 2024-09-14T11:01:51.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.143+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~ETKALQN8RI4K.1 size=676891 2024-09-14T11:01:51.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.143+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=ETKALQN8RI4K tag=6UV29PAJL550 type=write size=2774043 2024-09-14T11:01:51.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.144+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~0616400HSB73.0 size=1048576 2024-09-14T11:01:51.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.145+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~0616400HSB73.1 size=1048576 2024-09-14T11:01:51.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.146+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~0616400HSB73.2 size=709843 2024-09-14T11:01:51.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.148+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=0616400HSB73 tag=V8VRY4K6VX0X type=write size=3855571 2024-09-14T11:01:51.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.150+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~I6DOYV2UGOVJ.0 size=1037929 2024-09-14T11:01:51.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.150+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=I6DOYV2UGOVJ tag=1562YXQK1MUP type=write size=2086505 2024-09-14T11:01:51.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.151+0000 7fe3dd11f780 1 < completed write operation key=4JTN39NIB2UE tag=ZYYJW6TQWJRL type=write size=333720 2024-09-14T11:01:51.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.153+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=8JZ5QTNQE849 type=del size=350371 2024-09-14T11:01:51.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.155+0000 7fe3dd11f780 1 < suggested remove operation key=3PS4LAML698X tag=S5JSWA5KN642 type=del 2024-09-14T11:01:51.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.156+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=U1W01X2NIKZJ type=del size=1801030 2024-09-14T11:01:51.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.158+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=J1O1AW3R29Q7 type=del 2024-09-14T11:01:51.156 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.159+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=Y1H0MJ0GC6N3 type=write size=47317 2024-09-14T11:01:51.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.161+0000 7fe3dd11f780 1 < suggested remove operation key=V692HUUJP2RC tag=ETVNEN2MSW8M type=del 2024-09-14T11:01:51.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.162+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=2DOKQQQ3RFH8 type=del size=1851074 2024-09-14T11:01:51.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.163+0000 7fe3dd11f780 1 < completed write operation key=MD0OU8IC5PYI tag=7X7XD2EWGDPO type=write size=1047971 2024-09-14T11:01:51.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.165+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=JCCK6QSG66MZ type=del size=3758559 2024-09-14T11:01:51.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.166+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~D85QGPDEFB85.0 size=1048576 2024-09-14T11:01:51.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.167+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~D85QGPDEFB85.1 size=126631 2024-09-14T11:01:51.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.168+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=D85QGPDEFB85 tag=H46S2BLD7Y4F type=write size=2223783 2024-09-14T11:01:51.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.170+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~CPANNOUYMHEN.0 size=313340 2024-09-14T11:01:51.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.170+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=CPANNOUYMHEN tag=1THJ699X40ZP type=write size=1361916 2024-09-14T11:01:51.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.172+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~FW8ESS2O8FLX.0 size=1048576 2024-09-14T11:01:51.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.172+0000 7fe3dd11f780 1 < canceled part key=_multipart_PHLQ77OMLI37.2~FW8ESS2O8FLX.1 size=1048576 2024-09-14T11:01:51.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.173+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~FW8ESS2O8FLX.2 size=423329 2024-09-14T11:01:51.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.174+0000 7fe3dd11f780 1 < canceled multipart upload key=PHLQ77OMLI37 upload=FW8ESS2O8FLX tag=KFA6SB4E8KLH type=write size=3569057 2024-09-14T11:01:51.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.176+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~TOYJYFPFEG7G.0 size=630908 2024-09-14T11:01:51.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.176+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=TOYJYFPFEG7G tag=Y472R018ICF1 type=write size=1679484 2024-09-14T11:01:51.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.178+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=3G6VH9X41DKP type=del 2024-09-14T11:01:51.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.179+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=G3GWVQUI564F type=del size=643108 2024-09-14T11:01:51.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.180+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=JMDA5JFCEPRU type=del 2024-09-14T11:01:51.179 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.181+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=0THB6AQ0H2X2 type=write size=711278 2024-09-14T11:01:51.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.182+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TWV14TJALUZZ.0 size=1048576 2024-09-14T11:01:51.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.183+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TWV14TJALUZZ.1 size=1048576 2024-09-14T11:01:51.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.184+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TWV14TJALUZZ.2 size=823855 2024-09-14T11:01:51.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.186+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=TWV14TJALUZZ tag=CD0PMFMPMRQP type=write size=3969583 2024-09-14T11:01:51.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.187+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=ISRIYY7TDN4B type=write size=597698 2024-09-14T11:01:51.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.188+0000 7fe3dd11f780 1 < completed write operation key=JFLEJGPFLACM tag=Z7BG850NVAZM type=write size=427075 2024-09-14T11:01:51.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.190+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~MRK78PFP37X0.0 size=669370 2024-09-14T11:01:51.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.190+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=MRK78PFP37X0 tag=2WF4HBFI7GR0 type=write size=1717946 2024-09-14T11:01:51.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.191+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=ZQ9H9FFSC0QO type=del 2024-09-14T11:01:51.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.193+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~IZ8ZNVQWIGB2.0 size=139174 2024-09-14T11:01:51.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.193+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=IZ8ZNVQWIGB2 tag=YKQQSU0STTEW type=write size=1187750 2024-09-14T11:01:51.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.194+0000 7fe3dd11f780 -1 < no bi entry to suggest for operation key=V692HUUJP2RC tag=XSDNVPSY3UT3 type=write size=886536: (2) No such file or directory 2024-09-14T11:01:51.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.196+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~ZZ4Y6PIWIYNZ.0 size=1048576 2024-09-14T11:01:51.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.197+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~ZZ4Y6PIWIYNZ.1 size=816031 2024-09-14T11:01:51.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.197+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=ZZ4Y6PIWIYNZ tag=OR9GQS9J1HO6 type=write size=2913183 2024-09-14T11:01:51.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.198+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~ZF71Y3321B0J.0 size=1048576 2024-09-14T11:01:51.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.199+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~ZF71Y3321B0J.1 size=30952 2024-09-14T11:01:51.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.201+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=ZF71Y3321B0J tag=RE4J4DKG54RX type=write size=2128104 2024-09-14T11:01:51.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.202+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=B3RH4A1GL7DA type=del size=731919 2024-09-14T11:01:51.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.203+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~ETKALQN8RI4K.0 size=1048576 2024-09-14T11:01:51.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.204+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~ETKALQN8RI4K.1 size=676891 2024-09-14T11:01:51.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.206+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=ETKALQN8RI4K tag=6UV29PAJL550 type=write size=2774043 2024-09-14T11:01:51.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.207+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=GC4BPAQYPTO7 type=write size=259423 2024-09-14T11:01:51.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.208+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~I6DOYV2UGOVJ.0 size=1037929 2024-09-14T11:01:51.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.210+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=I6DOYV2UGOVJ tag=1562YXQK1MUP type=write size=2086505 2024-09-14T11:01:51.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.212+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=3QJID28S8XZ9 type=del size=386802 2024-09-14T11:01:51.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.213+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=8JZ5QTNQE849 type=del 2024-09-14T11:01:51.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.214+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=UWZHC1VE85B3 type=del size=2685366 2024-09-14T11:01:51.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.215+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=U1W01X2NIKZJ type=del 2024-09-14T11:01:51.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.217+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QHFHUNKNWV43.0 size=1048576 2024-09-14T11:01:51.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.218+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QHFHUNKNWV43.1 size=448882 2024-09-14T11:01:51.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.218+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=QHFHUNKNWV43 tag=JU2J20PKT9LW type=write size=2546034 2024-09-14T11:01:51.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.221+0000 7fe3dd11f780 1 < suggested remove operation key=YXPZXFY8930D tag=Y1H0MJ0GC6N3 type=write 2024-09-14T11:01:51.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.222+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=1BVA252FFDD5 type=write size=127287 2024-09-14T11:01:51.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.223+0000 7fe3dd11f780 1 < canceled operation key=JSEN4QXEMVHS tag=2DOKQQQ3RFH8 type=del size=1851074 2024-09-14T11:01:51.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.225+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~70WPU0CJAXWW.0 size=1029782 2024-09-14T11:01:51.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.225+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=70WPU0CJAXWW tag=XM72QXV4SMTZ type=write size=2078358 2024-09-14T11:01:51.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.226+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=JCCK6QSG66MZ type=del 2024-09-14T11:01:51.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.228+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~V29O7O2XUPYL.0 size=933033 2024-09-14T11:01:51.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.228+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=V29O7O2XUPYL tag=CF6KSJ1VXJX7 type=write size=1981609 2024-09-14T11:01:51.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.229+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~CPANNOUYMHEN.0 size=313340 2024-09-14T11:01:51.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.231+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=CPANNOUYMHEN tag=1THJ699X40ZP type=write size=1361916 2024-09-14T11:01:51.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.232+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=ZP9ZS5EM2ACJ type=del size=369659 2024-09-14T11:01:51.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.234+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~TOYJYFPFEG7G.0 size=630908 2024-09-14T11:01:51.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.235+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=TOYJYFPFEG7G tag=Y472R018ICF1 type=write size=1679484 2024-09-14T11:01:51.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.237+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~RL5QE2HA2AYC.0 size=1048576 2024-09-14T11:01:51.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.238+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~RL5QE2HA2AYC.1 size=1048576 2024-09-14T11:01:51.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.239+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~RL5QE2HA2AYC.2 size=685193 2024-09-14T11:01:51.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.239+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=RL5QE2HA2AYC tag=4HIEY0X3HG17 type=write size=3830921 2024-09-14T11:01:51.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.240+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=G3GWVQUI564F type=del 2024-09-14T11:01:51.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.242+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=CD2T0QHCWR0P type=write size=814958 2024-09-14T11:01:51.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.244+0000 7fe3dd11f780 1 < suggested remove operation key=UYZGHGZR74HQ tag=0THB6AQ0H2X2 type=write 2024-09-14T11:01:51.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.246+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~UAOG7P383OOU.0 size=71048 2024-09-14T11:01:51.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.246+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=UAOG7P383OOU tag=E3ZXE7RBFDUP type=write size=1119624 2024-09-14T11:01:51.245 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.247+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=ISRIYY7TDN4B type=write size=597698 2024-09-14T11:01:51.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.249+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~X0KVQAKN8OU7.0 size=966180 2024-09-14T11:01:51.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.249+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=X0KVQAKN8OU7 tag=G690AUP83B4Y type=write size=2014756 2024-09-14T11:01:51.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.250+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~MRK78PFP37X0.0 size=669370 2024-09-14T11:01:51.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.252+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=MRK78PFP37X0 tag=2WF4HBFI7GR0 type=write size=1717946 2024-09-14T11:01:51.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.254+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=95H7FQVVCES9 type=del size=507892 2024-09-14T11:01:51.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.255+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~IZ8ZNVQWIGB2.0 size=139174 2024-09-14T11:01:51.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.257+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=IZ8ZNVQWIGB2 tag=YKQQSU0STTEW type=write size=1187750 2024-09-14T11:01:51.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.259+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=PQ6LTNPSU4NG type=write size=11257 2024-09-14T11:01:51.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.259+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~ZZ4Y6PIWIYNZ.0 size=1048576 2024-09-14T11:01:51.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.260+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~ZZ4Y6PIWIYNZ.1 size=816031 2024-09-14T11:01:51.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.263+0000 7fe3dd11f780 1 < canceled multipart upload key=LL9VJXEU13IK upload=ZZ4Y6PIWIYNZ tag=OR9GQS9J1HO6 type=write size=2913183 2024-09-14T11:01:51.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.264+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=8TB5B66M1991 type=del size=67782 2024-09-14T11:01:51.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.266+0000 7fe3dd11f780 1 < canceled operation key=KXL3E0PJBNBA tag=B3RH4A1GL7DA type=del size=731919 2024-09-14T11:01:51.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.267+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=26AQI2E8CZ6D type=del size=350272 2024-09-14T11:01:51.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.268+0000 7fe3dd11f780 1 < completed write operation key=LL9VJXEU13IK tag=GC4BPAQYPTO7 type=write size=259423 2024-09-14T11:01:51.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.270+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~DV3JC4M1KUSB.0 size=1048576 2024-09-14T11:01:51.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.271+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~DV3JC4M1KUSB.1 size=948616 2024-09-14T11:01:51.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.271+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=DV3JC4M1KUSB tag=GL1D4Y62W6CB type=write size=3045768 2024-09-14T11:01:51.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.273+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=3QJID28S8XZ9 type=del 2024-09-14T11:01:51.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.275+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~Y4U4CWSZK04Q.0 size=854488 2024-09-14T11:01:51.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.275+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=Y4U4CWSZK04Q tag=0EZ2A1XI3LI5 type=write size=1903064 2024-09-14T11:01:51.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.276+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=UWZHC1VE85B3 type=del 2024-09-14T11:01:51.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.279+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~MRMOQJ7ICPVT.0 size=1048576 2024-09-14T11:01:51.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.279+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~MRMOQJ7ICPVT.1 size=375717 2024-09-14T11:01:51.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.279+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=MRMOQJ7ICPVT tag=BB4FWBJ2V0KY type=write size=2472869 2024-09-14T11:01:51.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.281+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QHFHUNKNWV43.0 size=1048576 2024-09-14T11:01:51.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.282+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QHFHUNKNWV43.1 size=448882 2024-09-14T11:01:51.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.284+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=QHFHUNKNWV43 tag=JU2J20PKT9LW type=write size=2546034 2024-09-14T11:01:51.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.285+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=74KP1QGNDY6G type=del size=2127612 2024-09-14T11:01:51.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.286+0000 7fe3dd11f780 1 < completed write operation key=GQEFQ1UD6QCJ tag=1BVA252FFDD5 type=write size=127287 2024-09-14T11:01:51.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.288+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=A9H53PACW0O6 type=write size=166989 2024-09-14T11:01:51.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.289+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~70WPU0CJAXWW.0 size=1029782 2024-09-14T11:01:51.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.291+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=70WPU0CJAXWW tag=XM72QXV4SMTZ type=write size=2078358 2024-09-14T11:01:51.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.293+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=5L4PO5EIHJHX type=del size=2032584 2024-09-14T11:01:51.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.294+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~V29O7O2XUPYL.0 size=933033 2024-09-14T11:01:51.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.296+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=V29O7O2XUPYL tag=CF6KSJ1VXJX7 type=write size=1981609 2024-09-14T11:01:51.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.297+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=I464QZRTAUFQ type=del size=1561780 2024-09-14T11:01:51.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.298+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=ZP9ZS5EM2ACJ type=del 2024-09-14T11:01:51.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.300+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=WXHHKTB7BUCB type=del size=786868 2024-09-14T11:01:51.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.301+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~RL5QE2HA2AYC.0 size=1048576 2024-09-14T11:01:51.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.302+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~RL5QE2HA2AYC.1 size=1048576 2024-09-14T11:01:51.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.303+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~RL5QE2HA2AYC.2 size=685193 2024-09-14T11:01:51.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.305+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=RL5QE2HA2AYC tag=4HIEY0X3HG17 type=write size=3830921 2024-09-14T11:01:51.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.307+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~M2QG8GNCP31X.0 size=1048576 2024-09-14T11:01:51.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.308+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~M2QG8GNCP31X.1 size=1048576 2024-09-14T11:01:51.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.308+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~M2QG8GNCP31X.2 size=212109 2024-09-14T11:01:51.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.308+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=M2QG8GNCP31X tag=I60A8VFT0J3G type=write size=3357837 2024-09-14T11:01:51.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.310+0000 7fe3dd11f780 1 < completed write operation key=ZI5SFHGWCHJA tag=CD2T0QHCWR0P type=write size=814958 2024-09-14T11:01:51.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.312+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~XRW550OTD9W2.0 size=988194 2024-09-14T11:01:51.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.312+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=XRW550OTD9W2 tag=ANQ375EDWUVV type=write size=2036770 2024-09-14T11:01:51.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.313+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~UAOG7P383OOU.0 size=71048 2024-09-14T11:01:51.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.316+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=UAOG7P383OOU tag=E3ZXE7RBFDUP type=write size=1119624 2024-09-14T11:01:51.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.317+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=EWX14N9HSS4U type=del size=271649 2024-09-14T11:01:51.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.318+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~X0KVQAKN8OU7.0 size=966180 2024-09-14T11:01:51.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.321+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=X0KVQAKN8OU7 tag=G690AUP83B4Y type=write size=2014756 2024-09-14T11:01:51.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.322+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=RXKVU59NKFJZ type=write size=666705 2024-09-14T11:01:51.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.323+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=95H7FQVVCES9 type=del 2024-09-14T11:01:51.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.324+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=LYOOZ8LSBYED type=write size=518808 2024-09-14T11:01:51.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.326+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=PQ6LTNPSU4NG type=write size=11257 2024-09-14T11:01:51.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.327+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=9AYUF8KNDUUU type=del size=1335693 2024-09-14T11:01:51.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.329+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=8TB5B66M1991 type=del 2024-09-14T11:01:51.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.331+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~NUDVQJNXZMAS.0 size=1048576 2024-09-14T11:01:51.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.332+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~NUDVQJNXZMAS.1 size=1048576 2024-09-14T11:01:51.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.333+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~NUDVQJNXZMAS.2 size=906310 2024-09-14T11:01:51.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.333+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=NUDVQJNXZMAS tag=KOFLSG68YD2S type=write size=4052038 2024-09-14T11:01:51.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.335+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=26AQI2E8CZ6D type=del 2024-09-14T11:01:51.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.336+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=XIN571RANS7Y type=del size=797328 2024-09-14T11:01:51.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.338+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~DV3JC4M1KUSB.0 size=1048576 2024-09-14T11:01:51.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.339+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~DV3JC4M1KUSB.1 size=948616 2024-09-14T11:01:51.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.340+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=DV3JC4M1KUSB tag=GL1D4Y62W6CB type=write size=3045768 2024-09-14T11:01:51.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.343+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~O8DTHV6XJSAY.0 size=1048576 2024-09-14T11:01:51.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.343+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~O8DTHV6XJSAY.1 size=1048576 2024-09-14T11:01:51.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.344+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~O8DTHV6XJSAY.2 size=188986 2024-09-14T11:01:51.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.344+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=O8DTHV6XJSAY tag=TV061XK4BMVT type=write size=3334714 2024-09-14T11:01:51.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.346+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~Y4U4CWSZK04Q.0 size=854488 2024-09-14T11:01:51.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.347+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=Y4U4CWSZK04Q tag=0EZ2A1XI3LI5 type=write size=1903064 2024-09-14T11:01:51.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.350+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~YR7QEDXETK22.0 size=1048576 2024-09-14T11:01:51.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.351+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~YR7QEDXETK22.1 size=1048576 2024-09-14T11:01:51.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.351+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~YR7QEDXETK22.2 size=867757 2024-09-14T11:01:51.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.351+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=YR7QEDXETK22 tag=R3DT17UF23S1 type=write size=4013485 2024-09-14T11:01:51.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.352+0000 7fe3dd11f780 1 < canceled part key=_multipart_IOAG4ZE1I58Z.2~MRMOQJ7ICPVT.0 size=1048576 2024-09-14T11:01:51.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.353+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~MRMOQJ7ICPVT.1 size=375717 2024-09-14T11:01:51.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.355+0000 7fe3dd11f780 1 < canceled multipart upload key=IOAG4ZE1I58Z upload=MRMOQJ7ICPVT tag=BB4FWBJ2V0KY type=write size=2472869 2024-09-14T11:01:51.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.356+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=2XYN0O6J945K type=del size=943286 2024-09-14T11:01:51.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.357+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=74KP1QGNDY6G type=del 2024-09-14T11:01:51.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.359+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~SZB2HWQPTA9M.0 size=1048576 2024-09-14T11:01:51.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.360+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~SZB2HWQPTA9M.1 size=1048576 2024-09-14T11:01:51.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.361+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~SZB2HWQPTA9M.2 size=643229 2024-09-14T11:01:51.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.361+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=SZB2HWQPTA9M tag=A3I5STJ0RTD7 type=write size=3788957 2024-09-14T11:01:51.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.362+0000 7fe3dd11f780 1 < canceled operation key=GQEFQ1UD6QCJ tag=A9H53PACW0O6 type=write size=166989 2024-09-14T11:01:51.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.364+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~QM30YLBP061T.0 size=1037485 2024-09-14T11:01:51.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.364+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=QM30YLBP061T tag=MKW114YVAKRW type=write size=2086061 2024-09-14T11:01:51.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.365+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=5L4PO5EIHJHX type=del 2024-09-14T11:01:51.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.367+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=WIIP3FVD5MEE type=del size=3857313 2024-09-14T11:01:51.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.368+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=I464QZRTAUFQ type=del 2024-09-14T11:01:51.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.370+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~EO3F58TB361I.0 size=1048576 2024-09-14T11:01:51.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.371+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~EO3F58TB361I.1 size=1048576 2024-09-14T11:01:51.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.372+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~EO3F58TB361I.2 size=750835 2024-09-14T11:01:51.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.372+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=EO3F58TB361I tag=S3AVFCWN2DKK type=write size=3896563 2024-09-14T11:01:51.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.373+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=WXHHKTB7BUCB type=del 2024-09-14T11:01:51.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.375+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=TKB3SYFH8NXI type=del size=1955811 2024-09-14T11:01:51.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.377+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~M2QG8GNCP31X.0 size=1048576 2024-09-14T11:01:51.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.378+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~M2QG8GNCP31X.1 size=1048576 2024-09-14T11:01:51.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.379+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~M2QG8GNCP31X.2 size=212109 2024-09-14T11:01:51.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.381+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=M2QG8GNCP31X tag=I60A8VFT0J3G type=write size=3357837 2024-09-14T11:01:51.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.382+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=HB1HHCMX2VH7 type=del size=890323 2024-09-14T11:01:51.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.383+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~XRW550OTD9W2.0 size=988194 2024-09-14T11:01:51.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.385+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=XRW550OTD9W2 tag=ANQ375EDWUVV type=write size=2036770 2024-09-14T11:01:51.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.386+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=FUJGLIMG2KZ0 type=write size=3039 2024-09-14T11:01:51.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.389+0000 7fe3dd11f780 1 < suggested update operation key=OK5L92EKOOMW tag=EWX14N9HSS4U type=del size=271649 2024-09-14T11:01:51.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.391+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~4GW1V50A4IVD.0 size=1048576 2024-09-14T11:01:51.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.392+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~4GW1V50A4IVD.1 size=1000559 2024-09-14T11:01:51.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.392+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=4GW1V50A4IVD tag=HUUGH243ENI7 type=write size=3097711 2024-09-14T11:01:51.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.393+0000 7fe3dd11f780 1 < completed write operation key=3PS4LAML698X tag=RXKVU59NKFJZ type=write size=666705 2024-09-14T11:01:51.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.394+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=I9LXRSFHKJEZ type=del size=1086601 2024-09-14T11:01:51.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.396+0000 7fe3dd11f780 1 < completed write operation key=LL9VJXEU13IK tag=LYOOZ8LSBYED type=write size=518808 2024-09-14T11:01:51.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.397+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=T6QU0ZGG6UDA type=del size=2120636 2024-09-14T11:01:51.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.398+0000 7fe3dd11f780 -1 < failed to complete operation key=NHKCRGX10WBM tag=9AYUF8KNDUUU type=del size=1335693: (22) Invalid argument 2024-09-14T11:01:51.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.399+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=ZYE5OMZFXF5Z type=del size=3743276 2024-09-14T11:01:51.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.401+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~NUDVQJNXZMAS.0 size=1048576 2024-09-14T11:01:51.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.402+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~NUDVQJNXZMAS.1 size=1048576 2024-09-14T11:01:51.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.402+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~NUDVQJNXZMAS.2 size=906310 2024-09-14T11:01:51.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.405+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=NUDVQJNXZMAS tag=KOFLSG68YD2S type=write size=4052038 2024-09-14T11:01:51.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.407+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~SZ3CV22RK2SV.0 size=245713 2024-09-14T11:01:51.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.407+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=SZ3CV22RK2SV tag=I5TLZSK231PF type=write size=1294289 2024-09-14T11:01:51.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.409+0000 7fe3dd11f780 1 < suggested remove operation key=4JTN39NIB2UE tag=XIN571RANS7Y type=del 2024-09-14T11:01:51.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.410+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=IU9BT4B7W4AA type=del size=1076711 2024-09-14T11:01:51.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.411+0000 7fe3dd11f780 1 < canceled part key=_multipart_3PS4LAML698X.2~O8DTHV6XJSAY.0 size=1048576 2024-09-14T11:01:51.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.411+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~O8DTHV6XJSAY.1 size=1048576 2024-09-14T11:01:51.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.412+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~O8DTHV6XJSAY.2 size=188986 2024-09-14T11:01:51.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.414+0000 7fe3dd11f780 1 < canceled multipart upload key=3PS4LAML698X upload=O8DTHV6XJSAY tag=TV061XK4BMVT type=write size=3334714 2024-09-14T11:01:51.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.417+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~EEYNMKU2HJC3.0 size=1048576 2024-09-14T11:01:51.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.418+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~EEYNMKU2HJC3.1 size=671868 2024-09-14T11:01:51.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.418+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=EEYNMKU2HJC3 tag=4MJEVOQ9AMTV type=write size=2769020 2024-09-14T11:01:51.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.418+0000 7fe3dd11f780 1 < canceled part key=_multipart_3PS4LAML698X.2~YR7QEDXETK22.0 size=1048576 2024-09-14T11:01:51.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.419+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~YR7QEDXETK22.1 size=1048576 2024-09-14T11:01:51.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.420+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~YR7QEDXETK22.2 size=867757 2024-09-14T11:01:51.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.422+0000 7fe3dd11f780 1 < canceled multipart upload key=3PS4LAML698X upload=YR7QEDXETK22 tag=R3DT17UF23S1 type=write size=4013485 2024-09-14T11:01:51.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.424+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~J5A0KH8TJV2R.0 size=503273 2024-09-14T11:01:51.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.424+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=J5A0KH8TJV2R tag=OOYY33H3RCN5 type=write size=1551849 2024-09-14T11:01:51.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.427+0000 7fe3dd11f780 1 < suggested remove operation key=MD0OU8IC5PYI tag=2XYN0O6J945K type=del 2024-09-14T11:01:51.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.429+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~E0UZN1E0HITJ.0 size=1048576 2024-09-14T11:01:51.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.430+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~E0UZN1E0HITJ.1 size=1048576 2024-09-14T11:01:51.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.431+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~E0UZN1E0HITJ.2 size=847507 2024-09-14T11:01:51.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.431+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=E0UZN1E0HITJ tag=H2V02LB3QOAA type=write size=3993235 2024-09-14T11:01:51.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.431+0000 7fe3dd11f780 1 < canceled part key=_multipart_22TI1VCDTK5P.2~SZB2HWQPTA9M.0 size=1048576 2024-09-14T11:01:51.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.432+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~SZB2HWQPTA9M.1 size=1048576 2024-09-14T11:01:51.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.433+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~SZB2HWQPTA9M.2 size=643229 2024-09-14T11:01:51.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.435+0000 7fe3dd11f780 1 < canceled multipart upload key=22TI1VCDTK5P upload=SZB2HWQPTA9M tag=A3I5STJ0RTD7 type=write size=3788957 2024-09-14T11:01:51.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.437+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~JHKR5Z6MCJ9U.0 size=1048576 2024-09-14T11:01:51.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.438+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~JHKR5Z6MCJ9U.1 size=992599 2024-09-14T11:01:51.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.438+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=JHKR5Z6MCJ9U tag=XLENDIFY8KYK type=write size=3089751 2024-09-14T11:01:51.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.440+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~QM30YLBP061T.0 size=1037485 2024-09-14T11:01:51.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.442+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=QM30YLBP061T tag=MKW114YVAKRW type=write size=2086061 2024-09-14T11:01:51.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.444+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=CLKJXI7BPA4I type=del size=3938864 2024-09-14T11:01:51.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.445+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=WIIP3FVD5MEE type=del 2024-09-14T11:01:51.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.446+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=BG4F1H9PNM05 type=write size=856360 2024-09-14T11:01:51.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.448+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~EO3F58TB361I.0 size=1048576 2024-09-14T11:01:51.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.448+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~EO3F58TB361I.1 size=1048576 2024-09-14T11:01:51.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.449+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~EO3F58TB361I.2 size=750835 2024-09-14T11:01:51.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.451+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=EO3F58TB361I tag=S3AVFCWN2DKK type=write size=3896563 2024-09-14T11:01:51.451 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.454+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~EJZYYJT3IN6G.0 size=1048576 2024-09-14T11:01:51.452 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.455+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~EJZYYJT3IN6G.1 size=1048576 2024-09-14T11:01:51.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.456+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~EJZYYJT3IN6G.2 size=825423 2024-09-14T11:01:51.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.456+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=EJZYYJT3IN6G tag=X3YQ8Y38PRYS type=write size=3971151 2024-09-14T11:01:51.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.457+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=TKB3SYFH8NXI type=del 2024-09-14T11:01:51.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.458+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=S5NO62Z0AYKB type=write size=440953 2024-09-14T11:01:51.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.459+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=HB1HHCMX2VH7 type=del 2024-09-14T11:01:51.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.461+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=LIIYX6N35ZP6 type=del size=1503154 2024-09-14T11:01:51.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.462+0000 7fe3dd11f780 1 < completed write operation key=LDILBET1CMYY tag=FUJGLIMG2KZ0 type=write size=3039 2024-09-14T11:01:51.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.463+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=KKJ7COR47IXZ type=del size=512890 2024-09-14T11:01:51.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.464+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~4GW1V50A4IVD.0 size=1048576 2024-09-14T11:01:51.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.466+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~4GW1V50A4IVD.1 size=1000559 2024-09-14T11:01:51.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.468+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=4GW1V50A4IVD tag=HUUGH243ENI7 type=write size=3097711 2024-09-14T11:01:51.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.469+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=8UOEMYIUF9IP type=del size=3550065 2024-09-14T11:01:51.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.470+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=I9LXRSFHKJEZ type=del 2024-09-14T11:01:51.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.472+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=1MYBGMIIVSBK type=del size=1672339 2024-09-14T11:01:51.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.474+0000 7fe3dd11f780 1 < suggested update operation key=3PS4LAML698X tag=T6QU0ZGG6UDA type=del size=2120636 2024-09-14T11:01:51.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.476+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=2F4XKULK9ZEV type=del size=1178440 2024-09-14T11:01:51.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.477+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=ZYE5OMZFXF5Z type=del 2024-09-14T11:01:51.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.479+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=O5AX0IKXTS85 type=del size=692989 2024-09-14T11:01:51.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.480+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~SZ3CV22RK2SV.0 size=245713 2024-09-14T11:01:51.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.482+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=SZ3CV22RK2SV tag=I5TLZSK231PF type=write size=1294289 2024-09-14T11:01:51.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.483+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=0F9VKHMQMHUW type=del size=2493491 2024-09-14T11:01:51.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.486+0000 7fe3dd11f780 1 < suggested update operation key=JG1RZQD4J2EB tag=IU9BT4B7W4AA type=del size=1076711 2024-09-14T11:01:51.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.488+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~YOKL5ODF7KET.0 size=489393 2024-09-14T11:01:51.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.488+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=YOKL5ODF7KET tag=YA01QQ4Q57Y5 type=write size=1537969 2024-09-14T11:01:51.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.489+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~EEYNMKU2HJC3.0 size=1048576 2024-09-14T11:01:51.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.490+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~EEYNMKU2HJC3.1 size=671868 2024-09-14T11:01:51.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.493+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=EEYNMKU2HJC3 tag=4MJEVOQ9AMTV type=write size=2769020 2024-09-14T11:01:51.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.495+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~YID7M9Q5LVTG.0 size=1048576 2024-09-14T11:01:51.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.496+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~YID7M9Q5LVTG.1 size=1048576 2024-09-14T11:01:51.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.497+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~YID7M9Q5LVTG.2 size=426263 2024-09-14T11:01:51.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.497+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=YID7M9Q5LVTG tag=K2ZATLSTU52U type=write size=3571991 2024-09-14T11:01:51.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.498+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~J5A0KH8TJV2R.0 size=503273 2024-09-14T11:01:51.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.500+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=J5A0KH8TJV2R tag=OOYY33H3RCN5 type=write size=1551849 2024-09-14T11:01:51.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.501+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=U9SE01DW13ZK type=del size=76878 2024-09-14T11:01:51.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.503+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~E0UZN1E0HITJ.0 size=1048576 2024-09-14T11:01:51.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.504+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~E0UZN1E0HITJ.1 size=1048576 2024-09-14T11:01:51.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.505+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~E0UZN1E0HITJ.2 size=847507 2024-09-14T11:01:51.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.507+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=E0UZN1E0HITJ tag=H2V02LB3QOAA type=write size=3993235 2024-09-14T11:01:51.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.508+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=R61GTJSS5GY6 type=del size=247944 2024-09-14T11:01:51.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.509+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~JHKR5Z6MCJ9U.0 size=1048576 2024-09-14T11:01:51.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.510+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~JHKR5Z6MCJ9U.1 size=992599 2024-09-14T11:01:51.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.512+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=JHKR5Z6MCJ9U tag=XLENDIFY8KYK type=write size=3089751 2024-09-14T11:01:51.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.513+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=9OKCD3OHL2MB type=write size=395055 2024-09-14T11:01:51.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.514+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=CLKJXI7BPA4I type=del 2024-09-14T11:01:51.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.516+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Y7PK6WAK619Z.0 size=1048576 2024-09-14T11:01:51.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.517+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Y7PK6WAK619Z.1 size=1048576 2024-09-14T11:01:51.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.518+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Y7PK6WAK619Z.2 size=953143 2024-09-14T11:01:51.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.518+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=Y7PK6WAK619Z tag=TIXVWM1GJ5TI type=write size=4098871 2024-09-14T11:01:51.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.520+0000 7fe3dd11f780 1 < completed write operation key=YMGE9GKLSPE6 tag=BG4F1H9PNM05 type=write size=856360 2024-09-14T11:01:51.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.522+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~ANUX6FXW8K1R.0 size=1048576 2024-09-14T11:01:51.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.523+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~ANUX6FXW8K1R.1 size=1048576 2024-09-14T11:01:51.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.524+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~ANUX6FXW8K1R.2 size=593724 2024-09-14T11:01:51.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.524+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=ANUX6FXW8K1R tag=5A4AYDA21GYE type=write size=3739452 2024-09-14T11:01:51.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.524+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~EJZYYJT3IN6G.0 size=1048576 2024-09-14T11:01:51.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.525+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~EJZYYJT3IN6G.1 size=1048576 2024-09-14T11:01:51.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.525+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~EJZYYJT3IN6G.2 size=825423 2024-09-14T11:01:51.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.527+0000 7fe3dd11f780 1 < canceled multipart upload key=LL9VJXEU13IK upload=EJZYYJT3IN6G tag=X3YQ8Y38PRYS type=write size=3971151 2024-09-14T11:01:51.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.528+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=JQRV6GWX1FF6 type=write size=219712 2024-09-14T11:01:51.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.529+0000 7fe3dd11f780 1 < completed write operation key=IOAG4ZE1I58Z tag=S5NO62Z0AYKB type=write size=440953 2024-09-14T11:01:51.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.531+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~SD5100YI7SYZ.0 size=457657 2024-09-14T11:01:51.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.531+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=SD5100YI7SYZ tag=CDLF522VT9PX type=write size=1506233 2024-09-14T11:01:51.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.532+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=LIIYX6N35ZP6 type=del 2024-09-14T11:01:51.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.534+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=S434LCRG3SUT type=del size=28237 2024-09-14T11:01:51.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.535+0000 7fe3dd11f780 -1 < failed to complete operation key=3PS4LAML698X tag=KKJ7COR47IXZ type=del size=512890: (22) Invalid argument 2024-09-14T11:01:51.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.536+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=54UYMF8FBPIZ type=write size=292426 2024-09-14T11:01:51.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.537+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=8UOEMYIUF9IP type=del 2024-09-14T11:01:51.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.540+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~WIBIZ070ICHA.0 size=95668 2024-09-14T11:01:51.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.540+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=WIBIZ070ICHA tag=1IL3KGJYQU49 type=write size=1144244 2024-09-14T11:01:51.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.542+0000 7fe3dd11f780 1 < suggested update operation key=LFKLJAJWQ2J6 tag=1MYBGMIIVSBK type=del size=1672339 2024-09-14T11:01:51.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.545+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~7WDRJ3XTOUPQ.0 size=1048576 2024-09-14T11:01:51.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.546+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~7WDRJ3XTOUPQ.1 size=1048576 2024-09-14T11:01:51.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.546+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~7WDRJ3XTOUPQ.2 size=332394 2024-09-14T11:01:51.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.546+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=7WDRJ3XTOUPQ tag=HSW50DUMDMHU type=write size=3478122 2024-09-14T11:01:51.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.547+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=2F4XKULK9ZEV type=del 2024-09-14T11:01:51.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.550+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~4XMDGR2DS7X4.0 size=1048576 2024-09-14T11:01:51.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.551+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~4XMDGR2DS7X4.1 size=1048576 2024-09-14T11:01:51.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.552+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~4XMDGR2DS7X4.2 size=537976 2024-09-14T11:01:51.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.552+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=4XMDGR2DS7X4 tag=TJRMA4I6XUGL type=write size=3683704 2024-09-14T11:01:51.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.554+0000 7fe3dd11f780 1 < suggested update operation key=NHKCRGX10WBM tag=O5AX0IKXTS85 type=del size=692989 2024-09-14T11:01:51.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.555+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=XGJOEFM01QT6 type=del size=3328422 2024-09-14T11:01:51.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.558+0000 7fe3dd11f780 1 < suggested remove operation key=ZI5SFHGWCHJA tag=0F9VKHMQMHUW type=del 2024-09-14T11:01:51.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.560+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~6ULYNXGR0PZJ.0 size=1048576 2024-09-14T11:01:51.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.561+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~6ULYNXGR0PZJ.1 size=1048576 2024-09-14T11:01:51.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.562+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~6ULYNXGR0PZJ.2 size=325706 2024-09-14T11:01:51.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.562+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=6ULYNXGR0PZJ tag=32GHL7QUXG13 type=write size=3471434 2024-09-14T11:01:51.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.564+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~YOKL5ODF7KET.0 size=489393 2024-09-14T11:01:51.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.566+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=YOKL5ODF7KET tag=YA01QQ4Q57Y5 type=write size=1537969 2024-09-14T11:01:51.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.567+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=079MT58S8DNB type=write size=246983 2024-09-14T11:01:51.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.568+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~YID7M9Q5LVTG.0 size=1048576 2024-09-14T11:01:51.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.568+0000 7fe3dd11f780 1 < canceled part key=_multipart_LFKLJAJWQ2J6.2~YID7M9Q5LVTG.1 size=1048576 2024-09-14T11:01:51.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.569+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~YID7M9Q5LVTG.2 size=426263 2024-09-14T11:01:51.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.571+0000 7fe3dd11f780 1 < canceled multipart upload key=LFKLJAJWQ2J6 upload=YID7M9Q5LVTG tag=K2ZATLSTU52U type=write size=3571991 2024-09-14T11:01:51.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.572+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=MEKQPVOJB8FT type=write size=517142 2024-09-14T11:01:51.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.574+0000 7fe3dd11f780 1 < suggested update operation key=6PJ03TAYRUT8 tag=U9SE01DW13ZK type=del size=76878 2024-09-14T11:01:51.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.576+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=AEH2B1TENO6K type=del size=611048 2024-09-14T11:01:51.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.577+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=R61GTJSS5GY6 type=del 2024-09-14T11:01:51.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.579+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~40OKDTUGOSMK.0 size=1048576 2024-09-14T11:01:51.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.580+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~40OKDTUGOSMK.1 size=996551 2024-09-14T11:01:51.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.580+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=40OKDTUGOSMK tag=COH8KI1F0W7W type=write size=3093703 2024-09-14T11:01:51.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.581+0000 7fe3dd11f780 1 < completed write operation key=US8KP3YL88TG tag=9OKCD3OHL2MB type=write size=395055 2024-09-14T11:01:51.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.582+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=3ERBB33AHN4G type=del size=848400 2024-09-14T11:01:51.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.583+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Y7PK6WAK619Z.0 size=1048576 2024-09-14T11:01:51.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.584+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Y7PK6WAK619Z.1 size=1048576 2024-09-14T11:01:51.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.585+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Y7PK6WAK619Z.2 size=953143 2024-09-14T11:01:51.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.587+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=Y7PK6WAK619Z tag=TIXVWM1GJ5TI type=write size=4098871 2024-09-14T11:01:51.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.589+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~FOCD7HAVYRD3.0 size=727400 2024-09-14T11:01:51.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.590+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=FOCD7HAVYRD3 tag=3V2HUW5K5CNZ type=write size=1775976 2024-09-14T11:01:51.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.591+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~ANUX6FXW8K1R.0 size=1048576 2024-09-14T11:01:51.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.592+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~ANUX6FXW8K1R.1 size=1048576 2024-09-14T11:01:51.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.592+0000 7fe3dd11f780 1 < canceled part key=_multipart_JG1RZQD4J2EB.2~ANUX6FXW8K1R.2 size=593724 2024-09-14T11:01:51.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.594+0000 7fe3dd11f780 1 < canceled multipart upload key=JG1RZQD4J2EB upload=ANUX6FXW8K1R tag=5A4AYDA21GYE type=write size=3739452 2024-09-14T11:01:51.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.595+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=BKH1R86LYFH0 type=del size=2850194 2024-09-14T11:01:51.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.596+0000 7fe3dd11f780 1 < completed write operation key=4JTN39NIB2UE tag=JQRV6GWX1FF6 type=write size=219712 2024-09-14T11:01:51.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.598+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~RGJR9P3HR7UX.0 size=1048576 2024-09-14T11:01:51.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.599+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~RGJR9P3HR7UX.1 size=830004 2024-09-14T11:01:51.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.599+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=RGJR9P3HR7UX tag=G3RO9D012LCE type=write size=2927156 2024-09-14T11:01:51.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.600+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~SD5100YI7SYZ.0 size=457657 2024-09-14T11:01:51.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.604+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=SD5100YI7SYZ tag=CDLF522VT9PX type=write size=1506233 2024-09-14T11:01:51.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.606+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~QHYSYXYJQWMG.0 size=1048576 2024-09-14T11:01:51.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.607+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~QHYSYXYJQWMG.1 size=524471 2024-09-14T11:01:51.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.607+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=QHYSYXYJQWMG tag=NGOP2LOCV7IX type=write size=2621623 2024-09-14T11:01:51.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.608+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=S434LCRG3SUT type=del 2024-09-14T11:01:51.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.609+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=KJGLTA4LYA90 type=write size=356872 2024-09-14T11:01:51.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.611+0000 7fe3dd11f780 1 < suggested remove operation key=ZTD98WQ6032X tag=54UYMF8FBPIZ type=write 2024-09-14T11:01:51.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.612+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=6C8PEWDEOJRX type=del size=984663 2024-09-14T11:01:51.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.614+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~WIBIZ070ICHA.0 size=95668 2024-09-14T11:01:51.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.616+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=WIBIZ070ICHA tag=1IL3KGJYQU49 type=write size=1144244 2024-09-14T11:01:51.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.618+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~2ZS6B2AD2G6W.0 size=1048576 2024-09-14T11:01:51.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.619+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~2ZS6B2AD2G6W.1 size=665831 2024-09-14T11:01:51.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.619+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=2ZS6B2AD2G6W tag=FJ6J0KYB2ED8 type=write size=2762983 2024-09-14T11:01:51.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.620+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~7WDRJ3XTOUPQ.0 size=1048576 2024-09-14T11:01:51.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.621+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~7WDRJ3XTOUPQ.1 size=1048576 2024-09-14T11:01:51.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.622+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~7WDRJ3XTOUPQ.2 size=332394 2024-09-14T11:01:51.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.624+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=7WDRJ3XTOUPQ tag=HSW50DUMDMHU type=write size=3478122 2024-09-14T11:01:51.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.626+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~2CUYF1MRTUDK.0 size=1048576 2024-09-14T11:01:51.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.627+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~2CUYF1MRTUDK.1 size=222449 2024-09-14T11:01:51.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.627+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=2CUYF1MRTUDK tag=3OW14S7V4CTY type=write size=2319601 2024-09-14T11:01:51.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.628+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~4XMDGR2DS7X4.0 size=1048576 2024-09-14T11:01:51.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.629+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~4XMDGR2DS7X4.1 size=1048576 2024-09-14T11:01:51.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.630+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~4XMDGR2DS7X4.2 size=537976 2024-09-14T11:01:51.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.632+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=4XMDGR2DS7X4 tag=TJRMA4I6XUGL type=write size=3683704 2024-09-14T11:01:51.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.633+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=PRS7ATSKYXFB type=del size=3743894 2024-09-14T11:01:51.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.635+0000 7fe3dd11f780 -1 < failed to complete operation key=6PJ03TAYRUT8 tag=XGJOEFM01QT6 type=del size=3328422: (22) Invalid argument 2024-09-14T11:01:51.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.637+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~XP9CN9ECV5I3.0 size=1048576 2024-09-14T11:01:51.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.638+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~XP9CN9ECV5I3.1 size=1048576 2024-09-14T11:01:51.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.639+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~XP9CN9ECV5I3.2 size=97460 2024-09-14T11:01:51.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.639+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=XP9CN9ECV5I3 tag=VZQJPLRN51RW type=write size=3243188 2024-09-14T11:01:51.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.640+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~6ULYNXGR0PZJ.0 size=1048576 2024-09-14T11:01:51.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.640+0000 7fe3dd11f780 1 < canceled part key=_multipart_K9BP30LHDPA1.2~6ULYNXGR0PZJ.1 size=1048576 2024-09-14T11:01:51.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.641+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~6ULYNXGR0PZJ.2 size=325706 2024-09-14T11:01:51.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.643+0000 7fe3dd11f780 1 < canceled multipart upload key=K9BP30LHDPA1 upload=6ULYNXGR0PZJ tag=32GHL7QUXG13 type=write size=3471434 2024-09-14T11:01:51.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.644+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=OB1V9GTE39OT type=del size=3755040 2024-09-14T11:01:51.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.645+0000 7fe3dd11f780 1 < completed write operation key=3PS4LAML698X tag=079MT58S8DNB type=write size=246983 2024-09-14T11:01:51.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.646+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=1VN6TMH63PLZ type=write size=719727 2024-09-14T11:01:51.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.648+0000 7fe3dd11f780 1 < completed write operation key=YMGE9GKLSPE6 tag=MEKQPVOJB8FT type=write size=517142 2024-09-14T11:01:51.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.649+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=RR0LE6UAJMSX type=write size=702105 2024-09-14T11:01:51.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.650+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=AEH2B1TENO6K type=del 2024-09-14T11:01:51.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.651+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=FKFB4BRC9NXK type=del size=1170475 2024-09-14T11:01:51.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.651+0000 7fe3dd11f780 1 < canceled part key=_multipart_V692HUUJP2RC.2~40OKDTUGOSMK.0 size=1048576 2024-09-14T11:01:51.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.652+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~40OKDTUGOSMK.1 size=996551 2024-09-14T11:01:51.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.654+0000 7fe3dd11f780 1 < canceled multipart upload key=V692HUUJP2RC upload=40OKDTUGOSMK tag=COH8KI1F0W7W type=write size=3093703 2024-09-14T11:01:51.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.656+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~GGQQMQEQJ6ZL.0 size=1048576 2024-09-14T11:01:51.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.657+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~GGQQMQEQJ6ZL.1 size=1048576 2024-09-14T11:01:51.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.658+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~GGQQMQEQJ6ZL.2 size=573444 2024-09-14T11:01:51.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.658+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=GGQQMQEQJ6ZL tag=HQL4GLHN3E7W type=write size=3719172 2024-09-14T11:01:51.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.659+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=3ERBB33AHN4G type=del 2024-09-14T11:01:51.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.661+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~M233FUPJGUSW.0 size=1048576 2024-09-14T11:01:51.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.662+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~M233FUPJGUSW.1 size=314418 2024-09-14T11:01:51.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.662+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=M233FUPJGUSW tag=KUM1EPNBF61C type=write size=2411570 2024-09-14T11:01:51.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.664+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~FOCD7HAVYRD3.0 size=727400 2024-09-14T11:01:51.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.666+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=FOCD7HAVYRD3 tag=3V2HUW5K5CNZ type=write size=1775976 2024-09-14T11:01:51.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.667+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=HYKF3O71NT04 type=write size=292194 2024-09-14T11:01:51.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.668+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=BKH1R86LYFH0 type=del 2024-09-14T11:01:51.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.670+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~O3UBQSTJG3TK.0 size=1048576 2024-09-14T11:01:51.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.671+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~O3UBQSTJG3TK.1 size=1048576 2024-09-14T11:01:51.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.672+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~O3UBQSTJG3TK.2 size=1045638 2024-09-14T11:01:51.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.672+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=O3UBQSTJG3TK tag=VBXDW269Z9BH type=write size=4191366 2024-09-14T11:01:51.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.673+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~RGJR9P3HR7UX.0 size=1048576 2024-09-14T11:01:51.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.674+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~RGJR9P3HR7UX.1 size=830004 2024-09-14T11:01:51.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.676+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=RGJR9P3HR7UX tag=G3RO9D012LCE type=write size=2927156 2024-09-14T11:01:51.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.678+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~CEU2CTSBO6S4.0 size=1048576 2024-09-14T11:01:51.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.679+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~CEU2CTSBO6S4.1 size=1048576 2024-09-14T11:01:51.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.680+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~CEU2CTSBO6S4.2 size=981288 2024-09-14T11:01:51.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.680+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=CEU2CTSBO6S4 tag=2G1NV602DVZ1 type=write size=4127016 2024-09-14T11:01:51.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.681+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~QHYSYXYJQWMG.0 size=1048576 2024-09-14T11:01:51.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.682+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~QHYSYXYJQWMG.1 size=524471 2024-09-14T11:01:51.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.684+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=QHYSYXYJQWMG tag=NGOP2LOCV7IX type=write size=2621623 2024-09-14T11:01:51.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.686+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~PUDAHSIUK9I5.0 size=211046 2024-09-14T11:01:51.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.686+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=PUDAHSIUK9I5 tag=33IXCH0W81GT type=write size=1259622 2024-09-14T11:01:51.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.687+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=KJGLTA4LYA90 type=write size=356872 2024-09-14T11:01:51.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.689+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~ICGFH5C23WM1.0 size=203642 2024-09-14T11:01:51.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.689+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=ICGFH5C23WM1 tag=FXI8722WEU4Y type=write size=1252218 2024-09-14T11:01:51.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.690+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=6C8PEWDEOJRX type=del 2024-09-14T11:01:51.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.692+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~1Q99QSH5A9QM.0 size=1048576 2024-09-14T11:01:51.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.693+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~1Q99QSH5A9QM.1 size=260109 2024-09-14T11:01:51.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.693+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=1Q99QSH5A9QM tag=1RH13N270S7R type=write size=2357261 2024-09-14T11:01:51.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.694+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~2ZS6B2AD2G6W.0 size=1048576 2024-09-14T11:01:51.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.694+0000 7fe3dd11f780 1 < canceled part key=_multipart_OK5L92EKOOMW.2~2ZS6B2AD2G6W.1 size=665831 2024-09-14T11:01:51.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.696+0000 7fe3dd11f780 1 < canceled multipart upload key=OK5L92EKOOMW upload=2ZS6B2AD2G6W tag=FJ6J0KYB2ED8 type=write size=2762983 2024-09-14T11:01:51.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.697+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=S4601H23U0D2 type=del size=860659 2024-09-14T11:01:51.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.697+0000 7fe3dd11f780 1 < canceled part key=_multipart_A89YQO40BHUS.2~2CUYF1MRTUDK.0 size=1048576 2024-09-14T11:01:51.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.698+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~2CUYF1MRTUDK.1 size=222449 2024-09-14T11:01:51.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.700+0000 7fe3dd11f780 1 < canceled multipart upload key=A89YQO40BHUS upload=2CUYF1MRTUDK tag=3OW14S7V4CTY type=write size=2319601 2024-09-14T11:01:51.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.702+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~VUHDN1U4G2AV.0 size=561773 2024-09-14T11:01:51.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.702+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=VUHDN1U4G2AV tag=FRN9OGRSPSXN type=write size=1610349 2024-09-14T11:01:51.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.704+0000 7fe3dd11f780 1 < suggested remove operation key=OK5L92EKOOMW tag=PRS7ATSKYXFB type=del 2024-09-14T11:01:51.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.705+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=YGKUUJJ02D6I type=del size=721664 2024-09-14T11:01:51.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.706+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~XP9CN9ECV5I3.0 size=1048576 2024-09-14T11:01:51.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.707+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~XP9CN9ECV5I3.1 size=1048576 2024-09-14T11:01:51.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.709+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~XP9CN9ECV5I3.2 size=97460 2024-09-14T11:01:51.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.711+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=XP9CN9ECV5I3 tag=VZQJPLRN51RW type=write size=3243188 2024-09-14T11:01:51.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.713+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~F8UTHCIJ83SD.0 size=666162 2024-09-14T11:01:51.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.713+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=F8UTHCIJ83SD tag=TDX4A630RP6X type=write size=1714738 2024-09-14T11:01:51.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.714+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=OB1V9GTE39OT type=del 2024-09-14T11:01:51.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.716+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~3ZXNFI4PN99R.0 size=1048576 2024-09-14T11:01:51.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.717+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~3ZXNFI4PN99R.1 size=180612 2024-09-14T11:01:51.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.717+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=3ZXNFI4PN99R tag=XFYN5AJ79PIK type=write size=2277764 2024-09-14T11:01:51.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.718+0000 7fe3dd11f780 1 < completed write operation key=6PJ03TAYRUT8 tag=1VN6TMH63PLZ type=write size=719727 2024-09-14T11:01:51.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.719+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=IJOJQMM9BQ0S type=del size=4109792 2024-09-14T11:01:51.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.722+0000 7fe3dd11f780 1 < suggested update operation key=ZI5SFHGWCHJA tag=RR0LE6UAJMSX type=write size=702105 2024-09-14T11:01:51.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.723+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~7TQDKZHZKVKD.0 size=1048576 2024-09-14T11:01:51.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.724+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~7TQDKZHZKVKD.1 size=1048576 2024-09-14T11:01:51.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.725+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~7TQDKZHZKVKD.2 size=473378 2024-09-14T11:01:51.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.725+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=7TQDKZHZKVKD tag=S5565XSS0AC7 type=write size=3619106 2024-09-14T11:01:51.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.726+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=FKFB4BRC9NXK type=del 2024-09-14T11:01:51.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.728+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=3G5Y3GWVWKY4 type=del size=2778031 2024-09-14T11:01:51.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.729+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~GGQQMQEQJ6ZL.0 size=1048576 2024-09-14T11:01:51.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.730+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~GGQQMQEQJ6ZL.1 size=1048576 2024-09-14T11:01:51.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.731+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~GGQQMQEQJ6ZL.2 size=573444 2024-09-14T11:01:51.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.733+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=GGQQMQEQJ6ZL tag=HQL4GLHN3E7W type=write size=3719172 2024-09-14T11:01:51.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.735+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~0GK2H94H429V.0 size=1048576 2024-09-14T11:01:51.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.736+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~0GK2H94H429V.1 size=1048576 2024-09-14T11:01:51.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.737+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~0GK2H94H429V.2 size=463033 2024-09-14T11:01:51.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.737+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=0GK2H94H429V tag=2KAPUGRUGVNK type=write size=3608761 2024-09-14T11:01:51.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.738+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~M233FUPJGUSW.0 size=1048576 2024-09-14T11:01:51.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.739+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~M233FUPJGUSW.1 size=314418 2024-09-14T11:01:51.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.741+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=M233FUPJGUSW tag=KUM1EPNBF61C type=write size=2411570 2024-09-14T11:01:51.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.742+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=G488U3AHL8HL type=del size=2208251 2024-09-14T11:01:51.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.744+0000 7fe3dd11f780 1 < completed write operation key=M0DMAQ5LTDR0 tag=HYKF3O71NT04 type=write size=292194 2024-09-14T11:01:51.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.745+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=LQTLGF9BN8EA type=write size=99043 2024-09-14T11:01:51.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.745+0000 7fe3dd11f780 1 < canceled part key=_multipart_K9BP30LHDPA1.2~O3UBQSTJG3TK.0 size=1048576 2024-09-14T11:01:51.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.746+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~O3UBQSTJG3TK.1 size=1048576 2024-09-14T11:01:51.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.748+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~O3UBQSTJG3TK.2 size=1045638 2024-09-14T11:01:51.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.750+0000 7fe3dd11f780 1 < canceled multipart upload key=K9BP30LHDPA1 upload=O3UBQSTJG3TK tag=VBXDW269Z9BH type=write size=4191366 2024-09-14T11:01:51.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.752+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~ZU4C8M38JSYE.0 size=1048576 2024-09-14T11:01:51.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.753+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~ZU4C8M38JSYE.1 size=393243 2024-09-14T11:01:51.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.753+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=ZU4C8M38JSYE tag=RZLKN0C298ZH type=write size=2490395 2024-09-14T11:01:51.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.754+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~CEU2CTSBO6S4.0 size=1048576 2024-09-14T11:01:51.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.756+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~CEU2CTSBO6S4.1 size=1048576 2024-09-14T11:01:51.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.757+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~CEU2CTSBO6S4.2 size=981288 2024-09-14T11:01:51.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.759+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=CEU2CTSBO6S4 tag=2G1NV602DVZ1 type=write size=4127016 2024-09-14T11:01:51.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.760+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=LGRDCNWSD67H type=del size=3376176 2024-09-14T11:01:51.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.762+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~PUDAHSIUK9I5.0 size=211046 2024-09-14T11:01:51.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.764+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=PUDAHSIUK9I5 tag=33IXCH0W81GT type=write size=1259622 2024-09-14T11:01:51.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.766+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Z0W3CEL4JU2D.0 size=661823 2024-09-14T11:01:51.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.766+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=Z0W3CEL4JU2D tag=0WX7F6FOTMXV type=write size=1710399 2024-09-14T11:01:51.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.768+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~ICGFH5C23WM1.0 size=203642 2024-09-14T11:01:51.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.770+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=ICGFH5C23WM1 tag=FXI8722WEU4Y type=write size=1252218 2024-09-14T11:01:51.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.771+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=JZLP18NBKQEJ type=del size=3361301 2024-09-14T11:01:51.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.772+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~1Q99QSH5A9QM.0 size=1048576 2024-09-14T11:01:51.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.773+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~1Q99QSH5A9QM.1 size=260109 2024-09-14T11:01:51.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.776+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=1Q99QSH5A9QM tag=1RH13N270S7R type=write size=2357261 2024-09-14T11:01:51.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.778+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~XGD2WFW6EU67.0 size=684638 2024-09-14T11:01:51.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.778+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=XGD2WFW6EU67 tag=RRS2GM6E5N4D type=write size=1733214 2024-09-14T11:01:51.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.779+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=S4601H23U0D2 type=del 2024-09-14T11:01:51.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.780+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=S4B4NO17G1WK type=del size=1117406 2024-09-14T11:01:51.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.782+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~VUHDN1U4G2AV.0 size=561773 2024-09-14T11:01:51.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.784+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=VUHDN1U4G2AV tag=FRN9OGRSPSXN type=write size=1610349 2024-09-14T11:01:51.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.785+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=3EMPOH0XAVNA type=del size=250547 2024-09-14T11:01:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.786+0000 7fe3dd11f780 1 < canceled operation key=YXPZXFY8930D tag=YGKUUJJ02D6I type=del size=721664 2024-09-14T11:01:51.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.787+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=Y77KBAWIV2EW type=del size=2894167 2024-09-14T11:01:51.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.789+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~F8UTHCIJ83SD.0 size=666162 2024-09-14T11:01:51.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.790+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=F8UTHCIJ83SD tag=TDX4A630RP6X type=write size=1714738 2024-09-14T11:01:51.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.793+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~9GMCU9VBKDAC.0 size=1048576 2024-09-14T11:01:51.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.794+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~9GMCU9VBKDAC.1 size=1048576 2024-09-14T11:01:51.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.795+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~9GMCU9VBKDAC.2 size=815943 2024-09-14T11:01:51.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.795+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=9GMCU9VBKDAC tag=7NQY9U9UCJPC type=write size=3961671 2024-09-14T11:01:51.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.796+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~3ZXNFI4PN99R.0 size=1048576 2024-09-14T11:01:51.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.796+0000 7fe3dd11f780 1 < canceled part key=_multipart_US8KP3YL88TG.2~3ZXNFI4PN99R.1 size=180612 2024-09-14T11:01:51.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.798+0000 7fe3dd11f780 1 < canceled multipart upload key=US8KP3YL88TG upload=3ZXNFI4PN99R tag=XFYN5AJ79PIK type=write size=2277764 2024-09-14T11:01:51.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.800+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=YXCEWJRV31ZL type=del size=3230917 2024-09-14T11:01:51.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.801+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=IJOJQMM9BQ0S type=del 2024-09-14T11:01:51.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.802+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=GN1VF60EJJ5N type=del size=3330075 2024-09-14T11:01:51.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.804+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~7TQDKZHZKVKD.0 size=1048576 2024-09-14T11:01:51.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.805+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~7TQDKZHZKVKD.1 size=1048576 2024-09-14T11:01:51.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.806+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~7TQDKZHZKVKD.2 size=473378 2024-09-14T11:01:51.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.808+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=7TQDKZHZKVKD tag=S5565XSS0AC7 type=write size=3619106 2024-09-14T11:01:51.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.810+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=FM80N60XQ6G3 type=del size=4184925 2024-09-14T11:01:51.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.811+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=3G5Y3GWVWKY4 type=del 2024-09-14T11:01:51.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.814+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~BBI5PTOJUJ5R.0 size=943498 2024-09-14T11:01:51.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.814+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=BBI5PTOJUJ5R tag=I6YE8IVMS0RS type=write size=1992074 2024-09-14T11:01:51.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.815+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~0GK2H94H429V.0 size=1048576 2024-09-14T11:01:51.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.815+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~0GK2H94H429V.1 size=1048576 2024-09-14T11:01:51.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.816+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~0GK2H94H429V.2 size=463033 2024-09-14T11:01:51.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.819+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=0GK2H94H429V tag=2KAPUGRUGVNK type=write size=3608761 2024-09-14T11:01:51.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.821+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~PVWBSWG8YHDM.0 size=1048576 2024-09-14T11:01:51.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.822+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~PVWBSWG8YHDM.1 size=1048576 2024-09-14T11:01:51.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.824+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~PVWBSWG8YHDM.2 size=463053 2024-09-14T11:01:51.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.824+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=PVWBSWG8YHDM tag=M1205DT42HVH type=write size=3608781 2024-09-14T11:01:51.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.825+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=G488U3AHL8HL type=del 2024-09-14T11:01:51.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.828+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~R2I6UGN7G6PM.0 size=1004407 2024-09-14T11:01:51.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.828+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=R2I6UGN7G6PM tag=L53P2J2N2YL3 type=write size=2052983 2024-09-14T11:01:51.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.829+0000 7fe3dd11f780 1 < completed write operation key=YMGE9GKLSPE6 tag=LQTLGF9BN8EA type=write size=99043 2024-09-14T11:01:51.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.830+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=5B2Y127OKQW3 type=del size=1709121 2024-09-14T11:01:51.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.832+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~ZU4C8M38JSYE.0 size=1048576 2024-09-14T11:01:51.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.833+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~ZU4C8M38JSYE.1 size=393243 2024-09-14T11:01:51.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.835+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=ZU4C8M38JSYE tag=RZLKN0C298ZH type=write size=2490395 2024-09-14T11:01:51.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.836+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=PYW3MZYSQ8N6 type=del size=1536839 2024-09-14T11:01:51.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.838+0000 7fe3dd11f780 1 < suggested remove operation key=YXPZXFY8930D tag=LGRDCNWSD67H type=del 2024-09-14T11:01:51.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.839+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=QZI8EIBP7PQ8 type=del size=2974770 2024-09-14T11:01:51.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.841+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Z0W3CEL4JU2D.0 size=661823 2024-09-14T11:01:51.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.843+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=Z0W3CEL4JU2D tag=0WX7F6FOTMXV type=write size=1710399 2024-09-14T11:01:51.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.844+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=P290NX9ZLYT7 type=del size=3880156 2024-09-14T11:01:51.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.845+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=JZLP18NBKQEJ type=del 2024-09-14T11:01:51.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.847+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~32Q01VQYXAW2.0 size=876273 2024-09-14T11:01:51.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.847+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=32Q01VQYXAW2 tag=2L0I4V2IBTPP type=write size=1924849 2024-09-14T11:01:51.846 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.848+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~XGD2WFW6EU67.0 size=684638 2024-09-14T11:01:51.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.850+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=XGD2WFW6EU67 tag=RRS2GM6E5N4D type=write size=1733214 2024-09-14T11:01:51.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.853+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~BRINAC6LVLAM.0 size=369868 2024-09-14T11:01:51.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.853+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=BRINAC6LVLAM tag=4BOII4LA6NCP type=write size=1418444 2024-09-14T11:01:51.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.854+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=S4B4NO17G1WK type=del 2024-09-14T11:01:51.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.856+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~PYSEJ5U1O7QZ.0 size=1048576 2024-09-14T11:01:51.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.857+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~PYSEJ5U1O7QZ.1 size=1048576 2024-09-14T11:01:51.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.858+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~PYSEJ5U1O7QZ.2 size=254887 2024-09-14T11:01:51.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.858+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=PYSEJ5U1O7QZ tag=KI47RXR7A8A1 type=write size=3400615 2024-09-14T11:01:51.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.859+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=3EMPOH0XAVNA type=del 2024-09-14T11:01:51.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.860+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=A4NBQSASEK30 type=write size=819623 2024-09-14T11:01:51.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.862+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=Y77KBAWIV2EW type=del 2024-09-14T11:01:51.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.863+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=Z183ANG8VZ53 type=del size=3820417 2024-09-14T11:01:51.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.864+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~9GMCU9VBKDAC.0 size=1048576 2024-09-14T11:01:51.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.865+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~9GMCU9VBKDAC.1 size=1048576 2024-09-14T11:01:51.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.865+0000 7fe3dd11f780 1 < canceled part key=_multipart_K9BP30LHDPA1.2~9GMCU9VBKDAC.2 size=815943 2024-09-14T11:01:51.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.867+0000 7fe3dd11f780 1 < canceled multipart upload key=K9BP30LHDPA1 upload=9GMCU9VBKDAC tag=7NQY9U9UCJPC type=write size=3961671 2024-09-14T11:01:51.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.868+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=HIIURGSSRISX type=del size=1138322 2024-09-14T11:01:51.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.869+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=YXCEWJRV31ZL type=del 2024-09-14T11:01:51.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.870+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=5W15WMYNF383 type=del size=1487789 2024-09-14T11:01:51.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.872+0000 7fe3dd11f780 1 < canceled operation key=ODDNSHK5YMNO tag=GN1VF60EJJ5N type=del size=3330075 2024-09-14T11:01:51.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.874+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~XCOHKLTLUBMQ.0 size=1048576 2024-09-14T11:01:51.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.875+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~XCOHKLTLUBMQ.1 size=1048576 2024-09-14T11:01:51.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.876+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~XCOHKLTLUBMQ.2 size=212029 2024-09-14T11:01:51.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.876+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=XCOHKLTLUBMQ tag=UHU3U93Z2UWT type=write size=3357757 2024-09-14T11:01:51.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.877+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=FM80N60XQ6G3 type=del 2024-09-14T11:01:51.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.878+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=05Z31GFW82PR type=del size=902154 2024-09-14T11:01:51.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.879+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~BBI5PTOJUJ5R.0 size=943498 2024-09-14T11:01:51.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.881+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=BBI5PTOJUJ5R tag=I6YE8IVMS0RS type=write size=1992074 2024-09-14T11:01:51.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.882+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=33EXZYSBYJ0C type=write size=406067 2024-09-14T11:01:51.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.883+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~PVWBSWG8YHDM.0 size=1048576 2024-09-14T11:01:51.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.884+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~PVWBSWG8YHDM.1 size=1048576 2024-09-14T11:01:51.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.884+0000 7fe3dd11f780 1 < canceled part key=_multipart_KXL3E0PJBNBA.2~PVWBSWG8YHDM.2 size=463053 2024-09-14T11:01:51.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.886+0000 7fe3dd11f780 1 < canceled multipart upload key=KXL3E0PJBNBA upload=PVWBSWG8YHDM tag=M1205DT42HVH type=write size=3608781 2024-09-14T11:01:51.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.887+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=HHJOO043DLFC type=write size=393136 2024-09-14T11:01:51.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.888+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~R2I6UGN7G6PM.0 size=1004407 2024-09-14T11:01:51.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.890+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=R2I6UGN7G6PM tag=L53P2J2N2YL3 type=write size=2052983 2024-09-14T11:01:51.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.891+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=Q3ATZ966USQL type=del size=3609630 2024-09-14T11:01:51.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.892+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=5B2Y127OKQW3 type=del 2024-09-14T11:01:51.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.894+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~ZEUHIJOH26HU.0 size=1048576 2024-09-14T11:01:51.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.895+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~ZEUHIJOH26HU.1 size=456934 2024-09-14T11:01:51.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.895+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=ZEUHIJOH26HU tag=32WNGVYZZHY8 type=write size=2554086 2024-09-14T11:01:51.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.896+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=PYW3MZYSQ8N6 type=del 2024-09-14T11:01:51.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.897+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=EBXERUAC3CSK type=write size=966767 2024-09-14T11:01:51.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.898+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=QZI8EIBP7PQ8 type=del 2024-09-14T11:01:51.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.899+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=A99YXN5XU9TN type=write size=569006 2024-09-14T11:01:51.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.900+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=P290NX9ZLYT7 type=del 2024-09-14T11:01:51.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.902+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=TAUF0W8M2GBK type=del size=3871203 2024-09-14T11:01:51.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.902+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~32Q01VQYXAW2.0 size=876273 2024-09-14T11:01:51.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.904+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=32Q01VQYXAW2 tag=2L0I4V2IBTPP type=write size=1924849 2024-09-14T11:01:51.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.910+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=RG3B4I8ERSSM type=write size=123457 2024-09-14T11:01:51.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.911+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~BRINAC6LVLAM.0 size=369868 2024-09-14T11:01:51.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.914+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=BRINAC6LVLAM tag=4BOII4LA6NCP type=write size=1418444 2024-09-14T11:01:51.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.916+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~WZ3HGRVGDKJA.0 size=1048576 2024-09-14T11:01:51.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.917+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~WZ3HGRVGDKJA.1 size=1048576 2024-09-14T11:01:51.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.918+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~WZ3HGRVGDKJA.2 size=671552 2024-09-14T11:01:51.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.918+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=WZ3HGRVGDKJA tag=E3N0KY1GA107 type=write size=3817280 2024-09-14T11:01:51.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.920+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~PYSEJ5U1O7QZ.0 size=1048576 2024-09-14T11:01:51.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.921+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~PYSEJ5U1O7QZ.1 size=1048576 2024-09-14T11:01:51.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.921+0000 7fe3dd11f780 1 < canceled part key=_multipart_QPH41U60044L.2~PYSEJ5U1O7QZ.2 size=254887 2024-09-14T11:01:51.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.923+0000 7fe3dd11f780 1 < canceled multipart upload key=QPH41U60044L upload=PYSEJ5U1O7QZ tag=KI47RXR7A8A1 type=write size=3400615 2024-09-14T11:01:51.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.925+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~4ADP718VG720.0 size=290306 2024-09-14T11:01:51.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.925+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=4ADP718VG720 tag=QHEDOZ0X3SDU type=write size=1338882 2024-09-14T11:01:51.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.927+0000 7fe3dd11f780 1 < completed write operation key=LDILBET1CMYY tag=A4NBQSASEK30 type=write size=819623 2024-09-14T11:01:51.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.928+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=OVDB8DNJW7T6 type=del size=3761441 2024-09-14T11:01:51.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.929+0000 7fe3dd11f780 1 < canceled operation key=3PS4LAML698X tag=Z183ANG8VZ53 type=del size=3820417 2024-09-14T11:01:51.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.931+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~8CVJ1DAFEHVM.0 size=119686 2024-09-14T11:01:51.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.931+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=8CVJ1DAFEHVM tag=YUHXJP29FVVG type=write size=1168262 2024-09-14T11:01:51.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.934+0000 7fe3dd11f780 1 < suggested update operation key=OK5L92EKOOMW tag=HIIURGSSRISX type=del size=1138322 2024-09-14T11:01:51.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.936+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~4ZL90MX595IG.0 size=1048576 2024-09-14T11:01:51.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.937+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~4ZL90MX595IG.1 size=1048576 2024-09-14T11:01:51.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.938+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~4ZL90MX595IG.2 size=273261 2024-09-14T11:01:51.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.938+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=4ZL90MX595IG tag=VWYB4OIOGHOH type=write size=3418989 2024-09-14T11:01:51.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.939+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=5W15WMYNF383 type=del 2024-09-14T11:01:51.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.942+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~55HCVW2Z99A1.0 size=1048576 2024-09-14T11:01:51.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.943+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~55HCVW2Z99A1.1 size=489053 2024-09-14T11:01:51.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.943+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=55HCVW2Z99A1 tag=4MTEU6F1YJ67 type=write size=2586205 2024-09-14T11:01:51.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.945+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~XCOHKLTLUBMQ.0 size=1048576 2024-09-14T11:01:51.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.946+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~XCOHKLTLUBMQ.1 size=1048576 2024-09-14T11:01:51.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.947+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~XCOHKLTLUBMQ.2 size=212029 2024-09-14T11:01:51.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.949+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=XCOHKLTLUBMQ tag=UHU3U93Z2UWT type=write size=3357757 2024-09-14T11:01:51.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.951+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~ZPKUIV3VG1KT.0 size=345421 2024-09-14T11:01:51.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.951+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=ZPKUIV3VG1KT tag=2MH81MH252TB type=write size=1393997 2024-09-14T11:01:51.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.952+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=05Z31GFW82PR type=del 2024-09-14T11:01:51.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.953+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=O3K78RYSGH38 type=del size=3093948 2024-09-14T11:01:51.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.955+0000 7fe3dd11f780 1 < completed write operation key=JSEN4QXEMVHS tag=33EXZYSBYJ0C type=write size=406067 2024-09-14T11:01:51.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.957+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~CHF0L4UEYXOL.0 size=1048576 2024-09-14T11:01:51.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.958+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~CHF0L4UEYXOL.1 size=468449 2024-09-14T11:01:51.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.958+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=CHF0L4UEYXOL tag=73368E1E3ZEB type=write size=2565601 2024-09-14T11:01:51.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.959+0000 7fe3dd11f780 1 < completed write operation key=PHLQ77OMLI37 tag=HHJOO043DLFC type=write size=393136 2024-09-14T11:01:51.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.960+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=718LVHEZVY01 type=del size=4129811 2024-09-14T11:01:51.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.963+0000 7fe3dd11f780 1 < suggested remove operation key=LFKLJAJWQ2J6 tag=Q3ATZ966USQL type=del 2024-09-14T11:01:51.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.965+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~61WYQ8YJDG1A.0 size=863783 2024-09-14T11:01:51.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.965+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=61WYQ8YJDG1A tag=KIKM71NY608E type=write size=1912359 2024-09-14T11:01:51.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.965+0000 7fe3dd11f780 1 < canceled part key=_multipart_ODDNSHK5YMNO.2~ZEUHIJOH26HU.0 size=1048576 2024-09-14T11:01:51.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.966+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~ZEUHIJOH26HU.1 size=456934 2024-09-14T11:01:51.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.968+0000 7fe3dd11f780 1 < canceled multipart upload key=ODDNSHK5YMNO upload=ZEUHIJOH26HU tag=32WNGVYZZHY8 type=write size=2554086 2024-09-14T11:01:51.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.969+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=T7E4PH7G0PUV type=write size=464087 2024-09-14T11:01:51.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.970+0000 7fe3dd11f780 1 < canceled operation key=NHKCRGX10WBM tag=EBXERUAC3CSK type=write size=966767 2024-09-14T11:01:51.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.973+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~NHF9F24ZOG19.0 size=1048576 2024-09-14T11:01:51.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.974+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~NHF9F24ZOG19.1 size=1048576 2024-09-14T11:01:51.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.974+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~NHF9F24ZOG19.2 size=1015259 2024-09-14T11:01:51.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.974+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=NHF9F24ZOG19 tag=I7B84T4ZXP5P type=write size=4160987 2024-09-14T11:01:51.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.976+0000 7fe3dd11f780 1 < completed write operation key=GQEFQ1UD6QCJ tag=A99YXN5XU9TN type=write size=569006 2024-09-14T11:01:51.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.977+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=LHPYU6LMQNUU type=del size=2522682 2024-09-14T11:01:51.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.978+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=TAUF0W8M2GBK type=del 2024-09-14T11:01:51.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.979+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=965N1B5K0DQE type=write size=844381 2024-09-14T11:01:51.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.980+0000 7fe3dd11f780 1 < completed write operation key=EGC5988RQOEZ tag=RG3B4I8ERSSM type=write size=123457 2024-09-14T11:01:51.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.982+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=YPHVL5ZHMWX6 type=del size=2965717 2024-09-14T11:01:51.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.983+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~WZ3HGRVGDKJA.0 size=1048576 2024-09-14T11:01:51.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.984+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~WZ3HGRVGDKJA.1 size=1048576 2024-09-14T11:01:51.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.985+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~WZ3HGRVGDKJA.2 size=671552 2024-09-14T11:01:51.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.987+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=WZ3HGRVGDKJA tag=E3N0KY1GA107 type=write size=3817280 2024-09-14T11:01:51.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.988+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=L2CKUAZN22WJ type=del size=477746 2024-09-14T11:01:51.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.989+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~4ADP718VG720.0 size=290306 2024-09-14T11:01:51.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.991+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=4ADP718VG720 tag=QHEDOZ0X3SDU type=write size=1338882 2024-09-14T11:01:51.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.992+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=6EUZ7AGDDNQR type=del size=980048 2024-09-14T11:01:51.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.993+0000 7fe3dd11f780 -1 < failed to complete operation key=OK5L92EKOOMW tag=OVDB8DNJW7T6 type=del size=3761441: (22) Invalid argument 2024-09-14T11:01:51.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.995+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=2I3V68KQB1V4 type=write size=93862 2024-09-14T11:01:51.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.996+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~8CVJ1DAFEHVM.0 size=119686 2024-09-14T11:01:51.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.998+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=8CVJ1DAFEHVM tag=YUHXJP29FVVG type=write size=1168262 2024-09-14T11:01:51.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:51.999+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=OC2MMY4IUT1Z type=del size=2907627 2024-09-14T11:01:51.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.000+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~4ZL90MX595IG.0 size=1048576 2024-09-14T11:01:51.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.001+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~4ZL90MX595IG.1 size=1048576 2024-09-14T11:01:52.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.002+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~4ZL90MX595IG.2 size=273261 2024-09-14T11:01:52.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.004+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=4ZL90MX595IG tag=VWYB4OIOGHOH type=write size=3418989 2024-09-14T11:01:52.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.006+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~V4V5HEZOQB59.0 size=1048576 2024-09-14T11:01:52.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.007+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~V4V5HEZOQB59.1 size=631923 2024-09-14T11:01:52.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.007+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=V4V5HEZOQB59 tag=79QBZXNABIQQ type=write size=2729075 2024-09-14T11:01:52.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.008+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~55HCVW2Z99A1.0 size=1048576 2024-09-14T11:01:52.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.009+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~55HCVW2Z99A1.1 size=489053 2024-09-14T11:01:52.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.011+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=55HCVW2Z99A1 tag=4MTEU6F1YJ67 type=write size=2586205 2024-09-14T11:01:52.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.012+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=SQ2HQCFTLMJK type=del size=369061 2024-09-14T11:01:52.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.014+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~ZPKUIV3VG1KT.0 size=345421 2024-09-14T11:01:52.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.016+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=ZPKUIV3VG1KT tag=2MH81MH252TB type=write size=1393997 2024-09-14T11:01:52.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.017+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=SS4GIW0W9NPF type=write size=48597 2024-09-14T11:01:52.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.018+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=O3K78RYSGH38 type=del 2024-09-14T11:01:52.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.020+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~8ADOJVX4PFSF.0 size=1048576 2024-09-14T11:01:52.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.021+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~8ADOJVX4PFSF.1 size=1426 2024-09-14T11:01:52.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.021+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=8ADOJVX4PFSF tag=2WOOSGNBPTRF type=write size=2098578 2024-09-14T11:01:52.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.022+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~CHF0L4UEYXOL.0 size=1048576 2024-09-14T11:01:52.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.023+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~CHF0L4UEYXOL.1 size=468449 2024-09-14T11:01:52.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.025+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=CHF0L4UEYXOL tag=73368E1E3ZEB type=write size=2565601 2024-09-14T11:01:52.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.026+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=WF2T2B4HRUTF type=del size=2487864 2024-09-14T11:01:52.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.027+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=718LVHEZVY01 type=del 2024-09-14T11:01:52.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.030+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~PPK3TBHQ9JNJ.0 size=1048576 2024-09-14T11:01:52.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.030+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~PPK3TBHQ9JNJ.1 size=845163 2024-09-14T11:01:52.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.031+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=PPK3TBHQ9JNJ tag=6P104SCW3VAO type=write size=2942315 2024-09-14T11:01:52.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.032+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~61WYQ8YJDG1A.0 size=863783 2024-09-14T11:01:52.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.034+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=61WYQ8YJDG1A tag=KIKM71NY608E type=write size=1912359 2024-09-14T11:01:52.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.035+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=B4BTJR2HSTZD type=del size=907062 2024-09-14T11:01:52.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.036+0000 7fe3dd11f780 1 < completed write operation key=ZI5SFHGWCHJA tag=T7E4PH7G0PUV type=write size=464087 2024-09-14T11:01:52.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.038+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=0IC1OJ184894 type=del size=801474 2024-09-14T11:01:52.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.039+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~NHF9F24ZOG19.0 size=1048576 2024-09-14T11:01:52.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.040+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~NHF9F24ZOG19.1 size=1048576 2024-09-14T11:01:52.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.041+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~NHF9F24ZOG19.2 size=1015259 2024-09-14T11:01:52.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.043+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=NHF9F24ZOG19 tag=I7B84T4ZXP5P type=write size=4160987 2024-09-14T11:01:52.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.045+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~C8FEL7S4LP1E.0 size=1048576 2024-09-14T11:01:52.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.046+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~C8FEL7S4LP1E.1 size=472485 2024-09-14T11:01:52.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.046+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=C8FEL7S4LP1E tag=A81QDU1VOTS2 type=write size=2569637 2024-09-14T11:01:52.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.048+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=LHPYU6LMQNUU type=del 2024-09-14T11:01:52.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.049+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=59Q9KEMCWY5M type=del size=4078804 2024-09-14T11:01:52.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.052+0000 7fe3dd11f780 1 < suggested remove operation key=6PJ03TAYRUT8 tag=965N1B5K0DQE type=write 2024-09-14T11:01:52.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.053+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=0ZVT04PB8DJX type=write size=662414 2024-09-14T11:01:52.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.055+0000 7fe3dd11f780 1 < suggested update operation key=M0DMAQ5LTDR0 tag=YPHVL5ZHMWX6 type=del size=2965717 2024-09-14T11:01:52.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.057+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=NNQ5CKUW06UE type=del size=1142942 2024-09-14T11:01:52.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.058+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=L2CKUAZN22WJ type=del 2024-09-14T11:01:52.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.059+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=NN0BRK1D9JIF type=del size=3187484 2024-09-14T11:01:52.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.060+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=6EUZ7AGDDNQR type=del 2024-09-14T11:01:52.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.061+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=73VJZMEYXSYJ type=write size=839936 2024-09-14T11:01:52.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.064+0000 7fe3dd11f780 1 < suggested update operation key=ZTD98WQ6032X tag=2I3V68KQB1V4 type=write size=93862 2024-09-14T11:01:52.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.066+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~A9P1G5YVOS3H.0 size=1048576 2024-09-14T11:01:52.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.067+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~A9P1G5YVOS3H.1 size=1048576 2024-09-14T11:01:52.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.068+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~A9P1G5YVOS3H.2 size=107755 2024-09-14T11:01:52.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.068+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=A9P1G5YVOS3H tag=E5DPJ1BRUG4A type=write size=3253483 2024-09-14T11:01:52.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.069+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=OC2MMY4IUT1Z type=del 2024-09-14T11:01:52.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.071+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~9GSNB9B1LGPI.0 size=1048576 2024-09-14T11:01:52.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.072+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~9GSNB9B1LGPI.1 size=1048576 2024-09-14T11:01:52.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.073+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~9GSNB9B1LGPI.2 size=666178 2024-09-14T11:01:52.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.073+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=9GSNB9B1LGPI tag=VGTC3J7ZK5Q5 type=write size=3811906 2024-09-14T11:01:52.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.074+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~V4V5HEZOQB59.0 size=1048576 2024-09-14T11:01:52.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.074+0000 7fe3dd11f780 1 < canceled part key=_multipart_YMGE9GKLSPE6.2~V4V5HEZOQB59.1 size=631923 2024-09-14T11:01:52.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.076+0000 7fe3dd11f780 1 < canceled multipart upload key=YMGE9GKLSPE6 upload=V4V5HEZOQB59 tag=79QBZXNABIQQ type=write size=2729075 2024-09-14T11:01:52.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.077+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=76TWDV0QIC7K type=del size=2121597 2024-09-14T11:01:52.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.078+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=SQ2HQCFTLMJK type=del 2024-09-14T11:01:52.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.080+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=5FD34JMK3P8A type=del size=2598436 2024-09-14T11:01:52.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.081+0000 7fe3dd11f780 -1 < failed to complete operation key=6PJ03TAYRUT8 tag=SS4GIW0W9NPF type=write size=48597: (22) Invalid argument 2024-09-14T11:01:52.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.083+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~EMPZX651HDWQ.0 size=1048576 2024-09-14T11:01:52.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.084+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~EMPZX651HDWQ.1 size=1048576 2024-09-14T11:01:52.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.085+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~EMPZX651HDWQ.2 size=440269 2024-09-14T11:01:52.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.085+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=EMPZX651HDWQ tag=7A4E0EH0SW93 type=write size=3585997 2024-09-14T11:01:52.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.086+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~8ADOJVX4PFSF.0 size=1048576 2024-09-14T11:01:52.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.087+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~8ADOJVX4PFSF.1 size=1426 2024-09-14T11:01:52.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.089+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=8ADOJVX4PFSF tag=2WOOSGNBPTRF type=write size=2098578 2024-09-14T11:01:52.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.090+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=08ID4BE9ZTPJ type=del size=1694858 2024-09-14T11:01:52.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.092+0000 7fe3dd11f780 1 < suggested remove operation key=ZTD98WQ6032X tag=WF2T2B4HRUTF type=del 2024-09-14T11:01:52.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.093+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=MC0TITZFJTL2 type=write size=583479 2024-09-14T11:01:52.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.095+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~PPK3TBHQ9JNJ.0 size=1048576 2024-09-14T11:01:52.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.096+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~PPK3TBHQ9JNJ.1 size=845163 2024-09-14T11:01:52.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.098+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=PPK3TBHQ9JNJ tag=6P104SCW3VAO type=write size=2942315 2024-09-14T11:01:52.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.099+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=1HGBDPPQRVNJ type=write size=546233 2024-09-14T11:01:52.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.100+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=B4BTJR2HSTZD type=del 2024-09-14T11:01:52.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.102+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~3V67DXLIJA9E.0 size=1048576 2024-09-14T11:01:52.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.103+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~3V67DXLIJA9E.1 size=479325 2024-09-14T11:01:52.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.103+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=3V67DXLIJA9E tag=2YFBJR3IZKC3 type=write size=2576477 2024-09-14T11:01:52.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.104+0000 7fe3dd11f780 1 < canceled operation key=4JTN39NIB2UE tag=0IC1OJ184894 type=del size=801474 2024-09-14T11:01:52.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.105+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=O440OD6LK0KS type=del size=2311310 2024-09-14T11:01:52.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.107+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~C8FEL7S4LP1E.0 size=1048576 2024-09-14T11:01:52.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.108+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~C8FEL7S4LP1E.1 size=472485 2024-09-14T11:01:52.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.110+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=C8FEL7S4LP1E tag=A81QDU1VOTS2 type=write size=2569637 2024-09-14T11:01:52.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.112+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~PGHZDPMF02TV.0 size=1048576 2024-09-14T11:01:52.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.113+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~PGHZDPMF02TV.1 size=1048576 2024-09-14T11:01:52.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.114+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~PGHZDPMF02TV.2 size=415799 2024-09-14T11:01:52.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.114+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=PGHZDPMF02TV tag=MX137BJ92HED type=write size=3561527 2024-09-14T11:01:52.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.115+0000 7fe3dd11f780 -1 < failed to complete operation key=M0DMAQ5LTDR0 tag=59Q9KEMCWY5M type=del size=4078804: (22) Invalid argument 2024-09-14T11:01:52.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.116+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=VSQ12SFX4VT6 type=del size=1558320 2024-09-14T11:01:52.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.118+0000 7fe3dd11f780 1 < suggested update operation key=KXL3E0PJBNBA tag=0ZVT04PB8DJX type=write size=662414 2024-09-14T11:01:52.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.120+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=2HUYJCXM6UBF type=del size=2631385 2024-09-14T11:01:52.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.121+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=NNQ5CKUW06UE type=del 2024-09-14T11:01:52.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.123+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~SXS93YQA9F45.0 size=1048576 2024-09-14T11:01:52.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.124+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~SXS93YQA9F45.1 size=1048576 2024-09-14T11:01:52.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.125+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~SXS93YQA9F45.2 size=411486 2024-09-14T11:01:52.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.125+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=SXS93YQA9F45 tag=94KC79VXBY9M type=write size=3557214 2024-09-14T11:01:52.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.127+0000 7fe3dd11f780 1 < suggested remove operation key=K9BP30LHDPA1 tag=NN0BRK1D9JIF type=del 2024-09-14T11:01:52.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.128+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=CHA23GNTMK54 type=del size=341612 2024-09-14T11:01:52.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.131+0000 7fe3dd11f780 1 < suggested update operation key=JSEN4QXEMVHS tag=73VJZMEYXSYJ type=write size=839936 2024-09-14T11:01:52.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.132+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=2NCPRPY6MTQ9 type=del size=3678518 2024-09-14T11:01:52.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.133+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~A9P1G5YVOS3H.0 size=1048576 2024-09-14T11:01:52.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.134+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~A9P1G5YVOS3H.1 size=1048576 2024-09-14T11:01:52.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.134+0000 7fe3dd11f780 1 < canceled part key=_multipart_IOAG4ZE1I58Z.2~A9P1G5YVOS3H.2 size=107755 2024-09-14T11:01:52.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.136+0000 7fe3dd11f780 1 < canceled multipart upload key=IOAG4ZE1I58Z upload=A9P1G5YVOS3H tag=E5DPJ1BRUG4A type=write size=3253483 2024-09-14T11:01:52.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.138+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~CVF4M29P23C6.0 size=1048576 2024-09-14T11:01:52.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.139+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~CVF4M29P23C6.1 size=1048576 2024-09-14T11:01:52.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.140+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~CVF4M29P23C6.2 size=309732 2024-09-14T11:01:52.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.140+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=CVF4M29P23C6 tag=LV3PFSDJ96VC type=write size=3455460 2024-09-14T11:01:52.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.141+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~9GSNB9B1LGPI.0 size=1048576 2024-09-14T11:01:52.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.142+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~9GSNB9B1LGPI.1 size=1048576 2024-09-14T11:01:52.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.143+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~9GSNB9B1LGPI.2 size=666178 2024-09-14T11:01:52.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.145+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=9GSNB9B1LGPI tag=VGTC3J7ZK5Q5 type=write size=3811906 2024-09-14T11:01:52.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.148+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~TR6L0MAQFJ06.0 size=1048576 2024-09-14T11:01:52.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.149+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~TR6L0MAQFJ06.1 size=301034 2024-09-14T11:01:52.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.149+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=TR6L0MAQFJ06 tag=82T0FPRWHJJU type=write size=2398186 2024-09-14T11:01:52.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.150+0000 7fe3dd11f780 1 < canceled operation key=MD0OU8IC5PYI tag=76TWDV0QIC7K type=del size=2121597 2024-09-14T11:01:52.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.152+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~JSPMVGVIGLQB.0 size=586480 2024-09-14T11:01:52.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.152+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=JSPMVGVIGLQB tag=7JC4RQEXRHP7 type=write size=1635056 2024-09-14T11:01:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.153+0000 7fe3dd11f780 1 < canceled operation key=IOAG4ZE1I58Z tag=5FD34JMK3P8A type=del size=2598436 2024-09-14T11:01:52.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.154+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=9SX9X016UF0X type=del size=2903236 2024-09-14T11:01:52.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.155+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~EMPZX651HDWQ.0 size=1048576 2024-09-14T11:01:52.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.156+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~EMPZX651HDWQ.1 size=1048576 2024-09-14T11:01:52.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.157+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~EMPZX651HDWQ.2 size=440269 2024-09-14T11:01:52.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.159+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=EMPZX651HDWQ tag=7A4E0EH0SW93 type=write size=3585997 2024-09-14T11:01:52.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.162+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=1FLMIZY09JP1 type=del size=2891700 2024-09-14T11:01:52.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.163+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=08ID4BE9ZTPJ type=del 2024-09-14T11:01:52.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.165+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MII7719RWZAC.0 size=1048576 2024-09-14T11:01:52.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.166+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MII7719RWZAC.1 size=1048576 2024-09-14T11:01:52.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.167+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MII7719RWZAC.2 size=363181 2024-09-14T11:01:52.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.167+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=MII7719RWZAC tag=ZV9B4C2CO76C type=write size=3508909 2024-09-14T11:01:52.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.168+0000 7fe3dd11f780 1 < canceled operation key=0PT98N1VBWAG tag=MC0TITZFJTL2 type=write size=583479 2024-09-14T11:01:52.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.169+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=51OLCZ7W0X0S type=del size=507590 2024-09-14T11:01:52.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.170+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=1HGBDPPQRVNJ type=write size=546233 2024-09-14T11:01:52.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.172+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~8WQYMW1FN0VC.0 size=1048576 2024-09-14T11:01:52.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.173+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~8WQYMW1FN0VC.1 size=216871 2024-09-14T11:01:52.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.173+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=8WQYMW1FN0VC tag=4L2JPSG683W0 type=write size=2314023 2024-09-14T11:01:52.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.174+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~3V67DXLIJA9E.0 size=1048576 2024-09-14T11:01:52.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.175+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~3V67DXLIJA9E.1 size=479325 2024-09-14T11:01:52.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.177+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=3V67DXLIJA9E tag=2YFBJR3IZKC3 type=write size=2576477 2024-09-14T11:01:52.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.179+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=F6ECTTU0F6WD type=write size=467140 2024-09-14T11:01:52.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.181+0000 7fe3dd11f780 1 < suggested remove operation key=ZI5SFHGWCHJA tag=O440OD6LK0KS type=del 2024-09-14T11:01:52.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.182+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=D5JWILMPBPWD type=del size=130226 2024-09-14T11:01:52.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.183+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~PGHZDPMF02TV.0 size=1048576 2024-09-14T11:01:52.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.184+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~PGHZDPMF02TV.1 size=1048576 2024-09-14T11:01:52.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.185+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~PGHZDPMF02TV.2 size=415799 2024-09-14T11:01:52.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.187+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=PGHZDPMF02TV tag=MX137BJ92HED type=write size=3561527 2024-09-14T11:01:52.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.189+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~V84V9262RYFV.0 size=1048576 2024-09-14T11:01:52.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.190+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~V84V9262RYFV.1 size=852150 2024-09-14T11:01:52.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.190+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=V84V9262RYFV tag=669PIL119LQB type=write size=2949302 2024-09-14T11:01:52.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.192+0000 7fe3dd11f780 1 < canceled operation key=M0DMAQ5LTDR0 tag=VSQ12SFX4VT6 type=del size=1558320 2024-09-14T11:01:52.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.193+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=MAHIOZ3ZQSWY type=del size=2972081 2024-09-14T11:01:52.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.195+0000 7fe3dd11f780 1 < suggested update operation key=ODDNSHK5YMNO tag=2HUYJCXM6UBF type=del size=2631385 2024-09-14T11:01:52.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.196+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=IZ4Z2GHPFYML type=del size=3483202 2024-09-14T11:01:52.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.198+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~SXS93YQA9F45.0 size=1048576 2024-09-14T11:01:52.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.199+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~SXS93YQA9F45.1 size=1048576 2024-09-14T11:01:52.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.200+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~SXS93YQA9F45.2 size=411486 2024-09-14T11:01:52.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.201+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=SXS93YQA9F45 tag=94KC79VXBY9M type=write size=3557214 2024-09-14T11:01:52.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.203+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=AHCC5ATV4PYM type=del size=3843762 2024-09-14T11:01:52.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.205+0000 7fe3dd11f780 1 < suggested remove operation key=K9BP30LHDPA1 tag=CHA23GNTMK54 type=del 2024-09-14T11:01:52.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.206+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=PY1AR2K8GR3B type=write size=121051 2024-09-14T11:01:52.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.209+0000 7fe3dd11f780 1 < suggested update operation key=A89YQO40BHUS tag=2NCPRPY6MTQ9 type=del size=3678518 2024-09-14T11:01:52.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.210+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=USVEXFKIB0EC type=del size=4074022 2024-09-14T11:01:52.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.211+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~CVF4M29P23C6.0 size=1048576 2024-09-14T11:01:52.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.212+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~CVF4M29P23C6.1 size=1048576 2024-09-14T11:01:52.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.213+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~CVF4M29P23C6.2 size=309732 2024-09-14T11:01:52.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.215+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=CVF4M29P23C6 tag=LV3PFSDJ96VC type=write size=3455460 2024-09-14T11:01:52.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.217+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=FDM7YNJHDXA1 type=del size=802023 2024-09-14T11:01:52.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.218+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~TR6L0MAQFJ06.0 size=1048576 2024-09-14T11:01:52.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.218+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZI5SFHGWCHJA.2~TR6L0MAQFJ06.1 size=301034 2024-09-14T11:01:52.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.220+0000 7fe3dd11f780 1 < canceled multipart upload key=ZI5SFHGWCHJA upload=TR6L0MAQFJ06 tag=82T0FPRWHJJU type=write size=2398186 2024-09-14T11:01:52.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.222+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~L01ZNSOPCT99.0 size=1048576 2024-09-14T11:01:52.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.223+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~L01ZNSOPCT99.1 size=1048576 2024-09-14T11:01:52.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.224+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~L01ZNSOPCT99.2 size=436497 2024-09-14T11:01:52.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.224+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=L01ZNSOPCT99 tag=M1A1YK5LUSRY type=write size=3582225 2024-09-14T11:01:52.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.225+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~JSPMVGVIGLQB.0 size=586480 2024-09-14T11:01:52.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.227+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=JSPMVGVIGLQB tag=7JC4RQEXRHP7 type=write size=1635056 2024-09-14T11:01:52.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.228+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=8D4XZEGOF36X type=del size=1752169 2024-09-14T11:01:52.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.229+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=9SX9X016UF0X type=del 2024-09-14T11:01:52.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.230+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=USWAKA4749K9 type=del size=2238261 2024-09-14T11:01:52.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.232+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=1FLMIZY09JP1 type=del 2024-09-14T11:01:52.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.234+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~JT7QKKBRBSVS.0 size=1048576 2024-09-14T11:01:52.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.235+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~JT7QKKBRBSVS.1 size=1048576 2024-09-14T11:01:52.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.236+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~JT7QKKBRBSVS.2 size=112088 2024-09-14T11:01:52.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.236+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=JT7QKKBRBSVS tag=FYJK00UBN8KH type=write size=3257816 2024-09-14T11:01:52.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.237+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MII7719RWZAC.0 size=1048576 2024-09-14T11:01:52.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.238+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MII7719RWZAC.1 size=1048576 2024-09-14T11:01:52.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.239+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MII7719RWZAC.2 size=363181 2024-09-14T11:01:52.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.241+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=MII7719RWZAC tag=ZV9B4C2CO76C type=write size=3508909 2024-09-14T11:01:52.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.242+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=2X2JE24NG1NF type=del size=3346991 2024-09-14T11:01:52.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.243+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=51OLCZ7W0X0S type=del 2024-09-14T11:01:52.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.244+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=7SJFASJGEAKN type=del size=3076438 2024-09-14T11:01:52.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.245+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~8WQYMW1FN0VC.0 size=1048576 2024-09-14T11:01:52.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.246+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~8WQYMW1FN0VC.1 size=216871 2024-09-14T11:01:52.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.248+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=8WQYMW1FN0VC tag=4L2JPSG683W0 type=write size=2314023 2024-09-14T11:01:52.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.249+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=XLZK3931FJLH type=del size=3579144 2024-09-14T11:01:52.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.250+0000 7fe3dd11f780 1 < completed write operation key=KXL3E0PJBNBA tag=F6ECTTU0F6WD type=write size=467140 2024-09-14T11:01:52.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.252+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=Y48UA29EMJTU type=write size=735059 2024-09-14T11:01:52.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.253+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=D5JWILMPBPWD type=del 2024-09-14T11:01:52.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.255+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~5AHQF5M16SHK.0 size=502087 2024-09-14T11:01:52.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.255+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=5AHQF5M16SHK tag=A1UXN3VDSTBK type=write size=1550663 2024-09-14T11:01:52.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.256+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~V84V9262RYFV.0 size=1048576 2024-09-14T11:01:52.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.257+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~V84V9262RYFV.1 size=852150 2024-09-14T11:01:52.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.259+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=V84V9262RYFV tag=669PIL119LQB type=write size=2949302 2024-09-14T11:01:52.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.262+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~73XENK3RLYLO.0 size=1048576 2024-09-14T11:01:52.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.263+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~73XENK3RLYLO.1 size=1048576 2024-09-14T11:01:52.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.264+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~73XENK3RLYLO.2 size=303084 2024-09-14T11:01:52.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.264+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=73XENK3RLYLO tag=5X523O2I2PXQ type=write size=3448812 2024-09-14T11:01:52.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.265+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=MAHIOZ3ZQSWY type=del 2024-09-14T11:01:52.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.268+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~3ZBSSN0OTFER.0 size=1048576 2024-09-14T11:01:52.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.269+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~3ZBSSN0OTFER.1 size=1048576 2024-09-14T11:01:52.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.270+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~3ZBSSN0OTFER.2 size=615297 2024-09-14T11:01:52.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.270+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=3ZBSSN0OTFER tag=YYHGG34UB60L type=write size=3761025 2024-09-14T11:01:52.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.272+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=IZ4Z2GHPFYML type=del 2024-09-14T11:01:52.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.273+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=MTQPYGCXAXPE type=del size=3433318 2024-09-14T11:01:52.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.274+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=AHCC5ATV4PYM type=del 2024-09-14T11:01:52.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.275+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=PV1N22LMXLLG type=del size=1556616 2024-09-14T11:01:52.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.277+0000 7fe3dd11f780 1 < completed write operation key=22TI1VCDTK5P tag=PY1AR2K8GR3B type=write size=121051 2024-09-14T11:01:52.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.278+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=TRTHCUPR4AMU type=del size=796966 2024-09-14T11:01:52.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.280+0000 7fe3dd11f780 1 < suggested remove operation key=MD0OU8IC5PYI tag=USVEXFKIB0EC type=del 2024-09-14T11:01:52.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.282+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~4TL3ZMAFS0BC.0 size=1048576 2024-09-14T11:01:52.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.283+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~4TL3ZMAFS0BC.1 size=1048576 2024-09-14T11:01:52.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.284+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~4TL3ZMAFS0BC.2 size=921399 2024-09-14T11:01:52.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.284+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=4TL3ZMAFS0BC tag=89OPQS4KHG2J type=write size=4067127 2024-09-14T11:01:52.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.286+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=FDM7YNJHDXA1 type=del 2024-09-14T11:01:52.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.287+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=020WR0NA8IUU type=del size=1176793 2024-09-14T11:01:52.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.288+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~L01ZNSOPCT99.0 size=1048576 2024-09-14T11:01:52.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.289+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~L01ZNSOPCT99.1 size=1048576 2024-09-14T11:01:52.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.290+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~L01ZNSOPCT99.2 size=436497 2024-09-14T11:01:52.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.293+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=L01ZNSOPCT99 tag=M1A1YK5LUSRY type=write size=3582225 2024-09-14T11:01:52.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.294+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=I1KFZW11SI16 type=del size=1679144 2024-09-14T11:01:52.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.295+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=8D4XZEGOF36X type=del 2024-09-14T11:01:52.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.296+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=5ZBP3CA1NKI2 type=write size=322033 2024-09-14T11:01:52.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.298+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=USWAKA4749K9 type=del 2024-09-14T11:01:52.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.299+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=IE59EFLDJVMM type=del size=180916 2024-09-14T11:01:52.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.300+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~JT7QKKBRBSVS.0 size=1048576 2024-09-14T11:01:52.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.301+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~JT7QKKBRBSVS.1 size=1048576 2024-09-14T11:01:52.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.303+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~JT7QKKBRBSVS.2 size=112088 2024-09-14T11:01:52.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.305+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=JT7QKKBRBSVS tag=FYJK00UBN8KH type=write size=3257816 2024-09-14T11:01:52.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.306+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=LHHFCEJIMZD4 type=del size=3234074 2024-09-14T11:01:52.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.308+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=2X2JE24NG1NF type=del 2024-09-14T11:01:52.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.309+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=I90YF0Q2QBXM type=write size=338916 2024-09-14T11:01:52.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.310+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=7SJFASJGEAKN type=del 2024-09-14T11:01:52.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.312+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=BQ4KJZV3WI9C type=del size=1712481 2024-09-14T11:01:52.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.313+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=XLZK3931FJLH type=del 2024-09-14T11:01:52.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.314+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=R0FVAJGFG27A type=write size=532455 2024-09-14T11:01:52.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.315+0000 7fe3dd11f780 1 < completed write operation key=ZI5SFHGWCHJA tag=Y48UA29EMJTU type=write size=735059 2024-09-14T11:01:52.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.317+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=Y63ZCJG7APH6 type=del size=1072340 2024-09-14T11:01:52.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.318+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~5AHQF5M16SHK.0 size=502087 2024-09-14T11:01:52.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.320+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=5AHQF5M16SHK tag=A1UXN3VDSTBK type=write size=1550663 2024-09-14T11:01:52.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.321+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=SG0V629V27SC type=del size=3603080 2024-09-14T11:01:52.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.322+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~73XENK3RLYLO.0 size=1048576 2024-09-14T11:01:52.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.323+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~73XENK3RLYLO.1 size=1048576 2024-09-14T11:01:52.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.324+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~73XENK3RLYLO.2 size=303084 2024-09-14T11:01:52.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.326+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=73XENK3RLYLO tag=5X523O2I2PXQ type=write size=3448812 2024-09-14T11:01:52.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.327+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=KJNROW2SPLXP type=del size=4001587 2024-09-14T11:01:52.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.328+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~3ZBSSN0OTFER.0 size=1048576 2024-09-14T11:01:52.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.329+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~3ZBSSN0OTFER.1 size=1048576 2024-09-14T11:01:52.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.330+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~3ZBSSN0OTFER.2 size=615297 2024-09-14T11:01:52.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.332+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=3ZBSSN0OTFER tag=YYHGG34UB60L type=write size=3761025 2024-09-14T11:01:52.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.333+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=93M3LZ6AL202 type=write size=119016 2024-09-14T11:01:52.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.334+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=MTQPYGCXAXPE type=del 2024-09-14T11:01:52.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.335+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=ELZFG8N353MZ type=del size=1633857 2024-09-14T11:01:52.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.338+0000 7fe3dd11f780 1 < suggested remove operation key=M0DMAQ5LTDR0 tag=PV1N22LMXLLG type=del 2024-09-14T11:01:52.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.339+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=0NZ64SA2LWS2 type=del size=1972476 2024-09-14T11:01:52.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.340+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=TRTHCUPR4AMU type=del 2024-09-14T11:01:52.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.342+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~P4ITJWFD2BUO.0 size=685969 2024-09-14T11:01:52.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.342+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=P4ITJWFD2BUO tag=2PGFRHKE2XVS type=write size=1734545 2024-09-14T11:01:52.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.343+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~4TL3ZMAFS0BC.0 size=1048576 2024-09-14T11:01:52.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.344+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~4TL3ZMAFS0BC.1 size=1048576 2024-09-14T11:01:52.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.345+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~4TL3ZMAFS0BC.2 size=921399 2024-09-14T11:01:52.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.347+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=4TL3ZMAFS0BC tag=89OPQS4KHG2J type=write size=4067127 2024-09-14T11:01:52.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.348+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=JLSTD1KCI3OE type=del size=671162 2024-09-14T11:01:52.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.351+0000 7fe3dd11f780 1 < suggested update operation key=IOAG4ZE1I58Z tag=020WR0NA8IUU type=del size=1176793 2024-09-14T11:01:52.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.353+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~ADMPIGB2WOMH.0 size=1048576 2024-09-14T11:01:52.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.354+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~ADMPIGB2WOMH.1 size=375423 2024-09-14T11:01:52.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.354+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=ADMPIGB2WOMH tag=HDO0QUM406S4 type=write size=2472575 2024-09-14T11:01:52.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.355+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=I1KFZW11SI16 type=del 2024-09-14T11:01:52.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.357+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~6YEQXX7ZWSS4.0 size=1048576 2024-09-14T11:01:52.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.358+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~6YEQXX7ZWSS4.1 size=1048576 2024-09-14T11:01:52.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.359+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~6YEQXX7ZWSS4.2 size=882156 2024-09-14T11:01:52.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.359+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=6YEQXX7ZWSS4 tag=OQZV9F6ZGPYE type=write size=4027884 2024-09-14T11:01:52.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.360+0000 7fe3dd11f780 1 < completed write operation key=KXL3E0PJBNBA tag=5ZBP3CA1NKI2 type=write size=322033 2024-09-14T11:01:52.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.361+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=S0J1RFK7E5FU type=del size=486081 2024-09-14T11:01:52.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.362+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=IE59EFLDJVMM type=del 2024-09-14T11:01:52.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.364+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~K4OFU5M6VYZH.0 size=1048576 2024-09-14T11:01:52.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.366+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~K4OFU5M6VYZH.1 size=727549 2024-09-14T11:01:52.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.366+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=K4OFU5M6VYZH tag=63EOUKNG0I51 type=write size=2824701 2024-09-14T11:01:52.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.367+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=LHHFCEJIMZD4 type=del 2024-09-14T11:01:52.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.369+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=U13GI4WB36TI type=write size=693921 2024-09-14T11:01:52.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.371+0000 7fe3dd11f780 1 < suggested update operation key=A89YQO40BHUS tag=I90YF0Q2QBXM type=write size=338916 2024-09-14T11:01:52.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.373+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~5LCZ8BD3LMZ1.0 size=1048576 2024-09-14T11:01:52.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.374+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~5LCZ8BD3LMZ1.1 size=986939 2024-09-14T11:01:52.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.374+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=5LCZ8BD3LMZ1 tag=UN379T8NEZ7Y type=write size=3084091 2024-09-14T11:01:52.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.376+0000 7fe3dd11f780 1 < suggested update operation key=V692HUUJP2RC tag=BQ4KJZV3WI9C type=del size=1712481 2024-09-14T11:01:52.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.378+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=QLDUYEGBZ1YA type=del size=1146778 2024-09-14T11:01:52.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.380+0000 7fe3dd11f780 1 < suggested remove operation key=4JTN39NIB2UE tag=R0FVAJGFG27A type=write 2024-09-14T11:01:52.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.381+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=FTXI3PVLA6G0 type=del size=77510 2024-09-14T11:01:52.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.382+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=Y63ZCJG7APH6 type=del 2024-09-14T11:01:52.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.384+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~W07AZOW6MIAO.0 size=1048576 2024-09-14T11:01:52.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.386+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~W07AZOW6MIAO.1 size=1048576 2024-09-14T11:01:52.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.387+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~W07AZOW6MIAO.2 size=686749 2024-09-14T11:01:52.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.387+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=W07AZOW6MIAO tag=YGB68DHK0HVO type=write size=3832477 2024-09-14T11:01:52.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.389+0000 7fe3dd11f780 1 < suggested update operation key=NHKCRGX10WBM tag=SG0V629V27SC type=del size=3603080 2024-09-14T11:01:52.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.391+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=MYJH1WT6340L type=write size=464635 2024-09-14T11:01:52.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.393+0000 7fe3dd11f780 1 < suggested remove operation key=EGC5988RQOEZ tag=KJNROW2SPLXP type=del 2024-09-14T11:01:52.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.395+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~WMJIYP3A6LTM.0 size=1048576 2024-09-14T11:01:52.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.396+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~WMJIYP3A6LTM.1 size=577194 2024-09-14T11:01:52.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.396+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=WMJIYP3A6LTM tag=4KVSY4PP1QAL type=write size=2674346 2024-09-14T11:01:52.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.397+0000 7fe3dd11f780 1 < completed write operation key=JFLEJGPFLACM tag=93M3LZ6AL202 type=write size=119016 2024-09-14T11:01:52.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.399+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~JVWS68QFUOGW.0 size=581618 2024-09-14T11:01:52.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.399+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=JVWS68QFUOGW tag=1Q90N0Y2NJ13 type=write size=1630194 2024-09-14T11:01:52.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.401+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=ELZFG8N353MZ type=del 2024-09-14T11:01:52.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.403+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~09RMRZ93VGJU.0 size=536798 2024-09-14T11:01:52.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.403+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=09RMRZ93VGJU tag=9LJVV4NWB06H type=write size=1585374 2024-09-14T11:01:52.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.404+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=0NZ64SA2LWS2 type=del 2024-09-14T11:01:52.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.405+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=GRICORLP0YMR type=write size=820543 2024-09-14T11:01:52.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.406+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~P4ITJWFD2BUO.0 size=685969 2024-09-14T11:01:52.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.408+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=P4ITJWFD2BUO tag=2PGFRHKE2XVS type=write size=1734545 2024-09-14T11:01:52.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.410+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~H1IKG5DZBJ9G.0 size=1048576 2024-09-14T11:01:52.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.411+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~H1IKG5DZBJ9G.1 size=1048576 2024-09-14T11:01:52.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.412+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~H1IKG5DZBJ9G.2 size=353967 2024-09-14T11:01:52.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.412+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=H1IKG5DZBJ9G tag=56THV23SPUFC type=write size=3499695 2024-09-14T11:01:52.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.414+0000 7fe3dd11f780 1 < suggested remove operation key=0PT98N1VBWAG tag=JLSTD1KCI3OE type=del 2024-09-14T11:01:52.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.416+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=4CKK8UCX8WGS type=write size=115046 2024-09-14T11:01:52.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.416+0000 7fe3dd11f780 1 < canceled part key=_multipart_JFLEJGPFLACM.2~ADMPIGB2WOMH.0 size=1048576 2024-09-14T11:01:52.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.417+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~ADMPIGB2WOMH.1 size=375423 2024-09-14T11:01:52.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.419+0000 7fe3dd11f780 1 < canceled multipart upload key=JFLEJGPFLACM upload=ADMPIGB2WOMH tag=HDO0QUM406S4 type=write size=2472575 2024-09-14T11:01:52.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.420+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=RM5NWGRQDKMF type=del size=244516 2024-09-14T11:01:52.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.421+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~6YEQXX7ZWSS4.0 size=1048576 2024-09-14T11:01:52.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.422+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~6YEQXX7ZWSS4.1 size=1048576 2024-09-14T11:01:52.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.423+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~6YEQXX7ZWSS4.2 size=882156 2024-09-14T11:01:52.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.425+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=6YEQXX7ZWSS4 tag=OQZV9F6ZGPYE type=write size=4027884 2024-09-14T11:01:52.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.427+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=8EWIM9XYXL5H type=del size=2869522 2024-09-14T11:01:52.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.428+0000 7fe3dd11f780 1 < canceled operation key=VDSOBBVO3QGB tag=S0J1RFK7E5FU type=del size=486081 2024-09-14T11:01:52.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.430+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=OFMK9OH85DIU type=write size=613721 2024-09-14T11:01:52.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.431+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~K4OFU5M6VYZH.0 size=1048576 2024-09-14T11:01:52.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.432+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~K4OFU5M6VYZH.1 size=727549 2024-09-14T11:01:52.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.434+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=K4OFU5M6VYZH tag=63EOUKNG0I51 type=write size=2824701 2024-09-14T11:01:52.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.435+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=XLYOK80MS9OY type=del size=1666981 2024-09-14T11:01:52.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.437+0000 7fe3dd11f780 1 < completed write operation key=QPH41U60044L tag=U13GI4WB36TI type=write size=693921 2024-09-14T11:01:52.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.439+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~6L03Z86JATGJ.0 size=1048576 2024-09-14T11:01:52.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.440+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~6L03Z86JATGJ.1 size=499861 2024-09-14T11:01:52.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.440+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=6L03Z86JATGJ tag=M9X3JWFH6TQW type=write size=2597013 2024-09-14T11:01:52.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.441+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~5LCZ8BD3LMZ1.0 size=1048576 2024-09-14T11:01:52.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.442+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~5LCZ8BD3LMZ1.1 size=986939 2024-09-14T11:01:52.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.444+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=5LCZ8BD3LMZ1 tag=UN379T8NEZ7Y type=write size=3084091 2024-09-14T11:01:52.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.446+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~4LIAR0A5BF1C.0 size=1048576 2024-09-14T11:01:52.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.447+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~4LIAR0A5BF1C.1 size=1048576 2024-09-14T11:01:52.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.448+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~4LIAR0A5BF1C.2 size=377223 2024-09-14T11:01:52.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.448+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=4LIAR0A5BF1C tag=QEUFZVWZXZWU type=write size=3522951 2024-09-14T11:01:52.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.450+0000 7fe3dd11f780 1 < suggested remove operation key=JSEN4QXEMVHS tag=QLDUYEGBZ1YA type=del 2024-09-14T11:01:52.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.452+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=J0103RQI6JQH type=del size=1513265 2024-09-14T11:01:52.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.453+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=FTXI3PVLA6G0 type=del 2024-09-14T11:01:52.452 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.454+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=BRD5MIA6H326 type=del size=345934 2024-09-14T11:01:52.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.456+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~W07AZOW6MIAO.0 size=1048576 2024-09-14T11:01:52.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.456+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~W07AZOW6MIAO.1 size=1048576 2024-09-14T11:01:52.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.456+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~W07AZOW6MIAO.2 size=686749 2024-09-14T11:01:52.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.458+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=W07AZOW6MIAO tag=YGB68DHK0HVO type=write size=3832477 2024-09-14T11:01:52.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.460+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QPJ6B1A8TV7Y.0 size=1048576 2024-09-14T11:01:52.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.461+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QPJ6B1A8TV7Y.1 size=1048576 2024-09-14T11:01:52.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.462+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~QPJ6B1A8TV7Y.2 size=522795 2024-09-14T11:01:52.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.462+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=QPJ6B1A8TV7Y tag=KX0NF0VYCFLW type=write size=3668523 2024-09-14T11:01:52.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.464+0000 7fe3dd11f780 1 < completed write operation key=IOAG4ZE1I58Z tag=MYJH1WT6340L type=write size=464635 2024-09-14T11:01:52.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.465+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=U6CZ1H8RAS36 type=del size=1498325 2024-09-14T11:01:52.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.466+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~WMJIYP3A6LTM.0 size=1048576 2024-09-14T11:01:52.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.467+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~WMJIYP3A6LTM.1 size=577194 2024-09-14T11:01:52.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.469+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=WMJIYP3A6LTM tag=4KVSY4PP1QAL type=write size=2674346 2024-09-14T11:01:52.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.470+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=8DB08IHAZK7A type=del size=2214710 2024-09-14T11:01:52.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.471+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~JVWS68QFUOGW.0 size=581618 2024-09-14T11:01:52.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.473+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=JVWS68QFUOGW tag=1Q90N0Y2NJ13 type=write size=1630194 2024-09-14T11:01:52.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.476+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~4B05WPCCS2PZ.0 size=634224 2024-09-14T11:01:52.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.476+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=4B05WPCCS2PZ tag=FQRW8EJAKLEJ type=write size=1682800 2024-09-14T11:01:52.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.477+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~09RMRZ93VGJU.0 size=536798 2024-09-14T11:01:52.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.479+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=09RMRZ93VGJU tag=9LJVV4NWB06H type=write size=1585374 2024-09-14T11:01:52.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.480+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=WAMMS70572X0 type=write size=400465 2024-09-14T11:01:52.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.481+0000 7fe3dd11f780 1 < completed write operation key=LFKLJAJWQ2J6 tag=GRICORLP0YMR type=write size=820543 2024-09-14T11:01:52.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.482+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=053GJGI13QBW type=write size=484613 2024-09-14T11:01:52.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.483+0000 7fe3dd11f780 1 < canceled part key=_multipart_6PJ03TAYRUT8.2~H1IKG5DZBJ9G.0 size=1048576 2024-09-14T11:01:52.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.484+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~H1IKG5DZBJ9G.1 size=1048576 2024-09-14T11:01:52.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.484+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~H1IKG5DZBJ9G.2 size=353967 2024-09-14T11:01:52.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.486+0000 7fe3dd11f780 1 < canceled multipart upload key=6PJ03TAYRUT8 upload=H1IKG5DZBJ9G tag=56THV23SPUFC type=write size=3499695 2024-09-14T11:01:52.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.488+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=YBRN7TYG4BOF type=del size=1489639 2024-09-14T11:01:52.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.489+0000 7fe3dd11f780 1 < completed write operation key=V692HUUJP2RC tag=4CKK8UCX8WGS type=write size=115046 2024-09-14T11:01:52.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.490+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=PH7Z8K44NEBR type=del size=200354 2024-09-14T11:01:52.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.492+0000 7fe3dd11f780 1 < suggested remove operation key=YMGE9GKLSPE6 tag=RM5NWGRQDKMF type=del 2024-09-14T11:01:52.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.494+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=AZ55KI1U0FO6 type=del size=1758153 2024-09-14T11:01:52.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.495+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=8EWIM9XYXL5H type=del 2024-09-14T11:01:52.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.496+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=WNI8ICPEHKLJ type=write size=937125 2024-09-14T11:01:52.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.499+0000 7fe3dd11f780 -1 < failed to complete operation key=JSEN4QXEMVHS tag=OFMK9OH85DIU type=write size=613721: (22) Invalid argument 2024-09-14T11:01:52.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.500+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=0NGOI09B0NZ4 type=write size=659982 2024-09-14T11:01:52.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.501+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=XLYOK80MS9OY type=del 2024-09-14T11:01:52.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.502+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=TVQ0WHNAV0DH type=del size=1642671 2024-09-14T11:01:52.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.503+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~6L03Z86JATGJ.0 size=1048576 2024-09-14T11:01:52.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.504+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~6L03Z86JATGJ.1 size=499861 2024-09-14T11:01:52.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.506+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=6L03Z86JATGJ tag=M9X3JWFH6TQW type=write size=2597013 2024-09-14T11:01:52.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.508+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~GK6NJJ2V6ED4.0 size=1048576 2024-09-14T11:01:52.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.509+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~GK6NJJ2V6ED4.1 size=39708 2024-09-14T11:01:52.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.509+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=GK6NJJ2V6ED4 tag=1H29GRKGRYRJ type=write size=2136860 2024-09-14T11:01:52.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.510+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~4LIAR0A5BF1C.0 size=1048576 2024-09-14T11:01:52.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.511+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~4LIAR0A5BF1C.1 size=1048576 2024-09-14T11:01:52.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.512+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~4LIAR0A5BF1C.2 size=377223 2024-09-14T11:01:52.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.514+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=4LIAR0A5BF1C tag=QEUFZVWZXZWU type=write size=3522951 2024-09-14T11:01:52.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.516+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~1VKYHHLSLCFA.0 size=1048576 2024-09-14T11:01:52.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.517+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~1VKYHHLSLCFA.1 size=631051 2024-09-14T11:01:52.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.517+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=1VKYHHLSLCFA tag=LH86FAJXQRAA type=write size=2728203 2024-09-14T11:01:52.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.518+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=J0103RQI6JQH type=del 2024-09-14T11:01:52.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.519+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=KP60XXL3JK4N type=del size=4042083 2024-09-14T11:01:52.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.520+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=BRD5MIA6H326 type=del 2024-09-14T11:01:52.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.522+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~7T74SVSO96OV.0 size=1048576 2024-09-14T11:01:52.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.523+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~7T74SVSO96OV.1 size=611371 2024-09-14T11:01:52.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.523+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=7T74SVSO96OV tag=B2QCJV003OOA type=write size=2708523 2024-09-14T11:01:52.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.524+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QPJ6B1A8TV7Y.0 size=1048576 2024-09-14T11:01:52.523 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.525+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QPJ6B1A8TV7Y.1 size=1048576 2024-09-14T11:01:52.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.526+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~QPJ6B1A8TV7Y.2 size=522795 2024-09-14T11:01:52.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.528+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=QPJ6B1A8TV7Y tag=KX0NF0VYCFLW type=write size=3668523 2024-09-14T11:01:52.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.530+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~2NU4ONJ1FSUO.0 size=1048576 2024-09-14T11:01:52.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.531+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~2NU4ONJ1FSUO.1 size=1048576 2024-09-14T11:01:52.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.532+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~2NU4ONJ1FSUO.2 size=862520 2024-09-14T11:01:52.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.532+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=2NU4ONJ1FSUO tag=GWJUTQ8ZCLL8 type=write size=4008248 2024-09-14T11:01:52.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.533+0000 7fe3dd11f780 1 < canceled operation key=QPH41U60044L tag=U6CZ1H8RAS36 type=del size=1498325 2024-09-14T11:01:52.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.535+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=B3F6B8ZPG41A type=del size=2562323 2024-09-14T11:01:52.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.536+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=8DB08IHAZK7A type=del 2024-09-14T11:01:52.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.537+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=E2E4HUFNQ9EE type=del size=3151153 2024-09-14T11:01:52.536 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.538+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~4B05WPCCS2PZ.0 size=634224 2024-09-14T11:01:52.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.540+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=4B05WPCCS2PZ tag=FQRW8EJAKLEJ type=write size=1682800 2024-09-14T11:01:52.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.542+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~WO79LCISKTOD.0 size=670255 2024-09-14T11:01:52.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.542+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=WO79LCISKTOD tag=X2X8K5HTTYHR type=write size=1718831 2024-09-14T11:01:52.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.543+0000 7fe3dd11f780 1 < canceled operation key=LFKLJAJWQ2J6 tag=WAMMS70572X0 type=write size=400465 2024-09-14T11:01:52.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.545+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~431UPDB3EYD7.0 size=1048576 2024-09-14T11:01:52.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.546+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~431UPDB3EYD7.1 size=18685 2024-09-14T11:01:52.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.546+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=431UPDB3EYD7 tag=IOOQ3Q3VSHS9 type=write size=2115837 2024-09-14T11:01:52.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.548+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=053GJGI13QBW type=write size=484613 2024-09-14T11:01:52.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.549+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=CRG7UXZV5P0S type=del size=1199061 2024-09-14T11:01:52.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.550+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=YBRN7TYG4BOF type=del 2024-09-14T11:01:52.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.551+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=3EQRR94WLCLM type=del size=3527049 2024-09-14T11:01:52.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.552+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=PH7Z8K44NEBR type=del 2024-09-14T11:01:52.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.554+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~ONDOKRSJ9JAO.0 size=310106 2024-09-14T11:01:52.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.554+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=ONDOKRSJ9JAO tag=C3J762LMRK69 type=write size=1358682 2024-09-14T11:01:52.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.555+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=AZ55KI1U0FO6 type=del 2024-09-14T11:01:52.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.558+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~LX1FCJ89DXQ4.0 size=1048576 2024-09-14T11:01:52.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.559+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~LX1FCJ89DXQ4.1 size=1048576 2024-09-14T11:01:52.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.559+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~LX1FCJ89DXQ4.2 size=540265 2024-09-14T11:01:52.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.559+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=LX1FCJ89DXQ4 tag=S7839YLWFOGI type=write size=3685993 2024-09-14T11:01:52.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.562+0000 7fe3dd11f780 1 < suggested remove operation key=ZI5SFHGWCHJA tag=WNI8ICPEHKLJ type=write 2024-09-14T11:01:52.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.564+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~E43SWOEFPFBN.0 size=1048576 2024-09-14T11:01:52.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.565+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~E43SWOEFPFBN.1 size=941264 2024-09-14T11:01:52.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.565+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=E43SWOEFPFBN tag=QCAOP0B8M98T type=write size=3038416 2024-09-14T11:01:52.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.566+0000 7fe3dd11f780 1 < completed write operation key=UYZGHGZR74HQ tag=0NGOI09B0NZ4 type=write size=659982 2024-09-14T11:01:52.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.567+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=PR0QHPUP2K4Z type=del size=2044812 2024-09-14T11:01:52.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.568+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=TVQ0WHNAV0DH type=del 2024-09-14T11:01:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.570+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~6A271ZWPWOW6.0 size=1048576 2024-09-14T11:01:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.571+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~6A271ZWPWOW6.1 size=559060 2024-09-14T11:01:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.571+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=6A271ZWPWOW6 tag=18L6Q7PJ4ETN type=write size=2656212 2024-09-14T11:01:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.573+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~GK6NJJ2V6ED4.0 size=1048576 2024-09-14T11:01:52.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.573+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~GK6NJJ2V6ED4.1 size=39708 2024-09-14T11:01:52.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.576+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=GK6NJJ2V6ED4 tag=1H29GRKGRYRJ type=write size=2136860 2024-09-14T11:01:52.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.578+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~WQM7OL7CHQ9Q.0 size=1048576 2024-09-14T11:01:52.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.579+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~WQM7OL7CHQ9Q.1 size=364694 2024-09-14T11:01:52.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.579+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=WQM7OL7CHQ9Q tag=4U7GEPZXND9G type=write size=2461846 2024-09-14T11:01:52.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.580+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~1VKYHHLSLCFA.0 size=1048576 2024-09-14T11:01:52.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.580+0000 7fe3dd11f780 1 < canceled part key=_multipart_22TI1VCDTK5P.2~1VKYHHLSLCFA.1 size=631051 2024-09-14T11:01:52.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.582+0000 7fe3dd11f780 1 < canceled multipart upload key=22TI1VCDTK5P upload=1VKYHHLSLCFA tag=LH86FAJXQRAA type=write size=2728203 2024-09-14T11:01:52.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.583+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=0167XSZ3W57J type=del size=2796030 2024-09-14T11:01:52.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.584+0000 7fe3dd11f780 1 < canceled operation key=JSEN4QXEMVHS tag=KP60XXL3JK4N type=del size=4042083 2024-09-14T11:01:52.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.586+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~XVB8ZC8H2MWO.0 size=1048576 2024-09-14T11:01:52.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.587+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~XVB8ZC8H2MWO.1 size=18442 2024-09-14T11:01:52.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.587+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=XVB8ZC8H2MWO tag=MFJTBKEVCK5W type=write size=2115594 2024-09-14T11:01:52.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.588+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~7T74SVSO96OV.0 size=1048576 2024-09-14T11:01:52.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.589+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~7T74SVSO96OV.1 size=611371 2024-09-14T11:01:52.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.591+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=7T74SVSO96OV tag=B2QCJV003OOA type=write size=2708523 2024-09-14T11:01:52.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.593+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~5SUW1NLFAO2L.0 size=1048576 2024-09-14T11:01:52.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.594+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~5SUW1NLFAO2L.1 size=1048576 2024-09-14T11:01:52.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.595+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~5SUW1NLFAO2L.2 size=1028303 2024-09-14T11:01:52.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.595+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=5SUW1NLFAO2L tag=RE4E3GOJ8V2D type=write size=4174031 2024-09-14T11:01:52.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.595+0000 7fe3dd11f780 1 < canceled part key=_multipart_4JTN39NIB2UE.2~2NU4ONJ1FSUO.0 size=1048576 2024-09-14T11:01:52.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.596+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~2NU4ONJ1FSUO.1 size=1048576 2024-09-14T11:01:52.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.597+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~2NU4ONJ1FSUO.2 size=862520 2024-09-14T11:01:52.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.599+0000 7fe3dd11f780 1 < canceled multipart upload key=4JTN39NIB2UE upload=2NU4ONJ1FSUO tag=GWJUTQ8ZCLL8 type=write size=4008248 2024-09-14T11:01:52.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.601+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=Y9L79Q8PQ19J type=write size=463810 2024-09-14T11:01:52.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.602+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=B3F6B8ZPG41A type=del 2024-09-14T11:01:52.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.603+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=72BLCHM8ADLH type=del size=362623 2024-09-14T11:01:52.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.607+0000 7fe3dd11f780 1 < suggested remove operation key=OK5L92EKOOMW tag=E2E4HUFNQ9EE type=del 2024-09-14T11:01:52.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.608+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=42C6QBKFTWXX type=del size=3735441 2024-09-14T11:01:52.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.608+0000 7fe3dd11f780 1 < canceled part key=_multipart_YMGE9GKLSPE6.2~WO79LCISKTOD.0 size=670255 2024-09-14T11:01:52.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.610+0000 7fe3dd11f780 1 < canceled multipart upload key=YMGE9GKLSPE6 upload=WO79LCISKTOD tag=X2X8K5HTTYHR type=write size=1718831 2024-09-14T11:01:52.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.611+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=358OEVDJ61VG type=write size=542367 2024-09-14T11:01:52.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.611+0000 7fe3dd11f780 1 < canceled part key=_multipart_OK5L92EKOOMW.2~431UPDB3EYD7.0 size=1048576 2024-09-14T11:01:52.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.612+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~431UPDB3EYD7.1 size=18685 2024-09-14T11:01:52.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.614+0000 7fe3dd11f780 1 < canceled multipart upload key=OK5L92EKOOMW upload=431UPDB3EYD7 tag=IOOQ3Q3VSHS9 type=write size=2115837 2024-09-14T11:01:52.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.616+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~3PD41OZZMUB7.0 size=1048576 2024-09-14T11:01:52.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.617+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~3PD41OZZMUB7.1 size=337154 2024-09-14T11:01:52.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.617+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=3PD41OZZMUB7 tag=95YI319NSDPY type=write size=2434306 2024-09-14T11:01:52.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.618+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=CRG7UXZV5P0S type=del 2024-09-14T11:01:52.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.619+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=DSS2G5PTB4YX type=del size=1367884 2024-09-14T11:01:52.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.621+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=3EQRR94WLCLM type=del 2024-09-14T11:01:52.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.623+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~M7I54OYU0X35.0 size=822344 2024-09-14T11:01:52.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.623+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=M7I54OYU0X35 tag=BCC05UMN4VN6 type=write size=1870920 2024-09-14T11:01:52.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.624+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~ONDOKRSJ9JAO.0 size=310106 2024-09-14T11:01:52.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.626+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=ONDOKRSJ9JAO tag=C3J762LMRK69 type=write size=1358682 2024-09-14T11:01:52.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.627+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=1W43M7HOF6B4 type=del size=173962 2024-09-14T11:01:52.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.628+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~LX1FCJ89DXQ4.0 size=1048576 2024-09-14T11:01:52.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.629+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~LX1FCJ89DXQ4.1 size=1048576 2024-09-14T11:01:52.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.630+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~LX1FCJ89DXQ4.2 size=540265 2024-09-14T11:01:52.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.632+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=LX1FCJ89DXQ4 tag=S7839YLWFOGI type=write size=3685993 2024-09-14T11:01:52.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.633+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=PPZWVDXRHXF7 type=write size=439813 2024-09-14T11:01:52.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.634+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~E43SWOEFPFBN.0 size=1048576 2024-09-14T11:01:52.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.635+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~E43SWOEFPFBN.1 size=941264 2024-09-14T11:01:52.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.637+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=E43SWOEFPFBN tag=QCAOP0B8M98T type=write size=3038416 2024-09-14T11:01:52.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.638+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=2A7ESUW0JD0I type=del size=2836239 2024-09-14T11:01:52.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.639+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=PR0QHPUP2K4Z type=del 2024-09-14T11:01:52.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.640+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=3SS05LQYY7QX type=del size=2162365 2024-09-14T11:01:52.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.641+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~6A271ZWPWOW6.0 size=1048576 2024-09-14T11:01:52.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.642+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~6A271ZWPWOW6.1 size=559060 2024-09-14T11:01:52.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.644+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=6A271ZWPWOW6 tag=18L6Q7PJ4ETN type=write size=2656212 2024-09-14T11:01:52.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.645+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=WZ688GEXONER type=del size=1178638 2024-09-14T11:01:52.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.646+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~WQM7OL7CHQ9Q.0 size=1048576 2024-09-14T11:01:52.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.647+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~WQM7OL7CHQ9Q.1 size=364694 2024-09-14T11:01:52.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.649+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=WQM7OL7CHQ9Q tag=4U7GEPZXND9G type=write size=2461846 2024-09-14T11:01:52.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.651+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~T94MRDLKADHA.0 size=1048576 2024-09-14T11:01:52.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.652+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~T94MRDLKADHA.1 size=1048576 2024-09-14T11:01:52.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.653+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~T94MRDLKADHA.2 size=871080 2024-09-14T11:01:52.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.653+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=T94MRDLKADHA tag=YASLYRJCS2K5 type=write size=4016808 2024-09-14T11:01:52.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.654+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=0167XSZ3W57J type=del 2024-09-14T11:01:52.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.656+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~KVGVKA2UH17O.0 size=1048576 2024-09-14T11:01:52.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.657+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~KVGVKA2UH17O.1 size=372241 2024-09-14T11:01:52.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.657+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=KVGVKA2UH17O tag=D0MK42YZBXQ5 type=write size=2469393 2024-09-14T11:01:52.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.658+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~XVB8ZC8H2MWO.0 size=1048576 2024-09-14T11:01:52.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.659+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~XVB8ZC8H2MWO.1 size=18442 2024-09-14T11:01:52.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.661+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=XVB8ZC8H2MWO tag=MFJTBKEVCK5W type=write size=2115594 2024-09-14T11:01:52.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.662+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=LXNQHA0DRKRB type=del size=2108895 2024-09-14T11:01:52.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.663+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~5SUW1NLFAO2L.0 size=1048576 2024-09-14T11:01:52.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.664+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~5SUW1NLFAO2L.1 size=1048576 2024-09-14T11:01:52.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.665+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~5SUW1NLFAO2L.2 size=1028303 2024-09-14T11:01:52.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.667+0000 7fe3dd11f780 1 < canceled multipart upload key=GQEFQ1UD6QCJ upload=5SUW1NLFAO2L tag=RE4E3GOJ8V2D type=write size=4174031 2024-09-14T11:01:52.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.669+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~DFCDNMH97MFZ.0 size=1048576 2024-09-14T11:01:52.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.670+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~DFCDNMH97MFZ.1 size=1048576 2024-09-14T11:01:52.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.671+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~DFCDNMH97MFZ.2 size=992651 2024-09-14T11:01:52.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.671+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=DFCDNMH97MFZ tag=LD873GENTN94 type=write size=4138379 2024-09-14T11:01:52.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.672+0000 7fe3dd11f780 1 < completed write operation key=JSEN4QXEMVHS tag=Y9L79Q8PQ19J type=write size=463810 2024-09-14T11:01:52.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.674+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TUNZ4J054S8C.0 size=1048576 2024-09-14T11:01:52.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.675+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TUNZ4J054S8C.1 size=1048576 2024-09-14T11:01:52.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.676+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TUNZ4J054S8C.2 size=941806 2024-09-14T11:01:52.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.676+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=TUNZ4J054S8C tag=ABE1XPA5P6L6 type=write size=4087534 2024-09-14T11:01:52.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.678+0000 7fe3dd11f780 1 < suggested update operation key=4JTN39NIB2UE tag=72BLCHM8ADLH type=del size=362623 2024-09-14T11:01:52.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.679+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=56JBOMSW663A type=del size=2397698 2024-09-14T11:01:52.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.680+0000 7fe3dd11f780 1 < canceled operation key=KXL3E0PJBNBA tag=42C6QBKFTWXX type=del size=3735441 2024-09-14T11:01:52.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.682+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=JKJ6QDVYNEAI type=del size=917124 2024-09-14T11:01:52.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.683+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=358OEVDJ61VG type=write size=542367 2024-09-14T11:01:52.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.685+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~5OVCD2PDOCNI.0 size=1048576 2024-09-14T11:01:52.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.686+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~5OVCD2PDOCNI.1 size=1048576 2024-09-14T11:01:52.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.687+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~5OVCD2PDOCNI.2 size=341206 2024-09-14T11:01:52.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.687+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=5OVCD2PDOCNI tag=9XJRI8W4XST6 type=write size=3486934 2024-09-14T11:01:52.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.688+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~3PD41OZZMUB7.0 size=1048576 2024-09-14T11:01:52.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.689+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~3PD41OZZMUB7.1 size=337154 2024-09-14T11:01:52.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.691+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=3PD41OZZMUB7 tag=95YI319NSDPY type=write size=2434306 2024-09-14T11:01:52.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.693+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=QIB4QVU0WE3D type=del size=3138794 2024-09-14T11:01:52.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.694+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=DSS2G5PTB4YX type=del 2024-09-14T11:01:52.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.696+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~17MPDLY7JXKP.0 size=746503 2024-09-14T11:01:52.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.696+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=17MPDLY7JXKP tag=8N4FNX8XCSCG type=write size=1795079 2024-09-14T11:01:52.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.697+0000 7fe3dd11f780 1 < canceled part key=_multipart_IOAG4ZE1I58Z.2~M7I54OYU0X35.0 size=822344 2024-09-14T11:01:52.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.699+0000 7fe3dd11f780 1 < canceled multipart upload key=IOAG4ZE1I58Z upload=M7I54OYU0X35 tag=BCC05UMN4VN6 type=write size=1870920 2024-09-14T11:01:52.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.700+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=LO54RJ9JCMQF type=del size=3788953 2024-09-14T11:01:52.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.701+0000 7fe3dd11f780 1 < canceled operation key=LL9VJXEU13IK tag=1W43M7HOF6B4 type=del size=173962 2024-09-14T11:01:52.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.703+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~6W9W3HGMRQJ4.0 size=1048576 2024-09-14T11:01:52.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.704+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~6W9W3HGMRQJ4.1 size=1048576 2024-09-14T11:01:52.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.705+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~6W9W3HGMRQJ4.2 size=802461 2024-09-14T11:01:52.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.705+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=6W9W3HGMRQJ4 tag=00RL31VRXS6Y type=write size=3948189 2024-09-14T11:01:52.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.706+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=PPZWVDXRHXF7 type=write size=439813 2024-09-14T11:01:52.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.708+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~1CEYFLMGZQUA.0 size=593957 2024-09-14T11:01:52.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.708+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=1CEYFLMGZQUA tag=6MC6FFVIV3HR type=write size=1642533 2024-09-14T11:01:52.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.710+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=2A7ESUW0JD0I type=del 2024-09-14T11:01:52.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.711+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=PEAOA614XYJ0 type=del size=2438318 2024-09-14T11:01:52.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.713+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=3SS05LQYY7QX type=del 2024-09-14T11:01:52.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.715+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~178QLSVAXXNH.0 size=1048576 2024-09-14T11:01:52.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.716+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~178QLSVAXXNH.1 size=551058 2024-09-14T11:01:52.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.716+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=178QLSVAXXNH tag=R8HXFSPDAXU1 type=write size=2648210 2024-09-14T11:01:52.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.717+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=WZ688GEXONER type=del 2024-09-14T11:01:52.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.719+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~R609HVFC544L.0 size=767583 2024-09-14T11:01:52.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.719+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=R609HVFC544L tag=6JKC1K97VRS0 type=write size=1816159 2024-09-14T11:01:52.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.721+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~T94MRDLKADHA.0 size=1048576 2024-09-14T11:01:52.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.722+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~T94MRDLKADHA.1 size=1048576 2024-09-14T11:01:52.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.723+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~T94MRDLKADHA.2 size=871080 2024-09-14T11:01:52.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.724+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=T94MRDLKADHA tag=YASLYRJCS2K5 type=write size=4016808 2024-09-14T11:01:52.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.727+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~G7AFBAWCKPJD.0 size=1033328 2024-09-14T11:01:52.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.727+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=G7AFBAWCKPJD tag=XIJGMOOKNWCU type=write size=2081904 2024-09-14T11:01:52.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.728+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~KVGVKA2UH17O.0 size=1048576 2024-09-14T11:01:52.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.729+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~KVGVKA2UH17O.1 size=372241 2024-09-14T11:01:52.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.731+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=KVGVKA2UH17O tag=D0MK42YZBXQ5 type=write size=2469393 2024-09-14T11:01:52.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.733+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~WH22VZGZPA1Y.0 size=730546 2024-09-14T11:01:52.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.733+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=WH22VZGZPA1Y tag=UKOZQN3TH89E type=write size=1779122 2024-09-14T11:01:52.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.735+0000 7fe3dd11f780 1 < suggested update operation key=YMGE9GKLSPE6 tag=LXNQHA0DRKRB type=del size=2108895 2024-09-14T11:01:52.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.737+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=JLWJCY2VO5SE type=del size=1690356 2024-09-14T11:01:52.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.738+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~DFCDNMH97MFZ.0 size=1048576 2024-09-14T11:01:52.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.738+0000 7fe3dd11f780 1 < canceled part key=_multipart_JFLEJGPFLACM.2~DFCDNMH97MFZ.1 size=1048576 2024-09-14T11:01:52.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.739+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~DFCDNMH97MFZ.2 size=992651 2024-09-14T11:01:52.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.741+0000 7fe3dd11f780 1 < canceled multipart upload key=JFLEJGPFLACM upload=DFCDNMH97MFZ tag=LD873GENTN94 type=write size=4138379 2024-09-14T11:01:52.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.743+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~9XK7OGH4HFCH.0 size=905965 2024-09-14T11:01:52.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.743+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=9XK7OGH4HFCH tag=QOO2KGRH29ZC type=write size=1954541 2024-09-14T11:01:52.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.744+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TUNZ4J054S8C.0 size=1048576 2024-09-14T11:01:52.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.745+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TUNZ4J054S8C.1 size=1048576 2024-09-14T11:01:52.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.746+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TUNZ4J054S8C.2 size=941806 2024-09-14T11:01:52.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.748+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=TUNZ4J054S8C tag=ABE1XPA5P6L6 type=write size=4087534 2024-09-14T11:01:52.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.749+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=EJT0X33JF37O type=del size=2958696 2024-09-14T11:01:52.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.750+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=56JBOMSW663A type=del 2024-09-14T11:01:52.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.752+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=NJSLV3AQN3EG type=del size=1152989 2024-09-14T11:01:52.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.755+0000 7fe3dd11f780 1 < suggested update operation key=ODDNSHK5YMNO tag=JKJ6QDVYNEAI type=del size=917124 2024-09-14T11:01:52.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.756+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=S19TEFN1F1WP type=del size=1176971 2024-09-14T11:01:52.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.756+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~5OVCD2PDOCNI.0 size=1048576 2024-09-14T11:01:52.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.757+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~5OVCD2PDOCNI.1 size=1048576 2024-09-14T11:01:52.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.758+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~5OVCD2PDOCNI.2 size=341206 2024-09-14T11:01:52.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.761+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=5OVCD2PDOCNI tag=9XJRI8W4XST6 type=write size=3486934 2024-09-14T11:01:52.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.762+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=9BIPZMB4F46X type=del size=2387211 2024-09-14T11:01:52.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.764+0000 7fe3dd11f780 1 < suggested update operation key=KXL3E0PJBNBA tag=QIB4QVU0WE3D type=del size=3138794 2024-09-14T11:01:52.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.766+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=E77U3L9ZEVCT type=del size=3274192 2024-09-14T11:01:52.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.767+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~17MPDLY7JXKP.0 size=746503 2024-09-14T11:01:52.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.770+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=17MPDLY7JXKP tag=8N4FNX8XCSCG type=write size=1795079 2024-09-14T11:01:52.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.771+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=1O5IQJIB6TON type=del size=1469633 2024-09-14T11:01:52.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.772+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=LO54RJ9JCMQF type=del 2024-09-14T11:01:52.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.773+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=M8U6PZSKWJ6B type=del size=2486595 2024-09-14T11:01:52.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.774+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~6W9W3HGMRQJ4.0 size=1048576 2024-09-14T11:01:52.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.775+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~6W9W3HGMRQJ4.1 size=1048576 2024-09-14T11:01:52.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.776+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~6W9W3HGMRQJ4.2 size=802461 2024-09-14T11:01:52.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.778+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=6W9W3HGMRQJ4 tag=00RL31VRXS6Y type=write size=3948189 2024-09-14T11:01:52.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.780+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=QPGW4DXSZD8M type=del size=1249743 2024-09-14T11:01:52.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.780+0000 7fe3dd11f780 1 < canceled part key=_multipart_6PJ03TAYRUT8.2~1CEYFLMGZQUA.0 size=593957 2024-09-14T11:01:52.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.782+0000 7fe3dd11f780 1 < canceled multipart upload key=6PJ03TAYRUT8 upload=1CEYFLMGZQUA tag=6MC6FFVIV3HR type=write size=1642533 2024-09-14T11:01:52.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.783+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=MQVIXLL111FX type=del size=2412837 2024-09-14T11:01:52.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.784+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=PEAOA614XYJ0 type=del 2024-09-14T11:01:52.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.786+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~1B77RT687CSJ.0 size=1048576 2024-09-14T11:01:52.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.787+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~1B77RT687CSJ.1 size=371572 2024-09-14T11:01:52.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.787+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=1B77RT687CSJ tag=MQG0QMONX4X2 type=write size=2468724 2024-09-14T11:01:52.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.788+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~178QLSVAXXNH.0 size=1048576 2024-09-14T11:01:52.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.789+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~178QLSVAXXNH.1 size=551058 2024-09-14T11:01:52.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.791+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=178QLSVAXXNH tag=R8HXFSPDAXU1 type=write size=2648210 2024-09-14T11:01:52.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.793+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~ZXUGL2ZJKMP7.0 size=909222 2024-09-14T11:01:52.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.793+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=ZXUGL2ZJKMP7 tag=X9KERP1UIGFO type=write size=1957798 2024-09-14T11:01:52.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.795+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~R609HVFC544L.0 size=767583 2024-09-14T11:01:52.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.797+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=R609HVFC544L tag=6JKC1K97VRS0 type=write size=1816159 2024-09-14T11:01:52.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.798+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=DI145QFFUHRN type=del size=570687 2024-09-14T11:01:52.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.799+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~G7AFBAWCKPJD.0 size=1033328 2024-09-14T11:01:52.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.801+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=G7AFBAWCKPJD tag=XIJGMOOKNWCU type=write size=2081904 2024-09-14T11:01:52.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.802+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=EZQQWBA9NMDE type=del size=1516021 2024-09-14T11:01:52.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.803+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~WH22VZGZPA1Y.0 size=730546 2024-09-14T11:01:52.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.805+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=WH22VZGZPA1Y tag=UKOZQN3TH89E type=write size=1779122 2024-09-14T11:01:52.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.807+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=K3Y8A7KYSA23 type=del size=1533466 2024-09-14T11:01:52.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.808+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=JLWJCY2VO5SE type=del 2024-09-14T11:01:52.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.809+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=G91LYQ5N4CKV type=del size=38686 2024-09-14T11:01:52.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.810+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~9XK7OGH4HFCH.0 size=905965 2024-09-14T11:01:52.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.812+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=9XK7OGH4HFCH tag=QOO2KGRH29ZC type=write size=1954541 2024-09-14T11:01:52.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.814+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=NOJEBDFB2QID type=del size=3526793 2024-09-14T11:01:52.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.815+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=EJT0X33JF37O type=del 2024-09-14T11:01:52.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.817+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~LWUNRMDXMI2H.0 size=935348 2024-09-14T11:01:52.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.817+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=LWUNRMDXMI2H tag=KZH3835860Y8 type=write size=1983924 2024-09-14T11:01:52.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.819+0000 7fe3dd11f780 1 < suggested remove operation key=K9BP30LHDPA1 tag=NJSLV3AQN3EG type=del 2024-09-14T11:01:52.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.821+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=TE24NK82P28F type=del size=3663608 2024-09-14T11:01:52.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.822+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=S19TEFN1F1WP type=del 2024-09-14T11:01:52.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.823+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=8FX6EVCQNZPU type=del size=728378 2024-09-14T11:01:52.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.824+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=9BIPZMB4F46X type=del 2024-09-14T11:01:52.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.827+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MG72K3XLG3FH.0 size=1048576 2024-09-14T11:01:52.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.828+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MG72K3XLG3FH.1 size=206484 2024-09-14T11:01:52.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.828+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=MG72K3XLG3FH tag=VGBK5I7EHZT1 type=write size=2303636 2024-09-14T11:01:52.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.829+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=E77U3L9ZEVCT type=del 2024-09-14T11:01:52.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.832+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~TIHLQRT7A86I.0 size=824865 2024-09-14T11:01:52.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.832+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=TIHLQRT7A86I tag=BUAEUVEX37XF type=write size=1873441 2024-09-14T11:01:52.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.833+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=1O5IQJIB6TON type=del 2024-09-14T11:01:52.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.835+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~I93C8XXWBP16.0 size=1048576 2024-09-14T11:01:52.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.836+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~I93C8XXWBP16.1 size=1048576 2024-09-14T11:01:52.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.837+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~I93C8XXWBP16.2 size=70825 2024-09-14T11:01:52.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.837+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=I93C8XXWBP16 tag=YF22B30YOEUE type=write size=3216553 2024-09-14T11:01:52.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.838+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=M8U6PZSKWJ6B type=del 2024-09-14T11:01:52.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.839+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=2UZBFFOJYUYQ type=del size=3211530 2024-09-14T11:01:52.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.840+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=QPGW4DXSZD8M type=del 2024-09-14T11:01:52.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.842+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=5WVWDRJR72XD type=write size=12309 2024-09-14T11:01:52.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.844+0000 7fe3dd11f780 1 < suggested remove operation key=JG1RZQD4J2EB tag=MQVIXLL111FX type=del 2024-09-14T11:01:52.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.846+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=7OUT5D1VSLFE type=del size=401353 2024-09-14T11:01:52.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.847+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~1B77RT687CSJ.0 size=1048576 2024-09-14T11:01:52.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.848+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~1B77RT687CSJ.1 size=371572 2024-09-14T11:01:52.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.850+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=1B77RT687CSJ tag=MQG0QMONX4X2 type=write size=2468724 2024-09-14T11:01:52.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.851+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=KPSV5HOC71OO type=del size=148989 2024-09-14T11:01:52.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.853+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~ZXUGL2ZJKMP7.0 size=909222 2024-09-14T11:01:52.852 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.855+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=ZXUGL2ZJKMP7 tag=X9KERP1UIGFO type=write size=1957798 2024-09-14T11:01:52.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.856+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=CD4YYWDRLMVK type=del size=1445675 2024-09-14T11:01:52.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.857+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=DI145QFFUHRN type=del 2024-09-14T11:01:52.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.858+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=MW0YDNMOZROA type=write size=333295 2024-09-14T11:01:52.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.859+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=EZQQWBA9NMDE type=del 2024-09-14T11:01:52.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.861+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=AI3B6II1FDEJ type=del size=3137926 2024-09-14T11:01:52.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.862+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=K3Y8A7KYSA23 type=del 2024-09-14T11:01:52.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.863+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=3PRFXEIWNLQF type=del size=3419676 2024-09-14T11:01:52.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.866+0000 7fe3dd11f780 1 < suggested remove operation key=EGC5988RQOEZ tag=G91LYQ5N4CKV type=del 2024-09-14T11:01:52.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.867+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=FZCD7WP4HGG6 type=del size=1827314 2024-09-14T11:01:52.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.868+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=NOJEBDFB2QID type=del 2024-09-14T11:01:52.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.869+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=PI2UN4MP250U type=del size=3294202 2024-09-14T11:01:52.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.871+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~LWUNRMDXMI2H.0 size=935348 2024-09-14T11:01:52.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.873+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=LWUNRMDXMI2H tag=KZH3835860Y8 type=write size=1983924 2024-09-14T11:01:52.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.875+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~RJQU3C35YK5Z.0 size=345426 2024-09-14T11:01:52.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.875+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=RJQU3C35YK5Z tag=PNJM4JNSOX12 type=write size=1394002 2024-09-14T11:01:52.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.876+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=TE24NK82P28F type=del 2024-09-14T11:01:52.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.878+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~OVQ9OOPYTOD5.0 size=472780 2024-09-14T11:01:52.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.878+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=OVQ9OOPYTOD5 tag=0414C3UW46B6 type=write size=1521356 2024-09-14T11:01:52.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.879+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=8FX6EVCQNZPU type=del 2024-09-14T11:01:52.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.881+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=37Z57RZAATX0 type=write size=257579 2024-09-14T11:01:52.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.882+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MG72K3XLG3FH.0 size=1048576 2024-09-14T11:01:52.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.883+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MG72K3XLG3FH.1 size=206484 2024-09-14T11:01:52.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.885+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=MG72K3XLG3FH tag=VGBK5I7EHZT1 type=write size=2303636 2024-09-14T11:01:52.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.886+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=XED3B1A5I1HP type=del size=754815 2024-09-14T11:01:52.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.888+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~TIHLQRT7A86I.0 size=824865 2024-09-14T11:01:52.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.889+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=TIHLQRT7A86I tag=BUAEUVEX37XF type=write size=1873441 2024-09-14T11:01:52.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.891+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=F32M7RH8M802 type=write size=767583 2024-09-14T11:01:52.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.892+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~I93C8XXWBP16.0 size=1048576 2024-09-14T11:01:52.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.893+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~I93C8XXWBP16.1 size=1048576 2024-09-14T11:01:52.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.894+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~I93C8XXWBP16.2 size=70825 2024-09-14T11:01:52.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.896+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=I93C8XXWBP16 tag=YF22B30YOEUE type=write size=3216553 2024-09-14T11:01:52.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.898+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~8L7F2HY525VR.0 size=1048576 2024-09-14T11:01:52.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.899+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~8L7F2HY525VR.1 size=952113 2024-09-14T11:01:52.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.899+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=8L7F2HY525VR tag=MN3YSY85AGCK type=write size=3049265 2024-09-14T11:01:52.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.900+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=2UZBFFOJYUYQ type=del 2024-09-14T11:01:52.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.902+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=5A4NGC7VJGLP type=write size=561226 2024-09-14T11:01:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.903+0000 7fe3dd11f780 1 < completed write operation key=UYZGHGZR74HQ tag=5WVWDRJR72XD type=write size=12309 2024-09-14T11:01:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.905+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~DL6BLURBDB4X.0 size=1048576 2024-09-14T11:01:52.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.906+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~DL6BLURBDB4X.1 size=449349 2024-09-14T11:01:52.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.906+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=DL6BLURBDB4X tag=7FZZ9QXOWBR8 type=write size=2546501 2024-09-14T11:01:52.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.908+0000 7fe3dd11f780 1 < suggested update operation key=ZI5SFHGWCHJA tag=7OUT5D1VSLFE type=del size=401353 2024-09-14T11:01:52.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.909+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=8RA01SLSOS3O type=del size=2445927 2024-09-14T11:01:52.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.911+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=KPSV5HOC71OO type=del 2024-09-14T11:01:52.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.912+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=5FH07L1TOKDG type=write size=21572 2024-09-14T11:01:52.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.915+0000 7fe3dd11f780 1 < suggested remove operation key=4JTN39NIB2UE tag=CD4YYWDRLMVK type=del 2024-09-14T11:01:52.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.916+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=X5S4FH32VU9F type=del size=3691975 2024-09-14T11:01:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.918+0000 7fe3dd11f780 1 < suggested remove operation key=LL9VJXEU13IK tag=MW0YDNMOZROA type=write 2024-09-14T11:01:52.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.921+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~Z1GEYKYCIDO6.0 size=327402 2024-09-14T11:01:52.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.921+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=Z1GEYKYCIDO6 tag=1F223ZDLJLSJ type=write size=1375978 2024-09-14T11:01:52.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.922+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=AI3B6II1FDEJ type=del 2024-09-14T11:01:52.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.923+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=AX8QI31OQG3B type=write size=853467 2024-09-14T11:01:52.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.925+0000 7fe3dd11f780 1 < suggested remove operation key=3PS4LAML698X tag=3PRFXEIWNLQF type=del 2024-09-14T11:01:52.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.927+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~7005VOYOZYUD.0 size=1048576 2024-09-14T11:01:52.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.928+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~7005VOYOZYUD.1 size=578036 2024-09-14T11:01:52.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.928+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=7005VOYOZYUD tag=9GZBA6UC7SM2 type=write size=2675188 2024-09-14T11:01:52.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.929+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=FZCD7WP4HGG6 type=del 2024-09-14T11:01:52.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.931+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=3R74UGK5MRAP type=write size=628084 2024-09-14T11:01:52.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.932+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=PI2UN4MP250U type=del 2024-09-14T11:01:52.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.933+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=WKLGJZR5K9V7 type=del size=3449535 2024-09-14T11:01:52.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.934+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~RJQU3C35YK5Z.0 size=345426 2024-09-14T11:01:52.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.936+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=RJQU3C35YK5Z tag=PNJM4JNSOX12 type=write size=1394002 2024-09-14T11:01:52.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.938+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=OIERAKSUWBOK type=del size=3087466 2024-09-14T11:01:52.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.939+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~OVQ9OOPYTOD5.0 size=472780 2024-09-14T11:01:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.942+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=OVQ9OOPYTOD5 tag=0414C3UW46B6 type=write size=1521356 2024-09-14T11:01:52.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.944+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~KBARGR42HSBL.0 size=1048576 2024-09-14T11:01:52.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.945+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~KBARGR42HSBL.1 size=892920 2024-09-14T11:01:52.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.945+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=KBARGR42HSBL tag=1ELW3D6UW1BD type=write size=2990072 2024-09-14T11:01:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.947+0000 7fe3dd11f780 1 < suggested update operation key=JFLEJGPFLACM tag=37Z57RZAATX0 type=write size=257579 2024-09-14T11:01:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.948+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=NRW5FORPTA4K type=del size=2577236 2024-09-14T11:01:52.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.949+0000 7fe3dd11f780 -1 < failed to complete operation key=JFLEJGPFLACM tag=XED3B1A5I1HP type=del size=754815: (22) Invalid argument 2024-09-14T11:01:52.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.951+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~Q086VNMOQ21N.0 size=1048576 2024-09-14T11:01:52.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.952+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~Q086VNMOQ21N.1 size=672500 2024-09-14T11:01:52.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.952+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=Q086VNMOQ21N tag=PI8EYMEIHG5C type=write size=2769652 2024-09-14T11:01:52.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.954+0000 7fe3dd11f780 1 < completed write operation key=0PT98N1VBWAG tag=F32M7RH8M802 type=write size=767583 2024-09-14T11:01:52.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.956+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~8RPC4GZR5RP2.0 size=967747 2024-09-14T11:01:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.956+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=8RPC4GZR5RP2 tag=21DQWESLU1J7 type=write size=2016323 2024-09-14T11:01:52.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.957+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~8L7F2HY525VR.0 size=1048576 2024-09-14T11:01:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.958+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~8L7F2HY525VR.1 size=952113 2024-09-14T11:01:52.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.960+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=8L7F2HY525VR tag=MN3YSY85AGCK type=write size=3049265 2024-09-14T11:01:52.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.961+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=DC9TNK4RMZF1 type=del size=2508293 2024-09-14T11:01:52.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.963+0000 7fe3dd11f780 1 < completed write operation key=KXL3E0PJBNBA tag=5A4NGC7VJGLP type=write size=561226 2024-09-14T11:01:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.965+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~GVBEPMWTHC62.0 size=1048576 2024-09-14T11:01:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.966+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~GVBEPMWTHC62.1 size=1048576 2024-09-14T11:01:52.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.967+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~GVBEPMWTHC62.2 size=457459 2024-09-14T11:01:52.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.967+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=GVBEPMWTHC62 tag=MUB5GU5MSRP5 type=write size=3603187 2024-09-14T11:01:52.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.969+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~DL6BLURBDB4X.0 size=1048576 2024-09-14T11:01:52.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.970+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~DL6BLURBDB4X.1 size=449349 2024-09-14T11:01:52.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.972+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=DL6BLURBDB4X tag=7FZZ9QXOWBR8 type=write size=2546501 2024-09-14T11:01:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.973+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=0VT6O49HCO18 type=del size=2606068 2024-09-14T11:01:52.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.974+0000 7fe3dd11f780 -1 < failed to complete operation key=LL9VJXEU13IK tag=8RA01SLSOS3O type=del size=2445927: (22) Invalid argument 2024-09-14T11:01:52.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.976+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=DR1XNC7Q5LR2 type=del size=2907848 2024-09-14T11:01:52.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.978+0000 7fe3dd11f780 1 < suggested remove operation key=PHLQ77OMLI37 tag=5FH07L1TOKDG type=write 2024-09-14T11:01:52.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.979+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=X2LGBL7G5SPF type=del size=3792023 2024-09-14T11:01:52.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.981+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=X5S4FH32VU9F type=del 2024-09-14T11:01:52.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.982+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=ZMSES4SO7IQX type=del size=2010474 2024-09-14T11:01:52.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.983+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~Z1GEYKYCIDO6.0 size=327402 2024-09-14T11:01:52.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.985+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=Z1GEYKYCIDO6 tag=1F223ZDLJLSJ type=write size=1375978 2024-09-14T11:01:52.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.987+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~Z3N3HFJM1HII.0 size=1048576 2024-09-14T11:01:52.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.988+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~Z3N3HFJM1HII.1 size=1048576 2024-09-14T11:01:52.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.989+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~Z3N3HFJM1HII.2 size=963251 2024-09-14T11:01:52.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.989+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=Z3N3HFJM1HII tag=SK05UWLC69FL type=write size=4108979 2024-09-14T11:01:52.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.991+0000 7fe3dd11f780 -1 < failed to complete operation key=3PS4LAML698X tag=AX8QI31OQG3B type=write size=853467: (22) Invalid argument 2024-09-14T11:01:52.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.993+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~HPHBV1D6XZY7.0 size=1048576 2024-09-14T11:01:52.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.994+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~HPHBV1D6XZY7.1 size=1048576 2024-09-14T11:01:52.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.996+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~HPHBV1D6XZY7.2 size=501011 2024-09-14T11:01:52.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.996+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=HPHBV1D6XZY7 tag=YPR4DDE3UH64 type=write size=3646739 2024-09-14T11:01:52.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.997+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~7005VOYOZYUD.0 size=1048576 2024-09-14T11:01:52.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:52.998+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~7005VOYOZYUD.1 size=578036 2024-09-14T11:01:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.000+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=7005VOYOZYUD tag=9GZBA6UC7SM2 type=write size=2675188 2024-09-14T11:01:53.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.003+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~PSKPVV2EDSZW.0 size=1048576 2024-09-14T11:01:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.004+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~PSKPVV2EDSZW.1 size=252295 2024-09-14T11:01:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.004+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=PSKPVV2EDSZW tag=QP356TBSCAFW type=write size=2349447 2024-09-14T11:01:53.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.005+0000 7fe3dd11f780 1 < canceled operation key=LFKLJAJWQ2J6 tag=3R74UGK5MRAP type=write size=628084 2024-09-14T11:01:53.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.006+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=YW9TQW5YKHXE type=del size=3421242 2024-09-14T11:01:53.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.007+0000 7fe3dd11f780 -1 < failed to complete operation key=JFLEJGPFLACM tag=WKLGJZR5K9V7 type=del size=3449535: (22) Invalid argument 2024-09-14T11:01:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.009+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~OHV9GWWC6ZN6.0 size=1048576 2024-09-14T11:01:53.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.010+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~OHV9GWWC6ZN6.1 size=367369 2024-09-14T11:01:53.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.010+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=OHV9GWWC6ZN6 tag=JP32V0E3TAAX type=write size=2464521 2024-09-14T11:01:53.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.013+0000 7fe3dd11f780 1 < suggested remove operation key=LDILBET1CMYY tag=OIERAKSUWBOK type=del 2024-09-14T11:01:53.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.016+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~XELDU3QFP4CL.0 size=1048576 2024-09-14T11:01:53.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.017+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~XELDU3QFP4CL.1 size=436484 2024-09-14T11:01:53.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.017+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=XELDU3QFP4CL tag=XT23RDAK8OYI type=write size=2533636 2024-09-14T11:01:53.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.018+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~KBARGR42HSBL.0 size=1048576 2024-09-14T11:01:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.019+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~KBARGR42HSBL.1 size=892920 2024-09-14T11:01:53.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.021+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=KBARGR42HSBL tag=1ELW3D6UW1BD type=write size=2990072 2024-09-14T11:01:53.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.023+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~FAX04IVWW4JA.0 size=839645 2024-09-14T11:01:53.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.023+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=FAX04IVWW4JA tag=JUT1Y6CCEAX6 type=write size=1888221 2024-09-14T11:01:53.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.025+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=NRW5FORPTA4K type=del 2024-09-14T11:01:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.027+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~WDYF258SGL7L.0 size=1048576 2024-09-14T11:01:53.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.028+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~WDYF258SGL7L.1 size=996231 2024-09-14T11:01:53.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.028+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=WDYF258SGL7L tag=SEAVKEEQPPM9 type=write size=3093383 2024-09-14T11:01:53.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.029+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~Q086VNMOQ21N.0 size=1048576 2024-09-14T11:01:53.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.029+0000 7fe3dd11f780 1 < canceled part key=_multipart_PHLQ77OMLI37.2~Q086VNMOQ21N.1 size=672500 2024-09-14T11:01:53.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.032+0000 7fe3dd11f780 1 < canceled multipart upload key=PHLQ77OMLI37 upload=Q086VNMOQ21N tag=PI8EYMEIHG5C type=write size=2769652 2024-09-14T11:01:53.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.033+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=AWQ5BGV8C9AP type=del size=3651181 2024-09-14T11:01:53.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.033+0000 7fe3dd11f780 1 < canceled part key=_multipart_JSEN4QXEMVHS.2~8RPC4GZR5RP2.0 size=967747 2024-09-14T11:01:53.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.035+0000 7fe3dd11f780 1 < canceled multipart upload key=JSEN4QXEMVHS upload=8RPC4GZR5RP2 tag=21DQWESLU1J7 type=write size=2016323 2024-09-14T11:01:53.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.037+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~L44J09YA0A37.0 size=1048576 2024-09-14T11:01:53.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.038+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~L44J09YA0A37.1 size=817220 2024-09-14T11:01:53.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.038+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=L44J09YA0A37 tag=74BIFPNIDXM1 type=write size=2914372 2024-09-14T11:01:53.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.039+0000 7fe3dd11f780 -1 < failed to complete operation key=PHLQ77OMLI37 tag=DC9TNK4RMZF1 type=del size=2508293: (22) Invalid argument 2024-09-14T11:01:53.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.041+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=U3U730D6CLPP type=del size=2012033 2024-09-14T11:01:53.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.042+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~GVBEPMWTHC62.0 size=1048576 2024-09-14T11:01:53.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.042+0000 7fe3dd11f780 1 < canceled part key=_multipart_PHLQ77OMLI37.2~GVBEPMWTHC62.1 size=1048576 2024-09-14T11:01:53.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.043+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~GVBEPMWTHC62.2 size=457459 2024-09-14T11:01:53.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.045+0000 7fe3dd11f780 1 < canceled multipart upload key=PHLQ77OMLI37 upload=GVBEPMWTHC62 tag=MUB5GU5MSRP5 type=write size=3603187 2024-09-14T11:01:53.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.046+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=V9KZDT1XD7OF type=write size=618873 2024-09-14T11:01:53.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.047+0000 7fe3dd11f780 1 < canceled operation key=NHKCRGX10WBM tag=0VT6O49HCO18 type=del size=2606068 2024-09-14T11:01:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.048+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=I7FA1SXEH2MU type=del size=2641096 2024-09-14T11:01:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.049+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=DR1XNC7Q5LR2 type=del 2024-09-14T11:01:53.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.051+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~PM6GID26Y7C3.0 size=1048576 2024-09-14T11:01:53.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.052+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~PM6GID26Y7C3.1 size=8873 2024-09-14T11:01:53.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.052+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=PM6GID26Y7C3 tag=YBG8QOJ1XORM type=write size=2106025 2024-09-14T11:01:53.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.054+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=X2LGBL7G5SPF type=del 2024-09-14T11:01:53.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.056+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~WPMK6HOU66R5.0 size=1048576 2024-09-14T11:01:53.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.057+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~WPMK6HOU66R5.1 size=833369 2024-09-14T11:01:53.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.057+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=WPMK6HOU66R5 tag=7C83DU3S1JM4 type=write size=2930521 2024-09-14T11:01:53.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.058+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=ZMSES4SO7IQX type=del 2024-09-14T11:01:53.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.060+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=51HOET1XRSHC type=write size=63859 2024-09-14T11:01:53.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.061+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~Z3N3HFJM1HII.0 size=1048576 2024-09-14T11:01:53.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.062+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~Z3N3HFJM1HII.1 size=1048576 2024-09-14T11:01:53.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.063+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~Z3N3HFJM1HII.2 size=963251 2024-09-14T11:01:53.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.065+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=Z3N3HFJM1HII tag=SK05UWLC69FL type=write size=4108979 2024-09-14T11:01:53.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.066+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=23HGZNCG4PZO type=del size=196201 2024-09-14T11:01:53.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.067+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~HPHBV1D6XZY7.0 size=1048576 2024-09-14T11:01:53.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.068+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~HPHBV1D6XZY7.1 size=1048576 2024-09-14T11:01:53.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.069+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~HPHBV1D6XZY7.2 size=501011 2024-09-14T11:01:53.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.072+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=HPHBV1D6XZY7 tag=YPR4DDE3UH64 type=write size=3646739 2024-09-14T11:01:53.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.073+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=GQGBEG6EZW5A type=del size=4080404 2024-09-14T11:01:53.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.074+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~PSKPVV2EDSZW.0 size=1048576 2024-09-14T11:01:53.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.075+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~PSKPVV2EDSZW.1 size=252295 2024-09-14T11:01:53.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.077+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=PSKPVV2EDSZW tag=QP356TBSCAFW type=write size=2349447 2024-09-14T11:01:53.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.079+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~SSYMFHPYWKIG.0 size=793556 2024-09-14T11:01:53.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.079+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=SSYMFHPYWKIG tag=6KC9NAEMMJ9C type=write size=1842132 2024-09-14T11:01:53.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.081+0000 7fe3dd11f780 1 < suggested update operation key=ODDNSHK5YMNO tag=YW9TQW5YKHXE type=del size=3421242 2024-09-14T11:01:53.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.083+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~2YRZ9QHMOLR0.0 size=1048576 2024-09-14T11:01:53.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.084+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~2YRZ9QHMOLR0.1 size=1048576 2024-09-14T11:01:53.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.085+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~2YRZ9QHMOLR0.2 size=186329 2024-09-14T11:01:53.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.085+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=2YRZ9QHMOLR0 tag=QTGPIAVCWI8I type=write size=3332057 2024-09-14T11:01:53.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.086+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~OHV9GWWC6ZN6.0 size=1048576 2024-09-14T11:01:53.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.087+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~OHV9GWWC6ZN6.1 size=367369 2024-09-14T11:01:53.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.089+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=OHV9GWWC6ZN6 tag=JP32V0E3TAAX type=write size=2464521 2024-09-14T11:01:53.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.091+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~VO0OHZP0T71C.0 size=1048576 2024-09-14T11:01:53.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.092+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~VO0OHZP0T71C.1 size=1048576 2024-09-14T11:01:53.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.092+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~VO0OHZP0T71C.2 size=168644 2024-09-14T11:01:53.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.092+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=VO0OHZP0T71C tag=8T2HWS6B2TA3 type=write size=3314372 2024-09-14T11:01:53.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.093+0000 7fe3dd11f780 1 < canceled part key=_multipart_KXL3E0PJBNBA.2~XELDU3QFP4CL.0 size=1048576 2024-09-14T11:01:53.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.094+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~XELDU3QFP4CL.1 size=436484 2024-09-14T11:01:53.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.096+0000 7fe3dd11f780 1 < canceled multipart upload key=KXL3E0PJBNBA upload=XELDU3QFP4CL tag=XT23RDAK8OYI type=write size=2533636 2024-09-14T11:01:53.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.098+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~MO8613UFO5DK.0 size=77143 2024-09-14T11:01:53.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.098+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=MO8613UFO5DK tag=RW84CL1TV8HK type=write size=1125719 2024-09-14T11:01:53.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.098+0000 7fe3dd11f780 1 < canceled part key=_multipart_VDSOBBVO3QGB.2~FAX04IVWW4JA.0 size=839645 2024-09-14T11:01:53.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.100+0000 7fe3dd11f780 1 < canceled multipart upload key=VDSOBBVO3QGB upload=FAX04IVWW4JA tag=JUT1Y6CCEAX6 type=write size=1888221 2024-09-14T11:01:53.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.101+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=89S4TC3VWT53 type=del size=667775 2024-09-14T11:01:53.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.102+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~WDYF258SGL7L.0 size=1048576 2024-09-14T11:01:53.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.103+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~WDYF258SGL7L.1 size=996231 2024-09-14T11:01:53.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.105+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=WDYF258SGL7L tag=SEAVKEEQPPM9 type=write size=3093383 2024-09-14T11:01:53.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.107+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~8J2PC5WEG90W.0 size=1048576 2024-09-14T11:01:53.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.108+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~8J2PC5WEG90W.1 size=1048576 2024-09-14T11:01:53.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.109+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~8J2PC5WEG90W.2 size=691483 2024-09-14T11:01:53.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.109+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=8J2PC5WEG90W tag=OCAIN1Q1AN3V type=write size=3837211 2024-09-14T11:01:53.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.110+0000 7fe3dd11f780 1 < canceled operation key=K9BP30LHDPA1 tag=AWQ5BGV8C9AP type=del size=3651181 2024-09-14T11:01:53.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.112+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~EHL8MM173K2D.0 size=678107 2024-09-14T11:01:53.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.112+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=EHL8MM173K2D tag=4CCXWOQSFLN3 type=write size=1726683 2024-09-14T11:01:53.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.113+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~L44J09YA0A37.0 size=1048576 2024-09-14T11:01:53.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.113+0000 7fe3dd11f780 1 < canceled part key=_multipart_QPH41U60044L.2~L44J09YA0A37.1 size=817220 2024-09-14T11:01:53.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.115+0000 7fe3dd11f780 1 < canceled multipart upload key=QPH41U60044L upload=L44J09YA0A37 tag=74BIFPNIDXM1 type=write size=2914372 2024-09-14T11:01:53.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.118+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~K740JY3UR72N.0 size=485439 2024-09-14T11:01:53.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.118+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=K740JY3UR72N tag=UHA82QKHLZKB type=write size=1534015 2024-09-14T11:01:53.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.119+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=U3U730D6CLPP type=del 2024-09-14T11:01:53.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.121+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~S73EV8I30QBY.0 size=1048576 2024-09-14T11:01:53.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.122+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~S73EV8I30QBY.1 size=826991 2024-09-14T11:01:53.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.122+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=S73EV8I30QBY tag=OUVUG8UZJ79Q type=write size=2924143 2024-09-14T11:01:53.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.123+0000 7fe3dd11f780 1 < completed write operation key=GQEFQ1UD6QCJ tag=V9KZDT1XD7OF type=write size=618873 2024-09-14T11:01:53.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.125+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=5F7GC103IGLP type=del size=2251047 2024-09-14T11:01:53.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.126+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=I7FA1SXEH2MU type=del 2024-09-14T11:01:53.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.128+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~8LLTMBMGWS8Q.0 size=591472 2024-09-14T11:01:53.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.128+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=8LLTMBMGWS8Q tag=W0BIMUT6UVKA type=write size=1640048 2024-09-14T11:01:53.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.131+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~PM6GID26Y7C3.0 size=1048576 2024-09-14T11:01:53.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.132+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~PM6GID26Y7C3.1 size=8873 2024-09-14T11:01:53.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.134+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=PM6GID26Y7C3 tag=YBG8QOJ1XORM type=write size=2106025 2024-09-14T11:01:53.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.136+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~7L52PSSIIY4E.0 size=991585 2024-09-14T11:01:53.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.136+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=7L52PSSIIY4E tag=MLBNKPXS7TN2 type=write size=2040161 2024-09-14T11:01:53.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.138+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~WPMK6HOU66R5.0 size=1048576 2024-09-14T11:01:53.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.139+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~WPMK6HOU66R5.1 size=833369 2024-09-14T11:01:53.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.141+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=WPMK6HOU66R5 tag=7C83DU3S1JM4 type=write size=2930521 2024-09-14T11:01:53.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.143+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~RAYJ4662NW0B.0 size=309542 2024-09-14T11:01:53.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.143+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=RAYJ4662NW0B tag=Q2J28J3QZ59N type=write size=1358118 2024-09-14T11:01:53.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.144+0000 7fe3dd11f780 1 < completed write operation key=K9BP30LHDPA1 tag=51HOET1XRSHC type=write size=63859 2024-09-14T11:01:53.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.146+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~TRQCJIB4RYQD.0 size=1030149 2024-09-14T11:01:53.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.146+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=TRQCJIB4RYQD tag=OT0R6ZH3UVD2 type=write size=2078725 2024-09-14T11:01:53.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.148+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=23HGZNCG4PZO type=del 2024-09-14T11:01:53.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.149+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=S6UDTD3WXWZ8 type=del size=513677 2024-09-14T11:01:53.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.151+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=GQGBEG6EZW5A type=del 2024-09-14T11:01:53.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.153+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~ZVECL7MACMHQ.0 size=1048576 2024-09-14T11:01:53.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.154+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~ZVECL7MACMHQ.1 size=918351 2024-09-14T11:01:53.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.154+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=ZVECL7MACMHQ tag=4ETI19VW6TKN type=write size=3015503 2024-09-14T11:01:53.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.155+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~SSYMFHPYWKIG.0 size=793556 2024-09-14T11:01:53.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.157+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=SSYMFHPYWKIG tag=6KC9NAEMMJ9C type=write size=1842132 2024-09-14T11:01:53.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.159+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~OHO291IM52MS.0 size=771468 2024-09-14T11:01:53.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.159+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=OHO291IM52MS tag=ZV5ZOCMBUS8F type=write size=1820044 2024-09-14T11:01:53.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.161+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~2YRZ9QHMOLR0.0 size=1048576 2024-09-14T11:01:53.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.161+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~2YRZ9QHMOLR0.1 size=1048576 2024-09-14T11:01:53.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.162+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~2YRZ9QHMOLR0.2 size=186329 2024-09-14T11:01:53.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.165+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=2YRZ9QHMOLR0 tag=QTGPIAVCWI8I type=write size=3332057 2024-09-14T11:01:53.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.168+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~K8J0F2RW2EAV.0 size=1048576 2024-09-14T11:01:53.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.169+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~K8J0F2RW2EAV.1 size=1048576 2024-09-14T11:01:53.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.170+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~K8J0F2RW2EAV.2 size=589496 2024-09-14T11:01:53.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.170+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=K8J0F2RW2EAV tag=X6WTW80H3OYW type=write size=3735224 2024-09-14T11:01:53.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.171+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~VO0OHZP0T71C.0 size=1048576 2024-09-14T11:01:53.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.172+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~VO0OHZP0T71C.1 size=1048576 2024-09-14T11:01:53.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.173+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~VO0OHZP0T71C.2 size=168644 2024-09-14T11:01:53.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.176+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=VO0OHZP0T71C tag=8T2HWS6B2TA3 type=write size=3314372 2024-09-14T11:01:53.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.178+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~Q5GY6MNQEHGZ.0 size=668948 2024-09-14T11:01:53.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.178+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=Q5GY6MNQEHGZ tag=9UG6MHVQIYY8 type=write size=1717524 2024-09-14T11:01:53.177 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.179+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~MO8613UFO5DK.0 size=77143 2024-09-14T11:01:53.179 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.181+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=MO8613UFO5DK tag=RW84CL1TV8HK type=write size=1125719 2024-09-14T11:01:53.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.183+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~OZQ1TQRZ29QO.0 size=1048576 2024-09-14T11:01:53.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.184+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~OZQ1TQRZ29QO.1 size=1048576 2024-09-14T11:01:53.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.185+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~OZQ1TQRZ29QO.2 size=667443 2024-09-14T11:01:53.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.185+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=OZQ1TQRZ29QO tag=TV3F6O5J1A5T type=write size=3813171 2024-09-14T11:01:53.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.186+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=89S4TC3VWT53 type=del 2024-09-14T11:01:53.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.187+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=VOREP23PYQJT type=del size=4049664 2024-09-14T11:01:53.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.189+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~8J2PC5WEG90W.0 size=1048576 2024-09-14T11:01:53.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.189+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~8J2PC5WEG90W.1 size=1048576 2024-09-14T11:01:53.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.190+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~8J2PC5WEG90W.2 size=691483 2024-09-14T11:01:53.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.192+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=8J2PC5WEG90W tag=OCAIN1Q1AN3V type=write size=3837211 2024-09-14T11:01:53.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.194+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~DF9HFE9WSUVW.0 size=532967 2024-09-14T11:01:53.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.194+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=DF9HFE9WSUVW tag=IBDEJFOBXEPI type=write size=1581543 2024-09-14T11:01:53.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.195+0000 7fe3dd11f780 1 < canceled part key=_multipart_JG1RZQD4J2EB.2~EHL8MM173K2D.0 size=678107 2024-09-14T11:01:53.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.196+0000 7fe3dd11f780 1 < canceled multipart upload key=JG1RZQD4J2EB upload=EHL8MM173K2D tag=4CCXWOQSFLN3 type=write size=1726683 2024-09-14T11:01:53.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.198+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=MLEPRN9U10W1 type=del size=2297951 2024-09-14T11:01:53.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.199+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~K740JY3UR72N.0 size=485439 2024-09-14T11:01:53.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.201+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=K740JY3UR72N tag=UHA82QKHLZKB type=write size=1534015 2024-09-14T11:01:53.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.203+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~ONBWMQ3R2L6C.0 size=1048576 2024-09-14T11:01:53.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.204+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~ONBWMQ3R2L6C.1 size=273008 2024-09-14T11:01:53.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.204+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=ONBWMQ3R2L6C tag=DVRM1PUERZ56 type=write size=2370160 2024-09-14T11:01:53.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.206+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~S73EV8I30QBY.0 size=1048576 2024-09-14T11:01:53.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.207+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~S73EV8I30QBY.1 size=826991 2024-09-14T11:01:53.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.209+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=S73EV8I30QBY tag=OUVUG8UZJ79Q type=write size=2924143 2024-09-14T11:01:53.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.210+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=NQ9CBR4SORPA type=del size=2304652 2024-09-14T11:01:53.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.212+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=5F7GC103IGLP type=del 2024-09-14T11:01:53.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.214+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~QX4TX7KBIN3X.0 size=1048576 2024-09-14T11:01:53.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.216+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~QX4TX7KBIN3X.1 size=1048576 2024-09-14T11:01:53.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.217+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~QX4TX7KBIN3X.2 size=736056 2024-09-14T11:01:53.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.217+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=QX4TX7KBIN3X tag=XC313RJ1A1GX type=write size=3881784 2024-09-14T11:01:53.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.218+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~8LLTMBMGWS8Q.0 size=591472 2024-09-14T11:01:53.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.220+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=8LLTMBMGWS8Q tag=W0BIMUT6UVKA type=write size=1640048 2024-09-14T11:01:53.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.221+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=9RU30JABUQB4 type=del size=119547 2024-09-14T11:01:53.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.222+0000 7fe3dd11f780 1 < canceled part key=_multipart_LFKLJAJWQ2J6.2~7L52PSSIIY4E.0 size=991585 2024-09-14T11:01:53.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.224+0000 7fe3dd11f780 1 < canceled multipart upload key=LFKLJAJWQ2J6 upload=7L52PSSIIY4E tag=MLBNKPXS7TN2 type=write size=2040161 2024-09-14T11:01:53.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.225+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=NBKJBPPVG2BK type=del size=1437709 2024-09-14T11:01:53.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.226+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~RAYJ4662NW0B.0 size=309542 2024-09-14T11:01:53.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.228+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=RAYJ4662NW0B tag=Q2J28J3QZ59N type=write size=1358118 2024-09-14T11:01:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.229+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=QM41YLT510QI type=del size=3174283 2024-09-14T11:01:53.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.230+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~TRQCJIB4RYQD.0 size=1030149 2024-09-14T11:01:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.232+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=TRQCJIB4RYQD tag=OT0R6ZH3UVD2 type=write size=2078725 2024-09-14T11:01:53.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.235+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~2N7E3DHSBUQS.0 size=550194 2024-09-14T11:01:53.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.235+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=2N7E3DHSBUQS tag=DH6OKUJLQM82 type=write size=1598770 2024-09-14T11:01:53.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.236+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=S6UDTD3WXWZ8 type=del 2024-09-14T11:01:53.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.238+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~FITLB0GRGT16.0 size=1048576 2024-09-14T11:01:53.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.239+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~FITLB0GRGT16.1 size=1048576 2024-09-14T11:01:53.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.240+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~FITLB0GRGT16.2 size=221257 2024-09-14T11:01:53.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.240+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=FITLB0GRGT16 tag=EEE2T1CF5ZK3 type=write size=3366985 2024-09-14T11:01:53.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.241+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~ZVECL7MACMHQ.0 size=1048576 2024-09-14T11:01:53.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.242+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~ZVECL7MACMHQ.1 size=918351 2024-09-14T11:01:53.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.244+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=ZVECL7MACMHQ tag=4ETI19VW6TKN type=write size=3015503 2024-09-14T11:01:53.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.246+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~1A5RHDALJNYV.0 size=1048576 2024-09-14T11:01:53.245 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.247+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~1A5RHDALJNYV.1 size=1048576 2024-09-14T11:01:53.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.248+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~1A5RHDALJNYV.2 size=629562 2024-09-14T11:01:53.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.248+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=1A5RHDALJNYV tag=KZN657XU753J type=write size=3775290 2024-09-14T11:01:53.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.249+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~OHO291IM52MS.0 size=771468 2024-09-14T11:01:53.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.251+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=OHO291IM52MS tag=ZV5ZOCMBUS8F type=write size=1820044 2024-09-14T11:01:53.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.253+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~20P5J6OZ8A9R.0 size=1048576 2024-09-14T11:01:53.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.254+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~20P5J6OZ8A9R.1 size=1048576 2024-09-14T11:01:53.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.256+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~20P5J6OZ8A9R.2 size=448472 2024-09-14T11:01:53.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.256+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=20P5J6OZ8A9R tag=O65LPAJ6W48O type=write size=3594200 2024-09-14T11:01:53.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.257+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~K8J0F2RW2EAV.0 size=1048576 2024-09-14T11:01:53.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.258+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~K8J0F2RW2EAV.1 size=1048576 2024-09-14T11:01:53.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.259+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~K8J0F2RW2EAV.2 size=589496 2024-09-14T11:01:53.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.262+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=K8J0F2RW2EAV tag=X6WTW80H3OYW type=write size=3735224 2024-09-14T11:01:53.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.263+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=UR9CH712KBUI type=del size=609285 2024-09-14T11:01:53.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.264+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~Q5GY6MNQEHGZ.0 size=668948 2024-09-14T11:01:53.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.266+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=Q5GY6MNQEHGZ tag=9UG6MHVQIYY8 type=write size=1717524 2024-09-14T11:01:53.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.269+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~AS2KC1SXR8FA.0 size=1048576 2024-09-14T11:01:53.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.270+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~AS2KC1SXR8FA.1 size=391901 2024-09-14T11:01:53.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.270+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=AS2KC1SXR8FA tag=4XB8AFEHBW7G type=write size=2489053 2024-09-14T11:01:53.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.271+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~OZQ1TQRZ29QO.0 size=1048576 2024-09-14T11:01:53.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.272+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~OZQ1TQRZ29QO.1 size=1048576 2024-09-14T11:01:53.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.273+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~OZQ1TQRZ29QO.2 size=667443 2024-09-14T11:01:53.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.275+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=OZQ1TQRZ29QO tag=TV3F6O5J1A5T type=write size=3813171 2024-09-14T11:01:53.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.276+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=VRWR7Y89ZCNI type=del size=3385764 2024-09-14T11:01:53.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.278+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=VOREP23PYQJT type=del 2024-09-14T11:01:53.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.280+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=R98NEUCIE9KV type=del size=182718 2024-09-14T11:01:53.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.281+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~DF9HFE9WSUVW.0 size=532967 2024-09-14T11:01:53.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.283+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=DF9HFE9WSUVW tag=IBDEJFOBXEPI type=write size=1581543 2024-09-14T11:01:53.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.284+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=3EQD7SA6DU0G type=del size=734163 2024-09-14T11:01:53.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.287+0000 7fe3dd11f780 1 < suggested update operation key=0PT98N1VBWAG tag=MLEPRN9U10W1 type=del size=2297951 2024-09-14T11:01:53.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.288+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=WC57GR58AF81 type=del size=3164593 2024-09-14T11:01:53.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.288+0000 7fe3dd11f780 1 < canceled part key=_multipart_JFLEJGPFLACM.2~ONBWMQ3R2L6C.0 size=1048576 2024-09-14T11:01:53.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.289+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~ONBWMQ3R2L6C.1 size=273008 2024-09-14T11:01:53.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.292+0000 7fe3dd11f780 1 < canceled multipart upload key=JFLEJGPFLACM upload=ONBWMQ3R2L6C tag=DVRM1PUERZ56 type=write size=2370160 2024-09-14T11:01:53.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.293+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=Z8TA2VL1CYB8 type=del size=3471035 2024-09-14T11:01:53.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.294+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=NQ9CBR4SORPA type=del 2024-09-14T11:01:53.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.295+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=N0P27U4IJX9X type=del size=2885551 2024-09-14T11:01:53.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.296+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~QX4TX7KBIN3X.0 size=1048576 2024-09-14T11:01:53.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.297+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~QX4TX7KBIN3X.1 size=1048576 2024-09-14T11:01:53.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.298+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~QX4TX7KBIN3X.2 size=736056 2024-09-14T11:01:53.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.300+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=QX4TX7KBIN3X tag=XC313RJ1A1GX type=write size=3881784 2024-09-14T11:01:53.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.301+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=R5FS9636IETJ type=del size=4069903 2024-09-14T11:01:53.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.303+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=9RU30JABUQB4 type=del 2024-09-14T11:01:53.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.304+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=BXWBIUJIDXTR type=del size=3618235 2024-09-14T11:01:53.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.305+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=NBKJBPPVG2BK type=del 2024-09-14T11:01:53.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.307+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~7XGMW1FX7WAM.0 size=619899 2024-09-14T11:01:53.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.307+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=7XGMW1FX7WAM tag=COXKQCQJTDKV type=write size=1668475 2024-09-14T11:01:53.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.309+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=QM41YLT510QI type=del 2024-09-14T11:01:53.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.310+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=BUV3AC217IGK type=write size=1046111 2024-09-14T11:01:53.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.311+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~2N7E3DHSBUQS.0 size=550194 2024-09-14T11:01:53.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.313+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=2N7E3DHSBUQS tag=DH6OKUJLQM82 type=write size=1598770 2024-09-14T11:01:53.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.315+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~CG62PT81RTCX.0 size=1048576 2024-09-14T11:01:53.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.316+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~CG62PT81RTCX.1 size=537207 2024-09-14T11:01:53.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.316+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=CG62PT81RTCX tag=DPB9E6LLLXJW type=write size=2634359 2024-09-14T11:01:53.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.317+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~FITLB0GRGT16.0 size=1048576 2024-09-14T11:01:53.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.318+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~FITLB0GRGT16.1 size=1048576 2024-09-14T11:01:53.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.319+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~FITLB0GRGT16.2 size=221257 2024-09-14T11:01:53.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.321+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=FITLB0GRGT16 tag=EEE2T1CF5ZK3 type=write size=3366985 2024-09-14T11:01:53.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.322+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=HRRYE1IN6MC0 type=del size=3322674 2024-09-14T11:01:53.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.323+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~1A5RHDALJNYV.0 size=1048576 2024-09-14T11:01:53.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.324+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~1A5RHDALJNYV.1 size=1048576 2024-09-14T11:01:53.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.325+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~1A5RHDALJNYV.2 size=629562 2024-09-14T11:01:53.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.327+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=1A5RHDALJNYV tag=KZN657XU753J type=write size=3775290 2024-09-14T11:01:53.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.328+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=ILD3JJ1KUAGP type=del size=1544804 2024-09-14T11:01:53.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.328+0000 7fe3dd11f780 1 < canceled part key=_multipart_22TI1VCDTK5P.2~20P5J6OZ8A9R.0 size=1048576 2024-09-14T11:01:53.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.329+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~20P5J6OZ8A9R.1 size=1048576 2024-09-14T11:01:53.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.330+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~20P5J6OZ8A9R.2 size=448472 2024-09-14T11:01:53.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.332+0000 7fe3dd11f780 1 < canceled multipart upload key=22TI1VCDTK5P upload=20P5J6OZ8A9R tag=O65LPAJ6W48O type=write size=3594200 2024-09-14T11:01:53.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.334+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=6X24XVRPIN6Q type=del size=2118378 2024-09-14T11:01:53.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.335+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=UR9CH712KBUI type=del 2024-09-14T11:01:53.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.337+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~NNSSUPXKE393.0 size=1048576 2024-09-14T11:01:53.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.338+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~NNSSUPXKE393.1 size=1048576 2024-09-14T11:01:53.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.339+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~NNSSUPXKE393.2 size=935554 2024-09-14T11:01:53.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.339+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=NNSSUPXKE393 tag=1RUPOIG1P7TL type=write size=4081282 2024-09-14T11:01:53.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.340+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~AS2KC1SXR8FA.0 size=1048576 2024-09-14T11:01:53.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.340+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~AS2KC1SXR8FA.1 size=391901 2024-09-14T11:01:53.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.342+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=AS2KC1SXR8FA tag=4XB8AFEHBW7G type=write size=2489053 2024-09-14T11:01:53.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.343+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=B24SIQNSDJ1Z type=del size=1078817 2024-09-14T11:01:53.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.344+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=VRWR7Y89ZCNI type=del 2024-09-14T11:01:53.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.345+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=4DG1KGAILJOO type=del size=1533318 2024-09-14T11:01:53.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.348+0000 7fe3dd11f780 1 < suggested update operation key=LL9VJXEU13IK tag=R98NEUCIE9KV type=del size=182718 2024-09-14T11:01:53.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.349+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=PDS43P3B6UNU type=write size=564518 2024-09-14T11:01:53.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.350+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=3EQD7SA6DU0G type=del 2024-09-14T11:01:53.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.351+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=EWYFESVPFG0X type=del size=67798 2024-09-14T11:01:53.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.353+0000 7fe3dd11f780 1 < suggested update operation key=US8KP3YL88TG tag=WC57GR58AF81 type=del size=3164593 2024-09-14T11:01:53.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.354+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=246T825H7NSH type=write size=376236 2024-09-14T11:01:53.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.355+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=Z8TA2VL1CYB8 type=del 2024-09-14T11:01:53.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.356+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=QXIXSL18EUKE type=del size=3214690 2024-09-14T11:01:53.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.357+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=N0P27U4IJX9X type=del 2024-09-14T11:01:53.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.359+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=PRNEL82TUYUM type=del size=681921 2024-09-14T11:01:53.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.361+0000 7fe3dd11f780 1 < suggested update operation key=PHLQ77OMLI37 tag=R5FS9636IETJ type=del size=4069903 2024-09-14T11:01:53.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.363+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~HMDIJVWXUK66.0 size=455111 2024-09-14T11:01:53.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.363+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=HMDIJVWXUK66 tag=PEUAGDMR2XTN type=write size=1503687 2024-09-14T11:01:53.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.364+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=BXWBIUJIDXTR type=del 2024-09-14T11:01:53.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.365+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=DZA6BNI0RELU type=del size=715889 2024-09-14T11:01:53.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.365+0000 7fe3dd11f780 1 < canceled part key=_multipart_JFLEJGPFLACM.2~7XGMW1FX7WAM.0 size=619899 2024-09-14T11:01:53.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.367+0000 7fe3dd11f780 1 < canceled multipart upload key=JFLEJGPFLACM upload=7XGMW1FX7WAM tag=COXKQCQJTDKV type=write size=1668475 2024-09-14T11:01:53.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.369+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~EZ2GGXRNLR8S.0 size=1048576 2024-09-14T11:01:53.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.370+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~EZ2GGXRNLR8S.1 size=1048576 2024-09-14T11:01:53.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.371+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~EZ2GGXRNLR8S.2 size=117266 2024-09-14T11:01:53.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.371+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=EZ2GGXRNLR8S tag=5XKEYRSDTFZI type=write size=3262994 2024-09-14T11:01:53.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.372+0000 7fe3dd11f780 1 < completed write operation key=KXL3E0PJBNBA tag=BUV3AC217IGK type=write size=1046111 2024-09-14T11:01:53.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.374+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=VS02QESI97DE type=del size=3036767 2024-09-14T11:01:53.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.375+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~CG62PT81RTCX.0 size=1048576 2024-09-14T11:01:53.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.376+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~CG62PT81RTCX.1 size=537207 2024-09-14T11:01:53.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.377+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=CG62PT81RTCX tag=DPB9E6LLLXJW type=write size=2634359 2024-09-14T11:01:53.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.379+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=WGZXEIXWW1CK type=del size=2783745 2024-09-14T11:01:53.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.380+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=HRRYE1IN6MC0 type=del 2024-09-14T11:01:53.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.381+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=K82HO20HJT9Y type=del size=1575486 2024-09-14T11:01:53.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.382+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=ILD3JJ1KUAGP type=del 2024-09-14T11:01:53.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.383+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=7EERAK6Q71ZL type=del size=300504 2024-09-14T11:01:53.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.384+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=6X24XVRPIN6Q type=del 2024-09-14T11:01:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.385+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=ID3Y09M6EF20 type=del size=1742702 2024-09-14T11:01:53.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.387+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~NNSSUPXKE393.0 size=1048576 2024-09-14T11:01:53.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.388+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~NNSSUPXKE393.1 size=1048576 2024-09-14T11:01:53.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.389+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~NNSSUPXKE393.2 size=935554 2024-09-14T11:01:53.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.391+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=NNSSUPXKE393 tag=1RUPOIG1P7TL type=write size=4081282 2024-09-14T11:01:53.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.392+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=IGQ7GF4RCLEI type=del size=1651394 2024-09-14T11:01:53.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.393+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=B24SIQNSDJ1Z type=del 2024-09-14T11:01:53.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.395+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~G4172AYD1TUP.0 size=1048576 2024-09-14T11:01:53.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.396+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~G4172AYD1TUP.1 size=1048576 2024-09-14T11:01:53.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.397+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~G4172AYD1TUP.2 size=176716 2024-09-14T11:01:53.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.397+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=G4172AYD1TUP tag=BEX6QHOHJ8LG type=write size=3322444 2024-09-14T11:01:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.398+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=4DG1KGAILJOO type=del 2024-09-14T11:01:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.399+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=GTLCNTZJKHE7 type=del size=4162481 2024-09-14T11:01:53.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.401+0000 7fe3dd11f780 1 < completed write operation key=K9BP30LHDPA1 tag=PDS43P3B6UNU type=write size=564518 2024-09-14T11:01:53.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.402+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=1FT1U7VG77HN type=del size=2052267 2024-09-14T11:01:53.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.403+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=EWYFESVPFG0X type=del 2024-09-14T11:01:53.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.405+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~2VMFV5S0OXPF.0 size=755967 2024-09-14T11:01:53.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.405+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=2VMFV5S0OXPF tag=Z2A3QV63ZSW2 type=write size=1804543 2024-09-14T11:01:53.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.406+0000 7fe3dd11f780 1 < completed write operation key=K9BP30LHDPA1 tag=246T825H7NSH type=write size=376236 2024-09-14T11:01:53.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.409+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~22WACMUQKR30.0 size=1048576 2024-09-14T11:01:53.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.409+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~22WACMUQKR30.1 size=1048576 2024-09-14T11:01:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.410+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~22WACMUQKR30.2 size=928688 2024-09-14T11:01:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.410+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=22WACMUQKR30 tag=7LWA5PEOMW64 type=write size=4074416 2024-09-14T11:01:53.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.411+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=QXIXSL18EUKE type=del 2024-09-14T11:01:53.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.413+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~FZX3A33W4FVN.0 size=1048576 2024-09-14T11:01:53.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.414+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~FZX3A33W4FVN.1 size=391843 2024-09-14T11:01:53.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.414+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=FZX3A33W4FVN tag=6OIPFKK30BDC type=write size=2488995 2024-09-14T11:01:53.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.417+0000 7fe3dd11f780 1 < suggested update operation key=LDILBET1CMYY tag=PRNEL82TUYUM type=del size=681921 2024-09-14T11:01:53.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.419+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~UW8EHXF0TMT3.0 size=1048576 2024-09-14T11:01:53.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.420+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~UW8EHXF0TMT3.1 size=1045320 2024-09-14T11:01:53.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.420+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=UW8EHXF0TMT3 tag=N0RJ581B2ACH type=write size=3142472 2024-09-14T11:01:53.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.421+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~HMDIJVWXUK66.0 size=455111 2024-09-14T11:01:53.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.423+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=HMDIJVWXUK66 tag=PEUAGDMR2XTN type=write size=1503687 2024-09-14T11:01:53.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.424+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=0ROLM7B1DO9M type=write size=488612 2024-09-14T11:01:53.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.425+0000 7fe3dd11f780 1 < canceled operation key=IOAG4ZE1I58Z tag=DZA6BNI0RELU type=del size=715889 2024-09-14T11:01:53.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.426+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=APSGCMX2A9S4 type=write size=914577 2024-09-14T11:01:53.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.428+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~EZ2GGXRNLR8S.0 size=1048576 2024-09-14T11:01:53.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.429+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~EZ2GGXRNLR8S.1 size=1048576 2024-09-14T11:01:53.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.430+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~EZ2GGXRNLR8S.2 size=117266 2024-09-14T11:01:53.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.432+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=EZ2GGXRNLR8S tag=5XKEYRSDTFZI type=write size=3262994 2024-09-14T11:01:53.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.434+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~93E39ZACX8IV.0 size=1048576 2024-09-14T11:01:53.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.435+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~93E39ZACX8IV.1 size=823685 2024-09-14T11:01:53.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.435+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=93E39ZACX8IV tag=CS7AYM21MHMD type=write size=2920837 2024-09-14T11:01:53.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.437+0000 7fe3dd11f780 1 < suggested remove operation key=KXL3E0PJBNBA tag=VS02QESI97DE type=del 2024-09-14T11:01:53.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.438+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=JCI2DYX8KWM9 type=del size=1118193 2024-09-14T11:01:53.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.440+0000 7fe3dd11f780 -1 < failed to complete operation key=KXL3E0PJBNBA tag=WGZXEIXWW1CK type=del size=2783745: (22) Invalid argument 2024-09-14T11:01:53.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.441+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=RIVD64FPC7ZC type=del size=3571694 2024-09-14T11:01:53.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.443+0000 7fe3dd11f780 1 < suggested update operation key=3PS4LAML698X tag=K82HO20HJT9Y type=del size=1575486 2024-09-14T11:01:53.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.446+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~OTE7XN93SDT1.0 size=1048576 2024-09-14T11:01:53.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.447+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~OTE7XN93SDT1.1 size=1048576 2024-09-14T11:01:53.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.448+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~OTE7XN93SDT1.2 size=941146 2024-09-14T11:01:53.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.448+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=OTE7XN93SDT1 tag=9T8Y45MXYW8R type=write size=4086874 2024-09-14T11:01:53.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.449+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=7EERAK6Q71ZL type=del 2024-09-14T11:01:53.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.450+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=25057OLCFJTU type=del size=2911637 2024-09-14T11:01:53.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.451+0000 7fe3dd11f780 -1 < failed to complete operation key=LDILBET1CMYY tag=ID3Y09M6EF20 type=del size=1742702: (22) Invalid argument 2024-09-14T11:01:53.451 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.454+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~WO3NSWZOXK51.0 size=1048576 2024-09-14T11:01:53.452 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.455+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~WO3NSWZOXK51.1 size=1048576 2024-09-14T11:01:53.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.455+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~WO3NSWZOXK51.2 size=999764 2024-09-14T11:01:53.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.456+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=WO3NSWZOXK51 tag=KLFV4COMX9YS type=write size=4145492 2024-09-14T11:01:53.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.457+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=IGQ7GF4RCLEI type=del 2024-09-14T11:01:53.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.458+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=M2VYZB64XHZ5 type=del size=1542803 2024-09-14T11:01:53.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.458+0000 7fe3dd11f780 1 < canceled part key=_multipart_PHLQ77OMLI37.2~G4172AYD1TUP.0 size=1048576 2024-09-14T11:01:53.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.459+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~G4172AYD1TUP.1 size=1048576 2024-09-14T11:01:53.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.460+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~G4172AYD1TUP.2 size=176716 2024-09-14T11:01:53.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.462+0000 7fe3dd11f780 1 < canceled multipart upload key=PHLQ77OMLI37 upload=G4172AYD1TUP tag=BEX6QHOHJ8LG type=write size=3322444 2024-09-14T11:01:53.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.464+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~C1UFWUTZBZQU.0 size=1048576 2024-09-14T11:01:53.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.466+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~C1UFWUTZBZQU.1 size=1048576 2024-09-14T11:01:53.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.466+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~C1UFWUTZBZQU.2 size=120876 2024-09-14T11:01:53.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.466+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=C1UFWUTZBZQU tag=7UB3BELFJ25M type=write size=3266604 2024-09-14T11:01:53.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.468+0000 7fe3dd11f780 1 < canceled operation key=EGC5988RQOEZ tag=GTLCNTZJKHE7 type=del size=4162481 2024-09-14T11:01:53.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.470+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~70JQIS1QYLX2.0 size=1048576 2024-09-14T11:01:53.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.471+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~70JQIS1QYLX2.1 size=1048576 2024-09-14T11:01:53.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.472+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~70JQIS1QYLX2.2 size=540449 2024-09-14T11:01:53.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.472+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=70JQIS1QYLX2 tag=73J0FNVFVW79 type=write size=3686177 2024-09-14T11:01:53.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.473+0000 7fe3dd11f780 -1 < failed to complete operation key=LDILBET1CMYY tag=1FT1U7VG77HN type=del size=2052267: (22) Invalid argument 2024-09-14T11:01:53.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.474+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=KFE8BNX7Y47D type=write size=640446 2024-09-14T11:01:53.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.475+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~2VMFV5S0OXPF.0 size=755967 2024-09-14T11:01:53.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.477+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=2VMFV5S0OXPF tag=Z2A3QV63ZSW2 type=write size=1804543 2024-09-14T11:01:53.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.480+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~P27OX94N8T6N.0 size=1048576 2024-09-14T11:01:53.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.481+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~P27OX94N8T6N.1 size=510728 2024-09-14T11:01:53.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.481+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=P27OX94N8T6N tag=LNK2GDO8E5TI type=write size=2607880 2024-09-14T11:01:53.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.482+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~22WACMUQKR30.0 size=1048576 2024-09-14T11:01:53.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.483+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~22WACMUQKR30.1 size=1048576 2024-09-14T11:01:53.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.484+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~22WACMUQKR30.2 size=928688 2024-09-14T11:01:53.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.486+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=22WACMUQKR30 tag=7LWA5PEOMW64 type=write size=4074416 2024-09-14T11:01:53.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.487+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=QBJTKFTQSIR6 type=del size=3378756 2024-09-14T11:01:53.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.489+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~FZX3A33W4FVN.0 size=1048576 2024-09-14T11:01:53.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.490+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~FZX3A33W4FVN.1 size=391843 2024-09-14T11:01:53.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.492+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=FZX3A33W4FVN tag=6OIPFKK30BDC type=write size=2488995 2024-09-14T11:01:53.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.493+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=7JA23J9KUKO5 type=del size=2586193 2024-09-14T11:01:53.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.494+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~UW8EHXF0TMT3.0 size=1048576 2024-09-14T11:01:53.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.495+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~UW8EHXF0TMT3.1 size=1045320 2024-09-14T11:01:53.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.498+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=UW8EHXF0TMT3 tag=N0RJ581B2ACH type=write size=3142472 2024-09-14T11:01:53.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.499+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=N3OZ8IV77U08 type=del size=1794896 2024-09-14T11:01:53.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.502+0000 7fe3dd11f780 1 < suggested remove operation key=JFLEJGPFLACM tag=0ROLM7B1DO9M type=write 2024-09-14T11:01:53.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.503+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=C31YMEOXQE6S type=write size=763810 2024-09-14T11:01:53.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.504+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=APSGCMX2A9S4 type=write size=914577 2024-09-14T11:01:53.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.505+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=FM8Y62N8ZWRL type=write size=610289 2024-09-14T11:01:53.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.506+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~93E39ZACX8IV.0 size=1048576 2024-09-14T11:01:53.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.507+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~93E39ZACX8IV.1 size=823685 2024-09-14T11:01:53.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.509+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=93E39ZACX8IV tag=CS7AYM21MHMD type=write size=2920837 2024-09-14T11:01:53.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.510+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=8JIP5JH1ENX8 type=del size=549584 2024-09-14T11:01:53.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.511+0000 7fe3dd11f780 -1 < failed to complete operation key=JFLEJGPFLACM tag=JCI2DYX8KWM9 type=del size=1118193: (22) Invalid argument 2024-09-14T11:01:53.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.514+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~46IQ4E3E2ZYO.0 size=951279 2024-09-14T11:01:53.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.514+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=46IQ4E3E2ZYO tag=H2LKYPWZDHNM type=write size=1999855 2024-09-14T11:01:53.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.515+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=RIVD64FPC7ZC type=del 2024-09-14T11:01:53.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.516+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=P8R53P3YE102 type=del size=444445 2024-09-14T11:01:53.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.517+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~OTE7XN93SDT1.0 size=1048576 2024-09-14T11:01:53.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.518+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~OTE7XN93SDT1.1 size=1048576 2024-09-14T11:01:53.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.518+0000 7fe3dd11f780 1 < canceled part key=_multipart_4JTN39NIB2UE.2~OTE7XN93SDT1.2 size=941146 2024-09-14T11:01:53.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.520+0000 7fe3dd11f780 1 < canceled multipart upload key=4JTN39NIB2UE upload=OTE7XN93SDT1 tag=9T8Y45MXYW8R type=write size=4086874 2024-09-14T11:01:53.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.521+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=IEYGKFS6L74H type=write size=437475 2024-09-14T11:01:53.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.522+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=25057OLCFJTU type=del 2024-09-14T11:01:53.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.525+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~RCGHF54YQJB1.0 size=1048576 2024-09-14T11:01:53.523 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.525+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~RCGHF54YQJB1.1 size=389862 2024-09-14T11:01:53.523 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.526+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=RCGHF54YQJB1 tag=5K9SPG1Q8ET2 type=write size=2487014 2024-09-14T11:01:53.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.527+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~WO3NSWZOXK51.0 size=1048576 2024-09-14T11:01:53.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.528+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~WO3NSWZOXK51.1 size=1048576 2024-09-14T11:01:53.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.529+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~WO3NSWZOXK51.2 size=999764 2024-09-14T11:01:53.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.531+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=WO3NSWZOXK51 tag=KLFV4COMX9YS type=write size=4145492 2024-09-14T11:01:53.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.532+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=DGZ89KQS3DVQ type=del size=661033 2024-09-14T11:01:53.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.533+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=M2VYZB64XHZ5 type=del 2024-09-14T11:01:53.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.534+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=CI1TQNZRMSYC type=del size=2182467 2024-09-14T11:01:53.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.535+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~C1UFWUTZBZQU.0 size=1048576 2024-09-14T11:01:53.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.536+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~C1UFWUTZBZQU.1 size=1048576 2024-09-14T11:01:53.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.537+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~C1UFWUTZBZQU.2 size=120876 2024-09-14T11:01:53.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.539+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=C1UFWUTZBZQU tag=7UB3BELFJ25M type=write size=3266604 2024-09-14T11:01:53.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.540+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=YJJ3T444WBZB type=del size=1698115 2024-09-14T11:01:53.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.542+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~70JQIS1QYLX2.0 size=1048576 2024-09-14T11:01:53.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.543+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~70JQIS1QYLX2.1 size=1048576 2024-09-14T11:01:53.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.543+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~70JQIS1QYLX2.2 size=540449 2024-09-14T11:01:53.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.545+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=70JQIS1QYLX2 tag=73J0FNVFVW79 type=write size=3686177 2024-09-14T11:01:53.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.547+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=BTPY1UW716JD type=del size=2297409 2024-09-14T11:01:53.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.548+0000 7fe3dd11f780 1 < completed write operation key=PHLQ77OMLI37 tag=KFE8BNX7Y47D type=write size=640446 2024-09-14T11:01:53.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.550+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~T06N6UQFC5G2.0 size=136949 2024-09-14T11:01:53.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.550+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=T06N6UQFC5G2 tag=22NLQZEVHYSG type=write size=1185525 2024-09-14T11:01:53.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.551+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~P27OX94N8T6N.0 size=1048576 2024-09-14T11:01:53.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.552+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~P27OX94N8T6N.1 size=510728 2024-09-14T11:01:53.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.554+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=P27OX94N8T6N tag=LNK2GDO8E5TI type=write size=2607880 2024-09-14T11:01:53.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.556+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=IB2UA3W78KUC type=del size=1240306 2024-09-14T11:01:53.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.557+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=QBJTKFTQSIR6 type=del 2024-09-14T11:01:53.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.559+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~7A2DJ71TM3EH.0 size=1048576 2024-09-14T11:01:53.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.560+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~7A2DJ71TM3EH.1 size=392365 2024-09-14T11:01:53.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.560+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=7A2DJ71TM3EH tag=OLFC8P2HCLK0 type=write size=2489517 2024-09-14T11:01:53.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.563+0000 7fe3dd11f780 1 < suggested remove operation key=LDILBET1CMYY tag=7JA23J9KUKO5 type=del 2024-09-14T11:01:53.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.564+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=V9ZRZW1RUE8W type=write size=698381 2024-09-14T11:01:53.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.565+0000 7fe3dd11f780 1 < canceled operation key=ZTD98WQ6032X tag=N3OZ8IV77U08 type=del size=1794896 2024-09-14T11:01:53.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.567+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~KMOA3RAWR2JZ.0 size=1048576 2024-09-14T11:01:53.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.568+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~KMOA3RAWR2JZ.1 size=1048576 2024-09-14T11:01:53.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.569+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~KMOA3RAWR2JZ.2 size=401643 2024-09-14T11:01:53.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.569+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=KMOA3RAWR2JZ tag=WGSYUQAJKBAP type=write size=3547371 2024-09-14T11:01:53.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.570+0000 7fe3dd11f780 1 < completed write operation key=QPH41U60044L tag=C31YMEOXQE6S type=write size=763810 2024-09-14T11:01:53.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.571+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=TPHZYQHDWP8L type=del size=922458 2024-09-14T11:01:53.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.574+0000 7fe3dd11f780 1 < suggested update operation key=UYZGHGZR74HQ tag=FM8Y62N8ZWRL type=write size=610289 2024-09-14T11:01:53.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.576+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~P52R2WOX0W2P.0 size=1048576 2024-09-14T11:01:53.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.577+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~P52R2WOX0W2P.1 size=485535 2024-09-14T11:01:53.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.577+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=P52R2WOX0W2P tag=6IG0D94AR1Q0 type=write size=2582687 2024-09-14T11:01:53.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.578+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=8JIP5JH1ENX8 type=del 2024-09-14T11:01:53.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.579+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=H0C34062H6AM type=del size=346756 2024-09-14T11:01:53.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.580+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~46IQ4E3E2ZYO.0 size=951279 2024-09-14T11:01:53.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.582+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=46IQ4E3E2ZYO tag=H2LKYPWZDHNM type=write size=1999855 2024-09-14T11:01:53.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.584+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~O0290FPT3RR9.0 size=702794 2024-09-14T11:01:53.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.584+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=O0290FPT3RR9 tag=0O29UCKW0T0Q type=write size=1751370 2024-09-14T11:01:53.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.587+0000 7fe3dd11f780 1 < suggested remove operation key=VDSOBBVO3QGB tag=P8R53P3YE102 type=del 2024-09-14T11:01:53.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.589+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Y9XGFWS76UT9.0 size=1048576 2024-09-14T11:01:53.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.590+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Y9XGFWS76UT9.1 size=1048576 2024-09-14T11:01:53.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.590+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Y9XGFWS76UT9.2 size=360836 2024-09-14T11:01:53.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.590+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=Y9XGFWS76UT9 tag=38Z78D0D8C42 type=write size=3506564 2024-09-14T11:01:53.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.592+0000 7fe3dd11f780 1 < completed write operation key=US8KP3YL88TG tag=IEYGKFS6L74H type=write size=437475 2024-09-14T11:01:53.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.593+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=EB7ZI7DN2LK8 type=del size=1258028 2024-09-14T11:01:53.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.594+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~RCGHF54YQJB1.0 size=1048576 2024-09-14T11:01:53.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.595+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~RCGHF54YQJB1.1 size=389862 2024-09-14T11:01:53.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.597+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=RCGHF54YQJB1 tag=5K9SPG1Q8ET2 type=write size=2487014 2024-09-14T11:01:53.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.599+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~234XI9GCND11.0 size=1048576 2024-09-14T11:01:53.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.600+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~234XI9GCND11.1 size=1048576 2024-09-14T11:01:53.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.601+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~234XI9GCND11.2 size=181827 2024-09-14T11:01:53.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.601+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=234XI9GCND11 tag=QVYB88FNYUXU type=write size=3327555 2024-09-14T11:01:53.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.602+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=DGZ89KQS3DVQ type=del 2024-09-14T11:01:53.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.603+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=80E30378O775 type=del size=3308147 2024-09-14T11:01:53.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.606+0000 7fe3dd11f780 1 < suggested update operation key=ZTD98WQ6032X tag=CI1TQNZRMSYC type=del size=2182467 2024-09-14T11:01:53.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.609+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~60RS0E9RLIQT.0 size=1048576 2024-09-14T11:01:53.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.610+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~60RS0E9RLIQT.1 size=1048576 2024-09-14T11:01:53.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.611+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~60RS0E9RLIQT.2 size=292704 2024-09-14T11:01:53.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.611+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=60RS0E9RLIQT tag=NOBDLZBHBMPP type=write size=3438432 2024-09-14T11:01:53.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.613+0000 7fe3dd11f780 1 < suggested remove operation key=3PS4LAML698X tag=YJJ3T444WBZB type=del 2024-09-14T11:01:53.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.615+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~KNWRA1W5YCVE.0 size=1048576 2024-09-14T11:01:53.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.616+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~KNWRA1W5YCVE.1 size=1048576 2024-09-14T11:01:53.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.617+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~KNWRA1W5YCVE.2 size=582207 2024-09-14T11:01:53.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.617+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=KNWRA1W5YCVE tag=Z5Y3FS7VIIRN type=write size=3727935 2024-09-14T11:01:53.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.618+0000 7fe3dd11f780 1 < canceled operation key=YXPZXFY8930D tag=BTPY1UW716JD type=del size=2297409 2024-09-14T11:01:53.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.619+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=94GLSC1VY2JP type=del size=3723426 2024-09-14T11:01:53.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.620+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~T06N6UQFC5G2.0 size=136949 2024-09-14T11:01:53.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.621+0000 7fe3dd11f780 1 < canceled multipart upload key=GQEFQ1UD6QCJ upload=T06N6UQFC5G2 tag=22NLQZEVHYSG type=write size=1185525 2024-09-14T11:01:53.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.623+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=SM8EMSJX91Y0 type=del size=1188900 2024-09-14T11:01:53.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.624+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=IB2UA3W78KUC type=del 2024-09-14T11:01:53.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.626+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~XKM33HZPB9K5.0 size=1048576 2024-09-14T11:01:53.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.627+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~XKM33HZPB9K5.1 size=686233 2024-09-14T11:01:53.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.627+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=XKM33HZPB9K5 tag=DOL2IRWU1OOR type=write size=2783385 2024-09-14T11:01:53.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.628+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~7A2DJ71TM3EH.0 size=1048576 2024-09-14T11:01:53.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.629+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~7A2DJ71TM3EH.1 size=392365 2024-09-14T11:01:53.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.631+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=7A2DJ71TM3EH tag=OLFC8P2HCLK0 type=write size=2489517 2024-09-14T11:01:53.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.633+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~5T5FBPR82JCS.0 size=876531 2024-09-14T11:01:53.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.633+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=5T5FBPR82JCS tag=0AB54UOQDHQ4 type=write size=1925107 2024-09-14T11:01:53.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.635+0000 7fe3dd11f780 1 < canceled operation key=JSEN4QXEMVHS tag=V9ZRZW1RUE8W type=write size=698381 2024-09-14T11:01:53.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.636+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=G6NRG62D1L4O type=del size=3111972 2024-09-14T11:01:53.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.637+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~KMOA3RAWR2JZ.0 size=1048576 2024-09-14T11:01:53.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.638+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~KMOA3RAWR2JZ.1 size=1048576 2024-09-14T11:01:53.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.639+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~KMOA3RAWR2JZ.2 size=401643 2024-09-14T11:01:53.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.641+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=KMOA3RAWR2JZ tag=WGSYUQAJKBAP type=write size=3547371 2024-09-14T11:01:53.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.642+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=AKUGBKSTG21T type=write size=26316 2024-09-14T11:01:53.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.645+0000 7fe3dd11f780 1 < suggested remove operation key=IOAG4ZE1I58Z tag=TPHZYQHDWP8L type=del 2024-09-14T11:01:53.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.646+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=D086K306F8ZC type=del size=2374160 2024-09-14T11:01:53.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.647+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~P52R2WOX0W2P.0 size=1048576 2024-09-14T11:01:53.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.648+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~P52R2WOX0W2P.1 size=485535 2024-09-14T11:01:53.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.650+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=P52R2WOX0W2P tag=6IG0D94AR1Q0 type=write size=2582687 2024-09-14T11:01:53.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.651+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=HGD393UQGLCG type=del size=3096473 2024-09-14T11:01:53.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.652+0000 7fe3dd11f780 -1 < failed to complete operation key=IOAG4ZE1I58Z tag=H0C34062H6AM type=del size=346756: (22) Invalid argument 2024-09-14T11:01:53.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.654+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~B8SPFNPJG2FY.0 size=1048576 2024-09-14T11:01:53.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.655+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~B8SPFNPJG2FY.1 size=418487 2024-09-14T11:01:53.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.655+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=B8SPFNPJG2FY tag=GOPCHPIIQIE1 type=write size=2515639 2024-09-14T11:01:53.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.656+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~O0290FPT3RR9.0 size=702794 2024-09-14T11:01:53.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.658+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=O0290FPT3RR9 tag=0O29UCKW0T0Q type=write size=1751370 2024-09-14T11:01:53.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.660+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~HNAW05ZJEUQV.0 size=1048576 2024-09-14T11:01:53.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.661+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~HNAW05ZJEUQV.1 size=1048576 2024-09-14T11:01:53.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.662+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~HNAW05ZJEUQV.2 size=620031 2024-09-14T11:01:53.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.662+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=HNAW05ZJEUQV tag=PLEYPNDTV7Z3 type=write size=3765759 2024-09-14T11:01:53.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.664+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Y9XGFWS76UT9.0 size=1048576 2024-09-14T11:01:53.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.665+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Y9XGFWS76UT9.1 size=1048576 2024-09-14T11:01:53.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.666+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Y9XGFWS76UT9.2 size=360836 2024-09-14T11:01:53.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.668+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=Y9XGFWS76UT9 tag=38Z78D0D8C42 type=write size=3506564 2024-09-14T11:01:53.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.670+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~MJQHSNUDLTS6.0 size=1048576 2024-09-14T11:01:53.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.671+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~MJQHSNUDLTS6.1 size=344886 2024-09-14T11:01:53.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.671+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=MJQHSNUDLTS6 tag=748Q4YB0ZC0N type=write size=2442038 2024-09-14T11:01:53.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.672+0000 7fe3dd11f780 -1 < failed to complete operation key=3PS4LAML698X tag=EB7ZI7DN2LK8 type=del size=1258028: (22) Invalid argument 2024-09-14T11:01:53.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.673+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=Z32RU01ONXOM type=del size=1506184 2024-09-14T11:01:53.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.674+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~234XI9GCND11.0 size=1048576 2024-09-14T11:01:53.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.675+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~234XI9GCND11.1 size=1048576 2024-09-14T11:01:53.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.676+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~234XI9GCND11.2 size=181827 2024-09-14T11:01:53.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.678+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=234XI9GCND11 tag=QVYB88FNYUXU type=write size=3327555 2024-09-14T11:01:53.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.680+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=G5TJWS5Q4RRG type=del size=1842636 2024-09-14T11:01:53.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.682+0000 7fe3dd11f780 1 < suggested remove operation key=M0DMAQ5LTDR0 tag=80E30378O775 type=del 2024-09-14T11:01:53.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.684+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~0QQNP1C9LLGX.0 size=1048576 2024-09-14T11:01:53.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.685+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~0QQNP1C9LLGX.1 size=1048576 2024-09-14T11:01:53.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.686+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~0QQNP1C9LLGX.2 size=990201 2024-09-14T11:01:53.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.686+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=0QQNP1C9LLGX tag=NVLNPWFM0L5L type=write size=4135929 2024-09-14T11:01:53.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.687+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~60RS0E9RLIQT.0 size=1048576 2024-09-14T11:01:53.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.688+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~60RS0E9RLIQT.1 size=1048576 2024-09-14T11:01:53.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.689+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~60RS0E9RLIQT.2 size=292704 2024-09-14T11:01:53.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.691+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=60RS0E9RLIQT tag=NOBDLZBHBMPP type=write size=3438432 2024-09-14T11:01:53.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.692+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=D9A216UOV2S9 type=del size=3543770 2024-09-14T11:01:53.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.693+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~KNWRA1W5YCVE.0 size=1048576 2024-09-14T11:01:53.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.694+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~KNWRA1W5YCVE.1 size=1048576 2024-09-14T11:01:53.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.695+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~KNWRA1W5YCVE.2 size=582207 2024-09-14T11:01:53.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.697+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=KNWRA1W5YCVE tag=Z5Y3FS7VIIRN type=write size=3727935 2024-09-14T11:01:53.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.698+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=OIJ0MOB3PT9S type=del size=51290 2024-09-14T11:01:53.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.701+0000 7fe3dd11f780 1 < suggested update operation key=K9BP30LHDPA1 tag=94GLSC1VY2JP type=del size=3723426 2024-09-14T11:01:53.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.703+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~CQADGN5JY37N.0 size=214053 2024-09-14T11:01:53.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.703+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=CQADGN5JY37N tag=HS39N0Z38GOF type=write size=1262629 2024-09-14T11:01:53.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.704+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=SM8EMSJX91Y0 type=del 2024-09-14T11:01:53.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.706+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~3SOX9J7O23OI.0 size=467085 2024-09-14T11:01:53.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.706+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=3SOX9J7O23OI tag=S8N41SOSN9UG type=write size=1515661 2024-09-14T11:01:53.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.707+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~XKM33HZPB9K5.0 size=1048576 2024-09-14T11:01:53.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.708+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~XKM33HZPB9K5.1 size=686233 2024-09-14T11:01:53.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.710+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=XKM33HZPB9K5 tag=DOL2IRWU1OOR type=write size=2783385 2024-09-14T11:01:53.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.712+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~S8U2U876MLZU.0 size=344480 2024-09-14T11:01:53.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.712+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=S8U2U876MLZU tag=4PIM7QSW4IFV type=write size=1393056 2024-09-14T11:01:53.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.713+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~5T5FBPR82JCS.0 size=876531 2024-09-14T11:01:53.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.716+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=5T5FBPR82JCS tag=0AB54UOQDHQ4 type=write size=1925107 2024-09-14T11:01:53.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.718+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~8H110TTNQYR1.0 size=475101 2024-09-14T11:01:53.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.718+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=8H110TTNQYR1 tag=8CRHHXG15ENQ type=write size=1523677 2024-09-14T11:01:53.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.720+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=G6NRG62D1L4O type=del 2024-09-14T11:01:53.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.722+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~Z8GT3GIHNBY3.0 size=676706 2024-09-14T11:01:53.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.722+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=Z8GT3GIHNBY3 tag=JOMPMAKE0K02 type=write size=1725282 2024-09-14T11:01:53.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.723+0000 7fe3dd11f780 1 < completed write operation key=NHKCRGX10WBM tag=AKUGBKSTG21T type=write size=26316 2024-09-14T11:01:53.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.724+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=KJIOP4P3O0Y3 type=del size=1115895 2024-09-14T11:01:53.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.725+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=D086K306F8ZC type=del 2024-09-14T11:01:53.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.728+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~IWCL0TZZHFP6.0 size=1000726 2024-09-14T11:01:53.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.728+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=IWCL0TZZHFP6 tag=QGP9TMX2Q03N type=write size=2049302 2024-09-14T11:01:53.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.729+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=HGD393UQGLCG type=del 2024-09-14T11:01:53.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.730+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=8U39FJS0HASM type=del size=497244 2024-09-14T11:01:53.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.731+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~B8SPFNPJG2FY.0 size=1048576 2024-09-14T11:01:53.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.732+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~B8SPFNPJG2FY.1 size=418487 2024-09-14T11:01:53.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.734+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=B8SPFNPJG2FY tag=GOPCHPIIQIE1 type=write size=2515639 2024-09-14T11:01:53.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.736+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~S2223BCTIY8R.0 size=1048576 2024-09-14T11:01:53.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.737+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~S2223BCTIY8R.1 size=1048576 2024-09-14T11:01:53.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.738+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~S2223BCTIY8R.2 size=531654 2024-09-14T11:01:53.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.738+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=S2223BCTIY8R tag=NBZISTZ4BQ0C type=write size=3677382 2024-09-14T11:01:53.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.739+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~HNAW05ZJEUQV.0 size=1048576 2024-09-14T11:01:53.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.739+0000 7fe3dd11f780 1 < canceled part key=_multipart_YXPZXFY8930D.2~HNAW05ZJEUQV.1 size=1048576 2024-09-14T11:01:53.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.739+0000 7fe3dd11f780 1 < canceled part key=_multipart_YXPZXFY8930D.2~HNAW05ZJEUQV.2 size=620031 2024-09-14T11:01:53.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.741+0000 7fe3dd11f780 1 < canceled multipart upload key=YXPZXFY8930D upload=HNAW05ZJEUQV tag=PLEYPNDTV7Z3 type=write size=3765759 2024-09-14T11:01:53.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.742+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=VOBDAHT3J8XN type=write size=818984 2024-09-14T11:01:53.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.743+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~MJQHSNUDLTS6.0 size=1048576 2024-09-14T11:01:53.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.744+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~MJQHSNUDLTS6.1 size=344886 2024-09-14T11:01:53.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.746+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=MJQHSNUDLTS6 tag=748Q4YB0ZC0N type=write size=2442038 2024-09-14T11:01:53.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.747+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=MECKGSZ0LECB type=del size=1026712 2024-09-14T11:01:53.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.749+0000 7fe3dd11f780 1 < canceled operation key=22TI1VCDTK5P tag=Z32RU01ONXOM type=del size=1506184 2024-09-14T11:01:53.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.750+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=TT9SEQFNCJO9 type=del size=208874 2024-09-14T11:01:53.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.751+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=G5TJWS5Q4RRG type=del 2024-09-14T11:01:53.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.752+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=RGRARZE362L1 type=write size=511708 2024-09-14T11:01:53.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.754+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~0QQNP1C9LLGX.0 size=1048576 2024-09-14T11:01:53.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.755+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~0QQNP1C9LLGX.1 size=1048576 2024-09-14T11:01:53.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.755+0000 7fe3dd11f780 1 < canceled part key=_multipart_VDSOBBVO3QGB.2~0QQNP1C9LLGX.2 size=990201 2024-09-14T11:01:53.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.757+0000 7fe3dd11f780 1 < canceled multipart upload key=VDSOBBVO3QGB upload=0QQNP1C9LLGX tag=NVLNPWFM0L5L type=write size=4135929 2024-09-14T11:01:53.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.758+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=0EHVD1XLCA4S type=del size=1474800 2024-09-14T11:01:53.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.760+0000 7fe3dd11f780 1 < suggested update operation key=22TI1VCDTK5P tag=D9A216UOV2S9 type=del size=3543770 2024-09-14T11:01:53.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.762+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=G3CSGFHNACNY type=del size=1679138 2024-09-14T11:01:53.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.763+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=OIJ0MOB3PT9S type=del 2024-09-14T11:01:53.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.764+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=UUI86T3TAMA6 type=del size=3464736 2024-09-14T11:01:53.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.766+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~CQADGN5JY37N.0 size=214053 2024-09-14T11:01:53.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.768+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=CQADGN5JY37N tag=HS39N0Z38GOF type=write size=1262629 2024-09-14T11:01:53.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.769+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=G9HR9ZSAKEAG type=del size=772453 2024-09-14T11:01:53.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.770+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~3SOX9J7O23OI.0 size=467085 2024-09-14T11:01:53.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.772+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=3SOX9J7O23OI tag=S8N41SOSN9UG type=write size=1515661 2024-09-14T11:01:53.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.773+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=3FGRVMS7K2RG type=del size=1271961 2024-09-14T11:01:53.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.775+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~S8U2U876MLZU.0 size=344480 2024-09-14T11:01:53.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.777+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=S8U2U876MLZU tag=4PIM7QSW4IFV type=write size=1393056 2024-09-14T11:01:53.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.778+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=ZCLPIDP77HTD type=del size=1312246 2024-09-14T11:01:53.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.778+0000 7fe3dd11f780 1 < canceled part key=_multipart_LDILBET1CMYY.2~8H110TTNQYR1.0 size=475101 2024-09-14T11:01:53.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.780+0000 7fe3dd11f780 1 < canceled multipart upload key=LDILBET1CMYY upload=8H110TTNQYR1 tag=8CRHHXG15ENQ type=write size=1523677 2024-09-14T11:01:53.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.782+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~KF1JRLE03S82.0 size=1048576 2024-09-14T11:01:53.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.783+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~KF1JRLE03S82.1 size=189047 2024-09-14T11:01:53.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.783+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=KF1JRLE03S82 tag=EIJTA2B6T5DG type=write size=2286199 2024-09-14T11:01:53.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.784+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~Z8GT3GIHNBY3.0 size=676706 2024-09-14T11:01:53.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.786+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=Z8GT3GIHNBY3 tag=JOMPMAKE0K02 type=write size=1725282 2024-09-14T11:01:53.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.788+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GC6ZPB6NU4DB.0 size=1048576 2024-09-14T11:01:53.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.789+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GC6ZPB6NU4DB.1 size=1048576 2024-09-14T11:01:53.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.790+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GC6ZPB6NU4DB.2 size=1002590 2024-09-14T11:01:53.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.790+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=GC6ZPB6NU4DB tag=391JTSW1HT4G type=write size=4148318 2024-09-14T11:01:53.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.793+0000 7fe3dd11f780 1 < suggested remove operation key=EGC5988RQOEZ tag=KJIOP4P3O0Y3 type=del 2024-09-14T11:01:53.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.795+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~11KX97JNXVJW.0 size=278895 2024-09-14T11:01:53.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.795+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=11KX97JNXVJW tag=U9A9SKCHNJGN type=write size=1327471 2024-09-14T11:01:53.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.796+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~IWCL0TZZHFP6.0 size=1000726 2024-09-14T11:01:53.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.798+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=IWCL0TZZHFP6 tag=QGP9TMX2Q03N type=write size=2049302 2024-09-14T11:01:53.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.801+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~ZHP69EWER5BK.0 size=1048576 2024-09-14T11:01:53.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.802+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~ZHP69EWER5BK.1 size=1028855 2024-09-14T11:01:53.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.802+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=ZHP69EWER5BK tag=NDX1IDF0JYJR type=write size=3126007 2024-09-14T11:01:53.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.803+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=8U39FJS0HASM type=del 2024-09-14T11:01:53.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.805+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~B4JF3BDYW6K0.0 size=424999 2024-09-14T11:01:53.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.805+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=B4JF3BDYW6K0 tag=6GNQVL1QQUFK type=write size=1473575 2024-09-14T11:01:53.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.806+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~S2223BCTIY8R.0 size=1048576 2024-09-14T11:01:53.805 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.807+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~S2223BCTIY8R.1 size=1048576 2024-09-14T11:01:53.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.808+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~S2223BCTIY8R.2 size=531654 2024-09-14T11:01:53.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.810+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=S2223BCTIY8R tag=NBZISTZ4BQ0C type=write size=3677382 2024-09-14T11:01:53.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.812+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=J4CB8L5PVBI5 type=write size=595052 2024-09-14T11:01:53.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.813+0000 7fe3dd11f780 1 < completed write operation key=QPH41U60044L tag=VOBDAHT3J8XN type=write size=818984 2024-09-14T11:01:53.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.814+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=F31VBDX9PJY9 type=del size=2220338 2024-09-14T11:01:53.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.815+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=MECKGSZ0LECB type=del 2024-09-14T11:01:53.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.816+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=0K7FCB781OY9 type=del size=1736476 2024-09-14T11:01:53.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.818+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=TT9SEQFNCJO9 type=del 2024-09-14T11:01:53.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.820+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~P2QDRRJW031G.0 size=1048576 2024-09-14T11:01:53.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.821+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~P2QDRRJW031G.1 size=640019 2024-09-14T11:01:53.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.821+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=P2QDRRJW031G tag=NSFE5SECORIR type=write size=2737171 2024-09-14T11:01:53.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.822+0000 7fe3dd11f780 -1 < failed to complete operation key=EGC5988RQOEZ tag=RGRARZE362L1 type=write size=511708: (22) Invalid argument 2024-09-14T11:01:53.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.824+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~2QVCLBW4TLAG.0 size=1048576 2024-09-14T11:01:53.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.825+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~2QVCLBW4TLAG.1 size=572603 2024-09-14T11:01:53.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.825+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=2QVCLBW4TLAG tag=I3VHSSLWYNOM type=write size=2669755 2024-09-14T11:01:53.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.827+0000 7fe3dd11f780 1 < canceled operation key=LFKLJAJWQ2J6 tag=0EHVD1XLCA4S type=del size=1474800 2024-09-14T11:01:53.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.829+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~RQPPO0DWI8KK.0 size=1048576 2024-09-14T11:01:53.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.830+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~RQPPO0DWI8KK.1 size=390381 2024-09-14T11:01:53.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.830+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=RQPPO0DWI8KK tag=NEWCYMXMGZZ5 type=write size=2487533 2024-09-14T11:01:53.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.832+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=G3CSGFHNACNY type=del 2024-09-14T11:01:53.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.834+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~ZICZJV53WK31.0 size=1048576 2024-09-14T11:01:53.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.835+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~ZICZJV53WK31.1 size=1048576 2024-09-14T11:01:53.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.836+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~ZICZJV53WK31.2 size=900552 2024-09-14T11:01:53.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.836+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=ZICZJV53WK31 tag=K7XLOHRY6PQ9 type=write size=4046280 2024-09-14T11:01:53.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.838+0000 7fe3dd11f780 1 < suggested update operation key=QPH41U60044L tag=UUI86T3TAMA6 type=del size=3464736 2024-09-14T11:01:53.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.839+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=0WMTQ7FSQNUR type=del size=807788 2024-09-14T11:01:53.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.841+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=G9HR9ZSAKEAG type=del 2024-09-14T11:01:53.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.842+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=74YIC8JBIKAW type=del size=3707441 2024-09-14T11:01:53.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.843+0000 7fe3dd11f780 1 < canceled operation key=NHKCRGX10WBM tag=3FGRVMS7K2RG type=del size=1271961 2024-09-14T11:01:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.845+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~YEFKHYY6N5JP.0 size=925490 2024-09-14T11:01:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.845+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=YEFKHYY6N5JP tag=FERYI3M77CW1 type=write size=1974066 2024-09-14T11:01:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.846+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=ZCLPIDP77HTD type=del 2024-09-14T11:01:53.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.848+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~0QPO3HVGPDRL.0 size=928801 2024-09-14T11:01:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.848+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=0QPO3HVGPDRL tag=CVX4SNK8LJEA type=write size=1977377 2024-09-14T11:01:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.849+0000 7fe3dd11f780 1 < canceled part key=_multipart_UYZGHGZR74HQ.2~KF1JRLE03S82.0 size=1048576 2024-09-14T11:01:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.850+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~KF1JRLE03S82.1 size=189047 2024-09-14T11:01:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.852+0000 7fe3dd11f780 1 < canceled multipart upload key=UYZGHGZR74HQ upload=KF1JRLE03S82 tag=EIJTA2B6T5DG type=write size=2286199 2024-09-14T11:01:53.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.853+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=JZIFYZ7XZ141 type=write size=889287 2024-09-14T11:01:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.854+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GC6ZPB6NU4DB.0 size=1048576 2024-09-14T11:01:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.855+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GC6ZPB6NU4DB.1 size=1048576 2024-09-14T11:01:53.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.857+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GC6ZPB6NU4DB.2 size=1002590 2024-09-14T11:01:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.859+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=GC6ZPB6NU4DB tag=391JTSW1HT4G type=write size=4148318 2024-09-14T11:01:53.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.860+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=VNHO67LY8IYH type=del size=2874436 2024-09-14T11:01:53.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.862+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~11KX97JNXVJW.0 size=278895 2024-09-14T11:01:53.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.864+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=11KX97JNXVJW tag=U9A9SKCHNJGN type=write size=1327471 2024-09-14T11:01:53.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.865+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=1NUDNLIJHMSN type=del size=740690 2024-09-14T11:01:53.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.866+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~ZHP69EWER5BK.0 size=1048576 2024-09-14T11:01:53.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.866+0000 7fe3dd11f780 1 < canceled part key=_multipart_LDILBET1CMYY.2~ZHP69EWER5BK.1 size=1028855 2024-09-14T11:01:53.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.868+0000 7fe3dd11f780 1 < canceled multipart upload key=LDILBET1CMYY upload=ZHP69EWER5BK tag=NDX1IDF0JYJR type=write size=3126007 2024-09-14T11:01:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.869+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=BLG8YG09A2ZD type=del size=1241994 2024-09-14T11:01:53.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.870+0000 7fe3dd11f780 1 < canceled part key=_multipart_PHLQ77OMLI37.2~B4JF3BDYW6K0.0 size=424999 2024-09-14T11:01:53.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.872+0000 7fe3dd11f780 1 < canceled multipart upload key=PHLQ77OMLI37 upload=B4JF3BDYW6K0 tag=6GNQVL1QQUFK type=write size=1473575 2024-09-14T11:01:53.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.873+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=XD9TUAI2U936 type=del size=3001677 2024-09-14T11:01:53.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.874+0000 7fe3dd11f780 1 < completed write operation key=NHKCRGX10WBM tag=J4CB8L5PVBI5 type=write size=595052 2024-09-14T11:01:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.876+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=KJE7I82P8QRE type=write size=104310 2024-09-14T11:01:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.878+0000 7fe3dd11f780 1 < suggested update operation key=ZI5SFHGWCHJA tag=F31VBDX9PJY9 type=del size=2220338 2024-09-14T11:01:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.881+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~UK40X1RVY60O.0 size=661344 2024-09-14T11:01:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.881+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=UK40X1RVY60O tag=IANFG1C76RTJ type=write size=1709920 2024-09-14T11:01:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.882+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=0K7FCB781OY9 type=del 2024-09-14T11:01:53.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.883+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=4IDI11P14Y98 type=del size=2050963 2024-09-14T11:01:53.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.885+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~P2QDRRJW031G.0 size=1048576 2024-09-14T11:01:53.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.886+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~P2QDRRJW031G.1 size=640019 2024-09-14T11:01:53.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.888+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=P2QDRRJW031G tag=NSFE5SECORIR type=write size=2737171 2024-09-14T11:01:53.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.889+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=DETIL7V6CB9F type=del size=1148893 2024-09-14T11:01:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.891+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~2QVCLBW4TLAG.0 size=1048576 2024-09-14T11:01:53.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.892+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~2QVCLBW4TLAG.1 size=572603 2024-09-14T11:01:53.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.894+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=2QVCLBW4TLAG tag=I3VHSSLWYNOM type=write size=2669755 2024-09-14T11:01:53.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.896+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~MF32985DJOOQ.0 size=1048576 2024-09-14T11:01:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.897+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~MF32985DJOOQ.1 size=93508 2024-09-14T11:01:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.897+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=MF32985DJOOQ tag=KONPX6RBMOL9 type=write size=2190660 2024-09-14T11:01:53.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.897+0000 7fe3dd11f780 1 < canceled part key=_multipart_QPH41U60044L.2~RQPPO0DWI8KK.0 size=1048576 2024-09-14T11:01:53.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.898+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~RQPPO0DWI8KK.1 size=390381 2024-09-14T11:01:53.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.900+0000 7fe3dd11f780 1 < canceled multipart upload key=QPH41U60044L upload=RQPPO0DWI8KK tag=NEWCYMXMGZZ5 type=write size=2487533 2024-09-14T11:01:53.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.902+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MS9L4YU6YII2.0 size=1048576 2024-09-14T11:01:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.903+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MS9L4YU6YII2.1 size=862098 2024-09-14T11:01:53.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.903+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=MS9L4YU6YII2 tag=1663K60TG23S type=write size=2959250 2024-09-14T11:01:53.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.904+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~ZICZJV53WK31.0 size=1048576 2024-09-14T11:01:53.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.905+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~ZICZJV53WK31.1 size=1048576 2024-09-14T11:01:53.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.905+0000 7fe3dd11f780 1 < canceled part key=_multipart_KXL3E0PJBNBA.2~ZICZJV53WK31.2 size=900552 2024-09-14T11:01:53.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.907+0000 7fe3dd11f780 1 < canceled multipart upload key=KXL3E0PJBNBA upload=ZICZJV53WK31 tag=K7XLOHRY6PQ9 type=write size=4046280 2024-09-14T11:01:53.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.908+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=DT7YYVIP5WRV type=del size=3794397 2024-09-14T11:01:53.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.910+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=0WMTQ7FSQNUR type=del 2024-09-14T11:01:53.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.912+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~IYQEAJAC0VRB.0 size=1048576 2024-09-14T11:01:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.913+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~IYQEAJAC0VRB.1 size=611409 2024-09-14T11:01:53.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.913+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=IYQEAJAC0VRB tag=DYCCXBU36KMT type=write size=2708561 2024-09-14T11:01:53.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.915+0000 7fe3dd11f780 1 < suggested remove operation key=YMGE9GKLSPE6 tag=74YIC8JBIKAW type=del 2024-09-14T11:01:53.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.917+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GK2PDBLOVDDM.0 size=1039817 2024-09-14T11:01:53.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.917+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=GK2PDBLOVDDM tag=L5AF5KXFOOB3 type=write size=2088393 2024-09-14T11:01:53.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.918+0000 7fe3dd11f780 1 < canceled part key=_multipart_4JTN39NIB2UE.2~YEFKHYY6N5JP.0 size=925490 2024-09-14T11:01:53.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.920+0000 7fe3dd11f780 1 < canceled multipart upload key=4JTN39NIB2UE upload=YEFKHYY6N5JP tag=FERYI3M77CW1 type=write size=1974066 2024-09-14T11:01:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.922+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~QS12W9VATWYE.0 size=32573 2024-09-14T11:01:53.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.922+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=QS12W9VATWYE tag=0DIHAFUALY9U type=write size=1081149 2024-09-14T11:01:53.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.923+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~0QPO3HVGPDRL.0 size=928801 2024-09-14T11:01:53.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.925+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=0QPO3HVGPDRL tag=CVX4SNK8LJEA type=write size=1977377 2024-09-14T11:01:53.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.926+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=SC1FXQ18UKFY type=write size=554862 2024-09-14T11:01:53.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.927+0000 7fe3dd11f780 -1 < failed to complete operation key=ZI5SFHGWCHJA tag=JZIFYZ7XZ141 type=write size=889287: (22) Invalid argument 2024-09-14T11:01:53.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.929+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~AFNQ9NHAT6KF.0 size=1048576 2024-09-14T11:01:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.930+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~AFNQ9NHAT6KF.1 size=247873 2024-09-14T11:01:53.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.930+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=AFNQ9NHAT6KF tag=NBWUDYG21AG3 type=write size=2345025 2024-09-14T11:01:53.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.931+0000 7fe3dd11f780 -1 < failed to complete operation key=ZI5SFHGWCHJA tag=VNHO67LY8IYH type=del size=2874436: (22) Invalid argument 2024-09-14T11:01:53.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.933+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~41IMEY3BU6MA.0 size=1048576 2024-09-14T11:01:53.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.934+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~41IMEY3BU6MA.1 size=768182 2024-09-14T11:01:53.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.934+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=41IMEY3BU6MA tag=VC56G5DNX9R6 type=write size=2865334 2024-09-14T11:01:53.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.937+0000 7fe3dd11f780 1 < suggested remove operation key=GQEFQ1UD6QCJ tag=1NUDNLIJHMSN type=del 2024-09-14T11:01:53.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.939+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~6N6Q34HFZ4EH.0 size=1048576 2024-09-14T11:01:53.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.941+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~6N6Q34HFZ4EH.1 size=1048576 2024-09-14T11:01:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.942+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~6N6Q34HFZ4EH.2 size=635970 2024-09-14T11:01:53.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.942+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=6N6Q34HFZ4EH tag=YT1R1Q2JFUCA type=write size=3781698 2024-09-14T11:01:53.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.943+0000 7fe3dd11f780 1 < canceled operation key=NHKCRGX10WBM tag=BLG8YG09A2ZD type=del size=1241994 2024-09-14T11:01:53.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.945+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~HQ1J7CE6NT5W.0 size=1048576 2024-09-14T11:01:53.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.946+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~HQ1J7CE6NT5W.1 size=452615 2024-09-14T11:01:53.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.946+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=HQ1J7CE6NT5W tag=888Q33PS66ME type=write size=2549767 2024-09-14T11:01:53.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.948+0000 7fe3dd11f780 1 < suggested remove operation key=LFKLJAJWQ2J6 tag=XD9TUAI2U936 type=del 2024-09-14T11:01:53.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.950+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=VW9U84OIP0BM type=del size=849259 2024-09-14T11:01:53.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.951+0000 7fe3dd11f780 1 < completed write operation key=6PJ03TAYRUT8 tag=KJE7I82P8QRE type=write size=104310 2024-09-14T11:01:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.953+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~BNJSFHA1SOUY.0 size=672309 2024-09-14T11:01:53.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.953+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=BNJSFHA1SOUY tag=V8T6SPTR8U7V type=write size=1720885 2024-09-14T11:01:53.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.955+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~UK40X1RVY60O.0 size=661344 2024-09-14T11:01:53.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.957+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=UK40X1RVY60O tag=IANFG1C76RTJ type=write size=1709920 2024-09-14T11:01:53.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.958+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=QZRM3V81X9T0 type=del size=3844581 2024-09-14T11:01:53.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.959+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=4IDI11P14Y98 type=del 2024-09-14T11:01:53.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.961+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=1Z1SFQQ2BG8V type=write size=140575 2024-09-14T11:01:53.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.963+0000 7fe3dd11f780 1 < suggested update operation key=4JTN39NIB2UE tag=DETIL7V6CB9F type=del size=1148893 2024-09-14T11:01:53.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.965+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=A81WX9VC15CP type=del size=903162 2024-09-14T11:01:53.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.966+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~MF32985DJOOQ.0 size=1048576 2024-09-14T11:01:53.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.967+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~MF32985DJOOQ.1 size=93508 2024-09-14T11:01:53.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.969+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=MF32985DJOOQ tag=KONPX6RBMOL9 type=write size=2190660 2024-09-14T11:01:53.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.971+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~DD6PFW19MCZU.0 size=1048576 2024-09-14T11:01:53.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.972+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~DD6PFW19MCZU.1 size=1048576 2024-09-14T11:01:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.973+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~DD6PFW19MCZU.2 size=604432 2024-09-14T11:01:53.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.973+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=DD6PFW19MCZU tag=T7QFQGTAGJEW type=write size=3750160 2024-09-14T11:01:53.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.974+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MS9L4YU6YII2.0 size=1048576 2024-09-14T11:01:53.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.975+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MS9L4YU6YII2.1 size=862098 2024-09-14T11:01:53.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.977+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=MS9L4YU6YII2 tag=1663K60TG23S type=write size=2959250 2024-09-14T11:01:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.980+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~27XN8WO19XCS.0 size=410508 2024-09-14T11:01:53.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.980+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=27XN8WO19XCS tag=53O15J41G3QA type=write size=1459084 2024-09-14T11:01:53.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.981+0000 7fe3dd11f780 -1 < no bi entry to suggest for operation key=YMGE9GKLSPE6 tag=DT7YYVIP5WRV type=del size=3794397: (2) No such file or directory 2024-09-14T11:01:53.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.982+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=8GA7JKZA8AKF type=del size=3391396 2024-09-14T11:01:53.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.983+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~IYQEAJAC0VRB.0 size=1048576 2024-09-14T11:01:53.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.984+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~IYQEAJAC0VRB.1 size=611409 2024-09-14T11:01:53.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.987+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=IYQEAJAC0VRB tag=DYCCXBU36KMT type=write size=2708561 2024-09-14T11:01:53.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.989+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~362XAWB29COC.0 size=1048576 2024-09-14T11:01:53.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.990+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~362XAWB29COC.1 size=154609 2024-09-14T11:01:53.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.990+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=362XAWB29COC tag=FUUNUBCXUMRU type=write size=2251761 2024-09-14T11:01:53.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.991+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GK2PDBLOVDDM.0 size=1039817 2024-09-14T11:01:53.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.993+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=GK2PDBLOVDDM tag=L5AF5KXFOOB3 type=write size=2088393 2024-09-14T11:01:53.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.994+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=K1ER60HZZT28 type=del size=931635 2024-09-14T11:01:53.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.995+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~QS12W9VATWYE.0 size=32573 2024-09-14T11:01:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.997+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=QS12W9VATWYE tag=0DIHAFUALY9U type=write size=1081149 2024-09-14T11:01:53.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:53.999+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~EUMLMG5M1II4.0 size=1048576 2024-09-14T11:01:53.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.000+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~EUMLMG5M1II4.1 size=159594 2024-09-14T11:01:53.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.000+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=EUMLMG5M1II4 tag=N6GBIA55JGLB type=write size=2256746 2024-09-14T11:01:53.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.001+0000 7fe3dd11f780 1 < completed write operation key=3PS4LAML698X tag=SC1FXQ18UKFY type=write size=554862 2024-09-14T11:01:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.003+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~MCC02QKNR2OM.0 size=1048576 2024-09-14T11:01:54.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.004+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~MCC02QKNR2OM.1 size=1048576 2024-09-14T11:01:54.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.005+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~MCC02QKNR2OM.2 size=468696 2024-09-14T11:01:54.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.005+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=MCC02QKNR2OM tag=GAZBURAUB321 type=write size=3614424 2024-09-14T11:01:54.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.006+0000 7fe3dd11f780 1 < canceled part key=_multipart_22TI1VCDTK5P.2~AFNQ9NHAT6KF.0 size=1048576 2024-09-14T11:01:54.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.007+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~AFNQ9NHAT6KF.1 size=247873 2024-09-14T11:01:54.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.009+0000 7fe3dd11f780 1 < canceled multipart upload key=22TI1VCDTK5P upload=AFNQ9NHAT6KF tag=NBWUDYG21AG3 type=write size=2345025 2024-09-14T11:01:54.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.011+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~T9V5HIJ2P68S.0 size=1048576 2024-09-14T11:01:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.012+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~T9V5HIJ2P68S.1 size=897671 2024-09-14T11:01:54.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.012+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=T9V5HIJ2P68S tag=P88LLE0FKHQY type=write size=2994823 2024-09-14T11:01:54.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.013+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~41IMEY3BU6MA.0 size=1048576 2024-09-14T11:01:54.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.014+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~41IMEY3BU6MA.1 size=768182 2024-09-14T11:01:54.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.016+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=41IMEY3BU6MA tag=VC56G5DNX9R6 type=write size=2865334 2024-09-14T11:01:54.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.018+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~L6HHM1Q2HM2P.0 size=1048576 2024-09-14T11:01:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.019+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~L6HHM1Q2HM2P.1 size=643533 2024-09-14T11:01:54.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.019+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=L6HHM1Q2HM2P tag=SM25TXZNITBC type=write size=2740685 2024-09-14T11:01:54.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.020+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~6N6Q34HFZ4EH.0 size=1048576 2024-09-14T11:01:54.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.021+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~6N6Q34HFZ4EH.1 size=1048576 2024-09-14T11:01:54.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.022+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~6N6Q34HFZ4EH.2 size=635970 2024-09-14T11:01:54.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.024+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=6N6Q34HFZ4EH tag=YT1R1Q2JFUCA type=write size=3781698 2024-09-14T11:01:54.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.026+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=FCUNOV8RM637 type=write size=120302 2024-09-14T11:01:54.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.027+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~HQ1J7CE6NT5W.0 size=1048576 2024-09-14T11:01:54.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.028+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~HQ1J7CE6NT5W.1 size=452615 2024-09-14T11:01:54.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.030+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=HQ1J7CE6NT5W tag=888Q33PS66ME type=write size=2549767 2024-09-14T11:01:54.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.031+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=6HYDBF9STVBS type=write size=718457 2024-09-14T11:01:54.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.032+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=VW9U84OIP0BM type=del 2024-09-14T11:01:54.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.033+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=RV8YNV3ISSKW type=del size=1288264 2024-09-14T11:01:54.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.035+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~BNJSFHA1SOUY.0 size=672309 2024-09-14T11:01:54.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.037+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=BNJSFHA1SOUY tag=V8T6SPTR8U7V type=write size=1720885 2024-09-14T11:01:54.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.038+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=K0ID5REF1T7Z type=del size=1793581 2024-09-14T11:01:54.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.039+0000 7fe3dd11f780 1 < canceled operation key=QPH41U60044L tag=QZRM3V81X9T0 type=del size=3844581 2024-09-14T11:01:54.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.041+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=67U7M2RXQZLH type=del size=2839708 2024-09-14T11:01:54.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.042+0000 7fe3dd11f780 1 < completed write operation key=V692HUUJP2RC tag=1Z1SFQQ2BG8V type=write size=140575 2024-09-14T11:01:54.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.044+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~D3MCS83OSRL0.0 size=1048576 2024-09-14T11:01:54.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.045+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~D3MCS83OSRL0.1 size=1048576 2024-09-14T11:01:54.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.046+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~D3MCS83OSRL0.2 size=244931 2024-09-14T11:01:54.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.046+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=D3MCS83OSRL0 tag=5AVZXLIPWUCC type=write size=3390659 2024-09-14T11:01:54.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.048+0000 7fe3dd11f780 1 < suggested update operation key=US8KP3YL88TG tag=A81WX9VC15CP type=del size=903162 2024-09-14T11:01:54.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.049+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=AAVNYKXLL4FB type=del size=196240 2024-09-14T11:01:54.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.050+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~DD6PFW19MCZU.0 size=1048576 2024-09-14T11:01:54.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.051+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~DD6PFW19MCZU.1 size=1048576 2024-09-14T11:01:54.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.053+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~DD6PFW19MCZU.2 size=604432 2024-09-14T11:01:54.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.055+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=DD6PFW19MCZU tag=T7QFQGTAGJEW type=write size=3750160 2024-09-14T11:01:54.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.056+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=AGM3BWC2RHJ6 type=del size=3977711 2024-09-14T11:01:54.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.057+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~27XN8WO19XCS.0 size=410508 2024-09-14T11:01:54.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.059+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=27XN8WO19XCS tag=53O15J41G3QA type=write size=1459084 2024-09-14T11:01:54.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.060+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=QDRYHSYB5TJB type=del size=232338 2024-09-14T11:01:54.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.063+0000 7fe3dd11f780 1 < suggested update operation key=JFLEJGPFLACM tag=8GA7JKZA8AKF type=del size=3391396 2024-09-14T11:01:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.065+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~ALUQ93V0U5DJ.0 size=469879 2024-09-14T11:01:54.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.065+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=ALUQ93V0U5DJ tag=3K07IBAQMPMW type=write size=1518455 2024-09-14T11:01:54.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.066+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~362XAWB29COC.0 size=1048576 2024-09-14T11:01:54.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.067+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~362XAWB29COC.1 size=154609 2024-09-14T11:01:54.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.069+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=362XAWB29COC tag=FUUNUBCXUMRU type=write size=2251761 2024-09-14T11:01:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.071+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~7TX349G2605U.0 size=746000 2024-09-14T11:01:54.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.071+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=7TX349G2605U tag=YL4LE23JLT0B type=write size=1794576 2024-09-14T11:01:54.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.072+0000 7fe3dd11f780 1 < canceled operation key=K9BP30LHDPA1 tag=K1ER60HZZT28 type=del size=931635 2024-09-14T11:01:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.074+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=X7M3D2T1AFZD type=write size=54770 2024-09-14T11:01:54.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.074+0000 7fe3dd11f780 1 < canceled part key=_multipart_YMGE9GKLSPE6.2~EUMLMG5M1II4.0 size=1048576 2024-09-14T11:01:54.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.075+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~EUMLMG5M1II4.1 size=159594 2024-09-14T11:01:54.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.077+0000 7fe3dd11f780 1 < canceled multipart upload key=YMGE9GKLSPE6 upload=EUMLMG5M1II4 tag=N6GBIA55JGLB type=write size=2256746 2024-09-14T11:01:54.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.079+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=RA0FWO8FO8JF type=del size=3620744 2024-09-14T11:01:54.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.080+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~MCC02QKNR2OM.0 size=1048576 2024-09-14T11:01:54.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.081+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~MCC02QKNR2OM.1 size=1048576 2024-09-14T11:01:54.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.081+0000 7fe3dd11f780 1 < canceled part key=_multipart_US8KP3YL88TG.2~MCC02QKNR2OM.2 size=468696 2024-09-14T11:01:54.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.084+0000 7fe3dd11f780 1 < canceled multipart upload key=US8KP3YL88TG upload=MCC02QKNR2OM tag=GAZBURAUB321 type=write size=3614424 2024-09-14T11:01:54.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.085+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=Y11FM92SDAN3 type=del size=2926009 2024-09-14T11:01:54.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.086+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~T9V5HIJ2P68S.0 size=1048576 2024-09-14T11:01:54.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.087+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~T9V5HIJ2P68S.1 size=897671 2024-09-14T11:01:54.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.090+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=T9V5HIJ2P68S tag=P88LLE0FKHQY type=write size=2994823 2024-09-14T11:01:54.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.091+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=VNC575BHX1U5 type=del size=1826308 2024-09-14T11:01:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.093+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~L6HHM1Q2HM2P.0 size=1048576 2024-09-14T11:01:54.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.094+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~L6HHM1Q2HM2P.1 size=643533 2024-09-14T11:01:54.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.096+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=L6HHM1Q2HM2P tag=SM25TXZNITBC type=write size=2740685 2024-09-14T11:01:54.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.099+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~VQ882UJUXXP5.0 size=1048576 2024-09-14T11:01:54.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.100+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~VQ882UJUXXP5.1 size=988989 2024-09-14T11:01:54.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.100+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=VQ882UJUXXP5 tag=4Y82J0L3RO0H type=write size=3086141 2024-09-14T11:01:54.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.101+0000 7fe3dd11f780 1 < completed write operation key=PHLQ77OMLI37 tag=FCUNOV8RM637 type=write size=120302 2024-09-14T11:01:54.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.102+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=YIT2L8WBBHIZ type=del size=2244849 2024-09-14T11:01:54.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.104+0000 7fe3dd11f780 1 < completed write operation key=ODDNSHK5YMNO tag=6HYDBF9STVBS type=write size=718457 2024-09-14T11:01:54.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.105+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=BU8TNJ235U5U type=del size=3093784 2024-09-14T11:01:54.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.106+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=RV8YNV3ISSKW type=del 2024-09-14T11:01:54.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.108+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=L8276P9MHTII type=del size=1870925 2024-09-14T11:01:54.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.109+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=K0ID5REF1T7Z type=del 2024-09-14T11:01:54.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.112+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FIZ9Y2GDTZDW.0 size=1048576 2024-09-14T11:01:54.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.113+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FIZ9Y2GDTZDW.1 size=1048576 2024-09-14T11:01:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.114+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FIZ9Y2GDTZDW.2 size=572986 2024-09-14T11:01:54.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.114+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=FIZ9Y2GDTZDW tag=SR4RVQEY7X03 type=write size=3718714 2024-09-14T11:01:54.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.117+0000 7fe3dd11f780 1 < suggested update operation key=UYZGHGZR74HQ tag=67U7M2RXQZLH type=del size=2839708 2024-09-14T11:01:54.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.119+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~T83Y5E5IZC7R.0 size=964913 2024-09-14T11:01:54.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.119+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=T83Y5E5IZC7R tag=GGEYGNJM4CBE type=write size=2013489 2024-09-14T11:01:54.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.120+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~D3MCS83OSRL0.0 size=1048576 2024-09-14T11:01:54.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.121+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~D3MCS83OSRL0.1 size=1048576 2024-09-14T11:01:54.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.123+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~D3MCS83OSRL0.2 size=244931 2024-09-14T11:01:54.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.125+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=D3MCS83OSRL0 tag=5AVZXLIPWUCC type=write size=3390659 2024-09-14T11:01:54.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.126+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=C2KZ1BSZ3JLB type=write size=503588 2024-09-14T11:01:54.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.128+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=AAVNYKXLL4FB type=del 2024-09-14T11:01:54.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.130+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~FX1C7XM6KNVI.0 size=820748 2024-09-14T11:01:54.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.130+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=FX1C7XM6KNVI tag=66WKLKN3CB18 type=write size=1869324 2024-09-14T11:01:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.132+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=AGM3BWC2RHJ6 type=del 2024-09-14T11:01:54.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.133+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=E1BU7KIELD0N type=del size=2187026 2024-09-14T11:01:54.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.134+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=QDRYHSYB5TJB type=del 2024-09-14T11:01:54.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.135+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=WRKPV51EJJEM type=write size=983706 2024-09-14T11:01:54.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.137+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~ALUQ93V0U5DJ.0 size=469879 2024-09-14T11:01:54.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.139+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=ALUQ93V0U5DJ tag=3K07IBAQMPMW type=write size=1518455 2024-09-14T11:01:54.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.140+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=RPM7DITOVGIA type=del size=120178 2024-09-14T11:01:54.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.142+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~7TX349G2605U.0 size=746000 2024-09-14T11:01:54.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.144+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=7TX349G2605U tag=YL4LE23JLT0B type=write size=1794576 2024-09-14T11:01:54.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.146+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=27SANTVQ1D36 type=del size=3835555 2024-09-14T11:01:54.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.147+0000 7fe3dd11f780 1 < completed write operation key=ZI5SFHGWCHJA tag=X7M3D2T1AFZD type=write size=54770 2024-09-14T11:01:54.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.149+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=7PF0H3DQIA8N type=del size=4104836 2024-09-14T11:01:54.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.150+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=RA0FWO8FO8JF type=del 2024-09-14T11:01:54.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.151+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=QBWWPQXNZ18Z type=del size=1815594 2024-09-14T11:01:54.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.153+0000 7fe3dd11f780 1 < canceled operation key=4JTN39NIB2UE tag=Y11FM92SDAN3 type=del size=2926009 2024-09-14T11:01:54.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.154+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=MUQXJJ28JKKN type=del size=2721450 2024-09-14T11:01:54.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.156+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=VNC575BHX1U5 type=del 2024-09-14T11:01:54.156 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.158+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~BQ6BK3TBJWHD.0 size=1048576 2024-09-14T11:01:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.159+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~BQ6BK3TBJWHD.1 size=797366 2024-09-14T11:01:54.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.159+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=BQ6BK3TBJWHD tag=JWM6IFYWAQ01 type=write size=2894518 2024-09-14T11:01:54.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.160+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~VQ882UJUXXP5.0 size=1048576 2024-09-14T11:01:54.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.161+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~VQ882UJUXXP5.1 size=988989 2024-09-14T11:01:54.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.163+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=VQ882UJUXXP5 tag=4Y82J0L3RO0H type=write size=3086141 2024-09-14T11:01:54.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.165+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=H1Q1SMXI03TG type=del size=3505548 2024-09-14T11:01:54.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.166+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=YIT2L8WBBHIZ type=del 2024-09-14T11:01:54.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.167+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=EWBI02KKUV1N type=del size=2183926 2024-09-14T11:01:54.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.170+0000 7fe3dd11f780 1 < suggested update operation key=22TI1VCDTK5P tag=BU8TNJ235U5U type=del size=3093784 2024-09-14T11:01:54.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.172+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~SBZC1T71I3WA.0 size=1048576 2024-09-14T11:01:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.173+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~SBZC1T71I3WA.1 size=795918 2024-09-14T11:01:54.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.173+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=SBZC1T71I3WA tag=GNNYTW3X02NF type=write size=2893070 2024-09-14T11:01:54.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.176+0000 7fe3dd11f780 1 < suggested update operation key=YMGE9GKLSPE6 tag=L8276P9MHTII type=del size=1870925 2024-09-14T11:01:54.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.179+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~KTPCPQCF0NT3.0 size=1048576 2024-09-14T11:01:54.177 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.180+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~KTPCPQCF0NT3.1 size=1048576 2024-09-14T11:01:54.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.181+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~KTPCPQCF0NT3.2 size=339816 2024-09-14T11:01:54.179 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.181+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=KTPCPQCF0NT3 tag=5PQBK8QZTK4O type=write size=3485544 2024-09-14T11:01:54.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.182+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~FIZ9Y2GDTZDW.0 size=1048576 2024-09-14T11:01:54.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.183+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~FIZ9Y2GDTZDW.1 size=1048576 2024-09-14T11:01:54.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.184+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~FIZ9Y2GDTZDW.2 size=572986 2024-09-14T11:01:54.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.186+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=FIZ9Y2GDTZDW tag=SR4RVQEY7X03 type=write size=3718714 2024-09-14T11:01:54.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.187+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=89XG3EF18J1O type=write size=822133 2024-09-14T11:01:54.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.189+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~T83Y5E5IZC7R.0 size=964913 2024-09-14T11:01:54.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.191+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=T83Y5E5IZC7R tag=GGEYGNJM4CBE type=write size=2013489 2024-09-14T11:01:54.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.192+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=XNU8BGMCFNLB type=del size=2352340 2024-09-14T11:01:54.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.193+0000 7fe3dd11f780 1 < completed write operation key=GQEFQ1UD6QCJ tag=C2KZ1BSZ3JLB type=write size=503588 2024-09-14T11:01:54.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.194+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=EIYT5XXTZYPO type=del size=2506515 2024-09-14T11:01:54.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.196+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~FX1C7XM6KNVI.0 size=820748 2024-09-14T11:01:54.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.198+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=FX1C7XM6KNVI tag=66WKLKN3CB18 type=write size=1869324 2024-09-14T11:01:54.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.199+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=RIJP7DRJ37T1 type=write size=477806 2024-09-14T11:01:54.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.200+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=E1BU7KIELD0N type=del 2024-09-14T11:01:54.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.203+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~L53ZVLBGW5AO.0 size=35845 2024-09-14T11:01:54.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.203+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=L53ZVLBGW5AO tag=604IRR58ZSTG type=write size=1084421 2024-09-14T11:01:54.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.204+0000 7fe3dd11f780 -1 < failed to complete operation key=YMGE9GKLSPE6 tag=WRKPV51EJJEM type=write size=983706: (22) Invalid argument 2024-09-14T11:01:54.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.206+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~9M9WU8006EB7.0 size=1048576 2024-09-14T11:01:54.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.207+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~9M9WU8006EB7.1 size=1048576 2024-09-14T11:01:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.208+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~9M9WU8006EB7.2 size=433775 2024-09-14T11:01:54.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.208+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=9M9WU8006EB7 tag=I0JDEIK5R5RK type=write size=3579503 2024-09-14T11:01:54.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.209+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=RPM7DITOVGIA type=del 2024-09-14T11:01:54.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.210+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=1EEXB1VQJXC3 type=del size=2847339 2024-09-14T11:01:54.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.213+0000 7fe3dd11f780 1 < suggested remove operation key=LFKLJAJWQ2J6 tag=27SANTVQ1D36 type=del 2024-09-14T11:01:54.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.215+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~P62CVY1TISTY.0 size=1048576 2024-09-14T11:01:54.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.216+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~P62CVY1TISTY.1 size=1048576 2024-09-14T11:01:54.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.217+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~P62CVY1TISTY.2 size=186180 2024-09-14T11:01:54.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.217+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=P62CVY1TISTY tag=JEKXPT6JGQWN type=write size=3331908 2024-09-14T11:01:54.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.220+0000 7fe3dd11f780 1 < suggested remove operation key=KXL3E0PJBNBA tag=7PF0H3DQIA8N type=del 2024-09-14T11:01:54.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.221+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=J0CWDSJTD7Y9 type=del size=1100288 2024-09-14T11:01:54.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.222+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=QBWWPQXNZ18Z type=del 2024-09-14T11:01:54.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.225+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~BSBXQB2HG0LV.0 size=1048576 2024-09-14T11:01:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.226+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~BSBXQB2HG0LV.1 size=1048576 2024-09-14T11:01:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.227+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~BSBXQB2HG0LV.2 size=592115 2024-09-14T11:01:54.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.227+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=BSBXQB2HG0LV tag=7JXHP6IISY8J type=write size=3737843 2024-09-14T11:01:54.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.228+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=MUQXJJ28JKKN type=del 2024-09-14T11:01:54.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.229+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=SOYQOAVOOSHO type=write size=162260 2024-09-14T11:01:54.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.230+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~BQ6BK3TBJWHD.0 size=1048576 2024-09-14T11:01:54.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.231+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~BQ6BK3TBJWHD.1 size=797366 2024-09-14T11:01:54.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.233+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=BQ6BK3TBJWHD tag=JWM6IFYWAQ01 type=write size=2894518 2024-09-14T11:01:54.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.234+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=RZR26KI7W30S type=del size=631087 2024-09-14T11:01:54.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.236+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=H1Q1SMXI03TG type=del 2024-09-14T11:01:54.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.237+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=UEKJ111Y0K60 type=del size=1376524 2024-09-14T11:01:54.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.238+0000 7fe3dd11f780 -1 < failed to complete operation key=YMGE9GKLSPE6 tag=EWBI02KKUV1N type=del size=2183926: (22) Invalid argument 2024-09-14T11:01:54.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.240+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~DXA76Z1F2TDD.0 size=1048576 2024-09-14T11:01:54.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.241+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~DXA76Z1F2TDD.1 size=158208 2024-09-14T11:01:54.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.241+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=DXA76Z1F2TDD tag=A5FCAZIMYF7D type=write size=2255360 2024-09-14T11:01:54.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.242+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~SBZC1T71I3WA.0 size=1048576 2024-09-14T11:01:54.245 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.243+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~SBZC1T71I3WA.1 size=795918 2024-09-14T11:01:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.245+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=SBZC1T71I3WA tag=GNNYTW3X02NF type=write size=2893070 2024-09-14T11:01:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.246+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=L5P3L17089W4 type=del size=1619243 2024-09-14T11:01:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.247+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~KTPCPQCF0NT3.0 size=1048576 2024-09-14T11:01:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.248+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~KTPCPQCF0NT3.1 size=1048576 2024-09-14T11:01:54.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.248+0000 7fe3dd11f780 1 < canceled part key=_multipart_KXL3E0PJBNBA.2~KTPCPQCF0NT3.2 size=339816 2024-09-14T11:01:54.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.250+0000 7fe3dd11f780 1 < canceled multipart upload key=KXL3E0PJBNBA upload=KTPCPQCF0NT3 tag=5PQBK8QZTK4O type=write size=3485544 2024-09-14T11:01:54.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.252+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~EV6HI50IEY9T.0 size=1048576 2024-09-14T11:01:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.253+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~EV6HI50IEY9T.1 size=183058 2024-09-14T11:01:54.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.253+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=EV6HI50IEY9T tag=DCBJBY9TBC0M type=write size=2280210 2024-09-14T11:01:54.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.256+0000 7fe3dd11f780 1 < suggested update operation key=YMGE9GKLSPE6 tag=89XG3EF18J1O type=write size=822133 2024-09-14T11:01:54.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.258+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~J7K19T2KZ7W1.0 size=133011 2024-09-14T11:01:54.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.258+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=J7K19T2KZ7W1 tag=FAGP6PJLZWRC type=write size=1181587 2024-09-14T11:01:54.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.259+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=XNU8BGMCFNLB type=del 2024-09-14T11:01:54.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.260+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=SPEJSD9QERI2 type=del size=3060100 2024-09-14T11:01:54.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.263+0000 7fe3dd11f780 1 < suggested update operation key=ODDNSHK5YMNO tag=EIYT5XXTZYPO type=del size=2506515 2024-09-14T11:01:54.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.264+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=L53GKOKX1KLC type=del size=1408292 2024-09-14T11:01:54.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.266+0000 7fe3dd11f780 1 < suggested update operation key=22TI1VCDTK5P tag=RIJP7DRJ37T1 type=write size=477806 2024-09-14T11:01:54.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.268+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=9BRFNLVDV6EU type=del size=199002 2024-09-14T11:01:54.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.269+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~L53ZVLBGW5AO.0 size=35845 2024-09-14T11:01:54.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.271+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=L53ZVLBGW5AO tag=604IRR58ZSTG type=write size=1084421 2024-09-14T11:01:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.274+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~B4CCEJKO6BMS.0 size=237329 2024-09-14T11:01:54.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.274+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=B4CCEJKO6BMS tag=KX5DJABUR6MH type=write size=1285905 2024-09-14T11:01:54.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.276+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~9M9WU8006EB7.0 size=1048576 2024-09-14T11:01:54.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.277+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~9M9WU8006EB7.1 size=1048576 2024-09-14T11:01:54.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.278+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~9M9WU8006EB7.2 size=433775 2024-09-14T11:01:54.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.280+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=9M9WU8006EB7 tag=I0JDEIK5R5RK type=write size=3579503 2024-09-14T11:01:54.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.281+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=6RQWQOSOUYM5 type=del size=3964673 2024-09-14T11:01:54.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.283+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=1EEXB1VQJXC3 type=del 2024-09-14T11:01:54.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.284+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=20VA546HBHHO type=del size=355636 2024-09-14T11:01:54.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.285+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~P62CVY1TISTY.0 size=1048576 2024-09-14T11:01:54.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.286+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~P62CVY1TISTY.1 size=1048576 2024-09-14T11:01:54.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.287+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~P62CVY1TISTY.2 size=186180 2024-09-14T11:01:54.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.289+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=P62CVY1TISTY tag=JEKXPT6JGQWN type=write size=3331908 2024-09-14T11:01:54.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.293+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~HIIPLE835AB9.0 size=1048576 2024-09-14T11:01:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.294+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~HIIPLE835AB9.1 size=643723 2024-09-14T11:01:54.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.294+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=HIIPLE835AB9 tag=5W69JAOVHMVU type=write size=2740875 2024-09-14T11:01:54.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.295+0000 7fe3dd11f780 -1 < failed to complete operation key=ODDNSHK5YMNO tag=J0CWDSJTD7Y9 type=del size=1100288: (22) Invalid argument 2024-09-14T11:01:54.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.296+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=8S23YY5GSWXZ type=del size=3585078 2024-09-14T11:01:54.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.297+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~BSBXQB2HG0LV.0 size=1048576 2024-09-14T11:01:54.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.298+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~BSBXQB2HG0LV.1 size=1048576 2024-09-14T11:01:54.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.299+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~BSBXQB2HG0LV.2 size=592115 2024-09-14T11:01:54.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.301+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=BSBXQB2HG0LV tag=7JXHP6IISY8J type=write size=3737843 2024-09-14T11:01:54.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.302+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=2K703IO8OHV1 type=write size=216191 2024-09-14T11:01:54.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.304+0000 7fe3dd11f780 1 < completed write operation key=3PS4LAML698X tag=SOYQOAVOOSHO type=write size=162260 2024-09-14T11:01:54.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.306+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~I82HYHRC1C6I.0 size=1048576 2024-09-14T11:01:54.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.307+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~I82HYHRC1C6I.1 size=32856 2024-09-14T11:01:54.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.307+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=I82HYHRC1C6I tag=1WIOWLQ6FMVA type=write size=2130008 2024-09-14T11:01:54.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.308+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=RZR26KI7W30S type=del 2024-09-14T11:01:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.310+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~9A6WG0IHF12C.0 size=173264 2024-09-14T11:01:54.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.310+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=9A6WG0IHF12C tag=EVLQX5QJE7KW type=write size=1221840 2024-09-14T11:01:54.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.311+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=UEKJ111Y0K60 type=del 2024-09-14T11:01:54.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.313+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=AFAE3KMFHA44 type=write size=151252 2024-09-14T11:01:54.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.314+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~DXA76Z1F2TDD.0 size=1048576 2024-09-14T11:01:54.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.314+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~DXA76Z1F2TDD.1 size=158208 2024-09-14T11:01:54.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.316+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=DXA76Z1F2TDD tag=A5FCAZIMYF7D type=write size=2255360 2024-09-14T11:01:54.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.319+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~PPYV976HPVFH.0 size=1048576 2024-09-14T11:01:54.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.320+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~PPYV976HPVFH.1 size=801214 2024-09-14T11:01:54.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.320+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=PPYV976HPVFH tag=SNXOUZUK7A8C type=write size=2898366 2024-09-14T11:01:54.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.321+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=L5P3L17089W4 type=del 2024-09-14T11:01:54.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.322+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=CXGMTVRKDQD7 type=write size=460836 2024-09-14T11:01:54.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.323+0000 7fe3dd11f780 1 < canceled part key=_multipart_JFLEJGPFLACM.2~EV6HI50IEY9T.0 size=1048576 2024-09-14T11:01:54.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.324+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~EV6HI50IEY9T.1 size=183058 2024-09-14T11:01:54.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.326+0000 7fe3dd11f780 1 < canceled multipart upload key=JFLEJGPFLACM upload=EV6HI50IEY9T tag=DCBJBY9TBC0M type=write size=2280210 2024-09-14T11:01:54.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.328+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~KH3KXGOSUW16.0 size=1048576 2024-09-14T11:01:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.329+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~KH3KXGOSUW16.1 size=242219 2024-09-14T11:01:54.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.329+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=KH3KXGOSUW16 tag=88V6E75BQLPN type=write size=2339371 2024-09-14T11:01:54.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.330+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~J7K19T2KZ7W1.0 size=133011 2024-09-14T11:01:54.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.332+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=J7K19T2KZ7W1 tag=FAGP6PJLZWRC type=write size=1181587 2024-09-14T11:01:54.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.334+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~W80IIELJ4BJS.0 size=1048576 2024-09-14T11:01:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.335+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~W80IIELJ4BJS.1 size=12676 2024-09-14T11:01:54.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.335+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=W80IIELJ4BJS tag=9S0K1IAPL4Q4 type=write size=2109828 2024-09-14T11:01:54.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.336+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=SPEJSD9QERI2 type=del 2024-09-14T11:01:54.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.339+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~ZQ468YO4VIJ7.0 size=1048576 2024-09-14T11:01:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.340+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~ZQ468YO4VIJ7.1 size=533942 2024-09-14T11:01:54.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.340+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=ZQ468YO4VIJ7 tag=C2919AETBYLL type=write size=2631094 2024-09-14T11:01:54.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.341+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=L53GKOKX1KLC type=del 2024-09-14T11:01:54.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.343+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~3W5826MDOYBL.0 size=1048576 2024-09-14T11:01:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.344+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~3W5826MDOYBL.1 size=593552 2024-09-14T11:01:54.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.344+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=3W5826MDOYBL tag=1CI1TCGCMA49 type=write size=2690704 2024-09-14T11:01:54.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.346+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=9BRFNLVDV6EU type=del 2024-09-14T11:01:54.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.348+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~GHNZXHAW535M.0 size=1048576 2024-09-14T11:01:54.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.349+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~GHNZXHAW535M.1 size=141392 2024-09-14T11:01:54.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.349+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=GHNZXHAW535M tag=GW2BAJRPGK58 type=write size=2238544 2024-09-14T11:01:54.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.350+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~B4CCEJKO6BMS.0 size=237329 2024-09-14T11:01:54.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.352+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=B4CCEJKO6BMS tag=KX5DJABUR6MH type=write size=1285905 2024-09-14T11:01:54.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.354+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~T1WD7SX8RZ12.0 size=1048576 2024-09-14T11:01:54.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.355+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~T1WD7SX8RZ12.1 size=1048576 2024-09-14T11:01:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.356+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~T1WD7SX8RZ12.2 size=446260 2024-09-14T11:01:54.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.356+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=T1WD7SX8RZ12 tag=OCIZCEU8NEU1 type=write size=3591988 2024-09-14T11:01:54.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.357+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=6RQWQOSOUYM5 type=del 2024-09-14T11:01:54.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.358+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=F0SDJ94V19PI type=del size=851750 2024-09-14T11:01:54.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.360+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=20VA546HBHHO type=del 2024-09-14T11:01:54.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.361+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=SRFAF9O9VCSM type=write size=524754 2024-09-14T11:01:54.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.362+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~HIIPLE835AB9.0 size=1048576 2024-09-14T11:01:54.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.363+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~HIIPLE835AB9.1 size=643723 2024-09-14T11:01:54.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.365+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=HIIPLE835AB9 tag=5W69JAOVHMVU type=write size=2740875 2024-09-14T11:01:54.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.366+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=BQ03KGPDKK0A type=del size=3190215 2024-09-14T11:01:54.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.367+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=8S23YY5GSWXZ type=del 2024-09-14T11:01:54.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.369+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=YTF2RY0H4IO3 type=del size=3317025 2024-09-14T11:01:54.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.370+0000 7fe3dd11f780 1 < completed write operation key=JSEN4QXEMVHS tag=2K703IO8OHV1 type=write size=216191 2024-09-14T11:01:54.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.372+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~AHXTVEQ17YJ8.0 size=1048576 2024-09-14T11:01:54.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.373+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~AHXTVEQ17YJ8.1 size=1048576 2024-09-14T11:01:54.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.374+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~AHXTVEQ17YJ8.2 size=76087 2024-09-14T11:01:54.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.374+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=AHXTVEQ17YJ8 tag=AIBHYT1WVCBQ type=write size=3221815 2024-09-14T11:01:54.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.376+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~I82HYHRC1C6I.0 size=1048576 2024-09-14T11:01:54.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.377+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~I82HYHRC1C6I.1 size=32856 2024-09-14T11:01:54.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.379+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=I82HYHRC1C6I tag=1WIOWLQ6FMVA type=write size=2130008 2024-09-14T11:01:54.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.381+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~ND2T2J8U4KK9.0 size=1048576 2024-09-14T11:01:54.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.382+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~ND2T2J8U4KK9.1 size=1048576 2024-09-14T11:01:54.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.383+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~ND2T2J8U4KK9.2 size=357034 2024-09-14T11:01:54.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.383+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=ND2T2J8U4KK9 tag=SI44E4PSCOHP type=write size=3502762 2024-09-14T11:01:54.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.384+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~9A6WG0IHF12C.0 size=173264 2024-09-14T11:01:54.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.386+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=9A6WG0IHF12C tag=EVLQX5QJE7KW type=write size=1221840 2024-09-14T11:01:54.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.387+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=DYG3GUQ3XPJU type=del size=3522785 2024-09-14T11:01:54.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.389+0000 7fe3dd11f780 1 < completed write operation key=PHLQ77OMLI37 tag=AFAE3KMFHA44 type=write size=151252 2024-09-14T11:01:54.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.390+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=OOA8E8J26XG1 type=del size=1807663 2024-09-14T11:01:54.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.391+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~PPYV976HPVFH.0 size=1048576 2024-09-14T11:01:54.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.392+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~PPYV976HPVFH.1 size=801214 2024-09-14T11:01:54.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.394+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=PPYV976HPVFH tag=SNXOUZUK7A8C type=write size=2898366 2024-09-14T11:01:54.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.395+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=GR0206GJBW6R type=write size=836690 2024-09-14T11:01:54.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.397+0000 7fe3dd11f780 1 < suggested update operation key=NHKCRGX10WBM tag=CXGMTVRKDQD7 type=write size=460836 2024-09-14T11:01:54.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.399+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=50EIP8Y2BXJQ type=write size=41899 2024-09-14T11:01:54.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.400+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~KH3KXGOSUW16.0 size=1048576 2024-09-14T11:01:54.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.401+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~KH3KXGOSUW16.1 size=242219 2024-09-14T11:01:54.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.404+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=KH3KXGOSUW16 tag=88V6E75BQLPN type=write size=2339371 2024-09-14T11:01:54.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.406+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~K04TAKARTD17.0 size=1048576 2024-09-14T11:01:54.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.407+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~K04TAKARTD17.1 size=1048576 2024-09-14T11:01:54.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.408+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~K04TAKARTD17.2 size=943216 2024-09-14T11:01:54.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.408+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=K04TAKARTD17 tag=QLSUYEMRPY72 type=write size=4088944 2024-09-14T11:01:54.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.409+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~W80IIELJ4BJS.0 size=1048576 2024-09-14T11:01:54.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.410+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~W80IIELJ4BJS.1 size=12676 2024-09-14T11:01:54.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.412+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=W80IIELJ4BJS tag=9S0K1IAPL4Q4 type=write size=2109828 2024-09-14T11:01:54.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.413+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=7HHTZYFRXFD5 type=write size=564961 2024-09-14T11:01:54.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.414+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~ZQ468YO4VIJ7.0 size=1048576 2024-09-14T11:01:54.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.415+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~ZQ468YO4VIJ7.1 size=533942 2024-09-14T11:01:54.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.417+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=ZQ468YO4VIJ7 tag=C2919AETBYLL type=write size=2631094 2024-09-14T11:01:54.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.418+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=R32BJ5XTWO2L type=del size=2551359 2024-09-14T11:01:54.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.420+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~3W5826MDOYBL.0 size=1048576 2024-09-14T11:01:54.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.421+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~3W5826MDOYBL.1 size=593552 2024-09-14T11:01:54.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.423+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=3W5826MDOYBL tag=1CI1TCGCMA49 type=write size=2690704 2024-09-14T11:01:54.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.425+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~PRCB8UZ0MKFH.0 size=1048576 2024-09-14T11:01:54.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.426+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~PRCB8UZ0MKFH.1 size=260894 2024-09-14T11:01:54.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.426+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=PRCB8UZ0MKFH tag=JKVBCBHSTN4Q type=write size=2358046 2024-09-14T11:01:54.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.427+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~GHNZXHAW535M.0 size=1048576 2024-09-14T11:01:54.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.428+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~GHNZXHAW535M.1 size=141392 2024-09-14T11:01:54.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.430+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=GHNZXHAW535M tag=GW2BAJRPGK58 type=write size=2238544 2024-09-14T11:01:54.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.432+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=YUENKXSR22NT type=write size=869331 2024-09-14T11:01:54.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.433+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~T1WD7SX8RZ12.0 size=1048576 2024-09-14T11:01:54.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.434+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~T1WD7SX8RZ12.1 size=1048576 2024-09-14T11:01:54.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.435+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~T1WD7SX8RZ12.2 size=446260 2024-09-14T11:01:54.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.437+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=T1WD7SX8RZ12 tag=OCIZCEU8NEU1 type=write size=3591988 2024-09-14T11:01:54.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.438+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=DJTB2EUUFH6P type=del size=1944955 2024-09-14T11:01:54.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.439+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=F0SDJ94V19PI type=del 2024-09-14T11:01:54.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.441+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=1L9VMS2HZ512 type=write size=937210 2024-09-14T11:01:54.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.443+0000 7fe3dd11f780 1 < suggested update operation key=4JTN39NIB2UE tag=SRFAF9O9VCSM type=write size=524754 2024-09-14T11:01:54.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.445+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~LBAW8W4ZSAOB.0 size=1048576 2024-09-14T11:01:54.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.446+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~LBAW8W4ZSAOB.1 size=315816 2024-09-14T11:01:54.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.446+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=LBAW8W4ZSAOB tag=FMA0HNUSPEF1 type=write size=2412968 2024-09-14T11:01:54.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.448+0000 7fe3dd11f780 1 < suggested update operation key=M0DMAQ5LTDR0 tag=BQ03KGPDKK0A type=del size=3190215 2024-09-14T11:01:54.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.451+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~Q0QMY75MNXBS.0 size=1048576 2024-09-14T11:01:54.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.452+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~Q0QMY75MNXBS.1 size=1048576 2024-09-14T11:01:54.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.453+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~Q0QMY75MNXBS.2 size=1000523 2024-09-14T11:01:54.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.453+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=Q0QMY75MNXBS tag=IORHVHHR61YN type=write size=4146251 2024-09-14T11:01:54.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.454+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=YTF2RY0H4IO3 type=del 2024-09-14T11:01:54.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.455+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=3HAI3IHVZXCJ type=del size=732873 2024-09-14T11:01:54.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.456+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~AHXTVEQ17YJ8.0 size=1048576 2024-09-14T11:01:54.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.457+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~AHXTVEQ17YJ8.1 size=1048576 2024-09-14T11:01:54.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.458+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~AHXTVEQ17YJ8.2 size=76087 2024-09-14T11:01:54.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.460+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=AHXTVEQ17YJ8 tag=AIBHYT1WVCBQ type=write size=3221815 2024-09-14T11:01:54.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.461+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=7TXTNF40K580 type=write size=997399 2024-09-14T11:01:54.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.462+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~ND2T2J8U4KK9.0 size=1048576 2024-09-14T11:01:54.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.463+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~ND2T2J8U4KK9.1 size=1048576 2024-09-14T11:01:54.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.464+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~ND2T2J8U4KK9.2 size=357034 2024-09-14T11:01:54.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.466+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=ND2T2J8U4KK9 tag=SI44E4PSCOHP type=write size=3502762 2024-09-14T11:01:54.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.467+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=5SM5W5P08Y8H type=del size=2455824 2024-09-14T11:01:54.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.469+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=DYG3GUQ3XPJU type=del 2024-09-14T11:01:54.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.470+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=TRBC5Z0G6S4T type=del size=514524 2024-09-14T11:01:54.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.472+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=OOA8E8J26XG1 type=del 2024-09-14T11:01:54.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.473+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=F4B9VXKPZN12 type=del size=2242440 2024-09-14T11:01:54.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.476+0000 7fe3dd11f780 1 < suggested update operation key=GQEFQ1UD6QCJ tag=GR0206GJBW6R type=write size=836690 2024-09-14T11:01:54.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.477+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=9K8RCBO5OTHS type=write size=522482 2024-09-14T11:01:54.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.478+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=50EIP8Y2BXJQ type=write size=41899 2024-09-14T11:01:54.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.480+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=LOXB4PF23LN2 type=write size=666823 2024-09-14T11:01:54.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.481+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~K04TAKARTD17.0 size=1048576 2024-09-14T11:01:54.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.481+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~K04TAKARTD17.1 size=1048576 2024-09-14T11:01:54.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.482+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~K04TAKARTD17.2 size=943216 2024-09-14T11:01:54.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.484+0000 7fe3dd11f780 1 < canceled multipart upload key=LL9VJXEU13IK upload=K04TAKARTD17 tag=QLSUYEMRPY72 type=write size=4088944 2024-09-14T11:01:54.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.486+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~61J15TODDDI8.0 size=1048576 2024-09-14T11:01:54.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.487+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~61J15TODDDI8.1 size=610729 2024-09-14T11:01:54.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.487+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=61J15TODDDI8 tag=4MWPECFOMWRN type=write size=2707881 2024-09-14T11:01:54.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.489+0000 7fe3dd11f780 1 < completed write operation key=PHLQ77OMLI37 tag=7HHTZYFRXFD5 type=write size=564961 2024-09-14T11:01:54.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.490+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=6OIM59V7J480 type=del size=813091 2024-09-14T11:01:54.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.491+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=R32BJ5XTWO2L type=del 2024-09-14T11:01:54.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.492+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=S83MQMAKQDDA type=del size=70678 2024-09-14T11:01:54.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.494+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~PRCB8UZ0MKFH.0 size=1048576 2024-09-14T11:01:54.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.495+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~PRCB8UZ0MKFH.1 size=260894 2024-09-14T11:01:54.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.497+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=PRCB8UZ0MKFH tag=JKVBCBHSTN4Q type=write size=2358046 2024-09-14T11:01:54.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.498+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=6H8XN7067SO0 type=write size=781836 2024-09-14T11:01:54.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.499+0000 7fe3dd11f780 1 < completed write operation key=YMGE9GKLSPE6 tag=YUENKXSR22NT type=write size=869331 2024-09-14T11:01:54.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.501+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~YRI5330NXSSA.0 size=594833 2024-09-14T11:01:54.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.501+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=YRI5330NXSSA tag=22DXT40YXBD4 type=write size=1643409 2024-09-14T11:01:54.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.503+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=DJTB2EUUFH6P type=del 2024-09-14T11:01:54.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.504+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=NNIRQLZQ5AES type=del size=2762303 2024-09-14T11:01:54.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.506+0000 7fe3dd11f780 1 < suggested remove operation key=GQEFQ1UD6QCJ tag=1L9VMS2HZ512 type=write 2024-09-14T11:01:54.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.507+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=EULLUBGFFCDO type=del size=1202914 2024-09-14T11:01:54.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.508+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~LBAW8W4ZSAOB.0 size=1048576 2024-09-14T11:01:54.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.509+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~LBAW8W4ZSAOB.1 size=315816 2024-09-14T11:01:54.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.511+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=LBAW8W4ZSAOB tag=FMA0HNUSPEF1 type=write size=2412968 2024-09-14T11:01:54.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.512+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=KKJPN0U27PEJ type=del size=2838668 2024-09-14T11:01:54.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.514+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~Q0QMY75MNXBS.0 size=1048576 2024-09-14T11:01:54.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.515+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~Q0QMY75MNXBS.1 size=1048576 2024-09-14T11:01:54.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.516+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~Q0QMY75MNXBS.2 size=1000523 2024-09-14T11:01:54.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.518+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=Q0QMY75MNXBS tag=IORHVHHR61YN type=write size=4146251 2024-09-14T11:01:54.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.520+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=5JJ941E2SWPS type=del size=1949501 2024-09-14T11:01:54.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.521+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=3HAI3IHVZXCJ type=del 2024-09-14T11:01:54.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.522+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=7R3JL6APXMBL type=write size=179424 2024-09-14T11:01:54.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.523+0000 7fe3dd11f780 1 < completed write operation key=KXL3E0PJBNBA tag=7TXTNF40K580 type=write size=997399 2024-09-14T11:01:54.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.524+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=YGLJBP5SJKI2 type=del size=3920263 2024-09-14T11:01:54.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.527+0000 7fe3dd11f780 1 < suggested remove operation key=3PS4LAML698X tag=5SM5W5P08Y8H type=del 2024-09-14T11:01:54.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.528+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=WLL0V92ZB71U type=del size=3919825 2024-09-14T11:01:54.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.529+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=TRBC5Z0G6S4T type=del 2024-09-14T11:01:54.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.531+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=GG516FK0U6PT type=del size=1815356 2024-09-14T11:01:54.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.533+0000 7fe3dd11f780 1 < suggested update operation key=K9BP30LHDPA1 tag=F4B9VXKPZN12 type=del size=2242440 2024-09-14T11:01:54.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.534+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=3G4N2IOUET7A type=del size=1778452 2024-09-14T11:01:54.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.535+0000 7fe3dd11f780 1 < completed write operation key=0PT98N1VBWAG tag=9K8RCBO5OTHS type=write size=522482 2024-09-14T11:01:54.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.536+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=IZYUPGZXA0OU type=del size=4182958 2024-09-14T11:01:54.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.538+0000 7fe3dd11f780 1 < completed write operation key=PHLQ77OMLI37 tag=LOXB4PF23LN2 type=write size=666823 2024-09-14T11:01:54.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.540+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~0DP3XU5MF7E7.0 size=1048576 2024-09-14T11:01:54.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.541+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~0DP3XU5MF7E7.1 size=1048576 2024-09-14T11:01:54.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.542+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~0DP3XU5MF7E7.2 size=298622 2024-09-14T11:01:54.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.542+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=0DP3XU5MF7E7 tag=RP62CICNSDA5 type=write size=3444350 2024-09-14T11:01:54.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.543+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~61J15TODDDI8.0 size=1048576 2024-09-14T11:01:54.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.544+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~61J15TODDDI8.1 size=610729 2024-09-14T11:01:54.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.546+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=61J15TODDDI8 tag=4MWPECFOMWRN type=write size=2707881 2024-09-14T11:01:54.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.548+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=DU3ZJEKDDG38 type=del size=3566692 2024-09-14T11:01:54.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.550+0000 7fe3dd11f780 1 < suggested update operation key=LFKLJAJWQ2J6 tag=6OIM59V7J480 type=del size=813091 2024-09-14T11:01:54.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.552+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=I9V361D0NMEK type=del size=677133 2024-09-14T11:01:54.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.553+0000 7fe3dd11f780 1 < canceled operation key=0PT98N1VBWAG tag=S83MQMAKQDDA type=del size=70678 2024-09-14T11:01:54.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.554+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=KJO1077F83VZ type=del size=2962831 2024-09-14T11:01:54.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.557+0000 7fe3dd11f780 1 < suggested update operation key=LDILBET1CMYY tag=6H8XN7067SO0 type=write size=781836 2024-09-14T11:01:54.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.558+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=N344JVXSUPFU type=del size=1718856 2024-09-14T11:01:54.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.559+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~YRI5330NXSSA.0 size=594833 2024-09-14T11:01:54.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.561+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=YRI5330NXSSA tag=22DXT40YXBD4 type=write size=1643409 2024-09-14T11:01:54.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.562+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=UY16FDQWSA5V type=del size=1451574 2024-09-14T11:01:54.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.564+0000 7fe3dd11f780 1 < suggested remove operation key=LDILBET1CMYY tag=NNIRQLZQ5AES type=del 2024-09-14T11:01:54.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.566+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~XFVDL8C9UDQH.0 size=1048576 2024-09-14T11:01:54.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.567+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~XFVDL8C9UDQH.1 size=301328 2024-09-14T11:01:54.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.567+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=XFVDL8C9UDQH tag=46M8UUB2OBFX type=write size=2398480 2024-09-14T11:01:54.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.569+0000 7fe3dd11f780 1 < suggested update operation key=ZTD98WQ6032X tag=EULLUBGFFCDO type=del size=1202914 2024-09-14T11:01:54.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.571+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=OTQH7N4AIZAJ type=del size=2427323 2024-09-14T11:01:54.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.572+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=KKJPN0U27PEJ type=del 2024-09-14T11:01:54.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.573+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=VL43DNSJGGKH type=del size=2270509 2024-09-14T11:01:54.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.574+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=5JJ941E2SWPS type=del 2024-09-14T11:01:54.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.576+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~0GPS8QP545D7.0 size=863985 2024-09-14T11:01:54.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.576+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=0GPS8QP545D7 tag=LQHY14NM6NMW type=write size=1912561 2024-09-14T11:01:54.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.578+0000 7fe3dd11f780 1 < completed write operation key=A89YQO40BHUS tag=7R3JL6APXMBL type=write size=179424 2024-09-14T11:01:54.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.580+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~LSCD973F9BUN.0 size=437369 2024-09-14T11:01:54.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.580+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=LSCD973F9BUN tag=ED4AGG5VFT2Z type=write size=1485945 2024-09-14T11:01:54.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.581+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=YGLJBP5SJKI2 type=del 2024-09-14T11:01:54.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.582+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=X0UPVZ20XK2P type=del size=3532220 2024-09-14T11:01:54.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.584+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=WLL0V92ZB71U type=del 2024-09-14T11:01:54.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.585+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=28BAYEBVA5NU type=del size=1403600 2024-09-14T11:01:54.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.586+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=GG516FK0U6PT type=del 2024-09-14T11:01:54.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.587+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=OK86SLUVBPEG type=del size=3266060 2024-09-14T11:01:54.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.588+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=3G4N2IOUET7A type=del 2024-09-14T11:01:54.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.591+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~BQLIHF0H0LM4.0 size=1048576 2024-09-14T11:01:54.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.592+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~BQLIHF0H0LM4.1 size=640361 2024-09-14T11:01:54.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.592+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=BQLIHF0H0LM4 tag=J5LQ34V7W4CP type=write size=2737513 2024-09-14T11:01:54.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.593+0000 7fe3dd11f780 1 < canceled operation key=22TI1VCDTK5P tag=IZYUPGZXA0OU type=del size=4182958 2024-09-14T11:01:54.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.595+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~XPSHEBCUOJLL.0 size=1048576 2024-09-14T11:01:54.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.596+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~XPSHEBCUOJLL.1 size=1048576 2024-09-14T11:01:54.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.597+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~XPSHEBCUOJLL.2 size=683723 2024-09-14T11:01:54.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.597+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=XPSHEBCUOJLL tag=FIEPZSHITRDD type=write size=3829451 2024-09-14T11:01:54.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.597+0000 7fe3dd11f780 1 < canceled part key=_multipart_A89YQO40BHUS.2~0DP3XU5MF7E7.0 size=1048576 2024-09-14T11:01:54.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.598+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~0DP3XU5MF7E7.1 size=1048576 2024-09-14T11:01:54.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.599+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~0DP3XU5MF7E7.2 size=298622 2024-09-14T11:01:54.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.601+0000 7fe3dd11f780 1 < canceled multipart upload key=A89YQO40BHUS upload=0DP3XU5MF7E7 tag=RP62CICNSDA5 type=write size=3444350 2024-09-14T11:01:54.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.603+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=PAC2K079RQ1M type=del size=3324010 2024-09-14T11:01:54.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.604+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=DU3ZJEKDDG38 type=del 2024-09-14T11:01:54.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.606+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~USI8DJ61WCTA.0 size=1048576 2024-09-14T11:01:54.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.607+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~USI8DJ61WCTA.1 size=1048576 2024-09-14T11:01:54.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.608+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~USI8DJ61WCTA.2 size=894963 2024-09-14T11:01:54.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.608+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=USI8DJ61WCTA tag=05A87F7SS6L1 type=write size=4040691 2024-09-14T11:01:54.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.610+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=I9V361D0NMEK type=del 2024-09-14T11:01:54.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.612+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~VBHNISBP5D6M.0 size=789252 2024-09-14T11:01:54.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.612+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=VBHNISBP5D6M tag=BY5W4Y5VO6P0 type=write size=1837828 2024-09-14T11:01:54.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.613+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=KJO1077F83VZ type=del 2024-09-14T11:01:54.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.615+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~5B8KB0XBH0LH.0 size=1048576 2024-09-14T11:01:54.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.616+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~5B8KB0XBH0LH.1 size=218707 2024-09-14T11:01:54.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.616+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=5B8KB0XBH0LH tag=IR87PUH78POZ type=write size=2315859 2024-09-14T11:01:54.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.617+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=N344JVXSUPFU type=del 2024-09-14T11:01:54.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.620+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~3AALJ1DSWZ53.0 size=1048576 2024-09-14T11:01:54.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.621+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~3AALJ1DSWZ53.1 size=190412 2024-09-14T11:01:54.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.621+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=3AALJ1DSWZ53 tag=1JBW9JY3295G type=write size=2287564 2024-09-14T11:01:54.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.622+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=UY16FDQWSA5V type=del 2024-09-14T11:01:54.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.624+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~H70IQ363BLFJ.0 size=1048576 2024-09-14T11:01:54.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.625+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~H70IQ363BLFJ.1 size=1048576 2024-09-14T11:01:54.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.626+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~H70IQ363BLFJ.2 size=874058 2024-09-14T11:01:54.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.626+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=H70IQ363BLFJ tag=DKCERNZDAYIP type=write size=4019786 2024-09-14T11:01:54.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.627+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~XFVDL8C9UDQH.0 size=1048576 2024-09-14T11:01:54.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.628+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~XFVDL8C9UDQH.1 size=301328 2024-09-14T11:01:54.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.630+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=XFVDL8C9UDQH tag=46M8UUB2OBFX type=write size=2398480 2024-09-14T11:01:54.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.633+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=D38VLDVA7D8X type=del size=1161061 2024-09-14T11:01:54.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.634+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=OTQH7N4AIZAJ type=del 2024-09-14T11:01:54.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.635+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=26LK9VSRHZW5 type=del size=2113666 2024-09-14T11:01:54.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.637+0000 7fe3dd11f780 1 < suggested update operation key=V692HUUJP2RC tag=VL43DNSJGGKH type=del size=2270509 2024-09-14T11:01:54.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.639+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=05PXSDZT9WVD type=write size=801181 2024-09-14T11:01:54.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.640+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~0GPS8QP545D7.0 size=863985 2024-09-14T11:01:54.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.642+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=0GPS8QP545D7 tag=LQHY14NM6NMW type=write size=1912561 2024-09-14T11:01:54.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.643+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=UZ5JDQHD9A9Z type=del size=1477100 2024-09-14T11:01:54.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.644+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~LSCD973F9BUN.0 size=437369 2024-09-14T11:01:54.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.646+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=LSCD973F9BUN tag=ED4AGG5VFT2Z type=write size=1485945 2024-09-14T11:01:54.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.647+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=1P89UNMDIZG2 type=del size=2484308 2024-09-14T11:01:54.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.649+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=X0UPVZ20XK2P type=del 2024-09-14T11:01:54.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.650+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=ADIVY0FLO09Q type=del size=2296040 2024-09-14T11:01:54.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.651+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=28BAYEBVA5NU type=del 2024-09-14T11:01:54.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.652+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=U3M3BD6AEKM3 type=del size=3012492 2024-09-14T11:01:54.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.653+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=OK86SLUVBPEG type=del 2024-09-14T11:01:54.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.656+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~NI7IOE309C7X.0 size=1048576 2024-09-14T11:01:54.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.657+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~NI7IOE309C7X.1 size=1048576 2024-09-14T11:01:54.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.658+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~NI7IOE309C7X.2 size=492737 2024-09-14T11:01:54.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.658+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=NI7IOE309C7X tag=5YF0OY7JJMPK type=write size=3638465 2024-09-14T11:01:54.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.659+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~BQLIHF0H0LM4.0 size=1048576 2024-09-14T11:01:54.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.660+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~BQLIHF0H0LM4.1 size=640361 2024-09-14T11:01:54.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.662+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=BQLIHF0H0LM4 tag=J5LQ34V7W4CP type=write size=2737513 2024-09-14T11:01:54.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.663+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=1RAWHO22EBEP type=write size=712701 2024-09-14T11:01:54.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.664+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~XPSHEBCUOJLL.0 size=1048576 2024-09-14T11:01:54.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.664+0000 7fe3dd11f780 1 < canceled part key=_multipart_OK5L92EKOOMW.2~XPSHEBCUOJLL.1 size=1048576 2024-09-14T11:01:54.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.665+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~XPSHEBCUOJLL.2 size=683723 2024-09-14T11:01:54.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.667+0000 7fe3dd11f780 1 < canceled multipart upload key=OK5L92EKOOMW upload=XPSHEBCUOJLL tag=FIEPZSHITRDD type=write size=3829451 2024-09-14T11:01:54.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.668+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=17WAUFIBY4KQ type=del size=1949926 2024-09-14T11:01:54.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.671+0000 7fe3dd11f780 1 < suggested remove operation key=M0DMAQ5LTDR0 tag=PAC2K079RQ1M type=del 2024-09-14T11:01:54.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.672+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=0O12UF1YA77M type=write size=983248 2024-09-14T11:01:54.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.673+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~USI8DJ61WCTA.0 size=1048576 2024-09-14T11:01:54.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.673+0000 7fe3dd11f780 1 < canceled part key=_multipart_3PS4LAML698X.2~USI8DJ61WCTA.1 size=1048576 2024-09-14T11:01:54.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.674+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~USI8DJ61WCTA.2 size=894963 2024-09-14T11:01:54.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.676+0000 7fe3dd11f780 1 < canceled multipart upload key=3PS4LAML698X upload=USI8DJ61WCTA tag=05A87F7SS6L1 type=write size=4040691 2024-09-14T11:01:54.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.678+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~QBJGGYE8T087.0 size=366085 2024-09-14T11:01:54.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.678+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=QBJGGYE8T087 tag=NBERSLGL0KHK type=write size=1414661 2024-09-14T11:01:54.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.679+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~VBHNISBP5D6M.0 size=789252 2024-09-14T11:01:54.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.681+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=VBHNISBP5D6M tag=BY5W4Y5VO6P0 type=write size=1837828 2024-09-14T11:01:54.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.682+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=2LFX2XGEUQSH type=del size=3947194 2024-09-14T11:01:54.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.684+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~5B8KB0XBH0LH.0 size=1048576 2024-09-14T11:01:54.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.685+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~5B8KB0XBH0LH.1 size=218707 2024-09-14T11:01:54.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.687+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=5B8KB0XBH0LH tag=IR87PUH78POZ type=write size=2315859 2024-09-14T11:01:54.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.688+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=XYNJFDDBRHN0 type=del size=31402 2024-09-14T11:01:54.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.689+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~3AALJ1DSWZ53.0 size=1048576 2024-09-14T11:01:54.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.690+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~3AALJ1DSWZ53.1 size=190412 2024-09-14T11:01:54.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.692+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=3AALJ1DSWZ53 tag=1JBW9JY3295G type=write size=2287564 2024-09-14T11:01:54.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.693+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=RH87U8T1V2KQ type=del size=1797329 2024-09-14T11:01:54.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.693+0000 7fe3dd11f780 1 < canceled part key=_multipart_YMGE9GKLSPE6.2~H70IQ363BLFJ.0 size=1048576 2024-09-14T11:01:54.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.694+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~H70IQ363BLFJ.1 size=1048576 2024-09-14T11:01:54.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.695+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~H70IQ363BLFJ.2 size=874058 2024-09-14T11:01:54.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.697+0000 7fe3dd11f780 1 < canceled multipart upload key=YMGE9GKLSPE6 upload=H70IQ363BLFJ tag=DKCERNZDAYIP type=write size=4019786 2024-09-14T11:01:54.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.698+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=ADOWYYTCK1PX type=del size=1756196 2024-09-14T11:01:54.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.700+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=D38VLDVA7D8X type=del 2024-09-14T11:01:54.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.701+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=42WCMK0D4T26 type=del size=540512 2024-09-14T11:01:54.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.702+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=26LK9VSRHZW5 type=del 2024-09-14T11:01:54.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.704+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~48GFGK7OP915.0 size=1048576 2024-09-14T11:01:54.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.705+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~48GFGK7OP915.1 size=487119 2024-09-14T11:01:54.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.705+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=48GFGK7OP915 tag=MJKS8QQNLVVX type=write size=2584271 2024-09-14T11:01:54.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.708+0000 7fe3dd11f780 1 < suggested remove operation key=YXPZXFY8930D tag=05PXSDZT9WVD type=write 2024-09-14T11:01:54.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.709+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=R0B5RAKASY0K type=del size=1119539 2024-09-14T11:01:54.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.710+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=UZ5JDQHD9A9Z type=del 2024-09-14T11:01:54.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.711+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=UX9Y0E6TMAL1 type=del size=744985 2024-09-14T11:01:54.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.713+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=1P89UNMDIZG2 type=del 2024-09-14T11:01:54.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.714+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=WTN8OEO18RYI type=del size=2077861 2024-09-14T11:01:54.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.715+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=ADIVY0FLO09Q type=del 2024-09-14T11:01:54.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.716+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=XJ919EH91BJT type=write size=1007121 2024-09-14T11:01:54.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.718+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=U3M3BD6AEKM3 type=del 2024-09-14T11:01:54.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.719+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=RDFFG374UV4G type=del size=3921332 2024-09-14T11:01:54.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.720+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~NI7IOE309C7X.0 size=1048576 2024-09-14T11:01:54.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.721+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~NI7IOE309C7X.1 size=1048576 2024-09-14T11:01:54.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.722+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~NI7IOE309C7X.2 size=492737 2024-09-14T11:01:54.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.724+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=NI7IOE309C7X tag=5YF0OY7JJMPK type=write size=3638465 2024-09-14T11:01:54.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.725+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=H7X5PZ5TSXOU type=del size=3332183 2024-09-14T11:01:54.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.726+0000 7fe3dd11f780 1 < completed write operation key=3PS4LAML698X tag=1RAWHO22EBEP type=write size=712701 2024-09-14T11:01:54.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.729+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~8SHQK8N9QY4W.0 size=1048576 2024-09-14T11:01:54.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.730+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~8SHQK8N9QY4W.1 size=1048576 2024-09-14T11:01:54.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.731+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~8SHQK8N9QY4W.2 size=61412 2024-09-14T11:01:54.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.731+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=8SHQK8N9QY4W tag=VCH0ZHM1S0UU type=write size=3207140 2024-09-14T11:01:54.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.733+0000 7fe3dd11f780 1 < suggested remove operation key=LL9VJXEU13IK tag=17WAUFIBY4KQ type=del 2024-09-14T11:01:54.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.734+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=U8X6EFFT64QZ type=del size=1571482 2024-09-14T11:01:54.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.736+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=0O12UF1YA77M type=write size=983248 2024-09-14T11:01:54.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.737+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=LCXKQML1LOBI type=del size=2081199 2024-09-14T11:01:54.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.738+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~QBJGGYE8T087.0 size=366085 2024-09-14T11:01:54.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.740+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=QBJGGYE8T087 tag=NBERSLGL0KHK type=write size=1414661 2024-09-14T11:01:54.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.742+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=V713U85COI9U type=del size=4187221 2024-09-14T11:01:54.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.743+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=2LFX2XGEUQSH type=del 2024-09-14T11:01:54.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.744+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=Z0G7D5L4IS0B type=del size=1665157 2024-09-14T11:01:54.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.747+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=XYNJFDDBRHN0 type=del 2024-09-14T11:01:54.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.748+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=54US0BEY7QL7 type=del size=1748391 2024-09-14T11:01:54.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.749+0000 7fe3dd11f780 -1 < no bi entry to suggest for operation key=LL9VJXEU13IK tag=RH87U8T1V2KQ type=del size=1797329: (2) No such file or directory 2024-09-14T11:01:54.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.750+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=5F90PMG4ZBEV type=del size=764915 2024-09-14T11:01:54.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.752+0000 7fe3dd11f780 1 < suggested update operation key=6PJ03TAYRUT8 tag=ADOWYYTCK1PX type=del size=1756196 2024-09-14T11:01:54.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.754+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~D53JGMVVHV82.0 size=1048576 2024-09-14T11:01:54.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.755+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~D53JGMVVHV82.1 size=568170 2024-09-14T11:01:54.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.755+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=D53JGMVVHV82 tag=6612CLLYOX56 type=write size=2665322 2024-09-14T11:01:54.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.756+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=42WCMK0D4T26 type=del 2024-09-14T11:01:54.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.758+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~528BEJ0EMZTJ.0 size=47421 2024-09-14T11:01:54.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.758+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=528BEJ0EMZTJ tag=XX2FOZSIF5JO type=write size=1095997 2024-09-14T11:01:54.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.760+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~48GFGK7OP915.0 size=1048576 2024-09-14T11:01:54.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.760+0000 7fe3dd11f780 1 < canceled part key=_multipart_A89YQO40BHUS.2~48GFGK7OP915.1 size=487119 2024-09-14T11:01:54.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.761+0000 7fe3dd11f780 1 < canceled multipart upload key=A89YQO40BHUS upload=48GFGK7OP915 tag=MJKS8QQNLVVX type=write size=2584271 2024-09-14T11:01:54.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.764+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~6EDU2ZFVU6PL.0 size=1048576 2024-09-14T11:01:54.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.765+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~6EDU2ZFVU6PL.1 size=154476 2024-09-14T11:01:54.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.765+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=6EDU2ZFVU6PL tag=6EGQ2T9APKH1 type=write size=2251628 2024-09-14T11:01:54.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.766+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=R0B5RAKASY0K type=del 2024-09-14T11:01:54.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.768+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~AQNLMAWSTYXK.0 size=201364 2024-09-14T11:01:54.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.768+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=AQNLMAWSTYXK tag=0HO4EYNEEJTK type=write size=1249940 2024-09-14T11:01:54.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.769+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=UX9Y0E6TMAL1 type=del 2024-09-14T11:01:54.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.770+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=DIVKUFBQ71R4 type=del size=1091846 2024-09-14T11:01:54.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.771+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=WTN8OEO18RYI type=del 2024-09-14T11:01:54.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.773+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=A9R26U4GKF3Q type=del size=2156292 2024-09-14T11:01:54.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.774+0000 7fe3dd11f780 1 < completed write operation key=MD0OU8IC5PYI tag=XJ919EH91BJT type=write size=1007121 2024-09-14T11:01:54.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.775+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=4OCM0EEDBJWK type=del size=3174395 2024-09-14T11:01:54.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.777+0000 7fe3dd11f780 1 < suggested remove operation key=ZI5SFHGWCHJA tag=RDFFG374UV4G type=del 2024-09-14T11:01:54.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.778+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=V29JKNCRKELO type=del size=993502 2024-09-14T11:01:54.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.780+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=H7X5PZ5TSXOU type=del 2024-09-14T11:01:54.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.783+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~8KTXH8A6S8WS.0 size=1043298 2024-09-14T11:01:54.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.783+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=8KTXH8A6S8WS tag=3VGDBMRBJZZD type=write size=2091874 2024-09-14T11:01:54.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.784+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~8SHQK8N9QY4W.0 size=1048576 2024-09-14T11:01:54.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.785+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~8SHQK8N9QY4W.1 size=1048576 2024-09-14T11:01:54.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.786+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~8SHQK8N9QY4W.2 size=61412 2024-09-14T11:01:54.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.787+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=8SHQK8N9QY4W tag=VCH0ZHM1S0UU type=write size=3207140 2024-09-14T11:01:54.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.789+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=J1HKO7T0MXL5 type=del size=1732282 2024-09-14T11:01:54.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.790+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=U8X6EFFT64QZ type=del 2024-09-14T11:01:54.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.791+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=1ABDQPXRZ85Y type=del size=806518 2024-09-14T11:01:54.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.793+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=LCXKQML1LOBI type=del 2024-09-14T11:01:54.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.794+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=QKNR6A4EC7Q4 type=del size=2653689 2024-09-14T11:01:54.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.795+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=V713U85COI9U type=del 2024-09-14T11:01:54.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.797+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~2ZNA39GEB7VE.0 size=1048576 2024-09-14T11:01:54.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.798+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~2ZNA39GEB7VE.1 size=314748 2024-09-14T11:01:54.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.798+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=2ZNA39GEB7VE tag=ZXA44D2JZLVJ type=write size=2411900 2024-09-14T11:01:54.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.800+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=Z0G7D5L4IS0B type=del 2024-09-14T11:01:54.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.801+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=1YQP4OTBZ331 type=del size=1742970 2024-09-14T11:01:54.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.802+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=54US0BEY7QL7 type=del 2024-09-14T11:01:54.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.803+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=SPMIMC8ZQG0L type=del size=3449653 2024-09-14T11:01:54.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.806+0000 7fe3dd11f780 1 < suggested update operation key=QPH41U60044L tag=5F90PMG4ZBEV type=del size=764915 2024-09-14T11:01:54.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.807+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=8CAKYDG14NYB type=del size=3378315 2024-09-14T11:01:54.805 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.808+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~D53JGMVVHV82.0 size=1048576 2024-09-14T11:01:54.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.809+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~D53JGMVVHV82.1 size=568170 2024-09-14T11:01:54.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.811+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=D53JGMVVHV82 tag=6612CLLYOX56 type=write size=2665322 2024-09-14T11:01:54.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.813+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~S2CPFXUPIBUM.0 size=1048576 2024-09-14T11:01:54.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.814+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~S2CPFXUPIBUM.1 size=723941 2024-09-14T11:01:54.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.814+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=S2CPFXUPIBUM tag=ZG773F90PUUZ type=write size=2821093 2024-09-14T11:01:54.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.815+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~528BEJ0EMZTJ.0 size=47421 2024-09-14T11:01:54.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.817+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=528BEJ0EMZTJ tag=XX2FOZSIF5JO type=write size=1095997 2024-09-14T11:01:54.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.819+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=VSFO0558EA5I type=write size=246049 2024-09-14T11:01:54.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.819+0000 7fe3dd11f780 1 < canceled part key=_multipart_22TI1VCDTK5P.2~6EDU2ZFVU6PL.0 size=1048576 2024-09-14T11:01:54.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.820+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~6EDU2ZFVU6PL.1 size=154476 2024-09-14T11:01:54.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.822+0000 7fe3dd11f780 1 < canceled multipart upload key=22TI1VCDTK5P upload=6EDU2ZFVU6PL tag=6EGQ2T9APKH1 type=write size=2251628 2024-09-14T11:01:54.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.823+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=433XDYUEZ54X type=del size=93185 2024-09-14T11:01:54.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.824+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~AQNLMAWSTYXK.0 size=201364 2024-09-14T11:01:54.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.826+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=AQNLMAWSTYXK tag=0HO4EYNEEJTK type=write size=1249940 2024-09-14T11:01:54.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.828+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=RFRU2ZTQRQQC type=del size=1178582 2024-09-14T11:01:54.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.829+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=DIVKUFBQ71R4 type=del 2024-09-14T11:01:54.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.830+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=30GQS89HXOEY type=del size=1386307 2024-09-14T11:01:54.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.832+0000 7fe3dd11f780 1 < suggested remove operation key=3PS4LAML698X tag=A9R26U4GKF3Q type=del 2024-09-14T11:01:54.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.835+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~WS13LK3QWJZS.0 size=869112 2024-09-14T11:01:54.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.835+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=WS13LK3QWJZS tag=1IU6T4R05KSB type=write size=1917688 2024-09-14T11:01:54.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.836+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=4OCM0EEDBJWK type=del 2024-09-14T11:01:54.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.838+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~6V7TT6NEDXLO.0 size=1048576 2024-09-14T11:01:54.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.839+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~6V7TT6NEDXLO.1 size=1048576 2024-09-14T11:01:54.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.840+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~6V7TT6NEDXLO.2 size=707601 2024-09-14T11:01:54.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.840+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=6V7TT6NEDXLO tag=NP0DJG1JPFBI type=write size=3853329 2024-09-14T11:01:54.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.841+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=V29JKNCRKELO type=del 2024-09-14T11:01:54.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.842+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=3RSNYF2ZYW96 type=del size=649271 2024-09-14T11:01:54.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.843+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~8KTXH8A6S8WS.0 size=1043298 2024-09-14T11:01:54.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.845+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=8KTXH8A6S8WS tag=3VGDBMRBJZZD type=write size=2091874 2024-09-14T11:01:54.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.846+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=0V75GEW25G4R type=write size=1043647 2024-09-14T11:01:54.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.848+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=J1HKO7T0MXL5 type=del 2024-09-14T11:01:54.846 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.849+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=14DPF5UK0P2Y type=del size=1068644 2024-09-14T11:01:54.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.850+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=1ABDQPXRZ85Y type=del 2024-09-14T11:01:54.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.852+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~4N63JP4NG853.0 size=1034985 2024-09-14T11:01:54.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.852+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=4N63JP4NG853 tag=FX19BDRTD4EH type=write size=2083561 2024-09-14T11:01:54.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.854+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=QKNR6A4EC7Q4 type=del 2024-09-14T11:01:54.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.856+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~2ATOMQ6ZTHQG.0 size=1048576 2024-09-14T11:01:54.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.857+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~2ATOMQ6ZTHQG.1 size=520565 2024-09-14T11:01:54.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.857+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=2ATOMQ6ZTHQG tag=MEN4WHFQ8PIK type=write size=2617717 2024-09-14T11:01:54.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.858+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~2ZNA39GEB7VE.0 size=1048576 2024-09-14T11:01:54.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.860+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~2ZNA39GEB7VE.1 size=314748 2024-09-14T11:01:54.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.862+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=2ZNA39GEB7VE tag=ZXA44D2JZLVJ type=write size=2411900 2024-09-14T11:01:54.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.865+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~TCHSO5SX3PRL.0 size=1048576 2024-09-14T11:01:54.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.866+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~TCHSO5SX3PRL.1 size=162915 2024-09-14T11:01:54.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.866+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=TCHSO5SX3PRL tag=MXETX98RSV5E type=write size=2260067 2024-09-14T11:01:54.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.867+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=1YQP4OTBZ331 type=del 2024-09-14T11:01:54.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.868+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=BSKEC04F1PU1 type=write size=532884 2024-09-14T11:01:54.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.871+0000 7fe3dd11f780 1 < suggested update operation key=KXL3E0PJBNBA tag=SPMIMC8ZQG0L type=del size=3449653 2024-09-14T11:01:54.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.873+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~SFV2VCDQIXVL.0 size=1048576 2024-09-14T11:01:54.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.874+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~SFV2VCDQIXVL.1 size=1048576 2024-09-14T11:01:54.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.875+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~SFV2VCDQIXVL.2 size=22286 2024-09-14T11:01:54.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.875+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=SFV2VCDQIXVL tag=VV0Y18LGKZNU type=write size=3168014 2024-09-14T11:01:54.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.876+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=8CAKYDG14NYB type=del 2024-09-14T11:01:54.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.878+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~9BBN8IARJFRA.0 size=1048576 2024-09-14T11:01:54.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.879+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~9BBN8IARJFRA.1 size=1048576 2024-09-14T11:01:54.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.880+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~9BBN8IARJFRA.2 size=41371 2024-09-14T11:01:54.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.880+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=9BBN8IARJFRA tag=705BM51G94JY type=write size=3187099 2024-09-14T11:01:54.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.880+0000 7fe3dd11f780 1 < canceled part key=_multipart_NHKCRGX10WBM.2~S2CPFXUPIBUM.0 size=1048576 2024-09-14T11:01:54.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.881+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~S2CPFXUPIBUM.1 size=723941 2024-09-14T11:01:54.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.883+0000 7fe3dd11f780 1 < canceled multipart upload key=NHKCRGX10WBM upload=S2CPFXUPIBUM tag=ZG773F90PUUZ type=write size=2821093 2024-09-14T11:01:54.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.884+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=18415XM6KK8T type=write size=603892 2024-09-14T11:01:54.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.886+0000 7fe3dd11f780 1 < suggested update operation key=22TI1VCDTK5P tag=VSFO0558EA5I type=write size=246049 2024-09-14T11:01:54.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.888+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=LSXKBR9OSQ9R type=del size=1367339 2024-09-14T11:01:54.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.889+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=433XDYUEZ54X type=del 2024-09-14T11:01:54.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.890+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=C5V2C2T4J2BE type=del size=2590189 2024-09-14T11:01:54.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.891+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=RFRU2ZTQRQQC type=del 2024-09-14T11:01:54.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.894+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~QDZVCH5049NO.0 size=1048576 2024-09-14T11:01:54.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.895+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~QDZVCH5049NO.1 size=252272 2024-09-14T11:01:54.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.895+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=QDZVCH5049NO tag=QCYG87QFCQ4Z type=write size=2349424 2024-09-14T11:01:54.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.896+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=30GQS89HXOEY type=del 2024-09-14T11:01:54.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.897+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=32LX0IMAIAHL type=del size=3212451 2024-09-14T11:01:54.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.898+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~WS13LK3QWJZS.0 size=869112 2024-09-14T11:01:54.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.900+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=WS13LK3QWJZS tag=1IU6T4R05KSB type=write size=1917688 2024-09-14T11:01:54.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.902+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=SX1H0FD08Q71 type=del size=1189420 2024-09-14T11:01:54.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.903+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~6V7TT6NEDXLO.0 size=1048576 2024-09-14T11:01:54.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.904+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~6V7TT6NEDXLO.1 size=1048576 2024-09-14T11:01:54.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.905+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~6V7TT6NEDXLO.2 size=707601 2024-09-14T11:01:54.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.908+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=6V7TT6NEDXLO tag=NP0DJG1JPFBI type=write size=3853329 2024-09-14T11:01:54.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.910+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~8U9EH19U407E.0 size=1048576 2024-09-14T11:01:54.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.911+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~8U9EH19U407E.1 size=737791 2024-09-14T11:01:54.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.911+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=8U9EH19U407E tag=PZ5PH02DM246 type=write size=2834943 2024-09-14T11:01:54.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.912+0000 7fe3dd11f780 -1 < failed to complete operation key=22TI1VCDTK5P tag=3RSNYF2ZYW96 type=del size=649271: (22) Invalid argument 2024-09-14T11:01:54.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.914+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=8LSTIY4YQPVT type=del size=756294 2024-09-14T11:01:54.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.915+0000 7fe3dd11f780 1 < completed write operation key=LL9VJXEU13IK tag=0V75GEW25G4R type=write size=1043647 2024-09-14T11:01:54.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.916+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=1NANMIIAA30G type=write size=556810 2024-09-14T11:01:54.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.917+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=14DPF5UK0P2Y type=del 2024-09-14T11:01:54.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.919+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=WVWLJH335L76 type=del size=3719437 2024-09-14T11:01:54.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.919+0000 7fe3dd11f780 1 < canceled part key=_multipart_4JTN39NIB2UE.2~4N63JP4NG853.0 size=1034985 2024-09-14T11:01:54.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.921+0000 7fe3dd11f780 1 < canceled multipart upload key=4JTN39NIB2UE upload=4N63JP4NG853 tag=FX19BDRTD4EH type=write size=2083561 2024-09-14T11:01:54.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.922+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=0JEORTHGIJI4 type=del size=2578214 2024-09-14T11:01:54.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.923+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~2ATOMQ6ZTHQG.0 size=1048576 2024-09-14T11:01:54.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.924+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~2ATOMQ6ZTHQG.1 size=520565 2024-09-14T11:01:54.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.926+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=2ATOMQ6ZTHQG tag=MEN4WHFQ8PIK type=write size=2617717 2024-09-14T11:01:54.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.927+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=2A09HQ5CNU08 type=write size=431881 2024-09-14T11:01:54.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.929+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~TCHSO5SX3PRL.0 size=1048576 2024-09-14T11:01:54.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.930+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~TCHSO5SX3PRL.1 size=162915 2024-09-14T11:01:54.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.932+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=TCHSO5SX3PRL tag=MXETX98RSV5E type=write size=2260067 2024-09-14T11:01:54.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.933+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=A47QTWWDIFZY type=del size=1156725 2024-09-14T11:01:54.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.934+0000 7fe3dd11f780 1 < canceled operation key=K9BP30LHDPA1 tag=BSKEC04F1PU1 type=write size=532884 2024-09-14T11:01:54.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.935+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=R7MKP9CX9UQ3 type=del size=3692208 2024-09-14T11:01:54.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.936+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~SFV2VCDQIXVL.0 size=1048576 2024-09-14T11:01:54.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.937+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~SFV2VCDQIXVL.1 size=1048576 2024-09-14T11:01:54.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.938+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~SFV2VCDQIXVL.2 size=22286 2024-09-14T11:01:54.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.940+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=SFV2VCDQIXVL tag=VV0Y18LGKZNU type=write size=3168014 2024-09-14T11:01:54.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.941+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=C0AF6P1YVUK4 type=del size=1698804 2024-09-14T11:01:54.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.942+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~9BBN8IARJFRA.0 size=1048576 2024-09-14T11:01:54.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.943+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~9BBN8IARJFRA.1 size=1048576 2024-09-14T11:01:54.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.943+0000 7fe3dd11f780 1 < canceled part key=_multipart_LDILBET1CMYY.2~9BBN8IARJFRA.2 size=41371 2024-09-14T11:01:54.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.945+0000 7fe3dd11f780 1 < canceled multipart upload key=LDILBET1CMYY upload=9BBN8IARJFRA tag=705BM51G94JY type=write size=3187099 2024-09-14T11:01:54.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.948+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~9IRDUNL3NGK7.0 size=1048576 2024-09-14T11:01:54.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.949+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~9IRDUNL3NGK7.1 size=1048576 2024-09-14T11:01:54.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.950+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~9IRDUNL3NGK7.2 size=753504 2024-09-14T11:01:54.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.950+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=9IRDUNL3NGK7 tag=QEXZ0O70NMR3 type=write size=3899232 2024-09-14T11:01:54.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.951+0000 7fe3dd11f780 1 < canceled operation key=0PT98N1VBWAG tag=18415XM6KK8T type=write size=603892 2024-09-14T11:01:54.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.953+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~5QOD0E5CNASS.0 size=1048576 2024-09-14T11:01:54.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.954+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~5QOD0E5CNASS.1 size=827435 2024-09-14T11:01:54.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.954+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=5QOD0E5CNASS tag=FVY335I2ZG25 type=write size=2924587 2024-09-14T11:01:54.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.956+0000 7fe3dd11f780 1 < suggested remove operation key=JSEN4QXEMVHS tag=LSXKBR9OSQ9R type=del 2024-09-14T11:01:54.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.959+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~VCYNAY15OVNG.0 size=1048576 2024-09-14T11:01:54.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.960+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~VCYNAY15OVNG.1 size=721655 2024-09-14T11:01:54.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.960+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=VCYNAY15OVNG tag=X112QDM744K8 type=write size=2818807 2024-09-14T11:01:54.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.962+0000 7fe3dd11f780 1 < suggested update operation key=A89YQO40BHUS tag=C5V2C2T4J2BE type=del size=2590189 2024-09-14T11:01:54.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.963+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=1XCIL88WWGGH type=del size=3028343 2024-09-14T11:01:54.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.965+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~QDZVCH5049NO.0 size=1048576 2024-09-14T11:01:54.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.966+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~QDZVCH5049NO.1 size=252272 2024-09-14T11:01:54.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.969+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=QDZVCH5049NO tag=QCYG87QFCQ4Z type=write size=2349424 2024-09-14T11:01:54.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.970+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=R37A6L179BBA type=del size=501057 2024-09-14T11:01:54.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.971+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=32LX0IMAIAHL type=del 2024-09-14T11:01:54.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.975+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~6C2WADFBC4OU.0 size=1048576 2024-09-14T11:01:54.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.976+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~6C2WADFBC4OU.1 size=757642 2024-09-14T11:01:54.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.976+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=6C2WADFBC4OU tag=RQ73PWQTRRV4 type=write size=2854794 2024-09-14T11:01:54.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.979+0000 7fe3dd11f780 1 < suggested update operation key=3PS4LAML698X tag=SX1H0FD08Q71 type=del size=1189420 2024-09-14T11:01:54.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.981+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~BFQ4DK353X7P.0 size=1048576 2024-09-14T11:01:54.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.982+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~BFQ4DK353X7P.1 size=383087 2024-09-14T11:01:54.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.982+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=BFQ4DK353X7P tag=B5V3XUMSTZ3O type=write size=2480239 2024-09-14T11:01:54.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.983+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~8U9EH19U407E.0 size=1048576 2024-09-14T11:01:54.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.984+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~8U9EH19U407E.1 size=737791 2024-09-14T11:01:54.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.986+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=8U9EH19U407E tag=PZ5PH02DM246 type=write size=2834943 2024-09-14T11:01:54.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.987+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=MGFWC17Z1FE5 type=del size=1999611 2024-09-14T11:01:54.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.988+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=8LSTIY4YQPVT type=del 2024-09-14T11:01:54.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.989+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=B3YATW2S67BP type=del size=686680 2024-09-14T11:01:54.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.992+0000 7fe3dd11f780 1 < suggested remove operation key=QPH41U60044L tag=1NANMIIAA30G type=write 2024-09-14T11:01:54.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.993+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=CURTAHKZ4G5T type=del size=715215 2024-09-14T11:01:54.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.994+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=WVWLJH335L76 type=del 2024-09-14T11:01:54.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.995+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=A01XSGSV8CT5 type=del size=764612 2024-09-14T11:01:54.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.996+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=0JEORTHGIJI4 type=del 2024-09-14T11:01:54.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:54.999+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~0LWA1M8B2JTT.0 size=1048576 2024-09-14T11:01:54.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.000+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~0LWA1M8B2JTT.1 size=1048576 2024-09-14T11:01:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.000+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~0LWA1M8B2JTT.2 size=486253 2024-09-14T11:01:54.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.000+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=0LWA1M8B2JTT tag=TEPPKL2XKOWF type=write size=3631981 2024-09-14T11:01:55.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.003+0000 7fe3dd11f780 1 < suggested remove operation key=GQEFQ1UD6QCJ tag=2A09HQ5CNU08 type=write 2024-09-14T11:01:55.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.004+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=TG43XUZA4FKD type=del size=2179794 2024-09-14T11:01:55.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.005+0000 7fe3dd11f780 -1 < failed to complete operation key=JSEN4QXEMVHS tag=A47QTWWDIFZY type=del size=1156725: (22) Invalid argument 2024-09-14T11:01:55.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.007+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=WZY9IRQQ8BTF type=del size=2856125 2024-09-14T11:01:55.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.008+0000 7fe3dd11f780 -1 < failed to complete operation key=QPH41U60044L tag=R7MKP9CX9UQ3 type=del size=3692208: (22) Invalid argument 2024-09-14T11:01:55.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.010+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=G7UFH8MJ0XTR type=del size=206639 2024-09-14T11:01:55.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.011+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=C0AF6P1YVUK4 type=del 2024-09-14T11:01:55.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.013+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~JVVD9TYJBOZI.0 size=35986 2024-09-14T11:01:55.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.013+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=JVVD9TYJBOZI tag=YNH7IB1169GD type=write size=1084562 2024-09-14T11:01:55.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.014+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~9IRDUNL3NGK7.0 size=1048576 2024-09-14T11:01:55.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.015+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~9IRDUNL3NGK7.1 size=1048576 2024-09-14T11:01:55.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.016+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~9IRDUNL3NGK7.2 size=753504 2024-09-14T11:01:55.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.019+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=9IRDUNL3NGK7 tag=QEXZ0O70NMR3 type=write size=3899232 2024-09-14T11:01:55.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.021+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~8KUDORMISXZV.0 size=1048576 2024-09-14T11:01:55.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.022+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~8KUDORMISXZV.1 size=949050 2024-09-14T11:01:55.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.022+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=8KUDORMISXZV tag=TC1HJNR34IJU type=write size=3046202 2024-09-14T11:01:55.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.024+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~5QOD0E5CNASS.0 size=1048576 2024-09-14T11:01:55.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.025+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~5QOD0E5CNASS.1 size=827435 2024-09-14T11:01:55.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.027+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=5QOD0E5CNASS tag=FVY335I2ZG25 type=write size=2924587 2024-09-14T11:01:55.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.028+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=ORUOP3XDP88N type=del size=3318267 2024-09-14T11:01:55.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.029+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~VCYNAY15OVNG.0 size=1048576 2024-09-14T11:01:55.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.030+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~VCYNAY15OVNG.1 size=721655 2024-09-14T11:01:55.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.032+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=VCYNAY15OVNG tag=X112QDM744K8 type=write size=2818807 2024-09-14T11:01:55.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.034+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=BHU6UDQZU5IW type=del size=3483297 2024-09-14T11:01:55.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.035+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=1XCIL88WWGGH type=del 2024-09-14T11:01:55.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.037+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~1I607S20FYWR.0 size=1048576 2024-09-14T11:01:55.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.038+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~1I607S20FYWR.1 size=1048576 2024-09-14T11:01:55.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.039+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~1I607S20FYWR.2 size=15096 2024-09-14T11:01:55.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.039+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=1I607S20FYWR tag=41CDVNEUBXVD type=write size=3160824 2024-09-14T11:01:55.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.040+0000 7fe3dd11f780 1 < canceled operation key=M0DMAQ5LTDR0 tag=R37A6L179BBA type=del size=501057 2024-09-14T11:01:55.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.042+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~ANNE0MWOL161.0 size=1048576 2024-09-14T11:01:55.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.043+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~ANNE0MWOL161.1 size=1048576 2024-09-14T11:01:55.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.044+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~ANNE0MWOL161.2 size=678220 2024-09-14T11:01:55.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.044+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=ANNE0MWOL161 tag=R1SK5WHP6G5O type=write size=3823948 2024-09-14T11:01:55.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.044+0000 7fe3dd11f780 1 < canceled part key=_multipart_6PJ03TAYRUT8.2~6C2WADFBC4OU.0 size=1048576 2024-09-14T11:01:55.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.045+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~6C2WADFBC4OU.1 size=757642 2024-09-14T11:01:55.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.047+0000 7fe3dd11f780 1 < canceled multipart upload key=6PJ03TAYRUT8 upload=6C2WADFBC4OU tag=RQ73PWQTRRV4 type=write size=2854794 2024-09-14T11:01:55.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.048+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=ZMCU4TGG54KR type=del size=1142172 2024-09-14T11:01:55.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.050+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~BFQ4DK353X7P.0 size=1048576 2024-09-14T11:01:55.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.051+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~BFQ4DK353X7P.1 size=383087 2024-09-14T11:01:55.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.053+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=BFQ4DK353X7P tag=B5V3XUMSTZ3O type=write size=2480239 2024-09-14T11:01:55.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.056+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~X2MPX546UECX.0 size=543534 2024-09-14T11:01:55.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.056+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=X2MPX546UECX tag=7KTXEDT0WCE2 type=write size=1592110 2024-09-14T11:01:55.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.058+0000 7fe3dd11f780 1 < suggested remove operation key=JG1RZQD4J2EB tag=MGFWC17Z1FE5 type=del 2024-09-14T11:01:55.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.061+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~IDJ5V0TPXDPF.0 size=605995 2024-09-14T11:01:55.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.061+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=IDJ5V0TPXDPF tag=GY9UIO9WTMHP type=write size=1654571 2024-09-14T11:01:55.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.062+0000 7fe3dd11f780 1 < canceled operation key=PHLQ77OMLI37 tag=B3YATW2S67BP type=del size=686680 2024-09-14T11:01:55.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.065+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~2NY427JAM9LE.0 size=1048576 2024-09-14T11:01:55.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.066+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~2NY427JAM9LE.1 size=1048576 2024-09-14T11:01:55.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.067+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~2NY427JAM9LE.2 size=466736 2024-09-14T11:01:55.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.067+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=2NY427JAM9LE tag=37AB8GQAJ0R9 type=write size=3612464 2024-09-14T11:01:55.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.069+0000 7fe3dd11f780 1 < suggested remove operation key=OK5L92EKOOMW tag=CURTAHKZ4G5T type=del 2024-09-14T11:01:55.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.071+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=59S23I7VG92Y type=del size=3917661 2024-09-14T11:01:55.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.072+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=A01XSGSV8CT5 type=del 2024-09-14T11:01:55.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.073+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=EFAUZIZI22U7 type=del size=3619712 2024-09-14T11:01:55.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.074+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~0LWA1M8B2JTT.0 size=1048576 2024-09-14T11:01:55.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.075+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~0LWA1M8B2JTT.1 size=1048576 2024-09-14T11:01:55.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.076+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~0LWA1M8B2JTT.2 size=486253 2024-09-14T11:01:55.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.078+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=0LWA1M8B2JTT tag=TEPPKL2XKOWF type=write size=3631981 2024-09-14T11:01:55.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.081+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~T2BA7NBSOXSN.0 size=1048576 2024-09-14T11:01:55.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.081+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~T2BA7NBSOXSN.1 size=957971 2024-09-14T11:01:55.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.081+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=T2BA7NBSOXSN tag=VE44X3WL4CAC type=write size=3055123 2024-09-14T11:01:55.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.084+0000 7fe3dd11f780 1 < suggested remove operation key=M0DMAQ5LTDR0 tag=TG43XUZA4FKD type=del 2024-09-14T11:01:55.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.086+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~SS73NXGEHG5L.0 size=700102 2024-09-14T11:01:55.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.086+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=SS73NXGEHG5L tag=P8HJNP47EL17 type=write size=1748678 2024-09-14T11:01:55.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.087+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=WZY9IRQQ8BTF type=del 2024-09-14T11:01:55.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.090+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~NDTIIDCO6T1L.0 size=1048576 2024-09-14T11:01:55.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.091+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~NDTIIDCO6T1L.1 size=677215 2024-09-14T11:01:55.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.091+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=NDTIIDCO6T1L tag=KLKZIM5R92R9 type=write size=2774367 2024-09-14T11:01:55.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.093+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=G7UFH8MJ0XTR type=del 2024-09-14T11:01:55.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.094+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=09AAN1JVUCQW type=write size=985751 2024-09-14T11:01:55.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.095+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~JVVD9TYJBOZI.0 size=35986 2024-09-14T11:01:55.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.097+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=JVVD9TYJBOZI tag=YNH7IB1169GD type=write size=1084562 2024-09-14T11:01:55.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.098+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=MA9XASEG3EL8 type=del size=3679612 2024-09-14T11:01:55.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.099+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~8KUDORMISXZV.0 size=1048576 2024-09-14T11:01:55.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.100+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~8KUDORMISXZV.1 size=949050 2024-09-14T11:01:55.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.102+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=8KUDORMISXZV tag=TC1HJNR34IJU type=write size=3046202 2024-09-14T11:01:55.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.103+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=R5IBZJVNI6MV type=del size=858229 2024-09-14T11:01:55.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.105+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=ORUOP3XDP88N type=del 2024-09-14T11:01:55.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.107+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=R119COQMP69F type=del size=2100044 2024-09-14T11:01:55.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.108+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=BHU6UDQZU5IW type=del 2024-09-14T11:01:55.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.109+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=TP7G2O2SX8CG type=write size=406165 2024-09-14T11:01:55.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.110+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~1I607S20FYWR.0 size=1048576 2024-09-14T11:01:55.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.111+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~1I607S20FYWR.1 size=1048576 2024-09-14T11:01:55.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.112+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~1I607S20FYWR.2 size=15096 2024-09-14T11:01:55.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.114+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=1I607S20FYWR tag=41CDVNEUBXVD type=write size=3160824 2024-09-14T11:01:55.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.115+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=DQAPB0OFMW39 type=del size=3842073 2024-09-14T11:01:55.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.117+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~ANNE0MWOL161.0 size=1048576 2024-09-14T11:01:55.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.118+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~ANNE0MWOL161.1 size=1048576 2024-09-14T11:01:55.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.119+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~ANNE0MWOL161.2 size=678220 2024-09-14T11:01:55.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.120+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=ANNE0MWOL161 tag=R1SK5WHP6G5O type=write size=3823948 2024-09-14T11:01:55.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.122+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=TBL1YL9MIGJS type=del size=3807386 2024-09-14T11:01:55.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.123+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=ZMCU4TGG54KR type=del 2024-09-14T11:01:55.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.124+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=TP0QAAA7VK1X type=write size=280525 2024-09-14T11:01:55.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.125+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~X2MPX546UECX.0 size=543534 2024-09-14T11:01:55.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.127+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=X2MPX546UECX tag=7KTXEDT0WCE2 type=write size=1592110 2024-09-14T11:01:55.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.129+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=5P5JDNZTM160 type=del size=3216708 2024-09-14T11:01:55.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.130+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~IDJ5V0TPXDPF.0 size=605995 2024-09-14T11:01:55.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.132+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=IDJ5V0TPXDPF tag=GY9UIO9WTMHP type=write size=1654571 2024-09-14T11:01:55.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.134+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~9DMBCJKF9P5U.0 size=1048576 2024-09-14T11:01:55.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.135+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~9DMBCJKF9P5U.1 size=290121 2024-09-14T11:01:55.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.135+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=9DMBCJKF9P5U tag=V0WFIQOSG1C5 type=write size=2387273 2024-09-14T11:01:55.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.136+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~2NY427JAM9LE.0 size=1048576 2024-09-14T11:01:55.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.137+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~2NY427JAM9LE.1 size=1048576 2024-09-14T11:01:55.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.138+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~2NY427JAM9LE.2 size=466736 2024-09-14T11:01:55.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.140+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=2NY427JAM9LE tag=37AB8GQAJ0R9 type=write size=3612464 2024-09-14T11:01:55.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.141+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=XRQDQFJZK6AT type=del size=483696 2024-09-14T11:01:55.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.143+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=59S23I7VG92Y type=del 2024-09-14T11:01:55.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.145+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~AMMO1N59161A.0 size=266503 2024-09-14T11:01:55.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.145+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=AMMO1N59161A tag=DNV8LAJNL40F type=write size=1315079 2024-09-14T11:01:55.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.146+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=EFAUZIZI22U7 type=del 2024-09-14T11:01:55.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.148+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~ZLLC3MYJVMZX.0 size=1048576 2024-09-14T11:01:55.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.149+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~ZLLC3MYJVMZX.1 size=597981 2024-09-14T11:01:55.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.149+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=ZLLC3MYJVMZX tag=WJGCHG0DZVCT type=write size=2695133 2024-09-14T11:01:55.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.150+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~T2BA7NBSOXSN.0 size=1048576 2024-09-14T11:01:55.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.151+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~T2BA7NBSOXSN.1 size=957971 2024-09-14T11:01:55.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.153+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=T2BA7NBSOXSN tag=VE44X3WL4CAC type=write size=3055123 2024-09-14T11:01:55.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.156+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~3IRE9C9K4D7B.0 size=1048576 2024-09-14T11:01:55.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.157+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~3IRE9C9K4D7B.1 size=899447 2024-09-14T11:01:55.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.157+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=3IRE9C9K4D7B tag=EDN1KI612Z5A type=write size=2996599 2024-09-14T11:01:55.156 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.158+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~SS73NXGEHG5L.0 size=700102 2024-09-14T11:01:55.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.160+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=SS73NXGEHG5L tag=P8HJNP47EL17 type=write size=1748678 2024-09-14T11:01:55.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.161+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=BMOHH4U1GLWT type=del size=289422 2024-09-14T11:01:55.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.163+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~NDTIIDCO6T1L.0 size=1048576 2024-09-14T11:01:55.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.164+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~NDTIIDCO6T1L.1 size=677215 2024-09-14T11:01:55.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.166+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=NDTIIDCO6T1L tag=KLKZIM5R92R9 type=write size=2774367 2024-09-14T11:01:55.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.168+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~0D9UA4WYZQER.0 size=519275 2024-09-14T11:01:55.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.168+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=0D9UA4WYZQER tag=0AFZ7021QQ9I type=write size=1567851 2024-09-14T11:01:55.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.170+0000 7fe3dd11f780 1 < suggested remove operation key=0PT98N1VBWAG tag=09AAN1JVUCQW type=write 2024-09-14T11:01:55.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.173+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~EWUFCSD8F071.0 size=1048576 2024-09-14T11:01:55.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.173+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~EWUFCSD8F071.1 size=1044955 2024-09-14T11:01:55.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.174+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=EWUFCSD8F071 tag=HMXIVUM9A3PO type=write size=3142107 2024-09-14T11:01:55.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.176+0000 7fe3dd11f780 1 < suggested update operation key=UYZGHGZR74HQ tag=MA9XASEG3EL8 type=del size=3679612 2024-09-14T11:01:55.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.178+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~Q78X18ITTQ2K.0 size=192711 2024-09-14T11:01:55.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.178+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=Q78X18ITTQ2K tag=J1YCWKEQZU0R type=write size=1241287 2024-09-14T11:01:55.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.180+0000 7fe3dd11f780 1 < suggested remove operation key=V692HUUJP2RC tag=R5IBZJVNI6MV type=del 2024-09-14T11:01:55.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.183+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~WDN2HR6H77QN.0 size=1048576 2024-09-14T11:01:55.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.184+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~WDN2HR6H77QN.1 size=1032835 2024-09-14T11:01:55.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.184+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=WDN2HR6H77QN tag=QK2YY3XYAY4J type=write size=3129987 2024-09-14T11:01:55.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.185+0000 7fe3dd11f780 -1 < failed to complete operation key=0PT98N1VBWAG tag=R119COQMP69F type=del size=2100044: (22) Invalid argument 2024-09-14T11:01:55.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.186+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=0WPW3NYILTE7 type=del size=2012773 2024-09-14T11:01:55.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.187+0000 7fe3dd11f780 1 < completed write operation key=LFKLJAJWQ2J6 tag=TP7G2O2SX8CG type=write size=406165 2024-09-14T11:01:55.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.189+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=LNNXX4FX5A8P type=del size=2733013 2024-09-14T11:01:55.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.190+0000 7fe3dd11f780 1 < canceled operation key=JFLEJGPFLACM tag=DQAPB0OFMW39 type=del size=3842073 2024-09-14T11:01:55.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.191+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=RLZ9AWQK1KZU type=del size=3604807 2024-09-14T11:01:55.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.192+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=TBL1YL9MIGJS type=del 2024-09-14T11:01:55.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.195+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~HPO3XEGG2H55.0 size=1048576 2024-09-14T11:01:55.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.196+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~HPO3XEGG2H55.1 size=927705 2024-09-14T11:01:55.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.196+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=HPO3XEGG2H55 tag=0CGPKML4014Y type=write size=3024857 2024-09-14T11:01:55.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.198+0000 7fe3dd11f780 1 < suggested remove operation key=PHLQ77OMLI37 tag=TP0QAAA7VK1X type=write 2024-09-14T11:01:55.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.199+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=ULIYULLFZI9I type=del size=1905557 2024-09-14T11:01:55.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.201+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=5P5JDNZTM160 type=del 2024-09-14T11:01:55.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.204+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~ZX5GS8C8ZA29.0 size=463618 2024-09-14T11:01:55.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.204+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=ZX5GS8C8ZA29 tag=OW7C55D579AP type=write size=1512194 2024-09-14T11:01:55.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.205+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~9DMBCJKF9P5U.0 size=1048576 2024-09-14T11:01:55.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.206+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~9DMBCJKF9P5U.1 size=290121 2024-09-14T11:01:55.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.208+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=9DMBCJKF9P5U tag=V0WFIQOSG1C5 type=write size=2387273 2024-09-14T11:01:55.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.211+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TXCMYTS288BX.0 size=1048576 2024-09-14T11:01:55.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.211+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TXCMYTS288BX.1 size=1048576 2024-09-14T11:01:55.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.213+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~TXCMYTS288BX.2 size=772872 2024-09-14T11:01:55.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.213+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=TXCMYTS288BX tag=2EEG4GW9H6YS type=write size=3918600 2024-09-14T11:01:55.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.214+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=XRQDQFJZK6AT type=del 2024-09-14T11:01:55.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.215+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=MFLQDJQ5UNBV type=del size=1445143 2024-09-14T11:01:55.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.217+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~AMMO1N59161A.0 size=266503 2024-09-14T11:01:55.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.219+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=AMMO1N59161A tag=DNV8LAJNL40F type=write size=1315079 2024-09-14T11:01:55.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.220+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=FB1Z8AVY09YL type=del size=2479054 2024-09-14T11:01:55.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.221+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~ZLLC3MYJVMZX.0 size=1048576 2024-09-14T11:01:55.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.222+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~ZLLC3MYJVMZX.1 size=597981 2024-09-14T11:01:55.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.224+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=ZLLC3MYJVMZX tag=WJGCHG0DZVCT type=write size=2695133 2024-09-14T11:01:55.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.225+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=RQ0OEEF5EMG2 type=del size=1345025 2024-09-14T11:01:55.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.226+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~3IRE9C9K4D7B.0 size=1048576 2024-09-14T11:01:55.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.227+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~3IRE9C9K4D7B.1 size=899447 2024-09-14T11:01:55.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.229+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=3IRE9C9K4D7B tag=EDN1KI612Z5A type=write size=2996599 2024-09-14T11:01:55.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.231+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~AZAJJGQXVK44.0 size=1048576 2024-09-14T11:01:55.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.232+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~AZAJJGQXVK44.1 size=1048576 2024-09-14T11:01:55.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.233+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~AZAJJGQXVK44.2 size=224222 2024-09-14T11:01:55.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.233+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=AZAJJGQXVK44 tag=Q71U8LDJHF4G type=write size=3369950 2024-09-14T11:01:55.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.234+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=BMOHH4U1GLWT type=del 2024-09-14T11:01:55.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.237+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~LS513DVIR8AA.0 size=582967 2024-09-14T11:01:55.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.237+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=LS513DVIR8AA tag=4BZ23KJ4V0UW type=write size=1631543 2024-09-14T11:01:55.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.238+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~0D9UA4WYZQER.0 size=519275 2024-09-14T11:01:55.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.240+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=0D9UA4WYZQER tag=0AFZ7021QQ9I type=write size=1567851 2024-09-14T11:01:55.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.242+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~M08IBMDA1HFQ.0 size=1048576 2024-09-14T11:01:55.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.243+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~M08IBMDA1HFQ.1 size=1011484 2024-09-14T11:01:55.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.243+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=M08IBMDA1HFQ tag=DL2ALAI08XWS type=write size=3108636 2024-09-14T11:01:55.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.244+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~EWUFCSD8F071.0 size=1048576 2024-09-14T11:01:55.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.245+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~EWUFCSD8F071.1 size=1044955 2024-09-14T11:01:55.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.247+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=EWUFCSD8F071 tag=HMXIVUM9A3PO type=write size=3142107 2024-09-14T11:01:55.245 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.248+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=VXYJVO8YGIKD type=del size=2759634 2024-09-14T11:01:55.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.249+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~Q78X18ITTQ2K.0 size=192711 2024-09-14T11:01:55.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.251+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=Q78X18ITTQ2K tag=J1YCWKEQZU0R type=write size=1241287 2024-09-14T11:01:55.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.253+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~DC5KEF2S1E1Y.0 size=1048576 2024-09-14T11:01:55.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.254+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~DC5KEF2S1E1Y.1 size=62504 2024-09-14T11:01:55.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.254+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=DC5KEF2S1E1Y tag=8YLHZAULECU3 type=write size=2159656 2024-09-14T11:01:55.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.254+0000 7fe3dd11f780 1 < canceled part key=_multipart_UYZGHGZR74HQ.2~WDN2HR6H77QN.0 size=1048576 2024-09-14T11:01:55.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.255+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~WDN2HR6H77QN.1 size=1032835 2024-09-14T11:01:55.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.257+0000 7fe3dd11f780 1 < canceled multipart upload key=UYZGHGZR74HQ upload=WDN2HR6H77QN tag=QK2YY3XYAY4J type=write size=3129987 2024-09-14T11:01:55.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.259+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=ALM0FAFQ22OS type=del size=2862003 2024-09-14T11:01:55.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.260+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=0WPW3NYILTE7 type=del 2024-09-14T11:01:55.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.261+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=K0EDVATRBIGS type=write size=1012020 2024-09-14T11:01:55.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.263+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=LNNXX4FX5A8P type=del 2024-09-14T11:01:55.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.264+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=7VYKFVD7WOYH type=write size=143279 2024-09-14T11:01:55.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.265+0000 7fe3dd11f780 1 < canceled operation key=ZTD98WQ6032X tag=RLZ9AWQK1KZU type=del size=3604807 2024-09-14T11:01:55.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.267+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~D7H3HM05UWWR.0 size=1048576 2024-09-14T11:01:55.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.268+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~D7H3HM05UWWR.1 size=259780 2024-09-14T11:01:55.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.268+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=D7H3HM05UWWR tag=G7EKSWT8XEZ9 type=write size=2356932 2024-09-14T11:01:55.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.268+0000 7fe3dd11f780 1 < canceled part key=_multipart_LDILBET1CMYY.2~HPO3XEGG2H55.0 size=1048576 2024-09-14T11:01:55.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.269+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~HPO3XEGG2H55.1 size=927705 2024-09-14T11:01:55.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.271+0000 7fe3dd11f780 1 < canceled multipart upload key=LDILBET1CMYY upload=HPO3XEGG2H55 tag=0CGPKML4014Y type=write size=3024857 2024-09-14T11:01:55.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.273+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~U2WREO912LQY.0 size=697998 2024-09-14T11:01:55.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.273+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=U2WREO912LQY tag=AQITR26M1262 type=write size=1746574 2024-09-14T11:01:55.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.275+0000 7fe3dd11f780 1 < canceled operation key=4JTN39NIB2UE tag=ULIYULLFZI9I type=del size=1905557 2024-09-14T11:01:55.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.277+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~WKJ8ZCXZM179.0 size=1048576 2024-09-14T11:01:55.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.278+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~WKJ8ZCXZM179.1 size=756283 2024-09-14T11:01:55.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.278+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=WKJ8ZCXZM179 tag=FADO1HI4FRXM type=write size=2853435 2024-09-14T11:01:55.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.279+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~ZX5GS8C8ZA29.0 size=463618 2024-09-14T11:01:55.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.281+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=ZX5GS8C8ZA29 tag=OW7C55D579AP type=write size=1512194 2024-09-14T11:01:55.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.282+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=SEYLW413Z19B type=del size=1289834 2024-09-14T11:01:55.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.283+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TXCMYTS288BX.0 size=1048576 2024-09-14T11:01:55.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.284+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TXCMYTS288BX.1 size=1048576 2024-09-14T11:01:55.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.285+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~TXCMYTS288BX.2 size=772872 2024-09-14T11:01:55.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.287+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=TXCMYTS288BX tag=2EEG4GW9H6YS type=write size=3918600 2024-09-14T11:01:55.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.288+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=PIRBM137CISB type=del size=2586862 2024-09-14T11:01:55.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.290+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=MFLQDJQ5UNBV type=del 2024-09-14T11:01:55.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.292+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~JNFT73FFO1BM.0 size=1048576 2024-09-14T11:01:55.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.293+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~JNFT73FFO1BM.1 size=508247 2024-09-14T11:01:55.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.293+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=JNFT73FFO1BM tag=3NTXTEG8AQ76 type=write size=2605399 2024-09-14T11:01:55.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.294+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=FB1Z8AVY09YL type=del 2024-09-14T11:01:55.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.295+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=6HPZR9YYXT0C type=del size=2346259 2024-09-14T11:01:55.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.296+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=RQ0OEEF5EMG2 type=del 2024-09-14T11:01:55.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.299+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~UUGOXAIK2LBS.0 size=1048576 2024-09-14T11:01:55.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.300+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~UUGOXAIK2LBS.1 size=834 2024-09-14T11:01:55.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.300+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=UUGOXAIK2LBS tag=IKNENT28MYR2 type=write size=2097986 2024-09-14T11:01:55.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.301+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~AZAJJGQXVK44.0 size=1048576 2024-09-14T11:01:55.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.302+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~AZAJJGQXVK44.1 size=1048576 2024-09-14T11:01:55.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.303+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~AZAJJGQXVK44.2 size=224222 2024-09-14T11:01:55.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.305+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=AZAJJGQXVK44 tag=Q71U8LDJHF4G type=write size=3369950 2024-09-14T11:01:55.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.307+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~YD1XAUTO2Y5X.0 size=1048576 2024-09-14T11:01:55.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.308+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~YD1XAUTO2Y5X.1 size=373504 2024-09-14T11:01:55.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.308+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=YD1XAUTO2Y5X tag=XOIX2UYEI12Z type=write size=2470656 2024-09-14T11:01:55.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.310+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~LS513DVIR8AA.0 size=582967 2024-09-14T11:01:55.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.312+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=LS513DVIR8AA tag=4BZ23KJ4V0UW type=write size=1631543 2024-09-14T11:01:55.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.314+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=6S4LII3FV9K5 type=write size=754340 2024-09-14T11:01:55.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.315+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~M08IBMDA1HFQ.0 size=1048576 2024-09-14T11:01:55.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.315+0000 7fe3dd11f780 1 < canceled part key=_multipart_JG1RZQD4J2EB.2~M08IBMDA1HFQ.1 size=1011484 2024-09-14T11:01:55.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.317+0000 7fe3dd11f780 1 < canceled multipart upload key=JG1RZQD4J2EB upload=M08IBMDA1HFQ tag=DL2ALAI08XWS type=write size=3108636 2024-09-14T11:01:55.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.319+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~20VD8FLA5K6Q.0 size=1048576 2024-09-14T11:01:55.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.320+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~20VD8FLA5K6Q.1 size=181532 2024-09-14T11:01:55.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.320+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=20VD8FLA5K6Q tag=AUXII9XJBKW6 type=write size=2278684 2024-09-14T11:01:55.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.321+0000 7fe3dd11f780 1 < canceled operation key=0PT98N1VBWAG tag=VXYJVO8YGIKD type=del size=2759634 2024-09-14T11:01:55.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.323+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~BG47XL2LNXVR.0 size=78106 2024-09-14T11:01:55.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.323+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=BG47XL2LNXVR tag=E2GC1Z48D57P type=write size=1126682 2024-09-14T11:01:55.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.325+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~DC5KEF2S1E1Y.0 size=1048576 2024-09-14T11:01:55.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.326+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~DC5KEF2S1E1Y.1 size=62504 2024-09-14T11:01:55.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.328+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=DC5KEF2S1E1Y tag=8YLHZAULECU3 type=write size=2159656 2024-09-14T11:01:55.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.329+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=2J0TTOKPA059 type=del size=2444772 2024-09-14T11:01:55.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.330+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=ALM0FAFQ22OS type=del 2024-09-14T11:01:55.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.332+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=PTTLFXXBGOLG type=del size=3942946 2024-09-14T11:01:55.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.333+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=K0EDVATRBIGS type=write size=1012020 2024-09-14T11:01:55.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.335+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~0D7S60MXGCBL.0 size=1048576 2024-09-14T11:01:55.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.336+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~0D7S60MXGCBL.1 size=1048576 2024-09-14T11:01:55.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.337+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~0D7S60MXGCBL.2 size=408280 2024-09-14T11:01:55.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.337+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=0D7S60MXGCBL tag=5NCPJ0CMVP8A type=write size=3554008 2024-09-14T11:01:55.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.338+0000 7fe3dd11f780 1 < completed write operation key=IOAG4ZE1I58Z tag=7VYKFVD7WOYH type=write size=143279 2024-09-14T11:01:55.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.340+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=4O58MZNV4FH4 type=del size=1195656 2024-09-14T11:01:55.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.341+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~D7H3HM05UWWR.0 size=1048576 2024-09-14T11:01:55.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.341+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZI5SFHGWCHJA.2~D7H3HM05UWWR.1 size=259780 2024-09-14T11:01:55.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.343+0000 7fe3dd11f780 1 < canceled multipart upload key=ZI5SFHGWCHJA upload=D7H3HM05UWWR tag=G7EKSWT8XEZ9 type=write size=2356932 2024-09-14T11:01:55.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.344+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=Y75UW453KOLJ type=del size=32754 2024-09-14T11:01:55.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.345+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~U2WREO912LQY.0 size=697998 2024-09-14T11:01:55.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.347+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=U2WREO912LQY tag=AQITR26M1262 type=write size=1746574 2024-09-14T11:01:55.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.349+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~NK18FZ100X6K.0 size=1048576 2024-09-14T11:01:55.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.350+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~NK18FZ100X6K.1 size=377295 2024-09-14T11:01:55.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.350+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=NK18FZ100X6K tag=59I2PB5QTQA0 type=write size=2474447 2024-09-14T11:01:55.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.351+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~WKJ8ZCXZM179.0 size=1048576 2024-09-14T11:01:55.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.352+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~WKJ8ZCXZM179.1 size=756283 2024-09-14T11:01:55.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.354+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=WKJ8ZCXZM179 tag=FADO1HI4FRXM type=write size=2853435 2024-09-14T11:01:55.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.356+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~MQMRSWXPKP4Q.0 size=1048576 2024-09-14T11:01:55.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.357+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~MQMRSWXPKP4Q.1 size=46618 2024-09-14T11:01:55.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.357+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=MQMRSWXPKP4Q tag=3P3WKWYR2LEN type=write size=2143770 2024-09-14T11:01:55.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.359+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=SEYLW413Z19B type=del 2024-09-14T11:01:55.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.360+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=0AXYM364HDMM type=del size=1471552 2024-09-14T11:01:55.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.362+0000 7fe3dd11f780 1 < suggested update operation key=EGC5988RQOEZ tag=PIRBM137CISB type=del size=2586862 2024-09-14T11:01:55.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.363+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=KY2XR4C9LOZX type=del size=3665035 2024-09-14T11:01:55.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.364+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~JNFT73FFO1BM.0 size=1048576 2024-09-14T11:01:55.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.365+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~JNFT73FFO1BM.1 size=508247 2024-09-14T11:01:55.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.367+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=JNFT73FFO1BM tag=3NTXTEG8AQ76 type=write size=2605399 2024-09-14T11:01:55.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.370+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~Q4HWMD3N14N4.0 size=601314 2024-09-14T11:01:55.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.370+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=Q4HWMD3N14N4 tag=QVL7HU7B7RL4 type=write size=1649890 2024-09-14T11:01:55.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.371+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=6HPZR9YYXT0C type=del 2024-09-14T11:01:55.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.373+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~P1VPVSVM4GV5.0 size=1048576 2024-09-14T11:01:55.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.374+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~P1VPVSVM4GV5.1 size=991819 2024-09-14T11:01:55.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.374+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=P1VPVSVM4GV5 tag=KDP1SCXWQRRR type=write size=3088971 2024-09-14T11:01:55.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.376+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~UUGOXAIK2LBS.0 size=1048576 2024-09-14T11:01:55.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.376+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~UUGOXAIK2LBS.1 size=834 2024-09-14T11:01:55.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.379+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=UUGOXAIK2LBS tag=IKNENT28MYR2 type=write size=2097986 2024-09-14T11:01:55.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.381+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~UKLSR6BFO3BH.0 size=873396 2024-09-14T11:01:55.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.381+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=UKLSR6BFO3BH tag=3JKIKCQZOR68 type=write size=1921972 2024-09-14T11:01:55.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.382+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~YD1XAUTO2Y5X.0 size=1048576 2024-09-14T11:01:55.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.383+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~YD1XAUTO2Y5X.1 size=373504 2024-09-14T11:01:55.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.385+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=YD1XAUTO2Y5X tag=XOIX2UYEI12Z type=write size=2470656 2024-09-14T11:01:55.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.386+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=GIRUPS2UD3TJ type=del size=2592383 2024-09-14T11:01:55.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.387+0000 7fe3dd11f780 1 < completed write operation key=YXPZXFY8930D tag=6S4LII3FV9K5 type=write size=754340 2024-09-14T11:01:55.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.389+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=SRQCO3T6VNRT type=del size=1719775 2024-09-14T11:01:55.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.390+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~20VD8FLA5K6Q.0 size=1048576 2024-09-14T11:01:55.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.391+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~20VD8FLA5K6Q.1 size=181532 2024-09-14T11:01:55.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.393+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=20VD8FLA5K6Q tag=AUXII9XJBKW6 type=write size=2278684 2024-09-14T11:01:55.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.394+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=247QO5CN08RY type=del size=729143 2024-09-14T11:01:55.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.394+0000 7fe3dd11f780 1 < canceled part key=_multipart_M0DMAQ5LTDR0.2~BG47XL2LNXVR.0 size=78106 2024-09-14T11:01:55.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.396+0000 7fe3dd11f780 1 < canceled multipart upload key=M0DMAQ5LTDR0 upload=BG47XL2LNXVR tag=E2GC1Z48D57P type=write size=1126682 2024-09-14T11:01:55.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.398+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~3UBLDIWT792Z.0 size=1048576 2024-09-14T11:01:55.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.399+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~3UBLDIWT792Z.1 size=138805 2024-09-14T11:01:55.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.399+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=3UBLDIWT792Z tag=2B4YMDLBJNQT type=write size=2235957 2024-09-14T11:01:55.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.402+0000 7fe3dd11f780 1 < suggested remove operation key=6PJ03TAYRUT8 tag=2J0TTOKPA059 type=del 2024-09-14T11:01:55.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.403+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=BJEM6L2YYQNV type=del size=3338002 2024-09-14T11:01:55.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.404+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=PTTLFXXBGOLG type=del 2024-09-14T11:01:55.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.405+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=D8XSLUDGCR6T type=del size=2300189 2024-09-14T11:01:55.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.406+0000 7fe3dd11f780 1 < canceled part key=_multipart_LDILBET1CMYY.2~0D7S60MXGCBL.0 size=1048576 2024-09-14T11:01:55.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.407+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~0D7S60MXGCBL.1 size=1048576 2024-09-14T11:01:55.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.407+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~0D7S60MXGCBL.2 size=408280 2024-09-14T11:01:55.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.410+0000 7fe3dd11f780 1 < canceled multipart upload key=LDILBET1CMYY upload=0D7S60MXGCBL tag=5NCPJ0CMVP8A type=write size=3554008 2024-09-14T11:01:55.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.411+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=9H4EY4TZD9CB type=del size=1954801 2024-09-14T11:01:55.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.412+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=4O58MZNV4FH4 type=del 2024-09-14T11:01:55.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.414+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=5LN7P5ZPGJQ8 type=del size=2051806 2024-09-14T11:01:55.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.415+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=Y75UW453KOLJ type=del 2024-09-14T11:01:55.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.416+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=CPX0K5PUWJ64 type=del size=2689003 2024-09-14T11:01:55.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.416+0000 7fe3dd11f780 1 < canceled part key=_multipart_VDSOBBVO3QGB.2~NK18FZ100X6K.0 size=1048576 2024-09-14T11:01:55.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.418+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~NK18FZ100X6K.1 size=377295 2024-09-14T11:01:55.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.420+0000 7fe3dd11f780 1 < canceled multipart upload key=VDSOBBVO3QGB upload=NK18FZ100X6K tag=59I2PB5QTQA0 type=write size=2474447 2024-09-14T11:01:55.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.421+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=UTXGAXTL8GSD type=del size=238034 2024-09-14T11:01:55.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.422+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~MQMRSWXPKP4Q.0 size=1048576 2024-09-14T11:01:55.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.423+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~MQMRSWXPKP4Q.1 size=46618 2024-09-14T11:01:55.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.427+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=MQMRSWXPKP4Q tag=3P3WKWYR2LEN type=write size=2143770 2024-09-14T11:01:55.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.429+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~X848RIQ4W2RH.0 size=1048576 2024-09-14T11:01:55.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.430+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~X848RIQ4W2RH.1 size=137826 2024-09-14T11:01:55.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.430+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=X848RIQ4W2RH tag=8E48KIA2GHY8 type=write size=2234978 2024-09-14T11:01:55.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.433+0000 7fe3dd11f780 1 < suggested remove operation key=YMGE9GKLSPE6 tag=0AXYM364HDMM type=del 2024-09-14T11:01:55.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.434+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=7XPPJ3882HED type=del size=1253265 2024-09-14T11:01:55.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.437+0000 7fe3dd11f780 1 < suggested update operation key=KXL3E0PJBNBA tag=KY2XR4C9LOZX type=del size=3665035 2024-09-14T11:01:55.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.438+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=3HP92BP8DZC3 type=del size=2206408 2024-09-14T11:01:55.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.438+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~Q4HWMD3N14N4.0 size=601314 2024-09-14T11:01:55.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.441+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=Q4HWMD3N14N4 tag=QVL7HU7B7RL4 type=write size=1649890 2024-09-14T11:01:55.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.443+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~BJKD78IS277U.0 size=624940 2024-09-14T11:01:55.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.443+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=BJKD78IS277U tag=DA0877ITGXC6 type=write size=1673516 2024-09-14T11:01:55.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.444+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~P1VPVSVM4GV5.0 size=1048576 2024-09-14T11:01:55.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.445+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~P1VPVSVM4GV5.1 size=991819 2024-09-14T11:01:55.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.447+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=P1VPVSVM4GV5 tag=KDP1SCXWQRRR type=write size=3088971 2024-09-14T11:01:55.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.448+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=6FXDEK4L3P9Y type=del size=3531899 2024-09-14T11:01:55.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.449+0000 7fe3dd11f780 1 < canceled part key=_multipart_VDSOBBVO3QGB.2~UKLSR6BFO3BH.0 size=873396 2024-09-14T11:01:55.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.451+0000 7fe3dd11f780 1 < canceled multipart upload key=VDSOBBVO3QGB upload=UKLSR6BFO3BH tag=3JKIKCQZOR68 type=write size=1921972 2024-09-14T11:01:55.451 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.453+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~4278H2YTZ3FQ.0 size=15658 2024-09-14T11:01:55.451 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.453+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=4278H2YTZ3FQ tag=KHAL55KLAMSB type=write size=1064234 2024-09-14T11:01:55.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.455+0000 7fe3dd11f780 1 < suggested update operation key=NHKCRGX10WBM tag=GIRUPS2UD3TJ type=del size=2592383 2024-09-14T11:01:55.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.457+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~PML7LLJKMEJH.0 size=1048576 2024-09-14T11:01:55.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.458+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~PML7LLJKMEJH.1 size=1048576 2024-09-14T11:01:55.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.459+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~PML7LLJKMEJH.2 size=1038840 2024-09-14T11:01:55.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.459+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=PML7LLJKMEJH tag=IDL40VJ71RFN type=write size=4184568 2024-09-14T11:01:55.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.462+0000 7fe3dd11f780 1 < suggested remove operation key=JG1RZQD4J2EB tag=SRQCO3T6VNRT type=del 2024-09-14T11:01:55.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.463+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=I2A58G9XBGIV type=del size=3213182 2024-09-14T11:01:55.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.464+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=247QO5CN08RY type=del 2024-09-14T11:01:55.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.465+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=E9UP1913VHM0 type=write size=418974 2024-09-14T11:01:55.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.466+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~3UBLDIWT792Z.0 size=1048576 2024-09-14T11:01:55.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.467+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~3UBLDIWT792Z.1 size=138805 2024-09-14T11:01:55.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.469+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=3UBLDIWT792Z tag=2B4YMDLBJNQT type=write size=2235957 2024-09-14T11:01:55.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.470+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=3KXB71P431XR type=write size=49769 2024-09-14T11:01:55.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.472+0000 7fe3dd11f780 -1 < failed to complete operation key=KXL3E0PJBNBA tag=BJEM6L2YYQNV type=del size=3338002: (22) Invalid argument 2024-09-14T11:01:55.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.473+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=WVNHA2PWA3LJ type=del size=1248985 2024-09-14T11:01:55.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.474+0000 7fe3dd11f780 1 < canceled operation key=IOAG4ZE1I58Z tag=D8XSLUDGCR6T type=del size=2300189 2024-09-14T11:01:55.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.475+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=WO52VT24TDVC type=del size=2507510 2024-09-14T11:01:55.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.477+0000 7fe3dd11f780 1 < suggested remove operation key=OK5L92EKOOMW tag=9H4EY4TZD9CB type=del 2024-09-14T11:01:55.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.478+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=IM1M57YW9OFA type=del size=2590473 2024-09-14T11:01:55.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.480+0000 7fe3dd11f780 1 < canceled operation key=ODDNSHK5YMNO tag=5LN7P5ZPGJQ8 type=del size=2051806 2024-09-14T11:01:55.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.482+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Q8KK8DW4FKMJ.0 size=1048576 2024-09-14T11:01:55.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.483+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~Q8KK8DW4FKMJ.1 size=464529 2024-09-14T11:01:55.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.483+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=Q8KK8DW4FKMJ tag=REK6RIEI6XS8 type=write size=2561681 2024-09-14T11:01:55.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.484+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=CPX0K5PUWJ64 type=del 2024-09-14T11:01:55.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.485+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=BL48JGLSRQOF type=del size=3423133 2024-09-14T11:01:55.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.486+0000 7fe3dd11f780 -1 < failed to complete operation key=YMGE9GKLSPE6 tag=UTXGAXTL8GSD type=del size=238034: (22) Invalid argument 2024-09-14T11:01:55.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.488+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=MT322Y7WMFQB type=del size=1986488 2024-09-14T11:01:55.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.489+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~X848RIQ4W2RH.0 size=1048576 2024-09-14T11:01:55.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.490+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~X848RIQ4W2RH.1 size=137826 2024-09-14T11:01:55.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.492+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=X848RIQ4W2RH tag=8E48KIA2GHY8 type=write size=2234978 2024-09-14T11:01:55.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.494+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~PJWK20NSKATU.0 size=1048576 2024-09-14T11:01:55.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.495+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~PJWK20NSKATU.1 size=842794 2024-09-14T11:01:55.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.495+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=PJWK20NSKATU tag=QX6NACCWC13O type=write size=2939946 2024-09-14T11:01:55.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.496+0000 7fe3dd11f780 -1 < failed to complete operation key=OK5L92EKOOMW tag=7XPPJ3882HED type=del size=1253265: (22) Invalid argument 2024-09-14T11:01:55.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.498+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~WE4MY2D6QHLZ.0 size=1048576 2024-09-14T11:01:55.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.500+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~WE4MY2D6QHLZ.1 size=769766 2024-09-14T11:01:55.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.500+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=WE4MY2D6QHLZ tag=UPDRBWUDOP3G type=write size=2866918 2024-09-14T11:01:55.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.501+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=3HP92BP8DZC3 type=del 2024-09-14T11:01:55.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.503+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~1I5U8TE0S95V.0 size=1048576 2024-09-14T11:01:55.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.504+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~1I5U8TE0S95V.1 size=1048576 2024-09-14T11:01:55.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.505+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~1I5U8TE0S95V.2 size=372008 2024-09-14T11:01:55.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.505+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=1I5U8TE0S95V tag=FH4G0HAUSRC2 type=write size=3517736 2024-09-14T11:01:55.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.506+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~BJKD78IS277U.0 size=624940 2024-09-14T11:01:55.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.508+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=BJKD78IS277U tag=DA0877ITGXC6 type=write size=1673516 2024-09-14T11:01:55.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.509+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=M2EHNT2ZK3H4 type=del size=1292116 2024-09-14T11:01:55.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.511+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=6FXDEK4L3P9Y type=del 2024-09-14T11:01:55.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.512+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=BGFSIQ8ADFXK type=write size=948718 2024-09-14T11:01:55.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.514+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~4278H2YTZ3FQ.0 size=15658 2024-09-14T11:01:55.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.516+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=4278H2YTZ3FQ tag=KHAL55KLAMSB type=write size=1064234 2024-09-14T11:01:55.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.517+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=62L63YYP9OJ3 type=del size=3691334 2024-09-14T11:01:55.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.518+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~PML7LLJKMEJH.0 size=1048576 2024-09-14T11:01:55.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.519+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~PML7LLJKMEJH.1 size=1048576 2024-09-14T11:01:55.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.520+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~PML7LLJKMEJH.2 size=1038840 2024-09-14T11:01:55.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.522+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=PML7LLJKMEJH tag=IDL40VJ71RFN type=write size=4184568 2024-09-14T11:01:55.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.524+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~PP3UKT8W7VUJ.0 size=1048576 2024-09-14T11:01:55.523 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.525+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~PP3UKT8W7VUJ.1 size=1048576 2024-09-14T11:01:55.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.526+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~PP3UKT8W7VUJ.2 size=499264 2024-09-14T11:01:55.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.526+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=PP3UKT8W7VUJ tag=1P5K2X63YNYV type=write size=3644992 2024-09-14T11:01:55.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.528+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=I2A58G9XBGIV type=del 2024-09-14T11:01:55.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.530+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~HRZMLQMKAR18.0 size=701822 2024-09-14T11:01:55.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.530+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=HRZMLQMKAR18 tag=G2EKFK0KSK1N type=write size=1750398 2024-09-14T11:01:55.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.531+0000 7fe3dd11f780 1 < completed write operation key=YXPZXFY8930D tag=E9UP1913VHM0 type=write size=418974 2024-09-14T11:01:55.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.532+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=CNP6OH776SIE type=del size=1321010 2024-09-14T11:01:55.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.534+0000 7fe3dd11f780 1 < canceled operation key=6PJ03TAYRUT8 tag=3KXB71P431XR type=write size=49769 2024-09-14T11:01:55.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.535+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=13NVKQUG3SFN type=del size=2031874 2024-09-14T11:01:55.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.536+0000 7fe3dd11f780 1 < canceled operation key=QPH41U60044L tag=WVNHA2PWA3LJ type=del size=1248985 2024-09-14T11:01:55.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.538+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=03TUR33EMSFS type=write size=785599 2024-09-14T11:01:55.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.539+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=WO52VT24TDVC type=del 2024-09-14T11:01:55.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.541+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=DPDDTBCFN9BP type=write size=634496 2024-09-14T11:01:55.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.542+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=IM1M57YW9OFA type=del 2024-09-14T11:01:55.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.544+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=HU7QCS797BIS type=del size=253438 2024-09-14T11:01:55.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.545+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~Q8KK8DW4FKMJ.0 size=1048576 2024-09-14T11:01:55.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.545+0000 7fe3dd11f780 1 < canceled part key=_multipart_UYZGHGZR74HQ.2~Q8KK8DW4FKMJ.1 size=464529 2024-09-14T11:01:55.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.547+0000 7fe3dd11f780 1 < canceled multipart upload key=UYZGHGZR74HQ upload=Q8KK8DW4FKMJ tag=REK6RIEI6XS8 type=write size=2561681 2024-09-14T11:01:55.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.549+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~8UHQST1ONWHE.0 size=1048576 2024-09-14T11:01:55.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.550+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~8UHQST1ONWHE.1 size=387206 2024-09-14T11:01:55.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.550+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=8UHQST1ONWHE tag=R23VBWK91N3Q type=write size=2484358 2024-09-14T11:01:55.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.551+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=BL48JGLSRQOF type=del 2024-09-14T11:01:55.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.553+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~POPKSGVT4Q61.0 size=1048576 2024-09-14T11:01:55.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.554+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~POPKSGVT4Q61.1 size=1048576 2024-09-14T11:01:55.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.555+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~POPKSGVT4Q61.2 size=602159 2024-09-14T11:01:55.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.555+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=POPKSGVT4Q61 tag=MT327W5A4EEY type=write size=3747887 2024-09-14T11:01:55.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.557+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=MT322Y7WMFQB type=del 2024-09-14T11:01:55.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.558+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=3YH4RVLH9OZQ type=del size=1789455 2024-09-14T11:01:55.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.559+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~PJWK20NSKATU.0 size=1048576 2024-09-14T11:01:55.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.559+0000 7fe3dd11f780 1 < canceled part key=_multipart_3PS4LAML698X.2~PJWK20NSKATU.1 size=842794 2024-09-14T11:01:55.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.561+0000 7fe3dd11f780 1 < canceled multipart upload key=3PS4LAML698X upload=PJWK20NSKATU tag=QX6NACCWC13O type=write size=2939946 2024-09-14T11:01:55.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.563+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~PZPRM4M01AR9.0 size=1048576 2024-09-14T11:01:55.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.564+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~PZPRM4M01AR9.1 size=873282 2024-09-14T11:01:55.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.564+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=PZPRM4M01AR9 tag=58RKWZI7ENK6 type=write size=2970434 2024-09-14T11:01:55.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.565+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~WE4MY2D6QHLZ.0 size=1048576 2024-09-14T11:01:55.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.565+0000 7fe3dd11f780 1 < canceled part key=_multipart_YXPZXFY8930D.2~WE4MY2D6QHLZ.1 size=769766 2024-09-14T11:01:55.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.567+0000 7fe3dd11f780 1 < canceled multipart upload key=YXPZXFY8930D upload=WE4MY2D6QHLZ tag=UPDRBWUDOP3G type=write size=2866918 2024-09-14T11:01:55.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.569+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=NBLML09L0FMH type=del size=18728 2024-09-14T11:01:55.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.570+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~1I5U8TE0S95V.0 size=1048576 2024-09-14T11:01:55.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.571+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~1I5U8TE0S95V.1 size=1048576 2024-09-14T11:01:55.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.572+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~1I5U8TE0S95V.2 size=372008 2024-09-14T11:01:55.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.574+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=1I5U8TE0S95V tag=FH4G0HAUSRC2 type=write size=3517736 2024-09-14T11:01:55.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.576+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~ZN2NZ0DAJPTR.0 size=1048576 2024-09-14T11:01:55.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.577+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~ZN2NZ0DAJPTR.1 size=676403 2024-09-14T11:01:55.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.577+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=ZN2NZ0DAJPTR tag=UDQYUG1WVEQP type=write size=2773555 2024-09-14T11:01:55.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.579+0000 7fe3dd11f780 1 < suggested remove operation key=A89YQO40BHUS tag=M2EHNT2ZK3H4 type=del 2024-09-14T11:01:55.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.582+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FPP3FKAA52PB.0 size=1048576 2024-09-14T11:01:55.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.582+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~FPP3FKAA52PB.1 size=90611 2024-09-14T11:01:55.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.582+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=FPP3FKAA52PB tag=RPGL3MXFNQV9 type=write size=2187763 2024-09-14T11:01:55.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.584+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=BGFSIQ8ADFXK type=write size=948718 2024-09-14T11:01:55.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.585+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=HT9Z6CUYDUZC type=write size=1017450 2024-09-14T11:01:55.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.586+0000 7fe3dd11f780 1 < canceled operation key=ODDNSHK5YMNO tag=62L63YYP9OJ3 type=del size=3691334 2024-09-14T11:01:55.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.587+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=8Z74XJKKJKUG type=del size=944768 2024-09-14T11:01:55.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.588+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~PP3UKT8W7VUJ.0 size=1048576 2024-09-14T11:01:55.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.589+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~PP3UKT8W7VUJ.1 size=1048576 2024-09-14T11:01:55.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.590+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~PP3UKT8W7VUJ.2 size=499264 2024-09-14T11:01:55.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.592+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=PP3UKT8W7VUJ tag=1P5K2X63YNYV type=write size=3644992 2024-09-14T11:01:55.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.593+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=UT6GI6I28CXR type=del size=409686 2024-09-14T11:01:55.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.594+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~HRZMLQMKAR18.0 size=701822 2024-09-14T11:01:55.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.596+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=HRZMLQMKAR18 tag=G2EKFK0KSK1N type=write size=1750398 2024-09-14T11:01:55.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.597+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=DRCG2XOE2XSJ type=write size=582661 2024-09-14T11:01:55.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.600+0000 7fe3dd11f780 1 < suggested remove operation key=K9BP30LHDPA1 tag=CNP6OH776SIE type=del 2024-09-14T11:01:55.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.601+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=AGFQS2PHYSBK type=del size=3822628 2024-09-14T11:01:55.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.602+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=13NVKQUG3SFN type=del 2024-09-14T11:01:55.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.604+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=578KTPJR27HL type=del size=2010977 2024-09-14T11:01:55.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.605+0000 7fe3dd11f780 1 < completed write operation key=22TI1VCDTK5P tag=03TUR33EMSFS type=write size=785599 2024-09-14T11:01:55.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.606+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=H2HBJXM9AX77 type=del size=1523418 2024-09-14T11:01:55.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.607+0000 7fe3dd11f780 1 < completed write operation key=MD0OU8IC5PYI tag=DPDDTBCFN9BP type=write size=634496 2024-09-14T11:01:55.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.609+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~6SGTBHRZ0QRV.0 size=1048576 2024-09-14T11:01:55.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.610+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~6SGTBHRZ0QRV.1 size=1048576 2024-09-14T11:01:55.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.611+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~6SGTBHRZ0QRV.2 size=161918 2024-09-14T11:01:55.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.611+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=6SGTBHRZ0QRV tag=GZI1Y1VMLIIT type=write size=3307646 2024-09-14T11:01:55.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.613+0000 7fe3dd11f780 1 < suggested update operation key=US8KP3YL88TG tag=HU7QCS797BIS type=del size=253438 2024-09-14T11:01:55.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.614+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=XQQJTNULGZ5Z type=del size=1775260 2024-09-14T11:01:55.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.615+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~8UHQST1ONWHE.0 size=1048576 2024-09-14T11:01:55.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.616+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~8UHQST1ONWHE.1 size=387206 2024-09-14T11:01:55.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.618+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=8UHQST1ONWHE tag=R23VBWK91N3Q type=write size=2484358 2024-09-14T11:01:55.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.619+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=KTM8XTZZD33K type=del size=2812046 2024-09-14T11:01:55.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.620+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~POPKSGVT4Q61.0 size=1048576 2024-09-14T11:01:55.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.620+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~POPKSGVT4Q61.1 size=1048576 2024-09-14T11:01:55.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.621+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~POPKSGVT4Q61.2 size=602159 2024-09-14T11:01:55.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.623+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=POPKSGVT4Q61 tag=MT327W5A4EEY type=write size=3747887 2024-09-14T11:01:55.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.624+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=5S3D4C2TY40N type=del size=173931 2024-09-14T11:01:55.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.625+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=3YH4RVLH9OZQ type=del 2024-09-14T11:01:55.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.626+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=FWKYGWC8MKZU type=del size=4103262 2024-09-14T11:01:55.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.627+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~PZPRM4M01AR9.0 size=1048576 2024-09-14T11:01:55.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.628+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~PZPRM4M01AR9.1 size=873282 2024-09-14T11:01:55.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.630+0000 7fe3dd11f780 1 < canceled multipart upload key=LL9VJXEU13IK upload=PZPRM4M01AR9 tag=58RKWZI7ENK6 type=write size=2970434 2024-09-14T11:01:55.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.632+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~QVR0LO0EMIET.0 size=270482 2024-09-14T11:01:55.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.632+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=QVR0LO0EMIET tag=Q7U74OFIEAST type=write size=1319058 2024-09-14T11:01:55.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.634+0000 7fe3dd11f780 1 < suggested remove operation key=MD0OU8IC5PYI tag=NBLML09L0FMH type=del 2024-09-14T11:01:55.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.635+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=VU9H2RNZT1ZH type=del size=3092768 2024-09-14T11:01:55.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.636+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~ZN2NZ0DAJPTR.0 size=1048576 2024-09-14T11:01:55.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.637+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~ZN2NZ0DAJPTR.1 size=676403 2024-09-14T11:01:55.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.639+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=ZN2NZ0DAJPTR tag=UDQYUG1WVEQP type=write size=2773555 2024-09-14T11:01:55.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.640+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=4KAM0L75F18A type=del size=2901526 2024-09-14T11:01:55.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.641+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~FPP3FKAA52PB.0 size=1048576 2024-09-14T11:01:55.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.642+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~FPP3FKAA52PB.1 size=90611 2024-09-14T11:01:55.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.644+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=FPP3FKAA52PB tag=RPGL3MXFNQV9 type=write size=2187763 2024-09-14T11:01:55.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.645+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=2DIGS1JF36XP type=del size=1175693 2024-09-14T11:01:55.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.646+0000 7fe3dd11f780 1 < completed write operation key=OK5L92EKOOMW tag=HT9Z6CUYDUZC type=write size=1017450 2024-09-14T11:01:55.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.649+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~XXBEGAD64E3P.0 size=1048576 2024-09-14T11:01:55.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.650+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~XXBEGAD64E3P.1 size=1048576 2024-09-14T11:01:55.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.651+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~XXBEGAD64E3P.2 size=353264 2024-09-14T11:01:55.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.651+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=XXBEGAD64E3P tag=NDF5R2AG8QNI type=write size=3498992 2024-09-14T11:01:55.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.653+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=8Z74XJKKJKUG type=del 2024-09-14T11:01:55.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.654+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=7ZTED6LQJRSB type=write size=306747 2024-09-14T11:01:55.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.655+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=UT6GI6I28CXR type=del 2024-09-14T11:01:55.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.656+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=L8ZMSYMS0008 type=del size=682968 2024-09-14T11:01:55.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.658+0000 7fe3dd11f780 1 < completed write operation key=KXL3E0PJBNBA tag=DRCG2XOE2XSJ type=write size=582661 2024-09-14T11:01:55.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.659+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=8F30UMVL95XS type=del size=2459379 2024-09-14T11:01:55.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.660+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=AGFQS2PHYSBK type=del 2024-09-14T11:01:55.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.662+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~DWWS9F2HR0LR.0 size=172198 2024-09-14T11:01:55.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.662+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=DWWS9F2HR0LR tag=Z20IJZX06FDR type=write size=1220774 2024-09-14T11:01:55.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.665+0000 7fe3dd11f780 1 < suggested remove operation key=M0DMAQ5LTDR0 tag=578KTPJR27HL type=del 2024-09-14T11:01:55.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.666+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=75CKP02406W4 type=del size=168494 2024-09-14T11:01:55.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.667+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=H2HBJXM9AX77 type=del 2024-09-14T11:01:55.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.668+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=5C8NE9STVNB1 type=write size=909788 2024-09-14T11:01:55.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.670+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~6SGTBHRZ0QRV.0 size=1048576 2024-09-14T11:01:55.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.671+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~6SGTBHRZ0QRV.1 size=1048576 2024-09-14T11:01:55.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.671+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~6SGTBHRZ0QRV.2 size=161918 2024-09-14T11:01:55.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.673+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=6SGTBHRZ0QRV tag=GZI1Y1VMLIIT type=write size=3307646 2024-09-14T11:01:55.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.675+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=G6UJ5MWFA9OU type=del size=2905283 2024-09-14T11:01:55.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.676+0000 7fe3dd11f780 1 < canceled operation key=IOAG4ZE1I58Z tag=XQQJTNULGZ5Z type=del size=1775260 2024-09-14T11:01:55.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.677+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=QOEVI4LB1XR7 type=del size=3958706 2024-09-14T11:01:55.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.679+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=KTM8XTZZD33K type=del 2024-09-14T11:01:55.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.681+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~8DA6AC5P9QO4.0 size=807677 2024-09-14T11:01:55.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.681+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=8DA6AC5P9QO4 tag=4OJXMZDV1CXJ type=write size=1856253 2024-09-14T11:01:55.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.682+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=5S3D4C2TY40N type=del 2024-09-14T11:01:55.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.683+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=PFEQ7VXFJ6SX type=del size=293065 2024-09-14T11:01:55.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.685+0000 7fe3dd11f780 1 < canceled operation key=GQEFQ1UD6QCJ tag=FWKYGWC8MKZU type=del size=4103262 2024-09-14T11:01:55.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.687+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~EG4WO7NYF697.0 size=1048576 2024-09-14T11:01:55.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.688+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~EG4WO7NYF697.1 size=1048576 2024-09-14T11:01:55.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.689+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~EG4WO7NYF697.2 size=545270 2024-09-14T11:01:55.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.689+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=EG4WO7NYF697 tag=TZI5O35WMMWN type=write size=3690998 2024-09-14T11:01:55.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.690+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~QVR0LO0EMIET.0 size=270482 2024-09-14T11:01:55.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.692+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=QVR0LO0EMIET tag=Q7U74OFIEAST type=write size=1319058 2024-09-14T11:01:55.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.693+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=DBXQ3AM20V6I type=del size=3069998 2024-09-14T11:01:55.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.694+0000 7fe3dd11f780 -1 < failed to complete operation key=M0DMAQ5LTDR0 tag=VU9H2RNZT1ZH type=del size=3092768: (22) Invalid argument 2024-09-14T11:01:55.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.696+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=8NTEDPCJKTYI type=del size=2312696 2024-09-14T11:01:55.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.698+0000 7fe3dd11f780 1 < suggested update operation key=YMGE9GKLSPE6 tag=4KAM0L75F18A type=del size=2901526 2024-09-14T11:01:55.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.699+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=JRL0ISA5KH4M type=del size=3909215 2024-09-14T11:01:55.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.700+0000 7fe3dd11f780 1 < canceled operation key=A89YQO40BHUS tag=2DIGS1JF36XP type=del size=1175693 2024-09-14T11:01:55.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.701+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=WOEUZ784VWZ1 type=del size=4185895 2024-09-14T11:01:55.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.703+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~XXBEGAD64E3P.0 size=1048576 2024-09-14T11:01:55.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.704+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~XXBEGAD64E3P.1 size=1048576 2024-09-14T11:01:55.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.704+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~XXBEGAD64E3P.2 size=353264 2024-09-14T11:01:55.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.706+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=XXBEGAD64E3P tag=NDF5R2AG8QNI type=write size=3498992 2024-09-14T11:01:55.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.708+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~CWD3NWEWPFBI.0 size=1048576 2024-09-14T11:01:55.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.709+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~CWD3NWEWPFBI.1 size=735896 2024-09-14T11:01:55.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.709+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=CWD3NWEWPFBI tag=IG088BRL033K type=write size=2833048 2024-09-14T11:01:55.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.712+0000 7fe3dd11f780 1 < suggested update operation key=GQEFQ1UD6QCJ tag=7ZTED6LQJRSB type=write size=306747 2024-09-14T11:01:55.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.713+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=NUKXLHEMPXBX type=del size=3415979 2024-09-14T11:01:55.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.714+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=L8ZMSYMS0008 type=del 2024-09-14T11:01:55.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.716+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=ON2TRUN4RV7P type=del size=3176166 2024-09-14T11:01:55.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.717+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=8F30UMVL95XS type=del 2024-09-14T11:01:55.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.718+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=4G8FGKSHCXHR type=del size=1091779 2024-09-14T11:01:55.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.719+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~DWWS9F2HR0LR.0 size=172198 2024-09-14T11:01:55.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.721+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=DWWS9F2HR0LR tag=Z20IJZX06FDR type=write size=1220774 2024-09-14T11:01:55.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.723+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=AD00TQM38BQF type=del size=3832459 2024-09-14T11:01:55.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.724+0000 7fe3dd11f780 1 < canceled operation key=ODDNSHK5YMNO tag=75CKP02406W4 type=del size=168494 2024-09-14T11:01:55.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.725+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=LCIGWG1UMC1A type=del size=892413 2024-09-14T11:01:55.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.726+0000 7fe3dd11f780 -1 < failed to complete operation key=GQEFQ1UD6QCJ tag=5C8NE9STVNB1 type=write size=909788: (22) Invalid argument 2024-09-14T11:01:55.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.727+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=WOWIYDLGL4WV type=del size=968155 2024-09-14T11:01:55.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.729+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=G6UJ5MWFA9OU type=del 2024-09-14T11:01:55.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.731+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~KQWTV0URROGX.0 size=1048576 2024-09-14T11:01:55.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.732+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~KQWTV0URROGX.1 size=413726 2024-09-14T11:01:55.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.732+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=KQWTV0URROGX tag=ZLPJODFLJFDW type=write size=2510878 2024-09-14T11:01:55.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.733+0000 7fe3dd11f780 -1 < failed to complete operation key=YMGE9GKLSPE6 tag=QOEVI4LB1XR7 type=del size=3958706: (22) Invalid argument 2024-09-14T11:01:55.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.735+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~SJWQH21L778P.0 size=835408 2024-09-14T11:01:55.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.735+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=SJWQH21L778P tag=PHQWYM6W1E80 type=write size=1883984 2024-09-14T11:01:55.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.737+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~8DA6AC5P9QO4.0 size=807677 2024-09-14T11:01:55.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.739+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=8DA6AC5P9QO4 tag=4OJXMZDV1CXJ type=write size=1856253 2024-09-14T11:01:55.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.741+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~4WDUIEHQY4YJ.0 size=295295 2024-09-14T11:01:55.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.741+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=4WDUIEHQY4YJ tag=UHRFY7NH3EVP type=write size=1343871 2024-09-14T11:01:55.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.742+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=PFEQ7VXFJ6SX type=del 2024-09-14T11:01:55.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.743+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=WEG0A3MI4TYA type=del size=2846334 2024-09-14T11:01:55.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.744+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~EG4WO7NYF697.0 size=1048576 2024-09-14T11:01:55.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.745+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~EG4WO7NYF697.1 size=1048576 2024-09-14T11:01:55.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.746+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~EG4WO7NYF697.2 size=545270 2024-09-14T11:01:55.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.748+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=EG4WO7NYF697 tag=TZI5O35WMMWN type=write size=3690998 2024-09-14T11:01:55.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.749+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=07JGUY9DCVKG type=write size=156528 2024-09-14T11:01:55.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.751+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=DBXQ3AM20V6I type=del 2024-09-14T11:01:55.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.753+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~GDNLDJDDY06F.0 size=1048576 2024-09-14T11:01:55.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.754+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~GDNLDJDDY06F.1 size=1048576 2024-09-14T11:01:55.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.755+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~GDNLDJDDY06F.2 size=773340 2024-09-14T11:01:55.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.755+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=GDNLDJDDY06F tag=H28BWCN241DF type=write size=3919068 2024-09-14T11:01:55.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.756+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=8NTEDPCJKTYI type=del 2024-09-14T11:01:55.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.757+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=Q92T8HG27S8K type=del size=935223 2024-09-14T11:01:55.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.760+0000 7fe3dd11f780 1 < suggested remove operation key=M0DMAQ5LTDR0 tag=JRL0ISA5KH4M type=del 2024-09-14T11:01:55.760 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.762+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~F349X6IP05WK.0 size=1048576 2024-09-14T11:01:55.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.765+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~F349X6IP05WK.1 size=797823 2024-09-14T11:01:55.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.765+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=F349X6IP05WK tag=NBSC1BJGG3AW type=write size=2894975 2024-09-14T11:01:55.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.767+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=WOEUZ784VWZ1 type=del 2024-09-14T11:01:55.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.769+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~F8IAUYD7ECTK.0 size=766779 2024-09-14T11:01:55.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.769+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=F8IAUYD7ECTK tag=4MKPKUXUGDV9 type=write size=1815355 2024-09-14T11:01:55.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.770+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~CWD3NWEWPFBI.0 size=1048576 2024-09-14T11:01:55.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.771+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~CWD3NWEWPFBI.1 size=735896 2024-09-14T11:01:55.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.773+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=CWD3NWEWPFBI tag=IG088BRL033K type=write size=2833048 2024-09-14T11:01:55.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.776+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~0N529YTR3ANM.0 size=1048576 2024-09-14T11:01:55.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.777+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~0N529YTR3ANM.1 size=332695 2024-09-14T11:01:55.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.777+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=0N529YTR3ANM tag=HWP3T7BWV34U type=write size=2429847 2024-09-14T11:01:55.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.778+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=NUKXLHEMPXBX type=del 2024-09-14T11:01:55.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.779+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=JOS09XLVWILL type=del size=2496330 2024-09-14T11:01:55.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.781+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=ON2TRUN4RV7P type=del 2024-09-14T11:01:55.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.782+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=EO8UBVBQEFV3 type=del size=1131345 2024-09-14T11:01:55.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.783+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=4G8FGKSHCXHR type=del 2024-09-14T11:01:55.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.786+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~LGWATKIM0HP8.0 size=1043412 2024-09-14T11:01:55.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.786+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=LGWATKIM0HP8 tag=ADZLQVSBCHVY type=write size=2091988 2024-09-14T11:01:55.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.787+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=AD00TQM38BQF type=del 2024-09-14T11:01:55.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.789+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~5M925GI4RGLY.0 size=598009 2024-09-14T11:01:55.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.789+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=5M925GI4RGLY tag=CNCVS4I0ILUC type=write size=1646585 2024-09-14T11:01:55.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.792+0000 7fe3dd11f780 1 < suggested update operation key=LDILBET1CMYY tag=LCIGWG1UMC1A type=del size=892413 2024-09-14T11:01:55.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.794+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~8S6CMU5JQUM6.0 size=1048576 2024-09-14T11:01:55.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.795+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~8S6CMU5JQUM6.1 size=529965 2024-09-14T11:01:55.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.795+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=8S6CMU5JQUM6 tag=4CL524K6C118 type=write size=2627117 2024-09-14T11:01:55.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.796+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=WOWIYDLGL4WV type=del 2024-09-14T11:01:55.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.798+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~ESON6H3V8HOK.0 size=1048576 2024-09-14T11:01:55.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.799+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~ESON6H3V8HOK.1 size=1048576 2024-09-14T11:01:55.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.800+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~ESON6H3V8HOK.2 size=960768 2024-09-14T11:01:55.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.800+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=ESON6H3V8HOK tag=8JXOYQOBB1F8 type=write size=4106496 2024-09-14T11:01:55.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.800+0000 7fe3dd11f780 1 < canceled part key=_multipart_6PJ03TAYRUT8.2~KQWTV0URROGX.0 size=1048576 2024-09-14T11:01:55.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.802+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~KQWTV0URROGX.1 size=413726 2024-09-14T11:01:55.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.804+0000 7fe3dd11f780 1 < canceled multipart upload key=6PJ03TAYRUT8 upload=KQWTV0URROGX tag=ZLPJODFLJFDW type=write size=2510878 2024-09-14T11:01:55.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.805+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=3MD8TX7QOOFH type=del size=1954197 2024-09-14T11:01:55.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.806+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~SJWQH21L778P.0 size=835408 2024-09-14T11:01:55.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.808+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=SJWQH21L778P tag=PHQWYM6W1E80 type=write size=1883984 2024-09-14T11:01:55.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.809+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=638ED3J85YU8 type=del size=1981434 2024-09-14T11:01:55.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.811+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~4WDUIEHQY4YJ.0 size=295295 2024-09-14T11:01:55.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.812+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=4WDUIEHQY4YJ tag=UHRFY7NH3EVP type=write size=1343871 2024-09-14T11:01:55.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.815+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~7TCQ282Z9I2G.0 size=1004732 2024-09-14T11:01:55.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.815+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=7TCQ282Z9I2G tag=EWRG327D0Y36 type=write size=2053308 2024-09-14T11:01:55.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.816+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=WEG0A3MI4TYA type=del 2024-09-14T11:01:55.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.817+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=KAIY9V5LOYWT type=del size=3723766 2024-09-14T11:01:55.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.818+0000 7fe3dd11f780 1 < completed write operation key=A89YQO40BHUS tag=07JGUY9DCVKG type=write size=156528 2024-09-14T11:01:55.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.819+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=NZXCN3ILVIJT type=del size=3309648 2024-09-14T11:01:55.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.821+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~GDNLDJDDY06F.0 size=1048576 2024-09-14T11:01:55.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.822+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~GDNLDJDDY06F.1 size=1048576 2024-09-14T11:01:55.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.823+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~GDNLDJDDY06F.2 size=773340 2024-09-14T11:01:55.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.825+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=GDNLDJDDY06F tag=H28BWCN241DF type=write size=3919068 2024-09-14T11:01:55.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.827+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~PA6UB47QK22G.0 size=1048576 2024-09-14T11:01:55.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.828+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~PA6UB47QK22G.1 size=895992 2024-09-14T11:01:55.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.828+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=PA6UB47QK22G tag=6NGZHDJ6TOWD type=write size=2993144 2024-09-14T11:01:55.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.829+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=Q92T8HG27S8K type=del 2024-09-14T11:01:55.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.830+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=ACOSW3XX02E7 type=del size=489584 2024-09-14T11:01:55.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.832+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~F349X6IP05WK.0 size=1048576 2024-09-14T11:01:55.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.833+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~F349X6IP05WK.1 size=797823 2024-09-14T11:01:55.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.835+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=F349X6IP05WK tag=NBSC1BJGG3AW type=write size=2894975 2024-09-14T11:01:55.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.837+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0PDKLSIMMDND.0 size=1048576 2024-09-14T11:01:55.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.838+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0PDKLSIMMDND.1 size=1048576 2024-09-14T11:01:55.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.839+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0PDKLSIMMDND.2 size=255824 2024-09-14T11:01:55.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.839+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=0PDKLSIMMDND tag=JR9Z303DJHM1 type=write size=3401552 2024-09-14T11:01:55.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.840+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~F8IAUYD7ECTK.0 size=766779 2024-09-14T11:01:55.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.842+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=F8IAUYD7ECTK tag=4MKPKUXUGDV9 type=write size=1815355 2024-09-14T11:01:55.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.843+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=3TORRKEE1M5M type=del size=2138719 2024-09-14T11:01:55.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.844+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~0N529YTR3ANM.0 size=1048576 2024-09-14T11:01:55.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.845+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~0N529YTR3ANM.1 size=332695 2024-09-14T11:01:55.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.847+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=0N529YTR3ANM tag=HWP3T7BWV34U type=write size=2429847 2024-09-14T11:01:55.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.850+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~LM5DO3Y34L9J.0 size=1048576 2024-09-14T11:01:55.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.850+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~LM5DO3Y34L9J.1 size=369181 2024-09-14T11:01:55.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.850+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=LM5DO3Y34L9J tag=QMFZT1AT5NWL type=write size=2466333 2024-09-14T11:01:55.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.852+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=JOS09XLVWILL type=del 2024-09-14T11:01:55.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.853+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=JVQ4V0J12G0S type=del size=1200700 2024-09-14T11:01:55.852 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.854+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=EO8UBVBQEFV3 type=del 2024-09-14T11:01:55.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.855+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=KGHMELT6K0AX type=del size=2503294 2024-09-14T11:01:55.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.856+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~LGWATKIM0HP8.0 size=1043412 2024-09-14T11:01:55.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.858+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=LGWATKIM0HP8 tag=ADZLQVSBCHVY type=write size=2091988 2024-09-14T11:01:55.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.861+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~3B5T0DXVNLHK.0 size=333004 2024-09-14T11:01:55.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.861+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=3B5T0DXVNLHK tag=ECYJCQLZ7WD8 type=write size=1381580 2024-09-14T11:01:55.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.862+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~5M925GI4RGLY.0 size=598009 2024-09-14T11:01:55.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.864+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=5M925GI4RGLY tag=CNCVS4I0ILUC type=write size=1646585 2024-09-14T11:01:55.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.866+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~SE9ZXI8KFYGS.0 size=507111 2024-09-14T11:01:55.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.866+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=SE9ZXI8KFYGS tag=QXI93WI402RS type=write size=1555687 2024-09-14T11:01:55.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.867+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~8S6CMU5JQUM6.0 size=1048576 2024-09-14T11:01:55.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.868+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~8S6CMU5JQUM6.1 size=529965 2024-09-14T11:01:55.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.870+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=8S6CMU5JQUM6 tag=4CL524K6C118 type=write size=2627117 2024-09-14T11:01:55.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.871+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=WHR57BZQNMU3 type=del size=1519415 2024-09-14T11:01:55.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.872+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~ESON6H3V8HOK.0 size=1048576 2024-09-14T11:01:55.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.873+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~ESON6H3V8HOK.1 size=1048576 2024-09-14T11:01:55.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.874+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~ESON6H3V8HOK.2 size=960768 2024-09-14T11:01:55.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.878+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=ESON6H3V8HOK tag=8JXOYQOBB1F8 type=write size=4106496 2024-09-14T11:01:55.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.879+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=6PAT9FI9OB06 type=del size=939822 2024-09-14T11:01:55.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.880+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=3MD8TX7QOOFH type=del 2024-09-14T11:01:55.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.881+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=HN10QGX9CE9E type=del size=2128535 2024-09-14T11:01:55.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.882+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=638ED3J85YU8 type=del 2024-09-14T11:01:55.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.884+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=KD7DJXGV2XB6 type=del size=3401357 2024-09-14T11:01:55.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.885+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~7TCQ282Z9I2G.0 size=1004732 2024-09-14T11:01:55.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.887+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=7TCQ282Z9I2G tag=EWRG327D0Y36 type=write size=2053308 2024-09-14T11:01:55.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.889+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~D13I236VHU5G.0 size=1886 2024-09-14T11:01:55.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.889+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=D13I236VHU5G tag=TAXC0P1ZI18I type=write size=1050462 2024-09-14T11:01:55.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.890+0000 7fe3dd11f780 1 < canceled operation key=JFLEJGPFLACM tag=KAIY9V5LOYWT type=del size=3723766 2024-09-14T11:01:55.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.891+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=AHP3I3DN5HZE type=write size=252985 2024-09-14T11:01:55.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.893+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=NZXCN3ILVIJT type=del 2024-09-14T11:01:55.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.894+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=SFIF0WRI9PDI type=del size=3254673 2024-09-14T11:01:55.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.895+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~PA6UB47QK22G.0 size=1048576 2024-09-14T11:01:55.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.896+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~PA6UB47QK22G.1 size=895992 2024-09-14T11:01:55.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.898+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=PA6UB47QK22G tag=6NGZHDJ6TOWD type=write size=2993144 2024-09-14T11:01:55.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.900+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~JLJQEYJF37D7.0 size=1048576 2024-09-14T11:01:55.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.901+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~JLJQEYJF37D7.1 size=871451 2024-09-14T11:01:55.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.901+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=JLJQEYJF37D7 tag=QJGIP578UBU0 type=write size=2968603 2024-09-14T11:01:55.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.904+0000 7fe3dd11f780 1 < suggested remove operation key=QPH41U60044L tag=ACOSW3XX02E7 type=del 2024-09-14T11:01:55.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.905+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=AIPRTHZWGTF2 type=del size=3646124 2024-09-14T11:01:55.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.906+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~0PDKLSIMMDND.0 size=1048576 2024-09-14T11:01:55.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.906+0000 7fe3dd11f780 1 < canceled part key=_multipart_V692HUUJP2RC.2~0PDKLSIMMDND.1 size=1048576 2024-09-14T11:01:55.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.907+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~0PDKLSIMMDND.2 size=255824 2024-09-14T11:01:55.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.909+0000 7fe3dd11f780 1 < canceled multipart upload key=V692HUUJP2RC upload=0PDKLSIMMDND tag=JR9Z303DJHM1 type=write size=3401552 2024-09-14T11:01:55.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.912+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~66GM664BRIXF.0 size=1048576 2024-09-14T11:01:55.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.913+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~66GM664BRIXF.1 size=963852 2024-09-14T11:01:55.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.913+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=66GM664BRIXF tag=H25O2KUOCVE9 type=write size=3061004 2024-09-14T11:01:55.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.914+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=3TORRKEE1M5M type=del 2024-09-14T11:01:55.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.916+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~3I6YMJZ2VTGQ.0 size=136909 2024-09-14T11:01:55.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.916+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=3I6YMJZ2VTGQ tag=EHQHPXVFDXU9 type=write size=1185485 2024-09-14T11:01:55.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.916+0000 7fe3dd11f780 1 < canceled part key=_multipart_YXPZXFY8930D.2~LM5DO3Y34L9J.0 size=1048576 2024-09-14T11:01:55.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.917+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~LM5DO3Y34L9J.1 size=369181 2024-09-14T11:01:55.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.920+0000 7fe3dd11f780 1 < canceled multipart upload key=YXPZXFY8930D upload=LM5DO3Y34L9J tag=QMFZT1AT5NWL type=write size=2466333 2024-09-14T11:01:55.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.921+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=JORCO5U0RDUK type=write size=1045950 2024-09-14T11:01:55.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.922+0000 7fe3dd11f780 1 < canceled operation key=ZTD98WQ6032X tag=JVQ4V0J12G0S type=del size=1200700 2024-09-14T11:01:55.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.923+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=1JUKZC4D3U9Q type=del size=1961298 2024-09-14T11:01:55.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.925+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=KGHMELT6K0AX type=del 2024-09-14T11:01:55.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.926+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=3B2ZNNC3RQM1 type=del size=1140097 2024-09-14T11:01:55.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.927+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~3B5T0DXVNLHK.0 size=333004 2024-09-14T11:01:55.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.929+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=3B5T0DXVNLHK tag=ECYJCQLZ7WD8 type=write size=1381580 2024-09-14T11:01:55.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.930+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=A0N3OME5FLN5 type=write size=321210 2024-09-14T11:01:55.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.932+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~SE9ZXI8KFYGS.0 size=507111 2024-09-14T11:01:55.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.934+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=SE9ZXI8KFYGS tag=QXI93WI402RS type=write size=1555687 2024-09-14T11:01:55.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.936+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~OATO9VPZOGT6.0 size=1048576 2024-09-14T11:01:55.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.937+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~OATO9VPZOGT6.1 size=1048576 2024-09-14T11:01:55.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.938+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~OATO9VPZOGT6.2 size=457728 2024-09-14T11:01:55.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.938+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=OATO9VPZOGT6 tag=AJUVTP6PTJR4 type=write size=3603456 2024-09-14T11:01:55.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.940+0000 7fe3dd11f780 1 < suggested remove operation key=ZTD98WQ6032X tag=WHR57BZQNMU3 type=del 2024-09-14T11:01:55.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.941+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=8KLLUBN2LN2I type=del size=183687 2024-09-14T11:01:55.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.943+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=6PAT9FI9OB06 type=del 2024-09-14T11:01:55.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.944+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=P8L4I4WBP6ZX type=del size=2990031 2024-09-14T11:01:55.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.945+0000 7fe3dd11f780 -1 < failed to complete operation key=QPH41U60044L tag=HN10QGX9CE9E type=del size=2128535: (22) Invalid argument 2024-09-14T11:01:55.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.947+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GM76VUYCT408.0 size=1048576 2024-09-14T11:01:55.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.948+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GM76VUYCT408.1 size=802789 2024-09-14T11:01:55.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.948+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=GM76VUYCT408 tag=R5WEUW86HWOD type=write size=2899941 2024-09-14T11:01:55.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.950+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=KD7DJXGV2XB6 type=del 2024-09-14T11:01:55.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.951+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=A8U858LKVPND type=del size=4134972 2024-09-14T11:01:55.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.952+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~D13I236VHU5G.0 size=1886 2024-09-14T11:01:55.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.954+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=D13I236VHU5G tag=TAXC0P1ZI18I type=write size=1050462 2024-09-14T11:01:55.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.957+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~LWEGHQ4I98DK.0 size=1048576 2024-09-14T11:01:55.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.958+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~LWEGHQ4I98DK.1 size=159065 2024-09-14T11:01:55.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.958+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=LWEGHQ4I98DK tag=XEK1WA7KIV7E type=write size=2256217 2024-09-14T11:01:55.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.960+0000 7fe3dd11f780 1 < suggested remove operation key=VDSOBBVO3QGB tag=AHP3I3DN5HZE type=write 2024-09-14T11:01:55.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.962+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~W2KCBN9QI0RL.0 size=972148 2024-09-14T11:01:55.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.962+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=W2KCBN9QI0RL tag=72LQKHYSO8X4 type=write size=2020724 2024-09-14T11:01:55.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.963+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=SFIF0WRI9PDI type=del 2024-09-14T11:01:55.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.966+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~GA1N739S0QDB.0 size=1048576 2024-09-14T11:01:55.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.966+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~GA1N739S0QDB.1 size=1048576 2024-09-14T11:01:55.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.968+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~GA1N739S0QDB.2 size=990678 2024-09-14T11:01:55.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.968+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=GA1N739S0QDB tag=KTTOPEECWB56 type=write size=4136406 2024-09-14T11:01:55.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.969+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~JLJQEYJF37D7.0 size=1048576 2024-09-14T11:01:55.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.970+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~JLJQEYJF37D7.1 size=871451 2024-09-14T11:01:55.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.972+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=JLJQEYJF37D7 tag=QJGIP578UBU0 type=write size=2968603 2024-09-14T11:01:55.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.974+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~I5HQWYRT5R74.0 size=1048576 2024-09-14T11:01:55.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.975+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~I5HQWYRT5R74.1 size=1048576 2024-09-14T11:01:55.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.976+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~I5HQWYRT5R74.2 size=416273 2024-09-14T11:01:55.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.976+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=I5HQWYRT5R74 tag=MVCQRK6RT70H type=write size=3562001 2024-09-14T11:01:55.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.977+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=AIPRTHZWGTF2 type=del 2024-09-14T11:01:55.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.979+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~N6Z0TJMQSTMW.0 size=1048576 2024-09-14T11:01:55.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.980+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~N6Z0TJMQSTMW.1 size=294700 2024-09-14T11:01:55.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.980+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=N6Z0TJMQSTMW tag=UZSJRAPQMRN0 type=write size=2391852 2024-09-14T11:01:55.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.981+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~66GM664BRIXF.0 size=1048576 2024-09-14T11:01:55.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.982+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~66GM664BRIXF.1 size=963852 2024-09-14T11:01:55.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.984+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=66GM664BRIXF tag=H25O2KUOCVE9 type=write size=3061004 2024-09-14T11:01:55.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.985+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=9OAQR0OT3HX1 type=del size=1376985 2024-09-14T11:01:55.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.986+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~3I6YMJZ2VTGQ.0 size=136909 2024-09-14T11:01:55.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.988+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=3I6YMJZ2VTGQ tag=EHQHPXVFDXU9 type=write size=1185485 2024-09-14T11:01:55.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.991+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=TZ2ZSY7PW5S6 type=del size=2259672 2024-09-14T11:01:55.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.992+0000 7fe3dd11f780 1 < canceled operation key=JSEN4QXEMVHS tag=JORCO5U0RDUK type=write size=1045950 2024-09-14T11:01:55.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.993+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=KLUDBWZUAI7P type=del size=1061564 2024-09-14T11:01:55.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.994+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=1JUKZC4D3U9Q type=del 2024-09-14T11:01:55.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.996+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~0A7J0REN45J4.0 size=355754 2024-09-14T11:01:55.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.996+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=0A7J0REN45J4 tag=RA0EFLB2DW85 type=write size=1404330 2024-09-14T11:01:55.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.997+0000 7fe3dd11f780 -1 < no bi entry to suggest for operation key=ZTD98WQ6032X tag=3B2ZNNC3RQM1 type=del size=1140097: (2) No such file or directory 2024-09-14T11:01:55.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.999+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~YFEJ12T0HUY7.0 size=1048576 2024-09-14T11:01:55.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:55.999+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~YFEJ12T0HUY7.1 size=1048576 2024-09-14T11:01:55.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.000+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~YFEJ12T0HUY7.2 size=854129 2024-09-14T11:01:55.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.000+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=YFEJ12T0HUY7 tag=Z2PN2JI3SYHU type=write size=3999857 2024-09-14T11:01:55.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.001+0000 7fe3dd11f780 1 < completed write operation key=A89YQO40BHUS tag=A0N3OME5FLN5 type=write size=321210 2024-09-14T11:01:56.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.003+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=SMZ3NVY99UY7 type=del size=199367 2024-09-14T11:01:56.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.004+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~OATO9VPZOGT6.0 size=1048576 2024-09-14T11:01:56.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.005+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~OATO9VPZOGT6.1 size=1048576 2024-09-14T11:01:56.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.006+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~OATO9VPZOGT6.2 size=457728 2024-09-14T11:01:56.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.007+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=OATO9VPZOGT6 tag=AJUVTP6PTJR4 type=write size=3603456 2024-09-14T11:01:56.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.009+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~W5G21HO06R17.0 size=1048576 2024-09-14T11:01:56.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.010+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~W5G21HO06R17.1 size=11196 2024-09-14T11:01:56.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.010+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=W5G21HO06R17 tag=5VBQ3NBPUIV7 type=write size=2108348 2024-09-14T11:01:56.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.011+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=8KLLUBN2LN2I type=del 2024-09-14T11:01:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.014+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~WECC7UF1JOPG.0 size=586959 2024-09-14T11:01:56.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.014+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=WECC7UF1JOPG tag=42CG6AM1VWLK type=write size=1635535 2024-09-14T11:01:56.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.015+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=P8L4I4WBP6ZX type=del 2024-09-14T11:01:56.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.016+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=SL0ZQ0TFCNG4 type=write size=578346 2024-09-14T11:01:56.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.017+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GM76VUYCT408.0 size=1048576 2024-09-14T11:01:56.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.018+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GM76VUYCT408.1 size=802789 2024-09-14T11:01:56.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.020+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=GM76VUYCT408 tag=R5WEUW86HWOD type=write size=2899941 2024-09-14T11:01:56.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.021+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=FETR83AF3ETV type=write size=550871 2024-09-14T11:01:56.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.022+0000 7fe3dd11f780 1 < canceled operation key=0PT98N1VBWAG tag=A8U858LKVPND type=del size=4134972 2024-09-14T11:01:56.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.025+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~K4FLKRRPPSRI.0 size=361097 2024-09-14T11:01:56.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.025+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=K4FLKRRPPSRI tag=I8P71TMAH4A0 type=write size=1409673 2024-09-14T11:01:56.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.026+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~LWEGHQ4I98DK.0 size=1048576 2024-09-14T11:01:56.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.027+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~LWEGHQ4I98DK.1 size=159065 2024-09-14T11:01:56.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.029+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=LWEGHQ4I98DK tag=XEK1WA7KIV7E type=write size=2256217 2024-09-14T11:01:56.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.030+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=FRSVZRY8IA7M type=del size=411401 2024-09-14T11:01:56.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.031+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~W2KCBN9QI0RL.0 size=972148 2024-09-14T11:01:56.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.033+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=W2KCBN9QI0RL tag=72LQKHYSO8X4 type=write size=2020724 2024-09-14T11:01:56.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.036+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~5642T06WYN4I.0 size=785923 2024-09-14T11:01:56.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.036+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=5642T06WYN4I tag=F1RCOAKX13T9 type=write size=1834499 2024-09-14T11:01:56.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.037+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~GA1N739S0QDB.0 size=1048576 2024-09-14T11:01:56.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.038+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~GA1N739S0QDB.1 size=1048576 2024-09-14T11:01:56.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.039+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~GA1N739S0QDB.2 size=990678 2024-09-14T11:01:56.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.040+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=GA1N739S0QDB tag=KTTOPEECWB56 type=write size=4136406 2024-09-14T11:01:56.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.042+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=5JGCCOH5SVOW type=del size=3394977 2024-09-14T11:01:56.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.043+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~I5HQWYRT5R74.0 size=1048576 2024-09-14T11:01:56.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.044+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~I5HQWYRT5R74.1 size=1048576 2024-09-14T11:01:56.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.045+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~I5HQWYRT5R74.2 size=416273 2024-09-14T11:01:56.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.047+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=I5HQWYRT5R74 tag=MVCQRK6RT70H type=write size=3562001 2024-09-14T11:01:56.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.049+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~LPBUC0VII50B.0 size=1048576 2024-09-14T11:01:56.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.050+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~LPBUC0VII50B.1 size=1048576 2024-09-14T11:01:56.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.051+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~LPBUC0VII50B.2 size=53573 2024-09-14T11:01:56.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.051+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=LPBUC0VII50B tag=PODGC6C9MHX2 type=write size=3199301 2024-09-14T11:01:56.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.052+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~N6Z0TJMQSTMW.0 size=1048576 2024-09-14T11:01:56.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.054+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~N6Z0TJMQSTMW.1 size=294700 2024-09-14T11:01:56.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.056+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=N6Z0TJMQSTMW tag=UZSJRAPQMRN0 type=write size=2391852 2024-09-14T11:01:56.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.058+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~XFMMUFFM5YBZ.0 size=971797 2024-09-14T11:01:56.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.058+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=XFMMUFFM5YBZ tag=FGXUXP4GT6QT type=write size=2020373 2024-09-14T11:01:56.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.059+0000 7fe3dd11f780 1 < canceled operation key=IOAG4ZE1I58Z tag=9OAQR0OT3HX1 type=del size=1376985 2024-09-14T11:01:56.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.060+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=UJT4M3C1RCYJ type=del size=1076314 2024-09-14T11:01:56.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.061+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=TZ2ZSY7PW5S6 type=del 2024-09-14T11:01:56.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.063+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=FS928M14UJ8R type=del size=2259566 2024-09-14T11:01:56.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.064+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=KLUDBWZUAI7P type=del 2024-09-14T11:01:56.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.065+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=863O011LQKM8 type=del size=763277 2024-09-14T11:01:56.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.066+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~0A7J0REN45J4.0 size=355754 2024-09-14T11:01:56.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.068+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=0A7J0REN45J4 tag=RA0EFLB2DW85 type=write size=1404330 2024-09-14T11:01:56.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.071+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~HP3TCCB767PQ.0 size=1048576 2024-09-14T11:01:56.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.072+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~HP3TCCB767PQ.1 size=1048576 2024-09-14T11:01:56.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.073+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~HP3TCCB767PQ.2 size=834850 2024-09-14T11:01:56.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.073+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=HP3TCCB767PQ tag=LO4MQFBX7Y1F type=write size=3980578 2024-09-14T11:01:56.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.074+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~YFEJ12T0HUY7.0 size=1048576 2024-09-14T11:01:56.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.075+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~YFEJ12T0HUY7.1 size=1048576 2024-09-14T11:01:56.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.075+0000 7fe3dd11f780 1 < canceled part key=_multipart_22TI1VCDTK5P.2~YFEJ12T0HUY7.2 size=854129 2024-09-14T11:01:56.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.077+0000 7fe3dd11f780 1 < canceled multipart upload key=22TI1VCDTK5P upload=YFEJ12T0HUY7 tag=Z2PN2JI3SYHU type=write size=3999857 2024-09-14T11:01:56.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.079+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~CN4L8ZXD35GS.0 size=1048576 2024-09-14T11:01:56.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.080+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~CN4L8ZXD35GS.1 size=370513 2024-09-14T11:01:56.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.080+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=CN4L8ZXD35GS tag=Y1VT5F62P0E1 type=write size=2467665 2024-09-14T11:01:56.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.081+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=SMZ3NVY99UY7 type=del 2024-09-14T11:01:56.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.082+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=47Q89AJBH9GW type=del size=482943 2024-09-14T11:01:56.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.084+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~W5G21HO06R17.0 size=1048576 2024-09-14T11:01:56.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.084+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~W5G21HO06R17.1 size=11196 2024-09-14T11:01:56.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.087+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=W5G21HO06R17 tag=5VBQ3NBPUIV7 type=write size=2108348 2024-09-14T11:01:56.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.088+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=OSR0MF3XA0P0 type=del size=1948191 2024-09-14T11:01:56.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.090+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~WECC7UF1JOPG.0 size=586959 2024-09-14T11:01:56.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.092+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=WECC7UF1JOPG tag=42CG6AM1VWLK type=write size=1635535 2024-09-14T11:01:56.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.094+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~EG5UESUXSJCO.0 size=1048576 2024-09-14T11:01:56.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.095+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~EG5UESUXSJCO.1 size=1048576 2024-09-14T11:01:56.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.096+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~EG5UESUXSJCO.2 size=886624 2024-09-14T11:01:56.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.096+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=EG5UESUXSJCO tag=2SXSBYZYOYWE type=write size=4032352 2024-09-14T11:01:56.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.097+0000 7fe3dd11f780 1 < completed write operation key=LFKLJAJWQ2J6 tag=SL0ZQ0TFCNG4 type=write size=578346 2024-09-14T11:01:56.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.098+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=U8OKW2PLNH6N type=del size=2462398 2024-09-14T11:01:56.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.100+0000 7fe3dd11f780 1 < completed write operation key=KXL3E0PJBNBA tag=FETR83AF3ETV type=write size=550871 2024-09-14T11:01:56.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.102+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=PCIBP42FTWKW type=del size=1864138 2024-09-14T11:01:56.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.103+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~K4FLKRRPPSRI.0 size=361097 2024-09-14T11:01:56.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.105+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=K4FLKRRPPSRI tag=I8P71TMAH4A0 type=write size=1409673 2024-09-14T11:01:56.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.106+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=BKI736ZGIZFG type=write size=38722 2024-09-14T11:01:56.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.107+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=FRSVZRY8IA7M type=del 2024-09-14T11:01:56.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.108+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=PDDWPHLJO191 type=del size=2505580 2024-09-14T11:01:56.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.110+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~5642T06WYN4I.0 size=785923 2024-09-14T11:01:56.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.111+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=5642T06WYN4I tag=F1RCOAKX13T9 type=write size=1834499 2024-09-14T11:01:56.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.114+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~E7OS64Y4P67H.0 size=1048576 2024-09-14T11:01:56.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.115+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~E7OS64Y4P67H.1 size=1048576 2024-09-14T11:01:56.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.115+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~E7OS64Y4P67H.2 size=860437 2024-09-14T11:01:56.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.115+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=E7OS64Y4P67H tag=2U2SPJDSSQPQ type=write size=4006165 2024-09-14T11:01:56.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.117+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=5JGCCOH5SVOW type=del 2024-09-14T11:01:56.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.119+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~Z5PVY01YS97I.0 size=1048576 2024-09-14T11:01:56.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.120+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~Z5PVY01YS97I.1 size=1048576 2024-09-14T11:01:56.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.121+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~Z5PVY01YS97I.2 size=533766 2024-09-14T11:01:56.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.121+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=Z5PVY01YS97I tag=U5YCV9GG9PDP type=write size=3679494 2024-09-14T11:01:56.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.122+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~LPBUC0VII50B.0 size=1048576 2024-09-14T11:01:56.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.123+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~LPBUC0VII50B.1 size=1048576 2024-09-14T11:01:56.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.124+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~LPBUC0VII50B.2 size=53573 2024-09-14T11:01:56.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.126+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=LPBUC0VII50B tag=PODGC6C9MHX2 type=write size=3199301 2024-09-14T11:01:56.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.128+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~AHLTKE6DW2F0.0 size=901343 2024-09-14T11:01:56.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.128+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=AHLTKE6DW2F0 tag=2JC2O78GTK6Z type=write size=1949919 2024-09-14T11:01:56.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.130+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~XFMMUFFM5YBZ.0 size=971797 2024-09-14T11:01:56.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.132+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=XFMMUFFM5YBZ tag=FGXUXP4GT6QT type=write size=2020373 2024-09-14T11:01:56.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.134+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~7ILA3K0NIWM0.0 size=1048576 2024-09-14T11:01:56.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.135+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~7ILA3K0NIWM0.1 size=1048576 2024-09-14T11:01:56.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.136+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~7ILA3K0NIWM0.2 size=630711 2024-09-14T11:01:56.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.136+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=7ILA3K0NIWM0 tag=VYPO1984FJKF type=write size=3776439 2024-09-14T11:01:56.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.137+0000 7fe3dd11f780 1 < canceled operation key=QPH41U60044L tag=UJT4M3C1RCYJ type=del size=1076314 2024-09-14T11:01:56.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.139+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~ZROAB9K7LQZJ.0 size=254852 2024-09-14T11:01:56.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.139+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=ZROAB9K7LQZJ tag=ZKMVLJYOCV8U type=write size=1303428 2024-09-14T11:01:56.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.140+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=FS928M14UJ8R type=del 2024-09-14T11:01:56.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.142+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=73KKVN09CMCE type=del size=2133797 2024-09-14T11:01:56.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.143+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=863O011LQKM8 type=del 2024-09-14T11:01:56.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.144+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=1QLE0DUQ12CL type=del size=4045981 2024-09-14T11:01:56.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.145+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~HP3TCCB767PQ.0 size=1048576 2024-09-14T11:01:56.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.146+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~HP3TCCB767PQ.1 size=1048576 2024-09-14T11:01:56.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.147+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~HP3TCCB767PQ.2 size=834850 2024-09-14T11:01:56.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.149+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=HP3TCCB767PQ tag=LO4MQFBX7Y1F type=write size=3980578 2024-09-14T11:01:56.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.151+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~8ELGSP48YLIJ.0 size=374405 2024-09-14T11:01:56.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.151+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=8ELGSP48YLIJ tag=6IUGD6RZH16Q type=write size=1422981 2024-09-14T11:01:56.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.152+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~CN4L8ZXD35GS.0 size=1048576 2024-09-14T11:01:56.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.153+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~CN4L8ZXD35GS.1 size=370513 2024-09-14T11:01:56.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.155+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=CN4L8ZXD35GS tag=Y1VT5F62P0E1 type=write size=2467665 2024-09-14T11:01:56.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.158+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~ZP0YNL8J3GJW.0 size=1048576 2024-09-14T11:01:56.156 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.159+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~ZP0YNL8J3GJW.1 size=1048576 2024-09-14T11:01:56.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.159+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~ZP0YNL8J3GJW.2 size=135719 2024-09-14T11:01:56.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.159+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=ZP0YNL8J3GJW tag=K3L9UQBB2YO8 type=write size=3281447 2024-09-14T11:01:56.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.161+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=47Q89AJBH9GW type=del 2024-09-14T11:01:56.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.163+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~LDVO8TVNMRO6.0 size=1048576 2024-09-14T11:01:56.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.164+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~LDVO8TVNMRO6.1 size=1048576 2024-09-14T11:01:56.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.165+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~LDVO8TVNMRO6.2 size=5969 2024-09-14T11:01:56.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.165+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=LDVO8TVNMRO6 tag=ETEQQ4D1J280 type=write size=3151697 2024-09-14T11:01:56.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.166+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=OSR0MF3XA0P0 type=del 2024-09-14T11:01:56.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.167+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=A3GHEKKVDOS5 type=del size=3518421 2024-09-14T11:01:56.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.168+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~EG5UESUXSJCO.0 size=1048576 2024-09-14T11:01:56.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.169+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~EG5UESUXSJCO.1 size=1048576 2024-09-14T11:01:56.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.170+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~EG5UESUXSJCO.2 size=886624 2024-09-14T11:01:56.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.172+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=EG5UESUXSJCO tag=2SXSBYZYOYWE type=write size=4032352 2024-09-14T11:01:56.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.173+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=0HVS6NT5H5TI type=write size=644880 2024-09-14T11:01:56.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.175+0000 7fe3dd11f780 1 < canceled operation key=6PJ03TAYRUT8 tag=U8OKW2PLNH6N type=del size=2462398 2024-09-14T11:01:56.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.176+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=P9IB7DHTKJJH type=del size=1798115 2024-09-14T11:01:56.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.179+0000 7fe3dd11f780 1 < suggested update operation key=K9BP30LHDPA1 tag=PCIBP42FTWKW type=del size=1864138 2024-09-14T11:01:56.177 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.180+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=35S0V4VNN921 type=del size=1967444 2024-09-14T11:01:56.179 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.181+0000 7fe3dd11f780 1 < completed write operation key=GQEFQ1UD6QCJ tag=BKI736ZGIZFG type=write size=38722 2024-09-14T11:01:56.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.183+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=5LV8MV9ZG8KA type=del size=3086412 2024-09-14T11:01:56.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.184+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=PDDWPHLJO191 type=del 2024-09-14T11:01:56.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.185+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=C4EFJHYEC610 type=del size=281442 2024-09-14T11:01:56.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.187+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~E7OS64Y4P67H.0 size=1048576 2024-09-14T11:01:56.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.188+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~E7OS64Y4P67H.1 size=1048576 2024-09-14T11:01:56.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.189+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~E7OS64Y4P67H.2 size=860437 2024-09-14T11:01:56.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.191+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=E7OS64Y4P67H tag=2U2SPJDSSQPQ type=write size=4006165 2024-09-14T11:01:56.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.192+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=CFLC05PCDQHH type=del size=609808 2024-09-14T11:01:56.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.193+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~Z5PVY01YS97I.0 size=1048576 2024-09-14T11:01:56.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.193+0000 7fe3dd11f780 1 < canceled part key=_multipart_0PT98N1VBWAG.2~Z5PVY01YS97I.1 size=1048576 2024-09-14T11:01:56.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.194+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~Z5PVY01YS97I.2 size=533766 2024-09-14T11:01:56.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.196+0000 7fe3dd11f780 1 < canceled multipart upload key=0PT98N1VBWAG upload=Z5PVY01YS97I tag=U5YCV9GG9PDP type=write size=3679494 2024-09-14T11:01:56.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.198+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=USA3EXBWNB2U type=del size=809825 2024-09-14T11:01:56.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.199+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~AHLTKE6DW2F0.0 size=901343 2024-09-14T11:01:56.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.201+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=AHLTKE6DW2F0 tag=2JC2O78GTK6Z type=write size=1949919 2024-09-14T11:01:56.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.203+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~VIRIA6085RHE.0 size=1048576 2024-09-14T11:01:56.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.204+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~VIRIA6085RHE.1 size=15562 2024-09-14T11:01:56.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.204+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=VIRIA6085RHE tag=2T90FTZO7Q1C type=write size=2112714 2024-09-14T11:01:56.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.205+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~7ILA3K0NIWM0.0 size=1048576 2024-09-14T11:01:56.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.206+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~7ILA3K0NIWM0.1 size=1048576 2024-09-14T11:01:56.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.207+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~7ILA3K0NIWM0.2 size=630711 2024-09-14T11:01:56.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.209+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=7ILA3K0NIWM0 tag=VYPO1984FJKF type=write size=3776439 2024-09-14T11:01:56.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.213+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GB5INSH9PP5U.0 size=1048576 2024-09-14T11:01:56.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.213+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GB5INSH9PP5U.1 size=1048576 2024-09-14T11:01:56.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.214+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~GB5INSH9PP5U.2 size=843065 2024-09-14T11:01:56.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.214+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=GB5INSH9PP5U tag=NZ100Y7KJ5CY type=write size=3988793 2024-09-14T11:01:56.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.216+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~ZROAB9K7LQZJ.0 size=254852 2024-09-14T11:01:56.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.218+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=ZROAB9K7LQZJ tag=ZKMVLJYOCV8U type=write size=1303428 2024-09-14T11:01:56.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.219+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=XR7QBZ12CN2Q type=del size=2588657 2024-09-14T11:01:56.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.220+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=73KKVN09CMCE type=del 2024-09-14T11:01:56.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.222+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=MOTHJVEL6LT4 type=del size=1144747 2024-09-14T11:01:56.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.224+0000 7fe3dd11f780 1 < suggested update operation key=M0DMAQ5LTDR0 tag=1QLE0DUQ12CL type=del size=4045981 2024-09-14T11:01:56.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.226+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=0RBGE0HTTXKW type=write size=255478 2024-09-14T11:01:56.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.227+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~8ELGSP48YLIJ.0 size=374405 2024-09-14T11:01:56.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.229+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=8ELGSP48YLIJ tag=6IUGD6RZH16Q type=write size=1422981 2024-09-14T11:01:56.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.231+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=A1EJN50UDDLD type=del size=965751 2024-09-14T11:01:56.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.232+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~ZP0YNL8J3GJW.0 size=1048576 2024-09-14T11:01:56.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.233+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~ZP0YNL8J3GJW.1 size=1048576 2024-09-14T11:01:56.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.233+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~ZP0YNL8J3GJW.2 size=135719 2024-09-14T11:01:56.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.235+0000 7fe3dd11f780 1 < canceled multipart upload key=GQEFQ1UD6QCJ upload=ZP0YNL8J3GJW tag=K3L9UQBB2YO8 type=write size=3281447 2024-09-14T11:01:56.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.238+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~15O0LVY2PJ5J.0 size=576212 2024-09-14T11:01:56.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.238+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=15O0LVY2PJ5J tag=HC7CTAP19OXF type=write size=1624788 2024-09-14T11:01:56.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.239+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~LDVO8TVNMRO6.0 size=1048576 2024-09-14T11:01:56.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.240+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~LDVO8TVNMRO6.1 size=1048576 2024-09-14T11:01:56.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.241+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~LDVO8TVNMRO6.2 size=5969 2024-09-14T11:01:56.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.244+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=LDVO8TVNMRO6 tag=ETEQQ4D1J280 type=write size=3151697 2024-09-14T11:01:56.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.246+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~HOVYRQVYOITY.0 size=35593 2024-09-14T11:01:56.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.246+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=HOVYRQVYOITY tag=Q8VEZNUW9BYI type=write size=1084169 2024-09-14T11:01:56.245 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.247+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=A3GHEKKVDOS5 type=del 2024-09-14T11:01:56.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.250+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~ZJ79SSWNNSKO.0 size=1048576 2024-09-14T11:01:56.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.251+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~ZJ79SSWNNSKO.1 size=21799 2024-09-14T11:01:56.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.251+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=ZJ79SSWNNSKO tag=PVGD2C4GSS9C type=write size=2118951 2024-09-14T11:01:56.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.254+0000 7fe3dd11f780 1 < suggested remove operation key=VDSOBBVO3QGB tag=0HVS6NT5H5TI type=write 2024-09-14T11:01:56.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.255+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=K8LXMS5BU9L8 type=del size=630154 2024-09-14T11:01:56.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.257+0000 7fe3dd11f780 1 < suggested update operation key=LFKLJAJWQ2J6 tag=P9IB7DHTKJJH type=del size=1798115 2024-09-14T11:01:56.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.258+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=2WQ93VZ61WWU type=del size=1379266 2024-09-14T11:01:56.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.259+0000 7fe3dd11f780 1 < canceled operation key=MD0OU8IC5PYI tag=35S0V4VNN921 type=del size=1967444 2024-09-14T11:01:56.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.261+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=KI24M82D1JXT type=del size=710283 2024-09-14T11:01:56.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.262+0000 7fe3dd11f780 -1 < failed to complete operation key=VDSOBBVO3QGB tag=5LV8MV9ZG8KA type=del size=3086412: (22) Invalid argument 2024-09-14T11:01:56.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.263+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=BECVFQHN5UCK type=write size=593994 2024-09-14T11:01:56.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.264+0000 7fe3dd11f780 -1 < failed to complete operation key=VDSOBBVO3QGB tag=C4EFJHYEC610 type=del size=281442: (22) Invalid argument 2024-09-14T11:01:56.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.266+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~W0X02YZMZN6M.0 size=233333 2024-09-14T11:01:56.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.266+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=W0X02YZMZN6M tag=LJ5W31DJKF2B type=write size=1281909 2024-09-14T11:01:56.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.267+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=CFLC05PCDQHH type=del 2024-09-14T11:01:56.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.269+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~SOXJ58ETNZ2X.0 size=1048576 2024-09-14T11:01:56.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.270+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~SOXJ58ETNZ2X.1 size=470694 2024-09-14T11:01:56.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.270+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=SOXJ58ETNZ2X tag=YTFYUPUV7LOL type=write size=2567846 2024-09-14T11:01:56.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.272+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=USA3EXBWNB2U type=del 2024-09-14T11:01:56.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.274+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~Y0QMG8A703BU.0 size=1012935 2024-09-14T11:01:56.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.274+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=Y0QMG8A703BU tag=2IPES8N6R3YC type=write size=2061511 2024-09-14T11:01:56.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.275+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~VIRIA6085RHE.0 size=1048576 2024-09-14T11:01:56.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.276+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~VIRIA6085RHE.1 size=15562 2024-09-14T11:01:56.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.278+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=VIRIA6085RHE tag=2T90FTZO7Q1C type=write size=2112714 2024-09-14T11:01:56.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.280+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~FQTAPGOOHA3H.0 size=46832 2024-09-14T11:01:56.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.280+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=FQTAPGOOHA3H tag=LUKQMGEUNPLP type=write size=1095408 2024-09-14T11:01:56.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.281+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GB5INSH9PP5U.0 size=1048576 2024-09-14T11:01:56.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.282+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GB5INSH9PP5U.1 size=1048576 2024-09-14T11:01:56.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.283+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~GB5INSH9PP5U.2 size=843065 2024-09-14T11:01:56.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.285+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=GB5INSH9PP5U tag=NZ100Y7KJ5CY type=write size=3988793 2024-09-14T11:01:56.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.286+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=UDKOQ849ZDRK type=write size=331972 2024-09-14T11:01:56.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.288+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=XR7QBZ12CN2Q type=del 2024-09-14T11:01:56.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.290+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~O4XLSFRN4LRB.0 size=794527 2024-09-14T11:01:56.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.290+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=O4XLSFRN4LRB tag=HJPT7QMR9HM6 type=write size=1843103 2024-09-14T11:01:56.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.291+0000 7fe3dd11f780 1 < canceled operation key=V692HUUJP2RC tag=MOTHJVEL6LT4 type=del size=1144747 2024-09-14T11:01:56.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.292+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=6OONZPY45NUQ type=del size=1782595 2024-09-14T11:01:56.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.294+0000 7fe3dd11f780 1 < canceled operation key=ODDNSHK5YMNO tag=0RBGE0HTTXKW type=write size=255478 2024-09-14T11:01:56.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.296+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~56X8JQ8WS4P4.0 size=1048576 2024-09-14T11:01:56.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.297+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~56X8JQ8WS4P4.1 size=1048576 2024-09-14T11:01:56.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.298+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~56X8JQ8WS4P4.2 size=653320 2024-09-14T11:01:56.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.298+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=56X8JQ8WS4P4 tag=9LLN9JLWOWR4 type=write size=3799048 2024-09-14T11:01:56.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.299+0000 7fe3dd11f780 -1 < failed to complete operation key=LFKLJAJWQ2J6 tag=A1EJN50UDDLD type=del size=965751: (22) Invalid argument 2024-09-14T11:01:56.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.300+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=OD2VGIVTO29D type=write size=882967 2024-09-14T11:01:56.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.301+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~15O0LVY2PJ5J.0 size=576212 2024-09-14T11:01:56.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.303+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=15O0LVY2PJ5J tag=HC7CTAP19OXF type=write size=1624788 2024-09-14T11:01:56.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.304+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=MXA9JBB1CTOR type=del size=3404961 2024-09-14T11:01:56.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.306+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~HOVYRQVYOITY.0 size=35593 2024-09-14T11:01:56.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.308+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=HOVYRQVYOITY tag=Q8VEZNUW9BYI type=write size=1084169 2024-09-14T11:01:56.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.310+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~5UPC99NCPALD.0 size=1048576 2024-09-14T11:01:56.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.311+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~5UPC99NCPALD.1 size=1048576 2024-09-14T11:01:56.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.311+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~5UPC99NCPALD.2 size=967837 2024-09-14T11:01:56.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.311+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=5UPC99NCPALD tag=JNXH2WND5FY0 type=write size=4113565 2024-09-14T11:01:56.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.313+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~ZJ79SSWNNSKO.0 size=1048576 2024-09-14T11:01:56.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.313+0000 7fe3dd11f780 1 < canceled part key=_multipart_JG1RZQD4J2EB.2~ZJ79SSWNNSKO.1 size=21799 2024-09-14T11:01:56.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.315+0000 7fe3dd11f780 1 < canceled multipart upload key=JG1RZQD4J2EB upload=ZJ79SSWNNSKO tag=PVGD2C4GSS9C type=write size=2118951 2024-09-14T11:01:56.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.316+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=5E00OJNH6MKK type=del size=814331 2024-09-14T11:01:56.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.317+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=K8LXMS5BU9L8 type=del 2024-09-14T11:01:56.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.318+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=OJP3HF7UXTIA type=del size=1723339 2024-09-14T11:01:56.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.321+0000 7fe3dd11f780 1 < suggested update operation key=ODDNSHK5YMNO tag=2WQ93VZ61WWU type=del size=1379266 2024-09-14T11:01:56.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.322+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=F172B0EVXAKK type=del size=2049915 2024-09-14T11:01:56.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.324+0000 7fe3dd11f780 1 < suggested update operation key=EGC5988RQOEZ tag=KI24M82D1JXT type=del size=710283 2024-09-14T11:01:56.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.327+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~C5OEAC1RXDM1.0 size=1048576 2024-09-14T11:01:56.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.328+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~C5OEAC1RXDM1.1 size=1048576 2024-09-14T11:01:56.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.329+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~C5OEAC1RXDM1.2 size=175175 2024-09-14T11:01:56.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.329+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=C5OEAC1RXDM1 tag=TSTCJWPOOGQ5 type=write size=3320903 2024-09-14T11:01:56.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.332+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=BECVFQHN5UCK type=write 2024-09-14T11:01:56.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.333+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=Y6GJLZ78DP33 type=del size=2982926 2024-09-14T11:01:56.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.335+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~W0X02YZMZN6M.0 size=233333 2024-09-14T11:01:56.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.336+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=W0X02YZMZN6M tag=LJ5W31DJKF2B type=write size=1281909 2024-09-14T11:01:56.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.339+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~0JLAXL0FBG5D.0 size=38688 2024-09-14T11:01:56.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.339+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=0JLAXL0FBG5D tag=PZ0CP6ICZYM3 type=write size=1087264 2024-09-14T11:01:56.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.340+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~SOXJ58ETNZ2X.0 size=1048576 2024-09-14T11:01:56.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.341+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~SOXJ58ETNZ2X.1 size=470694 2024-09-14T11:01:56.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.342+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=SOXJ58ETNZ2X tag=YTFYUPUV7LOL type=write size=2567846 2024-09-14T11:01:56.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.344+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=U04C264245TU type=del size=2171656 2024-09-14T11:01:56.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.344+0000 7fe3dd11f780 1 < canceled part key=_multipart_JSEN4QXEMVHS.2~Y0QMG8A703BU.0 size=1012935 2024-09-14T11:01:56.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.346+0000 7fe3dd11f780 1 < canceled multipart upload key=JSEN4QXEMVHS upload=Y0QMG8A703BU tag=2IPES8N6R3YC type=write size=2061511 2024-09-14T11:01:56.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.347+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=05Q0IUZJ321D type=del size=2433006 2024-09-14T11:01:56.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.348+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~FQTAPGOOHA3H.0 size=46832 2024-09-14T11:01:56.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.350+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=FQTAPGOOHA3H tag=LUKQMGEUNPLP type=write size=1095408 2024-09-14T11:01:56.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.351+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=S3Q8AN07B3U3 type=del size=3405842 2024-09-14T11:01:56.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.352+0000 7fe3dd11f780 1 < completed write operation key=LFKLJAJWQ2J6 tag=UDKOQ849ZDRK type=write size=331972 2024-09-14T11:01:56.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.353+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=3AGX0D2ZJN0V type=del size=2359615 2024-09-14T11:01:56.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.355+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~O4XLSFRN4LRB.0 size=794527 2024-09-14T11:01:56.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.356+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=O4XLSFRN4LRB tag=HJPT7QMR9HM6 type=write size=1843103 2024-09-14T11:01:56.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.359+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~3SHEAU49ZZPV.0 size=1048576 2024-09-14T11:01:56.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.360+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~3SHEAU49ZZPV.1 size=1048576 2024-09-14T11:01:56.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.360+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~3SHEAU49ZZPV.2 size=536898 2024-09-14T11:01:56.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.360+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=3SHEAU49ZZPV tag=MYIXK449IS3F type=write size=3682626 2024-09-14T11:01:56.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.362+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=6OONZPY45NUQ type=del 2024-09-14T11:01:56.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.364+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~UK0XQCHOZ350.0 size=1002337 2024-09-14T11:01:56.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.364+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=UK0XQCHOZ350 tag=ZFBYGZXNS4S4 type=write size=2050913 2024-09-14T11:01:56.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.365+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~56X8JQ8WS4P4.0 size=1048576 2024-09-14T11:01:56.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.366+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~56X8JQ8WS4P4.1 size=1048576 2024-09-14T11:01:56.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.367+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~56X8JQ8WS4P4.2 size=653320 2024-09-14T11:01:56.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.369+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=56X8JQ8WS4P4 tag=9LLN9JLWOWR4 type=write size=3799048 2024-09-14T11:01:56.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.371+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~MR1KX5NN5HH8.0 size=1048576 2024-09-14T11:01:56.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.372+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~MR1KX5NN5HH8.1 size=1048576 2024-09-14T11:01:56.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.373+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~MR1KX5NN5HH8.2 size=768890 2024-09-14T11:01:56.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.373+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=MR1KX5NN5HH8 tag=40IE53ZGLKDD type=write size=3914618 2024-09-14T11:01:56.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.374+0000 7fe3dd11f780 1 < completed write operation key=22TI1VCDTK5P tag=OD2VGIVTO29D type=write size=882967 2024-09-14T11:01:56.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.376+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~Y34KHU7STUYJ.0 size=1048576 2024-09-14T11:01:56.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.377+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~Y34KHU7STUYJ.1 size=884248 2024-09-14T11:01:56.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.377+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=Y34KHU7STUYJ tag=9M4609EIMHYX type=write size=2981400 2024-09-14T11:01:56.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.379+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=MXA9JBB1CTOR type=del 2024-09-14T11:01:56.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.381+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~LA38JIDMZMXV.0 size=1048576 2024-09-14T11:01:56.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.382+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~LA38JIDMZMXV.1 size=43716 2024-09-14T11:01:56.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.382+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=LA38JIDMZMXV tag=GBRURJFG10XA type=write size=2140868 2024-09-14T11:01:56.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.383+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~5UPC99NCPALD.0 size=1048576 2024-09-14T11:01:56.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.384+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~5UPC99NCPALD.1 size=1048576 2024-09-14T11:01:56.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.385+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~5UPC99NCPALD.2 size=967837 2024-09-14T11:01:56.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.388+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=5UPC99NCPALD tag=JNXH2WND5FY0 type=write size=4113565 2024-09-14T11:01:56.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.389+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=WXN4Y5IFWJL3 type=del size=1712176 2024-09-14T11:01:56.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.391+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=5E00OJNH6MKK type=del 2024-09-14T11:01:56.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.392+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=SUZ7NY664KOM type=del size=944135 2024-09-14T11:01:56.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.393+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=OJP3HF7UXTIA type=del 2024-09-14T11:01:56.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.395+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~B8T3AQQA52B0.0 size=1048576 2024-09-14T11:01:56.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.397+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~B8T3AQQA52B0.1 size=1048576 2024-09-14T11:01:56.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.397+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~B8T3AQQA52B0.2 size=225572 2024-09-14T11:01:56.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.397+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=B8T3AQQA52B0 tag=PCAGNM3BMWJQ type=write size=3371300 2024-09-14T11:01:56.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.399+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=F172B0EVXAKK type=del 2024-09-14T11:01:56.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.401+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~NAMP56BFI5VJ.0 size=1048576 2024-09-14T11:01:56.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.402+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~NAMP56BFI5VJ.1 size=1048576 2024-09-14T11:01:56.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.403+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~NAMP56BFI5VJ.2 size=997636 2024-09-14T11:01:56.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.403+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=NAMP56BFI5VJ tag=ROOHAMQ91NOG type=write size=4143364 2024-09-14T11:01:56.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.404+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~C5OEAC1RXDM1.0 size=1048576 2024-09-14T11:01:56.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.405+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~C5OEAC1RXDM1.1 size=1048576 2024-09-14T11:01:56.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.406+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~C5OEAC1RXDM1.2 size=175175 2024-09-14T11:01:56.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.409+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=C5OEAC1RXDM1 tag=TSTCJWPOOGQ5 type=write size=3320903 2024-09-14T11:01:56.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.411+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~C66P6P44TTVX.0 size=939938 2024-09-14T11:01:56.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.411+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=C66P6P44TTVX tag=BU7ACW9EGGRD type=write size=1988514 2024-09-14T11:01:56.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.412+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=Y6GJLZ78DP33 type=del 2024-09-14T11:01:56.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.413+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=6RNUJ8VE5IQO type=del size=3874967 2024-09-14T11:01:56.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.414+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~0JLAXL0FBG5D.0 size=38688 2024-09-14T11:01:56.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.416+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=0JLAXL0FBG5D tag=PZ0CP6ICZYM3 type=write size=1087264 2024-09-14T11:01:56.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.419+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~JRI23NX17CJN.0 size=1048576 2024-09-14T11:01:56.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.419+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~JRI23NX17CJN.1 size=1048576 2024-09-14T11:01:56.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.420+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~JRI23NX17CJN.2 size=805821 2024-09-14T11:01:56.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.420+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=JRI23NX17CJN tag=EUO2CPFGG5HF type=write size=3951549 2024-09-14T11:01:56.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.422+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=U04C264245TU type=del 2024-09-14T11:01:56.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.423+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=ACPTG6G2SH0Z type=del size=2746570 2024-09-14T11:01:56.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.426+0000 7fe3dd11f780 1 < suggested remove operation key=QPH41U60044L tag=05Q0IUZJ321D type=del 2024-09-14T11:01:56.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.427+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=WVTFFUUE99GB type=del size=2439909 2024-09-14T11:01:56.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.428+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=S3Q8AN07B3U3 type=del 2024-09-14T11:01:56.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.431+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~AR0FBLME0Z4X.0 size=1048576 2024-09-14T11:01:56.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.431+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~AR0FBLME0Z4X.1 size=1048576 2024-09-14T11:01:56.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.432+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~AR0FBLME0Z4X.2 size=452197 2024-09-14T11:01:56.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.432+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=AR0FBLME0Z4X tag=ECNWVW3M95TZ type=write size=3597925 2024-09-14T11:01:56.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.434+0000 7fe3dd11f780 1 < canceled operation key=MD0OU8IC5PYI tag=3AGX0D2ZJN0V type=del size=2359615 2024-09-14T11:01:56.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.436+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~NRJKVVR50DRZ.0 size=1048576 2024-09-14T11:01:56.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.437+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~NRJKVVR50DRZ.1 size=377643 2024-09-14T11:01:56.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.437+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=NRJKVVR50DRZ tag=O3HGL5NPOEMU type=write size=2474795 2024-09-14T11:01:56.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.439+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~3SHEAU49ZZPV.0 size=1048576 2024-09-14T11:01:56.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.440+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~3SHEAU49ZZPV.1 size=1048576 2024-09-14T11:01:56.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.441+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~3SHEAU49ZZPV.2 size=536898 2024-09-14T11:01:56.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.443+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=3SHEAU49ZZPV tag=MYIXK449IS3F type=write size=3682626 2024-09-14T11:01:56.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.445+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~PKKNO6MELQ3U.0 size=211086 2024-09-14T11:01:56.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.445+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=PKKNO6MELQ3U tag=Z86F1RLXRT25 type=write size=1259662 2024-09-14T11:01:56.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.446+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~UK0XQCHOZ350.0 size=1002337 2024-09-14T11:01:56.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.448+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=UK0XQCHOZ350 tag=ZFBYGZXNS4S4 type=write size=2050913 2024-09-14T11:01:56.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.450+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~BL2JZPGWH4QU.0 size=1048576 2024-09-14T11:01:56.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.451+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~BL2JZPGWH4QU.1 size=1048576 2024-09-14T11:01:56.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.452+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~BL2JZPGWH4QU.2 size=556299 2024-09-14T11:01:56.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.452+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=BL2JZPGWH4QU tag=N2Z867A294OT type=write size=3702027 2024-09-14T11:01:56.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.453+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~MR1KX5NN5HH8.0 size=1048576 2024-09-14T11:01:56.451 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.454+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~MR1KX5NN5HH8.1 size=1048576 2024-09-14T11:01:56.452 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.455+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~MR1KX5NN5HH8.2 size=768890 2024-09-14T11:01:56.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.457+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=MR1KX5NN5HH8 tag=40IE53ZGLKDD type=write size=3914618 2024-09-14T11:01:56.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.458+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=YZNFB3VS40XI type=del size=3204561 2024-09-14T11:01:56.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.459+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~Y34KHU7STUYJ.0 size=1048576 2024-09-14T11:01:56.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.459+0000 7fe3dd11f780 1 < canceled part key=_multipart_VDSOBBVO3QGB.2~Y34KHU7STUYJ.1 size=884248 2024-09-14T11:01:56.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.461+0000 7fe3dd11f780 1 < canceled multipart upload key=VDSOBBVO3QGB upload=Y34KHU7STUYJ tag=9M4609EIMHYX type=write size=2981400 2024-09-14T11:01:56.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.462+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=I3SJU61NNLNY type=del size=3959981 2024-09-14T11:01:56.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.462+0000 7fe3dd11f780 1 < canceled part key=_multipart_V692HUUJP2RC.2~LA38JIDMZMXV.0 size=1048576 2024-09-14T11:01:56.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.463+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~LA38JIDMZMXV.1 size=43716 2024-09-14T11:01:56.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.465+0000 7fe3dd11f780 1 < canceled multipart upload key=V692HUUJP2RC upload=LA38JIDMZMXV tag=GBRURJFG10XA type=write size=2140868 2024-09-14T11:01:56.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.467+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~XEQ83PI2L2NJ.0 size=1048576 2024-09-14T11:01:56.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.468+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~XEQ83PI2L2NJ.1 size=731928 2024-09-14T11:01:56.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.468+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=XEQ83PI2L2NJ tag=H6ICXOGDN64E type=write size=2829080 2024-09-14T11:01:56.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.471+0000 7fe3dd11f780 1 < suggested remove operation key=4JTN39NIB2UE tag=WXN4Y5IFWJL3 type=del 2024-09-14T11:01:56.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.473+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~XIZLX0KUBWUV.0 size=1048576 2024-09-14T11:01:56.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.474+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~XIZLX0KUBWUV.1 size=750062 2024-09-14T11:01:56.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.474+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=XIZLX0KUBWUV tag=412HXSFC0JAC type=write size=2847214 2024-09-14T11:01:56.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.475+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=SUZ7NY664KOM type=del 2024-09-14T11:01:56.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.476+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=R958FOIOIMNV type=del size=2294880 2024-09-14T11:01:56.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.477+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~B8T3AQQA52B0.0 size=1048576 2024-09-14T11:01:56.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.478+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~B8T3AQQA52B0.1 size=1048576 2024-09-14T11:01:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.479+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~B8T3AQQA52B0.2 size=225572 2024-09-14T11:01:56.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.481+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=B8T3AQQA52B0 tag=PCAGNM3BMWJQ type=write size=3371300 2024-09-14T11:01:56.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.483+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=YQ39O712OUAS type=del size=4035653 2024-09-14T11:01:56.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.484+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~NAMP56BFI5VJ.0 size=1048576 2024-09-14T11:01:56.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.484+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~NAMP56BFI5VJ.1 size=1048576 2024-09-14T11:01:56.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.485+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~NAMP56BFI5VJ.2 size=997636 2024-09-14T11:01:56.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.487+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=NAMP56BFI5VJ tag=ROOHAMQ91NOG type=write size=4143364 2024-09-14T11:01:56.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.488+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=L2ZEETKY53UQ type=del size=1218643 2024-09-14T11:01:56.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.489+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~C66P6P44TTVX.0 size=939938 2024-09-14T11:01:56.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.492+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=C66P6P44TTVX tag=BU7ACW9EGGRD type=write size=1988514 2024-09-14T11:01:56.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.494+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~DGA67WI7HRMG.0 size=1048576 2024-09-14T11:01:56.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.495+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~DGA67WI7HRMG.1 size=1048576 2024-09-14T11:01:56.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.496+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~DGA67WI7HRMG.2 size=299225 2024-09-14T11:01:56.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.496+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=DGA67WI7HRMG tag=IJV60TLEVJL9 type=write size=3444953 2024-09-14T11:01:56.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.497+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=6RNUJ8VE5IQO type=del 2024-09-14T11:01:56.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.499+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~TQ0543TI958G.0 size=1048576 2024-09-14T11:01:56.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.500+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~TQ0543TI958G.1 size=526237 2024-09-14T11:01:56.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.500+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=TQ0543TI958G tag=9QHZ8AOFTZPL type=write size=2623389 2024-09-14T11:01:56.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.501+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~JRI23NX17CJN.0 size=1048576 2024-09-14T11:01:56.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.502+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~JRI23NX17CJN.1 size=1048576 2024-09-14T11:01:56.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.503+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~JRI23NX17CJN.2 size=805821 2024-09-14T11:01:56.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.505+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=JRI23NX17CJN tag=EUO2CPFGG5HF type=write size=3951549 2024-09-14T11:01:56.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.506+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=OO67NOUVFFNY type=del size=2375717 2024-09-14T11:01:56.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.509+0000 7fe3dd11f780 1 < suggested update operation key=ZI5SFHGWCHJA tag=ACPTG6G2SH0Z type=del size=2746570 2024-09-14T11:01:56.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.510+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=HQVZUATVPLB3 type=del size=613919 2024-09-14T11:01:56.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.512+0000 7fe3dd11f780 1 < suggested remove operation key=VDSOBBVO3QGB tag=WVTFFUUE99GB type=del 2024-09-14T11:01:56.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.514+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~SB1NWV63LU5I.0 size=1048576 2024-09-14T11:01:56.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.516+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~SB1NWV63LU5I.1 size=20492 2024-09-14T11:01:56.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.516+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=SB1NWV63LU5I tag=ZDBS2TU1B01J type=write size=2117644 2024-09-14T11:01:56.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.516+0000 7fe3dd11f780 1 < canceled part key=_multipart_VDSOBBVO3QGB.2~AR0FBLME0Z4X.0 size=1048576 2024-09-14T11:01:56.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.517+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~AR0FBLME0Z4X.1 size=1048576 2024-09-14T11:01:56.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.518+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~AR0FBLME0Z4X.2 size=452197 2024-09-14T11:01:56.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.520+0000 7fe3dd11f780 1 < canceled multipart upload key=VDSOBBVO3QGB upload=AR0FBLME0Z4X tag=ECNWVW3M95TZ type=write size=3597925 2024-09-14T11:01:56.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.521+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=T5F19NOLNUOB type=del size=1203028 2024-09-14T11:01:56.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.523+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~NRJKVVR50DRZ.0 size=1048576 2024-09-14T11:01:56.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.524+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~NRJKVVR50DRZ.1 size=377643 2024-09-14T11:01:56.523 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.526+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=NRJKVVR50DRZ tag=O3HGL5NPOEMU type=write size=2474795 2024-09-14T11:01:56.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.528+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~UX6IXUILV1XJ.0 size=1048576 2024-09-14T11:01:56.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.529+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~UX6IXUILV1XJ.1 size=588162 2024-09-14T11:01:56.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.529+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=UX6IXUILV1XJ tag=B2TPZ35FTXUB type=write size=2685314 2024-09-14T11:01:56.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.530+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~PKKNO6MELQ3U.0 size=211086 2024-09-14T11:01:56.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.532+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=PKKNO6MELQ3U tag=Z86F1RLXRT25 type=write size=1259662 2024-09-14T11:01:56.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.534+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~2Q01UOJUB3YU.0 size=1048576 2024-09-14T11:01:56.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.535+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~2Q01UOJUB3YU.1 size=942717 2024-09-14T11:01:56.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.535+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=2Q01UOJUB3YU tag=FN6ETG373J8S type=write size=3039869 2024-09-14T11:01:56.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.536+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~BL2JZPGWH4QU.0 size=1048576 2024-09-14T11:01:56.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.537+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~BL2JZPGWH4QU.1 size=1048576 2024-09-14T11:01:56.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.538+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~BL2JZPGWH4QU.2 size=556299 2024-09-14T11:01:56.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.539+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=BL2JZPGWH4QU tag=N2Z867A294OT type=write size=3702027 2024-09-14T11:01:56.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.541+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=3RBT23E2VTRL type=del size=2411142 2024-09-14T11:01:56.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.542+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=YZNFB3VS40XI type=del 2024-09-14T11:01:56.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.543+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=SWTIPAVP1FJ6 type=del size=3317792 2024-09-14T11:01:56.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.544+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=I3SJU61NNLNY type=del 2024-09-14T11:01:56.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.548+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~RN4MS0Z686PU.0 size=759115 2024-09-14T11:01:56.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.548+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=RN4MS0Z686PU tag=UTA02S3D9SUR type=write size=1807691 2024-09-14T11:01:56.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.549+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~XEQ83PI2L2NJ.0 size=1048576 2024-09-14T11:01:56.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.550+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~XEQ83PI2L2NJ.1 size=731928 2024-09-14T11:01:56.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.552+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=XEQ83PI2L2NJ tag=H6ICXOGDN64E type=write size=2829080 2024-09-14T11:01:56.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.554+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~JQLFS4P1Q8PS.0 size=1048576 2024-09-14T11:01:56.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.555+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~JQLFS4P1Q8PS.1 size=1048576 2024-09-14T11:01:56.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.556+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~JQLFS4P1Q8PS.2 size=352547 2024-09-14T11:01:56.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.556+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=JQLFS4P1Q8PS tag=XZEBG79EV4BI type=write size=3498275 2024-09-14T11:01:56.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.557+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~XIZLX0KUBWUV.0 size=1048576 2024-09-14T11:01:56.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.558+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~XIZLX0KUBWUV.1 size=750062 2024-09-14T11:01:56.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.560+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=XIZLX0KUBWUV tag=412HXSFC0JAC type=write size=2847214 2024-09-14T11:01:56.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.561+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=RDAKYRQE6EGQ type=del size=2093605 2024-09-14T11:01:56.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.563+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=R958FOIOIMNV type=del 2024-09-14T11:01:56.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.565+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~ET8BXM9B22N4.0 size=1048576 2024-09-14T11:01:56.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.566+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~ET8BXM9B22N4.1 size=30528 2024-09-14T11:01:56.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.566+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=ET8BXM9B22N4 tag=DI0D362HPKZQ type=write size=2127680 2024-09-14T11:01:56.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.568+0000 7fe3dd11f780 1 < suggested update operation key=KXL3E0PJBNBA tag=YQ39O712OUAS type=del size=4035653 2024-09-14T11:01:56.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.569+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=R9CKAX7EAN1B type=del size=1688542 2024-09-14T11:01:56.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.571+0000 7fe3dd11f780 -1 < failed to complete operation key=VDSOBBVO3QGB tag=L2ZEETKY53UQ type=del size=1218643: (22) Invalid argument 2024-09-14T11:01:56.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.572+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=5FGJOWXW98IF type=del size=1091085 2024-09-14T11:01:56.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.573+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~DGA67WI7HRMG.0 size=1048576 2024-09-14T11:01:56.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.574+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~DGA67WI7HRMG.1 size=1048576 2024-09-14T11:01:56.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.575+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~DGA67WI7HRMG.2 size=299225 2024-09-14T11:01:56.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.577+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=DGA67WI7HRMG tag=IJV60TLEVJL9 type=write size=3444953 2024-09-14T11:01:56.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.578+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=WE11E6FT0ME8 type=del size=2565196 2024-09-14T11:01:56.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.579+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~TQ0543TI958G.0 size=1048576 2024-09-14T11:01:56.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.580+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~TQ0543TI958G.1 size=526237 2024-09-14T11:01:56.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.582+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=TQ0543TI958G tag=9QHZ8AOFTZPL type=write size=2623389 2024-09-14T11:01:56.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.583+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=SSL6R93YZDP5 type=del size=3075852 2024-09-14T11:01:56.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.586+0000 7fe3dd11f780 1 < suggested update operation key=LDILBET1CMYY tag=OO67NOUVFFNY type=del size=2375717 2024-09-14T11:01:56.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.587+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=ROGU3EDCIEWL type=del size=216911 2024-09-14T11:01:56.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.588+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=HQVZUATVPLB3 type=del 2024-09-14T11:01:56.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.589+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=NP2JTLN7HFJT type=del size=4147374 2024-09-14T11:01:56.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.591+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~SB1NWV63LU5I.0 size=1048576 2024-09-14T11:01:56.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.592+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~SB1NWV63LU5I.1 size=20492 2024-09-14T11:01:56.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.594+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=SB1NWV63LU5I tag=ZDBS2TU1B01J type=write size=2117644 2024-09-14T11:01:56.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.595+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=OGWBT2OURWEC type=del size=3471139 2024-09-14T11:01:56.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.596+0000 7fe3dd11f780 1 < canceled operation key=M0DMAQ5LTDR0 tag=T5F19NOLNUOB type=del size=1203028 2024-09-14T11:01:56.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.597+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=57Y9N8KK4VQ1 type=del size=3012287 2024-09-14T11:01:56.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.598+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~UX6IXUILV1XJ.0 size=1048576 2024-09-14T11:01:56.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.599+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~UX6IXUILV1XJ.1 size=588162 2024-09-14T11:01:56.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.602+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=UX6IXUILV1XJ tag=B2TPZ35FTXUB type=write size=2685314 2024-09-14T11:01:56.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.603+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=VMOB0IX3UGCS type=del size=3379221 2024-09-14T11:01:56.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.604+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~2Q01UOJUB3YU.0 size=1048576 2024-09-14T11:01:56.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.605+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~2Q01UOJUB3YU.1 size=942717 2024-09-14T11:01:56.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.606+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=2Q01UOJUB3YU tag=FN6ETG373J8S type=write size=3039869 2024-09-14T11:01:56.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.609+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~C7K8R9QMI2T3.0 size=50171 2024-09-14T11:01:56.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.609+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=C7K8R9QMI2T3 tag=8MMDUMCQMVHK type=write size=1098747 2024-09-14T11:01:56.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.611+0000 7fe3dd11f780 1 < suggested update operation key=JG1RZQD4J2EB tag=3RBT23E2VTRL type=del size=2411142 2024-09-14T11:01:56.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.612+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=74T906FT6CTO type=del size=856437 2024-09-14T11:01:56.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.614+0000 7fe3dd11f780 1 < suggested update operation key=6PJ03TAYRUT8 tag=SWTIPAVP1FJ6 type=del size=3317792 2024-09-14T11:01:56.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.616+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~X58QA4JV9DBO.0 size=919881 2024-09-14T11:01:56.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.616+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=X58QA4JV9DBO tag=LYLA3H3WAS7T type=write size=1968457 2024-09-14T11:01:56.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.617+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~RN4MS0Z686PU.0 size=759115 2024-09-14T11:01:56.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.619+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=RN4MS0Z686PU tag=UTA02S3D9SUR type=write size=1807691 2024-09-14T11:01:56.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.620+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=RQKBAPHXLMMA type=write size=650892 2024-09-14T11:01:56.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.621+0000 7fe3dd11f780 1 < canceled part key=_multipart_A89YQO40BHUS.2~JQLFS4P1Q8PS.0 size=1048576 2024-09-14T11:01:56.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.622+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~JQLFS4P1Q8PS.1 size=1048576 2024-09-14T11:01:56.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.622+0000 7fe3dd11f780 1 < canceled part key=_multipart_A89YQO40BHUS.2~JQLFS4P1Q8PS.2 size=352547 2024-09-14T11:01:56.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.624+0000 7fe3dd11f780 1 < canceled multipart upload key=A89YQO40BHUS upload=JQLFS4P1Q8PS tag=XZEBG79EV4BI type=write size=3498275 2024-09-14T11:01:56.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.625+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=IF55AE2SB4K4 type=del size=3414855 2024-09-14T11:01:56.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.626+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=RDAKYRQE6EGQ type=del 2024-09-14T11:01:56.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.628+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~N4MYJZ8M9RAK.0 size=1048576 2024-09-14T11:01:56.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.629+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~N4MYJZ8M9RAK.1 size=941733 2024-09-14T11:01:56.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.629+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=N4MYJZ8M9RAK tag=7RZFQG71NZYV type=write size=3038885 2024-09-14T11:01:56.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.630+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~ET8BXM9B22N4.0 size=1048576 2024-09-14T11:01:56.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.631+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~ET8BXM9B22N4.1 size=30528 2024-09-14T11:01:56.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.633+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=ET8BXM9B22N4 tag=DI0D362HPKZQ type=write size=2127680 2024-09-14T11:01:56.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.634+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=1WJKCK5SIZV3 type=del size=3805750 2024-09-14T11:01:56.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.636+0000 7fe3dd11f780 1 < suggested remove operation key=A89YQO40BHUS tag=R9CKAX7EAN1B type=del 2024-09-14T11:01:56.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.638+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=TS9BCRBM0ZD6 type=del size=1299836 2024-09-14T11:01:56.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.639+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=5FGJOWXW98IF type=del 2024-09-14T11:01:56.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.641+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~LDYGTIRYT51S.0 size=1048576 2024-09-14T11:01:56.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.642+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~LDYGTIRYT51S.1 size=60107 2024-09-14T11:01:56.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.642+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=LDYGTIRYT51S tag=MAU8Z4IM15AK type=write size=2157259 2024-09-14T11:01:56.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.643+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=WE11E6FT0ME8 type=del 2024-09-14T11:01:56.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.644+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=BSVCEEX9HEZT type=del size=3203419 2024-09-14T11:01:56.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.645+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=SSL6R93YZDP5 type=del 2024-09-14T11:01:56.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.647+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=U42IP2LM9TMN type=write size=528442 2024-09-14T11:01:56.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.648+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=ROGU3EDCIEWL type=del 2024-09-14T11:01:56.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.650+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~VFHQGX8BI0K5.0 size=1048576 2024-09-14T11:01:56.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.651+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~VFHQGX8BI0K5.1 size=621243 2024-09-14T11:01:56.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.651+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=VFHQGX8BI0K5 tag=T611A6KFNZ38 type=write size=2718395 2024-09-14T11:01:56.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.652+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=NP2JTLN7HFJT type=del 2024-09-14T11:01:56.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.654+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~56MOLSXNAZ6J.0 size=839499 2024-09-14T11:01:56.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.654+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=56MOLSXNAZ6J tag=4O2PPXU6TTT9 type=write size=1888075 2024-09-14T11:01:56.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.656+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=OGWBT2OURWEC type=del 2024-09-14T11:01:56.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.658+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=19W9FR3GNQFE type=del size=3321304 2024-09-14T11:01:56.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.659+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=57Y9N8KK4VQ1 type=del 2024-09-14T11:01:56.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.661+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~23BV37KPYZ6L.0 size=1048576 2024-09-14T11:01:56.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.662+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~23BV37KPYZ6L.1 size=1048576 2024-09-14T11:01:56.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.663+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~23BV37KPYZ6L.2 size=967563 2024-09-14T11:01:56.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.663+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=23BV37KPYZ6L tag=WBFWQN72G0MB type=write size=4113291 2024-09-14T11:01:56.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.665+0000 7fe3dd11f780 1 < suggested update operation key=YMGE9GKLSPE6 tag=VMOB0IX3UGCS type=del size=3379221 2024-09-14T11:01:56.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.666+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=XWEKBZNKMECB type=del size=3966814 2024-09-14T11:01:56.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.667+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~C7K8R9QMI2T3.0 size=50171 2024-09-14T11:01:56.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.669+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=C7K8R9QMI2T3 tag=8MMDUMCQMVHK type=write size=1098747 2024-09-14T11:01:56.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.670+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=T20HTJWAGVYX type=del size=2590708 2024-09-14T11:01:56.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.671+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=74T906FT6CTO type=del 2024-09-14T11:01:56.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.673+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=VCA7ZSGIGJ3K type=del size=766598 2024-09-14T11:01:56.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.674+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~X58QA4JV9DBO.0 size=919881 2024-09-14T11:01:56.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.676+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=X58QA4JV9DBO tag=LYLA3H3WAS7T type=write size=1968457 2024-09-14T11:01:56.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.677+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=E6AI3SPHH0S3 type=del size=3262064 2024-09-14T11:01:56.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.678+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=RQKBAPHXLMMA type=write size=650892 2024-09-14T11:01:56.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.680+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~1DERZ9BPD943.0 size=1048576 2024-09-14T11:01:56.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.681+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~1DERZ9BPD943.1 size=1048576 2024-09-14T11:01:56.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.682+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~1DERZ9BPD943.2 size=772214 2024-09-14T11:01:56.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.682+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=1DERZ9BPD943 tag=JJTVBUVG2R65 type=write size=3917942 2024-09-14T11:01:56.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.684+0000 7fe3dd11f780 -1 < failed to complete operation key=A89YQO40BHUS tag=IF55AE2SB4K4 type=del size=3414855: (22) Invalid argument 2024-09-14T11:01:56.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.685+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=AFDR62RSO30K type=del size=3149180 2024-09-14T11:01:56.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.686+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~N4MYJZ8M9RAK.0 size=1048576 2024-09-14T11:01:56.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.687+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~N4MYJZ8M9RAK.1 size=941733 2024-09-14T11:01:56.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.689+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=N4MYJZ8M9RAK tag=7RZFQG71NZYV type=write size=3038885 2024-09-14T11:01:56.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.690+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=23PMKVZON3NY type=write size=616096 2024-09-14T11:01:56.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.691+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=1WJKCK5SIZV3 type=del 2024-09-14T11:01:56.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.692+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=OK3XRSL8LEW9 type=write size=731055 2024-09-14T11:01:56.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.694+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=TS9BCRBM0ZD6 type=del 2024-09-14T11:01:56.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.695+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=SMMTLN9HS5DF type=del size=462987 2024-09-14T11:01:56.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.696+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~LDYGTIRYT51S.0 size=1048576 2024-09-14T11:01:56.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.697+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~LDYGTIRYT51S.1 size=60107 2024-09-14T11:01:56.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.699+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=LDYGTIRYT51S tag=MAU8Z4IM15AK type=write size=2157259 2024-09-14T11:01:56.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.700+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=936Q8BC7BYC5 type=del size=1971223 2024-09-14T11:01:56.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.702+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=BSVCEEX9HEZT type=del 2024-09-14T11:01:56.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.703+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=APRJ0B9N52AH type=write size=297271 2024-09-14T11:01:56.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.704+0000 7fe3dd11f780 1 < completed write operation key=ZI5SFHGWCHJA tag=U42IP2LM9TMN type=write size=528442 2024-09-14T11:01:56.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.706+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=O9YQF8NQ3H9T type=del size=842452 2024-09-14T11:01:56.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.707+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~VFHQGX8BI0K5.0 size=1048576 2024-09-14T11:01:56.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.708+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~VFHQGX8BI0K5.1 size=621243 2024-09-14T11:01:56.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.710+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=VFHQGX8BI0K5 tag=T611A6KFNZ38 type=write size=2718395 2024-09-14T11:01:56.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.712+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~8VBMXIAKM8VV.0 size=115241 2024-09-14T11:01:56.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.712+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=8VBMXIAKM8VV tag=CYB7OVYGPCCS type=write size=1163817 2024-09-14T11:01:56.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.713+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~56MOLSXNAZ6J.0 size=839499 2024-09-14T11:01:56.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.715+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=56MOLSXNAZ6J tag=4O2PPXU6TTT9 type=write size=1888075 2024-09-14T11:01:56.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.716+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=2I6S6HHTSJNO type=del size=2759972 2024-09-14T11:01:56.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.717+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=19W9FR3GNQFE type=del 2024-09-14T11:01:56.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.719+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~MLIYPOAMUE3R.0 size=1048576 2024-09-14T11:01:56.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.720+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~MLIYPOAMUE3R.1 size=1048576 2024-09-14T11:01:56.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.721+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~MLIYPOAMUE3R.2 size=841209 2024-09-14T11:01:56.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.721+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=MLIYPOAMUE3R tag=FL0OTKDV807I type=write size=3986937 2024-09-14T11:01:56.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.722+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~23BV37KPYZ6L.0 size=1048576 2024-09-14T11:01:56.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.723+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~23BV37KPYZ6L.1 size=1048576 2024-09-14T11:01:56.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.724+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~23BV37KPYZ6L.2 size=967563 2024-09-14T11:01:56.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.726+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=23BV37KPYZ6L tag=WBFWQN72G0MB type=write size=4113291 2024-09-14T11:01:56.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.729+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~NN8M2JJSCD63.0 size=1048576 2024-09-14T11:01:56.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.730+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~NN8M2JJSCD63.1 size=607028 2024-09-14T11:01:56.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.730+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=NN8M2JJSCD63 tag=XZJ8D0JUVTR3 type=write size=2704180 2024-09-14T11:01:56.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.731+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=XWEKBZNKMECB type=del 2024-09-14T11:01:56.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.732+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=U4MMFVSXXI2V type=del size=714261 2024-09-14T11:01:56.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.733+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=T20HTJWAGVYX type=del 2024-09-14T11:01:56.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.736+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0XUB59BNAOJM.0 size=1048576 2024-09-14T11:01:56.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.737+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0XUB59BNAOJM.1 size=1048576 2024-09-14T11:01:56.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.738+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0XUB59BNAOJM.2 size=526487 2024-09-14T11:01:56.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.738+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=0XUB59BNAOJM tag=PH8MEG3G56OJ type=write size=3672215 2024-09-14T11:01:56.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.740+0000 7fe3dd11f780 1 < suggested update operation key=3PS4LAML698X tag=VCA7ZSGIGJ3K type=del size=766598 2024-09-14T11:01:56.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.741+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=JPM4FWYETPG1 type=del size=1184768 2024-09-14T11:01:56.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.744+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=E6AI3SPHH0S3 type=del 2024-09-14T11:01:56.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.746+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~R32JXK23DDMZ.0 size=1048576 2024-09-14T11:01:56.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.747+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~R32JXK23DDMZ.1 size=1048576 2024-09-14T11:01:56.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.748+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~R32JXK23DDMZ.2 size=479660 2024-09-14T11:01:56.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.748+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=R32JXK23DDMZ tag=QYILKMO2N4M8 type=write size=3625388 2024-09-14T11:01:56.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.749+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~1DERZ9BPD943.0 size=1048576 2024-09-14T11:01:56.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.750+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~1DERZ9BPD943.1 size=1048576 2024-09-14T11:01:56.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.751+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~1DERZ9BPD943.2 size=772214 2024-09-14T11:01:56.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.753+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=1DERZ9BPD943 tag=JJTVBUVG2R65 type=write size=3917942 2024-09-14T11:01:56.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.754+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=ZI2LT5X8HJ7P type=del size=287749 2024-09-14T11:01:56.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.756+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=AFDR62RSO30K type=del 2024-09-14T11:01:56.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.757+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=ZH831VA2QPK5 type=write size=178798 2024-09-14T11:01:56.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.758+0000 7fe3dd11f780 1 < canceled operation key=0PT98N1VBWAG tag=23PMKVZON3NY type=write size=616096 2024-09-14T11:01:56.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.760+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~Z84XUZ13W5WO.0 size=485116 2024-09-14T11:01:56.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.760+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=Z84XUZ13W5WO tag=53W269ZETC62 type=write size=1533692 2024-09-14T11:01:56.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.761+0000 7fe3dd11f780 1 < completed write operation key=ZTD98WQ6032X tag=OK3XRSL8LEW9 type=write size=731055 2024-09-14T11:01:56.760 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.763+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=HRXOZ7E0O4HI type=del size=3264152 2024-09-14T11:01:56.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.765+0000 7fe3dd11f780 1 < suggested remove operation key=EGC5988RQOEZ tag=SMMTLN9HS5DF type=del 2024-09-14T11:01:56.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.766+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=6VZ29XLDEUGP type=del size=3053912 2024-09-14T11:01:56.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.769+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=936Q8BC7BYC5 type=del 2024-09-14T11:01:56.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.770+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=IIK5UBNLOI7J type=del size=3222300 2024-09-14T11:01:56.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.771+0000 7fe3dd11f780 1 < completed write operation key=0PT98N1VBWAG tag=APRJ0B9N52AH type=write size=297271 2024-09-14T11:01:56.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.773+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=54KCD6B2KNDN type=del size=2709058 2024-09-14T11:01:56.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.775+0000 7fe3dd11f780 1 < suggested remove operation key=V692HUUJP2RC tag=O9YQF8NQ3H9T type=del 2024-09-14T11:01:56.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.776+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=2D5VKAYP5JRW type=del size=2020241 2024-09-14T11:01:56.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.777+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~8VBMXIAKM8VV.0 size=115241 2024-09-14T11:01:56.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.779+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=8VBMXIAKM8VV tag=CYB7OVYGPCCS type=write size=1163817 2024-09-14T11:01:56.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.781+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~BO32FAFXJ7DV.0 size=990986 2024-09-14T11:01:56.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.781+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=BO32FAFXJ7DV tag=CQ3UY8JPDZWX type=write size=2039562 2024-09-14T11:01:56.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.782+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=2I6S6HHTSJNO type=del 2024-09-14T11:01:56.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.784+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=OR2W9Y63AD15 type=del size=4129242 2024-09-14T11:01:56.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.785+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~MLIYPOAMUE3R.0 size=1048576 2024-09-14T11:01:56.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.785+0000 7fe3dd11f780 1 < canceled part key=_multipart_UYZGHGZR74HQ.2~MLIYPOAMUE3R.1 size=1048576 2024-09-14T11:01:56.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.786+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~MLIYPOAMUE3R.2 size=841209 2024-09-14T11:01:56.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.788+0000 7fe3dd11f780 1 < canceled multipart upload key=UYZGHGZR74HQ upload=MLIYPOAMUE3R tag=FL0OTKDV807I type=write size=3986937 2024-09-14T11:01:56.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.789+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=Q0WWQORIT35O type=del size=2038026 2024-09-14T11:01:56.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.790+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~NN8M2JJSCD63.0 size=1048576 2024-09-14T11:01:56.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.791+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~NN8M2JJSCD63.1 size=607028 2024-09-14T11:01:56.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.793+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=NN8M2JJSCD63 tag=XZJ8D0JUVTR3 type=write size=2704180 2024-09-14T11:01:56.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.795+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=WWX7KBS272ZH type=del size=2081603 2024-09-14T11:01:56.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.796+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=U4MMFVSXXI2V type=del 2024-09-14T11:01:56.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.797+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=05KDD8GFXZ6Q type=del size=1294485 2024-09-14T11:01:56.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.799+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~0XUB59BNAOJM.0 size=1048576 2024-09-14T11:01:56.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.799+0000 7fe3dd11f780 1 < canceled part key=_multipart_V692HUUJP2RC.2~0XUB59BNAOJM.1 size=1048576 2024-09-14T11:01:56.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.800+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~0XUB59BNAOJM.2 size=526487 2024-09-14T11:01:56.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.802+0000 7fe3dd11f780 1 < canceled multipart upload key=V692HUUJP2RC upload=0XUB59BNAOJM tag=PH8MEG3G56OJ type=write size=3672215 2024-09-14T11:01:56.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.803+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=S7AN5KMHFY00 type=del size=141869 2024-09-14T11:01:56.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.804+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=JPM4FWYETPG1 type=del 2024-09-14T11:01:56.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.805+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=8UKW4DLRW5DQ type=del size=2201587 2024-09-14T11:01:56.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.807+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~R32JXK23DDMZ.0 size=1048576 2024-09-14T11:01:56.805 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.808+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~R32JXK23DDMZ.1 size=1048576 2024-09-14T11:01:56.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.809+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~R32JXK23DDMZ.2 size=479660 2024-09-14T11:01:56.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.811+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=R32JXK23DDMZ tag=QYILKMO2N4M8 type=write size=3625388 2024-09-14T11:01:56.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.813+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~VV2WL1ZHEJZV.0 size=1048576 2024-09-14T11:01:56.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.814+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~VV2WL1ZHEJZV.1 size=928344 2024-09-14T11:01:56.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.814+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=VV2WL1ZHEJZV tag=PVO2WWGVQQAY type=write size=3025496 2024-09-14T11:01:56.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.815+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=ZI2LT5X8HJ7P type=del 2024-09-14T11:01:56.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.817+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~64QFCC3ERYY6.0 size=1048576 2024-09-14T11:01:56.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.818+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~64QFCC3ERYY6.1 size=1048576 2024-09-14T11:01:56.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.819+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~64QFCC3ERYY6.2 size=202004 2024-09-14T11:01:56.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.819+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=64QFCC3ERYY6 tag=6VRB5NUZEIC7 type=write size=3347732 2024-09-14T11:01:56.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.821+0000 7fe3dd11f780 1 < completed write operation key=0PT98N1VBWAG tag=ZH831VA2QPK5 type=write size=178798 2024-09-14T11:01:56.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.822+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=ZWWN1KLVMW0I type=write size=165603 2024-09-14T11:01:56.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.823+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~Z84XUZ13W5WO.0 size=485116 2024-09-14T11:01:56.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.825+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=Z84XUZ13W5WO tag=53W269ZETC62 type=write size=1533692 2024-09-14T11:01:56.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.826+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=JAUQ2YOXS34C type=write size=1047319 2024-09-14T11:01:56.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.828+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=HRXOZ7E0O4HI type=del 2024-09-14T11:01:56.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.830+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~HYF3C741NQFF.0 size=372224 2024-09-14T11:01:56.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.830+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=HYF3C741NQFF tag=GR4XK0SYN6HN type=write size=1420800 2024-09-14T11:01:56.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.832+0000 7fe3dd11f780 1 < suggested update operation key=LFKLJAJWQ2J6 tag=6VZ29XLDEUGP type=del size=3053912 2024-09-14T11:01:56.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.833+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=FWB0FLY4562S type=del size=3337832 2024-09-14T11:01:56.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.834+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=IIK5UBNLOI7J type=del 2024-09-14T11:01:56.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.835+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=9UQ9TY7M2LGJ type=del size=3953337 2024-09-14T11:01:56.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.837+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=54KCD6B2KNDN type=del 2024-09-14T11:01:56.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.839+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~BHVB5E6NY3KQ.0 size=1048576 2024-09-14T11:01:56.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.840+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~BHVB5E6NY3KQ.1 size=1048576 2024-09-14T11:01:56.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.841+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~BHVB5E6NY3KQ.2 size=516035 2024-09-14T11:01:56.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.841+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=BHVB5E6NY3KQ tag=GLO984RVP2PR type=write size=3661763 2024-09-14T11:01:56.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.842+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=2D5VKAYP5JRW type=del 2024-09-14T11:01:56.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.843+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=MPO0CJW6ZD35 type=del size=831076 2024-09-14T11:01:56.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.845+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~BO32FAFXJ7DV.0 size=990986 2024-09-14T11:01:56.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.847+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=BO32FAFXJ7DV tag=CQ3UY8JPDZWX type=write size=2039562 2024-09-14T11:01:56.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.848+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=ZJZRB5RZGLAK type=del size=3891282 2024-09-14T11:01:56.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.849+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=OR2W9Y63AD15 type=del 2024-09-14T11:01:56.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.850+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=LTCQEF8W25JU type=del size=3634495 2024-09-14T11:01:56.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.852+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=Q0WWQORIT35O type=del 2024-09-14T11:01:56.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.853+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=AO6JBO72C4TJ type=del size=3149924 2024-09-14T11:01:56.852 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.855+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=WWX7KBS272ZH type=del 2024-09-14T11:01:56.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.857+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~W86BT3QSIGJX.0 size=586163 2024-09-14T11:01:56.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.857+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=W86BT3QSIGJX tag=9OQLNOSGLAY7 type=write size=1634739 2024-09-14T11:01:56.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.858+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=05KDD8GFXZ6Q type=del 2024-09-14T11:01:56.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.860+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=EPP371CWYPZD type=del size=2876985 2024-09-14T11:01:56.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.861+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=S7AN5KMHFY00 type=del 2024-09-14T11:01:56.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.862+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=L863H76477BY type=del size=2255789 2024-09-14T11:01:56.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.864+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=8UKW4DLRW5DQ type=del 2024-09-14T11:01:56.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.865+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=S0IYO29WI2UK type=del size=3845885 2024-09-14T11:01:56.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.866+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~VV2WL1ZHEJZV.0 size=1048576 2024-09-14T11:01:56.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.867+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~VV2WL1ZHEJZV.1 size=928344 2024-09-14T11:01:56.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.869+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=VV2WL1ZHEJZV tag=PVO2WWGVQQAY type=write size=3025496 2024-09-14T11:01:56.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.871+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~LNLMLBOPI5BU.0 size=1048576 2024-09-14T11:01:56.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.872+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~LNLMLBOPI5BU.1 size=246663 2024-09-14T11:01:56.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.872+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=LNLMLBOPI5BU tag=1ZNU5B042513 type=write size=2343815 2024-09-14T11:01:56.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.873+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~64QFCC3ERYY6.0 size=1048576 2024-09-14T11:01:56.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.874+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~64QFCC3ERYY6.1 size=1048576 2024-09-14T11:01:56.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.874+0000 7fe3dd11f780 1 < canceled part key=_multipart_PHLQ77OMLI37.2~64QFCC3ERYY6.2 size=202004 2024-09-14T11:01:56.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.876+0000 7fe3dd11f780 1 < canceled multipart upload key=PHLQ77OMLI37 upload=64QFCC3ERYY6 tag=6VRB5NUZEIC7 type=write size=3347732 2024-09-14T11:01:56.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.878+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=O799KU08DBHO type=del size=3685446 2024-09-14T11:01:56.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.880+0000 7fe3dd11f780 1 < suggested update operation key=4JTN39NIB2UE tag=ZWWN1KLVMW0I type=write size=165603 2024-09-14T11:01:56.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.882+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~MN0BXZ3AR3Z2.0 size=705932 2024-09-14T11:01:56.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.882+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=MN0BXZ3AR3Z2 tag=Z8WOVUXNQ1QH type=write size=1754508 2024-09-14T11:01:56.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.884+0000 7fe3dd11f780 1 < completed write operation key=OK5L92EKOOMW tag=JAUQ2YOXS34C type=write size=1047319 2024-09-14T11:01:56.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.886+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=AERAO2CRKBAB type=write size=24422 2024-09-14T11:01:56.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.887+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~HYF3C741NQFF.0 size=372224 2024-09-14T11:01:56.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.889+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=HYF3C741NQFF tag=GR4XK0SYN6HN type=write size=1420800 2024-09-14T11:01:56.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.890+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=LVH9HN2YQ025 type=del size=749229 2024-09-14T11:01:56.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.891+0000 7fe3dd11f780 -1 < failed to complete operation key=4JTN39NIB2UE tag=FWB0FLY4562S type=del size=3337832: (22) Invalid argument 2024-09-14T11:01:56.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.893+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=AX5HCAOXV67R type=del size=2264605 2024-09-14T11:01:56.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.894+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=9UQ9TY7M2LGJ type=del 2024-09-14T11:01:56.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.895+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=3JEY8IR2S71J type=write size=35675 2024-09-14T11:01:56.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.896+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~BHVB5E6NY3KQ.0 size=1048576 2024-09-14T11:01:56.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.897+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~BHVB5E6NY3KQ.1 size=1048576 2024-09-14T11:01:56.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.898+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~BHVB5E6NY3KQ.2 size=516035 2024-09-14T11:01:56.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.900+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=BHVB5E6NY3KQ tag=GLO984RVP2PR type=write size=3661763 2024-09-14T11:01:56.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.902+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=DK500Z06KO0V type=write size=319498 2024-09-14T11:01:56.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.903+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=MPO0CJW6ZD35 type=del 2024-09-14T11:01:56.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.905+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~07EHFREB4OYP.0 size=1048576 2024-09-14T11:01:56.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.906+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~07EHFREB4OYP.1 size=1048576 2024-09-14T11:01:56.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.907+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~07EHFREB4OYP.2 size=711583 2024-09-14T11:01:56.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.907+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=07EHFREB4OYP tag=5V5XBCDFFSBT type=write size=3857311 2024-09-14T11:01:56.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.908+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=ZJZRB5RZGLAK type=del 2024-09-14T11:01:56.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.910+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~WJF91NRLH77P.0 size=1048576 2024-09-14T11:01:56.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.911+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~WJF91NRLH77P.1 size=613243 2024-09-14T11:01:56.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.911+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=WJF91NRLH77P tag=F0JFQC8TN741 type=write size=2710395 2024-09-14T11:01:56.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.912+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=LTCQEF8W25JU type=del 2024-09-14T11:01:56.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.914+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=PATREYPU3SW4 type=write size=233272 2024-09-14T11:01:56.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.915+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=AO6JBO72C4TJ type=del 2024-09-14T11:01:56.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.917+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~W0J3FFSHUE7Z.0 size=1048576 2024-09-14T11:01:56.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.918+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~W0J3FFSHUE7Z.1 size=816607 2024-09-14T11:01:56.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.918+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=W0J3FFSHUE7Z tag=4XNEHUBMV7KW type=write size=2913759 2024-09-14T11:01:56.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.920+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~W86BT3QSIGJX.0 size=586163 2024-09-14T11:01:56.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.922+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=W86BT3QSIGJX tag=9OQLNOSGLAY7 type=write size=1634739 2024-09-14T11:01:56.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.923+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=OQCHOD3FVMDB type=del size=2286306 2024-09-14T11:01:56.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.924+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=EPP371CWYPZD type=del 2024-09-14T11:01:56.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.926+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=KWL9VKM901HP type=del size=1224793 2024-09-14T11:01:56.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.928+0000 7fe3dd11f780 1 < suggested remove operation key=ZTD98WQ6032X tag=L863H76477BY type=del 2024-09-14T11:01:56.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.929+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=CB7BBXH2GBEO type=del size=1400120 2024-09-14T11:01:56.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.931+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=S0IYO29WI2UK type=del 2024-09-14T11:01:56.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.933+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~HRDNDM4IZYVO.0 size=49846 2024-09-14T11:01:56.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.933+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=HRDNDM4IZYVO tag=YXA8AWT443TZ type=write size=1098422 2024-09-14T11:01:56.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.934+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~LNLMLBOPI5BU.0 size=1048576 2024-09-14T11:01:56.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.935+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~LNLMLBOPI5BU.1 size=246663 2024-09-14T11:01:56.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.938+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=LNLMLBOPI5BU tag=1ZNU5B042513 type=write size=2343815 2024-09-14T11:01:56.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.940+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~CI2G2X5Y3V4A.0 size=1048576 2024-09-14T11:01:56.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.941+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~CI2G2X5Y3V4A.1 size=1048576 2024-09-14T11:01:56.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.942+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~CI2G2X5Y3V4A.2 size=347185 2024-09-14T11:01:56.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.942+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=CI2G2X5Y3V4A tag=USO6A0X7D3XE type=write size=3492913 2024-09-14T11:01:56.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.944+0000 7fe3dd11f780 1 < suggested update operation key=M0DMAQ5LTDR0 tag=O799KU08DBHO type=del size=3685446 2024-09-14T11:01:56.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.946+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~SIK3JX9MCRY8.0 size=1048576 2024-09-14T11:01:56.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.948+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~SIK3JX9MCRY8.1 size=758885 2024-09-14T11:01:56.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.948+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=SIK3JX9MCRY8 tag=1BTTLQP9EK69 type=write size=2856037 2024-09-14T11:01:56.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.948+0000 7fe3dd11f780 1 < canceled part key=_multipart_EGC5988RQOEZ.2~MN0BXZ3AR3Z2.0 size=705932 2024-09-14T11:01:56.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.950+0000 7fe3dd11f780 1 < canceled multipart upload key=EGC5988RQOEZ upload=MN0BXZ3AR3Z2 tag=Z8WOVUXNQ1QH type=write size=1754508 2024-09-14T11:01:56.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.951+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=SH8IIF0F8UQE type=del size=553202 2024-09-14T11:01:56.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.952+0000 7fe3dd11f780 1 < completed write operation key=US8KP3YL88TG tag=AERAO2CRKBAB type=write size=24422 2024-09-14T11:01:56.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.954+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=XFM6G936GE1O type=del size=872656 2024-09-14T11:01:56.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.955+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=LVH9HN2YQ025 type=del 2024-09-14T11:01:56.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.957+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~O2P88LQHN2E6.0 size=1048576 2024-09-14T11:01:56.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.958+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~O2P88LQHN2E6.1 size=630853 2024-09-14T11:01:56.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.958+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=O2P88LQHN2E6 tag=Y1QJ8CM5WC8C type=write size=2728005 2024-09-14T11:01:56.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.960+0000 7fe3dd11f780 1 < canceled operation key=A89YQO40BHUS tag=AX5HCAOXV67R type=del size=2264605 2024-09-14T11:01:56.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.961+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=SQ871IVMBGXT type=del size=1697858 2024-09-14T11:01:56.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.963+0000 7fe3dd11f780 1 < suggested update operation key=UYZGHGZR74HQ tag=3JEY8IR2S71J type=write size=35675 2024-09-14T11:01:56.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.965+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~M4QM6ZFMC5CY.0 size=1048576 2024-09-14T11:01:56.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.966+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~M4QM6ZFMC5CY.1 size=1048576 2024-09-14T11:01:56.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.967+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~M4QM6ZFMC5CY.2 size=336589 2024-09-14T11:01:56.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.967+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=M4QM6ZFMC5CY tag=M8QBIW2EXQXO type=write size=3482317 2024-09-14T11:01:56.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.968+0000 7fe3dd11f780 1 < completed write operation key=K9BP30LHDPA1 tag=DK500Z06KO0V type=write size=319498 2024-09-14T11:01:56.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.970+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=KK4NXHE3YV1S type=write size=309229 2024-09-14T11:01:56.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.971+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~07EHFREB4OYP.0 size=1048576 2024-09-14T11:01:56.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.972+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~07EHFREB4OYP.1 size=1048576 2024-09-14T11:01:56.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.973+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~07EHFREB4OYP.2 size=711583 2024-09-14T11:01:56.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.975+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=07EHFREB4OYP tag=5V5XBCDFFSBT type=write size=3857311 2024-09-14T11:01:56.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.976+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=DI1XW9QBUOZ1 type=del size=2655055 2024-09-14T11:01:56.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.977+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~WJF91NRLH77P.0 size=1048576 2024-09-14T11:01:56.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.978+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~WJF91NRLH77P.1 size=613243 2024-09-14T11:01:56.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.980+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=WJF91NRLH77P tag=F0JFQC8TN741 type=write size=2710395 2024-09-14T11:01:56.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.982+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=UGMC0H2OCTIS type=del size=3826509 2024-09-14T11:01:56.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.984+0000 7fe3dd11f780 1 < suggested remove operation key=MD0OU8IC5PYI tag=PATREYPU3SW4 type=write 2024-09-14T11:01:56.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.985+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=SUTPWC46OP58 type=write size=247682 2024-09-14T11:01:56.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.986+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~W0J3FFSHUE7Z.0 size=1048576 2024-09-14T11:01:56.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.987+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~W0J3FFSHUE7Z.1 size=816607 2024-09-14T11:01:56.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.989+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=W0J3FFSHUE7Z tag=4XNEHUBMV7KW type=write size=2913759 2024-09-14T11:01:56.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.991+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~XCQN4D0JC1NU.0 size=712098 2024-09-14T11:01:56.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.991+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=XCQN4D0JC1NU tag=37AE7A0R04O4 type=write size=1760674 2024-09-14T11:01:56.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.992+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=OQCHOD3FVMDB type=del 2024-09-14T11:01:56.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.993+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=9QM4CWJ23CNP type=del size=2240018 2024-09-14T11:01:56.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.994+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=KWL9VKM901HP type=del 2024-09-14T11:01:56.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.995+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=7KQQTJ0SWBNP type=write size=623485 2024-09-14T11:01:56.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.996+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=CB7BBXH2GBEO type=del 2024-09-14T11:01:56.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:56.999+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=TXV14479KQCD type=del size=482925 2024-09-14T11:01:56.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.000+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~HRDNDM4IZYVO.0 size=49846 2024-09-14T11:01:57.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.002+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=HRDNDM4IZYVO tag=YXA8AWT443TZ type=write size=1098422 2024-09-14T11:01:57.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.004+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~UFQQCA7X9ODX.0 size=227051 2024-09-14T11:01:57.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.004+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=UFQQCA7X9ODX tag=JORSRX1B9YK7 type=write size=1275627 2024-09-14T11:01:57.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.005+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~CI2G2X5Y3V4A.0 size=1048576 2024-09-14T11:01:57.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.006+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~CI2G2X5Y3V4A.1 size=1048576 2024-09-14T11:01:57.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.007+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~CI2G2X5Y3V4A.2 size=347185 2024-09-14T11:01:57.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.009+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=CI2G2X5Y3V4A tag=USO6A0X7D3XE type=write size=3492913 2024-09-14T11:01:57.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.010+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=P4V31NY53KCF type=write size=584894 2024-09-14T11:01:57.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.011+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~SIK3JX9MCRY8.0 size=1048576 2024-09-14T11:01:57.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.012+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~SIK3JX9MCRY8.1 size=758885 2024-09-14T11:01:57.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.014+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=SIK3JX9MCRY8 tag=1BTTLQP9EK69 type=write size=2856037 2024-09-14T11:01:57.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.016+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~YEGS2AVAPH7X.0 size=1048576 2024-09-14T11:01:57.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.017+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~YEGS2AVAPH7X.1 size=199617 2024-09-14T11:01:57.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.017+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=YEGS2AVAPH7X tag=9D6FXPN1B6MU type=write size=2296769 2024-09-14T11:01:57.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.018+0000 7fe3dd11f780 -1 < failed to complete operation key=UYZGHGZR74HQ tag=SH8IIF0F8UQE type=del size=553202: (22) Invalid argument 2024-09-14T11:01:57.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.019+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=G3270UJKU0RT type=del size=999833 2024-09-14T11:01:57.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.021+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=XFM6G936GE1O type=del 2024-09-14T11:01:57.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.022+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=4R8ARHAI27BX type=del size=2964537 2024-09-14T11:01:57.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.023+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~O2P88LQHN2E6.0 size=1048576 2024-09-14T11:01:57.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.024+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~O2P88LQHN2E6.1 size=630853 2024-09-14T11:01:57.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.026+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=O2P88LQHN2E6 tag=Y1QJ8CM5WC8C type=write size=2728005 2024-09-14T11:01:57.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.027+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=OVFY2N1QX1PR type=del size=153022 2024-09-14T11:01:57.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.029+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=SQ871IVMBGXT type=del 2024-09-14T11:01:57.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.030+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=HFA4BAPTKL1E type=del size=3168797 2024-09-14T11:01:57.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.031+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~M4QM6ZFMC5CY.0 size=1048576 2024-09-14T11:01:57.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.033+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~M4QM6ZFMC5CY.1 size=1048576 2024-09-14T11:01:57.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.034+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~M4QM6ZFMC5CY.2 size=336589 2024-09-14T11:01:57.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.035+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=M4QM6ZFMC5CY tag=M8QBIW2EXQXO type=write size=3482317 2024-09-14T11:01:57.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.038+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~H6H20K1GE5I1.0 size=45269 2024-09-14T11:01:57.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.038+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=H6H20K1GE5I1 tag=9V4IT0D6EUYE type=write size=1093845 2024-09-14T11:01:57.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.039+0000 7fe3dd11f780 1 < completed write operation key=LDILBET1CMYY tag=KK4NXHE3YV1S type=write size=309229 2024-09-14T11:01:57.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.040+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=0MC0H0KIM0ZT type=del size=688112 2024-09-14T11:01:57.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.041+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=DI1XW9QBUOZ1 type=del 2024-09-14T11:01:57.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.043+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=ZLNHA0HAOA97 type=del size=402456 2024-09-14T11:01:57.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.044+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=UGMC0H2OCTIS type=del 2024-09-14T11:01:57.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.046+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=R1BWY3U3P7F2 type=del size=1927609 2024-09-14T11:01:57.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.047+0000 7fe3dd11f780 1 < canceled operation key=A89YQO40BHUS tag=SUTPWC46OP58 type=write size=247682 2024-09-14T11:01:57.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.049+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~SV3HCUCR8TGE.0 size=66912 2024-09-14T11:01:57.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.049+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=SV3HCUCR8TGE tag=NU06CHWWC2L2 type=write size=1115488 2024-09-14T11:01:57.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.051+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~XCQN4D0JC1NU.0 size=712098 2024-09-14T11:01:57.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.053+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=XCQN4D0JC1NU tag=37AE7A0R04O4 type=write size=1760674 2024-09-14T11:01:57.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.055+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~QXIOP570F492.0 size=1048576 2024-09-14T11:01:57.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.056+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~QXIOP570F492.1 size=260672 2024-09-14T11:01:57.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.056+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=QXIOP570F492 tag=40C3P6N9KK08 type=write size=2357824 2024-09-14T11:01:57.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.057+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=9QM4CWJ23CNP type=del 2024-09-14T11:01:57.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.058+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=6L5XVULQUNIG type=del size=3968385 2024-09-14T11:01:57.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.059+0000 7fe3dd11f780 1 < completed write operation key=22TI1VCDTK5P tag=7KQQTJ0SWBNP type=write size=623485 2024-09-14T11:01:57.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.061+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~05NNFCJSHGZJ.0 size=1048576 2024-09-14T11:01:57.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.062+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~05NNFCJSHGZJ.1 size=596882 2024-09-14T11:01:57.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.062+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=05NNFCJSHGZJ tag=2MY69AJ6LK8T type=write size=2694034 2024-09-14T11:01:57.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.065+0000 7fe3dd11f780 1 < suggested update operation key=LFKLJAJWQ2J6 tag=TXV14479KQCD type=del size=482925 2024-09-14T11:01:57.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.066+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=JTMIA582FP5A type=del size=3366346 2024-09-14T11:01:57.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.067+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~UFQQCA7X9ODX.0 size=227051 2024-09-14T11:01:57.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.069+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=UFQQCA7X9ODX tag=JORSRX1B9YK7 type=write size=1275627 2024-09-14T11:01:57.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.070+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=CAKPLOKEMORM type=del size=396136 2024-09-14T11:01:57.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.073+0000 7fe3dd11f780 1 < suggested remove operation key=K9BP30LHDPA1 tag=P4V31NY53KCF type=write 2024-09-14T11:01:57.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.074+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=ZG125Q3J3YYZ type=del size=1832564 2024-09-14T11:01:57.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.075+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~YEGS2AVAPH7X.0 size=1048576 2024-09-14T11:01:57.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.076+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~YEGS2AVAPH7X.1 size=199617 2024-09-14T11:01:57.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.078+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=YEGS2AVAPH7X tag=9D6FXPN1B6MU type=write size=2296769 2024-09-14T11:01:57.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.079+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=VR6HUHWCZM4S type=del size=2269835 2024-09-14T11:01:57.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.081+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=G3270UJKU0RT type=del 2024-09-14T11:01:57.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.083+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~M0A09V7K8KNH.0 size=1048576 2024-09-14T11:01:57.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.084+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~M0A09V7K8KNH.1 size=1048576 2024-09-14T11:01:57.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.085+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~M0A09V7K8KNH.2 size=414917 2024-09-14T11:01:57.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.085+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=M0A09V7K8KNH tag=M1ROFGINPA3Q type=write size=3560645 2024-09-14T11:01:57.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.086+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=4R8ARHAI27BX type=del 2024-09-14T11:01:57.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.087+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=BD0I5XB9Z0F8 type=write size=276277 2024-09-14T11:01:57.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.088+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=OVFY2N1QX1PR type=del 2024-09-14T11:01:57.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.089+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=9WXC7RNP525L type=del size=3597761 2024-09-14T11:01:57.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.090+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=HFA4BAPTKL1E type=del 2024-09-14T11:01:57.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.092+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~5J2TIF6CFM2U.0 size=1048576 2024-09-14T11:01:57.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.093+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~5J2TIF6CFM2U.1 size=346109 2024-09-14T11:01:57.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.093+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=5J2TIF6CFM2U tag=U72PV129COWQ type=write size=2443261 2024-09-14T11:01:57.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.094+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~H6H20K1GE5I1.0 size=45269 2024-09-14T11:01:57.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.096+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=H6H20K1GE5I1 tag=9V4IT0D6EUYE type=write size=1093845 2024-09-14T11:01:57.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.097+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=PZHL5ZLF9A2U type=del size=750203 2024-09-14T11:01:57.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.100+0000 7fe3dd11f780 1 < suggested remove operation key=YXPZXFY8930D tag=0MC0H0KIM0ZT type=del 2024-09-14T11:01:57.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.101+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=V3524G00ILMA type=del size=1687470 2024-09-14T11:01:57.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.102+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=ZLNHA0HAOA97 type=del 2024-09-14T11:01:57.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.104+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~T9AWUVR7G5UR.0 size=158603 2024-09-14T11:01:57.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.104+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=T9AWUVR7G5UR tag=AXX9NQQ7AN1F type=write size=1207179 2024-09-14T11:01:57.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.105+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=R1BWY3U3P7F2 type=del 2024-09-14T11:01:57.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.107+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~6KZJWA60M3MM.0 size=848872 2024-09-14T11:01:57.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.107+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=6KZJWA60M3MM tag=8Q67BX3UBQDZ type=write size=1897448 2024-09-14T11:01:57.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.108+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~SV3HCUCR8TGE.0 size=66912 2024-09-14T11:01:57.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.111+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=SV3HCUCR8TGE tag=NU06CHWWC2L2 type=write size=1115488 2024-09-14T11:01:57.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.112+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=5JTLOL9JPXTH type=del size=232583 2024-09-14T11:01:57.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.114+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~QXIOP570F492.0 size=1048576 2024-09-14T11:01:57.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.114+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~QXIOP570F492.1 size=260672 2024-09-14T11:01:57.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.116+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=QXIOP570F492 tag=40C3P6N9KK08 type=write size=2357824 2024-09-14T11:01:57.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.117+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=C1UYU3Z4G4FL type=del size=2718835 2024-09-14T11:01:57.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.119+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=6L5XVULQUNIG type=del 2024-09-14T11:01:57.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.120+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=DTV3CFXAB3U0 type=write size=910331 2024-09-14T11:01:57.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.121+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~05NNFCJSHGZJ.0 size=1048576 2024-09-14T11:01:57.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.122+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~05NNFCJSHGZJ.1 size=596882 2024-09-14T11:01:57.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.124+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=05NNFCJSHGZJ tag=2MY69AJ6LK8T type=write size=2694034 2024-09-14T11:01:57.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.126+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~QWRL62MQS24K.0 size=411546 2024-09-14T11:01:57.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.126+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=QWRL62MQS24K tag=1NN0BF5GGK79 type=write size=1460122 2024-09-14T11:01:57.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.127+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=JTMIA582FP5A type=del 2024-09-14T11:01:57.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.128+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=H6QVDQOYXKDU type=del size=1805679 2024-09-14T11:01:57.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.130+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=CAKPLOKEMORM type=del 2024-09-14T11:01:57.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.131+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=J4Y4U2CNCV20 type=del size=1273949 2024-09-14T11:01:57.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.132+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=ZG125Q3J3YYZ type=del 2024-09-14T11:01:57.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.134+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=T9O8OBM1RHY4 type=del size=902003 2024-09-14T11:01:57.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.135+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=VR6HUHWCZM4S type=del 2024-09-14T11:01:57.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.138+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~XXVICO150DNT.0 size=1048576 2024-09-14T11:01:57.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.139+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~XXVICO150DNT.1 size=1048576 2024-09-14T11:01:57.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.140+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~XXVICO150DNT.2 size=385168 2024-09-14T11:01:57.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.140+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=XXVICO150DNT tag=9OUR9HPKRVDV type=write size=3530896 2024-09-14T11:01:57.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.140+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~M0A09V7K8KNH.0 size=1048576 2024-09-14T11:01:57.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.141+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~M0A09V7K8KNH.1 size=1048576 2024-09-14T11:01:57.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.141+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~M0A09V7K8KNH.2 size=414917 2024-09-14T11:01:57.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.144+0000 7fe3dd11f780 1 < canceled multipart upload key=GQEFQ1UD6QCJ upload=M0A09V7K8KNH tag=M1ROFGINPA3Q type=write size=3560645 2024-09-14T11:01:57.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.145+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=YYNHOGN6038U type=del size=1826659 2024-09-14T11:01:57.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.147+0000 7fe3dd11f780 1 < completed write operation key=US8KP3YL88TG tag=BD0I5XB9Z0F8 type=write size=276277 2024-09-14T11:01:57.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.148+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=X8IY5RA62EEC type=del size=116352 2024-09-14T11:01:57.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.150+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=9WXC7RNP525L type=del 2024-09-14T11:01:57.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.151+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=AQEAWTRH703C type=del size=484642 2024-09-14T11:01:57.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.152+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~5J2TIF6CFM2U.0 size=1048576 2024-09-14T11:01:57.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.154+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~5J2TIF6CFM2U.1 size=346109 2024-09-14T11:01:57.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.156+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=5J2TIF6CFM2U tag=U72PV129COWQ type=write size=2443261 2024-09-14T11:01:57.156 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.158+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~MVU5EBHQE79D.0 size=1048576 2024-09-14T11:01:57.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.159+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~MVU5EBHQE79D.1 size=614864 2024-09-14T11:01:57.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.159+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=MVU5EBHQE79D tag=X06R3X1SBSLC type=write size=2712016 2024-09-14T11:01:57.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.160+0000 7fe3dd11f780 1 < canceled operation key=6PJ03TAYRUT8 tag=PZHL5ZLF9A2U type=del size=750203 2024-09-14T11:01:57.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.163+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~ALEQ7LKIR78J.0 size=1048576 2024-09-14T11:01:57.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.164+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~ALEQ7LKIR78J.1 size=514196 2024-09-14T11:01:57.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.164+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=ALEQ7LKIR78J tag=COBAIR2L21AK type=write size=2611348 2024-09-14T11:01:57.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.165+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=V3524G00ILMA type=del 2024-09-14T11:01:57.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.167+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~SWWPRGYS6IPW.0 size=953854 2024-09-14T11:01:57.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.167+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=SWWPRGYS6IPW tag=TWD3AJ2C49B9 type=write size=2002430 2024-09-14T11:01:57.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.168+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~T9AWUVR7G5UR.0 size=158603 2024-09-14T11:01:57.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.170+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=T9AWUVR7G5UR tag=AXX9NQQ7AN1F type=write size=1207179 2024-09-14T11:01:57.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.171+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=CMOW5H7V4YWM type=del size=3422337 2024-09-14T11:01:57.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.173+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~6KZJWA60M3MM.0 size=848872 2024-09-14T11:01:57.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.175+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=6KZJWA60M3MM tag=8Q67BX3UBQDZ type=write size=1897448 2024-09-14T11:01:57.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.177+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~WI64GWACG9ZM.0 size=995439 2024-09-14T11:01:57.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.177+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=WI64GWACG9ZM tag=I2QJQKVV4BCT type=write size=2044015 2024-09-14T11:01:57.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.178+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=5JTLOL9JPXTH type=del 2024-09-14T11:01:57.177 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.179+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=UYGQAEFI43VJ type=del size=2895629 2024-09-14T11:01:57.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.181+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=C1UYU3Z4G4FL type=del 2024-09-14T11:01:57.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.183+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~79U2EUACTUL9.0 size=1048576 2024-09-14T11:01:57.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.184+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~79U2EUACTUL9.1 size=1048576 2024-09-14T11:01:57.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.185+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~79U2EUACTUL9.2 size=733073 2024-09-14T11:01:57.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.185+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=79U2EUACTUL9 tag=4NXXLFIYM0QX type=write size=3878801 2024-09-14T11:01:57.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.186+0000 7fe3dd11f780 1 < completed write operation key=US8KP3YL88TG tag=DTV3CFXAB3U0 type=write size=910331 2024-09-14T11:01:57.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.187+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=AADZQ3GN6U2F type=del size=3604265 2024-09-14T11:01:57.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.188+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~QWRL62MQS24K.0 size=411546 2024-09-14T11:01:57.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.190+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=QWRL62MQS24K tag=1NN0BF5GGK79 type=write size=1460122 2024-09-14T11:01:57.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.192+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~JYF0DP5APIP6.0 size=1048576 2024-09-14T11:01:57.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.193+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~JYF0DP5APIP6.1 size=1048576 2024-09-14T11:01:57.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.194+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~JYF0DP5APIP6.2 size=648034 2024-09-14T11:01:57.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.194+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=JYF0DP5APIP6 tag=A8J6L47616C5 type=write size=3793762 2024-09-14T11:01:57.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.196+0000 7fe3dd11f780 1 < suggested remove operation key=JG1RZQD4J2EB tag=H6QVDQOYXKDU type=del 2024-09-14T11:01:57.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.198+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=92ZM00QEIO6C type=del size=3634793 2024-09-14T11:01:57.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.199+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=J4Y4U2CNCV20 type=del 2024-09-14T11:01:57.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.200+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=KL9GEJRC9FXA type=write size=248437 2024-09-14T11:01:57.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.201+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=T9O8OBM1RHY4 type=del 2024-09-14T11:01:57.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.202+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=03WCD3Z2EGYT type=del size=4054751 2024-09-14T11:01:57.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.203+0000 7fe3dd11f780 1 < canceled part key=_multipart_JSEN4QXEMVHS.2~XXVICO150DNT.0 size=1048576 2024-09-14T11:01:57.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.204+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~XXVICO150DNT.1 size=1048576 2024-09-14T11:01:57.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.205+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~XXVICO150DNT.2 size=385168 2024-09-14T11:01:57.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.207+0000 7fe3dd11f780 1 < canceled multipart upload key=JSEN4QXEMVHS upload=XXVICO150DNT tag=9OUR9HPKRVDV type=write size=3530896 2024-09-14T11:01:57.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.208+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=HUMYAJSGMCAZ type=del size=3293862 2024-09-14T11:01:57.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.209+0000 7fe3dd11f780 1 < canceled operation key=YXPZXFY8930D tag=YYNHOGN6038U type=del size=1826659 2024-09-14T11:01:57.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.210+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=YKPNJJB52W1Q type=del size=2844578 2024-09-14T11:01:57.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.212+0000 7fe3dd11f780 1 < suggested remove operation key=OK5L92EKOOMW tag=X8IY5RA62EEC type=del 2024-09-14T11:01:57.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.214+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=ZEAUHI123M0X type=del size=121551 2024-09-14T11:01:57.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.216+0000 7fe3dd11f780 1 < suggested update operation key=GQEFQ1UD6QCJ tag=AQEAWTRH703C type=del size=484642 2024-09-14T11:01:57.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.217+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=7ESIGZ3B6321 type=del size=3897708 2024-09-14T11:01:57.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.217+0000 7fe3dd11f780 1 < canceled part key=_multipart_EGC5988RQOEZ.2~MVU5EBHQE79D.0 size=1048576 2024-09-14T11:01:57.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.218+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~MVU5EBHQE79D.1 size=614864 2024-09-14T11:01:57.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.220+0000 7fe3dd11f780 1 < canceled multipart upload key=EGC5988RQOEZ upload=MVU5EBHQE79D tag=X06R3X1SBSLC type=write size=2712016 2024-09-14T11:01:57.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.221+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=3OZH7KUT33KJ type=del size=71392 2024-09-14T11:01:57.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.223+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~ALEQ7LKIR78J.0 size=1048576 2024-09-14T11:01:57.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.224+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~ALEQ7LKIR78J.1 size=514196 2024-09-14T11:01:57.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.227+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=ALEQ7LKIR78J tag=COBAIR2L21AK type=write size=2611348 2024-09-14T11:01:57.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.229+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~BWWX6NCIBLGK.0 size=1048576 2024-09-14T11:01:57.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.230+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~BWWX6NCIBLGK.1 size=1048576 2024-09-14T11:01:57.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.231+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~BWWX6NCIBLGK.2 size=442666 2024-09-14T11:01:57.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.231+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=BWWX6NCIBLGK tag=TKH8ZBEU60DI type=write size=3588394 2024-09-14T11:01:57.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.233+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~SWWPRGYS6IPW.0 size=953854 2024-09-14T11:01:57.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.235+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=SWWPRGYS6IPW tag=TWD3AJ2C49B9 type=write size=2002430 2024-09-14T11:01:57.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.236+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=C6JPZW9Q4DRA type=del size=733648 2024-09-14T11:01:57.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.237+0000 7fe3dd11f780 1 < canceled operation key=M0DMAQ5LTDR0 tag=CMOW5H7V4YWM type=del size=3422337 2024-09-14T11:01:57.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.239+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=JUJBCUR1UCJK type=del size=3069146 2024-09-14T11:01:57.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.240+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~WI64GWACG9ZM.0 size=995439 2024-09-14T11:01:57.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.242+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=WI64GWACG9ZM tag=I2QJQKVV4BCT type=write size=2044015 2024-09-14T11:01:57.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.244+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~XQUGRNC21S62.0 size=1048576 2024-09-14T11:01:57.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.245+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~XQUGRNC21S62.1 size=1025004 2024-09-14T11:01:57.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.245+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=XQUGRNC21S62 tag=AALT7YF2V0SP type=write size=3122156 2024-09-14T11:01:57.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.247+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=UYGQAEFI43VJ type=del 2024-09-14T11:01:57.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.248+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=R1R9CR92LQ1C type=del size=3271115 2024-09-14T11:01:57.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.248+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~79U2EUACTUL9.0 size=1048576 2024-09-14T11:01:57.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.249+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~79U2EUACTUL9.1 size=1048576 2024-09-14T11:01:57.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.250+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~79U2EUACTUL9.2 size=733073 2024-09-14T11:01:57.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.253+0000 7fe3dd11f780 1 < canceled multipart upload key=GQEFQ1UD6QCJ upload=79U2EUACTUL9 tag=4NXXLFIYM0QX type=write size=3878801 2024-09-14T11:01:57.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.254+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=AP4VH6EJDU5T type=del size=4099154 2024-09-14T11:01:57.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.255+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=AADZQ3GN6U2F type=del 2024-09-14T11:01:57.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.258+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~6K320IDAUOLF.0 size=1048576 2024-09-14T11:01:57.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.259+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~6K320IDAUOLF.1 size=1048576 2024-09-14T11:01:57.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.260+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~6K320IDAUOLF.2 size=901838 2024-09-14T11:01:57.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.260+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=6K320IDAUOLF tag=AUSATU5SKO2T type=write size=4047566 2024-09-14T11:01:57.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.261+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~JYF0DP5APIP6.0 size=1048576 2024-09-14T11:01:57.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.262+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~JYF0DP5APIP6.1 size=1048576 2024-09-14T11:01:57.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.263+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~JYF0DP5APIP6.2 size=648034 2024-09-14T11:01:57.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.266+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=JYF0DP5APIP6 tag=A8J6L47616C5 type=write size=3793762 2024-09-14T11:01:57.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.267+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=7ERN183R4R9Q type=del size=2229207 2024-09-14T11:01:57.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.270+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=92ZM00QEIO6C type=del 2024-09-14T11:01:57.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.271+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=WV5KWFDEFWJ2 type=del size=562316 2024-09-14T11:01:57.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.272+0000 7fe3dd11f780 1 < completed write operation key=YXPZXFY8930D tag=KL9GEJRC9FXA type=write size=248437 2024-09-14T11:01:57.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.274+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=VNQDXU6TUXPH type=del size=2250389 2024-09-14T11:01:57.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.275+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=03WCD3Z2EGYT type=del 2024-09-14T11:01:57.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.277+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~TO33VOF4EBQ6.0 size=1048576 2024-09-14T11:01:57.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.278+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~TO33VOF4EBQ6.1 size=1048576 2024-09-14T11:01:57.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.279+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~TO33VOF4EBQ6.2 size=761711 2024-09-14T11:01:57.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.279+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=TO33VOF4EBQ6 tag=UH1YNC7VOVKK type=write size=3907439 2024-09-14T11:01:57.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.280+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=HUMYAJSGMCAZ type=del 2024-09-14T11:01:57.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.282+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=87NDAKVHAFXS type=del size=1965005 2024-09-14T11:01:57.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.283+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=YKPNJJB52W1Q type=del 2024-09-14T11:01:57.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.284+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=SQTQZVVRHZBY type=del size=4010411 2024-09-14T11:01:57.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.285+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=ZEAUHI123M0X type=del 2024-09-14T11:01:57.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.286+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=5L6K5Z9YV1Y7 type=del size=3632233 2024-09-14T11:01:57.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.289+0000 7fe3dd11f780 1 < suggested remove operation key=A89YQO40BHUS tag=7ESIGZ3B6321 type=del 2024-09-14T11:01:57.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.291+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~JHVLL1D84G7M.0 size=1048576 2024-09-14T11:01:57.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.292+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~JHVLL1D84G7M.1 size=940029 2024-09-14T11:01:57.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.292+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=JHVLL1D84G7M tag=Y75VRM1BEGLJ type=write size=3037181 2024-09-14T11:01:57.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.293+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=3OZH7KUT33KJ type=del 2024-09-14T11:01:57.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.294+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=M6LJB833U78J type=write size=936793 2024-09-14T11:01:57.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.296+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~BWWX6NCIBLGK.0 size=1048576 2024-09-14T11:01:57.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.297+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~BWWX6NCIBLGK.1 size=1048576 2024-09-14T11:01:57.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.297+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~BWWX6NCIBLGK.2 size=442666 2024-09-14T11:01:57.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.299+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=BWWX6NCIBLGK tag=TKH8ZBEU60DI type=write size=3588394 2024-09-14T11:01:57.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.301+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=1FXSVF95QEYZ type=del size=922471 2024-09-14T11:01:57.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.303+0000 7fe3dd11f780 1 < suggested remove operation key=V692HUUJP2RC tag=C6JPZW9Q4DRA type=del 2024-09-14T11:01:57.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.304+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=036N9EJ5B3KC type=del size=1166864 2024-09-14T11:01:57.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.305+0000 7fe3dd11f780 -1 < failed to complete operation key=NHKCRGX10WBM tag=JUJBCUR1UCJK type=del size=3069146: (22) Invalid argument 2024-09-14T11:01:57.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.306+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=WAEUSGOTEW8R type=del size=1558285 2024-09-14T11:01:57.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.306+0000 7fe3dd11f780 1 < canceled part key=_multipart_OK5L92EKOOMW.2~XQUGRNC21S62.0 size=1048576 2024-09-14T11:01:57.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.307+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~XQUGRNC21S62.1 size=1025004 2024-09-14T11:01:57.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.309+0000 7fe3dd11f780 1 < canceled multipart upload key=OK5L92EKOOMW upload=XQUGRNC21S62 tag=AALT7YF2V0SP type=write size=3122156 2024-09-14T11:01:57.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.311+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=N4XL2KO98F81 type=del size=159468 2024-09-14T11:01:57.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.312+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=R1R9CR92LQ1C type=del 2024-09-14T11:01:57.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.313+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=VOY8F23UA5VV type=del size=1338607 2024-09-14T11:01:57.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.314+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=AP4VH6EJDU5T type=del 2024-09-14T11:01:57.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.315+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=YRVW57MC5HN4 type=del size=3328417 2024-09-14T11:01:57.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.316+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~6K320IDAUOLF.0 size=1048576 2024-09-14T11:01:57.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.316+0000 7fe3dd11f780 1 < canceled part key=_multipart_ODDNSHK5YMNO.2~6K320IDAUOLF.1 size=1048576 2024-09-14T11:01:57.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.318+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~6K320IDAUOLF.2 size=901838 2024-09-14T11:01:57.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.319+0000 7fe3dd11f780 1 < canceled multipart upload key=ODDNSHK5YMNO upload=6K320IDAUOLF tag=AUSATU5SKO2T type=write size=4047566 2024-09-14T11:01:57.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.321+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=DN3Z23N4163V type=del size=1750966 2024-09-14T11:01:57.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.322+0000 7fe3dd11f780 -1 < failed to complete operation key=A89YQO40BHUS tag=7ERN183R4R9Q type=del size=2229207: (22) Invalid argument 2024-09-14T11:01:57.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.323+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=ESUYPMAEHJAH type=del size=2674110 2024-09-14T11:01:57.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.324+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=WV5KWFDEFWJ2 type=del 2024-09-14T11:01:57.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.326+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~73ACJEPPFJB9.0 size=475277 2024-09-14T11:01:57.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.326+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=73ACJEPPFJB9 tag=07Z82JVB2N1M type=write size=1523853 2024-09-14T11:01:57.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.327+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=VNQDXU6TUXPH type=del 2024-09-14T11:01:57.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.328+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=Z987SRUDR89T type=del size=682646 2024-09-14T11:01:57.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.329+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~TO33VOF4EBQ6.0 size=1048576 2024-09-14T11:01:57.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.330+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~TO33VOF4EBQ6.1 size=1048576 2024-09-14T11:01:57.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.331+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~TO33VOF4EBQ6.2 size=761711 2024-09-14T11:01:57.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.332+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=TO33VOF4EBQ6 tag=UH1YNC7VOVKK type=write size=3907439 2024-09-14T11:01:57.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.334+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=XKO673V3ZP5D type=del size=3579409 2024-09-14T11:01:57.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.335+0000 7fe3dd11f780 1 < canceled operation key=JSEN4QXEMVHS tag=87NDAKVHAFXS type=del size=1965005 2024-09-14T11:01:57.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.337+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~BOOJNMYTF2E9.0 size=1048576 2024-09-14T11:01:57.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.338+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~BOOJNMYTF2E9.1 size=953735 2024-09-14T11:01:57.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.338+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=BOOJNMYTF2E9 tag=917R5MTLPO53 type=write size=3050887 2024-09-14T11:01:57.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.339+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=SQTQZVVRHZBY type=del 2024-09-14T11:01:57.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.341+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=SBSWW4N22K58 type=del size=3899838 2024-09-14T11:01:57.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.342+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=5L6K5Z9YV1Y7 type=del 2024-09-14T11:01:57.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.343+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=RZ83H2OVSB2Z type=del size=1936086 2024-09-14T11:01:57.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.344+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~JHVLL1D84G7M.0 size=1048576 2024-09-14T11:01:57.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.345+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~JHVLL1D84G7M.1 size=940029 2024-09-14T11:01:57.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.347+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=JHVLL1D84G7M tag=Y75VRM1BEGLJ type=write size=3037181 2024-09-14T11:01:57.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.348+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=3RROKC1P66HC type=del size=188149 2024-09-14T11:01:57.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.350+0000 7fe3dd11f780 1 < completed write operation key=ZTD98WQ6032X tag=M6LJB833U78J type=write size=936793 2024-09-14T11:01:57.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.351+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=DM0T02QCI4GW type=write size=245252 2024-09-14T11:01:57.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.352+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=1FXSVF95QEYZ type=del 2024-09-14T11:01:57.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.354+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~I7E2469KR7M0.0 size=170302 2024-09-14T11:01:57.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.354+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=I7E2469KR7M0 tag=MCENI9LBMDNZ type=write size=1218878 2024-09-14T11:01:57.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.355+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=036N9EJ5B3KC type=del 2024-09-14T11:01:57.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.356+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=FGAD0QNDV5H8 type=del size=800909 2024-09-14T11:01:57.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.358+0000 7fe3dd11f780 1 < canceled operation key=YXPZXFY8930D tag=WAEUSGOTEW8R type=del size=1558285 2024-09-14T11:01:57.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.359+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=WQPGCYUY1L8G type=del size=2961221 2024-09-14T11:01:57.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.360+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=N4XL2KO98F81 type=del 2024-09-14T11:01:57.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.362+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~J4LQ4P3ZHE50.0 size=202424 2024-09-14T11:01:57.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.362+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=J4LQ4P3ZHE50 tag=O3DWKAP15LDT type=write size=1251000 2024-09-14T11:01:57.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.363+0000 7fe3dd11f780 1 < canceled operation key=LFKLJAJWQ2J6 tag=VOY8F23UA5VV type=del size=1338607 2024-09-14T11:01:57.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.365+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~LR0N3BH3ZEEL.0 size=1048576 2024-09-14T11:01:57.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.366+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~LR0N3BH3ZEEL.1 size=1048576 2024-09-14T11:01:57.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.367+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~LR0N3BH3ZEEL.2 size=733856 2024-09-14T11:01:57.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.367+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=LR0N3BH3ZEEL tag=WMC5EZ1WIUSP type=write size=3879584 2024-09-14T11:01:57.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.369+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=YRVW57MC5HN4 type=del 2024-09-14T11:01:57.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.370+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=AF9SB5LYHDPC type=del size=3012950 2024-09-14T11:01:57.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.371+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=DN3Z23N4163V type=del 2024-09-14T11:01:57.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.372+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=IHA1LNIUJVJN type=del size=3273618 2024-09-14T11:01:57.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.373+0000 7fe3dd11f780 1 < canceled operation key=LL9VJXEU13IK tag=ESUYPMAEHJAH type=del size=2674110 2024-09-14T11:01:57.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.374+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=LVQDKQAECQTX type=write size=165235 2024-09-14T11:01:57.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.375+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~73ACJEPPFJB9.0 size=475277 2024-09-14T11:01:57.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.377+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=73ACJEPPFJB9 tag=07Z82JVB2N1M type=write size=1523853 2024-09-14T11:01:57.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.379+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=JC4N6HA06AD4 type=del size=2751221 2024-09-14T11:01:57.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.380+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=Z987SRUDR89T type=del 2024-09-14T11:01:57.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.381+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=0O5MJLHS1YSA type=del size=674290 2024-09-14T11:01:57.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.382+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=XKO673V3ZP5D type=del 2024-09-14T11:01:57.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.383+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=XWDX4VGFLBTN type=del size=743464 2024-09-14T11:01:57.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.385+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~BOOJNMYTF2E9.0 size=1048576 2024-09-14T11:01:57.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.385+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~BOOJNMYTF2E9.1 size=953735 2024-09-14T11:01:57.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.387+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=BOOJNMYTF2E9 tag=917R5MTLPO53 type=write size=3050887 2024-09-14T11:01:57.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.390+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~2ULDUX1O9FOB.0 size=1048576 2024-09-14T11:01:57.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.391+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~2ULDUX1O9FOB.1 size=836305 2024-09-14T11:01:57.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.391+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=2ULDUX1O9FOB tag=FLG0AG00C538 type=write size=2933457 2024-09-14T11:01:57.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.392+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=SBSWW4N22K58 type=del 2024-09-14T11:01:57.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.393+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=SZ3HBYP2GUKO type=write size=927427 2024-09-14T11:01:57.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.394+0000 7fe3dd11f780 1 < canceled operation key=IOAG4ZE1I58Z tag=RZ83H2OVSB2Z type=del size=1936086 2024-09-14T11:01:57.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.396+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~GHA2JNN3NFHM.0 size=937171 2024-09-14T11:01:57.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.396+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=GHA2JNN3NFHM tag=GEGFD4XS2RZ4 type=write size=1985747 2024-09-14T11:01:57.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.397+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=3RROKC1P66HC type=del 2024-09-14T11:01:57.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.399+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=2HS7SUKNXC8C type=del size=739367 2024-09-14T11:01:57.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.400+0000 7fe3dd11f780 1 < completed write operation key=K9BP30LHDPA1 tag=DM0T02QCI4GW type=write size=245252 2024-09-14T11:01:57.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.401+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=H2ZVI9NC12FJ type=del size=4092202 2024-09-14T11:01:57.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.402+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~I7E2469KR7M0.0 size=170302 2024-09-14T11:01:57.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.404+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=I7E2469KR7M0 tag=MCENI9LBMDNZ type=write size=1218878 2024-09-14T11:01:57.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.405+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=D4K38928DL1G type=del size=921523 2024-09-14T11:01:57.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.407+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=FGAD0QNDV5H8 type=del 2024-09-14T11:01:57.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.408+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=5VDF5MV71INX type=del size=324669 2024-09-14T11:01:57.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.409+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=WQPGCYUY1L8G type=del 2024-09-14T11:01:57.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.410+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=9Z8P2O2AVS64 type=write size=358928 2024-09-14T11:01:57.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.411+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~J4LQ4P3ZHE50.0 size=202424 2024-09-14T11:01:57.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.413+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=J4LQ4P3ZHE50 tag=O3DWKAP15LDT type=write size=1251000 2024-09-14T11:01:57.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.415+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~FHUIH1NHPZAL.0 size=1048576 2024-09-14T11:01:57.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.416+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~FHUIH1NHPZAL.1 size=1048576 2024-09-14T11:01:57.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.417+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~FHUIH1NHPZAL.2 size=883622 2024-09-14T11:01:57.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.417+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=FHUIH1NHPZAL tag=Y3XNLBSTEUPE type=write size=4029350 2024-09-14T11:01:57.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.419+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~LR0N3BH3ZEEL.0 size=1048576 2024-09-14T11:01:57.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.420+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~LR0N3BH3ZEEL.1 size=1048576 2024-09-14T11:01:57.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.421+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~LR0N3BH3ZEEL.2 size=733856 2024-09-14T11:01:57.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.423+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=LR0N3BH3ZEEL tag=WMC5EZ1WIUSP type=write size=3879584 2024-09-14T11:01:57.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.425+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~OJ48IH11X6NW.0 size=1048576 2024-09-14T11:01:57.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.426+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~OJ48IH11X6NW.1 size=345797 2024-09-14T11:01:57.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.426+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=OJ48IH11X6NW tag=DQYX2EJET191 type=write size=2442949 2024-09-14T11:01:57.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.427+0000 7fe3dd11f780 1 < canceled operation key=M0DMAQ5LTDR0 tag=AF9SB5LYHDPC type=del size=3012950 2024-09-14T11:01:57.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.428+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=NYZGUXZHV0OU type=del size=1620070 2024-09-14T11:01:57.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.431+0000 7fe3dd11f780 1 < suggested update operation key=YMGE9GKLSPE6 tag=IHA1LNIUJVJN type=del size=3273618 2024-09-14T11:01:57.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.432+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=MUM32WMZA2VH type=del size=3485713 2024-09-14T11:01:57.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.433+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=LVQDKQAECQTX type=write size=165235 2024-09-14T11:01:57.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.434+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=8JPHFSB3Z4XO type=del size=2721163 2024-09-14T11:01:57.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.436+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=JC4N6HA06AD4 type=del 2024-09-14T11:01:57.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.437+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=OGF2WZ74COJK type=del size=3381799 2024-09-14T11:01:57.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.438+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=0O5MJLHS1YSA type=del 2024-09-14T11:01:57.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.440+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~EXJYO5GTYDZR.0 size=732246 2024-09-14T11:01:57.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.440+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=EXJYO5GTYDZR tag=2Y0G508170BO type=write size=1780822 2024-09-14T11:01:57.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.441+0000 7fe3dd11f780 -1 < failed to complete operation key=YMGE9GKLSPE6 tag=XWDX4VGFLBTN type=del size=743464: (22) Invalid argument 2024-09-14T11:01:57.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.442+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=607LR3SPDK00 type=del size=21801 2024-09-14T11:01:57.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.444+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~2ULDUX1O9FOB.0 size=1048576 2024-09-14T11:01:57.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.444+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~2ULDUX1O9FOB.1 size=836305 2024-09-14T11:01:57.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.446+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=2ULDUX1O9FOB tag=FLG0AG00C538 type=write size=2933457 2024-09-14T11:01:57.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.447+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=DQBHD496XW8L type=del size=3526146 2024-09-14T11:01:57.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.449+0000 7fe3dd11f780 -1 < failed to complete operation key=YMGE9GKLSPE6 tag=SZ3HBYP2GUKO type=write size=927427: (22) Invalid argument 2024-09-14T11:01:57.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.450+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=8N4B8XO11K3D type=del size=3452927 2024-09-14T11:01:57.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.451+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~GHA2JNN3NFHM.0 size=937171 2024-09-14T11:01:57.452 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.455+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=GHA2JNN3NFHM tag=GEGFD4XS2RZ4 type=write size=1985747 2024-09-14T11:01:57.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.456+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=NSGA9TFYIBET type=write size=536440 2024-09-14T11:01:57.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.457+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=2HS7SUKNXC8C type=del 2024-09-14T11:01:57.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.458+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=Y1HNTZFHM4Y9 type=write size=690299 2024-09-14T11:01:57.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.459+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=H2ZVI9NC12FJ type=del 2024-09-14T11:01:57.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.460+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=1GDF7NPHIWVD type=del size=230994 2024-09-14T11:01:57.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.462+0000 7fe3dd11f780 1 < completed delete operation key=0PT98N1VBWAG tag=D4K38928DL1G type=del 2024-09-14T11:01:57.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.463+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=7NU03P75JSOB type=write size=665679 2024-09-14T11:01:57.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.465+0000 7fe3dd11f780 1 < suggested remove operation key=6PJ03TAYRUT8 tag=5VDF5MV71INX type=del 2024-09-14T11:01:57.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.466+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=R29CE9T45EWA type=del size=1460003 2024-09-14T11:01:57.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.468+0000 7fe3dd11f780 1 < completed write operation key=JFLEJGPFLACM tag=9Z8P2O2AVS64 type=write size=358928 2024-09-14T11:01:57.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.470+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~4Y7UAEKVDJVG.0 size=1048576 2024-09-14T11:01:57.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.470+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~4Y7UAEKVDJVG.1 size=1048576 2024-09-14T11:01:57.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.471+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~4Y7UAEKVDJVG.2 size=294620 2024-09-14T11:01:57.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.471+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=4Y7UAEKVDJVG tag=1TQWWVISO7RU type=write size=3440348 2024-09-14T11:01:57.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.473+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~FHUIH1NHPZAL.0 size=1048576 2024-09-14T11:01:57.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.473+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~FHUIH1NHPZAL.1 size=1048576 2024-09-14T11:01:57.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.474+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~FHUIH1NHPZAL.2 size=883622 2024-09-14T11:01:57.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.476+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=FHUIH1NHPZAL tag=Y3XNLBSTEUPE type=write size=4029350 2024-09-14T11:01:57.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.477+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=QV4GRYKFXFWI type=del size=3179214 2024-09-14T11:01:57.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.479+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~OJ48IH11X6NW.0 size=1048576 2024-09-14T11:01:57.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.479+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~OJ48IH11X6NW.1 size=345797 2024-09-14T11:01:57.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.481+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=OJ48IH11X6NW tag=DQYX2EJET191 type=write size=2442949 2024-09-14T11:01:57.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.483+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=C976NN7XGNM4 type=del size=1142397 2024-09-14T11:01:57.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.484+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=NYZGUXZHV0OU type=del 2024-09-14T11:01:57.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.486+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~7RYUWGMP1XAP.0 size=1048576 2024-09-14T11:01:57.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.487+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~7RYUWGMP1XAP.1 size=1048576 2024-09-14T11:01:57.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.488+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~7RYUWGMP1XAP.2 size=633216 2024-09-14T11:01:57.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.488+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=7RYUWGMP1XAP tag=9W2ZZEL4BMVP type=write size=3778944 2024-09-14T11:01:57.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.489+0000 7fe3dd11f780 -1 < failed to complete operation key=6PJ03TAYRUT8 tag=MUM32WMZA2VH type=del size=3485713: (22) Invalid argument 2024-09-14T11:01:57.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.491+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~PSNZON5GCWBO.0 size=1048576 2024-09-14T11:01:57.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.492+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~PSNZON5GCWBO.1 size=199562 2024-09-14T11:01:57.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.492+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=PSNZON5GCWBO tag=DKEYI11MUV1L type=write size=2296714 2024-09-14T11:01:57.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.495+0000 7fe3dd11f780 1 < suggested update operation key=22TI1VCDTK5P tag=8JPHFSB3Z4XO type=del size=2721163 2024-09-14T11:01:57.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.497+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~PL4SA4K89W1U.0 size=641250 2024-09-14T11:01:57.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.497+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=PL4SA4K89W1U tag=5SDIX3ECXMCC type=write size=1689826 2024-09-14T11:01:57.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.498+0000 7fe3dd11f780 1 < canceled operation key=PHLQ77OMLI37 tag=OGF2WZ74COJK type=del size=3381799 2024-09-14T11:01:57.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.500+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~JNK8BN6OUFU0.0 size=1048576 2024-09-14T11:01:57.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.501+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~JNK8BN6OUFU0.1 size=1048576 2024-09-14T11:01:57.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.502+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~JNK8BN6OUFU0.2 size=839016 2024-09-14T11:01:57.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.502+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=JNK8BN6OUFU0 tag=KGAEEGIOC3KH type=write size=3984744 2024-09-14T11:01:57.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.503+0000 7fe3dd11f780 1 < canceled part key=_multipart_YMGE9GKLSPE6.2~EXJYO5GTYDZR.0 size=732246 2024-09-14T11:01:57.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.505+0000 7fe3dd11f780 1 < canceled multipart upload key=YMGE9GKLSPE6 upload=EXJYO5GTYDZR tag=2Y0G508170BO type=write size=1780822 2024-09-14T11:01:57.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.506+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=TNWDR3EGXCCA type=del size=1440771 2024-09-14T11:01:57.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.507+0000 7fe3dd11f780 1 < canceled operation key=4JTN39NIB2UE tag=607LR3SPDK00 type=del size=21801 2024-09-14T11:01:57.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.508+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=P5FNWBZVAC3G type=del size=1992665 2024-09-14T11:01:57.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.511+0000 7fe3dd11f780 1 < suggested remove operation key=LL9VJXEU13IK tag=DQBHD496XW8L type=del 2024-09-14T11:01:57.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.513+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~RAQM5WZNSTNL.0 size=1048576 2024-09-14T11:01:57.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.514+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~RAQM5WZNSTNL.1 size=410211 2024-09-14T11:01:57.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.514+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=RAQM5WZNSTNL tag=LMEZCEGLR4UW type=write size=2507363 2024-09-14T11:01:57.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.515+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=8N4B8XO11K3D type=del 2024-09-14T11:01:57.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.516+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=NLQNMU4MDZZJ type=write size=311838 2024-09-14T11:01:57.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.518+0000 7fe3dd11f780 1 < suggested update operation key=ZI5SFHGWCHJA tag=NSGA9TFYIBET type=write size=536440 2024-09-14T11:01:57.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.520+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=5WFOITNR3ML2 type=del size=2149977 2024-09-14T11:01:57.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.521+0000 7fe3dd11f780 1 < completed write operation key=0PT98N1VBWAG tag=Y1HNTZFHM4Y9 type=write size=690299 2024-09-14T11:01:57.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.522+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=KD7D2K709AI5 type=del size=2547435 2024-09-14T11:01:57.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.523+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=1GDF7NPHIWVD type=del 2024-09-14T11:01:57.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.525+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=33E36FO3RFQX type=del size=3903171 2024-09-14T11:01:57.523 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.526+0000 7fe3dd11f780 1 < completed write operation key=OK5L92EKOOMW tag=7NU03P75JSOB type=write size=665679 2024-09-14T11:01:57.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.527+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=S3IMDFRZW2O7 type=del size=1657468 2024-09-14T11:01:57.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.529+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=R29CE9T45EWA type=del 2024-09-14T11:01:57.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.530+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=QSX5FMIKMD6K type=del size=2539425 2024-09-14T11:01:57.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.531+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~4Y7UAEKVDJVG.0 size=1048576 2024-09-14T11:01:57.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.532+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~4Y7UAEKVDJVG.1 size=1048576 2024-09-14T11:01:57.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.534+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~4Y7UAEKVDJVG.2 size=294620 2024-09-14T11:01:57.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.536+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=4Y7UAEKVDJVG tag=1TQWWVISO7RU type=write size=3440348 2024-09-14T11:01:57.536 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.538+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~1Z2OEQDS4FZJ.0 size=1048576 2024-09-14T11:01:57.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.539+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~1Z2OEQDS4FZJ.1 size=310472 2024-09-14T11:01:57.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.539+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=1Z2OEQDS4FZJ tag=MI2T53EGUTE6 type=write size=2407624 2024-09-14T11:01:57.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.540+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=QV4GRYKFXFWI type=del 2024-09-14T11:01:57.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.542+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=V8JTMFY4R5O0 type=del size=3555659 2024-09-14T11:01:57.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.543+0000 7fe3dd11f780 1 < canceled operation key=A89YQO40BHUS tag=C976NN7XGNM4 type=del size=1142397 2024-09-14T11:01:57.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.544+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=7J4D776D05LY type=del size=1023248 2024-09-14T11:01:57.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.546+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~7RYUWGMP1XAP.0 size=1048576 2024-09-14T11:01:57.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.547+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~7RYUWGMP1XAP.1 size=1048576 2024-09-14T11:01:57.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.548+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~7RYUWGMP1XAP.2 size=633216 2024-09-14T11:01:57.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.550+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=7RYUWGMP1XAP tag=9W2ZZEL4BMVP type=write size=3778944 2024-09-14T11:01:57.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.551+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=8LM44AK5L2JV type=del size=3663503 2024-09-14T11:01:57.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.553+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~PSNZON5GCWBO.0 size=1048576 2024-09-14T11:01:57.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.554+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~PSNZON5GCWBO.1 size=199562 2024-09-14T11:01:57.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.556+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=PSNZON5GCWBO tag=DKEYI11MUV1L type=write size=2296714 2024-09-14T11:01:57.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.558+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~EY228B9SC8AZ.0 size=374858 2024-09-14T11:01:57.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.558+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=EY228B9SC8AZ tag=8T5Z1V5F974F type=write size=1423434 2024-09-14T11:01:57.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.560+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~PL4SA4K89W1U.0 size=641250 2024-09-14T11:01:57.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.562+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=PL4SA4K89W1U tag=5SDIX3ECXMCC type=write size=1689826 2024-09-14T11:01:57.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.563+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=JAUBTYJ78AE9 type=del size=152468 2024-09-14T11:01:57.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.564+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~JNK8BN6OUFU0.0 size=1048576 2024-09-14T11:01:57.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.565+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~JNK8BN6OUFU0.1 size=1048576 2024-09-14T11:01:57.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.565+0000 7fe3dd11f780 1 < canceled part key=_multipart_A89YQO40BHUS.2~JNK8BN6OUFU0.2 size=839016 2024-09-14T11:01:57.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.568+0000 7fe3dd11f780 1 < canceled multipart upload key=A89YQO40BHUS upload=JNK8BN6OUFU0 tag=KGAEEGIOC3KH type=write size=3984744 2024-09-14T11:01:57.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.569+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=GD9MMNGKTG1H type=write size=574234 2024-09-14T11:01:57.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.571+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=TNWDR3EGXCCA type=del 2024-09-14T11:01:57.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.573+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~33U5PH8PSPER.0 size=1048576 2024-09-14T11:01:57.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.574+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~33U5PH8PSPER.1 size=541530 2024-09-14T11:01:57.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.574+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=33U5PH8PSPER tag=LTNTW2G2MNRQ type=write size=2638682 2024-09-14T11:01:57.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.575+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=P5FNWBZVAC3G type=del 2024-09-14T11:01:57.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.576+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=U19Z1JT336Z9 type=del size=60744 2024-09-14T11:01:57.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.577+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~RAQM5WZNSTNL.0 size=1048576 2024-09-14T11:01:57.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.578+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~RAQM5WZNSTNL.1 size=410211 2024-09-14T11:01:57.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.580+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=RAQM5WZNSTNL tag=LMEZCEGLR4UW type=write size=2507363 2024-09-14T11:01:57.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.581+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=D8M1RQPHF6GV type=write size=910708 2024-09-14T11:01:57.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.583+0000 7fe3dd11f780 1 < suggested update operation key=JSEN4QXEMVHS tag=NLQNMU4MDZZJ type=write size=311838 2024-09-14T11:01:57.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.585+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=KNO498DQX516 type=del size=2195427 2024-09-14T11:01:57.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.587+0000 7fe3dd11f780 1 < suggested update operation key=MD0OU8IC5PYI tag=5WFOITNR3ML2 type=del size=2149977 2024-09-14T11:01:57.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.588+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=SNQI9215128P type=del size=1813369 2024-09-14T11:01:57.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.590+0000 7fe3dd11f780 1 < suggested update operation key=K9BP30LHDPA1 tag=KD7D2K709AI5 type=del size=2547435 2024-09-14T11:01:57.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.592+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=K4UFE6QMN2WB type=del size=1753151 2024-09-14T11:01:57.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.593+0000 7fe3dd11f780 -1 < failed to complete operation key=JSEN4QXEMVHS tag=33E36FO3RFQX type=del size=3903171: (22) Invalid argument 2024-09-14T11:01:57.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.595+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~1O9T8KH96V2U.0 size=357866 2024-09-14T11:01:57.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.595+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=1O9T8KH96V2U tag=MNOC13PE87LI type=write size=1406442 2024-09-14T11:01:57.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.597+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=S3IMDFRZW2O7 type=del 2024-09-14T11:01:57.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.599+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~Y1YBC3C990R5.0 size=1048576 2024-09-14T11:01:57.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.600+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~Y1YBC3C990R5.1 size=691970 2024-09-14T11:01:57.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.600+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=Y1YBC3C990R5 tag=Z4AZ2SGTBQST type=write size=2789122 2024-09-14T11:01:57.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.601+0000 7fe3dd11f780 -1 < failed to complete operation key=JSEN4QXEMVHS tag=QSX5FMIKMD6K type=del size=2539425: (22) Invalid argument 2024-09-14T11:01:57.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.603+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~UIS20QFY3ZE4.0 size=1048576 2024-09-14T11:01:57.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.604+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~UIS20QFY3ZE4.1 size=1048576 2024-09-14T11:01:57.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.605+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~UIS20QFY3ZE4.2 size=1009586 2024-09-14T11:01:57.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.605+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=UIS20QFY3ZE4 tag=DRFBSZJ3848D type=write size=4155314 2024-09-14T11:01:57.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.607+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~1Z2OEQDS4FZJ.0 size=1048576 2024-09-14T11:01:57.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.608+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~1Z2OEQDS4FZJ.1 size=310472 2024-09-14T11:01:57.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.610+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=1Z2OEQDS4FZJ tag=MI2T53EGUTE6 type=write size=2407624 2024-09-14T11:01:57.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.611+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=FYA30S4JOMLG type=write size=238713 2024-09-14T11:01:57.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.612+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=V8JTMFY4R5O0 type=del 2024-09-14T11:01:57.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.613+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=Q5NQLUCFBV8M type=del size=3542153 2024-09-14T11:01:57.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.615+0000 7fe3dd11f780 1 < canceled operation key=YXPZXFY8930D tag=7J4D776D05LY type=del size=1023248 2024-09-14T11:01:57.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.617+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~G63BST3FV23K.0 size=1048576 2024-09-14T11:01:57.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.618+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~G63BST3FV23K.1 size=1048576 2024-09-14T11:01:57.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.619+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~G63BST3FV23K.2 size=1015329 2024-09-14T11:01:57.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.619+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=G63BST3FV23K tag=1GS62AM9IBI8 type=write size=4161057 2024-09-14T11:01:57.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.622+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=8LM44AK5L2JV type=del 2024-09-14T11:01:57.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.623+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=26AYZK06S4OJ type=del size=3650467 2024-09-14T11:01:57.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.624+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~EY228B9SC8AZ.0 size=374858 2024-09-14T11:01:57.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.626+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=EY228B9SC8AZ tag=8T5Z1V5F974F type=write size=1423434 2024-09-14T11:01:57.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.627+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=GRP3YG6F7D5Q type=del size=1471635 2024-09-14T11:01:57.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.629+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=JAUBTYJ78AE9 type=del 2024-09-14T11:01:57.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.631+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~ADL8UK9PSSV8.0 size=588724 2024-09-14T11:01:57.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.631+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=ADL8UK9PSSV8 tag=PXO39B08OLCR type=write size=1637300 2024-09-14T11:01:57.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.632+0000 7fe3dd11f780 1 < canceled operation key=QPH41U60044L tag=GD9MMNGKTG1H type=write size=574234 2024-09-14T11:01:57.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.633+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=70211BYXT1MR type=del size=1478428 2024-09-14T11:01:57.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.634+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~33U5PH8PSPER.0 size=1048576 2024-09-14T11:01:57.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.635+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~33U5PH8PSPER.1 size=541530 2024-09-14T11:01:57.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.637+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=33U5PH8PSPER tag=LTNTW2G2MNRQ type=write size=2638682 2024-09-14T11:01:57.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.638+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=PKM0XS7IASJJ type=del size=2737923 2024-09-14T11:01:57.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.640+0000 7fe3dd11f780 -1 < failed to complete operation key=JSEN4QXEMVHS tag=U19Z1JT336Z9 type=del size=60744: (22) Invalid argument 2024-09-14T11:01:57.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.641+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=00AFXPIMHKRN type=write size=548327 2024-09-14T11:01:57.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.643+0000 7fe3dd11f780 1 < completed write operation key=UYZGHGZR74HQ tag=D8M1RQPHF6GV type=write size=910708 2024-09-14T11:01:57.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.644+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=FHEG8NSMCZJG type=write size=405298 2024-09-14T11:01:57.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.645+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=KNO498DQX516 type=del 2024-09-14T11:01:57.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.646+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=ZB8T0YTRSIYF type=del size=3384048 2024-09-14T11:01:57.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.648+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=SNQI9215128P type=del 2024-09-14T11:01:57.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.649+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=FLU2PHY2FZQE type=del size=624873 2024-09-14T11:01:57.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.650+0000 7fe3dd11f780 1 < canceled operation key=JSEN4QXEMVHS tag=K4UFE6QMN2WB type=del size=1753151 2024-09-14T11:01:57.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.652+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=ID5D1JKCHTWW type=del size=2618476 2024-09-14T11:01:57.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.652+0000 7fe3dd11f780 1 < canceled part key=_multipart_QPH41U60044L.2~1O9T8KH96V2U.0 size=357866 2024-09-14T11:01:57.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.654+0000 7fe3dd11f780 1 < canceled multipart upload key=QPH41U60044L upload=1O9T8KH96V2U tag=MNOC13PE87LI type=write size=1406442 2024-09-14T11:01:57.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.655+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=0JZ1QRTM40X6 type=del size=3682245 2024-09-14T11:01:57.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.656+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~Y1YBC3C990R5.0 size=1048576 2024-09-14T11:01:57.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.658+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~Y1YBC3C990R5.1 size=691970 2024-09-14T11:01:57.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.660+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=Y1YBC3C990R5 tag=Z4AZ2SGTBQST type=write size=2789122 2024-09-14T11:01:57.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.661+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=ARLV1NP3W91G type=del size=470540 2024-09-14T11:01:57.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.662+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~UIS20QFY3ZE4.0 size=1048576 2024-09-14T11:01:57.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.663+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~UIS20QFY3ZE4.1 size=1048576 2024-09-14T11:01:57.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.664+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~UIS20QFY3ZE4.2 size=1009586 2024-09-14T11:01:57.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.666+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=UIS20QFY3ZE4 tag=DRFBSZJ3848D type=write size=4155314 2024-09-14T11:01:57.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.667+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=6PIVCP7BCV5M type=del size=1931899 2024-09-14T11:01:57.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.670+0000 7fe3dd11f780 1 < suggested update operation key=M0DMAQ5LTDR0 tag=FYA30S4JOMLG type=write size=238713 2024-09-14T11:01:57.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.672+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=RLF3KL9I0UF3 type=del size=3483604 2024-09-14T11:01:57.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.673+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=Q5NQLUCFBV8M type=del 2024-09-14T11:01:57.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.674+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=VAOD2RS8WTJN type=del size=2411422 2024-09-14T11:01:57.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.675+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~G63BST3FV23K.0 size=1048576 2024-09-14T11:01:57.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.676+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~G63BST3FV23K.1 size=1048576 2024-09-14T11:01:57.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.677+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~G63BST3FV23K.2 size=1015329 2024-09-14T11:01:57.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.679+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=G63BST3FV23K tag=1GS62AM9IBI8 type=write size=4161057 2024-09-14T11:01:57.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.680+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=8L0KF65P590E type=del size=2892008 2024-09-14T11:01:57.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.682+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=26AYZK06S4OJ type=del 2024-09-14T11:01:57.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.683+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=RF0EUKBGTTR3 type=del size=2897141 2024-09-14T11:01:57.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.685+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=GRP3YG6F7D5Q type=del 2024-09-14T11:01:57.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.688+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~7876UO4AIXM3.0 size=1048576 2024-09-14T11:01:57.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.688+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~7876UO4AIXM3.1 size=1048576 2024-09-14T11:01:57.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.689+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~7876UO4AIXM3.2 size=1025492 2024-09-14T11:01:57.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.689+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=7876UO4AIXM3 tag=JQB7EFL684JF type=write size=4171220 2024-09-14T11:01:57.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.691+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~ADL8UK9PSSV8.0 size=588724 2024-09-14T11:01:57.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.693+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=ADL8UK9PSSV8 tag=PXO39B08OLCR type=write size=1637300 2024-09-14T11:01:57.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.694+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=M7JH8HW5XTSU type=write size=624684 2024-09-14T11:01:57.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.696+0000 7fe3dd11f780 1 < suggested remove operation key=ZTD98WQ6032X tag=70211BYXT1MR type=del 2024-09-14T11:01:57.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.698+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~FCJZTE9SIIAX.0 size=1048576 2024-09-14T11:01:57.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.699+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~FCJZTE9SIIAX.1 size=744566 2024-09-14T11:01:57.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.699+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=FCJZTE9SIIAX tag=I8IJYDOZKZVD type=write size=2841718 2024-09-14T11:01:57.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.701+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=PKM0XS7IASJJ type=del 2024-09-14T11:01:57.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.703+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~U9MFB0TQA2ED.0 size=1048576 2024-09-14T11:01:57.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.704+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~U9MFB0TQA2ED.1 size=197387 2024-09-14T11:01:57.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.704+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=U9MFB0TQA2ED tag=MW5J8597AK37 type=write size=2294539 2024-09-14T11:01:57.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.705+0000 7fe3dd11f780 1 < completed write operation key=QPH41U60044L tag=00AFXPIMHKRN type=write size=548327 2024-09-14T11:01:57.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.706+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=ZYDONO50QSTU type=del size=1887766 2024-09-14T11:01:57.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.707+0000 7fe3dd11f780 1 < completed write operation key=JFLEJGPFLACM tag=FHEG8NSMCZJG type=write size=405298 2024-09-14T11:01:57.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.710+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~K5BLLDXWS2EK.0 size=1048576 2024-09-14T11:01:57.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.711+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~K5BLLDXWS2EK.1 size=1048576 2024-09-14T11:01:57.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.712+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~K5BLLDXWS2EK.2 size=877306 2024-09-14T11:01:57.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.712+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=K5BLLDXWS2EK tag=GF8RTXALPLDU type=write size=4023034 2024-09-14T11:01:57.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.714+0000 7fe3dd11f780 1 < suggested remove operation key=4JTN39NIB2UE tag=ZB8T0YTRSIYF type=del 2024-09-14T11:01:57.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.715+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=D7ZJZIB011OL type=write size=496887 2024-09-14T11:01:57.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.718+0000 7fe3dd11f780 1 < suggested update operation key=JG1RZQD4J2EB tag=FLU2PHY2FZQE type=del size=624873 2024-09-14T11:01:57.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.720+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~1F8CZUCUUEB0.0 size=1038998 2024-09-14T11:01:57.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.720+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=1F8CZUCUUEB0 tag=432PQ2C2QUDS type=write size=2087574 2024-09-14T11:01:57.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.721+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=ID5D1JKCHTWW type=del 2024-09-14T11:01:57.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.722+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=2WDWD9BZ0F17 type=write size=396519 2024-09-14T11:01:57.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.723+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=0JZ1QRTM40X6 type=del 2024-09-14T11:01:57.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.725+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~W2W3G4ULKOEV.0 size=1048576 2024-09-14T11:01:57.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.726+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~W2W3G4ULKOEV.1 size=448524 2024-09-14T11:01:57.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.726+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=W2W3G4ULKOEV tag=2ZNEE0Q32TDN type=write size=2545676 2024-09-14T11:01:57.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.728+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=ARLV1NP3W91G type=del 2024-09-14T11:01:57.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.729+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=IMBH3RK2XPZ8 type=del size=3551660 2024-09-14T11:01:57.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.730+0000 7fe3dd11f780 1 < canceled operation key=GQEFQ1UD6QCJ tag=6PIVCP7BCV5M type=del size=1931899 2024-09-14T11:01:57.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.731+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=1GR8FO2QOCVU type=del size=883806 2024-09-14T11:01:57.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.733+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=RLF3KL9I0UF3 type=del 2024-09-14T11:01:57.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.734+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=SE6VKVYUV752 type=del size=2341425 2024-09-14T11:01:57.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.735+0000 7fe3dd11f780 1 < canceled operation key=YMGE9GKLSPE6 tag=VAOD2RS8WTJN type=del size=2411422 2024-09-14T11:01:57.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.736+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=MVZQCGCC0YV5 type=del size=3339123 2024-09-14T11:01:57.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.737+0000 7fe3dd11f780 1 < canceled operation key=NHKCRGX10WBM tag=8L0KF65P590E type=del size=2892008 2024-09-14T11:01:57.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.740+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~V377R2P1FAI6.0 size=734128 2024-09-14T11:01:57.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.740+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=V377R2P1FAI6 tag=O5FC53UQZT0X type=write size=1782704 2024-09-14T11:01:57.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.741+0000 7fe3dd11f780 -1 < failed to complete operation key=ZTD98WQ6032X tag=RF0EUKBGTTR3 type=del size=2897141: (22) Invalid argument 2024-09-14T11:01:57.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.742+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=6XER78M07G07 type=del size=228101 2024-09-14T11:01:57.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.743+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~7876UO4AIXM3.0 size=1048576 2024-09-14T11:01:57.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.744+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~7876UO4AIXM3.1 size=1048576 2024-09-14T11:01:57.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.745+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~7876UO4AIXM3.2 size=1025492 2024-09-14T11:01:57.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.747+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=7876UO4AIXM3 tag=JQB7EFL684JF type=write size=4171220 2024-09-14T11:01:57.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.748+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=5ZG0TTCOE8KT type=del size=2226185 2024-09-14T11:01:57.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.751+0000 7fe3dd11f780 1 < suggested update operation key=LL9VJXEU13IK tag=M7JH8HW5XTSU type=write size=624684 2024-09-14T11:01:57.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.752+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=9NMWHBMQ3RF9 type=del size=310755 2024-09-14T11:01:57.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.754+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~FCJZTE9SIIAX.0 size=1048576 2024-09-14T11:01:57.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.754+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~FCJZTE9SIIAX.1 size=744566 2024-09-14T11:01:57.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.757+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=FCJZTE9SIIAX tag=I8IJYDOZKZVD type=write size=2841718 2024-09-14T11:01:57.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.758+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=XW23ZLVXLA54 type=del size=2933502 2024-09-14T11:01:57.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.760+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~U9MFB0TQA2ED.0 size=1048576 2024-09-14T11:01:57.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.760+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~U9MFB0TQA2ED.1 size=197387 2024-09-14T11:01:57.760 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.763+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=U9MFB0TQA2ED tag=MW5J8597AK37 type=write size=2294539 2024-09-14T11:01:57.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.764+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=90VOPCG9EQMC type=del size=386297 2024-09-14T11:01:57.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.765+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=ZYDONO50QSTU type=del 2024-09-14T11:01:57.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.766+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=NGHHSCC9YF1J type=del size=2916274 2024-09-14T11:01:57.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.768+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~K5BLLDXWS2EK.0 size=1048576 2024-09-14T11:01:57.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.768+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~K5BLLDXWS2EK.1 size=1048576 2024-09-14T11:01:57.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.769+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~K5BLLDXWS2EK.2 size=877306 2024-09-14T11:01:57.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.771+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=K5BLLDXWS2EK tag=GF8RTXALPLDU type=write size=4023034 2024-09-14T11:01:57.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.773+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=YFZHDKBDCVFW type=del size=1767282 2024-09-14T11:01:57.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.774+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=D7ZJZIB011OL type=write size=496887 2024-09-14T11:01:57.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.775+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=3EIE5BD1JB57 type=del size=433503 2024-09-14T11:01:57.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.777+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~1F8CZUCUUEB0.0 size=1038998 2024-09-14T11:01:57.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.779+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=1F8CZUCUUEB0 tag=432PQ2C2QUDS type=write size=2087574 2024-09-14T11:01:57.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.781+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~NQYHKWHGO4WV.0 size=454807 2024-09-14T11:01:57.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.781+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=NQYHKWHGO4WV tag=SUGXBEYTCDK3 type=write size=1503383 2024-09-14T11:01:57.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.782+0000 7fe3dd11f780 1 < completed write operation key=JSEN4QXEMVHS tag=2WDWD9BZ0F17 type=write size=396519 2024-09-14T11:01:57.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.784+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~WFFZ16CW3YGX.0 size=1048576 2024-09-14T11:01:57.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.786+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~WFFZ16CW3YGX.1 size=492368 2024-09-14T11:01:57.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.786+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=WFFZ16CW3YGX tag=YASE35MNA4M0 type=write size=2589520 2024-09-14T11:01:57.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.787+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~W2W3G4ULKOEV.0 size=1048576 2024-09-14T11:01:57.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.788+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~W2W3G4ULKOEV.1 size=448524 2024-09-14T11:01:57.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.790+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=W2W3G4ULKOEV tag=2ZNEE0Q32TDN type=write size=2545676 2024-09-14T11:01:57.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.791+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=O7Q2QK4AW55C type=del size=1418325 2024-09-14T11:01:57.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.793+0000 7fe3dd11f780 1 < suggested remove operation key=YMGE9GKLSPE6 tag=IMBH3RK2XPZ8 type=del 2024-09-14T11:01:57.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.794+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=25ZVOAJ5XMXP type=del size=3866800 2024-09-14T11:01:57.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.796+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=1GR8FO2QOCVU type=del 2024-09-14T11:01:57.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.797+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=9MY0DFPQF16E type=del size=1101171 2024-09-14T11:01:57.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.798+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=SE6VKVYUV752 type=del 2024-09-14T11:01:57.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.800+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=5KG5VTDWX7P4 type=del size=3733416 2024-09-14T11:01:57.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.801+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=MVZQCGCC0YV5 type=del 2024-09-14T11:01:57.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.804+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~W6WR38MGFN39.0 size=102345 2024-09-14T11:01:57.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.804+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=W6WR38MGFN39 tag=ADRL5LGJH2FJ type=write size=1150921 2024-09-14T11:01:57.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.805+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~V377R2P1FAI6.0 size=734128 2024-09-14T11:01:57.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.807+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=V377R2P1FAI6 tag=O5FC53UQZT0X type=write size=1782704 2024-09-14T11:01:57.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.808+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=GX1HK78IDEW4 type=del size=414752 2024-09-14T11:01:57.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.809+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=6XER78M07G07 type=del 2024-09-14T11:01:57.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.810+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=D4UUVZDURQCK type=del size=53511 2024-09-14T11:01:57.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.811+0000 7fe3dd11f780 1 < canceled operation key=QPH41U60044L tag=5ZG0TTCOE8KT type=del size=2226185 2024-09-14T11:01:57.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.813+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=LKV7EIOU7KLZ type=del size=2193595 2024-09-14T11:01:57.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.814+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=9NMWHBMQ3RF9 type=del 2024-09-14T11:01:57.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.815+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=IDVXUYJLUOL8 type=del size=939718 2024-09-14T11:01:57.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.817+0000 7fe3dd11f780 1 < suggested update operation key=4JTN39NIB2UE tag=XW23ZLVXLA54 type=del size=2933502 2024-09-14T11:01:57.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.818+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=HPOQMV4N8YO4 type=write size=108233 2024-09-14T11:01:57.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.819+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=90VOPCG9EQMC type=del 2024-09-14T11:01:57.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.821+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=N7A01J8S1GYO type=del size=2198311 2024-09-14T11:01:57.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.822+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=NGHHSCC9YF1J type=del 2024-09-14T11:01:57.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.824+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~32FUYNSAEM6F.0 size=1048576 2024-09-14T11:01:57.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.825+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~32FUYNSAEM6F.1 size=506334 2024-09-14T11:01:57.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.825+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=32FUYNSAEM6F tag=F4IIU3L3QBXT type=write size=2603486 2024-09-14T11:01:57.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.826+0000 7fe3dd11f780 1 < canceled operation key=PHLQ77OMLI37 tag=YFZHDKBDCVFW type=del size=1767282 2024-09-14T11:01:57.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.827+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=X1HW2RQWGFY8 type=del size=3829692 2024-09-14T11:01:57.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.828+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=3EIE5BD1JB57 type=del 2024-09-14T11:01:57.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.830+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~U8WISPTO1QAI.0 size=1048576 2024-09-14T11:01:57.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.831+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~U8WISPTO1QAI.1 size=185628 2024-09-14T11:01:57.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.831+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=U8WISPTO1QAI tag=P7Z0I954P8CT type=write size=2282780 2024-09-14T11:01:57.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.832+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~NQYHKWHGO4WV.0 size=454807 2024-09-14T11:01:57.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.834+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=NQYHKWHGO4WV tag=SUGXBEYTCDK3 type=write size=1503383 2024-09-14T11:01:57.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.835+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=QVP2MM3KXCYY type=del size=3233374 2024-09-14T11:01:57.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.836+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~WFFZ16CW3YGX.0 size=1048576 2024-09-14T11:01:57.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.837+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~WFFZ16CW3YGX.1 size=492368 2024-09-14T11:01:57.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.839+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=WFFZ16CW3YGX tag=YASE35MNA4M0 type=write size=2589520 2024-09-14T11:01:57.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.840+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=N12OXAHP2LQE type=del size=1221663 2024-09-14T11:01:57.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.842+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=O7Q2QK4AW55C type=del 2024-09-14T11:01:57.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.843+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=J3390Z1IQ18H type=del size=3115477 2024-09-14T11:01:57.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.844+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=25ZVOAJ5XMXP type=del 2024-09-14T11:01:57.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.845+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=XPSKB9G5ED8I type=write size=500436 2024-09-14T11:01:57.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.846+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=9MY0DFPQF16E type=del 2024-09-14T11:01:57.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.847+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=AFWTB2D7Y2QJ type=del size=2179384 2024-09-14T11:01:57.846 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.848+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=5KG5VTDWX7P4 type=del 2024-09-14T11:01:57.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.850+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=HSEG6DO6C3LQ type=del size=2316201 2024-09-14T11:01:57.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.851+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~W6WR38MGFN39.0 size=102345 2024-09-14T11:01:57.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.853+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=W6WR38MGFN39 tag=ADRL5LGJH2FJ type=write size=1150921 2024-09-14T11:01:57.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.855+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~JYYQ15IH4G0C.0 size=1048576 2024-09-14T11:01:57.853 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.856+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~JYYQ15IH4G0C.1 size=686967 2024-09-14T11:01:57.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.856+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=JYYQ15IH4G0C tag=PNECUKV15P5X type=write size=2784119 2024-09-14T11:01:57.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.857+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=GX1HK78IDEW4 type=del 2024-09-14T11:01:57.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.859+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~L2J3Z6NEB8A9.0 size=1048576 2024-09-14T11:01:57.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.860+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~L2J3Z6NEB8A9.1 size=1048576 2024-09-14T11:01:57.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.861+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~L2J3Z6NEB8A9.2 size=462321 2024-09-14T11:01:57.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.861+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=L2J3Z6NEB8A9 tag=B0VVL2IGTJZ0 type=write size=3608049 2024-09-14T11:01:57.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.863+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=D4UUVZDURQCK type=del 2024-09-14T11:01:57.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.864+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=7X4WUPPUGJL1 type=write size=892016 2024-09-14T11:01:57.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.865+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=LKV7EIOU7KLZ type=del 2024-09-14T11:01:57.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.867+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~1OAKMS7GOVBC.0 size=930025 2024-09-14T11:01:57.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.867+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=1OAKMS7GOVBC tag=R2GLN6BHCA83 type=write size=1978601 2024-09-14T11:01:57.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.869+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=IDVXUYJLUOL8 type=del 2024-09-14T11:01:57.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.871+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~3JRX47MLOQFM.0 size=1048576 2024-09-14T11:01:57.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.872+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~3JRX47MLOQFM.1 size=116471 2024-09-14T11:01:57.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.872+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=3JRX47MLOQFM tag=CM79QDKQG50O type=write size=2213623 2024-09-14T11:01:57.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.873+0000 7fe3dd11f780 1 < completed write operation key=OK5L92EKOOMW tag=HPOQMV4N8YO4 type=write size=108233 2024-09-14T11:01:57.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.875+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~I482JHASA0PC.0 size=1048576 2024-09-14T11:01:57.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.876+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~I482JHASA0PC.1 size=1048576 2024-09-14T11:01:57.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.877+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~I482JHASA0PC.2 size=476510 2024-09-14T11:01:57.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.877+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=I482JHASA0PC tag=3KJZNLS4KD3O type=write size=3622238 2024-09-14T11:01:57.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.878+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=N7A01J8S1GYO type=del 2024-09-14T11:01:57.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.880+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~5IBA13TXT1QS.0 size=1048576 2024-09-14T11:01:57.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.881+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~5IBA13TXT1QS.1 size=848748 2024-09-14T11:01:57.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.881+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=5IBA13TXT1QS tag=DXMFTVGHJ6X6 type=write size=2945900 2024-09-14T11:01:57.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.882+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~32FUYNSAEM6F.0 size=1048576 2024-09-14T11:01:57.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.883+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~32FUYNSAEM6F.1 size=506334 2024-09-14T11:01:57.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.885+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=32FUYNSAEM6F tag=F4IIU3L3QBXT type=write size=2603486 2024-09-14T11:01:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.886+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=KHK65K0SBZTY type=del size=2125900 2024-09-14T11:01:57.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.887+0000 7fe3dd11f780 1 < canceled operation key=3PS4LAML698X tag=X1HW2RQWGFY8 type=del size=3829692 2024-09-14T11:01:57.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.890+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~7H9FQAVBW288.0 size=1010215 2024-09-14T11:01:57.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.890+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=7H9FQAVBW288 tag=XJRLKD5BISD4 type=write size=2058791 2024-09-14T11:01:57.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.891+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~U8WISPTO1QAI.0 size=1048576 2024-09-14T11:01:57.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.892+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~U8WISPTO1QAI.1 size=185628 2024-09-14T11:01:57.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.894+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=U8WISPTO1QAI tag=P7Z0I954P8CT type=write size=2282780 2024-09-14T11:01:57.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.895+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=8M19YQ7GGAXO type=del size=1941946 2024-09-14T11:01:57.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.896+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=QVP2MM3KXCYY type=del 2024-09-14T11:01:57.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.897+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=IPI8RG0AXNST type=del size=3244742 2024-09-14T11:01:57.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.898+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=N12OXAHP2LQE type=del 2024-09-14T11:01:57.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.899+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=E5YRE271UROX type=del size=2537289 2024-09-14T11:01:57.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.901+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=J3390Z1IQ18H type=del 2024-09-14T11:01:57.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.903+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~UO3IEJ2WO0BB.0 size=1048576 2024-09-14T11:01:57.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.904+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~UO3IEJ2WO0BB.1 size=1048576 2024-09-14T11:01:57.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.904+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~UO3IEJ2WO0BB.2 size=319455 2024-09-14T11:01:57.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.904+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=UO3IEJ2WO0BB tag=79VXBHC6AV0H type=write size=3465183 2024-09-14T11:01:57.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.907+0000 7fe3dd11f780 1 < suggested remove operation key=ZI5SFHGWCHJA tag=XPSKB9G5ED8I type=write 2024-09-14T11:01:57.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.908+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=0QOE3DZ2SH0Y type=del size=4178082 2024-09-14T11:01:57.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.912+0000 7fe3dd11f780 1 < suggested remove operation key=K9BP30LHDPA1 tag=AFWTB2D7Y2QJ type=del 2024-09-14T11:01:57.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.913+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=R6K3YEQPG31Z type=del size=3450383 2024-09-14T11:01:57.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.914+0000 7fe3dd11f780 1 < canceled operation key=US8KP3YL88TG tag=HSEG6DO6C3LQ type=del size=2316201 2024-09-14T11:01:57.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.915+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=V55D5FYBW213 type=del size=926181 2024-09-14T11:01:57.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.915+0000 7fe3dd11f780 1 < canceled part key=_multipart_VDSOBBVO3QGB.2~JYYQ15IH4G0C.0 size=1048576 2024-09-14T11:01:57.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.916+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~JYYQ15IH4G0C.1 size=686967 2024-09-14T11:01:57.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.918+0000 7fe3dd11f780 1 < canceled multipart upload key=VDSOBBVO3QGB upload=JYYQ15IH4G0C tag=PNECUKV15P5X type=write size=2784119 2024-09-14T11:01:57.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.921+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~VGC2GYEBZR28.0 size=1048576 2024-09-14T11:01:57.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.922+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~VGC2GYEBZR28.1 size=379208 2024-09-14T11:01:57.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.922+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=VGC2GYEBZR28 tag=U8CGZ35UHUFM type=write size=2476360 2024-09-14T11:01:57.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.923+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~L2J3Z6NEB8A9.0 size=1048576 2024-09-14T11:01:57.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.924+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~L2J3Z6NEB8A9.1 size=1048576 2024-09-14T11:01:57.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.925+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~L2J3Z6NEB8A9.2 size=462321 2024-09-14T11:01:57.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.927+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=L2J3Z6NEB8A9 tag=B0VVL2IGTJZ0 type=write size=3608049 2024-09-14T11:01:57.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.929+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~4VXD3FLKZ1KB.0 size=1048576 2024-09-14T11:01:57.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.930+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~4VXD3FLKZ1KB.1 size=1048576 2024-09-14T11:01:57.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.931+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~4VXD3FLKZ1KB.2 size=382176 2024-09-14T11:01:57.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.931+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=4VXD3FLKZ1KB tag=EONN0LMKEVJU type=write size=3527904 2024-09-14T11:01:57.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.933+0000 7fe3dd11f780 1 < canceled operation key=YMGE9GKLSPE6 tag=7X4WUPPUGJL1 type=write size=892016 2024-09-14T11:01:57.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.935+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~011X3GXD8VHM.0 size=950293 2024-09-14T11:01:57.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.935+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=011X3GXD8VHM tag=A4783O7XAZUR type=write size=1998869 2024-09-14T11:01:57.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.935+0000 7fe3dd11f780 1 < canceled part key=_multipart_UYZGHGZR74HQ.2~1OAKMS7GOVBC.0 size=930025 2024-09-14T11:01:57.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.937+0000 7fe3dd11f780 1 < canceled multipart upload key=UYZGHGZR74HQ upload=1OAKMS7GOVBC tag=R2GLN6BHCA83 type=write size=1978601 2024-09-14T11:01:57.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.939+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=8PLBP4CVWNKA type=del size=3937202 2024-09-14T11:01:57.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.940+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~3JRX47MLOQFM.0 size=1048576 2024-09-14T11:01:57.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.941+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~3JRX47MLOQFM.1 size=116471 2024-09-14T11:01:57.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.943+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=3JRX47MLOQFM tag=CM79QDKQG50O type=write size=2213623 2024-09-14T11:01:57.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.946+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~GJICWKTDXFUT.0 size=1048576 2024-09-14T11:01:57.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.946+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~GJICWKTDXFUT.1 size=1048576 2024-09-14T11:01:57.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.947+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~GJICWKTDXFUT.2 size=783638 2024-09-14T11:01:57.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.947+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=GJICWKTDXFUT tag=VNNVME6RQAJF type=write size=3929366 2024-09-14T11:01:57.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.949+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~I482JHASA0PC.0 size=1048576 2024-09-14T11:01:57.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.950+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~I482JHASA0PC.1 size=1048576 2024-09-14T11:01:57.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.951+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~I482JHASA0PC.2 size=476510 2024-09-14T11:01:57.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.953+0000 7fe3dd11f780 1 < completed multipart upload key=ODDNSHK5YMNO upload=I482JHASA0PC tag=3KJZNLS4KD3O type=write size=3622238 2024-09-14T11:01:57.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.954+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=7ZVP1M2IMXHR type=del size=1157594 2024-09-14T11:01:57.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.956+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~5IBA13TXT1QS.0 size=1048576 2024-09-14T11:01:57.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.957+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~5IBA13TXT1QS.1 size=848748 2024-09-14T11:01:57.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.959+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=5IBA13TXT1QS tag=DXMFTVGHJ6X6 type=write size=2945900 2024-09-14T11:01:57.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.960+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=7V7II53L5T1C type=del size=2258981 2024-09-14T11:01:57.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.962+0000 7fe3dd11f780 1 < suggested remove operation key=IOAG4ZE1I58Z tag=KHK65K0SBZTY type=del 2024-09-14T11:01:57.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.965+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~5IQDS4E1L0Y0.0 size=1048576 2024-09-14T11:01:57.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.966+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~5IQDS4E1L0Y0.1 size=444969 2024-09-14T11:01:57.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.966+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=5IQDS4E1L0Y0 tag=Q0D92IOI1VA9 type=write size=2542121 2024-09-14T11:01:57.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.967+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~7H9FQAVBW288.0 size=1010215 2024-09-14T11:01:57.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.969+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=7H9FQAVBW288 tag=XJRLKD5BISD4 type=write size=2058791 2024-09-14T11:01:57.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.971+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~80K229SKQVF1.0 size=1048576 2024-09-14T11:01:57.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.973+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~80K229SKQVF1.1 size=1048576 2024-09-14T11:01:57.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.974+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~80K229SKQVF1.2 size=266966 2024-09-14T11:01:57.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.974+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=80K229SKQVF1 tag=EZASOQ3KPKHX type=write size=3412694 2024-09-14T11:01:57.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.976+0000 7fe3dd11f780 1 < suggested remove operation key=VDSOBBVO3QGB tag=8M19YQ7GGAXO type=del 2024-09-14T11:01:57.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.977+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=3MGCXW005Q1V type=del size=3434856 2024-09-14T11:01:57.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.979+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=IPI8RG0AXNST type=del 2024-09-14T11:01:57.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.981+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~BP65XIJSAUXT.0 size=1048576 2024-09-14T11:01:57.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.982+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~BP65XIJSAUXT.1 size=102238 2024-09-14T11:01:57.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.982+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=BP65XIJSAUXT tag=WONRI3IWSXVA type=write size=2199390 2024-09-14T11:01:57.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.983+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=E5YRE271UROX type=del 2024-09-14T11:01:57.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.985+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~5PYAJQY9H1X5.0 size=1048576 2024-09-14T11:01:57.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.986+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~5PYAJQY9H1X5.1 size=1048576 2024-09-14T11:01:57.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.987+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~5PYAJQY9H1X5.2 size=964828 2024-09-14T11:01:57.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.987+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=5PYAJQY9H1X5 tag=1H3DMABHMKEJ type=write size=4110556 2024-09-14T11:01:57.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.988+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~UO3IEJ2WO0BB.0 size=1048576 2024-09-14T11:01:57.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.989+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~UO3IEJ2WO0BB.1 size=1048576 2024-09-14T11:01:57.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.989+0000 7fe3dd11f780 1 < canceled part key=_multipart_QPH41U60044L.2~UO3IEJ2WO0BB.2 size=319455 2024-09-14T11:01:57.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.991+0000 7fe3dd11f780 1 < canceled multipart upload key=QPH41U60044L upload=UO3IEJ2WO0BB tag=79VXBHC6AV0H type=write size=3465183 2024-09-14T11:01:57.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.993+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~O7PK3AER4JF3.0 size=1048576 2024-09-14T11:01:57.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.994+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~O7PK3AER4JF3.1 size=1048576 2024-09-14T11:01:57.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.995+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~O7PK3AER4JF3.2 size=81524 2024-09-14T11:01:57.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.995+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=O7PK3AER4JF3 tag=9GJ1OW1876N5 type=write size=3227252 2024-09-14T11:01:57.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.996+0000 7fe3dd11f780 -1 < failed to complete operation key=K9BP30LHDPA1 tag=0QOE3DZ2SH0Y type=del size=4178082: (22) Invalid argument 2024-09-14T11:01:57.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.998+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~EKVMDD8RF5MC.0 size=1048576 2024-09-14T11:01:57.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:57.999+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~EKVMDD8RF5MC.1 size=1048576 2024-09-14T11:01:57.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.000+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~EKVMDD8RF5MC.2 size=228860 2024-09-14T11:01:57.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.000+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=EKVMDD8RF5MC tag=XGYRS4BEV3U1 type=write size=3374588 2024-09-14T11:01:57.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.001+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=R6K3YEQPG31Z type=del 2024-09-14T11:01:58.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.003+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=02PV3I1U1KYT type=del size=1503449 2024-09-14T11:01:58.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.004+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=V55D5FYBW213 type=del 2024-09-14T11:01:58.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.006+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~Y0OIICLQV656.0 size=1048576 2024-09-14T11:01:58.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.007+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~Y0OIICLQV656.1 size=140518 2024-09-14T11:01:58.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.007+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=Y0OIICLQV656 tag=NEP6MZI50YV5 type=write size=2237670 2024-09-14T11:01:58.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.007+0000 7fe3dd11f780 1 < canceled part key=_multipart_3PS4LAML698X.2~VGC2GYEBZR28.0 size=1048576 2024-09-14T11:01:58.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.008+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~VGC2GYEBZR28.1 size=379208 2024-09-14T11:01:58.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.010+0000 7fe3dd11f780 1 < canceled multipart upload key=3PS4LAML698X upload=VGC2GYEBZR28 tag=U8CGZ35UHUFM type=write size=2476360 2024-09-14T11:01:58.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.011+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=BZT7TDT9U8YQ type=del size=937738 2024-09-14T11:01:58.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.012+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~4VXD3FLKZ1KB.0 size=1048576 2024-09-14T11:01:58.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.013+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~4VXD3FLKZ1KB.1 size=1048576 2024-09-14T11:01:58.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.014+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~4VXD3FLKZ1KB.2 size=382176 2024-09-14T11:01:58.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.016+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=4VXD3FLKZ1KB tag=EONN0LMKEVJU type=write size=3527904 2024-09-14T11:01:58.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.018+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~65HQTHWI8XL7.0 size=1048576 2024-09-14T11:01:58.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.019+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~65HQTHWI8XL7.1 size=782815 2024-09-14T11:01:58.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.019+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=65HQTHWI8XL7 tag=0X2TBJFJ15BF type=write size=2879967 2024-09-14T11:01:58.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.021+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~011X3GXD8VHM.0 size=950293 2024-09-14T11:01:58.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.023+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=011X3GXD8VHM tag=A4783O7XAZUR type=write size=1998869 2024-09-14T11:01:58.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.025+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~09OGYROA6ZVF.0 size=716710 2024-09-14T11:01:58.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.025+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=09OGYROA6ZVF tag=J5RNUNZHKQOM type=write size=1765286 2024-09-14T11:01:58.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.026+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=8PLBP4CVWNKA type=del 2024-09-14T11:01:58.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.028+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=YCMY200BJZWX type=del size=407266 2024-09-14T11:01:58.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.029+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~GJICWKTDXFUT.0 size=1048576 2024-09-14T11:01:58.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.030+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~GJICWKTDXFUT.1 size=1048576 2024-09-14T11:01:58.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.031+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~GJICWKTDXFUT.2 size=783638 2024-09-14T11:01:58.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.033+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=GJICWKTDXFUT tag=VNNVME6RQAJF type=write size=3929366 2024-09-14T11:01:58.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.034+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=OFU23A4KSU03 type=del size=3315228 2024-09-14T11:01:58.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.035+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=7ZVP1M2IMXHR type=del 2024-09-14T11:01:58.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.037+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=IRHM0PCW07TR type=del size=2385825 2024-09-14T11:01:58.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.038+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=7V7II53L5T1C type=del 2024-09-14T11:01:58.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.040+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=6W23LBXIHS6X type=write size=898741 2024-09-14T11:01:58.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.041+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~5IQDS4E1L0Y0.0 size=1048576 2024-09-14T11:01:58.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.042+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~5IQDS4E1L0Y0.1 size=444969 2024-09-14T11:01:58.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.044+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=5IQDS4E1L0Y0 tag=Q0D92IOI1VA9 type=write size=2542121 2024-09-14T11:01:58.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.045+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=J97E2PT2EG6C type=del size=353287 2024-09-14T11:01:58.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.046+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~80K229SKQVF1.0 size=1048576 2024-09-14T11:01:58.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.047+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~80K229SKQVF1.1 size=1048576 2024-09-14T11:01:58.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.048+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~80K229SKQVF1.2 size=266966 2024-09-14T11:01:58.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.051+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=80K229SKQVF1 tag=EZASOQ3KPKHX type=write size=3412694 2024-09-14T11:01:58.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.053+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~IWMSTE07FU0W.0 size=1048576 2024-09-14T11:01:58.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.054+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~IWMSTE07FU0W.1 size=492848 2024-09-14T11:01:58.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.054+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=IWMSTE07FU0W tag=CQX2CQOX2LTS type=write size=2590000 2024-09-14T11:01:58.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.056+0000 7fe3dd11f780 1 < suggested update operation key=UYZGHGZR74HQ tag=3MGCXW005Q1V type=del size=3434856 2024-09-14T11:01:58.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.059+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~OR8E9LM4MST4.0 size=1004992 2024-09-14T11:01:58.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.059+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=OR8E9LM4MST4 tag=E40UPT83OFOA type=write size=2053568 2024-09-14T11:01:58.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.060+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~BP65XIJSAUXT.0 size=1048576 2024-09-14T11:01:58.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.061+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~BP65XIJSAUXT.1 size=102238 2024-09-14T11:01:58.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.063+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=BP65XIJSAUXT tag=WONRI3IWSXVA type=write size=2199390 2024-09-14T11:01:58.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.064+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=H4CJDIM2T8Q4 type=del size=1761385 2024-09-14T11:01:58.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.065+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~5PYAJQY9H1X5.0 size=1048576 2024-09-14T11:01:58.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.065+0000 7fe3dd11f780 1 < canceled part key=_multipart_3PS4LAML698X.2~5PYAJQY9H1X5.1 size=1048576 2024-09-14T11:01:58.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.066+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~5PYAJQY9H1X5.2 size=964828 2024-09-14T11:01:58.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.069+0000 7fe3dd11f780 1 < canceled multipart upload key=3PS4LAML698X upload=5PYAJQY9H1X5 tag=1H3DMABHMKEJ type=write size=4110556 2024-09-14T11:01:58.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.070+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=R76DNPYVCRVI type=del size=2731769 2024-09-14T11:01:58.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.070+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~O7PK3AER4JF3.0 size=1048576 2024-09-14T11:01:58.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.071+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~O7PK3AER4JF3.1 size=1048576 2024-09-14T11:01:58.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.072+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~O7PK3AER4JF3.2 size=81524 2024-09-14T11:01:58.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.074+0000 7fe3dd11f780 1 < canceled multipart upload key=GQEFQ1UD6QCJ upload=O7PK3AER4JF3 tag=9GJ1OW1876N5 type=write size=3227252 2024-09-14T11:01:58.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.075+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=R4644TO1GXPY type=del size=2203836 2024-09-14T11:01:58.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.076+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~EKVMDD8RF5MC.0 size=1048576 2024-09-14T11:01:58.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.077+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~EKVMDD8RF5MC.1 size=1048576 2024-09-14T11:01:58.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.078+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~EKVMDD8RF5MC.2 size=228860 2024-09-14T11:01:58.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.080+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=EKVMDD8RF5MC tag=XGYRS4BEV3U1 type=write size=3374588 2024-09-14T11:01:58.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.081+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=ZOA2W0KKVM80 type=write size=141246 2024-09-14T11:01:58.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.083+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=02PV3I1U1KYT type=del 2024-09-14T11:01:58.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.084+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=TNTPEGJYUCQ5 type=del size=338043 2024-09-14T11:01:58.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.085+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~Y0OIICLQV656.0 size=1048576 2024-09-14T11:01:58.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.086+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~Y0OIICLQV656.1 size=140518 2024-09-14T11:01:58.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.088+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=Y0OIICLQV656 tag=NEP6MZI50YV5 type=write size=2237670 2024-09-14T11:01:58.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.090+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=RZEU4XOZECD0 type=write size=253025 2024-09-14T11:01:58.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.091+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=BZT7TDT9U8YQ type=del 2024-09-14T11:01:58.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.092+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=QF71DI2XA3V9 type=del size=2482670 2024-09-14T11:01:58.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.093+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~65HQTHWI8XL7.0 size=1048576 2024-09-14T11:01:58.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.094+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~65HQTHWI8XL7.1 size=782815 2024-09-14T11:01:58.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.096+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=65HQTHWI8XL7 tag=0X2TBJFJ15BF type=write size=2879967 2024-09-14T11:01:58.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.097+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=Z3YXGJ19FSVT type=del size=504908 2024-09-14T11:01:58.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.099+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~09OGYROA6ZVF.0 size=716710 2024-09-14T11:01:58.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.101+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=09OGYROA6ZVF tag=J5RNUNZHKQOM type=write size=1765286 2024-09-14T11:01:58.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.103+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~6FSAFFWN0BJW.0 size=1048576 2024-09-14T11:01:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.104+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~6FSAFFWN0BJW.1 size=1009500 2024-09-14T11:01:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.104+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=6FSAFFWN0BJW tag=VXV3K3BCD3RH type=write size=3106652 2024-09-14T11:01:58.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.105+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=YCMY200BJZWX type=del 2024-09-14T11:01:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.106+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=RK5G5KRAUFIU type=del size=3614617 2024-09-14T11:01:58.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.108+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=OFU23A4KSU03 type=del 2024-09-14T11:01:58.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.109+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=Y0QTZ3C2CQTE type=del size=958154 2024-09-14T11:01:58.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.110+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=IRHM0PCW07TR type=del 2024-09-14T11:01:58.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.111+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=OX6S1D0KKQNT type=del size=159352 2024-09-14T11:01:58.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.114+0000 7fe3dd11f780 1 < suggested remove operation key=JSEN4QXEMVHS tag=6W23LBXIHS6X type=write 2024-09-14T11:01:58.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.115+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=UH3NUAVGKN84 type=del size=1091500 2024-09-14T11:01:58.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.117+0000 7fe3dd11f780 1 < suggested remove operation key=LFKLJAJWQ2J6 tag=J97E2PT2EG6C type=del 2024-09-14T11:01:58.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.119+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~TBU0SWMESTUR.0 size=232177 2024-09-14T11:01:58.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.119+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=TBU0SWMESTUR tag=FRRTYJXNFMHY type=write size=1280753 2024-09-14T11:01:58.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.120+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~IWMSTE07FU0W.0 size=1048576 2024-09-14T11:01:58.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.120+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~IWMSTE07FU0W.1 size=492848 2024-09-14T11:01:58.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.121+0000 7fe3dd11f780 1 < canceled multipart upload key=LL9VJXEU13IK upload=IWMSTE07FU0W tag=CQX2CQOX2LTS type=write size=2590000 2024-09-14T11:01:58.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.123+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=F9JW05HGBC80 type=del size=3121385 2024-09-14T11:01:58.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.124+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~OR8E9LM4MST4.0 size=1004992 2024-09-14T11:01:58.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.126+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=OR8E9LM4MST4 tag=E40UPT83OFOA type=write size=2053568 2024-09-14T11:01:58.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.128+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~7DVZUR1PLL86.0 size=1048576 2024-09-14T11:01:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.129+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~7DVZUR1PLL86.1 size=61883 2024-09-14T11:01:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.129+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=7DVZUR1PLL86 tag=94SYXQOEJF4I type=write size=2159035 2024-09-14T11:01:58.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.130+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=H4CJDIM2T8Q4 type=del 2024-09-14T11:01:58.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.131+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=XKFSSWFG7CUP type=del size=2737828 2024-09-14T11:01:58.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.133+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=R76DNPYVCRVI type=del 2024-09-14T11:01:58.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.135+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=Y5LDG0C88BGB type=del size=1411086 2024-09-14T11:01:58.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.136+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=R4644TO1GXPY type=del 2024-09-14T11:01:58.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.138+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=X1NG7JJELGHA type=del size=2712115 2024-09-14T11:01:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.139+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=ZOA2W0KKVM80 type=write size=141246 2024-09-14T11:01:58.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.140+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=1BPGI67SMNTF type=del size=1242730 2024-09-14T11:01:58.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.141+0000 7fe3dd11f780 1 < canceled operation key=UYZGHGZR74HQ tag=TNTPEGJYUCQ5 type=del size=338043 2024-09-14T11:01:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.142+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=7YGUV1GW4TM8 type=del size=1857113 2024-09-14T11:01:58.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.145+0000 7fe3dd11f780 1 < suggested update operation key=MD0OU8IC5PYI tag=RZEU4XOZECD0 type=write size=253025 2024-09-14T11:01:58.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.147+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~0ZTDSAXVTDDE.0 size=1048576 2024-09-14T11:01:58.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.148+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~0ZTDSAXVTDDE.1 size=1048576 2024-09-14T11:01:58.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.149+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~0ZTDSAXVTDDE.2 size=918859 2024-09-14T11:01:58.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.149+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=0ZTDSAXVTDDE tag=FJASRHXEVSRI type=write size=4064587 2024-09-14T11:01:58.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.150+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=QF71DI2XA3V9 type=del 2024-09-14T11:01:58.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.151+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=0BY6JD9K57RJ type=del size=2638648 2024-09-14T11:01:58.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.152+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=Z3YXGJ19FSVT type=del 2024-09-14T11:01:58.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.154+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~TWYCBVLRSXFN.0 size=1048576 2024-09-14T11:01:58.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.155+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~TWYCBVLRSXFN.1 size=1048576 2024-09-14T11:01:58.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.156+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~TWYCBVLRSXFN.2 size=987940 2024-09-14T11:01:58.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.156+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=TWYCBVLRSXFN tag=HRGJL79H0IG8 type=write size=4133668 2024-09-14T11:01:58.156 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.158+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~6FSAFFWN0BJW.0 size=1048576 2024-09-14T11:01:58.156 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.159+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~6FSAFFWN0BJW.1 size=1009500 2024-09-14T11:01:58.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.161+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=6FSAFFWN0BJW tag=VXV3K3BCD3RH type=write size=3106652 2024-09-14T11:01:58.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.162+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=3BLCQHPQ9R0Z type=del size=201223 2024-09-14T11:01:58.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.163+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=RK5G5KRAUFIU type=del 2024-09-14T11:01:58.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.165+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~3WNRRZA3QDZH.0 size=572989 2024-09-14T11:01:58.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.165+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=3WNRRZA3QDZH tag=MRA078CHY340 type=write size=1621565 2024-09-14T11:01:58.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.166+0000 7fe3dd11f780 -1 < failed to complete operation key=JSEN4QXEMVHS tag=Y0QTZ3C2CQTE type=del size=958154: (22) Invalid argument 2024-09-14T11:01:58.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.167+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=4VMMK8UHDOKW type=del size=1790768 2024-09-14T11:01:58.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.169+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=OX6S1D0KKQNT type=del 2024-09-14T11:01:58.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.170+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=JFQV4KCUPAKX type=del size=2679891 2024-09-14T11:01:58.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.172+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=UH3NUAVGKN84 type=del 2024-09-14T11:01:58.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.174+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~VBMMQ9WX6ZHC.0 size=1048576 2024-09-14T11:01:58.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.175+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~VBMMQ9WX6ZHC.1 size=1048576 2024-09-14T11:01:58.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.176+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~VBMMQ9WX6ZHC.2 size=220296 2024-09-14T11:01:58.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.176+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=VBMMQ9WX6ZHC tag=NUIBZE96324X type=write size=3366024 2024-09-14T11:01:58.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.177+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~TBU0SWMESTUR.0 size=232177 2024-09-14T11:01:58.177 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.179+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=TBU0SWMESTUR tag=FRRTYJXNFMHY type=write size=1280753 2024-09-14T11:01:58.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.180+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=RQ0143EHDRX2 type=del size=2701474 2024-09-14T11:01:58.179 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.181+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=F9JW05HGBC80 type=del 2024-09-14T11:01:58.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.183+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=RTU6AWMYM4B8 type=del size=1957311 2024-09-14T11:01:58.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.184+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~7DVZUR1PLL86.0 size=1048576 2024-09-14T11:01:58.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.185+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~7DVZUR1PLL86.1 size=61883 2024-09-14T11:01:58.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.187+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=7DVZUR1PLL86 tag=94SYXQOEJF4I type=write size=2159035 2024-09-14T11:01:58.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.189+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~Q85ZACAJUOQO.0 size=1048576 2024-09-14T11:01:58.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.190+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~Q85ZACAJUOQO.1 size=980399 2024-09-14T11:01:58.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.190+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=Q85ZACAJUOQO tag=FYTHZMLRU4SV type=write size=3077551 2024-09-14T11:01:58.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.191+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=XKFSSWFG7CUP type=del 2024-09-14T11:01:58.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.192+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=U76NZ7SWKEHW type=write size=815525 2024-09-14T11:01:58.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.193+0000 7fe3dd11f780 -1 < failed to complete operation key=MD0OU8IC5PYI tag=Y5LDG0C88BGB type=del size=1411086: (22) Invalid argument 2024-09-14T11:01:58.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.195+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~7ZZUBG6WPH66.0 size=1048576 2024-09-14T11:01:58.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.196+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~7ZZUBG6WPH66.1 size=263995 2024-09-14T11:01:58.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.196+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=7ZZUBG6WPH66 tag=9W5YP7BE0NK4 type=write size=2361147 2024-09-14T11:01:58.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.197+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=X1NG7JJELGHA type=del 2024-09-14T11:01:58.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.198+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=7XN9ZJS85WR7 type=write size=706920 2024-09-14T11:01:58.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.200+0000 7fe3dd11f780 1 < suggested update operation key=3PS4LAML698X tag=1BPGI67SMNTF type=del size=1242730 2024-09-14T11:01:58.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.202+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=753IYC5WGYW9 type=del size=165402 2024-09-14T11:01:58.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.203+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=7YGUV1GW4TM8 type=del 2024-09-14T11:01:58.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.205+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~V25IG69EHHNO.0 size=1048576 2024-09-14T11:01:58.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.206+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~V25IG69EHHNO.1 size=840921 2024-09-14T11:01:58.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.206+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=V25IG69EHHNO tag=H54VLFXBBYHE type=write size=2938073 2024-09-14T11:01:58.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.207+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~0ZTDSAXVTDDE.0 size=1048576 2024-09-14T11:01:58.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.208+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~0ZTDSAXVTDDE.1 size=1048576 2024-09-14T11:01:58.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.208+0000 7fe3dd11f780 1 < canceled part key=_multipart_KXL3E0PJBNBA.2~0ZTDSAXVTDDE.2 size=918859 2024-09-14T11:01:58.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.209+0000 7fe3dd11f780 1 < canceled multipart upload key=KXL3E0PJBNBA upload=0ZTDSAXVTDDE tag=FJASRHXEVSRI type=write size=4064587 2024-09-14T11:01:58.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.211+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=3I3TDXPRGMH2 type=del size=264151 2024-09-14T11:01:58.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.212+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=0BY6JD9K57RJ type=del 2024-09-14T11:01:58.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.214+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~898U6XFX2KHA.0 size=1048576 2024-09-14T11:01:58.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.215+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~898U6XFX2KHA.1 size=327444 2024-09-14T11:01:58.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.215+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=898U6XFX2KHA tag=4B4YV2P8P7R0 type=write size=2424596 2024-09-14T11:01:58.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.216+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~TWYCBVLRSXFN.0 size=1048576 2024-09-14T11:01:58.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.217+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~TWYCBVLRSXFN.1 size=1048576 2024-09-14T11:01:58.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.218+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~TWYCBVLRSXFN.2 size=987940 2024-09-14T11:01:58.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.220+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=TWYCBVLRSXFN tag=HRGJL79H0IG8 type=write size=4133668 2024-09-14T11:01:58.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.221+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=4ICKT1A7HLMP type=del size=1901386 2024-09-14T11:01:58.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.223+0000 7fe3dd11f780 1 < suggested update operation key=QPH41U60044L tag=3BLCQHPQ9R0Z type=del size=201223 2024-09-14T11:01:58.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.225+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~PXPJAGIOKMWC.0 size=1048576 2024-09-14T11:01:58.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.226+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~PXPJAGIOKMWC.1 size=1048576 2024-09-14T11:01:58.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.227+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~PXPJAGIOKMWC.2 size=781246 2024-09-14T11:01:58.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.227+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=PXPJAGIOKMWC tag=MXGKEHBLMO6A type=write size=3926974 2024-09-14T11:01:58.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.227+0000 7fe3dd11f780 1 < canceled part key=_multipart_OK5L92EKOOMW.2~3WNRRZA3QDZH.0 size=572989 2024-09-14T11:01:58.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.229+0000 7fe3dd11f780 1 < canceled multipart upload key=OK5L92EKOOMW upload=3WNRRZA3QDZH tag=MRA078CHY340 type=write size=1621565 2024-09-14T11:01:58.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.230+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=XTVR4N5PTDJ2 type=del size=3083112 2024-09-14T11:01:58.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.233+0000 7fe3dd11f780 1 < suggested remove operation key=3PS4LAML698X tag=4VMMK8UHDOKW type=del 2024-09-14T11:01:58.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.234+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=BCE3DU0Y1XCH type=del size=3550159 2024-09-14T11:01:58.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.235+0000 7fe3dd11f780 1 < canceled operation key=YMGE9GKLSPE6 tag=JFQV4KCUPAKX type=del size=2679891 2024-09-14T11:01:58.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.236+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=A8PG2CZTZLAD type=del size=1436838 2024-09-14T11:01:58.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.238+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~VBMMQ9WX6ZHC.0 size=1048576 2024-09-14T11:01:58.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.239+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~VBMMQ9WX6ZHC.1 size=1048576 2024-09-14T11:01:58.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.239+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~VBMMQ9WX6ZHC.2 size=220296 2024-09-14T11:01:58.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.241+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=VBMMQ9WX6ZHC tag=NUIBZE96324X type=write size=3366024 2024-09-14T11:01:58.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.244+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~PQEJ3D4RVAG2.0 size=1048576 2024-09-14T11:01:58.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.245+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~PQEJ3D4RVAG2.1 size=1048576 2024-09-14T11:01:58.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.246+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~PQEJ3D4RVAG2.2 size=172048 2024-09-14T11:01:58.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.246+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=PQEJ3D4RVAG2 tag=5D8XBU19Z9E0 type=write size=3317776 2024-09-14T11:01:58.245 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.247+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=RQ0143EHDRX2 type=del 2024-09-14T11:01:58.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.249+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=ET7UECHWLCSL type=del size=2095356 2024-09-14T11:01:58.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.250+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=RTU6AWMYM4B8 type=del 2024-09-14T11:01:58.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.251+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=OR3Q0SK32ISE type=del size=181097 2024-09-14T11:01:58.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.252+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~Q85ZACAJUOQO.0 size=1048576 2024-09-14T11:01:58.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.253+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~Q85ZACAJUOQO.1 size=980399 2024-09-14T11:01:58.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.255+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=Q85ZACAJUOQO tag=FYTHZMLRU4SV type=write size=3077551 2024-09-14T11:01:58.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.257+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~G3XFXLU558P0.0 size=271266 2024-09-14T11:01:58.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.257+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=G3XFXLU558P0 tag=BRE3148K6Y4J type=write size=1319842 2024-09-14T11:01:58.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.258+0000 7fe3dd11f780 1 < completed write operation key=6PJ03TAYRUT8 tag=U76NZ7SWKEHW type=write size=815525 2024-09-14T11:01:58.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.259+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=P3SQ2GMQR0W2 type=del size=2785095 2024-09-14T11:01:58.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.260+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~7ZZUBG6WPH66.0 size=1048576 2024-09-14T11:01:58.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.261+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~7ZZUBG6WPH66.1 size=263995 2024-09-14T11:01:58.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.263+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=7ZZUBG6WPH66 tag=9W5YP7BE0NK4 type=write size=2361147 2024-09-14T11:01:58.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.264+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=1PTJSN0134KB type=del size=2205401 2024-09-14T11:01:58.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.265+0000 7fe3dd11f780 1 < canceled operation key=UYZGHGZR74HQ tag=7XN9ZJS85WR7 type=write size=706920 2024-09-14T11:01:58.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.267+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=CIIA1C6U6DWK type=del size=1521828 2024-09-14T11:01:58.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.269+0000 7fe3dd11f780 1 < suggested remove operation key=ODDNSHK5YMNO tag=753IYC5WGYW9 type=del 2024-09-14T11:01:58.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.270+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=8P0X2611CZTU type=write size=781926 2024-09-14T11:01:58.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.271+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~V25IG69EHHNO.0 size=1048576 2024-09-14T11:01:58.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.272+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~V25IG69EHHNO.1 size=840921 2024-09-14T11:01:58.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.274+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=V25IG69EHHNO tag=H54VLFXBBYHE type=write size=2938073 2024-09-14T11:01:58.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.275+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=DL617Z9S5SKK type=del size=1429123 2024-09-14T11:01:58.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.276+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=3I3TDXPRGMH2 type=del 2024-09-14T11:01:58.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.278+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~8SAL6E5LITQD.0 size=32728 2024-09-14T11:01:58.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.278+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=8SAL6E5LITQD tag=XB4KBATRSYNS type=write size=1081304 2024-09-14T11:01:58.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.279+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~898U6XFX2KHA.0 size=1048576 2024-09-14T11:01:58.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.280+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~898U6XFX2KHA.1 size=327444 2024-09-14T11:01:58.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.282+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=898U6XFX2KHA tag=4B4YV2P8P7R0 type=write size=2424596 2024-09-14T11:01:58.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.283+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=U42I9XSW93Q3 type=del size=671343 2024-09-14T11:01:58.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.285+0000 7fe3dd11f780 -1 < failed to complete operation key=3PS4LAML698X tag=4ICKT1A7HLMP type=del size=1901386: (22) Invalid argument 2024-09-14T11:01:58.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.286+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=HGL0H6VKF69L type=del size=3930085 2024-09-14T11:01:58.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.287+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~PXPJAGIOKMWC.0 size=1048576 2024-09-14T11:01:58.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.288+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~PXPJAGIOKMWC.1 size=1048576 2024-09-14T11:01:58.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.289+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~PXPJAGIOKMWC.2 size=781246 2024-09-14T11:01:58.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.291+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=PXPJAGIOKMWC tag=MXGKEHBLMO6A type=write size=3926974 2024-09-14T11:01:58.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.292+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=0EBH2MQCZGAK type=del size=3858251 2024-09-14T11:01:58.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.294+0000 7fe3dd11f780 1 < suggested remove operation key=US8KP3YL88TG tag=XTVR4N5PTDJ2 type=del 2024-09-14T11:01:58.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.296+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~S7NKNBFT4P31.0 size=895120 2024-09-14T11:01:58.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.296+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=S7NKNBFT4P31 tag=9ER4QM5QW7M2 type=write size=1943696 2024-09-14T11:01:58.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.298+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=BCE3DU0Y1XCH type=del 2024-09-14T11:01:58.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.300+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~ODLET893WT3P.0 size=1048576 2024-09-14T11:01:58.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.301+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~ODLET893WT3P.1 size=583334 2024-09-14T11:01:58.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.301+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=ODLET893WT3P tag=ZB3W2JSEODEK type=write size=2680486 2024-09-14T11:01:58.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.302+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=A8PG2CZTZLAD type=del 2024-09-14T11:01:58.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.303+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=KK0D6H31BR4S type=del size=337528 2024-09-14T11:01:58.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.304+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~PQEJ3D4RVAG2.0 size=1048576 2024-09-14T11:01:58.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.305+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~PQEJ3D4RVAG2.1 size=1048576 2024-09-14T11:01:58.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.306+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~PQEJ3D4RVAG2.2 size=172048 2024-09-14T11:01:58.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.308+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=PQEJ3D4RVAG2 tag=5D8XBU19Z9E0 type=write size=3317776 2024-09-14T11:01:58.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.309+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=004WLVX2IIAV type=del size=1730933 2024-09-14T11:01:58.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.310+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=ET7UECHWLCSL type=del 2024-09-14T11:01:58.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.311+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=BXU1EHAUC6XW type=del size=3899185 2024-09-14T11:01:58.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.313+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=OR3Q0SK32ISE type=del 2024-09-14T11:01:58.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.315+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~CHH6WA3PW9RB.0 size=1048576 2024-09-14T11:01:58.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.316+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~CHH6WA3PW9RB.1 size=278115 2024-09-14T11:01:58.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.316+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=CHH6WA3PW9RB tag=0TKXRTK82JZW type=write size=2375267 2024-09-14T11:01:58.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.317+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~G3XFXLU558P0.0 size=271266 2024-09-14T11:01:58.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.319+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=G3XFXLU558P0 tag=BRE3148K6Y4J type=write size=1319842 2024-09-14T11:01:58.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.320+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=Q9TXNWFYTLP3 type=del size=1323319 2024-09-14T11:01:58.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.321+0000 7fe3dd11f780 -1 < failed to complete operation key=US8KP3YL88TG tag=P3SQ2GMQR0W2 type=del size=2785095: (22) Invalid argument 2024-09-14T11:01:58.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.324+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~QQ0DW5GQ9WAN.0 size=1048576 2024-09-14T11:01:58.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.325+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~QQ0DW5GQ9WAN.1 size=1048576 2024-09-14T11:01:58.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.326+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~QQ0DW5GQ9WAN.2 size=770774 2024-09-14T11:01:58.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.326+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=QQ0DW5GQ9WAN tag=J2F9LIWQGYLW type=write size=3916502 2024-09-14T11:01:58.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.328+0000 7fe3dd11f780 1 < suggested update operation key=A89YQO40BHUS tag=1PTJSN0134KB type=del size=2205401 2024-09-14T11:01:58.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.330+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=ZNQCZ603NJ4I type=del size=2765910 2024-09-14T11:01:58.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.331+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=CIIA1C6U6DWK type=del 2024-09-14T11:01:58.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.332+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=88BH8LBT8PLR type=del size=3500609 2024-09-14T11:01:58.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.333+0000 7fe3dd11f780 1 < completed write operation key=QPH41U60044L tag=8P0X2611CZTU type=write size=781926 2024-09-14T11:01:58.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.335+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~DSBOP5QBCAWI.0 size=1048576 2024-09-14T11:01:58.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.336+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~DSBOP5QBCAWI.1 size=1048576 2024-09-14T11:01:58.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.337+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~DSBOP5QBCAWI.2 size=997630 2024-09-14T11:01:58.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.337+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=DSBOP5QBCAWI tag=6ALFXWRIHZOZ type=write size=4143358 2024-09-14T11:01:58.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.338+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=DL617Z9S5SKK type=del 2024-09-14T11:01:58.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.340+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~NA5HK2VQ0LXE.0 size=409275 2024-09-14T11:01:58.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.340+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=NA5HK2VQ0LXE tag=I10XEX30JI00 type=write size=1457851 2024-09-14T11:01:58.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.341+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~8SAL6E5LITQD.0 size=32728 2024-09-14T11:01:58.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.343+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=8SAL6E5LITQD tag=XB4KBATRSYNS type=write size=1081304 2024-09-14T11:01:58.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.345+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=F17VV2XEX2S8 type=del size=3970959 2024-09-14T11:01:58.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.346+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=U42I9XSW93Q3 type=del 2024-09-14T11:01:58.344 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.347+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=2DW3ZITLBOGU type=del size=355010 2024-09-14T11:01:58.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.348+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=HGL0H6VKF69L type=del 2024-09-14T11:01:58.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.349+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=Q4UHTFAZKXTV type=del size=897705 2024-09-14T11:01:58.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.352+0000 7fe3dd11f780 1 < suggested update operation key=YXPZXFY8930D tag=0EBH2MQCZGAK type=del size=3858251 2024-09-14T11:01:58.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.355+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~BHEY9WDJ3RUX.0 size=1048576 2024-09-14T11:01:58.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.357+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~BHEY9WDJ3RUX.1 size=1048576 2024-09-14T11:01:58.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.358+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~BHEY9WDJ3RUX.2 size=860393 2024-09-14T11:01:58.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.358+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=BHEY9WDJ3RUX tag=SDGWLMN0R1JR type=write size=4006121 2024-09-14T11:01:58.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.359+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~S7NKNBFT4P31.0 size=895120 2024-09-14T11:01:58.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.361+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=S7NKNBFT4P31 tag=9ER4QM5QW7M2 type=write size=1943696 2024-09-14T11:01:58.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.362+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=MMXN5QYVQAD3 type=del size=3666955 2024-09-14T11:01:58.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.363+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~ODLET893WT3P.0 size=1048576 2024-09-14T11:01:58.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.364+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~ODLET893WT3P.1 size=583334 2024-09-14T11:01:58.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.366+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=ODLET893WT3P tag=ZB3W2JSEODEK type=write size=2680486 2024-09-14T11:01:58.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.368+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~HO8XPMAN9EYZ.0 size=1048576 2024-09-14T11:01:58.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.369+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~HO8XPMAN9EYZ.1 size=831804 2024-09-14T11:01:58.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.369+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=HO8XPMAN9EYZ tag=HR9GQ0AL6ALO type=write size=2928956 2024-09-14T11:01:58.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.370+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=KK0D6H31BR4S type=del 2024-09-14T11:01:58.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.371+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=GXK0UWYILEI3 type=write size=666901 2024-09-14T11:01:58.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.374+0000 7fe3dd11f780 1 < suggested update operation key=IOAG4ZE1I58Z tag=004WLVX2IIAV type=del size=1730933 2024-09-14T11:01:58.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.375+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=QU1YAROFCEXY type=del size=3512419 2024-09-14T11:01:58.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.377+0000 7fe3dd11f780 1 < suggested update operation key=MD0OU8IC5PYI tag=BXU1EHAUC6XW type=del size=3899185 2024-09-14T11:01:58.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.378+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=IVUZ7RS5313S type=del size=430514 2024-09-14T11:01:58.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.379+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~CHH6WA3PW9RB.0 size=1048576 2024-09-14T11:01:58.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.380+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~CHH6WA3PW9RB.1 size=278115 2024-09-14T11:01:58.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.382+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=CHH6WA3PW9RB tag=0TKXRTK82JZW type=write size=2375267 2024-09-14T11:01:58.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.384+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=HA0JB4OTDM71 type=del size=2721235 2024-09-14T11:01:58.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.385+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=Q9TXNWFYTLP3 type=del 2024-09-14T11:01:58.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.386+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=HF1ES469U4K3 type=del size=862052 2024-09-14T11:01:58.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.387+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~QQ0DW5GQ9WAN.0 size=1048576 2024-09-14T11:01:58.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.388+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~QQ0DW5GQ9WAN.1 size=1048576 2024-09-14T11:01:58.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.389+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~QQ0DW5GQ9WAN.2 size=770774 2024-09-14T11:01:58.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.391+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=QQ0DW5GQ9WAN tag=J2F9LIWQGYLW type=write size=3916502 2024-09-14T11:01:58.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.392+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=EYFC5UDGCSA2 type=del size=1992311 2024-09-14T11:01:58.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.393+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=ZNQCZ603NJ4I type=del 2024-09-14T11:01:58.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.395+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=LH39HLA6OL1X type=del size=432415 2024-09-14T11:01:58.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.396+0000 7fe3dd11f780 -1 < failed to complete operation key=MD0OU8IC5PYI tag=88BH8LBT8PLR type=del size=3500609: (22) Invalid argument 2024-09-14T11:01:58.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.397+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=EZ3POFVQ0OY7 type=del size=594613 2024-09-14T11:01:58.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.397+0000 7fe3dd11f780 1 < canceled part key=_multipart_NHKCRGX10WBM.2~DSBOP5QBCAWI.0 size=1048576 2024-09-14T11:01:58.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.398+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~DSBOP5QBCAWI.1 size=1048576 2024-09-14T11:01:58.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.400+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~DSBOP5QBCAWI.2 size=997630 2024-09-14T11:01:58.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.402+0000 7fe3dd11f780 1 < canceled multipart upload key=NHKCRGX10WBM upload=DSBOP5QBCAWI tag=6ALFXWRIHZOZ type=write size=4143358 2024-09-14T11:01:58.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.403+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=LKNWG8VNWAKD type=del size=3059458 2024-09-14T11:01:58.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.404+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~NA5HK2VQ0LXE.0 size=409275 2024-09-14T11:01:58.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.406+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=NA5HK2VQ0LXE tag=I10XEX30JI00 type=write size=1457851 2024-09-14T11:01:58.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.408+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~MGCFUIVXXVD4.0 size=1048576 2024-09-14T11:01:58.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.409+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~MGCFUIVXXVD4.1 size=398164 2024-09-14T11:01:58.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.409+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=MGCFUIVXXVD4 tag=1Q7KSX8RIH9U type=write size=2495316 2024-09-14T11:01:58.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.410+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=F17VV2XEX2S8 type=del 2024-09-14T11:01:58.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.411+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=TGG7XVIUI8MC type=del size=1725415 2024-09-14T11:01:58.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.413+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=2DW3ZITLBOGU type=del 2024-09-14T11:01:58.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.415+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~H5GCUBJNS0B8.0 size=1048576 2024-09-14T11:01:58.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.416+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~H5GCUBJNS0B8.1 size=590073 2024-09-14T11:01:58.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.416+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=H5GCUBJNS0B8 tag=75QE6G55XF63 type=write size=2687225 2024-09-14T11:01:58.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.417+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=Q4UHTFAZKXTV type=del 2024-09-14T11:01:58.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.418+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=53ME061PZ1AA type=del size=1193170 2024-09-14T11:01:58.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.419+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~BHEY9WDJ3RUX.0 size=1048576 2024-09-14T11:01:58.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.420+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~BHEY9WDJ3RUX.1 size=1048576 2024-09-14T11:01:58.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.421+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~BHEY9WDJ3RUX.2 size=860393 2024-09-14T11:01:58.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.423+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=BHEY9WDJ3RUX tag=SDGWLMN0R1JR type=write size=4006121 2024-09-14T11:01:58.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.426+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~G8ZUF58Z5E2M.0 size=1048576 2024-09-14T11:01:58.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.427+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~G8ZUF58Z5E2M.1 size=59409 2024-09-14T11:01:58.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.427+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=G8ZUF58Z5E2M tag=EGWB0ZWDXBX9 type=write size=2156561 2024-09-14T11:01:58.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.428+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=MMXN5QYVQAD3 type=del 2024-09-14T11:01:58.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.430+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~ONQC7B7I863U.0 size=138835 2024-09-14T11:01:58.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.430+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=ONQC7B7I863U tag=SIMWYX94DR3X type=write size=1187411 2024-09-14T11:01:58.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.431+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~HO8XPMAN9EYZ.0 size=1048576 2024-09-14T11:01:58.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.432+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~HO8XPMAN9EYZ.1 size=831804 2024-09-14T11:01:58.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.434+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=HO8XPMAN9EYZ tag=HR9GQ0AL6ALO type=write size=2928956 2024-09-14T11:01:58.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.436+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=JQ0K2WDNWIVP type=del size=3852837 2024-09-14T11:01:58.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.437+0000 7fe3dd11f780 1 < completed write operation key=22TI1VCDTK5P tag=GXK0UWYILEI3 type=write size=666901 2024-09-14T11:01:58.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.439+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~AQ4OXA7UR764.0 size=1048576 2024-09-14T11:01:58.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.440+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~AQ4OXA7UR764.1 size=337327 2024-09-14T11:01:58.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.440+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=AQ4OXA7UR764 tag=HPW4KSG7G949 type=write size=2434479 2024-09-14T11:01:58.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.442+0000 7fe3dd11f780 1 < suggested update operation key=YMGE9GKLSPE6 tag=QU1YAROFCEXY type=del size=3512419 2024-09-14T11:01:58.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.444+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=6V5BTMFSP8UY type=write size=18028 2024-09-14T11:01:58.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.445+0000 7fe3dd11f780 1 < canceled operation key=4JTN39NIB2UE tag=IVUZ7RS5313S type=del size=430514 2024-09-14T11:01:58.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.446+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=3YM9GTLRXZNM type=write size=377839 2024-09-14T11:01:58.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.447+0000 7fe3dd11f780 1 < canceled operation key=US8KP3YL88TG tag=HA0JB4OTDM71 type=del size=2721235 2024-09-14T11:01:58.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.448+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=21O7YQAOSAM8 type=del size=3497755 2024-09-14T11:01:58.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.450+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=HF1ES469U4K3 type=del 2024-09-14T11:01:58.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.451+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=O44WBSAFF26D type=write size=135686 2024-09-14T11:01:58.450 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.452+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=EYFC5UDGCSA2 type=del 2024-09-14T11:01:58.452 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.454+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~307WTAODBY03.0 size=1048576 2024-09-14T11:01:58.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.455+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~307WTAODBY03.1 size=1048576 2024-09-14T11:01:58.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.456+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~307WTAODBY03.2 size=883106 2024-09-14T11:01:58.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.456+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=307WTAODBY03 tag=6EJI7V6BTPYU type=write size=4028834 2024-09-14T11:01:58.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.458+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=LH39HLA6OL1X type=del 2024-09-14T11:01:58.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.459+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=TVIFS1R82OMG type=write size=269403 2024-09-14T11:01:58.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.460+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=EZ3POFVQ0OY7 type=del 2024-09-14T11:01:58.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.461+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=RO344DTS86IN type=write size=210252 2024-09-14T11:01:58.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.462+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=LKNWG8VNWAKD type=del 2024-09-14T11:01:58.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.463+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=2TN5IM6GEIBJ type=del size=2133120 2024-09-14T11:01:58.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.465+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~MGCFUIVXXVD4.0 size=1048576 2024-09-14T11:01:58.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.466+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~MGCFUIVXXVD4.1 size=398164 2024-09-14T11:01:58.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.468+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=MGCFUIVXXVD4 tag=1Q7KSX8RIH9U type=write size=2495316 2024-09-14T11:01:58.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.470+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=FJDKZQCK67HF type=write size=1040578 2024-09-14T11:01:58.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.471+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=TGG7XVIUI8MC type=del 2024-09-14T11:01:58.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.472+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=SF6W7KG8O86W type=del size=3773217 2024-09-14T11:01:58.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.473+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~H5GCUBJNS0B8.0 size=1048576 2024-09-14T11:01:58.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.474+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~H5GCUBJNS0B8.1 size=590073 2024-09-14T11:01:58.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.476+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=H5GCUBJNS0B8 tag=75QE6G55XF63 type=write size=2687225 2024-09-14T11:01:58.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.477+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=W0CULAEUILAL type=del size=46686 2024-09-14T11:01:58.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.478+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=53ME061PZ1AA type=del 2024-09-14T11:01:58.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.480+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=CJL7B8OY1TYR type=del size=3348006 2024-09-14T11:01:58.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.481+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~G8ZUF58Z5E2M.0 size=1048576 2024-09-14T11:01:58.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.482+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~G8ZUF58Z5E2M.1 size=59409 2024-09-14T11:01:58.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.484+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=G8ZUF58Z5E2M tag=EGWB0ZWDXBX9 type=write size=2156561 2024-09-14T11:01:58.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.486+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=QGTFM10AF067 type=write size=88782 2024-09-14T11:01:58.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.486+0000 7fe3dd11f780 1 < canceled part key=_multipart_LL9VJXEU13IK.2~ONQC7B7I863U.0 size=138835 2024-09-14T11:01:58.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.488+0000 7fe3dd11f780 1 < canceled multipart upload key=LL9VJXEU13IK upload=ONQC7B7I863U tag=SIMWYX94DR3X type=write size=1187411 2024-09-14T11:01:58.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.490+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~60DYDT95Z17D.0 size=1048576 2024-09-14T11:01:58.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.491+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~60DYDT95Z17D.1 size=1048576 2024-09-14T11:01:58.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.492+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~60DYDT95Z17D.2 size=494646 2024-09-14T11:01:58.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.492+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=60DYDT95Z17D tag=3X6PUFOXZR3P type=write size=3640374 2024-09-14T11:01:58.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.494+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=JQ0K2WDNWIVP type=del 2024-09-14T11:01:58.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.495+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=T7ZFDD1IW8RL type=del size=1967846 2024-09-14T11:01:58.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.496+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~AQ4OXA7UR764.0 size=1048576 2024-09-14T11:01:58.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.497+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~AQ4OXA7UR764.1 size=337327 2024-09-14T11:01:58.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.499+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=AQ4OXA7UR764 tag=HPW4KSG7G949 type=write size=2434479 2024-09-14T11:01:58.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.501+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~3W3Z92WLI4OT.0 size=1048576 2024-09-14T11:01:58.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.502+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~3W3Z92WLI4OT.1 size=961218 2024-09-14T11:01:58.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.502+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=3W3Z92WLI4OT tag=QM34RSLPT0IW type=write size=3058370 2024-09-14T11:01:58.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.504+0000 7fe3dd11f780 1 < suggested remove operation key=IOAG4ZE1I58Z tag=6V5BTMFSP8UY type=write 2024-09-14T11:01:58.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.505+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=D2PXOC82BKZ0 type=del size=4645 2024-09-14T11:01:58.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.507+0000 7fe3dd11f780 1 < completed write operation key=YMGE9GKLSPE6 tag=3YM9GTLRXZNM type=write size=377839 2024-09-14T11:01:58.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.509+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~6PQ1UMY06D14.0 size=586093 2024-09-14T11:01:58.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.509+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=6PQ1UMY06D14 tag=BE36TJSNTMEC type=write size=1634669 2024-09-14T11:01:58.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.510+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=21O7YQAOSAM8 type=del 2024-09-14T11:01:58.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.511+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=8NKYRSJQXSBM type=del size=389001 2024-09-14T11:01:58.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.513+0000 7fe3dd11f780 1 < completed write operation key=22TI1VCDTK5P tag=O44WBSAFF26D type=write size=135686 2024-09-14T11:01:58.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.515+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~QK7KB32PZO94.0 size=1048576 2024-09-14T11:01:58.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.516+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~QK7KB32PZO94.1 size=1048576 2024-09-14T11:01:58.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.517+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~QK7KB32PZO94.2 size=309486 2024-09-14T11:01:58.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.517+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=QK7KB32PZO94 tag=9VMXEGUE44EG type=write size=3455214 2024-09-14T11:01:58.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.518+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~307WTAODBY03.0 size=1048576 2024-09-14T11:01:58.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.519+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~307WTAODBY03.1 size=1048576 2024-09-14T11:01:58.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.520+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~307WTAODBY03.2 size=883106 2024-09-14T11:01:58.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.522+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=307WTAODBY03 tag=6EJI7V6BTPYU type=write size=4028834 2024-09-14T11:01:58.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.524+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=Z6KTOBZEFY0M type=del size=3648704 2024-09-14T11:01:58.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.526+0000 7fe3dd11f780 1 < suggested update operation key=PHLQ77OMLI37 tag=TVIFS1R82OMG type=write size=269403 2024-09-14T11:01:58.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.529+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~Z34V573NDSE2.0 size=1048576 2024-09-14T11:01:58.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.530+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~Z34V573NDSE2.1 size=1048576 2024-09-14T11:01:58.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.531+0000 7fe3dd11f780 1 > prepared part key=_multipart_0PT98N1VBWAG.2~Z34V573NDSE2.2 size=843281 2024-09-14T11:01:58.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.531+0000 7fe3dd11f780 1 > prepared multipart upload key=0PT98N1VBWAG upload=Z34V573NDSE2 tag=E5YKWNO2DY4P type=write size=3989009 2024-09-14T11:01:58.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.533+0000 7fe3dd11f780 1 < suggested update operation key=EGC5988RQOEZ tag=RO344DTS86IN type=write size=210252 2024-09-14T11:01:58.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.535+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=PC7HDREAOZL0 type=del size=3086894 2024-09-14T11:01:58.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.536+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=2TN5IM6GEIBJ type=del 2024-09-14T11:01:58.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.537+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=UVF08XGV6T6I type=del size=884383 2024-09-14T11:01:58.536 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.539+0000 7fe3dd11f780 1 < completed write operation key=6PJ03TAYRUT8 tag=FJDKZQCK67HF type=write size=1040578 2024-09-14T11:01:58.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.540+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=7T133DR0ILZR type=del size=1679980 2024-09-14T11:01:58.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.541+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=SF6W7KG8O86W type=del 2024-09-14T11:01:58.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.542+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=NKU3ZUOYVQSC type=del size=942665 2024-09-14T11:01:58.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.544+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=W0CULAEUILAL type=del 2024-09-14T11:01:58.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.545+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=SS82WCCYA2XB type=del size=2514311 2024-09-14T11:01:58.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.546+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=CJL7B8OY1TYR type=del 2024-09-14T11:01:58.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.547+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=GHBNTOHOT49I type=write size=214620 2024-09-14T11:01:58.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.549+0000 7fe3dd11f780 1 < completed write operation key=ZTD98WQ6032X tag=QGTFM10AF067 type=write size=88782 2024-09-14T11:01:58.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.550+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=AM9G1VAQKBFL type=write size=534743 2024-09-14T11:01:58.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.551+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~60DYDT95Z17D.0 size=1048576 2024-09-14T11:01:58.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.552+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~60DYDT95Z17D.1 size=1048576 2024-09-14T11:01:58.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.553+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~60DYDT95Z17D.2 size=494646 2024-09-14T11:01:58.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.555+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=60DYDT95Z17D tag=3X6PUFOXZR3P type=write size=3640374 2024-09-14T11:01:58.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.556+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=D67DHQTS1IUN type=del size=2811040 2024-09-14T11:01:58.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.558+0000 7fe3dd11f780 1 < suggested update operation key=4JTN39NIB2UE tag=T7ZFDD1IW8RL type=del size=1967846 2024-09-14T11:01:58.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.559+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=6XT4N9LZYKAG type=del size=789231 2024-09-14T11:01:58.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.560+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~3W3Z92WLI4OT.0 size=1048576 2024-09-14T11:01:58.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.561+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~3W3Z92WLI4OT.1 size=961218 2024-09-14T11:01:58.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.563+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=3W3Z92WLI4OT tag=QM34RSLPT0IW type=write size=3058370 2024-09-14T11:01:58.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.564+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=PXYYXO593U79 type=del size=2796754 2024-09-14T11:01:58.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.565+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=D2PXOC82BKZ0 type=del 2024-09-14T11:01:58.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.567+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~96R645VNYWE3.0 size=1048576 2024-09-14T11:01:58.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.569+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~96R645VNYWE3.1 size=1048576 2024-09-14T11:01:58.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.570+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~96R645VNYWE3.2 size=772875 2024-09-14T11:01:58.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.570+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=96R645VNYWE3 tag=ECJ61EI309AZ type=write size=3918603 2024-09-14T11:01:58.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.571+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~6PQ1UMY06D14.0 size=586093 2024-09-14T11:01:58.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.573+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=6PQ1UMY06D14 tag=BE36TJSNTMEC type=write size=1634669 2024-09-14T11:01:58.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.574+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=T5Y122OGRD4N type=del size=2892825 2024-09-14T11:01:58.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.577+0000 7fe3dd11f780 1 < suggested update operation key=0PT98N1VBWAG tag=8NKYRSJQXSBM type=del size=389001 2024-09-14T11:01:58.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.579+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=HTH1JC4JI3HT type=del size=877607 2024-09-14T11:01:58.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.580+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~QK7KB32PZO94.0 size=1048576 2024-09-14T11:01:58.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.582+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~QK7KB32PZO94.1 size=1048576 2024-09-14T11:01:58.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.583+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~QK7KB32PZO94.2 size=309486 2024-09-14T11:01:58.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.585+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=QK7KB32PZO94 tag=9VMXEGUE44EG type=write size=3455214 2024-09-14T11:01:58.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.587+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~YMUY0BLNIQ15.0 size=838922 2024-09-14T11:01:58.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.587+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=YMUY0BLNIQ15 tag=CYBB34S3M1RY type=write size=1887498 2024-09-14T11:01:58.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.589+0000 7fe3dd11f780 -1 < failed to complete operation key=4JTN39NIB2UE tag=Z6KTOBZEFY0M type=del size=3648704: (22) Invalid argument 2024-09-14T11:01:58.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.590+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=BZDTJZMCT3HG type=del size=988534 2024-09-14T11:01:58.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.591+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~Z34V573NDSE2.0 size=1048576 2024-09-14T11:01:58.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.592+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~Z34V573NDSE2.1 size=1048576 2024-09-14T11:01:58.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.593+0000 7fe3dd11f780 1 < completed part key=_multipart_0PT98N1VBWAG.2~Z34V573NDSE2.2 size=843281 2024-09-14T11:01:58.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.596+0000 7fe3dd11f780 1 < completed multipart upload key=0PT98N1VBWAG upload=Z34V573NDSE2 tag=E5YKWNO2DY4P type=write size=3989009 2024-09-14T11:01:58.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.597+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=S1562WN0O5OC type=del size=3658918 2024-09-14T11:01:58.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.598+0000 7fe3dd11f780 1 < canceled operation key=EGC5988RQOEZ tag=PC7HDREAOZL0 type=del size=3086894 2024-09-14T11:01:58.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.600+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=QLGI18T8QDBE type=del size=2770479 2024-09-14T11:01:58.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.601+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=UVF08XGV6T6I type=del 2024-09-14T11:01:58.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.604+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~18SIWWBIWHQX.0 size=1048576 2024-09-14T11:01:58.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.605+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~18SIWWBIWHQX.1 size=289142 2024-09-14T11:01:58.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.605+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=18SIWWBIWHQX tag=FI5CCFLVPFXZ type=write size=2386294 2024-09-14T11:01:58.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.606+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=7T133DR0ILZR type=del 2024-09-14T11:01:58.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.608+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=X315U0P2RNXN type=del size=3460696 2024-09-14T11:01:58.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.610+0000 7fe3dd11f780 1 < suggested remove operation key=PHLQ77OMLI37 tag=NKU3ZUOYVQSC type=del 2024-09-14T11:01:58.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.611+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=112IK14G0UZ4 type=write size=827905 2024-09-14T11:01:58.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.612+0000 7fe3dd11f780 1 < canceled operation key=VDSOBBVO3QGB tag=SS82WCCYA2XB type=del size=2514311 2024-09-14T11:01:58.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.615+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~02Q7AZR0RJO5.0 size=1048576 2024-09-14T11:01:58.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.616+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~02Q7AZR0RJO5.1 size=1048576 2024-09-14T11:01:58.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.617+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~02Q7AZR0RJO5.2 size=412729 2024-09-14T11:01:58.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.617+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=02Q7AZR0RJO5 tag=QZ0Q8DKBZF8K type=write size=3558457 2024-09-14T11:01:58.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.620+0000 7fe3dd11f780 1 < suggested remove operation key=VDSOBBVO3QGB tag=GHBNTOHOT49I type=write 2024-09-14T11:01:58.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.622+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~AL9FJTWO1WR6.0 size=1048576 2024-09-14T11:01:58.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.623+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~AL9FJTWO1WR6.1 size=1048576 2024-09-14T11:01:58.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.624+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~AL9FJTWO1WR6.2 size=418141 2024-09-14T11:01:58.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.624+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=AL9FJTWO1WR6 tag=2RQCDPZG9A1A type=write size=3563869 2024-09-14T11:01:58.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.626+0000 7fe3dd11f780 1 < completed write operation key=EGC5988RQOEZ tag=AM9G1VAQKBFL type=write size=534743 2024-09-14T11:01:58.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.627+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=5NA2H6MNY6FI type=del size=852138 2024-09-14T11:01:58.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.628+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=D67DHQTS1IUN type=del 2024-09-14T11:01:58.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.631+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~LAVACSF2L85Q.0 size=1048576 2024-09-14T11:01:58.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.632+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~LAVACSF2L85Q.1 size=658195 2024-09-14T11:01:58.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.632+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=LAVACSF2L85Q tag=SC0OG4NENU9Q type=write size=2755347 2024-09-14T11:01:58.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.633+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=6XT4N9LZYKAG type=del 2024-09-14T11:01:58.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.635+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~7Y9MLF7JHCQ7.0 size=1048576 2024-09-14T11:01:58.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.637+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~7Y9MLF7JHCQ7.1 size=783946 2024-09-14T11:01:58.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.637+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=7Y9MLF7JHCQ7 tag=USKG0YQBFSY1 type=write size=2881098 2024-09-14T11:01:58.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.639+0000 7fe3dd11f780 1 < suggested remove operation key=KXL3E0PJBNBA tag=PXYYXO593U79 type=del 2024-09-14T11:01:58.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.641+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~36134X0SJP9C.0 size=1048576 2024-09-14T11:01:58.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.642+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~36134X0SJP9C.1 size=523573 2024-09-14T11:01:58.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.642+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=36134X0SJP9C tag=0WEIY889W6BD type=write size=2620725 2024-09-14T11:01:58.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.643+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~96R645VNYWE3.0 size=1048576 2024-09-14T11:01:58.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.644+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~96R645VNYWE3.1 size=1048576 2024-09-14T11:01:58.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.645+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~96R645VNYWE3.2 size=772875 2024-09-14T11:01:58.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.646+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=96R645VNYWE3 tag=ECJ61EI309AZ type=write size=3918603 2024-09-14T11:01:58.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.647+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=FFS5PZ24H130 type=del size=2010952 2024-09-14T11:01:58.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.649+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=T5Y122OGRD4N type=del 2024-09-14T11:01:58.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.650+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=5LP7G9NZ8H2H type=del size=4153011 2024-09-14T11:01:58.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.651+0000 7fe3dd11f780 1 < canceled operation key=V692HUUJP2RC tag=HTH1JC4JI3HT type=del size=877607 2024-09-14T11:01:58.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.652+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=700Q2N8WK4P6 type=del size=1430110 2024-09-14T11:01:58.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.653+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~YMUY0BLNIQ15.0 size=838922 2024-09-14T11:01:58.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.655+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=YMUY0BLNIQ15 tag=CYBB34S3M1RY type=write size=1887498 2024-09-14T11:01:58.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.657+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~BZXVZE6SE2P3.0 size=1048576 2024-09-14T11:01:58.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.657+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~BZXVZE6SE2P3.1 size=1048576 2024-09-14T11:01:58.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.658+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~BZXVZE6SE2P3.2 size=706518 2024-09-14T11:01:58.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.658+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=BZXVZE6SE2P3 tag=ELHWC1ZNPBNE type=write size=3852246 2024-09-14T11:01:58.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.660+0000 7fe3dd11f780 1 < suggested update operation key=6PJ03TAYRUT8 tag=BZDTJZMCT3HG type=del size=988534 2024-09-14T11:01:58.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.662+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=OWEPHDO6NQXC type=del size=1509672 2024-09-14T11:01:58.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.663+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=S1562WN0O5OC type=del 2024-09-14T11:01:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.664+0000 7fe3dd11f780 1 > prepared operation key=0PT98N1VBWAG tag=3YVIJ5KEVQUP type=del size=1629807 2024-09-14T11:01:58.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.665+0000 7fe3dd11f780 1 < canceled operation key=LL9VJXEU13IK tag=QLGI18T8QDBE type=del size=2770479 2024-09-14T11:01:58.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.667+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=BW3ZG197VXXT type=del size=1983251 2024-09-14T11:01:58.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.668+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~18SIWWBIWHQX.0 size=1048576 2024-09-14T11:01:58.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.669+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~18SIWWBIWHQX.1 size=289142 2024-09-14T11:01:58.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.671+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=18SIWWBIWHQX tag=FI5CCFLVPFXZ type=write size=2386294 2024-09-14T11:01:58.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.672+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=SWF9P8YL04S4 type=del size=161117 2024-09-14T11:01:58.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.674+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=X315U0P2RNXN type=del 2024-09-14T11:01:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.675+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=O3UCEBIX1MB8 type=del size=389517 2024-09-14T11:01:58.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.676+0000 7fe3dd11f780 1 < completed write operation key=JG1RZQD4J2EB tag=112IK14G0UZ4 type=write size=827905 2024-09-14T11:01:58.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.678+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~EN7J0XLPYKO6.0 size=1048576 2024-09-14T11:01:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.679+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~EN7J0XLPYKO6.1 size=1048576 2024-09-14T11:01:58.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.680+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~EN7J0XLPYKO6.2 size=131114 2024-09-14T11:01:58.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.680+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=EN7J0XLPYKO6 tag=0GLCO5ZFVO1S type=write size=3276842 2024-09-14T11:01:58.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.681+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~02Q7AZR0RJO5.0 size=1048576 2024-09-14T11:01:58.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.681+0000 7fe3dd11f780 1 < canceled part key=_multipart_M0DMAQ5LTDR0.2~02Q7AZR0RJO5.1 size=1048576 2024-09-14T11:01:58.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.682+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~02Q7AZR0RJO5.2 size=412729 2024-09-14T11:01:58.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.684+0000 7fe3dd11f780 1 < canceled multipart upload key=M0DMAQ5LTDR0 upload=02Q7AZR0RJO5 tag=QZ0Q8DKBZF8K type=write size=3558457 2024-09-14T11:01:58.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.686+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=W0RJ54MXZ3H4 type=del size=2388793 2024-09-14T11:01:58.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.687+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~AL9FJTWO1WR6.0 size=1048576 2024-09-14T11:01:58.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.688+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~AL9FJTWO1WR6.1 size=1048576 2024-09-14T11:01:58.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.689+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~AL9FJTWO1WR6.2 size=418141 2024-09-14T11:01:58.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.691+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=AL9FJTWO1WR6 tag=2RQCDPZG9A1A type=write size=3563869 2024-09-14T11:01:58.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.693+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~BQN4RKAXH1FX.0 size=856858 2024-09-14T11:01:58.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.693+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=BQN4RKAXH1FX tag=FXKXA0Q9SKM5 type=write size=1905434 2024-09-14T11:01:58.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.694+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=5NA2H6MNY6FI type=del 2024-09-14T11:01:58.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.697+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=NDFQ55F1HDQI type=del size=3960456 2024-09-14T11:01:58.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.698+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~LAVACSF2L85Q.0 size=1048576 2024-09-14T11:01:58.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.699+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~LAVACSF2L85Q.1 size=658195 2024-09-14T11:01:58.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.701+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=LAVACSF2L85Q tag=SC0OG4NENU9Q type=write size=2755347 2024-09-14T11:01:58.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.702+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=Y9CWQSHB912A type=del size=979842 2024-09-14T11:01:58.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.703+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~7Y9MLF7JHCQ7.0 size=1048576 2024-09-14T11:01:58.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.704+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~7Y9MLF7JHCQ7.1 size=783946 2024-09-14T11:01:58.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.706+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=7Y9MLF7JHCQ7 tag=USKG0YQBFSY1 type=write size=2881098 2024-09-14T11:01:58.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.708+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~VJ6LDVM0C6VM.0 size=1048576 2024-09-14T11:01:58.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.709+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~VJ6LDVM0C6VM.1 size=1048576 2024-09-14T11:01:58.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.710+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~VJ6LDVM0C6VM.2 size=404534 2024-09-14T11:01:58.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.710+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=VJ6LDVM0C6VM tag=39N1V16UJR9W type=write size=3550262 2024-09-14T11:01:58.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.711+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~36134X0SJP9C.0 size=1048576 2024-09-14T11:01:58.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.712+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~36134X0SJP9C.1 size=523573 2024-09-14T11:01:58.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.714+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=36134X0SJP9C tag=0WEIY889W6BD type=write size=2620725 2024-09-14T11:01:58.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.716+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~34AT53SHOQPT.0 size=1048576 2024-09-14T11:01:58.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.717+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~34AT53SHOQPT.1 size=350442 2024-09-14T11:01:58.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.717+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=34AT53SHOQPT tag=LSJ7KSTUZ57A type=write size=2447594 2024-09-14T11:01:58.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.719+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=FFS5PZ24H130 type=del 2024-09-14T11:01:58.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.720+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=ZAWO41KTK6KN type=del size=2813299 2024-09-14T11:01:58.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.722+0000 7fe3dd11f780 1 < suggested update operation key=3PS4LAML698X tag=5LP7G9NZ8H2H type=del size=4153011 2024-09-14T11:01:58.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.724+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~T0JVT0ET8QRZ.0 size=1048576 2024-09-14T11:01:58.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.725+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~T0JVT0ET8QRZ.1 size=804583 2024-09-14T11:01:58.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.725+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=T0JVT0ET8QRZ tag=L568FTT4NW34 type=write size=2901735 2024-09-14T11:01:58.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.727+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=700Q2N8WK4P6 type=del 2024-09-14T11:01:58.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.728+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=B18REKM7APLQ type=write size=810741 2024-09-14T11:01:58.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.729+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~BZXVZE6SE2P3.0 size=1048576 2024-09-14T11:01:58.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.730+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~BZXVZE6SE2P3.1 size=1048576 2024-09-14T11:01:58.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.731+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~BZXVZE6SE2P3.2 size=706518 2024-09-14T11:01:58.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.733+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=BZXVZE6SE2P3 tag=ELHWC1ZNPBNE type=write size=3852246 2024-09-14T11:01:58.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.734+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=R3KF62HZH64J type=del size=2384125 2024-09-14T11:01:58.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.735+0000 7fe3dd11f780 1 < completed delete operation key=4JTN39NIB2UE tag=OWEPHDO6NQXC type=del 2024-09-14T11:01:58.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.737+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~3LLE33B7MB4X.0 size=1048576 2024-09-14T11:01:58.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.738+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~3LLE33B7MB4X.1 size=1048576 2024-09-14T11:01:58.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.739+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~3LLE33B7MB4X.2 size=969552 2024-09-14T11:01:58.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.739+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=3LLE33B7MB4X tag=9U54S85BPNKT type=write size=4115280 2024-09-14T11:01:58.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.741+0000 7fe3dd11f780 1 < suggested update operation key=0PT98N1VBWAG tag=3YVIJ5KEVQUP type=del size=1629807 2024-09-14T11:01:58.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.743+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=BLE0DX0W2QMF type=write size=340654 2024-09-14T11:01:58.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.744+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=BW3ZG197VXXT type=del 2024-09-14T11:01:58.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.745+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=S70COWMZQ40D type=del size=1722947 2024-09-14T11:01:58.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.746+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=SWF9P8YL04S4 type=del 2024-09-14T11:01:58.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.748+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~AAPPWT55YIK2.0 size=1048576 2024-09-14T11:01:58.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.749+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~AAPPWT55YIK2.1 size=381142 2024-09-14T11:01:58.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.749+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=AAPPWT55YIK2 tag=2CLH2AF8PMDS type=write size=2478294 2024-09-14T11:01:58.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.750+0000 7fe3dd11f780 -1 < failed to complete operation key=3PS4LAML698X tag=O3UCEBIX1MB8 type=del size=389517: (22) Invalid argument 2024-09-14T11:01:58.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.751+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=Z1WDR4BCZ933 type=del size=1032283 2024-09-14T11:01:58.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.753+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~EN7J0XLPYKO6.0 size=1048576 2024-09-14T11:01:58.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.754+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~EN7J0XLPYKO6.1 size=1048576 2024-09-14T11:01:58.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.755+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~EN7J0XLPYKO6.2 size=131114 2024-09-14T11:01:58.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.757+0000 7fe3dd11f780 1 < completed multipart upload key=KXL3E0PJBNBA upload=EN7J0XLPYKO6 tag=0GLCO5ZFVO1S type=write size=3276842 2024-09-14T11:01:58.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.759+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~POPU0K61183V.0 size=424775 2024-09-14T11:01:58.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.759+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=POPU0K61183V tag=3NKYANSZM9E9 type=write size=1473351 2024-09-14T11:01:58.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.760+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=W0RJ54MXZ3H4 type=del 2024-09-14T11:01:58.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.761+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=B1Y8ASNE0FB1 type=del size=1099288 2024-09-14T11:01:58.760 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.762+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~BQN4RKAXH1FX.0 size=856858 2024-09-14T11:01:58.762 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.764+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=BQN4RKAXH1FX tag=FXKXA0Q9SKM5 type=write size=1905434 2024-09-14T11:01:58.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.765+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=A1QTGX7Y21T3 type=del size=105730 2024-09-14T11:01:58.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.766+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=NDFQ55F1HDQI type=del 2024-09-14T11:01:58.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.768+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~Q0GT8V2MOLDA.0 size=324070 2024-09-14T11:01:58.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.768+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=Q0GT8V2MOLDA tag=FWSCM0I8MZ7U type=write size=1372646 2024-09-14T11:01:58.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.770+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=Y9CWQSHB912A type=del 2024-09-14T11:01:58.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.772+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~EGOORNZ18RJ2.0 size=401068 2024-09-14T11:01:58.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.772+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=EGOORNZ18RJ2 tag=XA0HELGTP4Q5 type=write size=1449644 2024-09-14T11:01:58.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.773+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~VJ6LDVM0C6VM.0 size=1048576 2024-09-14T11:01:58.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.774+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~VJ6LDVM0C6VM.1 size=1048576 2024-09-14T11:01:58.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.775+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~VJ6LDVM0C6VM.2 size=404534 2024-09-14T11:01:58.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.777+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=VJ6LDVM0C6VM tag=39N1V16UJR9W type=write size=3550262 2024-09-14T11:01:58.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.778+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=JJOCPD1HB4C8 type=del size=3325853 2024-09-14T11:01:58.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.779+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~34AT53SHOQPT.0 size=1048576 2024-09-14T11:01:58.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.780+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~34AT53SHOQPT.1 size=350442 2024-09-14T11:01:58.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.782+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=34AT53SHOQPT tag=LSJ7KSTUZ57A type=write size=2447594 2024-09-14T11:01:58.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.783+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=WYZW3S43R2SD type=del size=3321760 2024-09-14T11:01:58.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.784+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=ZAWO41KTK6KN type=del 2024-09-14T11:01:58.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.786+0000 7fe3dd11f780 1 > prepared part key=_multipart_NHKCRGX10WBM.2~SZ03S73598XA.0 size=600834 2024-09-14T11:01:58.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.786+0000 7fe3dd11f780 1 > prepared multipart upload key=NHKCRGX10WBM upload=SZ03S73598XA tag=HIC3UQHEJA4B type=write size=1649410 2024-09-14T11:01:58.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.788+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~T0JVT0ET8QRZ.0 size=1048576 2024-09-14T11:01:58.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.788+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~T0JVT0ET8QRZ.1 size=804583 2024-09-14T11:01:58.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.790+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=T0JVT0ET8QRZ tag=L568FTT4NW34 type=write size=2901735 2024-09-14T11:01:58.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.791+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=NWXERGCKPZUT type=del size=3162973 2024-09-14T11:01:58.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.792+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=B18REKM7APLQ type=write size=810741 2024-09-14T11:01:58.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.793+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=U7ZC69NX5L2J type=del size=3964852 2024-09-14T11:01:58.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.795+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=R3KF62HZH64J type=del 2024-09-14T11:01:58.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.796+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~LRZGHWQGDP6F.0 size=880590 2024-09-14T11:01:58.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.796+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=LRZGHWQGDP6F tag=C0PL8IFTL1JM type=write size=1929166 2024-09-14T11:01:58.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.798+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~3LLE33B7MB4X.0 size=1048576 2024-09-14T11:01:58.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.798+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~3LLE33B7MB4X.1 size=1048576 2024-09-14T11:01:58.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.799+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~3LLE33B7MB4X.2 size=969552 2024-09-14T11:01:58.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.801+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=3LLE33B7MB4X tag=9U54S85BPNKT type=write size=4115280 2024-09-14T11:01:58.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.804+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~F446AYP82VPU.0 size=1048576 2024-09-14T11:01:58.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.805+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~F446AYP82VPU.1 size=25960 2024-09-14T11:01:58.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.805+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=F446AYP82VPU tag=ZR3URK8FDG2H type=write size=2123112 2024-09-14T11:01:58.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.806+0000 7fe3dd11f780 1 < completed write operation key=JSEN4QXEMVHS tag=BLE0DX0W2QMF type=write size=340654 2024-09-14T11:01:58.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.808+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~7970QPPZEA80.0 size=1048576 2024-09-14T11:01:58.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.809+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~7970QPPZEA80.1 size=212151 2024-09-14T11:01:58.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.809+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=7970QPPZEA80 tag=BNG8R0NYCZUF type=write size=2309303 2024-09-14T11:01:58.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.810+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=S70COWMZQ40D type=del 2024-09-14T11:01:58.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.812+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=0K0ZN1YLUJI2 type=del size=1425002 2024-09-14T11:01:58.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.813+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~AAPPWT55YIK2.0 size=1048576 2024-09-14T11:01:58.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.814+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~AAPPWT55YIK2.1 size=381142 2024-09-14T11:01:58.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.815+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=AAPPWT55YIK2 tag=2CLH2AF8PMDS type=write size=2478294 2024-09-14T11:01:58.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.817+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=6D26D3KQPFTF type=del size=3099246 2024-09-14T11:01:58.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.818+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=Z1WDR4BCZ933 type=del 2024-09-14T11:01:58.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.820+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~OA7G3ATJ1J28.0 size=910874 2024-09-14T11:01:58.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.820+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=OA7G3ATJ1J28 tag=NVEYS8Q2UGEF type=write size=1959450 2024-09-14T11:01:58.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.821+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~POPU0K61183V.0 size=424775 2024-09-14T11:01:58.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.823+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=POPU0K61183V tag=3NKYANSZM9E9 type=write size=1473351 2024-09-14T11:01:58.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.824+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=G7OK0PVGJ033 type=del size=3689890 2024-09-14T11:01:58.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.825+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=B1Y8ASNE0FB1 type=del 2024-09-14T11:01:58.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.826+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=N2B72TZ33B9Q type=del size=2697167 2024-09-14T11:01:58.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.828+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=A1QTGX7Y21T3 type=del 2024-09-14T11:01:58.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.830+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~HZ5IGDBM0RQA.0 size=1048576 2024-09-14T11:01:58.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.831+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~HZ5IGDBM0RQA.1 size=967602 2024-09-14T11:01:58.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.831+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=HZ5IGDBM0RQA tag=17YRE349KY3T type=write size=3064754 2024-09-14T11:01:58.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.833+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~Q0GT8V2MOLDA.0 size=324070 2024-09-14T11:01:58.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.834+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=Q0GT8V2MOLDA tag=FWSCM0I8MZ7U type=write size=1372646 2024-09-14T11:01:58.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.836+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=D15DPJUMY9ZF type=del size=1150331 2024-09-14T11:01:58.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.837+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~EGOORNZ18RJ2.0 size=401068 2024-09-14T11:01:58.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.840+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=EGOORNZ18RJ2 tag=XA0HELGTP4Q5 type=write size=1449644 2024-09-14T11:01:58.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.842+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~HCHEA1M8M8HO.0 size=1048576 2024-09-14T11:01:58.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.843+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~HCHEA1M8M8HO.1 size=1048576 2024-09-14T11:01:58.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.844+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~HCHEA1M8M8HO.2 size=1033875 2024-09-14T11:01:58.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.844+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=HCHEA1M8M8HO tag=CMKV1FJ9KY6D type=write size=4179603 2024-09-14T11:01:58.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.845+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=JJOCPD1HB4C8 type=del 2024-09-14T11:01:58.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.847+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~BRIQDXA31KXS.0 size=1048576 2024-09-14T11:01:58.846 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.848+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~BRIQDXA31KXS.1 size=1048576 2024-09-14T11:01:58.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.849+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~BRIQDXA31KXS.2 size=819712 2024-09-14T11:01:58.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.849+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=BRIQDXA31KXS tag=Q6123Q7TWRA6 type=write size=3965440 2024-09-14T11:01:58.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.850+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=WYZW3S43R2SD type=del 2024-09-14T11:01:58.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.851+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=WXLBRQUQOJLO type=write size=938794 2024-09-14T11:01:58.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.853+0000 7fe3dd11f780 1 < completed part key=_multipart_NHKCRGX10WBM.2~SZ03S73598XA.0 size=600834 2024-09-14T11:01:58.852 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.854+0000 7fe3dd11f780 1 < completed multipart upload key=NHKCRGX10WBM upload=SZ03S73598XA tag=HIC3UQHEJA4B type=write size=1649410 2024-09-14T11:01:58.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.857+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~718B14S187X2.0 size=1048576 2024-09-14T11:01:58.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.858+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~718B14S187X2.1 size=1048576 2024-09-14T11:01:58.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.859+0000 7fe3dd11f780 1 > prepared part key=_multipart_MD0OU8IC5PYI.2~718B14S187X2.2 size=477532 2024-09-14T11:01:58.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.859+0000 7fe3dd11f780 1 > prepared multipart upload key=MD0OU8IC5PYI upload=718B14S187X2 tag=KAYOH3OWZL9Z type=write size=3623260 2024-09-14T11:01:58.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.860+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=NWXERGCKPZUT type=del 2024-09-14T11:01:58.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.862+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~7VCYR4C3PH0U.0 size=635154 2024-09-14T11:01:58.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.862+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=7VCYR4C3PH0U tag=C63HR6EPGMX0 type=write size=1683730 2024-09-14T11:01:58.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.863+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=U7ZC69NX5L2J type=del 2024-09-14T11:01:58.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.864+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=TH0HNSYSG6T9 type=del size=3977421 2024-09-14T11:01:58.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.865+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~LRZGHWQGDP6F.0 size=880590 2024-09-14T11:01:58.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.868+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=LRZGHWQGDP6F tag=C0PL8IFTL1JM type=write size=1929166 2024-09-14T11:01:58.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.870+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~8D8F65TD5KTK.0 size=1048576 2024-09-14T11:01:58.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.871+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~8D8F65TD5KTK.1 size=460500 2024-09-14T11:01:58.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.871+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=8D8F65TD5KTK tag=FIHAA84ASYJ4 type=write size=2557652 2024-09-14T11:01:58.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.873+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~F446AYP82VPU.0 size=1048576 2024-09-14T11:01:58.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.873+0000 7fe3dd11f780 1 < canceled part key=_multipart_LFKLJAJWQ2J6.2~F446AYP82VPU.1 size=25960 2024-09-14T11:01:58.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.874+0000 7fe3dd11f780 1 < canceled multipart upload key=LFKLJAJWQ2J6 upload=F446AYP82VPU tag=ZR3URK8FDG2H type=write size=2123112 2024-09-14T11:01:58.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.877+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~1JK3PVD4LC4H.0 size=839480 2024-09-14T11:01:58.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.877+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=1JK3PVD4LC4H tag=MBULKLZBWF21 type=write size=1888056 2024-09-14T11:01:58.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.878+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~7970QPPZEA80.0 size=1048576 2024-09-14T11:01:58.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.879+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~7970QPPZEA80.1 size=212151 2024-09-14T11:01:58.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.881+0000 7fe3dd11f780 1 < completed multipart upload key=A89YQO40BHUS upload=7970QPPZEA80 tag=BNG8R0NYCZUF type=write size=2309303 2024-09-14T11:01:58.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.883+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~9GJIWVL2SRVQ.0 size=1048576 2024-09-14T11:01:58.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.884+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~9GJIWVL2SRVQ.1 size=566258 2024-09-14T11:01:58.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.884+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=9GJIWVL2SRVQ tag=WDFK8D94I5DF type=write size=2663410 2024-09-14T11:01:58.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.886+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=0K0ZN1YLUJI2 type=del 2024-09-14T11:01:58.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.887+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=BC4B35Q8RZ3D type=write size=883474 2024-09-14T11:01:58.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.889+0000 7fe3dd11f780 1 < suggested remove operation key=ZTD98WQ6032X tag=6D26D3KQPFTF type=del 2024-09-14T11:01:58.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.891+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~0DHE2JGD6D65.0 size=1048576 2024-09-14T11:01:58.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.892+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~0DHE2JGD6D65.1 size=866988 2024-09-14T11:01:58.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.892+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=0DHE2JGD6D65 tag=AYR1UVBSTCBA type=write size=2964140 2024-09-14T11:01:58.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.893+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~OA7G3ATJ1J28.0 size=910874 2024-09-14T11:01:58.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.895+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=OA7G3ATJ1J28 tag=NVEYS8Q2UGEF type=write size=1959450 2024-09-14T11:01:58.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.896+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=YBJOD3R8ZQC0 type=write size=380857 2024-09-14T11:01:58.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.899+0000 7fe3dd11f780 1 < suggested update operation key=JSEN4QXEMVHS tag=G7OK0PVGJ033 type=del size=3689890 2024-09-14T11:01:58.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.900+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=5ZHGIAEFTBNA type=write size=182437 2024-09-14T11:01:58.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.902+0000 7fe3dd11f780 1 < completed delete operation key=OK5L92EKOOMW tag=N2B72TZ33B9Q type=del 2024-09-14T11:01:58.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.904+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MTSM2WSM4AK7.0 size=1048576 2024-09-14T11:01:58.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.905+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~MTSM2WSM4AK7.1 size=463813 2024-09-14T11:01:58.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.905+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=MTSM2WSM4AK7 tag=VMBN3WF2F6HF type=write size=2560965 2024-09-14T11:01:58.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.906+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~HZ5IGDBM0RQA.0 size=1048576 2024-09-14T11:01:58.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.907+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~HZ5IGDBM0RQA.1 size=967602 2024-09-14T11:01:58.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.910+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=HZ5IGDBM0RQA tag=17YRE349KY3T type=write size=3064754 2024-09-14T11:01:58.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.911+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=ZNWQRQKK4HKK type=del size=3610076 2024-09-14T11:01:58.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.912+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=D15DPJUMY9ZF type=del 2024-09-14T11:01:58.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.916+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~36TVIBZV3NA9.0 size=1048576 2024-09-14T11:01:58.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.917+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~36TVIBZV3NA9.1 size=1048576 2024-09-14T11:01:58.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.918+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~36TVIBZV3NA9.2 size=790647 2024-09-14T11:01:58.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.918+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=36TVIBZV3NA9 tag=LTXQXQIAF2R1 type=write size=3936375 2024-09-14T11:01:58.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.919+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~HCHEA1M8M8HO.0 size=1048576 2024-09-14T11:01:58.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.920+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~HCHEA1M8M8HO.1 size=1048576 2024-09-14T11:01:58.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.921+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~HCHEA1M8M8HO.2 size=1033875 2024-09-14T11:01:58.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.923+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=HCHEA1M8M8HO tag=CMKV1FJ9KY6D type=write size=4179603 2024-09-14T11:01:58.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.924+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=S3CCH4VKOM0S type=del size=2762858 2024-09-14T11:01:58.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.925+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~BRIQDXA31KXS.0 size=1048576 2024-09-14T11:01:58.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.926+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~BRIQDXA31KXS.1 size=1048576 2024-09-14T11:01:58.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.927+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~BRIQDXA31KXS.2 size=819712 2024-09-14T11:01:58.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.930+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=BRIQDXA31KXS tag=Q6123Q7TWRA6 type=write size=3965440 2024-09-14T11:01:58.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.931+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=R16BMJNCC4AZ type=del size=3495249 2024-09-14T11:01:58.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.932+0000 7fe3dd11f780 1 < completed write operation key=IOAG4ZE1I58Z tag=WXLBRQUQOJLO type=write size=938794 2024-09-14T11:01:58.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.933+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=SOG0JC8OG5V6 type=del size=3842396 2024-09-14T11:01:58.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.935+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~718B14S187X2.0 size=1048576 2024-09-14T11:01:58.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.936+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~718B14S187X2.1 size=1048576 2024-09-14T11:01:58.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.937+0000 7fe3dd11f780 1 < completed part key=_multipart_MD0OU8IC5PYI.2~718B14S187X2.2 size=477532 2024-09-14T11:01:58.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.938+0000 7fe3dd11f780 1 < completed multipart upload key=MD0OU8IC5PYI upload=718B14S187X2 tag=KAYOH3OWZL9Z type=write size=3623260 2024-09-14T11:01:58.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.940+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=Z04BDEW21F3C type=write size=76452 2024-09-14T11:01:58.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.941+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~7VCYR4C3PH0U.0 size=635154 2024-09-14T11:01:58.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.943+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=7VCYR4C3PH0U tag=C63HR6EPGMX0 type=write size=1683730 2024-09-14T11:01:58.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.944+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=XDXMJT40QI86 type=del size=2292847 2024-09-14T11:01:58.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.945+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=TH0HNSYSG6T9 type=del 2024-09-14T11:01:58.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.947+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~9C3UJH0XF2DD.0 size=1048576 2024-09-14T11:01:58.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.948+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~9C3UJH0XF2DD.1 size=479406 2024-09-14T11:01:58.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.948+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=9C3UJH0XF2DD tag=VZSISEAQ3SE8 type=write size=2576558 2024-09-14T11:01:58.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.950+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~8D8F65TD5KTK.0 size=1048576 2024-09-14T11:01:58.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.950+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~8D8F65TD5KTK.1 size=460500 2024-09-14T11:01:58.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.952+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=8D8F65TD5KTK tag=FIHAA84ASYJ4 type=write size=2557652 2024-09-14T11:01:58.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.953+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=IHZSX11Q3U94 type=del size=3888209 2024-09-14T11:01:58.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.954+0000 7fe3dd11f780 1 < canceled part key=_multipart_GQEFQ1UD6QCJ.2~1JK3PVD4LC4H.0 size=839480 2024-09-14T11:01:58.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.956+0000 7fe3dd11f780 1 < canceled multipart upload key=GQEFQ1UD6QCJ upload=1JK3PVD4LC4H tag=MBULKLZBWF21 type=write size=1888056 2024-09-14T11:01:58.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.957+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=XH9NAQF9141F type=del size=2172953 2024-09-14T11:01:58.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.958+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~9GJIWVL2SRVQ.0 size=1048576 2024-09-14T11:01:58.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.959+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~9GJIWVL2SRVQ.1 size=566258 2024-09-14T11:01:58.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.961+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=9GJIWVL2SRVQ tag=WDFK8D94I5DF type=write size=2663410 2024-09-14T11:01:58.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.962+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=Q5E9NXR6C20Y type=del size=1860254 2024-09-14T11:01:58.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.964+0000 7fe3dd11f780 1 < completed write operation key=ZI5SFHGWCHJA tag=BC4B35Q8RZ3D type=write size=883474 2024-09-14T11:01:58.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.965+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=NDXPMN1WUJBI type=write size=951606 2024-09-14T11:01:58.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.966+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~0DHE2JGD6D65.0 size=1048576 2024-09-14T11:01:58.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.967+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~0DHE2JGD6D65.1 size=866988 2024-09-14T11:01:58.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.969+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=0DHE2JGD6D65 tag=AYR1UVBSTCBA type=write size=2964140 2024-09-14T11:01:58.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.972+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~TH6FB14GUHKZ.0 size=216600 2024-09-14T11:01:58.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.972+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=TH6FB14GUHKZ tag=2Y0XMSOZB9R1 type=write size=1265176 2024-09-14T11:01:58.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.973+0000 7fe3dd11f780 -1 < failed to complete operation key=JSEN4QXEMVHS tag=YBJOD3R8ZQC0 type=write size=380857: (22) Invalid argument 2024-09-14T11:01:58.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.975+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~YY82JR9PQXBJ.0 size=1048576 2024-09-14T11:01:58.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.976+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~YY82JR9PQXBJ.1 size=829891 2024-09-14T11:01:58.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.976+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=YY82JR9PQXBJ tag=28OLPUJAOIGA type=write size=2927043 2024-09-14T11:01:58.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.978+0000 7fe3dd11f780 1 < canceled operation key=V692HUUJP2RC tag=5ZHGIAEFTBNA type=write size=182437 2024-09-14T11:01:58.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.980+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~M1YCVYPVZ8LX.0 size=975914 2024-09-14T11:01:58.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.980+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=M1YCVYPVZ8LX tag=DGAL0D9L6MVS type=write size=2024490 2024-09-14T11:01:58.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.981+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MTSM2WSM4AK7.0 size=1048576 2024-09-14T11:01:58.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.982+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~MTSM2WSM4AK7.1 size=463813 2024-09-14T11:01:58.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.984+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=MTSM2WSM4AK7 tag=VMBN3WF2F6HF type=write size=2560965 2024-09-14T11:01:58.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.985+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=7WPBAEI0CQ8H type=del size=1273169 2024-09-14T11:01:58.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.986+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=ZNWQRQKK4HKK type=del 2024-09-14T11:01:58.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.988+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~3PZLT81IT10B.0 size=1043463 2024-09-14T11:01:58.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.988+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=3PZLT81IT10B tag=QU3US3293GM5 type=write size=2092039 2024-09-14T11:01:58.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.990+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~36TVIBZV3NA9.0 size=1048576 2024-09-14T11:01:58.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.990+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~36TVIBZV3NA9.1 size=1048576 2024-09-14T11:01:58.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.990+0000 7fe3dd11f780 1 < canceled part key=_multipart_V692HUUJP2RC.2~36TVIBZV3NA9.2 size=790647 2024-09-14T11:01:58.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.992+0000 7fe3dd11f780 1 < canceled multipart upload key=V692HUUJP2RC upload=36TVIBZV3NA9 tag=LTXQXQIAF2R1 type=write size=3936375 2024-09-14T11:01:58.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.994+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=BU0Q5YEWAGX2 type=del size=2794313 2024-09-14T11:01:58.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.996+0000 7fe3dd11f780 1 < suggested remove operation key=YMGE9GKLSPE6 tag=S3CCH4VKOM0S type=del 2024-09-14T11:01:58.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.997+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=5HAXX4OX0UPJ type=del size=3752291 2024-09-14T11:01:58.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:58.998+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=R16BMJNCC4AZ type=del 2024-09-14T11:01:58.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.000+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~6L58D8SQI835.0 size=1048576 2024-09-14T11:01:58.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.001+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~6L58D8SQI835.1 size=1048576 2024-09-14T11:01:59.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.002+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~6L58D8SQI835.2 size=863733 2024-09-14T11:01:59.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.002+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=6L58D8SQI835 tag=MG74RT0ZD7J8 type=write size=4009461 2024-09-14T11:01:59.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.004+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=SOG0JC8OG5V6 type=del 2024-09-14T11:01:59.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.005+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=I78LE5GV9GZ1 type=del size=1196347 2024-09-14T11:01:59.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.006+0000 7fe3dd11f780 1 < completed write operation key=6PJ03TAYRUT8 tag=Z04BDEW21F3C type=write size=76452 2024-09-14T11:01:59.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.008+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~6VS1784HX0KA.0 size=538587 2024-09-14T11:01:59.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.008+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=6VS1784HX0KA tag=XZ5FUJLG16YD type=write size=1587163 2024-09-14T11:01:59.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.009+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=XDXMJT40QI86 type=del 2024-09-14T11:01:59.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.010+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=AA2MBJAG27BQ type=del size=231494 2024-09-14T11:01:59.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.011+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~9C3UJH0XF2DD.0 size=1048576 2024-09-14T11:01:59.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.012+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~9C3UJH0XF2DD.1 size=479406 2024-09-14T11:01:59.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.014+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=9C3UJH0XF2DD tag=VZSISEAQ3SE8 type=write size=2576558 2024-09-14T11:01:59.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.015+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=QUKUSRKI8C3Z type=del size=3033340 2024-09-14T11:01:59.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.018+0000 7fe3dd11f780 1 < suggested update operation key=US8KP3YL88TG tag=IHZSX11Q3U94 type=del size=3888209 2024-09-14T11:01:59.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.019+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=MV34TTUWSYC1 type=del size=3444116 2024-09-14T11:01:59.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.020+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=XH9NAQF9141F type=del 2024-09-14T11:01:59.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.021+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=G9M4KXGGK1P6 type=del size=3349202 2024-09-14T11:01:59.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.022+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=Q5E9NXR6C20Y type=del 2024-09-14T11:01:59.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.024+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~5FK57R84DZB8.0 size=1048576 2024-09-14T11:01:59.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.026+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~5FK57R84DZB8.1 size=1048576 2024-09-14T11:01:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.027+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~5FK57R84DZB8.2 size=343608 2024-09-14T11:01:59.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.027+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=5FK57R84DZB8 tag=W8CLNOI8O87Y type=write size=3489336 2024-09-14T11:01:59.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.028+0000 7fe3dd11f780 1 < completed write operation key=LDILBET1CMYY tag=NDXPMN1WUJBI type=write size=951606 2024-09-14T11:01:59.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.030+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=UX433I9DE8MD type=del size=1099895 2024-09-14T11:01:59.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.031+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~TH6FB14GUHKZ.0 size=216600 2024-09-14T11:01:59.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.033+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=TH6FB14GUHKZ tag=2Y0XMSOZB9R1 type=write size=1265176 2024-09-14T11:01:59.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.034+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=VML6AXS01LO4 type=del size=2506663 2024-09-14T11:01:59.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.035+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~YY82JR9PQXBJ.0 size=1048576 2024-09-14T11:01:59.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.036+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~YY82JR9PQXBJ.1 size=829891 2024-09-14T11:01:59.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.038+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=YY82JR9PQXBJ tag=28OLPUJAOIGA type=write size=2927043 2024-09-14T11:01:59.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.039+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=I25332296L96 type=del size=2879074 2024-09-14T11:01:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.040+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~M1YCVYPVZ8LX.0 size=975914 2024-09-14T11:01:59.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.042+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=M1YCVYPVZ8LX tag=DGAL0D9L6MVS type=write size=2024490 2024-09-14T11:01:59.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.044+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~DUK03E07BO9V.0 size=1048576 2024-09-14T11:01:59.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.045+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~DUK03E07BO9V.1 size=221226 2024-09-14T11:01:59.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.045+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=DUK03E07BO9V tag=G9F93KU7IMNO type=write size=2318378 2024-09-14T11:01:59.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.046+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=7WPBAEI0CQ8H type=del 2024-09-14T11:01:59.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.048+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~L38BDBQCWFN0.0 size=726488 2024-09-14T11:01:59.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.048+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=L38BDBQCWFN0 tag=0BE6ILLGTG0M type=write size=1775064 2024-09-14T11:01:59.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.050+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~3PZLT81IT10B.0 size=1043463 2024-09-14T11:01:59.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.052+0000 7fe3dd11f780 1 < completed multipart upload key=4JTN39NIB2UE upload=3PZLT81IT10B tag=QU3US3293GM5 type=write size=2092039 2024-09-14T11:01:59.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.053+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=BTWAOBRS903Q type=del size=537605 2024-09-14T11:01:59.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.054+0000 7fe3dd11f780 1 < canceled operation key=UYZGHGZR74HQ tag=BU0Q5YEWAGX2 type=del size=2794313 2024-09-14T11:01:59.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.055+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=PVMNFDMMB31Y type=write size=608593 2024-09-14T11:01:59.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.056+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=5HAXX4OX0UPJ type=del 2024-09-14T11:01:59.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.058+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~K40XTOASHFHT.0 size=702050 2024-09-14T11:01:59.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.058+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=K40XTOASHFHT tag=MJ7QL86Q5VKW type=write size=1750626 2024-09-14T11:01:59.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.060+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~6L58D8SQI835.0 size=1048576 2024-09-14T11:01:59.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.061+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~6L58D8SQI835.1 size=1048576 2024-09-14T11:01:59.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.062+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~6L58D8SQI835.2 size=863733 2024-09-14T11:01:59.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.064+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=6L58D8SQI835 tag=MG74RT0ZD7J8 type=write size=4009461 2024-09-14T11:01:59.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.066+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~FUUD0693VCGE.0 size=1048576 2024-09-14T11:01:59.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.067+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~FUUD0693VCGE.1 size=980923 2024-09-14T11:01:59.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.067+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=FUUD0693VCGE tag=1B3AHGST91RH type=write size=3078075 2024-09-14T11:01:59.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.068+0000 7fe3dd11f780 1 < canceled operation key=MD0OU8IC5PYI tag=I78LE5GV9GZ1 type=del size=1196347 2024-09-14T11:01:59.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.069+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=MHB0BWBDOLA1 type=del size=4167636 2024-09-14T11:01:59.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.070+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~6VS1784HX0KA.0 size=538587 2024-09-14T11:01:59.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.073+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=6VS1784HX0KA tag=XZ5FUJLG16YD type=write size=1587163 2024-09-14T11:01:59.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.075+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~V1MZORTW1ST9.0 size=419479 2024-09-14T11:01:59.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.075+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=V1MZORTW1ST9 tag=NVM5D9L8D1XB type=write size=1468055 2024-09-14T11:01:59.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.077+0000 7fe3dd11f780 1 < suggested update operation key=KXL3E0PJBNBA tag=AA2MBJAG27BQ type=del size=231494 2024-09-14T11:01:59.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.079+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~SK10EON4D93E.0 size=233107 2024-09-14T11:01:59.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.079+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=SK10EON4D93E tag=T1DKWEQ4RRU3 type=write size=1281683 2024-09-14T11:01:59.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.080+0000 7fe3dd11f780 1 < completed delete operation key=GQEFQ1UD6QCJ tag=QUKUSRKI8C3Z type=del 2024-09-14T11:01:59.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.082+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=ONOO0UEZQRXB type=del size=2098661 2024-09-14T11:01:59.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.084+0000 7fe3dd11f780 1 < suggested update operation key=QPH41U60044L tag=MV34TTUWSYC1 type=del size=3444116 2024-09-14T11:01:59.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.085+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=YXJJ3SSEERQ6 type=del size=2540446 2024-09-14T11:01:59.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.086+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=G9M4KXGGK1P6 type=del 2024-09-14T11:01:59.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.088+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~CQ35EVCDZJV1.0 size=1048576 2024-09-14T11:01:59.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.089+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~CQ35EVCDZJV1.1 size=142627 2024-09-14T11:01:59.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.089+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=CQ35EVCDZJV1 tag=NAATXPDWJUM1 type=write size=2239779 2024-09-14T11:01:59.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.091+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~5FK57R84DZB8.0 size=1048576 2024-09-14T11:01:59.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.091+0000 7fe3dd11f780 1 < canceled part key=_multipart_EGC5988RQOEZ.2~5FK57R84DZB8.1 size=1048576 2024-09-14T11:01:59.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.091+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~5FK57R84DZB8.2 size=343608 2024-09-14T11:01:59.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.093+0000 7fe3dd11f780 1 < canceled multipart upload key=EGC5988RQOEZ upload=5FK57R84DZB8 tag=W8CLNOI8O87Y type=write size=3489336 2024-09-14T11:01:59.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.095+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~DE50FRHYLLRC.0 size=663472 2024-09-14T11:01:59.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.095+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=DE50FRHYLLRC tag=9Y6GHK8J3TQB type=write size=1712048 2024-09-14T11:01:59.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.097+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=UX433I9DE8MD type=del 2024-09-14T11:01:59.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.098+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=BE4IDO8NTAMQ type=del size=2034677 2024-09-14T11:01:59.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.100+0000 7fe3dd11f780 1 < suggested remove operation key=YMGE9GKLSPE6 tag=VML6AXS01LO4 type=del 2024-09-14T11:01:59.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.101+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=UDA8EOMK1NWO type=del size=3149710 2024-09-14T11:01:59.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.102+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=I25332296L96 type=del 2024-09-14T11:01:59.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.103+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=WG77KYCMHHWW type=del size=3874584 2024-09-14T11:01:59.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.105+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~DUK03E07BO9V.0 size=1048576 2024-09-14T11:01:59.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.105+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~DUK03E07BO9V.1 size=221226 2024-09-14T11:01:59.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.107+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=DUK03E07BO9V tag=G9F93KU7IMNO type=write size=2318378 2024-09-14T11:01:59.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.109+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~QOWGHH0DA914.0 size=847645 2024-09-14T11:01:59.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.109+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=QOWGHH0DA914 tag=LJFD7ZUP46NW type=write size=1896221 2024-09-14T11:01:59.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.111+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~L38BDBQCWFN0.0 size=726488 2024-09-14T11:01:59.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.113+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=L38BDBQCWFN0 tag=0BE6ILLGTG0M type=write size=1775064 2024-09-14T11:01:59.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.114+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=DDQBMX7NJ967 type=del size=258102 2024-09-14T11:01:59.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.117+0000 7fe3dd11f780 1 < suggested remove operation key=A89YQO40BHUS tag=BTWAOBRS903Q type=del 2024-09-14T11:01:59.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.118+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=67SERBH9LB10 type=del size=52516 2024-09-14T11:01:59.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.119+0000 7fe3dd11f780 1 < canceled operation key=IOAG4ZE1I58Z tag=PVMNFDMMB31Y type=write size=608593 2024-09-14T11:01:59.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.120+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=ZAFF137VKCZ1 type=del size=1349200 2024-09-14T11:01:59.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.122+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~K40XTOASHFHT.0 size=702050 2024-09-14T11:01:59.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.124+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=K40XTOASHFHT tag=MJ7QL86Q5VKW type=write size=1750626 2024-09-14T11:01:59.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.125+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=PKPZP0VT9XBL type=write size=576507 2024-09-14T11:01:59.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.126+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~FUUD0693VCGE.0 size=1048576 2024-09-14T11:01:59.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.127+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~FUUD0693VCGE.1 size=980923 2024-09-14T11:01:59.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.129+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=FUUD0693VCGE tag=1B3AHGST91RH type=write size=3078075 2024-09-14T11:01:59.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.131+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~EZP1SV1M5IOH.0 size=439070 2024-09-14T11:01:59.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.131+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=EZP1SV1M5IOH tag=KOD5L2LS13B0 type=write size=1487646 2024-09-14T11:01:59.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.132+0000 7fe3dd11f780 -1 < failed to complete operation key=YMGE9GKLSPE6 tag=MHB0BWBDOLA1 type=del size=4167636: (22) Invalid argument 2024-09-14T11:01:59.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.133+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=JANCDEZAD8VM type=del size=1743714 2024-09-14T11:01:59.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.134+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~V1MZORTW1ST9.0 size=419479 2024-09-14T11:01:59.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.138+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=V1MZORTW1ST9 tag=NVM5D9L8D1XB type=write size=1468055 2024-09-14T11:01:59.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.139+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=TAFNWKQCITNY type=del size=3063058 2024-09-14T11:01:59.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.139+0000 7fe3dd11f780 1 < canceled part key=_multipart_LFKLJAJWQ2J6.2~SK10EON4D93E.0 size=233107 2024-09-14T11:01:59.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.141+0000 7fe3dd11f780 1 < canceled multipart upload key=LFKLJAJWQ2J6 upload=SK10EON4D93E tag=T1DKWEQ4RRU3 type=write size=1281683 2024-09-14T11:01:59.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.143+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~SDFFR41S76KY.0 size=123990 2024-09-14T11:01:59.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.143+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=SDFFR41S76KY tag=MB76N3PXVCA0 type=write size=1172566 2024-09-14T11:01:59.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.144+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=ONOO0UEZQRXB type=del 2024-09-14T11:01:59.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.146+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=LOXRO5E5VPI4 type=write size=20798 2024-09-14T11:01:59.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.148+0000 7fe3dd11f780 1 < suggested update operation key=PHLQ77OMLI37 tag=YXJJ3SSEERQ6 type=del size=2540446 2024-09-14T11:01:59.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.149+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=DCM2LTI7ZTRH type=del size=784666 2024-09-14T11:01:59.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.149+0000 7fe3dd11f780 1 < canceled part key=_multipart_KXL3E0PJBNBA.2~CQ35EVCDZJV1.0 size=1048576 2024-09-14T11:01:59.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.150+0000 7fe3dd11f780 1 < completed part key=_multipart_KXL3E0PJBNBA.2~CQ35EVCDZJV1.1 size=142627 2024-09-14T11:01:59.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.152+0000 7fe3dd11f780 1 < canceled multipart upload key=KXL3E0PJBNBA upload=CQ35EVCDZJV1 tag=NAATXPDWJUM1 type=write size=2239779 2024-09-14T11:01:59.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.153+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=LCJWOQHOC5NM type=del size=2557261 2024-09-14T11:01:59.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.154+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~DE50FRHYLLRC.0 size=663472 2024-09-14T11:01:59.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.157+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=DE50FRHYLLRC tag=9Y6GHK8J3TQB type=write size=1712048 2024-09-14T11:01:59.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.159+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~UHOD4WBWGJXP.0 size=1048576 2024-09-14T11:01:59.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.160+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~UHOD4WBWGJXP.1 size=1048576 2024-09-14T11:01:59.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.161+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~UHOD4WBWGJXP.2 size=781821 2024-09-14T11:01:59.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.161+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=UHOD4WBWGJXP tag=WBQC374L0ZC6 type=write size=3927549 2024-09-14T11:01:59.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.162+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=BE4IDO8NTAMQ type=del 2024-09-14T11:01:59.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.164+0000 7fe3dd11f780 1 > prepared part key=_multipart_K9BP30LHDPA1.2~CHUQZNZEKA2L.0 size=270990 2024-09-14T11:01:59.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.164+0000 7fe3dd11f780 1 > prepared multipart upload key=K9BP30LHDPA1 upload=CHUQZNZEKA2L tag=ANITNCMGX3KG type=write size=1319566 2024-09-14T11:01:59.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.166+0000 7fe3dd11f780 1 < completed delete operation key=VDSOBBVO3QGB tag=UDA8EOMK1NWO type=del 2024-09-14T11:01:59.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.167+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=AEQVKATF0C8N type=write size=37230 2024-09-14T11:01:59.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.168+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=WG77KYCMHHWW type=del 2024-09-14T11:01:59.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.169+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=5314BBXY9G23 type=write size=55508 2024-09-14T11:01:59.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.171+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~QOWGHH0DA914.0 size=847645 2024-09-14T11:01:59.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.172+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=QOWGHH0DA914 tag=LJFD7ZUP46NW type=write size=1896221 2024-09-14T11:01:59.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.174+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=76U01PIVYDZM type=write size=54414 2024-09-14T11:01:59.173 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.175+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=DDQBMX7NJ967 type=del 2024-09-14T11:01:59.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.177+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=SFTZUUM2UVMD type=del size=1749086 2024-09-14T11:01:59.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.178+0000 7fe3dd11f780 1 < canceled operation key=LL9VJXEU13IK tag=67SERBH9LB10 type=del size=52516 2024-09-14T11:01:59.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.180+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~5A9XFJGD0WN5.0 size=893726 2024-09-14T11:01:59.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.180+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=5A9XFJGD0WN5 tag=K1UZ7SUGF60N type=write size=1942302 2024-09-14T11:01:59.179 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.181+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=ZAFF137VKCZ1 type=del 2024-09-14T11:01:59.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.183+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=ALJOMJ0SHU46 type=del size=1352633 2024-09-14T11:01:59.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.184+0000 7fe3dd11f780 1 < completed write operation key=VDSOBBVO3QGB tag=PKPZP0VT9XBL type=write size=576507 2024-09-14T11:01:59.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.185+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=38EPE3YY5M49 type=del size=1343900 2024-09-14T11:01:59.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.187+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~EZP1SV1M5IOH.0 size=439070 2024-09-14T11:01:59.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.189+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=EZP1SV1M5IOH tag=KOD5L2LS13B0 type=write size=1487646 2024-09-14T11:01:59.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.190+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=50E368JM26OU type=del size=723535 2024-09-14T11:01:59.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.191+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=JANCDEZAD8VM type=del 2024-09-14T11:01:59.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.192+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=63G2J2A440QW type=del size=2365529 2024-09-14T11:01:59.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.194+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=TAFNWKQCITNY type=del 2024-09-14T11:01:59.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.195+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=NBO9WNDF1VX2 type=del size=3297208 2024-09-14T11:01:59.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.196+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~SDFFR41S76KY.0 size=123990 2024-09-14T11:01:59.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.198+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=SDFFR41S76KY tag=MB76N3PXVCA0 type=write size=1172566 2024-09-14T11:01:59.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.200+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~IL3TGAT050FP.0 size=1048576 2024-09-14T11:01:59.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.201+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~IL3TGAT050FP.1 size=1048576 2024-09-14T11:01:59.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.202+0000 7fe3dd11f780 1 > prepared part key=_multipart_YXPZXFY8930D.2~IL3TGAT050FP.2 size=369401 2024-09-14T11:01:59.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.202+0000 7fe3dd11f780 1 > prepared multipart upload key=YXPZXFY8930D upload=IL3TGAT050FP tag=AZHLXP6Y3SAR type=write size=3515129 2024-09-14T11:01:59.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.203+0000 7fe3dd11f780 1 < completed write operation key=3PS4LAML698X tag=LOXRO5E5VPI4 type=write size=20798 2024-09-14T11:01:59.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.204+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=XWN1HPY0034C type=del size=1426097 2024-09-14T11:01:59.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.206+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=DCM2LTI7ZTRH type=del 2024-09-14T11:01:59.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.207+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=R5GN02E7WRA4 type=del size=3007464 2024-09-14T11:01:59.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.209+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=LCJWOQHOC5NM type=del 2024-09-14T11:01:59.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.211+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~6ZAGH7ICOZ21.0 size=1048576 2024-09-14T11:01:59.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.212+0000 7fe3dd11f780 1 > prepared part key=_multipart_JSEN4QXEMVHS.2~6ZAGH7ICOZ21.1 size=999100 2024-09-14T11:01:59.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.212+0000 7fe3dd11f780 1 > prepared multipart upload key=JSEN4QXEMVHS upload=6ZAGH7ICOZ21 tag=61C15I335SGN type=write size=3096252 2024-09-14T11:01:59.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.213+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~UHOD4WBWGJXP.0 size=1048576 2024-09-14T11:01:59.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.214+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~UHOD4WBWGJXP.1 size=1048576 2024-09-14T11:01:59.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.215+0000 7fe3dd11f780 1 < completed part key=_multipart_3PS4LAML698X.2~UHOD4WBWGJXP.2 size=781821 2024-09-14T11:01:59.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.217+0000 7fe3dd11f780 1 < completed multipart upload key=3PS4LAML698X upload=UHOD4WBWGJXP tag=WBQC374L0ZC6 type=write size=3927549 2024-09-14T11:01:59.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.218+0000 7fe3dd11f780 1 > prepared operation key=4JTN39NIB2UE tag=XOD4I05NNVM1 type=write size=286021 2024-09-14T11:01:59.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.219+0000 7fe3dd11f780 1 < completed part key=_multipart_K9BP30LHDPA1.2~CHUQZNZEKA2L.0 size=270990 2024-09-14T11:01:59.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.222+0000 7fe3dd11f780 1 < completed multipart upload key=K9BP30LHDPA1 upload=CHUQZNZEKA2L tag=ANITNCMGX3KG type=write size=1319566 2024-09-14T11:01:59.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.223+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=V71D2I3JA152 type=del size=2715635 2024-09-14T11:01:59.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.224+0000 7fe3dd11f780 1 < completed write operation key=US8KP3YL88TG tag=AEQVKATF0C8N type=write size=37230 2024-09-14T11:01:59.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.225+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=ICFS1V0UDMT0 type=del size=3483396 2024-09-14T11:01:59.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.227+0000 7fe3dd11f780 1 < canceled operation key=22TI1VCDTK5P tag=5314BBXY9G23 type=write size=55508 2024-09-14T11:01:59.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.228+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=FGDV88T57ZXF type=del size=1850216 2024-09-14T11:01:59.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.229+0000 7fe3dd11f780 1 < completed write operation key=ZTD98WQ6032X tag=76U01PIVYDZM type=write size=54414 2024-09-14T11:01:59.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.230+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=37ED9BM30G1V type=del size=2495558 2024-09-14T11:01:59.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.231+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=SFTZUUM2UVMD type=del 2024-09-14T11:01:59.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.233+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=251IXJI9TEFF type=del size=1621329 2024-09-14T11:01:59.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.234+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~5A9XFJGD0WN5.0 size=893726 2024-09-14T11:01:59.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.236+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=5A9XFJGD0WN5 tag=K1UZ7SUGF60N type=write size=1942302 2024-09-14T11:01:59.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.237+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=RD9Q8J2VWSHB type=del size=669810 2024-09-14T11:01:59.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.238+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=ALJOMJ0SHU46 type=del 2024-09-14T11:01:59.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.239+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=HUTQMYNZKHJE type=del size=885923 2024-09-14T11:01:59.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.240+0000 7fe3dd11f780 1 < canceled operation key=LFKLJAJWQ2J6 tag=38EPE3YY5M49 type=del size=1343900 2024-09-14T11:01:59.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.242+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~6I3NTQMLUIP7.0 size=878445 2024-09-14T11:01:59.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.242+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=6I3NTQMLUIP7 tag=9MKZSNZAZT90 type=write size=1927021 2024-09-14T11:01:59.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.243+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=50E368JM26OU type=del 2024-09-14T11:01:59.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.245+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=PNSB7ZVXATWB type=del size=407939 2024-09-14T11:01:59.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.246+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=63G2J2A440QW type=del 2024-09-14T11:01:59.245 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.248+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~1RCZP8G2G56G.0 size=876988 2024-09-14T11:01:59.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.248+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=1RCZP8G2G56G tag=4GV1X8CXFEJQ type=write size=1925564 2024-09-14T11:01:59.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.249+0000 7fe3dd11f780 1 < completed delete operation key=A89YQO40BHUS tag=NBO9WNDF1VX2 type=del 2024-09-14T11:01:59.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.250+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=XUFQETFII07P type=write size=811783 2024-09-14T11:01:59.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.252+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~IL3TGAT050FP.0 size=1048576 2024-09-14T11:01:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.253+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~IL3TGAT050FP.1 size=1048576 2024-09-14T11:01:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.254+0000 7fe3dd11f780 1 < completed part key=_multipart_YXPZXFY8930D.2~IL3TGAT050FP.2 size=369401 2024-09-14T11:01:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.256+0000 7fe3dd11f780 1 < completed multipart upload key=YXPZXFY8930D upload=IL3TGAT050FP tag=AZHLXP6Y3SAR type=write size=3515129 2024-09-14T11:01:59.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.257+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=03USS68E8THH type=del size=1224082 2024-09-14T11:01:59.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.258+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=XWN1HPY0034C type=del 2024-09-14T11:01:59.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.260+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~33OQIQ70JXH2.0 size=1048576 2024-09-14T11:01:59.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.261+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~33OQIQ70JXH2.1 size=164733 2024-09-14T11:01:59.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.261+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=33OQIQ70JXH2 tag=RQW1GXUC7JRK type=write size=2261885 2024-09-14T11:01:59.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.262+0000 7fe3dd11f780 1 < completed delete operation key=3PS4LAML698X tag=R5GN02E7WRA4 type=del 2024-09-14T11:01:59.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.264+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~5W7MEMHFQXDQ.0 size=1048576 2024-09-14T11:01:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.265+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~5W7MEMHFQXDQ.1 size=1048576 2024-09-14T11:01:59.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.266+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~5W7MEMHFQXDQ.2 size=335841 2024-09-14T11:01:59.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.266+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=5W7MEMHFQXDQ tag=U815Y8UBBEZ4 type=write size=3481569 2024-09-14T11:01:59.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.267+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~6ZAGH7ICOZ21.0 size=1048576 2024-09-14T11:01:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.268+0000 7fe3dd11f780 1 < completed part key=_multipart_JSEN4QXEMVHS.2~6ZAGH7ICOZ21.1 size=999100 2024-09-14T11:01:59.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.270+0000 7fe3dd11f780 1 < completed multipart upload key=JSEN4QXEMVHS upload=6ZAGH7ICOZ21 tag=61C15I335SGN type=write size=3096252 2024-09-14T11:01:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.272+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~02ZEQR64G4VY.0 size=145354 2024-09-14T11:01:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.272+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=02ZEQR64G4VY tag=JDD0APYEVOBC type=write size=1193930 2024-09-14T11:01:59.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.274+0000 7fe3dd11f780 1 < completed write operation key=4JTN39NIB2UE tag=XOD4I05NNVM1 type=write size=286021 2024-09-14T11:01:59.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.275+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=QQ2Y2LB663VG type=write size=183409 2024-09-14T11:01:59.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.277+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=V71D2I3JA152 type=del 2024-09-14T11:01:59.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.278+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=YQ8IIFO3Q7E7 type=del size=2629286 2024-09-14T11:01:59.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.281+0000 7fe3dd11f780 1 < suggested remove operation key=ZI5SFHGWCHJA tag=ICFS1V0UDMT0 type=del 2024-09-14T11:01:59.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.282+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=QIV7HVUDSC9S type=del size=1015156 2024-09-14T11:01:59.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.284+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=FGDV88T57ZXF type=del 2024-09-14T11:01:59.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.285+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=A81B6ZDUMECG type=del size=3406602 2024-09-14T11:01:59.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.286+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=37ED9BM30G1V type=del 2024-09-14T11:01:59.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.287+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=IAVEAUNTP3Q1 type=del size=2124829 2024-09-14T11:01:59.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.288+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=251IXJI9TEFF type=del 2024-09-14T11:01:59.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.289+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=BIC12CUS2RO1 type=del size=1149928 2024-09-14T11:01:59.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.291+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=RD9Q8J2VWSHB type=del 2024-09-14T11:01:59.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.292+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=SUK14CS0EHE0 type=del size=3187386 2024-09-14T11:01:59.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.294+0000 7fe3dd11f780 1 < suggested remove operation key=A89YQO40BHUS tag=HUTQMYNZKHJE type=del 2024-09-14T11:01:59.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.296+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~1IVP4SUA0N1L.0 size=1048576 2024-09-14T11:01:59.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.297+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~1IVP4SUA0N1L.1 size=185131 2024-09-14T11:01:59.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.297+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=1IVP4SUA0N1L tag=PDVOFZT67YHR type=write size=2282283 2024-09-14T11:01:59.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.299+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~6I3NTQMLUIP7.0 size=878445 2024-09-14T11:01:59.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.301+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=6I3NTQMLUIP7 tag=9MKZSNZAZT90 type=write size=1927021 2024-09-14T11:01:59.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.302+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=9KQYCDP82KXQ type=del size=3527158 2024-09-14T11:01:59.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.303+0000 7fe3dd11f780 1 < canceled operation key=JSEN4QXEMVHS tag=PNSB7ZVXATWB type=del size=407939 2024-09-14T11:01:59.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.304+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=VPWAM0C4T7FB type=write size=412276 2024-09-14T11:01:59.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.305+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~1RCZP8G2G56G.0 size=876988 2024-09-14T11:01:59.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.307+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=1RCZP8G2G56G tag=4GV1X8CXFEJQ type=write size=1925564 2024-09-14T11:01:59.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.309+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~3VNGAYM2JY8Y.0 size=914264 2024-09-14T11:01:59.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.310+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=3VNGAYM2JY8Y tag=6S6H3QGU0YKA type=write size=1962840 2024-09-14T11:01:59.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.311+0000 7fe3dd11f780 1 < completed write operation key=V692HUUJP2RC tag=XUFQETFII07P type=write size=811783 2024-09-14T11:01:59.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.313+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~H3DHVFGUERAR.0 size=1048576 2024-09-14T11:01:59.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.314+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~H3DHVFGUERAR.1 size=1048576 2024-09-14T11:01:59.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.315+0000 7fe3dd11f780 1 > prepared part key=_multipart_22TI1VCDTK5P.2~H3DHVFGUERAR.2 size=919517 2024-09-14T11:01:59.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.315+0000 7fe3dd11f780 1 > prepared multipart upload key=22TI1VCDTK5P upload=H3DHVFGUERAR tag=L87AW2IKXNY4 type=write size=4065245 2024-09-14T11:01:59.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.316+0000 7fe3dd11f780 1 < canceled operation key=VDSOBBVO3QGB tag=03USS68E8THH type=del size=1224082 2024-09-14T11:01:59.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.319+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~781OKL92MG0I.0 size=1048576 2024-09-14T11:01:59.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.320+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~781OKL92MG0I.1 size=732989 2024-09-14T11:01:59.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.320+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=781OKL92MG0I tag=3SCX71OUN00V type=write size=2830141 2024-09-14T11:01:59.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.321+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~33OQIQ70JXH2.0 size=1048576 2024-09-14T11:01:59.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.322+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~33OQIQ70JXH2.1 size=164733 2024-09-14T11:01:59.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.324+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=33OQIQ70JXH2 tag=RQW1GXUC7JRK type=write size=2261885 2024-09-14T11:01:59.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.325+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=MX6XWP3J63TA type=del size=1329325 2024-09-14T11:01:59.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.326+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~5W7MEMHFQXDQ.0 size=1048576 2024-09-14T11:01:59.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.327+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~5W7MEMHFQXDQ.1 size=1048576 2024-09-14T11:01:59.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.328+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~5W7MEMHFQXDQ.2 size=335841 2024-09-14T11:01:59.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.331+0000 7fe3dd11f780 1 < completed multipart upload key=JG1RZQD4J2EB upload=5W7MEMHFQXDQ tag=U815Y8UBBEZ4 type=write size=3481569 2024-09-14T11:01:59.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.333+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~UCWVJRBG8GMV.0 size=1048576 2024-09-14T11:01:59.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.334+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~UCWVJRBG8GMV.1 size=729507 2024-09-14T11:01:59.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.334+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=UCWVJRBG8GMV tag=C5X6875G6RDN type=write size=2826659 2024-09-14T11:01:59.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.335+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~02ZEQR64G4VY.0 size=145354 2024-09-14T11:01:59.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.337+0000 7fe3dd11f780 1 < completed multipart upload key=UYZGHGZR74HQ upload=02ZEQR64G4VY tag=JDD0APYEVOBC type=write size=1193930 2024-09-14T11:01:59.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.339+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~DAF8RHV297XF.0 size=1048576 2024-09-14T11:01:59.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.340+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~DAF8RHV297XF.1 size=1048576 2024-09-14T11:01:59.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.341+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~DAF8RHV297XF.2 size=193777 2024-09-14T11:01:59.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.341+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=DAF8RHV297XF tag=W8B8Q9XHT8RX type=write size=3339505 2024-09-14T11:01:59.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.342+0000 7fe3dd11f780 1 < completed write operation key=PHLQ77OMLI37 tag=QQ2Y2LB663VG type=write size=183409 2024-09-14T11:01:59.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.343+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=0WS9UTH4TI2J type=del size=720236 2024-09-14T11:01:59.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.344+0000 7fe3dd11f780 -1 < failed to complete operation key=ZI5SFHGWCHJA tag=YQ8IIFO3Q7E7 type=del size=2629286: (22) Invalid argument 2024-09-14T11:01:59.344 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.347+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~00OVU5CTQEH8.0 size=1048576 2024-09-14T11:01:59.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.348+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~00OVU5CTQEH8.1 size=672653 2024-09-14T11:01:59.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.348+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=00OVU5CTQEH8 tag=K6FSMZEFWUDA type=write size=2769805 2024-09-14T11:01:59.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.350+0000 7fe3dd11f780 1 < suggested remove operation key=PHLQ77OMLI37 tag=QIV7HVUDSC9S type=del 2024-09-14T11:01:59.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.352+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=Y2GLKEPRZEUJ type=write size=864683 2024-09-14T11:01:59.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.354+0000 7fe3dd11f780 1 < suggested update operation key=YXPZXFY8930D tag=A81B6ZDUMECG type=del size=3406602 2024-09-14T11:01:59.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.356+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=3RZO8I2JM1U9 type=write size=73181 2024-09-14T11:01:59.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.357+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=IAVEAUNTP3Q1 type=del 2024-09-14T11:01:59.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.359+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~CLZ67G1FXZ17.0 size=1048576 2024-09-14T11:01:59.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.360+0000 7fe3dd11f780 1 > prepared part key=_multipart_OK5L92EKOOMW.2~CLZ67G1FXZ17.1 size=778260 2024-09-14T11:01:59.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.360+0000 7fe3dd11f780 1 > prepared multipart upload key=OK5L92EKOOMW upload=CLZ67G1FXZ17 tag=EN74QYKWTVQY type=write size=2875412 2024-09-14T11:01:59.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.361+0000 7fe3dd11f780 -1 < failed to complete operation key=PHLQ77OMLI37 tag=BIC12CUS2RO1 type=del size=1149928: (22) Invalid argument 2024-09-14T11:01:59.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.363+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=G66SS98PVAYG type=del size=2795955 2024-09-14T11:01:59.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.364+0000 7fe3dd11f780 1 < completed delete operation key=US8KP3YL88TG tag=SUK14CS0EHE0 type=del 2024-09-14T11:01:59.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.368+0000 7fe3dd11f780 1 > prepared part key=_multipart_M0DMAQ5LTDR0.2~YOWNBZLVY33O.0 size=625017 2024-09-14T11:01:59.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.368+0000 7fe3dd11f780 1 > prepared multipart upload key=M0DMAQ5LTDR0 upload=YOWNBZLVY33O tag=DUJ3SI8IQLP7 type=write size=1673593 2024-09-14T11:01:59.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.369+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~1IVP4SUA0N1L.0 size=1048576 2024-09-14T11:01:59.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.370+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~1IVP4SUA0N1L.1 size=185131 2024-09-14T11:01:59.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.372+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=1IVP4SUA0N1L tag=PDVOFZT67YHR type=write size=2282283 2024-09-14T11:01:59.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.373+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=2LJYA2A9NNUI type=del size=3123747 2024-09-14T11:01:59.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.374+0000 7fe3dd11f780 1 < completed delete operation key=M0DMAQ5LTDR0 tag=9KQYCDP82KXQ type=del 2024-09-14T11:01:59.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.376+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=TDMRK5UBCEDG type=write size=277866 2024-09-14T11:01:59.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.378+0000 7fe3dd11f780 1 < suggested remove operation key=ODDNSHK5YMNO tag=VPWAM0C4T7FB type=write 2024-09-14T11:01:59.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.380+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~N37TLM328KAU.0 size=1048576 2024-09-14T11:01:59.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.381+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~N37TLM328KAU.1 size=1048576 2024-09-14T11:01:59.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.382+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~N37TLM328KAU.2 size=850697 2024-09-14T11:01:59.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.382+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=N37TLM328KAU tag=X54OTD6F2QRM type=write size=3996425 2024-09-14T11:01:59.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.383+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~3VNGAYM2JY8Y.0 size=914264 2024-09-14T11:01:59.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.385+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=3VNGAYM2JY8Y tag=6S6H3QGU0YKA type=write size=1962840 2024-09-14T11:01:59.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.386+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=TDHDRR16JM81 type=del size=2543661 2024-09-14T11:01:59.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.387+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~H3DHVFGUERAR.0 size=1048576 2024-09-14T11:01:59.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.388+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~H3DHVFGUERAR.1 size=1048576 2024-09-14T11:01:59.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.389+0000 7fe3dd11f780 1 < completed part key=_multipart_22TI1VCDTK5P.2~H3DHVFGUERAR.2 size=919517 2024-09-14T11:01:59.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.391+0000 7fe3dd11f780 1 < completed multipart upload key=22TI1VCDTK5P upload=H3DHVFGUERAR tag=L87AW2IKXNY4 type=write size=4065245 2024-09-14T11:01:59.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.393+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~9LR5X93ZVOVD.0 size=1048576 2024-09-14T11:01:59.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.394+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~9LR5X93ZVOVD.1 size=1048576 2024-09-14T11:01:59.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.395+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~9LR5X93ZVOVD.2 size=518236 2024-09-14T11:01:59.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.395+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=9LR5X93ZVOVD tag=3N7X34W6WPBO type=write size=3663964 2024-09-14T11:01:59.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.396+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~781OKL92MG0I.0 size=1048576 2024-09-14T11:01:59.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.397+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~781OKL92MG0I.1 size=732989 2024-09-14T11:01:59.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.399+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=781OKL92MG0I tag=3SCX71OUN00V type=write size=2830141 2024-09-14T11:01:59.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.400+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=GCBVXLADUA4Y type=del size=3243799 2024-09-14T11:01:59.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.401+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=MX6XWP3J63TA type=del 2024-09-14T11:01:59.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.402+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=8P5KVI0C8VDC type=del size=3537994 2024-09-14T11:01:59.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.404+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~UCWVJRBG8GMV.0 size=1048576 2024-09-14T11:01:59.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.405+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~UCWVJRBG8GMV.1 size=729507 2024-09-14T11:01:59.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.407+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=UCWVJRBG8GMV tag=C5X6875G6RDN type=write size=2826659 2024-09-14T11:01:59.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.409+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~6PQ7KR79737X.0 size=1048576 2024-09-14T11:01:59.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.410+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZI5SFHGWCHJA.2~6PQ7KR79737X.1 size=1046318 2024-09-14T11:01:59.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.410+0000 7fe3dd11f780 1 > prepared multipart upload key=ZI5SFHGWCHJA upload=6PQ7KR79737X tag=BZ40M4FR7QL9 type=write size=3143470 2024-09-14T11:01:59.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.411+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~DAF8RHV297XF.0 size=1048576 2024-09-14T11:01:59.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.412+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~DAF8RHV297XF.1 size=1048576 2024-09-14T11:01:59.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.413+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~DAF8RHV297XF.2 size=193777 2024-09-14T11:01:59.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.415+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=DAF8RHV297XF tag=W8B8Q9XHT8RX type=write size=3339505 2024-09-14T11:01:59.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.417+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~HFM0YVVM1ZB9.0 size=908292 2024-09-14T11:01:59.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.417+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=HFM0YVVM1ZB9 tag=RRAE8KFAARN6 type=write size=1956868 2024-09-14T11:01:59.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.418+0000 7fe3dd11f780 1 < canceled operation key=US8KP3YL88TG tag=0WS9UTH4TI2J type=del size=720236 2024-09-14T11:01:59.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.420+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=62I1NPMH0WMO type=del size=3405403 2024-09-14T11:01:59.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.421+0000 7fe3dd11f780 1 < completed part key=_multipart_JG1RZQD4J2EB.2~00OVU5CTQEH8.0 size=1048576 2024-09-14T11:01:59.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.421+0000 7fe3dd11f780 1 < canceled part key=_multipart_JG1RZQD4J2EB.2~00OVU5CTQEH8.1 size=672653 2024-09-14T11:01:59.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.423+0000 7fe3dd11f780 1 < canceled multipart upload key=JG1RZQD4J2EB upload=00OVU5CTQEH8 tag=K6FSMZEFWUDA type=write size=2769805 2024-09-14T11:01:59.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.425+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~IPJ0LNNHJUZ1.0 size=1048576 2024-09-14T11:01:59.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.426+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~IPJ0LNNHJUZ1.1 size=834186 2024-09-14T11:01:59.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.426+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=IPJ0LNNHJUZ1 tag=YF5JWU7B2Y3T type=write size=2931338 2024-09-14T11:01:59.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.428+0000 7fe3dd11f780 1 < suggested remove operation key=US8KP3YL88TG tag=Y2GLKEPRZEUJ type=write 2024-09-14T11:01:59.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.429+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=N9PEC2JJI292 type=del size=3105622 2024-09-14T11:01:59.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.431+0000 7fe3dd11f780 1 < suggested remove operation key=NHKCRGX10WBM tag=3RZO8I2JM1U9 type=write 2024-09-14T11:01:59.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.433+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=S44D554PV4MT type=del size=3391772 2024-09-14T11:01:59.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.434+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~CLZ67G1FXZ17.0 size=1048576 2024-09-14T11:01:59.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.435+0000 7fe3dd11f780 1 < completed part key=_multipart_OK5L92EKOOMW.2~CLZ67G1FXZ17.1 size=778260 2024-09-14T11:01:59.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.437+0000 7fe3dd11f780 1 < completed multipart upload key=OK5L92EKOOMW upload=CLZ67G1FXZ17 tag=EN74QYKWTVQY type=write size=2875412 2024-09-14T11:01:59.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.440+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~DIFSRV8JDWT5.0 size=1048576 2024-09-14T11:01:59.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.441+0000 7fe3dd11f780 1 > prepared part key=_multipart_UYZGHGZR74HQ.2~DIFSRV8JDWT5.1 size=735585 2024-09-14T11:01:59.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.441+0000 7fe3dd11f780 1 > prepared multipart upload key=UYZGHGZR74HQ upload=DIFSRV8JDWT5 tag=EA1EHEW31VTT type=write size=2832737 2024-09-14T11:01:59.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.442+0000 7fe3dd11f780 1 < completed delete operation key=EGC5988RQOEZ tag=G66SS98PVAYG type=del 2024-09-14T11:01:59.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.443+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=DC5ZQBG31LTH type=del size=598501 2024-09-14T11:01:59.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.444+0000 7fe3dd11f780 1 < completed part key=_multipart_M0DMAQ5LTDR0.2~YOWNBZLVY33O.0 size=625017 2024-09-14T11:01:59.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.446+0000 7fe3dd11f780 1 < completed multipart upload key=M0DMAQ5LTDR0 upload=YOWNBZLVY33O tag=DUJ3SI8IQLP7 type=write size=1673593 2024-09-14T11:01:59.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.448+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~UBH3M2D1DVOR.0 size=824657 2024-09-14T11:01:59.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.448+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=UBH3M2D1DVOR tag=OWMZCKQUE1HS type=write size=1873233 2024-09-14T11:01:59.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.450+0000 7fe3dd11f780 1 < completed delete operation key=IOAG4ZE1I58Z tag=2LJYA2A9NNUI type=del 2024-09-14T11:01:59.449 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.451+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=35GCUR50XN1U type=del size=1011506 2024-09-14T11:01:59.451 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.453+0000 7fe3dd11f780 1 < suggested remove operation key=LL9VJXEU13IK tag=TDMRK5UBCEDG type=write 2024-09-14T11:01:59.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.455+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~2ZTVL0CRSGKV.0 size=1048576 2024-09-14T11:01:59.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.456+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~2ZTVL0CRSGKV.1 size=299440 2024-09-14T11:01:59.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.456+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=2ZTVL0CRSGKV tag=LURON9J1ERQM type=write size=2396592 2024-09-14T11:01:59.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.458+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~N37TLM328KAU.0 size=1048576 2024-09-14T11:01:59.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.459+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~N37TLM328KAU.1 size=1048576 2024-09-14T11:01:59.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.460+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~N37TLM328KAU.2 size=850697 2024-09-14T11:01:59.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.462+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=N37TLM328KAU tag=X54OTD6F2QRM type=write size=3996425 2024-09-14T11:01:59.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.463+0000 7fe3dd11f780 1 > prepared operation key=EGC5988RQOEZ tag=B6TBJ9PF1Y1U type=write size=142812 2024-09-14T11:01:59.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.466+0000 7fe3dd11f780 1 < suggested update operation key=QPH41U60044L tag=TDHDRR16JM81 type=del size=2543661 2024-09-14T11:01:59.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.467+0000 7fe3dd11f780 1 > prepared operation key=IOAG4ZE1I58Z tag=376VM2PCXF8O type=write size=128255 2024-09-14T11:01:59.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.468+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~9LR5X93ZVOVD.0 size=1048576 2024-09-14T11:01:59.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.469+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~9LR5X93ZVOVD.1 size=1048576 2024-09-14T11:01:59.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.470+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~9LR5X93ZVOVD.2 size=518236 2024-09-14T11:01:59.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.472+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=9LR5X93ZVOVD tag=3N7X34W6WPBO type=write size=3663964 2024-09-14T11:01:59.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.474+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=GWM53JP7Y6QX type=del size=4090154 2024-09-14T11:01:59.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.475+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=GCBVXLADUA4Y type=del 2024-09-14T11:01:59.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.478+0000 7fe3dd11f780 1 > prepared operation key=6PJ03TAYRUT8 tag=CWT7OWP8M53P type=del size=2204163 2024-09-14T11:01:59.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.480+0000 7fe3dd11f780 1 < canceled operation key=ZI5SFHGWCHJA tag=8P5KVI0C8VDC type=del size=3537994 2024-09-14T11:01:59.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.481+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=0Y77MXKMVR2U type=write size=16626 2024-09-14T11:01:59.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.482+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~6PQ7KR79737X.0 size=1048576 2024-09-14T11:01:59.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.483+0000 7fe3dd11f780 1 < completed part key=_multipart_ZI5SFHGWCHJA.2~6PQ7KR79737X.1 size=1046318 2024-09-14T11:01:59.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.485+0000 7fe3dd11f780 1 < completed multipart upload key=ZI5SFHGWCHJA upload=6PQ7KR79737X tag=BZ40M4FR7QL9 type=write size=3143470 2024-09-14T11:01:59.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.486+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=H1UHVJWSY4QW type=del size=3472849 2024-09-14T11:01:59.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.488+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~HFM0YVVM1ZB9.0 size=908292 2024-09-14T11:01:59.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.490+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=HFM0YVVM1ZB9 tag=RRAE8KFAARN6 type=write size=1956868 2024-09-14T11:01:59.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.492+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~HSDOOJ6WY4HK.0 size=999044 2024-09-14T11:01:59.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.492+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=HSDOOJ6WY4HK tag=UPAQXQVQ6782 type=write size=2047620 2024-09-14T11:01:59.491 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.493+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=62I1NPMH0WMO type=del 2024-09-14T11:01:59.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.494+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=YODQJ3XMXSPK type=del size=1826019 2024-09-14T11:01:59.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.496+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~IPJ0LNNHJUZ1.0 size=1048576 2024-09-14T11:01:59.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.496+0000 7fe3dd11f780 1 < canceled part key=_multipart_ZTD98WQ6032X.2~IPJ0LNNHJUZ1.1 size=834186 2024-09-14T11:01:59.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.498+0000 7fe3dd11f780 1 < canceled multipart upload key=ZTD98WQ6032X upload=IPJ0LNNHJUZ1 tag=YF5JWU7B2Y3T type=write size=2931338 2024-09-14T11:01:59.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.499+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=B8RKSEPG8VPL type=del size=1984139 2024-09-14T11:01:59.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.502+0000 7fe3dd11f780 1 < suggested update operation key=QPH41U60044L tag=N9PEC2JJI292 type=del size=3105622 2024-09-14T11:01:59.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.503+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=X48E21ESYPN8 type=del size=4056163 2024-09-14T11:01:59.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.504+0000 7fe3dd11f780 1 < completed delete operation key=ZI5SFHGWCHJA tag=S44D554PV4MT type=del 2024-09-14T11:01:59.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.507+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~CR090NM1WOH0.0 size=1048576 2024-09-14T11:01:59.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.508+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~CR090NM1WOH0.1 size=1048576 2024-09-14T11:01:59.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.509+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~CR090NM1WOH0.2 size=166142 2024-09-14T11:01:59.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.509+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=CR090NM1WOH0 tag=QGPDWYZWYO49 type=write size=3311870 2024-09-14T11:01:59.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.509+0000 7fe3dd11f780 1 < canceled part key=_multipart_UYZGHGZR74HQ.2~DIFSRV8JDWT5.0 size=1048576 2024-09-14T11:01:59.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.510+0000 7fe3dd11f780 1 < completed part key=_multipart_UYZGHGZR74HQ.2~DIFSRV8JDWT5.1 size=735585 2024-09-14T11:01:59.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.512+0000 7fe3dd11f780 1 < canceled multipart upload key=UYZGHGZR74HQ upload=DIFSRV8JDWT5 tag=EA1EHEW31VTT type=write size=2832737 2024-09-14T11:01:59.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.514+0000 7fe3dd11f780 1 > prepared part key=_multipart_LL9VJXEU13IK.2~KVZCVQ3E7MPB.0 size=748260 2024-09-14T11:01:59.512 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.514+0000 7fe3dd11f780 1 > prepared multipart upload key=LL9VJXEU13IK upload=KVZCVQ3E7MPB tag=XV7Q81HBJY9S type=write size=1796836 2024-09-14T11:01:59.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.515+0000 7fe3dd11f780 1 < canceled operation key=US8KP3YL88TG tag=DC5ZQBG31LTH type=del size=598501 2024-09-14T11:01:59.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.517+0000 7fe3dd11f780 1 > prepared part key=_multipart_LFKLJAJWQ2J6.2~BQBZ7FKUU5IO.0 size=801139 2024-09-14T11:01:59.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.517+0000 7fe3dd11f780 1 > prepared multipart upload key=LFKLJAJWQ2J6 upload=BQBZ7FKUU5IO tag=BXCXU64KBWJK type=write size=1849715 2024-09-14T11:01:59.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.519+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~UBH3M2D1DVOR.0 size=824657 2024-09-14T11:01:59.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.521+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=UBH3M2D1DVOR tag=OWMZCKQUE1HS type=write size=1873233 2024-09-14T11:01:59.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.523+0000 7fe3dd11f780 1 > prepared part key=_multipart_JFLEJGPFLACM.2~02T4BXO62MV4.0 size=1012270 2024-09-14T11:01:59.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.523+0000 7fe3dd11f780 1 > prepared multipart upload key=JFLEJGPFLACM upload=02T4BXO62MV4 tag=OG8XLCYR5AMP type=write size=2060846 2024-09-14T11:01:59.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.524+0000 7fe3dd11f780 -1 < failed to complete operation key=QPH41U60044L tag=35GCUR50XN1U type=del size=1011506: (22) Invalid argument 2024-09-14T11:01:59.523 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.525+0000 7fe3dd11f780 1 > prepared operation key=3PS4LAML698X tag=K6PZGSE6EW7X type=del size=1253847 2024-09-14T11:01:59.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.527+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~2ZTVL0CRSGKV.0 size=1048576 2024-09-14T11:01:59.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.527+0000 7fe3dd11f780 1 < canceled part key=_multipart_LFKLJAJWQ2J6.2~2ZTVL0CRSGKV.1 size=299440 2024-09-14T11:01:59.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.529+0000 7fe3dd11f780 1 < canceled multipart upload key=LFKLJAJWQ2J6 upload=2ZTVL0CRSGKV tag=LURON9J1ERQM type=write size=2396592 2024-09-14T11:01:59.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.531+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~H2EA4ZNHB0FG.0 size=866107 2024-09-14T11:01:59.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.531+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=H2EA4ZNHB0FG tag=3VKSMJC505BH type=write size=1914683 2024-09-14T11:01:59.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.532+0000 7fe3dd11f780 1 < completed write operation key=EGC5988RQOEZ tag=B6TBJ9PF1Y1U type=write size=142812 2024-09-14T11:01:59.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.533+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=X3OMLLA8ZOFR type=write size=727409 2024-09-14T11:01:59.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.536+0000 7fe3dd11f780 1 < suggested update operation key=IOAG4ZE1I58Z tag=376VM2PCXF8O type=write size=128255 2024-09-14T11:01:59.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.538+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~X0XSR9FC0DV6.0 size=674986 2024-09-14T11:01:59.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.538+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=X0XSR9FC0DV6 tag=Z1F92EN2VUO7 type=write size=1723562 2024-09-14T11:01:59.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.539+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=GWM53JP7Y6QX type=del 2024-09-14T11:01:59.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.541+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~R3B43BGBJGPH.0 size=731689 2024-09-14T11:01:59.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.541+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=R3B43BGBJGPH tag=W641XGD8C1I9 type=write size=1780265 2024-09-14T11:01:59.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.543+0000 7fe3dd11f780 1 < completed delete operation key=6PJ03TAYRUT8 tag=CWT7OWP8M53P type=del 2024-09-14T11:01:59.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.545+0000 7fe3dd11f780 1 > prepared part key=_multipart_IOAG4ZE1I58Z.2~ZPUTOKBZYLWO.0 size=484988 2024-09-14T11:01:59.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.545+0000 7fe3dd11f780 1 > prepared multipart upload key=IOAG4ZE1I58Z upload=ZPUTOKBZYLWO tag=GJEQB44DGPCI type=write size=1533564 2024-09-14T11:01:59.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.547+0000 7fe3dd11f780 1 < suggested update operation key=PHLQ77OMLI37 tag=0Y77MXKMVR2U type=write size=16626 2024-09-14T11:01:59.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.549+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~5NISJAZ9GCWW.0 size=1048576 2024-09-14T11:01:59.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.550+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~5NISJAZ9GCWW.1 size=294177 2024-09-14T11:01:59.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.550+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=5NISJAZ9GCWW tag=WHSHCOXRV44W type=write size=2391329 2024-09-14T11:01:59.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.551+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=H1UHVJWSY4QW type=del 2024-09-14T11:01:59.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.552+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=P17PWYEIZYVH type=del size=522483 2024-09-14T11:01:59.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.554+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~HSDOOJ6WY4HK.0 size=999044 2024-09-14T11:01:59.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.556+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=HSDOOJ6WY4HK tag=UPAQXQVQ6782 type=write size=2047620 2024-09-14T11:01:59.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.557+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=8ZHRVTSSD55J type=del size=2322453 2024-09-14T11:01:59.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.559+0000 7fe3dd11f780 1 < suggested update operation key=K9BP30LHDPA1 tag=YODQJ3XMXSPK type=del size=1826019 2024-09-14T11:01:59.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.560+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=TU9Q9G32LUP6 type=del size=3660663 2024-09-14T11:01:59.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.562+0000 7fe3dd11f780 -1 < failed to complete operation key=QPH41U60044L tag=B8RKSEPG8VPL type=del size=1984139: (22) Invalid argument 2024-09-14T11:01:59.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.564+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~OUVYJ7CJQ0SI.0 size=1048576 2024-09-14T11:01:59.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.565+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~OUVYJ7CJQ0SI.1 size=65845 2024-09-14T11:01:59.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.565+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=OUVYJ7CJQ0SI tag=OLZ7BTXYV75D type=write size=2162997 2024-09-14T11:01:59.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.566+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=X48E21ESYPN8 type=del 2024-09-14T11:01:59.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.568+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~F1HFFPW5BOSG.0 size=1048576 2024-09-14T11:01:59.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.569+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~F1HFFPW5BOSG.1 size=786715 2024-09-14T11:01:59.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.569+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=F1HFFPW5BOSG tag=RIDIB3LJETFV type=write size=2883867 2024-09-14T11:01:59.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.570+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~CR090NM1WOH0.0 size=1048576 2024-09-14T11:01:59.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.571+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~CR090NM1WOH0.1 size=1048576 2024-09-14T11:01:59.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.572+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~CR090NM1WOH0.2 size=166142 2024-09-14T11:01:59.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.574+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=CR090NM1WOH0 tag=QGPDWYZWYO49 type=write size=3311870 2024-09-14T11:01:59.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.576+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=21JB5CMDPHEY type=write size=644174 2024-09-14T11:01:59.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.577+0000 7fe3dd11f780 1 < completed part key=_multipart_LL9VJXEU13IK.2~KVZCVQ3E7MPB.0 size=748260 2024-09-14T11:01:59.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.579+0000 7fe3dd11f780 1 < completed multipart upload key=LL9VJXEU13IK upload=KVZCVQ3E7MPB tag=XV7Q81HBJY9S type=write size=1796836 2024-09-14T11:01:59.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.580+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=J5LI5MU1D2US type=del size=2948903 2024-09-14T11:01:59.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.581+0000 7fe3dd11f780 1 < completed part key=_multipart_LFKLJAJWQ2J6.2~BQBZ7FKUU5IO.0 size=801139 2024-09-14T11:01:59.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.583+0000 7fe3dd11f780 1 < completed multipart upload key=LFKLJAJWQ2J6 upload=BQBZ7FKUU5IO tag=BXCXU64KBWJK type=write size=1849715 2024-09-14T11:01:59.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.585+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=S3EKR9DKCF44 type=del size=1220352 2024-09-14T11:01:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.586+0000 7fe3dd11f780 1 < completed part key=_multipart_JFLEJGPFLACM.2~02T4BXO62MV4.0 size=1012270 2024-09-14T11:01:59.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.588+0000 7fe3dd11f780 1 < completed multipart upload key=JFLEJGPFLACM upload=02T4BXO62MV4 tag=OG8XLCYR5AMP type=write size=2060846 2024-09-14T11:01:59.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.589+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=HTWHVENR5F1V type=del size=3738733 2024-09-14T11:01:59.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.593+0000 7fe3dd11f780 1 < suggested remove operation key=3PS4LAML698X tag=K6PZGSE6EW7X type=del 2024-09-14T11:01:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.594+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=8DYLUDUOUN3D type=del size=1035752 2024-09-14T11:01:59.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.595+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~H2EA4ZNHB0FG.0 size=866107 2024-09-14T11:01:59.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.597+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=H2EA4ZNHB0FG tag=3VKSMJC505BH type=write size=1914683 2024-09-14T11:01:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.599+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~XLBP4TBB7PC1.0 size=1048576 2024-09-14T11:01:59.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.600+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~XLBP4TBB7PC1.1 size=986725 2024-09-14T11:01:59.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.600+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=XLBP4TBB7PC1 tag=OHYIQJE5PBBT type=write size=3083877 2024-09-14T11:01:59.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.603+0000 7fe3dd11f780 1 < suggested remove operation key=YMGE9GKLSPE6 tag=X3OMLLA8ZOFR type=write 2024-09-14T11:01:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.604+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=IN44O27FNG2V type=write size=732095 2024-09-14T11:01:59.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.605+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~X0XSR9FC0DV6.0 size=674986 2024-09-14T11:01:59.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.607+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=X0XSR9FC0DV6 tag=Z1F92EN2VUO7 type=write size=1723562 2024-09-14T11:01:59.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.608+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=DE19I3HEAT17 type=del size=2336503 2024-09-14T11:01:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.609+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~R3B43BGBJGPH.0 size=731689 2024-09-14T11:01:59.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.611+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=R3B43BGBJGPH tag=W641XGD8C1I9 type=write size=1780265 2024-09-14T11:01:59.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.613+0000 7fe3dd11f780 1 > prepared part key=_multipart_EGC5988RQOEZ.2~GR6NAROU6IIH.0 size=332980 2024-09-14T11:01:59.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.613+0000 7fe3dd11f780 1 > prepared multipart upload key=EGC5988RQOEZ upload=GR6NAROU6IIH tag=GS4PCUCT6M9Z type=write size=1381556 2024-09-14T11:01:59.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.614+0000 7fe3dd11f780 1 < completed part key=_multipart_IOAG4ZE1I58Z.2~ZPUTOKBZYLWO.0 size=484988 2024-09-14T11:01:59.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.616+0000 7fe3dd11f780 1 < completed multipart upload key=IOAG4ZE1I58Z upload=ZPUTOKBZYLWO tag=GJEQB44DGPCI type=write size=1533564 2024-09-14T11:01:59.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.617+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=YIVEVTE1MFNI type=del size=180376 2024-09-14T11:01:59.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.619+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~5NISJAZ9GCWW.0 size=1048576 2024-09-14T11:01:59.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.620+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~5NISJAZ9GCWW.1 size=294177 2024-09-14T11:01:59.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.622+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=5NISJAZ9GCWW tag=WHSHCOXRV44W type=write size=2391329 2024-09-14T11:01:59.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.623+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=5TM5S7O9IDF7 type=del size=1834922 2024-09-14T11:01:59.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.624+0000 7fe3dd11f780 -1 < failed to complete operation key=K9BP30LHDPA1 tag=P17PWYEIZYVH type=del size=522483: (22) Invalid argument 2024-09-14T11:01:59.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.626+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=N6UONS1DS4JF type=del size=1987951 2024-09-14T11:01:59.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.627+0000 7fe3dd11f780 1 < completed delete operation key=ODDNSHK5YMNO tag=8ZHRVTSSD55J type=del 2024-09-14T11:01:59.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.628+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=7JDQZKMRSDND type=del size=3759637 2024-09-14T11:01:59.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.629+0000 7fe3dd11f780 1 < completed delete operation key=KXL3E0PJBNBA tag=TU9Q9G32LUP6 type=del 2024-09-14T11:01:59.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.630+0000 7fe3dd11f780 1 > prepared operation key=ZI5SFHGWCHJA tag=IAZ2WY04RUQN type=del size=2747929 2024-09-14T11:01:59.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.631+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~OUVYJ7CJQ0SI.0 size=1048576 2024-09-14T11:01:59.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.632+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~OUVYJ7CJQ0SI.1 size=65845 2024-09-14T11:01:59.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.634+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=OUVYJ7CJQ0SI tag=OLZ7BTXYV75D type=write size=2162997 2024-09-14T11:01:59.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.636+0000 7fe3dd11f780 1 > prepared operation key=GQEFQ1UD6QCJ tag=869CWJZZL640 type=write size=352667 2024-09-14T11:01:59.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.637+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~F1HFFPW5BOSG.0 size=1048576 2024-09-14T11:01:59.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.637+0000 7fe3dd11f780 1 < canceled part key=_multipart_QPH41U60044L.2~F1HFFPW5BOSG.1 size=786715 2024-09-14T11:01:59.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.639+0000 7fe3dd11f780 1 < canceled multipart upload key=QPH41U60044L upload=F1HFFPW5BOSG tag=RIDIB3LJETFV type=write size=2883867 2024-09-14T11:01:59.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.640+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=C966PVWGD5KN type=del size=3734452 2024-09-14T11:01:59.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.641+0000 7fe3dd11f780 1 < canceled operation key=JG1RZQD4J2EB tag=21JB5CMDPHEY type=write size=644174 2024-09-14T11:01:59.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.644+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~83Y0KIFLXXJ2.0 size=1048576 2024-09-14T11:01:59.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.645+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~83Y0KIFLXXJ2.1 size=1048576 2024-09-14T11:01:59.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.646+0000 7fe3dd11f780 1 > prepared part key=_multipart_4JTN39NIB2UE.2~83Y0KIFLXXJ2.2 size=42915 2024-09-14T11:01:59.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.646+0000 7fe3dd11f780 1 > prepared multipart upload key=4JTN39NIB2UE upload=83Y0KIFLXXJ2 tag=JX2W3RHF049H type=write size=3188643 2024-09-14T11:01:59.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.648+0000 7fe3dd11f780 1 < suggested remove operation key=UYZGHGZR74HQ tag=J5LI5MU1D2US type=del 2024-09-14T11:01:59.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.650+0000 7fe3dd11f780 1 > prepared part key=_multipart_US8KP3YL88TG.2~0GJ62C3OPHCB.0 size=259768 2024-09-14T11:01:59.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.650+0000 7fe3dd11f780 1 > prepared multipart upload key=US8KP3YL88TG upload=0GJ62C3OPHCB tag=8UNNMSVQ7HC8 type=write size=1308344 2024-09-14T11:01:59.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.651+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=S3EKR9DKCF44 type=del 2024-09-14T11:01:59.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.654+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~0J3STBKPNAG2.0 size=283092 2024-09-14T11:01:59.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.654+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=0J3STBKPNAG2 tag=C696HNEKIZ2R type=write size=1331668 2024-09-14T11:01:59.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.655+0000 7fe3dd11f780 1 < completed delete operation key=22TI1VCDTK5P tag=HTWHVENR5F1V type=del 2024-09-14T11:01:59.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.657+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=5YAARE6GB23X type=del size=1820578 2024-09-14T11:01:59.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.658+0000 7fe3dd11f780 1 < completed delete operation key=PHLQ77OMLI37 tag=8DYLUDUOUN3D type=del 2024-09-14T11:01:59.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.659+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=APIUSLK6DNS8 type=del size=1231714 2024-09-14T11:01:59.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.661+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~XLBP4TBB7PC1.0 size=1048576 2024-09-14T11:01:59.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.662+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~XLBP4TBB7PC1.1 size=986725 2024-09-14T11:01:59.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.664+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=XLBP4TBB7PC1 tag=OHYIQJE5PBBT type=write size=3083877 2024-09-14T11:01:59.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.666+0000 7fe3dd11f780 1 > prepared part key=_multipart_PHLQ77OMLI37.2~U84A4GEJHYU5.0 size=197790 2024-09-14T11:01:59.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.666+0000 7fe3dd11f780 1 > prepared multipart upload key=PHLQ77OMLI37 upload=U84A4GEJHYU5 tag=I63HIOYEJVN9 type=write size=1246366 2024-09-14T11:01:59.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.667+0000 7fe3dd11f780 1 < completed write operation key=JSEN4QXEMVHS tag=IN44O27FNG2V type=write size=732095 2024-09-14T11:01:59.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.669+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~1VTXSTE963X9.0 size=1048576 2024-09-14T11:01:59.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.670+0000 7fe3dd11f780 1 > prepared part key=_multipart_ODDNSHK5YMNO.2~1VTXSTE963X9.1 size=2692 2024-09-14T11:01:59.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.670+0000 7fe3dd11f780 1 > prepared multipart upload key=ODDNSHK5YMNO upload=1VTXSTE963X9 tag=G4Y9WPGJKFR9 type=write size=2099844 2024-09-14T11:01:59.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.672+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=DE19I3HEAT17 type=del 2024-09-14T11:01:59.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.673+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=YVHJNOHVSHB1 type=write size=569011 2024-09-14T11:01:59.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.674+0000 7fe3dd11f780 1 < completed part key=_multipart_EGC5988RQOEZ.2~GR6NAROU6IIH.0 size=332980 2024-09-14T11:01:59.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.676+0000 7fe3dd11f780 1 < completed multipart upload key=EGC5988RQOEZ upload=GR6NAROU6IIH tag=GS4PCUCT6M9Z type=write size=1381556 2024-09-14T11:01:59.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.678+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~6XNQ0TMTVRWF.0 size=1048576 2024-09-14T11:01:59.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.679+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~6XNQ0TMTVRWF.1 size=1048576 2024-09-14T11:01:59.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.680+0000 7fe3dd11f780 1 > prepared part key=_multipart_GQEFQ1UD6QCJ.2~6XNQ0TMTVRWF.2 size=1014497 2024-09-14T11:01:59.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.680+0000 7fe3dd11f780 1 > prepared multipart upload key=GQEFQ1UD6QCJ upload=6XNQ0TMTVRWF tag=6OKZD61DVJRQ type=write size=4160225 2024-09-14T11:01:59.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.681+0000 7fe3dd11f780 1 < completed delete operation key=V692HUUJP2RC tag=YIVEVTE1MFNI type=del 2024-09-14T11:01:59.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.682+0000 7fe3dd11f780 1 > prepared operation key=YXPZXFY8930D tag=FKIUXZM4Y734 type=del size=1195730 2024-09-14T11:01:59.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.683+0000 7fe3dd11f780 1 < canceled operation key=ZTD98WQ6032X tag=5TM5S7O9IDF7 type=del size=1834922 2024-09-14T11:01:59.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.685+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=BCD2GEWRIB0X type=del size=154205 2024-09-14T11:01:59.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.686+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=N6UONS1DS4JF type=del 2024-09-14T11:01:59.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.688+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~4U1SGEKGFI9F.0 size=1048576 2024-09-14T11:01:59.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.689+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~4U1SGEKGFI9F.1 size=1048576 2024-09-14T11:01:59.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.690+0000 7fe3dd11f780 1 > prepared part key=_multipart_A89YQO40BHUS.2~4U1SGEKGFI9F.2 size=74973 2024-09-14T11:01:59.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.690+0000 7fe3dd11f780 1 > prepared multipart upload key=A89YQO40BHUS upload=4U1SGEKGFI9F tag=PJ9SVYYKG2NK type=write size=3220701 2024-09-14T11:01:59.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.691+0000 7fe3dd11f780 1 < completed delete operation key=MD0OU8IC5PYI tag=7JDQZKMRSDND type=del 2024-09-14T11:01:59.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.693+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~6884P7MSUHUH.0 size=1048576 2024-09-14T11:01:59.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.694+0000 7fe3dd11f780 1 > prepared part key=_multipart_YMGE9GKLSPE6.2~6884P7MSUHUH.1 size=200517 2024-09-14T11:01:59.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.694+0000 7fe3dd11f780 1 > prepared multipart upload key=YMGE9GKLSPE6 upload=6884P7MSUHUH tag=6MBP7IJFCUY4 type=write size=2297669 2024-09-14T11:01:59.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.695+0000 7fe3dd11f780 1 < canceled operation key=ZI5SFHGWCHJA tag=IAZ2WY04RUQN type=del size=2747929 2024-09-14T11:01:59.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.696+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=94L9PX8U53FM type=del size=3240354 2024-09-14T11:01:59.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.697+0000 7fe3dd11f780 1 < canceled operation key=GQEFQ1UD6QCJ tag=869CWJZZL640 type=write size=352667 2024-09-14T11:01:59.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.699+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=00SDW0U5BYIS type=del size=3666812 2024-09-14T11:01:59.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.700+0000 7fe3dd11f780 1 < completed delete operation key=JSEN4QXEMVHS tag=C966PVWGD5KN type=del 2024-09-14T11:01:59.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.702+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~2G0U3YLQ9H7T.0 size=1048576 2024-09-14T11:01:59.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.703+0000 7fe3dd11f780 1 > prepared part key=_multipart_LDILBET1CMYY.2~2G0U3YLQ9H7T.1 size=957217 2024-09-14T11:01:59.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.703+0000 7fe3dd11f780 1 > prepared multipart upload key=LDILBET1CMYY upload=2G0U3YLQ9H7T tag=39XDM895T0NK type=write size=3054369 2024-09-14T11:01:59.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.705+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~83Y0KIFLXXJ2.0 size=1048576 2024-09-14T11:01:59.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.705+0000 7fe3dd11f780 1 < canceled part key=_multipart_4JTN39NIB2UE.2~83Y0KIFLXXJ2.1 size=1048576 2024-09-14T11:01:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.706+0000 7fe3dd11f780 1 < completed part key=_multipart_4JTN39NIB2UE.2~83Y0KIFLXXJ2.2 size=42915 2024-09-14T11:01:59.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.708+0000 7fe3dd11f780 1 < canceled multipart upload key=4JTN39NIB2UE upload=83Y0KIFLXXJ2 tag=JX2W3RHF049H type=write size=3188643 2024-09-14T11:01:59.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.709+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=CJS6NI6SKDT3 type=del size=1503554 2024-09-14T11:01:59.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.710+0000 7fe3dd11f780 1 < completed part key=_multipart_US8KP3YL88TG.2~0GJ62C3OPHCB.0 size=259768 2024-09-14T11:01:59.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.712+0000 7fe3dd11f780 1 < completed multipart upload key=US8KP3YL88TG upload=0GJ62C3OPHCB tag=8UNNMSVQ7HC8 type=write size=1308344 2024-09-14T11:01:59.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.713+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=G9863VZ0BJHN type=del size=436923 2024-09-14T11:01:59.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.714+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~0J3STBKPNAG2.0 size=283092 2024-09-14T11:01:59.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.716+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=0J3STBKPNAG2 tag=C696HNEKIZ2R type=write size=1331668 2024-09-14T11:01:59.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.717+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=T3RVX1CQJQKW type=del size=1605248 2024-09-14T11:01:59.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.718+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=5YAARE6GB23X type=del 2024-09-14T11:01:59.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.720+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0EC8YC7CD89T.0 size=1048576 2024-09-14T11:01:59.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.721+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0EC8YC7CD89T.1 size=1048576 2024-09-14T11:01:59.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.722+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~0EC8YC7CD89T.2 size=778000 2024-09-14T11:01:59.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.722+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=0EC8YC7CD89T tag=CTYVVTBNYLLI type=write size=3923728 2024-09-14T11:01:59.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.723+0000 7fe3dd11f780 1 < canceled operation key=MD0OU8IC5PYI tag=APIUSLK6DNS8 type=del size=1231714 2024-09-14T11:01:59.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.724+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=X6PITX7SA18L type=del size=127148 2024-09-14T11:01:59.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.726+0000 7fe3dd11f780 1 < completed part key=_multipart_PHLQ77OMLI37.2~U84A4GEJHYU5.0 size=197790 2024-09-14T11:01:59.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.728+0000 7fe3dd11f780 1 < completed multipart upload key=PHLQ77OMLI37 upload=U84A4GEJHYU5 tag=I63HIOYEJVN9 type=write size=1246366 2024-09-14T11:01:59.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.730+0000 7fe3dd11f780 1 > prepared part key=_multipart_3PS4LAML698X.2~VJVN0U9P0A74.0 size=863421 2024-09-14T11:01:59.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.730+0000 7fe3dd11f780 1 > prepared multipart upload key=3PS4LAML698X upload=VJVN0U9P0A74 tag=FL40BXVX7T8A type=write size=1911997 2024-09-14T11:01:59.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.731+0000 7fe3dd11f780 1 < completed part key=_multipart_ODDNSHK5YMNO.2~1VTXSTE963X9.0 size=1048576 2024-09-14T11:01:59.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.731+0000 7fe3dd11f780 1 < canceled part key=_multipart_ODDNSHK5YMNO.2~1VTXSTE963X9.1 size=2692 2024-09-14T11:01:59.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.733+0000 7fe3dd11f780 1 < canceled multipart upload key=ODDNSHK5YMNO upload=1VTXSTE963X9 tag=G4Y9WPGJKFR9 type=write size=2099844 2024-09-14T11:01:59.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.734+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=Q78KDURMJ45N type=del size=1740965 2024-09-14T11:01:59.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.735+0000 7fe3dd11f780 1 < completed write operation key=OK5L92EKOOMW tag=YVHJNOHVSHB1 type=write size=569011 2024-09-14T11:01:59.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.736+0000 7fe3dd11f780 1 > prepared operation key=LL9VJXEU13IK tag=YGN6H1DDSVDU type=del size=3540466 2024-09-14T11:01:59.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.738+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~6XNQ0TMTVRWF.0 size=1048576 2024-09-14T11:01:59.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.739+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~6XNQ0TMTVRWF.1 size=1048576 2024-09-14T11:01:59.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.739+0000 7fe3dd11f780 1 < completed part key=_multipart_GQEFQ1UD6QCJ.2~6XNQ0TMTVRWF.2 size=1014497 2024-09-14T11:01:59.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.741+0000 7fe3dd11f780 1 < completed multipart upload key=GQEFQ1UD6QCJ upload=6XNQ0TMTVRWF tag=6OKZD61DVJRQ type=write size=4160225 2024-09-14T11:01:59.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.743+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=D19A517FW6TA type=del size=3709049 2024-09-14T11:01:59.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.744+0000 7fe3dd11f780 1 < completed delete operation key=YXPZXFY8930D tag=FKIUXZM4Y734 type=del 2024-09-14T11:01:59.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.745+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=V5W4YOOXU5SY type=del size=3906351 2024-09-14T11:01:59.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.746+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=BCD2GEWRIB0X type=del 2024-09-14T11:01:59.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.747+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=HJZRVV86XV5I type=del size=676736 2024-09-14T11:01:59.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.749+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~4U1SGEKGFI9F.0 size=1048576 2024-09-14T11:01:59.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.749+0000 7fe3dd11f780 1 < canceled part key=_multipart_A89YQO40BHUS.2~4U1SGEKGFI9F.1 size=1048576 2024-09-14T11:01:59.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.750+0000 7fe3dd11f780 1 < completed part key=_multipart_A89YQO40BHUS.2~4U1SGEKGFI9F.2 size=74973 2024-09-14T11:01:59.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.752+0000 7fe3dd11f780 1 < canceled multipart upload key=A89YQO40BHUS upload=4U1SGEKGFI9F tag=PJ9SVYYKG2NK type=write size=3220701 2024-09-14T11:01:59.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.753+0000 7fe3dd11f780 1 > prepared operation key=22TI1VCDTK5P tag=EK8CZOS125ZI type=write size=806626 2024-09-14T11:01:59.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.754+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~6884P7MSUHUH.0 size=1048576 2024-09-14T11:01:59.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.755+0000 7fe3dd11f780 1 < completed part key=_multipart_YMGE9GKLSPE6.2~6884P7MSUHUH.1 size=200517 2024-09-14T11:01:59.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.757+0000 7fe3dd11f780 1 < completed multipart upload key=YMGE9GKLSPE6 upload=6884P7MSUHUH tag=6MBP7IJFCUY4 type=write size=2297669 2024-09-14T11:01:59.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.759+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~BH9AZ5N0EHVO.0 size=1048576 2024-09-14T11:01:59.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.760+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~BH9AZ5N0EHVO.1 size=1048576 2024-09-14T11:01:59.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.761+0000 7fe3dd11f780 1 > prepared part key=_multipart_V692HUUJP2RC.2~BH9AZ5N0EHVO.2 size=155783 2024-09-14T11:01:59.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.761+0000 7fe3dd11f780 1 > prepared multipart upload key=V692HUUJP2RC upload=BH9AZ5N0EHVO tag=XUHKZOXYEYNZ type=write size=3301511 2024-09-14T11:01:59.760 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.762+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=94L9PX8U53FM type=del 2024-09-14T11:01:59.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.764+0000 7fe3dd11f780 1 > prepared operation key=OK5L92EKOOMW tag=CW8E90HJC3NU type=del size=2476035 2024-09-14T11:01:59.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.765+0000 7fe3dd11f780 1 < completed delete operation key=LDILBET1CMYY tag=00SDW0U5BYIS type=del 2024-09-14T11:01:59.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.766+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=BR2P5A60PV6J type=del size=1580201 2024-09-14T11:01:59.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.767+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~2G0U3YLQ9H7T.0 size=1048576 2024-09-14T11:01:59.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.768+0000 7fe3dd11f780 1 < completed part key=_multipart_LDILBET1CMYY.2~2G0U3YLQ9H7T.1 size=957217 2024-09-14T11:01:59.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.770+0000 7fe3dd11f780 1 < completed multipart upload key=LDILBET1CMYY upload=2G0U3YLQ9H7T tag=39XDM895T0NK type=write size=3054369 2024-09-14T11:01:59.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.772+0000 7fe3dd11f780 1 > prepared operation key=KXL3E0PJBNBA tag=K4QJ0R2Q145P type=write size=263888 2024-09-14T11:01:59.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.773+0000 7fe3dd11f780 1 < completed delete operation key=K9BP30LHDPA1 tag=CJS6NI6SKDT3 type=del 2024-09-14T11:01:59.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.774+0000 7fe3dd11f780 1 > prepared operation key=JG1RZQD4J2EB tag=I3J7PSB12W1L type=del size=342258 2024-09-14T11:01:59.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.775+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=G9863VZ0BJHN type=del 2024-09-14T11:01:59.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.778+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~K8WF5JDHW04V.0 size=1048576 2024-09-14T11:01:59.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.779+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~K8WF5JDHW04V.1 size=1048576 2024-09-14T11:01:59.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.780+0000 7fe3dd11f780 1 > prepared part key=_multipart_ZTD98WQ6032X.2~K8WF5JDHW04V.2 size=262260 2024-09-14T11:01:59.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.780+0000 7fe3dd11f780 1 > prepared multipart upload key=ZTD98WQ6032X upload=K8WF5JDHW04V tag=KWH5TJDHUVE8 type=write size=3407988 2024-09-14T11:01:59.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.782+0000 7fe3dd11f780 1 < completed delete operation key=UYZGHGZR74HQ tag=T3RVX1CQJQKW type=del 2024-09-14T11:01:59.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.783+0000 7fe3dd11f780 1 > prepared operation key=QPH41U60044L tag=JY4CA083OG5U type=del size=3205951 2024-09-14T11:01:59.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.784+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~0EC8YC7CD89T.0 size=1048576 2024-09-14T11:01:59.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.785+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~0EC8YC7CD89T.1 size=1048576 2024-09-14T11:01:59.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.786+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~0EC8YC7CD89T.2 size=778000 2024-09-14T11:01:59.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.789+0000 7fe3dd11f780 1 < completed multipart upload key=V692HUUJP2RC upload=0EC8YC7CD89T tag=CTYVVTBNYLLI type=write size=3923728 2024-09-14T11:01:59.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.790+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=3112ZP5UG5AU type=del size=244391 2024-09-14T11:01:59.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.791+0000 7fe3dd11f780 1 < completed delete operation key=ZTD98WQ6032X tag=X6PITX7SA18L type=del 2024-09-14T11:01:59.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.793+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~PSOF16RMQN3I.0 size=1048576 2024-09-14T11:01:59.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.794+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~PSOF16RMQN3I.1 size=1048576 2024-09-14T11:01:59.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.795+0000 7fe3dd11f780 1 > prepared part key=_multipart_QPH41U60044L.2~PSOF16RMQN3I.2 size=543714 2024-09-14T11:01:59.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.795+0000 7fe3dd11f780 1 > prepared multipart upload key=QPH41U60044L upload=PSOF16RMQN3I tag=WXT03KMYQ6RV type=write size=3689442 2024-09-14T11:01:59.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.795+0000 7fe3dd11f780 1 < canceled part key=_multipart_3PS4LAML698X.2~VJVN0U9P0A74.0 size=863421 2024-09-14T11:01:59.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.797+0000 7fe3dd11f780 1 < canceled multipart upload key=3PS4LAML698X upload=VJVN0U9P0A74 tag=FL40BXVX7T8A type=write size=1911997 2024-09-14T11:01:59.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.798+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=61OFA2L5VVXU type=del size=4113449 2024-09-14T11:01:59.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.800+0000 7fe3dd11f780 1 < completed delete operation key=LL9VJXEU13IK tag=Q78KDURMJ45N type=del 2024-09-14T11:01:59.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.801+0000 7fe3dd11f780 1 > prepared operation key=A89YQO40BHUS tag=COQL3E6R1RWQ type=write size=739205 2024-09-14T11:01:59.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.803+0000 7fe3dd11f780 1 < suggested remove operation key=LL9VJXEU13IK tag=YGN6H1DDSVDU type=del 2024-09-14T11:01:59.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.804+0000 7fe3dd11f780 1 > prepared operation key=M0DMAQ5LTDR0 tag=MKNFZ7GJ9O5T type=del size=3621194 2024-09-14T11:01:59.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.807+0000 7fe3dd11f780 1 < suggested update operation key=KXL3E0PJBNBA tag=D19A517FW6TA type=del size=3709049 2024-09-14T11:01:59.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.808+0000 7fe3dd11f780 1 > prepared operation key=LFKLJAJWQ2J6 tag=3W4FIHODPGXQ type=del size=717493 2024-09-14T11:01:59.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.809+0000 7fe3dd11f780 -1 < failed to complete operation key=KXL3E0PJBNBA tag=V5W4YOOXU5SY type=del size=3906351: (22) Invalid argument 2024-09-14T11:01:59.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.810+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=3Z3MA72YPTFH type=del size=1526649 2024-09-14T11:01:59.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.812+0000 7fe3dd11f780 1 < completed delete operation key=JFLEJGPFLACM tag=HJZRVV86XV5I type=del 2024-09-14T11:01:59.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.814+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~KP6O0LLF2EO7.0 size=1048576 2024-09-14T11:01:59.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.815+0000 7fe3dd11f780 1 > prepared part key=_multipart_6PJ03TAYRUT8.2~KP6O0LLF2EO7.1 size=481172 2024-09-14T11:01:59.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.815+0000 7fe3dd11f780 1 > prepared multipart upload key=6PJ03TAYRUT8 upload=KP6O0LLF2EO7 tag=OJ22VGWRR05L type=write size=2578324 2024-09-14T11:01:59.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.817+0000 7fe3dd11f780 1 < completed write operation key=22TI1VCDTK5P tag=EK8CZOS125ZI type=write size=806626 2024-09-14T11:01:59.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.818+0000 7fe3dd11f780 1 > prepared operation key=VDSOBBVO3QGB tag=AMGFQT8HZ5X5 type=del size=3147020 2024-09-14T11:01:59.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.819+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~BH9AZ5N0EHVO.0 size=1048576 2024-09-14T11:01:59.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.819+0000 7fe3dd11f780 1 < canceled part key=_multipart_V692HUUJP2RC.2~BH9AZ5N0EHVO.1 size=1048576 2024-09-14T11:01:59.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.820+0000 7fe3dd11f780 1 < completed part key=_multipart_V692HUUJP2RC.2~BH9AZ5N0EHVO.2 size=155783 2024-09-14T11:01:59.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.822+0000 7fe3dd11f780 1 < canceled multipart upload key=V692HUUJP2RC upload=BH9AZ5N0EHVO tag=XUHKZOXYEYNZ type=write size=3301511 2024-09-14T11:01:59.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.824+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~7E0OEL3I9DXE.0 size=1048576 2024-09-14T11:01:59.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.826+0000 7fe3dd11f780 1 > prepared part key=_multipart_VDSOBBVO3QGB.2~7E0OEL3I9DXE.1 size=970719 2024-09-14T11:01:59.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.826+0000 7fe3dd11f780 1 > prepared multipart upload key=VDSOBBVO3QGB upload=7E0OEL3I9DXE tag=NN2SQ62E9FW9 type=write size=3067871 2024-09-14T11:01:59.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.828+0000 7fe3dd11f780 1 < suggested remove operation key=OK5L92EKOOMW tag=CW8E90HJC3NU type=del 2024-09-14T11:01:59.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.830+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=ZKO23Q4NNW5G type=del size=2149056 2024-09-14T11:01:59.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.831+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=BR2P5A60PV6J type=del 2024-09-14T11:01:59.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.832+0000 7fe3dd11f780 1 > prepared operation key=YMGE9GKLSPE6 tag=ALT75EPWCISU type=del size=493341 2024-09-14T11:01:59.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.833+0000 7fe3dd11f780 -1 < failed to complete operation key=KXL3E0PJBNBA tag=K4QJ0R2Q145P type=write size=263888: (22) Invalid argument 2024-09-14T11:01:59.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.835+0000 7fe3dd11f780 1 > prepared operation key=JSEN4QXEMVHS tag=DITDHAWCT3U5 type=del size=2964161 2024-09-14T11:01:59.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.836+0000 7fe3dd11f780 1 < completed delete operation key=JG1RZQD4J2EB tag=I3J7PSB12W1L type=del 2024-09-14T11:01:59.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.837+0000 7fe3dd11f780 1 > prepared operation key=NHKCRGX10WBM tag=VMV9OGRB8KTV type=del size=3635979 2024-09-14T11:01:59.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.838+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~K8WF5JDHW04V.0 size=1048576 2024-09-14T11:01:59.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.839+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~K8WF5JDHW04V.1 size=1048576 2024-09-14T11:01:59.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.840+0000 7fe3dd11f780 1 < completed part key=_multipart_ZTD98WQ6032X.2~K8WF5JDHW04V.2 size=262260 2024-09-14T11:01:59.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.842+0000 7fe3dd11f780 1 < completed multipart upload key=ZTD98WQ6032X upload=K8WF5JDHW04V tag=KWH5TJDHUVE8 type=write size=3407988 2024-09-14T11:01:59.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.844+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~31O3UI7K9DHX.0 size=1048576 2024-09-14T11:01:59.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.845+0000 7fe3dd11f780 1 > prepared part key=_multipart_KXL3E0PJBNBA.2~31O3UI7K9DHX.1 size=1031065 2024-09-14T11:01:59.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.845+0000 7fe3dd11f780 1 > prepared multipart upload key=KXL3E0PJBNBA upload=31O3UI7K9DHX tag=VS5WT08SK6C6 type=write size=3128217 2024-09-14T11:01:59.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.847+0000 7fe3dd11f780 1 < completed delete operation key=QPH41U60044L tag=JY4CA083OG5U type=del 2024-09-14T11:01:59.846 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.848+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=CXZ8OJ5JPJ8V type=write size=751906 2024-09-14T11:01:59.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.850+0000 7fe3dd11f780 1 < canceled operation key=NHKCRGX10WBM tag=3112ZP5UG5AU type=del size=244391 2024-09-14T11:01:59.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.851+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=DTVBEYQ47N9O type=del size=1237035 2024-09-14T11:01:59.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.852+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~PSOF16RMQN3I.0 size=1048576 2024-09-14T11:01:59.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.853+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~PSOF16RMQN3I.1 size=1048576 2024-09-14T11:01:59.852 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.854+0000 7fe3dd11f780 1 < completed part key=_multipart_QPH41U60044L.2~PSOF16RMQN3I.2 size=543714 2024-09-14T11:01:59.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.856+0000 7fe3dd11f780 1 < completed multipart upload key=QPH41U60044L upload=PSOF16RMQN3I tag=WXT03KMYQ6RV type=write size=3689442 2024-09-14T11:01:59.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.858+0000 7fe3dd11f780 1 > prepared operation key=US8KP3YL88TG tag=9FH52BNYGFKG type=del size=3110417 2024-09-14T11:01:59.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.859+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=61OFA2L5VVXU type=del 2024-09-14T11:01:59.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.860+0000 7fe3dd11f780 1 > prepared operation key=K9BP30LHDPA1 tag=Z27HYRGJZD6E type=del size=2650785 2024-09-14T11:01:59.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.862+0000 7fe3dd11f780 1 < suggested remove operation key=A89YQO40BHUS tag=COQL3E6R1RWQ type=write 2024-09-14T11:01:59.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.863+0000 7fe3dd11f780 1 > prepared operation key=PHLQ77OMLI37 tag=MW8KW73CK1YE type=write size=50313 2024-09-14T11:01:59.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.866+0000 7fe3dd11f780 1 < suggested remove operation key=M0DMAQ5LTDR0 tag=MKNFZ7GJ9O5T type=del 2024-09-14T11:01:59.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.867+0000 7fe3dd11f780 1 > prepared operation key=V692HUUJP2RC tag=718KA37SGIY2 type=write size=396012 2024-09-14T11:01:59.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.868+0000 7fe3dd11f780 1 < completed delete operation key=LFKLJAJWQ2J6 tag=3W4FIHODPGXQ type=del 2024-09-14T11:01:59.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.869+0000 7fe3dd11f780 1 > prepared operation key=LDILBET1CMYY tag=DFZ43VE0QOXN type=write size=172207 2024-09-14T11:01:59.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.871+0000 7fe3dd11f780 1 < completed delete operation key=YMGE9GKLSPE6 tag=3Z3MA72YPTFH type=del 2024-09-14T11:01:59.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.872+0000 7fe3dd11f780 1 > prepared operation key=ODDNSHK5YMNO tag=ZQTCL0HHH1WF type=del size=56362 2024-09-14T11:01:59.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.873+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~KP6O0LLF2EO7.0 size=1048576 2024-09-14T11:01:59.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.875+0000 7fe3dd11f780 1 < completed part key=_multipart_6PJ03TAYRUT8.2~KP6O0LLF2EO7.1 size=481172 2024-09-14T11:01:59.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.877+0000 7fe3dd11f780 1 < completed multipart upload key=6PJ03TAYRUT8 upload=KP6O0LLF2EO7 tag=OJ22VGWRR05L type=write size=2578324 2024-09-14T11:01:59.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.878+0000 7fe3dd11f780 1 > prepared operation key=JFLEJGPFLACM tag=NPX0VTLINF76 type=del size=4169810 2024-09-14T11:01:59.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.881+0000 7fe3dd11f780 1 < suggested remove operation key=VDSOBBVO3QGB tag=AMGFQT8HZ5X5 type=del 2024-09-14T11:01:59.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.882+0000 7fe3dd11f780 1 > prepared operation key=ZTD98WQ6032X tag=JXF0Y870DDNH type=del size=3279700 2024-09-14T11:01:59.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.884+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~7E0OEL3I9DXE.0 size=1048576 2024-09-14T11:01:59.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.885+0000 7fe3dd11f780 1 < completed part key=_multipart_VDSOBBVO3QGB.2~7E0OEL3I9DXE.1 size=970719 2024-09-14T11:01:59.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.887+0000 7fe3dd11f780 1 < completed multipart upload key=VDSOBBVO3QGB upload=7E0OEL3I9DXE tag=NN2SQ62E9FW9 type=write size=3067871 2024-09-14T11:01:59.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.888+0000 7fe3dd11f780 1 > prepared operation key=UYZGHGZR74HQ tag=P91Y9YNG7VJZ type=del size=3498271 2024-09-14T11:01:59.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.889+0000 7fe3dd11f780 1 < completed delete operation key=NHKCRGX10WBM tag=ZKO23Q4NNW5G type=del 2024-09-14T11:01:59.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.891+0000 7fe3dd11f780 1 > prepared operation key=MD0OU8IC5PYI tag=GBXABKX3XTMY type=write size=19255 2024-09-14T11:01:59.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.892+0000 7fe3dd11f780 1 < canceled operation key=YMGE9GKLSPE6 tag=ALT75EPWCISU type=del size=493341 2024-09-14T11:01:59.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.894+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~5CCZ7HCKGQTO.0 size=1048576 2024-09-14T11:01:59.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.895+0000 7fe3dd11f780 1 > prepared part key=_multipart_JG1RZQD4J2EB.2~5CCZ7HCKGQTO.1 size=120711 2024-09-14T11:01:59.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:01:59.895+0000 7fe3dd11f780 1 > prepared multipart upload key=JG1RZQD4J2EB upload=5CCZ7HCKGQTO tag=U0AA4QYZVYI2 type=write size=2217863 2024-09-14T11:01:59.893 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] cls_rgw_stats.simulate (8999 ms) 2024-09-14T11:01:59.894 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 1 test from cls_rgw_stats (8999 ms total) 2024-09-14T11:01:59.894 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:01:59.894 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:01:59.976 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 1 test from 1 test suite ran. (10977 ms total) 2024-09-14T11:01:59.976 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 1 test. 2024-09-14T11:01:59.979 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:01:59.979 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:02:00.060 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-14T11:02:00.061 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-14T11:02:00.061 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-14T11:02:00.146 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T11:02:00.146 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-14T11:02:00.147 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:02:01.992 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 31 tests from CmpOmap 2024-09-14T11:02:01.992 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-14T11:02:02.008 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (15 ms) 2024-09-14T11:02:02.008 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-14T11:02:02.011 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (3 ms) 2024-09-14T11:02:02.011 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-14T11:02:02.014 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-14T11:02:02.014 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-14T11:02:02.020 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-14T11:02:02.020 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-14T11:02:02.024 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-14T11:02:02.024 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-14T11:02:02.030 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-14T11:02:02.030 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-14T11:02:02.034 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (4 ms) 2024-09-14T11:02:02.034 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-14T11:02:02.037 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-14T11:02:02.037 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-14T11:02:02.041 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-14T11:02:02.041 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-14T11:02:02.045 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (4 ms) 2024-09-14T11:02:02.045 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-14T11:02:02.046 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-14T11:02:02.046 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-14T11:02:02.046 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (0 ms) 2024-09-14T11:02:02.047 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-14T11:02:02.054 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (8 ms) 2024-09-14T11:02:02.054 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-14T11:02:02.061 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (7 ms) 2024-09-14T11:02:02.061 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-14T11:02:02.067 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (6 ms) 2024-09-14T11:02:02.067 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-14T11:02:02.074 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-14T11:02:02.074 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-14T11:02:02.082 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_str (8 ms) 2024-09-14T11:02:02.082 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-14T11:02:02.090 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-14T11:02:02.091 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-14T11:02:02.093 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (3 ms) 2024-09-14T11:02:02.093 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-14T11:02:02.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-14T11:02:02.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-14T11:02:02.097 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-14T11:02:02.097 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-14T11:02:02.097 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-14T11:02:02.097 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-14T11:02:02.104 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-14T11:02:02.104 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-14T11:02:02.110 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (6 ms) 2024-09-14T11:02:02.110 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-14T11:02:02.117 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (7 ms) 2024-09-14T11:02:02.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-14T11:02:02.127 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (10 ms) 2024-09-14T11:02:02.127 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-14T11:02:02.129 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-14T11:02:02.129 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-14T11:02:02.132 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-14T11:02:02.132 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-14T11:02:02.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-14T11:02:02.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-14T11:02:02.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (0 ms) 2024-09-14T11:02:02.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-14T11:02:02.141 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (8 ms) 2024-09-14T11:02:02.141 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 31 tests from CmpOmap (149 ms total) 2024-09-14T11:02:02.141 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:02:02.141 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:02:02.997 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 31 tests from 1 test suite ran. (2851 ms total) 2024-09-14T11:02:02.998 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 31 tests. 2024-09-14T11:02:03.001 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:02:03.001 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:02:03.047 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-14T11:02:03.048 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-14T11:02:03.048 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-14T11:02:03.099 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T11:02:03.099 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:02:03.099 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:02:03.099 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-14T11:02:03.100 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-14T11:02:06.010 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2911 ms) 2024-09-14T11:02:06.010 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-14T11:02:09.028 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3018 ms) 2024-09-14T11:02:09.028 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-14T11:02:12.048 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.Reserve (3020 ms) 2024-09-14T11:02:12.048 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-14T11:02:15.066 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3017 ms) 2024-09-14T11:02:15.066 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-14T11:02:19.088 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.Commit (4023 ms) 2024-09-14T11:02:19.089 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-14T11:02:22.095 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.Stats (3006 ms) 2024-09-14T11:02:22.095 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-14T11:02:26.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4024 ms) 2024-09-14T11:02:26.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-14T11:02:29.145 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.Abort (3027 ms) 2024-09-14T11:02:29.145 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-14T11:02:32.161 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.ReserveError (3016 ms) 2024-09-14T11:02:32.161 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-14T11:02:35.180 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.CommitError (3019 ms) 2024-09-14T11:02:35.180 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-14T11:02:38.196 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.AbortError (3016 ms) 2024-09-14T11:02:38.196 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-14T11:02:41.213 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3017 ms) 2024-09-14T11:02:41.214 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-14T11:02:44.227 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3014 ms) 2024-09-14T11:02:44.227 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-14T11:02:47.248 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3020 ms) 2024-09-14T11:02:47.248 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-14T11:02:50.262 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3015 ms) 2024-09-14T11:02:50.263 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-14T11:02:53.281 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3019 ms) 2024-09-14T11:02:53.281 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-14T11:02:56.297 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3016 ms) 2024-09-14T11:02:56.297 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-14T11:02:59.320 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.Cleanup (3023 ms) 2024-09-14T11:02:59.320 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-14T11:03:10.349 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11028 ms) 2024-09-14T11:03:10.349 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-14T11:03:14.380 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (4031 ms) 2024-09-14T11:03:14.380 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-14T11:03:27.416 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13036 ms) 2024-09-14T11:03:27.417 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-14T11:03:31.434 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4019 ms) 2024-09-14T11:03:31.434 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-14T11:03:37.462 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (6028 ms) 2024-09-14T11:03:37.463 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-14T11:03:43.240 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5778 ms) 2024-09-14T11:03:43.240 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from TestCls2PCQueue (100141 ms total) 2024-09-14T11:03:43.240 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:03:43.240 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:03:43.240 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 24 tests from 1 test suite ran. (100141 ms total) 2024-09-14T11:03:43.240 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 24 tests. 2024-09-14T11:03:43.243 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:03:43.244 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:03:43.290 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-14T11:03:43.291 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-14T11:03:43.291 DEBUG:teuthology.orchestra.run.smithi002:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-14T11:03:43.348 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:43.348 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:43.349 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:03:43.349 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:03:45.251 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 4 tests from ClsAccount 2024-09-14T11:03:45.251 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsAccount.add 2024-09-14T11:03:45.274 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsAccount.add (23 ms) 2024-09-14T11:03:45.275 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsAccount.get 2024-09-14T11:03:45.279 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsAccount.get (5 ms) 2024-09-14T11:03:45.279 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsAccount.rm 2024-09-14T11:03:45.635 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsAccount.rm (355 ms) 2024-09-14T11:03:45.635 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] ClsAccount.list 2024-09-14T11:03:45.657 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] ClsAccount.list (23 ms) 2024-09-14T11:03:45.657 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 4 tests from ClsAccount (406 ms total) 2024-09-14T11:03:45.657 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:03:45.657 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:03:46.256 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 4 tests from 1 test suite ran. (2908 ms total) 2024-09-14T11:03:46.256 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 4 tests. 2024-09-14T11:03:46.259 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:03:46.260 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:03:46.305 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-14T11:03:46.306 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-14T11:03:46.307 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-14T11:03:46.363 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:46.363 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:46.364 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-14T11:03:46.364 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:03:48.268 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 6 tests from rgw_gc_log 2024-09-14T11:03:48.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-14T11:03:48.285 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] rgw_gc_log.init_existing_queue (17 ms) 2024-09-14T11:03:48.285 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-14T11:03:48.289 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] rgw_gc_log.init_existing_omap (4 ms) 2024-09-14T11:03:48.289 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-14T11:03:48.292 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (3 ms) 2024-09-14T11:03:48.292 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-14T11:03:48.293 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-14T11:03:48.294 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-14T11:03:48.297 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-14T11:03:48.297 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-14T11:03:48.298 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-14T11:03:48.299 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 6 tests from rgw_gc_log (30 ms total) 2024-09-14T11:03:48.299 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:03:48.299 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:03:49.275 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 6 tests from 1 test suite ran. (2912 ms total) 2024-09-14T11:03:49.276 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 6 tests. 2024-09-14T11:03:49.279 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:03:49.280 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:03:49.325 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-14T11:03:49.326 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-14T11:03:49.326 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-14T11:03:49.387 INFO:tasks.workunit.client.0.smithi002.stdout:Running main() from gmock_main.cc 2024-09-14T11:03:49.387 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 4 tests from TestRGWObj 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestRGWObj.underscore 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns= i= 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns= i= 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.388 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns= i= 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.389 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.390 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.391 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.392 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.392 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.392 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.393 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.393 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.393 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.393 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.393 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.393 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.393 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.394 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.395 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.395 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.395 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.395 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.395 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.395 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.395 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns=ns i= 2024-09-14T11:03:49.396 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns=ns i= 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns=ns i= 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.397 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.398 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.399 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.400 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.401 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.404 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.404 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.404 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.404 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.405 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.405 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.405 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.405 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.405 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.405 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.406 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.407 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns= i=v1 2024-09-14T11:03:49.407 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.407 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.407 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns= i=v1 2024-09-14T11:03:49.407 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.407 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.408 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns= i=v1 2024-09-14T11:03:49.408 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.408 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.408 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.408 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.408 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.409 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.409 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.409 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.409 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.409 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.409 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.410 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.410 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.410 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.410 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.410 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.410 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.411 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.412 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.413 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.414 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.414 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.414 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.414 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.414 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.415 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.415 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.415 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.415 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.415 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.415 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.416 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.416 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.416 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.416 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.416 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.416 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.416 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: _obj[v1] 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: _obj ns=ns i=v1 2024-09-14T11:03:49.417 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.418 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.419 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.420 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.421 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_obj", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.422 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns= i= 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns= i= 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns= i= 2024-09-14T11:03:49.423 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.424 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.425 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.426 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.427 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.428 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns=ns i= 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns=ns i= 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns=ns i= 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.429 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.430 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.431 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.432 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.433 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.434 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns= i=v1 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns= i=v1 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns= i=v1 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.435 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.436 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.437 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.438 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.439 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.440 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:parsed: obj[v1] 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:stripped: obj ns=ns i=v1 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout: "obj1": { 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.441 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.442 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "obj2": { 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.443 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3": { 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.444 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "obj3-2": { 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.445 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "obj", 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "v1", 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.446 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.447 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.448 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker_myobj", 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.449 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.450 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.451 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.452 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.453 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker_myobj", 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.454 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.455 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.456 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.457 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.458 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.459 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.460 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.461 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.462 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.463 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.464 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.465 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.466 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.467 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.468 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.469 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.470 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.471 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.472 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.473 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.474 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.475 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.476 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.477 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.478 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.479 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.480 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.481 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.482 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.483 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj", 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.484 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.485 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.486 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.487 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj", 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.488 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.489 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.490 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.491 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.492 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.493 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.494 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.495 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.496 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.497 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.498 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.499 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.500 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.501 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.502 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.503 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.504 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.505 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.506 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.507 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.508 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.509 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.510 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.511 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.512 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.513 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.514 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.515 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.516 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.517 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.518 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj_", 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.519 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.520 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.521 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.522 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj_", 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.523 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.524 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.525 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.526 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.527 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.528 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.529 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.530 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.531 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.532 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.533 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.534 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.535 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.536 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.537 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.538 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.539 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.540 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.541 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.542 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.543 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": "default-placement.data", 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.544 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "test", 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": "", 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": "" 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.545 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.546 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "obj": { 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.547 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.548 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.549 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-14T11:03:49.550 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker_myobj", 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.551 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker_myobj 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.552 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker_myobj", 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.553 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker_myobj 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.554 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.555 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.556 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.556 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.556 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.556 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.556 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__ns_myobj 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns_myobj", 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.557 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.558 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.559 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.560 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst_myobj", 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.561 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.562 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.563 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.564 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.565 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst_myobj", 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.566 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "myobj", 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.567 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj", 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.568 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker___myobj 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.569 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj", 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.570 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker___myobj 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.571 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.572 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__ns__myobj 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.573 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj", 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.574 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.575 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.576 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.577 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj", 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj" 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.578 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:03:49.579 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.580 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj", 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.581 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.582 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj", 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj_", 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.583 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.584 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker___myobj_ 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker___myobj_", 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.585 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.586 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker___myobj_ 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.587 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.588 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.589 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns__myobj_", 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.590 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "", 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:03:49.591 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.592 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.593 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__:inst__myobj_", 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "marker__myobj_" 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.594 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "" 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj": { 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:03:49.595 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj": { 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.596 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "raw_obj2": { 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "pool": ".data-pool", 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: "loc": "" 2024-09-14T11:03:49.597 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "new_obj2": { 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket": { 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "ebtest", 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "marker": "marker", 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_id": "bucket-id", 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "tenant": "", 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "explicit_placement": { 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "data_pool": ".data-pool", 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "data_extra_pool": "", 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: "index_pool": ".index-pool" 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.598 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout: "key": { 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout: "name": "_myobj_", 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout: "instance": "inst", 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout: "ns": "ns" 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-14T11:03:49.599 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 4 tests. 2024-09-14T11:03:49.600 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:03:49.600 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:03:49.642 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-14T11:03:49.643 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-14T11:03:49.643 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-14T11:03:49.761 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:49.761 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:49.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.811+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:49.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.812+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:49.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.812+0000 7fc102723800 20 realm 2024-09-14T11:03:49.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.812+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:49.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.813+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:49.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.813+0000 7fc102723800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:03:49.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.813+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:49.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.813+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:49.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.813+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:49.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.814+0000 7fc102723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:49.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.814+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:49.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.814+0000 7fc102723800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:03:49.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:49.814+0000 7fc102723800 20 searching for the correct realm 2024-09-14T11:03:50.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.019+0000 7fc0fdb32640 0 -- 172.21.15.2:0/1024939193 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fc0f0080070 msgr2=0x7fc0f0099050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:03:50.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.024+0000 7fc0fe333640 0 -- 172.21.15.2:0/1024939193 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fc0e80b4910 msgr2=0x7fc0e8064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:03:50.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:03:50.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:03:50.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:03:50.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:03:50.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:03:50.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:03:50.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:50.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.232+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:03:50.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:03:50.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 zone default found 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 4 Realm: () 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 zonegroup default 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.233+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.234+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.234+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.234+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.234+0000 7fc102723800 20 started sync module instance, tier type = 2024-09-14T11:03:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.234+0000 7fc102723800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:03:50.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.245+0000 7fc102723800 20 add_watcher() i=0 2024-09-14T11:03:50.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.245+0000 7fc102723800 20 add_watcher() i=1 2024-09-14T11:03:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.245+0000 7fc102723800 20 add_watcher() i=2 2024-09-14T11:03:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.245+0000 7fc102723800 20 add_watcher() i=3 2024-09-14T11:03:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.245+0000 7fc102723800 20 add_watcher() i=4 2024-09-14T11:03:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.245+0000 7fc102723800 20 add_watcher() i=5 2024-09-14T11:03:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.245+0000 7fc102723800 20 add_watcher() i=6 2024-09-14T11:03:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.246+0000 7fc102723800 20 add_watcher() i=7 2024-09-14T11:03:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.246+0000 7fc102723800 2 all 8 watchers are set, enabling cache 2024-09-14T11:03:50.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.249+0000 7fbfb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:50.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.249+0000 7fc102723800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:03:50.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.249+0000 7fc102723800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:03:50.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.249+0000 7fc102723800 5 note: GC not initialized 2024-09-14T11:03:50.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.250+0000 7fbf2f7fe640 20 reqs_thread_entry: start 2024-09-14T11:03:50.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.250+0000 7fc102723800 20 init_complete bucket index max shards: 1 2024-09-14T11:03:50.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.250+0000 7fc102723800 20 Filter name: none 2024-09-14T11:03:50.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.250+0000 7fbf2d7fa640 20 reqs_thread_entry: start 2024-09-14T11:03:50.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.250+0000 7fc102723800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-14T11:03:50.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.250+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:50.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 10 cache get: name=default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= : miss 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.251+0000 7fc102723800 20 rados->read ofs=0 len=0 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.252+0000 7fc102723800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.252+0000 7fc102723800 10 cache put: name=default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= info.flags=0x0 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.252+0000 7fc102723800 10 adding default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= to cache LRU end 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.252+0000 7fc102723800 10 cache get: name=default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= : hit (negative entry) 2024-09-14T11:03:50.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.252+0000 7fc102723800 10 cache get: name=default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= : hit (negative entry) 2024-09-14T11:03:50.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.253+0000 7fc102723800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:03:50.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.253+0000 7fc102723800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:03:50.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.253+0000 7fc102723800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-14T11:03:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.254+0000 7fbfe1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824001 cookie 94604754211888 notifier 5303 bl.length()=697 2024-09-14T11:03:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.254+0000 7fbfe1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-14T11:03:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.254+0000 7fbfe1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-14T11:03:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.255+0000 7fc102723800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:03:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.255+0000 7fc102723800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:03:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.255+0000 7fc102723800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-14T11:03:50.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.256+0000 7fbfe1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824000 cookie 94604754203440 notifier 5303 bl.length()=194 2024-09-14T11:03:50.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.256+0000 7fbfe1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-14T11:03:50.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.256+0000 7fbfe1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-14T11:03:50.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.258+0000 7fc102723800 10 cache put: name=default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= info.flags=0x7 2024-09-14T11:03:50.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.258+0000 7fc102723800 10 moving default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= to cache LRU end 2024-09-14T11:03:50.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.258+0000 7fc102723800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:eX8II3bMTqiUAEuaEKjws3wKBFE=, ofs0, ns] 2024-09-14T11:03:50.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.258+0000 7fbfe1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824002 cookie 94604754214528 notifier 5303 bl.length()=203 2024-09-14T11:03:50.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.258+0000 7fbfe1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= info.flags=0x7 2024-09-14T11:03:50.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.258+0000 7fbfe1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+eX8II3bMTqiUAEuaEKjws3wKBFE= to cache LRU end 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "user_id": "ceph-test-librgw-file", 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "display_name": "librgw test user", 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "email": "librgw@example.com", 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "suspended": 0, 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "subusers": [], 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "keys": [ 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: { 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "user": "ceph-test-librgw-file", 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "access_key": "eX8II3bMTqiUAEuaEKjws3wKBFE=", 2024-09-14T11:03:50.257 INFO:tasks.workunit.client.0.smithi002.stdout: "secret_key": "17WIpI/XpdDAlYNbcqpfoWJMZGMMJ4UxArEswPPHt4+b5/ZGBmbdVA==", 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "active": true, 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "create_date": "2024-09-14T11:03:50.252885Z" 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: ], 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "swift_keys": [], 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "caps": [], 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "default_placement": "", 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "placement_tags": [], 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_quota": { 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "enabled": false, 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:03:50.258 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size": -1, 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "max_objects": -1 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "user_quota": { 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "enabled": false, 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size": -1, 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: "max_objects": -1 2024-09-14T11:03:50.259 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "type": "rgw", 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "account_id": "", 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "path": "/", 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "create_date": "2024-09-14T11:03:50.252861Z", 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "tags": [], 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: "group_ids": [] 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:03:50.260 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:03:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.260+0000 7fbfb4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:03:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.262+0000 7fc102723800 20 remove_watcher() i=0 2024-09-14T11:03:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.262+0000 7fc102723800 2 removed watcher, disabling cache 2024-09-14T11:03:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.263+0000 7fc102723800 20 remove_watcher() i=1 2024-09-14T11:03:50.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.265+0000 7fc102723800 20 remove_watcher() i=2 2024-09-14T11:03:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.266+0000 7fc102723800 20 remove_watcher() i=3 2024-09-14T11:03:50.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.267+0000 7fc102723800 20 remove_watcher() i=4 2024-09-14T11:03:50.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.268+0000 7fc102723800 20 remove_watcher() i=5 2024-09-14T11:03:50.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.270+0000 7fc102723800 20 remove_watcher() i=6 2024-09-14T11:03:50.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:50.271+0000 7fc102723800 20 remove_watcher() i=7 2024-09-14T11:03:50.282 INFO:tasks.workunit.client.0.smithi002.stdout:phase 1.1 2024-09-14T11:03:50.305 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:03:50.305 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:03:50.306 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:03:50.306 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:03:50.317 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:03:50.317 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:03:50.703 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (398 ms) 2024-09-14T11:03:50.704 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:03:50.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:03:50.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:03:50.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:03:50.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:03:50.712 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-14T11:03:50.717 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/f1 2024-09-14T11:03:50.719 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/f2 2024-09-14T11:03:50.723 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/f1 2024-09-14T11:03:50.725 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-14T11:03:50.728 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-14T11:03:50.730 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-14T11:03:50.733 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-14T11:03:50.736 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-14T11:03:50.739 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-14T11:03:50.741 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-14T11:03:50.744 INFO:tasks.workunit.client.0.smithi002.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-14T11:03:50.747 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETUP_HIER1 (43 ms) 2024-09-14T11:03:50.747 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:03:50.838 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETUP_DIRS1 (90 ms) 2024-09-14T11:03:50.838 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:03:50.838 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:03:50.838 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:03:50.852 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (15 ms) 2024-09-14T11:03:50.853 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:03:50.887 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (35 ms) 2024-09-14T11:03:50.888 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:03:50.888 INFO:tasks.workunit.client.0.smithi002.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-14T11:03:50.893 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (6 ms) 2024-09-14T11:03:50.893 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:03:50.893 INFO:tasks.workunit.client.0.smithi002.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (6 ms) 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:03:50.899 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:03:50.900 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:03:50.901 INFO:tasks.workunit.client.0.smithi002.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:03:50.901 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:03:50.901 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:03:50.901 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:03:50.902 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:03:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:03:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:03:50.902 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:03:50.902 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:03:50.903 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:03:50.903 INFO:tasks.workunit.client.0.smithi002.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:03:50.903 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:03:50.904 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:03:50.904 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:03:50.905 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:03:50.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-14T11:03:50.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READF_SETUP1 (180 ms) 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:03:51.086 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:03:51.087 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:03:51.093 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:03:51.094 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:03:51.096 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:03:51.099 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:03:51.101 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:03:51.101 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:03:51.102 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:03:51.102 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:03:51.103 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:03:51.104 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:03:51.105 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:03:51.107 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:03:51.107 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:03:51.107 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:03:51.108 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:03:51.108 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.HIER1 (21 ms) 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:03:51.109 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:03:51.110 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:03:51.110 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:03:51.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:51.108+0000 7f3c11d528c0 -1 shutting down 2024-09-14T11:03:51.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:03:51.109+0000 7f3aeba91640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62740, si_uid : 1000, si_addr0x3e80000f514, si_status0 2024-09-14T11:04:21.063 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (29957 ms) 2024-09-14T11:04:21.064 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from LibRGW (30758 ms total) 2024-09-14T11:04:21.064 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:04:21.064 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:21.064 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 24 tests from 1 test suite ran. (30758 ms total) 2024-09-14T11:04:21.064 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 24 tests. 2024-09-14T11:04:21.070 INFO:tasks.workunit.client.0.smithi002.stdout:phase 1.2 2024-09-14T11:04:21.096 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:04:21.096 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:21.096 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:04:21.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:04:21.104 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:21.105 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:21.499 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (403 ms) 2024-09-14T11:04:21.500 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:04:21.501 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:04:21.501 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:04:21.501 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:04:21.501 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:04:21.501 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:04:21.502 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:04:21.503 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:04:21.504 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:04:21.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:04:21.502+0000 7f0f533338c0 -1 shutting down 2024-09-14T11:04:21.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:04:21.503+0000 7f0e2b301640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63359, si_uid : 1000, si_addr0x3e80000f77f, si_status0 2024-09-14T11:04:51.809 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30309 ms) 2024-09-14T11:04:51.810 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from LibRGW (30713 ms total) 2024-09-14T11:04:51.810 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:04:51.810 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:04:51.810 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 24 tests from 1 test suite ran. (30713 ms total) 2024-09-14T11:04:51.810 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 24 tests. 2024-09-14T11:04:51.815 INFO:tasks.workunit.client.0.smithi002.stdout:phase 1.3 2024-09-14T11:04:51.841 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-14T11:04:51.841 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:04:51.841 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from LibRGW 2024-09-14T11:04:51.841 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:04:51.851 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:04:51.851 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:04:52.035 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (195 ms) 2024-09-14T11:04:52.036 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-14T11:04:52.036 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-14T11:04:52.036 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:04:52.036 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:04:52.036 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-14T11:04:52.040 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETUP_HIER1 (4 ms) 2024-09-14T11:04:52.040 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-14T11:04:52.095 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETUP_DIRS1 (55 ms) 2024-09-14T11:04:52.095 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SETATTR 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout:scanning objects in /bdirs1/dir_0 2024-09-14T11:04:52.096 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout:scanning objects in /bdirs1/dir_1 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout:scanning objects in /bdirs1/dir_2 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-14T11:04:52.097 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:read back objects in /bdirs1/dir_0 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_0/sfile_0 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_0/sfile_1 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:read back objects in /bdirs1/dir_1 2024-09-14T11:04:52.098 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_1/sfile_0 2024-09-14T11:04:52.099 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:04:52.099 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_1/sfile_1 2024-09-14T11:04:52.100 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:04:52.100 INFO:tasks.workunit.client.0.smithi002.stdout:read back objects in /bdirs1/dir_2 2024-09-14T11:04:52.100 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_2/sfile_0 2024-09-14T11:04:52.101 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-14T11:04:52.101 INFO:tasks.workunit.client.0.smithi002.stdout:reading 0,256 dir_2/sfile_1 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READ_DIRS1 (6 ms) 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-14T11:04:52.102 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_0 type: DIR refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_0 type: FILE refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sdir_1 type: DIR refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:release sfile_1 type: FILE refs: 2 2024-09-14T11:04:52.103 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-14T11:04:52.104 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.HIER1 2024-09-14T11:04:52.108 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-14T11:04:52.108 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-14T11:04:52.111 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-14T11:04:52.112 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-14T11:04:52.115 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:04:52.115 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-14T11:04:52.116 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-14T11:04:52.117 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-14T11:04:52.117 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:04:52.117 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-14T11:04:52.118 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot/foo (foo): DIR 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:/nfsroot (nfsroot): DIR 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.HIER1 (18 ms) 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:04:52.120 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:04:52.121 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:04:52.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:04:52.122+0000 7f673cf238c0 -1 shutting down 2024-09-14T11:04:52.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:04:52.123+0000 7f6614dac640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63978, si_uid : 1000, si_addr0x3e80000f9ea, si_status0 2024-09-14T11:05:22.458 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30338 ms) 2024-09-14T11:05:22.458 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 24 tests from LibRGW (30617 ms total) 2024-09-14T11:05:22.459 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:05:22.459 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:05:22.459 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 24 tests from 1 test suite ran. (30617 ms total) 2024-09-14T11:05:22.459 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 24 tests. 2024-09-14T11:05:22.464 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2.1 2024-09-14T11:05:22.491 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:05:22.491 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:05:22.491 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:05:22.491 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:05:22.501 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:22.501 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:22.897 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (405 ms) 2024-09-14T11:05:22.897 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:05:22.897 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:05:22.897 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:05:22.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2024-09-14T11:05:22.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:05:22.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:05:22.905 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:05:22.912 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave0 2024-09-14T11:05:22.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave1 2024-09-14T11:05:22.926 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave2 2024-09-14T11:05:22.933 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave3 2024-09-14T11:05:22.940 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave4 2024-09-14T11:05:22.947 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave5 2024-09-14T11:05:22.954 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave6 2024-09-14T11:05:22.961 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave7 2024-09-14T11:05:22.967 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave8 2024-09-14T11:05:22.974 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave9 2024-09-14T11:05:22.974 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (70 ms) 2024-09-14T11:05:22.974 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:05:23.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (143 ms) 2024-09-14T11:05:23.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:05:23.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:05:23.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:05:23.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:05:23.118 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:05:23.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:05:23.119+0000 7f7b133518c0 -1 shutting down 2024-09-14T11:05:23.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:05:23.120+0000 7f79eb34c640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64597, si_uid : 1000, si_addr0x3e80000fc55, si_status0 2024-09-14T11:05:53.128 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30010 ms) 2024-09-14T11:05:53.129 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 9 tests from LibRGW (30636 ms total) 2024-09-14T11:05:53.129 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:05:53.129 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:05:53.129 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 9 tests from 1 test suite ran. (30636 ms total) 2024-09-14T11:05:53.129 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 9 tests. 2024-09-14T11:05:53.134 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2.2 2024-09-14T11:05:53.160 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-14T11:05:53.160 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:05:53.160 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 9 tests from LibRGW 2024-09-14T11:05:53.160 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:05:53.170 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:05:53.170 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:05:53.762 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (602 ms) 2024-09-14T11:05:53.762 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:05:53.762 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-14T11:05:53.763 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:05:53.763 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:05:53.763 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:05:53.782 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET (20 ms) 2024-09-14T11:05:53.782 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-14T11:05:53.789 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave0 2024-09-14T11:05:53.797 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave1 2024-09-14T11:05:53.803 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave2 2024-09-14T11:05:53.810 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave3 2024-09-14T11:05:53.817 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave4 2024-09-14T11:05:53.823 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave5 2024-09-14T11:05:53.831 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave6 2024-09-14T11:05:53.837 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave7 2024-09-14T11:05:53.844 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave8 2024-09-14T11:05:53.851 INFO:tasks.workunit.client.0.smithi002.stdout:created: sorrydave9 2024-09-14T11:05:53.851 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (69 ms) 2024-09-14T11:05:53.851 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-14T11:05:53.994 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (142 ms) 2024-09-14T11:05:53.994 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:05:53.994 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:05:53.994 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:05:53.994 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:05:53.994 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:05:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:05:53.995+0000 7f6b9323a8c0 -1 shutting down 2024-09-14T11:05:53.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:05:53.996+0000 7f6a6cf77640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65216, si_uid : 1000, si_addr0x3e80000fec0, si_status0 2024-09-14T11:06:24.130 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30135 ms) 2024-09-14T11:06:24.130 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 9 tests from LibRGW (30969 ms total) 2024-09-14T11:06:24.130 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:06:24.130 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:24.130 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 9 tests from 1 test suite ran. (30969 ms total) 2024-09-14T11:06:24.130 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 9 tests. 2024-09-14T11:06:24.136 INFO:tasks.workunit.client.0.smithi002.stdout:phase 3.1 2024-09-14T11:06:24.467 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:06:24.467 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:06:24.467 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:06:24.467 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:06:24.476 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:24.476 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:24.654 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (188 ms) 2024-09-14T11:06:24.654 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:06:24.655 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:06:24.655 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:06:24.662 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET (7 ms) 2024-09-14T11:06:24.662 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:06:24.665 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:06:24.665 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:06:24.667 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-14T11:06:24.667 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:06:24.722 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LARGE1 (55 ms) 2024-09-14T11:06:24.723 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LARGE2 (46 ms) 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:06:24.769 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:06:24.770 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:06:24.770 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:06:24.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:06:24.770+0000 7f623da408c0 -1 shutting down 2024-09-14T11:06:24.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:06:24.772+0000 7f611777f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65836, si_uid : 1000, si_addr0x3e80001012c, si_status0 2024-09-14T11:06:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30192 ms) 2024-09-14T11:06:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 13 tests from LibRGW (30494 ms total) 2024-09-14T11:06:54.961 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:06:54.961 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:06:54.962 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 13 tests from 1 test suite ran. (30494 ms total) 2024-09-14T11:06:54.962 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 13 tests. 2024-09-14T11:06:54.968 INFO:tasks.workunit.client.0.smithi002.stdout:phase 3.2 2024-09-14T11:06:55.299 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-14T11:06:55.299 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:06:55.299 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 13 tests from LibRGW 2024-09-14T11:06:55.299 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:06:55.307 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:06:55.307 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:06:55.689 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (389 ms) 2024-09-14T11:06:55.689 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:06:55.689 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:06:55.689 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:06:55.689 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:06:55.689 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:06:55.693 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:06:55.693 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:06:55.697 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-14T11:06:55.697 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LARGE1 2024-09-14T11:06:55.754 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LARGE1 (58 ms) 2024-09-14T11:06:55.754 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LARGE2 2024-09-14T11:06:55.754 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-14T11:06:55.754 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:06:55.754 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:06:55.754 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:06:55.758 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-14T11:06:55.758 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:06:55.774 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET (15 ms) 2024-09-14T11:06:55.774 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:06:55.774 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:06:55.774 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:06:55.774 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:06:55.775 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:06:55.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:06:55.776+0000 7f199152e8c0 -1 shutting down 2024-09-14T11:06:55.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:06:55.777+0000 7f186b26d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66457, si_uid : 1000, si_addr0x3e800010399, si_status0 2024-09-14T11:07:25.750 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (29976 ms) 2024-09-14T11:07:25.750 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 13 tests from LibRGW (30450 ms total) 2024-09-14T11:07:25.750 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:07:25.750 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:07:25.750 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 13 tests from 1 test suite ran. (30450 ms total) 2024-09-14T11:07:25.751 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 13 tests. 2024-09-14T11:07:25.757 INFO:tasks.workunit.client.0.smithi002.stdout:phase 4.1 2024-09-14T11:07:25.786 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:07:25.786 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:07:25.786 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:07:25.786 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:07:25.787 INFO:tasks.workunit.client.0.smithi002.stdout:read i1: 64001 2024-09-14T11:07:25.787 INFO:tasks.workunit.client.0.smithi002.stdout:read s1: blunderbuss 2024-09-14T11:07:25.787 INFO:tasks.workunit.client.0.smithi002.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:07:25.787 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:07:25.798 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:25.798 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:26.399 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (612 ms) 2024-09-14T11:07:26.399 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:07:26.399 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:07:26.400 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:07:26.414 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-14T11:07:26.415 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:07:26.917 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_0 2024-09-14T11:07:26.917 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_1 2024-09-14T11:07:26.917 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_2 2024-09-14T11:07:26.917 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_3 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_4 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_5 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_6 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_7 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_8 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_9 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_10 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_11 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_12 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_13 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_14 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_15 2024-09-14T11:07:26.918 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_16 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_17 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_18 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_19 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_20 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_21 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_22 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_23 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_24 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_25 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_26 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_27 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_28 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_29 2024-09-14T11:07:26.919 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_30 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_31 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_32 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_33 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_34 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_35 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_36 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_37 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_38 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_39 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_40 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_41 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_42 2024-09-14T11:07:26.920 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_43 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_44 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_45 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_46 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_47 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_48 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_49 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_50 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_51 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_52 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_53 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_54 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_55 2024-09-14T11:07:26.921 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_56 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_57 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_58 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_59 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_60 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_61 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_62 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_63 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_64 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_65 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_66 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_67 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_68 2024-09-14T11:07:26.922 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_69 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_70 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_71 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_72 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_73 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_74 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_75 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_76 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_77 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_78 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_79 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_80 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_81 2024-09-14T11:07:26.923 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_82 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_83 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_84 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_85 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_86 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_87 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_88 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_89 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_90 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_91 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_92 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_93 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_94 2024-09-14T11:07:26.924 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_95 2024-09-14T11:07:26.925 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_96 2024-09-14T11:07:26.925 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_97 2024-09-14T11:07:26.925 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_98 2024-09-14T11:07:26.925 INFO:tasks.workunit.client.0.smithi002.stdout:created: dmarker:f_99 2024-09-14T11:07:26.925 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (503 ms) 2024-09-14T11:07:26.925 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:07:26.926 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:07:26.927 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:07:26.928 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:07:26.929 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:07:26.930 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:07:26.931 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:07:26.932 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:07:26.933 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_READDIR (2 ms) 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:07:26.934 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:07:26.935 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:07:26.936 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:07:26.937 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:07:26.938 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:07:26.938 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:07:26.938 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:07:26.938 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:07:26.938 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:07:26.938 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:07:26.938 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:07:26.939 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:07:26.940 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:07:26.941 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:07:26.942 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:07:26.943 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:07:26.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:07:26.924+0000 7f559f91f8c0 -1 shutting down 2024-09-14T11:07:26.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:07:26.925+0000 7f5476c31640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67076, si_uid : 1000, si_addr0x3e800010604, si_status0 2024-09-14T11:07:56.689 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (29766 ms) 2024-09-14T11:07:56.689 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 11 tests from LibRGW (30902 ms total) 2024-09-14T11:07:56.689 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:07:56.689 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:07:56.690 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 11 tests from 1 test suite ran. (30902 ms total) 2024-09-14T11:07:56.690 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 11 tests. 2024-09-14T11:07:56.695 INFO:tasks.workunit.client.0.smithi002.stdout:phase 4.2 2024-09-14T11:07:56.722 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-14T11:07:56.723 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:07:56.723 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 11 tests from LibRGW 2024-09-14T11:07:56.723 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.TVAR 2024-09-14T11:07:56.723 INFO:tasks.workunit.client.0.smithi002.stdout:read i1: 64001 2024-09-14T11:07:56.723 INFO:tasks.workunit.client.0.smithi002.stdout:read s1: blunderbuss 2024-09-14T11:07:56.723 INFO:tasks.workunit.client.0.smithi002.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-14T11:07:56.723 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:07:56.731 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:07:56.731 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:07:57.123 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (401 ms) 2024-09-14T11:07:57.123 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:07:57.124 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:07:57.124 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-14T11:07:57.132 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (8 ms) 2024-09-14T11:07:57.132 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-14T11:07:57.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-14T11:07:57.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-14T11:07:57.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-14T11:07:57.133 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-14T11:07:57.135 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-14T11:07:57.136 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-14T11:07:57.137 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-14T11:07:57.138 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-14T11:07:57.139 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-14T11:07:57.140 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-14T11:07:57.141 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-14T11:07:57.142 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER2_READDIR (3 ms) 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:07:57.143 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:07:57.144 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:07:57.144 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:07:57.144 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:07:57.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:07:57.136+0000 7fada791f8c0 -1 shutting down 2024-09-14T11:07:57.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:07:57.137+0000 7fac7ec27640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67695, si_uid : 1000, si_addr0x3e80001086f, si_status0 2024-09-14T11:08:27.450 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30314 ms) 2024-09-14T11:08:27.450 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 11 tests from LibRGW (30727 ms total) 2024-09-14T11:08:27.450 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:08:27.450 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:08:27.450 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 11 tests from 1 test suite ran. (30727 ms total) 2024-09-14T11:08:27.450 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 11 tests. 2024-09-14T11:08:27.455 INFO:tasks.workunit.client.0.smithi002.stdout:phase 5.1 2024-09-14T11:08:27.490 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:08:27.490 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:08:27.490 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:08:27.490 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:08:27.501 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:27.501 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (194 ms) 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:08:27.685 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:08:27.686 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET (8 ms) 2024-09-14T11:08:27.693 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (3 ms) 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:08:27.696 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (1 ms) 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:08:27.698 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.PUT_OBJECT (5 ms) 2024-09-14T11:08:27.702 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:08:27.704 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.GET_OBJECT (1 ms) 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:08:27.705 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:08:27.706+0000 7ff21e5308c0 -1 shutting down 2024-09-14T11:08:27.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:08:27.707+0000 7ff0f640e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68314, si_uid : 1000, si_addr0x3e800010ada, si_status0 2024-09-14T11:08:57.826 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30122 ms) 2024-09-14T11:08:57.826 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 19 tests from LibRGW (30335 ms total) 2024-09-14T11:08:57.826 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:08:57.826 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:08:57.826 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 19 tests from 1 test suite ran. (30335 ms total) 2024-09-14T11:08:57.826 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 19 tests. 2024-09-14T11:08:57.832 INFO:tasks.workunit.client.0.smithi002.stdout:phase 5.2 2024-09-14T11:08:57.866 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-14T11:08:57.866 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:08:57.866 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 19 tests from LibRGW 2024-09-14T11:08:57.866 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:08:57.874 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:08:57.874 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:08:58.262 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (396 ms) 2024-09-14T11:08:58.262 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:08:58.263 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:08:58.263 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-14T11:08:58.263 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-14T11:08:58.263 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-14T11:08:58.268 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.WRITEV 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READV 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-14T11:08:58.269 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-14T11:08:58.272 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-14T11:08:58.272 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-14T11:08:58.288 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.DELETE_BUCKET (16 ms) 2024-09-14T11:08:58.289 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:08:58.289 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:08:58.289 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:08:58.289 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:08:58.289 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:08:58.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:08:58.290+0000 7fcd5793c8c0 -1 shutting down 2024-09-14T11:08:58.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:08:58.292+0000 7fcc2f90f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68933, si_uid : 1000, si_addr0x3e800010d45, si_status0 2024-09-14T11:09:29.418 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (31129 ms) 2024-09-14T11:09:29.418 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 19 tests from LibRGW (31551 ms total) 2024-09-14T11:09:29.418 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:09:29.418 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:09:29.418 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 19 tests from 1 test suite ran. (31551 ms total) 2024-09-14T11:09:29.418 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 19 tests. 2024-09-14T11:09:29.424 INFO:tasks.workunit.client.0.smithi002.stdout:phase 6.1 2024-09-14T11:09:29.450 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-14T11:09:29.450 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment set-up. 2024-09-14T11:09:29.450 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 10 tests from LibRGW 2024-09-14T11:09:29.450 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.INIT 2024-09-14T11:09:29.457 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:09:29.457 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.INIT (399 ms) 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.MOUNT 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-14T11:09:29.849 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-14T11:09:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CREATE_BUCKETS (15 ms) 2024-09-14T11:09:29.865 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-14T11:09:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (6 ms) 2024-09-14T11:09:29.870 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-14T11:09:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.TOPDIR_RENAME (17 ms) 2024-09-14T11:09:29.889 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-14T11:09:29.910 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SUBDIR_RENAME (23 ms) 2024-09-14T11:09:29.910 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-14T11:09:29.932 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (21 ms) 2024-09-14T11:09:29.932 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-14T11:09:29.932 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-14T11:09:29.932 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-14T11:09:29.932 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-14T11:09:29.932 INFO:tasks.workunit.client.0.smithi002.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-14T11:09:29.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:09:29.932+0000 7ff9c2cc18c0 -1 shutting down 2024-09-14T11:09:29.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:09:29.933+0000 7ff899cc7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69552, si_uid : 1000, si_addr0x3e800010fb0, si_status0 2024-09-14T11:10:00.197 INFO:tasks.workunit.client.0.smithi002.stdout:[ OK ] LibRGW.SHUTDOWN (30265 ms) 2024-09-14T11:10:00.197 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] 10 tests from LibRGW (30747 ms total) 2024-09-14T11:10:00.197 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:10:00.197 INFO:tasks.workunit.client.0.smithi002.stdout:[----------] Global test environment tear-down 2024-09-14T11:10:00.197 INFO:tasks.workunit.client.0.smithi002.stdout:[==========] 10 tests from 1 test suite ran. (30747 ms total) 2024-09-14T11:10:00.197 INFO:tasks.workunit.client.0.smithi002.stdout:[ PASSED ] 10 tests. 2024-09-14T11:10:00.204 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:10:00.204 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:10:00.250 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-14T11:10:00.251 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-14T11:10:00.252 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-14T11:10:00.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -z ']' 2024-09-14T11:10:00.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:10:00.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:10:00.288 INFO:tasks.workunit.client.0.smithi002.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:10:00.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:10:00.289 INFO:tasks.workunit.client.0.smithi002.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-14T11:10:00.326 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:10:00.327 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:10:00.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.368+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 20 realm 2024-09-14T11:10:00.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:10:00.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.370+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.371+0000 7fd7e672c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:00.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.371+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.371+0000 7fd7e672c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:10:00.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.371+0000 7fd7e672c800 20 searching for the correct realm 2024-09-14T11:10:00.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.374+0000 7fd7e1b3d640 0 -- 172.21.15.2:0/3774657112 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fd7d4039060 msgr2=0x7fd7d40683f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:00.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.378+0000 7fd7e233e640 0 -- 172.21.15.2:0/3774657112 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd7d802d930 msgr2=0x7fd7d8020440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:10:00.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:10:00.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:10:00.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:10:00.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:10:00.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:10:00.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:10:00.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.586+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 zone default found 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 4 Realm: () 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 zonegroup default 2024-09-14T11:10:00.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.587+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.588+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.588+0000 7fd7e672c800 20 started sync module instance, tier type = 2024-09-14T11:10:00.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.588+0000 7fd7e672c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:10:00.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.599+0000 7fd7e672c800 20 add_watcher() i=0 2024-09-14T11:10:00.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.599+0000 7fd7e672c800 20 add_watcher() i=1 2024-09-14T11:10:00.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.599+0000 7fd7e672c800 20 add_watcher() i=2 2024-09-14T11:10:00.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.599+0000 7fd7e672c800 20 add_watcher() i=3 2024-09-14T11:10:00.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.599+0000 7fd7e672c800 20 add_watcher() i=4 2024-09-14T11:10:00.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.599+0000 7fd7e672c800 20 add_watcher() i=5 2024-09-14T11:10:00.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.599+0000 7fd7e672c800 20 add_watcher() i=6 2024-09-14T11:10:00.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.600+0000 7fd7e672c800 20 add_watcher() i=7 2024-09-14T11:10:00.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.600+0000 7fd7e672c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:10:00.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.601+0000 7fd698fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:00.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd7e672c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:10:00.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd7e672c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:10:00.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd7e672c800 5 note: GC not initialized 2024-09-14T11:10:00.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd6137fe640 20 reqs_thread_entry: start 2024-09-14T11:10:00.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd7e672c800 20 init_complete bucket index max shards: 1 2024-09-14T11:10:00.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd7e672c800 20 Filter name: none 2024-09-14T11:10:00.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd6117fa640 20 reqs_thread_entry: start 2024-09-14T11:10:00.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd7e672c800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-14T11:10:00.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.602+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-14T11:10:00.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:10:00.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-14T11:10:00.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 20 rados->read ofs=0 len=0 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:10:00.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.603+0000 7fd7e672c800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-14T11:10:00.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.604+0000 7fd7e672c800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:10:00.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.604+0000 7fd7e672c800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:10:00.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.604+0000 7fd7e672c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-14T11:10:00.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.605+0000 7fd6c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824004 cookie 94559371965088 notifier 5769 bl.length()=677 2024-09-14T11:10:00.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.605+0000 7fd6c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-14T11:10:00.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.605+0000 7fd6c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-14T11:10:00.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.607+0000 7fd7e672c800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:10:00.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.607+0000 7fd7e672c800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:10:00.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.607+0000 7fd7e672c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-14T11:10:00.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.607+0000 7fd6c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824005 cookie 94559371949392 notifier 5769 bl.length()=187 2024-09-14T11:10:00.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.607+0000 7fd6c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-14T11:10:00.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.607+0000 7fd6c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-14T11:10:00.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.609+0000 7fd7e672c800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:10:00.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.609+0000 7fd7e672c800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:10:00.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.609+0000 7fd7e672c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-14T11:10:00.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.609+0000 7fd6c5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1073741824006 cookie 94559371949392 notifier 5769 bl.length()=197 2024-09-14T11:10:00.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.609+0000 7fd6c5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-14T11:10:00.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.610+0000 7fd6c5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-14T11:10:00.608 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:10:00.608 INFO:tasks.workunit.client.0.smithi002.stdout: "user_id": "ceph-test-maven", 2024-09-14T11:10:00.608 INFO:tasks.workunit.client.0.smithi002.stdout: "display_name": "maven test user", 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "email": "sigv4@example.com", 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "suspended": 0, 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "subusers": [], 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "keys": [ 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: { 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "user": "ceph-test-maven", 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "active": true, 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: "create_date": "2024-09-14T11:10:00.604415Z" 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:10:00.609 INFO:tasks.workunit.client.0.smithi002.stdout: ], 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "swift_keys": [], 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "caps": [], 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "default_placement": "", 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "placement_tags": [], 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_quota": { 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "enabled": false, 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size": -1, 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "max_objects": -1 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:10:00.610 INFO:tasks.workunit.client.0.smithi002.stdout: "user_quota": { 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "enabled": false, 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size": -1, 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "max_objects": -1 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "type": "rgw", 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "account_id": "", 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "path": "/", 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "create_date": "2024-09-14T11:10:00.604398Z", 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "tags": [], 2024-09-14T11:10:00.611 INFO:tasks.workunit.client.0.smithi002.stdout: "group_ids": [] 2024-09-14T11:10:00.612 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:10:00.612 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:10:00.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.611+0000 7fd698fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:10:00.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.613+0000 7fd7e672c800 20 remove_watcher() i=0 2024-09-14T11:10:00.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.613+0000 7fd7e672c800 2 removed watcher, disabling cache 2024-09-14T11:10:00.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.614+0000 7fd7e672c800 20 remove_watcher() i=1 2024-09-14T11:10:00.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.616+0000 7fd7e672c800 20 remove_watcher() i=2 2024-09-14T11:10:00.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.617+0000 7fd7e672c800 20 remove_watcher() i=3 2024-09-14T11:10:00.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.618+0000 7fd7e672c800 20 remove_watcher() i=4 2024-09-14T11:10:00.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.619+0000 7fd7e672c800 20 remove_watcher() i=5 2024-09-14T11:10:00.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.620+0000 7fd7e672c800 20 remove_watcher() i=6 2024-09-14T11:10:00.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:10:00.621+0000 7fd7e672c800 20 remove_watcher() i=7 2024-09-14T11:10:00.630 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -z ']' 2024-09-14T11:10:00.630 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-14T11:10:00.630 INFO:tasks.workunit.client.0.smithi002.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-14T11:10:00.631 INFO:tasks.workunit.client.0.smithi002.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi002.front.sepia.ceph.com:443 2024-09-14T11:10:00.631 INFO:tasks.workunit.client.0.smithi002.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi002.front.sepia.ceph.com:443 2024-09-14T11:10:00.631 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-14T11:10:00.631 INFO:tasks.workunit.client.0.smithi002.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-14T11:10:00.631 INFO:tasks.workunit.client.0.smithi002.stderr:+ ./mvnw clean package 2024-09-14T11:10:00.640 INFO:tasks.workunit.client.0.smithi002.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:10:02.210 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Scanning for projects... 2024-09-14T11:10:02.321 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-14T11:10:02.401 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 68 kB/s) 2024-09-14T11:10:02.412 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-14T11:10:02.452 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 18/83 kB Progress (1): 19/83 kB Progress (1): 21/83 kB Progress (1): 22/83 kB Progress (1): 23/83 kB Progress (1): 25/83 kB Progress (1): 26/83 kB Progress (1): 27/83 kB Progress (1): 29/83 kB Progress (1): 30/83 kB Progress (1): 32/83 kB Progress (1): 33/83 kB Progress (1): 34/83 kB Progress (1): 36/83 kB Progress (1): 37/83 kB Progress (1): 38/83 kB Progress (1): 40/83 kB Progress (1): 41/83 kB Progress (1): 43/83 kB Progress (1): 44/83 kB Progress (1): 45/83 kB Progress (1): 47/83 kB Progress (1): 48/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-14T11:10:02.460 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-14T11:10:02.479 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/77 kB Progress (1): 33/77 kB Progress (1): 49/77 kB Progress (1): 66/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 4.0 MB/s) 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] from pom.xml 2024-09-14T11:10:02.502 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:10:02.504 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-14T11:10:02.520 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 354 kB/s) 2024-09-14T11:10:02.526 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-14T11:10:02.541 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 0.1/9.9 kB Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 660 kB/s) 2024-09-14T11:10:02.545 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-14T11:10:02.561 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.7 MB/s) 2024-09-14T11:10:02.568 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-14T11:10:02.583 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.3 MB/s) 2024-09-14T11:10:02.594 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-14T11:10:02.610 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-14T11:10:02.617 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-14T11:10:02.632 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 583 kB/s) 2024-09-14T11:10:02.634 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-14T11:10:02.651 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.7/8.1 kB Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-14T11:10:02.653 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-14T11:10:02.667 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/48 kB Progress (1): 33/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 3.2 MB/s) 2024-09-14T11:10:02.671 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-14T11:10:02.686 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 1.4 MB/s) 2024-09-14T11:10:02.692 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-14T11:10:02.708 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.9 MB/s) 2024-09-14T11:10:02.712 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-14T11:10:02.727 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 654 kB/s) 2024-09-14T11:10:02.733 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-14T11:10:02.750 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.9 MB/s) 2024-09-14T11:10:02.755 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-14T11:10:02.770 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 355 kB/s) 2024-09-14T11:10:02.772 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-14T11:10:02.786 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.6 MB/s) 2024-09-14T11:10:02.790 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-14T11:10:02.806 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 3.1 MB/s) 2024-09-14T11:10:02.810 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-14T11:10:02.824 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-14T11:10:02.830 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-14T11:10:02.844 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-14T11:10:02.848 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-14T11:10:02.863 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.8 MB/s) 2024-09-14T11:10:02.871 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-14T11:10:02.886 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 483 kB/s) 2024-09-14T11:10:02.888 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-14T11:10:02.902 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 707 kB/s) 2024-09-14T11:10:02.904 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-14T11:10:02.920 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.9 MB/s) 2024-09-14T11:10:02.923 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-14T11:10:02.939 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.4 MB/s) 2024-09-14T11:10:02.943 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-14T11:10:02.958 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.8 MB/s) 2024-09-14T11:10:02.972 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-14T11:10:02.987 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 406 kB/s) 2024-09-14T11:10:02.989 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-14T11:10:03.003 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.4 MB/s) 2024-09-14T11:10:03.008 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-14T11:10:03.022 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.3 MB/s) 2024-09-14T11:10:03.030 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-14T11:10:03.044 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 267 kB/s) 2024-09-14T11:10:03.047 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-14T11:10:03.061 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 104 kB/s) 2024-09-14T11:10:03.063 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-14T11:10:03.078 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 159 kB/s) 2024-09-14T11:10:03.082 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-14T11:10:03.096 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 243 kB/s) 2024-09-14T11:10:03.101 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-14T11:10:03.115 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 215 kB/s) 2024-09-14T11:10:03.119 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-14T11:10:03.134 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 731 kB/s) 2024-09-14T11:10:03.138 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-14T11:10:03.153 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 120 kB/s) 2024-09-14T11:10:03.156 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-14T11:10:03.173 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 255 kB/s) 2024-09-14T11:10:03.175 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-14T11:10:03.189 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 327 kB/s) 2024-09-14T11:10:03.192 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-14T11:10:03.206 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 83 kB/s) 2024-09-14T11:10:03.208 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-14T11:10:03.222 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-14T11:10:03.224 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-14T11:10:03.238 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 1.1 MB/s) 2024-09-14T11:10:03.241 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-14T11:10:03.256 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 245 kB/s) 2024-09-14T11:10:03.259 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-14T11:10:03.273 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 175 kB/s) 2024-09-14T11:10:03.277 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-14T11:10:03.292 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 208 kB/s) 2024-09-14T11:10:03.295 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-14T11:10:03.309 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 529 kB/s) 2024-09-14T11:10:03.313 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-14T11:10:03.327 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 390 kB/s) 2024-09-14T11:10:03.331 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-14T11:10:03.345 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-14T11:10:03.349 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-14T11:10:03.363 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 314 kB/s) 2024-09-14T11:10:03.365 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-14T11:10:03.380 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 161 kB/s) 2024-09-14T11:10:03.384 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-14T11:10:03.398 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 460 kB/s) 2024-09-14T11:10:03.402 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-14T11:10:03.416 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 404 kB/s) 2024-09-14T11:10:03.419 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-14T11:10:03.434 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 212 kB/s) 2024-09-14T11:10:03.437 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-14T11:10:03.451 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 248 kB/s) 2024-09-14T11:10:03.455 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-14T11:10:03.470 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-14T11:10:03.472 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-14T11:10:03.486 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 127 kB/s) 2024-09-14T11:10:03.489 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-14T11:10:03.503 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-14T11:10:03.505 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-14T11:10:03.519 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 1.1 MB/s) 2024-09-14T11:10:03.521 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-14T11:10:03.535 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.5 MB/s) 2024-09-14T11:10:03.538 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-14T11:10:03.552 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.2 MB/s) 2024-09-14T11:10:03.555 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-14T11:10:03.569 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 355 kB/s) 2024-09-14T11:10:03.571 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-14T11:10:03.585 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 940 kB/s) 2024-09-14T11:10:03.589 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-14T11:10:03.602 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 998 kB/s) 2024-09-14T11:10:03.605 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-14T11:10:03.619 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/68 kB Progress (1): 32/68 kB Progress (1): 49/68 kB Progress (1): 65/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.5 MB/s) 2024-09-14T11:10:03.625 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-14T11:10:03.639 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.1 MB/s) 2024-09-14T11:10:03.643 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-14T11:10:03.657 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:10:03.659 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-14T11:10:03.674 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 5.0 MB/s) 2024-09-14T11:10:03.678 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-14T11:10:03.692 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.3 MB/s) 2024-09-14T11:10:03.695 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-14T11:10:03.709 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.4 MB/s) 2024-09-14T11:10:03.712 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-14T11:10:03.727 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 5.2 MB/s) 2024-09-14T11:10:03.732 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-14T11:10:03.746 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 274 kB/s) 2024-09-14T11:10:03.748 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-14T11:10:03.762 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 986 kB/s) 2024-09-14T11:10:03.765 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-14T11:10:03.779 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:10:03.781 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-14T11:10:03.794 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 245 kB/s) 2024-09-14T11:10:03.796 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-14T11:10:03.810 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 157 kB/s) 2024-09-14T11:10:03.812 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-14T11:10:03.825 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 202 kB/s) 2024-09-14T11:10:03.827 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-14T11:10:03.842 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 102 kB/s) 2024-09-14T11:10:03.844 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-14T11:10:03.858 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 215 kB/s) 2024-09-14T11:10:03.860 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-14T11:10:03.873 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 246 kB/s) 2024-09-14T11:10:03.875 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-14T11:10:03.889 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 229 kB/s) 2024-09-14T11:10:03.892 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-14T11:10:03.906 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 73 kB/s) 2024-09-14T11:10:03.909 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-14T11:10:03.923 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 69 kB/s) 2024-09-14T11:10:03.925 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-14T11:10:03.939 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 218 kB/s) 2024-09-14T11:10:03.941 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-14T11:10:03.955 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 217 kB/s) 2024-09-14T11:10:03.957 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-14T11:10:03.971 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 246 kB/s) 2024-09-14T11:10:03.973 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-14T11:10:03.987 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 245 kB/s) 2024-09-14T11:10:03.989 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-14T11:10:04.003 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 216 kB/s) 2024-09-14T11:10:04.020 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-14T11:10:04.100 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 41 MB/s) 2024-09-14T11:10:04.101 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-14T11:10:04.101 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-14T11:10:04.102 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-14T11:10:04.102 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-14T11:10:04.102 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-14T11:10:04.119 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/35 kB Progress (1): 33/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 2.1 MB/s) 2024-09-14T11:10:04.119 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-14T11:10:04.133 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 517 kB/s) 2024-09-14T11:10:04.133 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-14T11:10:04.150 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/16 kB Progress (2): 1.4/16 kB | 1.4/98 kB Progress (2): 2.8/16 kB | 1.4/98 kB Progress (2): 2.8/16 kB | 2.8/98 kB Progress (3): 2.8/16 kB | 2.8/98 kB | 1.4/49 kB Progress (4): 2.8/16 kB | 2.8/98 kB | 1.4/49 kB | 1.4/71 kB Progress (4): 2.8/16 kB | 2.8/98 kB | 2.8/49 kB | 1.4/71 kB Progress (4): 2.8/16 kB | 4.1/98 kB | 2.8/49 kB | 1.4/71 kB Progress (4): 4.1/16 kB | 4.1/98 kB | 2.8/49 kB | 1.4/71 kB Progress (4): 4.1/16 kB | 5.5/98 kB | 2.8/49 kB | 1.4/71 kB Progress (4): 4.1/16 kB | 5.5/98 kB | 4.1/49 kB | 1.4/71 kB Progress (4): 4.1/16 kB | 5.5/98 kB | 4.1/49 kB | 2.8/71 kB Progress (4): 4.1/16 kB | 5.5/98 kB | 5.5/49 kB | 2.8/71 kB Progress (4): 4.1/16 kB | 5.5/98 kB | 5.5/49 kB | 4.1/71 kB Progress (4): 4.1/16 kB | 6.9/98 kB | 5.5/49 kB | 4.1/71 kB Progress (4): 5.5/16 kB | 6.9/98 kB | 5.5/49 kB | 4.1/71 kB Progress (4): 5.5/16 kB | 8.3/98 kB | 5.5/49 kB | 4.1/71 kB Progress (4): 6.9/16 kB | 8.3/98 kB | 5.5/49 kB | 4.1/71 kB Progress (4): 6.9/16 kB | 8.3/98 kB | 6.9/49 kB | 4.1/71 kB Progress (4): 8.3/16 kB | 8.3/98 kB | 6.9/49 kB | 4.1/71 kB Progress (4): 8.3/16 kB | 8.3/98 kB | 6.9/49 kB | 5.5/71 kB Progress (4): 9.7/16 kB | 8.3/98 kB | 6.9/49 kB | 5.5/71 kB Progress (4): 9.7/16 kB | 8.3/98 kB | 8.3/49 kB | 5.5/71 kB Progress (4): 11/16 kB | 8.3/98 kB | 8.3/49 kB | 5.5/71 kB Progress (4): 11/16 kB | 9.7/98 kB | 8.3/49 kB | 5.5/71 kB Progress (4): 12/16 kB | 9.7/98 kB | 8.3/49 kB | 5.5/71 kB Progress (4): 12/16 kB | 9.7/98 kB | 9.7/49 kB | 5.5/71 kB Progress (4): 12/16 kB | 9.7/98 kB | 9.7/49 kB | 6.9/71 kB Progress (4): 12/16 kB | 9.7/98 kB | 11/49 kB | 6.9/71 kB Progress (4): 12/16 kB | 9.7/98 kB | 11/49 kB | 8.3/71 kB Progress (4): 13/16 kB | 9.7/98 kB | 11/49 kB | 8.3/71 kB Progress (4): 13/16 kB | 11/98 kB | 11/49 kB | 8.3/71 kB Progress (4): 15/16 kB | 11/98 kB | 11/49 kB | 8.3/71 kB Progress (4): 15/16 kB | 11/98 kB | 11/49 kB | 9.7/71 kB Progress (4): 15/16 kB | 11/98 kB | 12/49 kB | 9.7/71 kB Progress (4): 15/16 kB | 11/98 kB | 12/49 kB | 11/71 kB Progress (4): 16 kB | 11/98 kB | 12/49 kB | 11/71 kB Progress (5): 16 kB | 11/98 kB | 12/49 kB | 11/71 kB | 16/782 kB Progress (5): 16 kB | 12/98 kB | 12/49 kB | 11/71 kB | 16/782 kB Progress (5): 16 kB | 12/98 kB | 12/49 kB | 12/71 kB | 16/782 kB Progress (5): 16 kB | 12/98 kB | 14/49 kB | 12/71 kB | 16/782 kB Progress (5): 16 kB | 12/98 kB | 14/49 kB | 14/71 kB | 16/782 kB Progress (5): 16 kB | 12/98 kB | 15/49 kB | 14/71 kB | 16/782 kB Progress (5): 16 kB | 12/98 kB | 15/49 kB | 14/71 kB | 33/782 kB Progress (5): 16 kB | 14/98 kB | 15/49 kB | 14/71 kB | 33/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 336 kB/s) 2024-09-14T11:10:04.150 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (4): 14/98 kB | 16/49 kB | 14/71 kB | 33/782 kB Progress (4): 14/98 kB | 16/49 kB | 15/71 kB | 33/782 kB Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-14T11:10:04.162 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (4): 15/98 kB | 16/49 kB | 15/71 kB | 33/782 kB Progress (4): 15/98 kB | 16/49 kB | 16/71 kB | 33/782 kB Progress (4): 15/98 kB | 18/49 kB | 16/71 kB | 33/782 kB Progress (4): 16/98 kB | 18/49 kB | 16/71 kB | 33/782 kB Progress (4): 16/98 kB | 18/49 kB | 16/71 kB | 49/782 kB Progress (4): 16/98 kB | 19/49 kB | 16/71 kB | 49/782 kB Progress (4): 16/98 kB | 21/49 kB | 16/71 kB | 49/782 kB Progress (4): 16/98 kB | 22/49 kB | 16/71 kB | 49/782 kB Progress (4): 16/98 kB | 22/49 kB | 16/71 kB | 66/782 kB Progress (4): 16/98 kB | 23/49 kB | 16/71 kB | 66/782 kB Progress (4): 16/98 kB | 25/49 kB | 16/71 kB | 66/782 kB Progress (4): 16/98 kB | 26/49 kB | 16/71 kB | 66/782 kB Progress (4): 16/98 kB | 26/49 kB | 16/71 kB | 82/782 kB Progress (4): 16/98 kB | 27/49 kB | 16/71 kB | 82/782 kB Progress (4): 16/98 kB | 29/49 kB | 16/71 kB | 82/782 kB Progress (4): 16/98 kB | 29/49 kB | 16/71 kB | 98/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 98/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 115/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 131/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 147/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 164/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 180/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 197/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 213/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 229/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 246/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 262/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 278/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 295/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 311/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 328/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 344/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 360/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 377/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 393/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 410/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 426/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 442/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 459/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 475/782 kB Progress (4): 16/98 kB | 30/49 kB | 16/71 kB | 491/782 kB Progress (4): 33/98 kB | 30/49 kB | 16/71 kB | 491/782 kB Progress (4): 33/98 kB | 30/49 kB | 33/71 kB | 491/782 kB Progress (4): 33/98 kB | 30/49 kB | 33/71 kB | 508/782 kB Progress (4): 33/98 kB | 30/49 kB | 33/71 kB | 524/782 kB Progress (4): 33/98 kB | 32/49 kB | 33/71 kB | 524/782 kB Progress (4): 33/98 kB | 33/49 kB | 33/71 kB | 524/782 kB Progress (4): 33/98 kB | 34/49 kB | 33/71 kB | 524/782 kB Progress (4): 33/98 kB | 34/49 kB | 33/71 kB | 541/782 kB Progress (4): 33/98 kB | 36/49 kB | 33/71 kB | 541/782 kB Progress (4): 33/98 kB | 37/49 kB | 33/71 kB | 541/782 kB Progress (4): 33/98 kB | 37/49 kB | 33/71 kB | 557/782 kB Progress (4): 33/98 kB | 38/49 kB | 33/71 kB | 557/782 kB Progress (4): 33/98 kB | 40/49 kB | 33/71 kB | 557/782 kB Progress (4): 33/98 kB | 41/49 kB | 33/71 kB | 557/782 kB Progress (4): 33/98 kB | 41/49 kB | 33/71 kB | 573/782 kB Progress (4): 33/98 kB | 43/49 kB | 33/71 kB | 573/782 kB Progress (4): 33/98 kB | 44/49 kB | 33/71 kB | 573/782 kB Progress (4): 33/98 kB | 45/49 kB | 33/71 kB | 573/782 kB Progress (4): 33/98 kB | 45/49 kB | 33/71 kB | 590/782 kB Progress (4): 33/98 kB | 45/49 kB | 33/71 kB | 606/782 kB Progress (4): 33/98 kB | 45/49 kB | 49/71 kB | 606/782 kB Progress (4): 33/98 kB | 45/49 kB | 49/71 kB | 623/782 kB Progress (4): 49/98 kB | 45/49 kB | 49/71 kB | 623/782 kB Progress (4): 49/98 kB | 45/49 kB | 49/71 kB | 639/782 kB Progress (4): 49/98 kB | 45/49 kB | 49/71 kB | 655/782 kB Progress (4): 49/98 kB | 45/49 kB | 49/71 kB | 672/782 kB Progress (4): 49/98 kB | 47/49 kB | 49/71 kB | 672/782 kB Progress (4): 49/98 kB | 47/49 kB | 49/71 kB | 688/782 kB Progress (4): 49/98 kB | 48/49 kB | 49/71 kB | 688/782 kB Progress (4): 49/98 kB | 49 kB | 49/71 kB | 688/782 kB Progress (4): 49/98 kB | 49 kB | 49/71 kB | 704/782 kB Progress (4): 49/98 kB | 49 kB | 49/71 kB | 721/782 kB Progress (4): 49/98 kB | 49 kB | 49/71 kB | 737/782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 821 kB/s) 2024-09-14T11:10:04.162 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-14T11:10:04.163 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 49/98 kB | 49/71 kB | 754/782 kB Progress (3): 49/98 kB | 49/71 kB | 770/782 kB Progress (4): 49/98 kB | 49/71 kB | 770/782 kB | 1.4/11 kB Progress (4): 49/98 kB | 49/71 kB | 770/782 kB | 2.8/11 kB Progress (4): 49/98 kB | 49/71 kB | 782 kB | 2.8/11 kB Progress (4): 49/98 kB | 49/71 kB | 782 kB | 4.1/11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 13 MB/s) 2024-09-14T11:10:04.163 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 49/98 kB | 49/71 kB | 5.5/11 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-14T11:10:04.164 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 49/98 kB | 49/71 kB | 6.9/11 kB Progress (3): 49/98 kB | 49/71 kB | 8.3/11 kB Progress (3): 49/98 kB | 49/71 kB | 9.7/11 kB Progress (3): 49/98 kB | 49/71 kB | 11/11 kB Progress (3): 49/98 kB | 49/71 kB | 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 183 kB/s) 2024-09-14T11:10:04.164 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-14T11:10:04.169 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 49/98 kB | 66/71 kB Progress (2): 66/98 kB | 66/71 kB Progress (2): 66/98 kB | 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-14T11:10:04.169 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-14T11:10:04.171 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 79/98 kB Progress (1): 95/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.4 MB/s) 2024-09-14T11:10:04.172 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-14T11:10:04.177 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/205 kB Progress (2): 16/205 kB | 16/30 kB Progress (2): 16/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 408 kB/s) 2024-09-14T11:10:04.177 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-14T11:10:04.186 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 33/205 kB Progress (2): 33/205 kB | 1.4/81 kB Progress (2): 33/205 kB | 2.8/81 kB Progress (2): 33/205 kB | 4.1/81 kB Progress (2): 33/205 kB | 5.5/81 kB Progress (2): 33/205 kB | 6.9/81 kB Progress (2): 33/205 kB | 8.3/81 kB Progress (2): 33/205 kB | 9.7/81 kB Progress (2): 33/205 kB | 11/81 kB Progress (2): 49/205 kB | 11/81 kB Progress (2): 49/205 kB | 12/81 kB Progress (2): 49/205 kB | 14/81 kB Progress (2): 49/205 kB | 15/81 kB Progress (2): 49/205 kB | 16/81 kB Progress (3): 49/205 kB | 16/81 kB | 15/798 kB Progress (3): 49/205 kB | 16/81 kB | 31/798 kB Progress (4): 49/205 kB | 16/81 kB | 31/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 161 kB/s) 2024-09-14T11:10:04.186 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-14T11:10:04.194 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 49/205 kB | 16/81 kB | 48/798 kB Progress (3): 65/205 kB | 16/81 kB | 48/798 kB Progress (3): 65/205 kB | 16/81 kB | 64/798 kB Progress (3): 81/205 kB | 16/81 kB | 64/798 kB Progress (3): 98/205 kB | 16/81 kB | 64/798 kB Progress (3): 114/205 kB | 16/81 kB | 64/798 kB Progress (3): 114/205 kB | 33/81 kB | 64/798 kB Progress (4): 114/205 kB | 33/81 kB | 64/798 kB | 16/182 kB Progress (4): 131/205 kB | 33/81 kB | 64/798 kB | 16/182 kB Progress (4): 131/205 kB | 33/81 kB | 64/798 kB | 33/182 kB Progress (4): 131/205 kB | 49/81 kB | 64/798 kB | 33/182 kB Progress (4): 131/205 kB | 49/81 kB | 64/798 kB | 49/182 kB Progress (4): 147/205 kB | 49/81 kB | 64/798 kB | 49/182 kB Progress (4): 147/205 kB | 49/81 kB | 64/798 kB | 62/182 kB Progress (4): 147/205 kB | 49/81 kB | 64/798 kB | 78/182 kB Progress (4): 147/205 kB | 49/81 kB | 64/798 kB | 94/182 kB Progress (4): 147/205 kB | 49/81 kB | 64/798 kB | 111/182 kB Progress (4): 147/205 kB | 64/81 kB | 64/798 kB | 111/182 kB Progress (4): 147/205 kB | 64/81 kB | 64/798 kB | 127/182 kB Progress (4): 147/205 kB | 64/81 kB | 64/798 kB | 143/182 kB Progress (4): 163/205 kB | 64/81 kB | 64/798 kB | 143/182 kB Progress (4): 163/205 kB | 64/81 kB | 64/798 kB | 160/182 kB Progress (4): 180/205 kB | 64/81 kB | 64/798 kB | 160/182 kB Progress (4): 180/205 kB | 64/81 kB | 64/798 kB | 176/182 kB Progress (4): 180/205 kB | 64/81 kB | 64/798 kB | 182 kB Progress (4): 180/205 kB | 64/81 kB | 78/798 kB | 182 kB Progress (4): 180/205 kB | 80/81 kB | 78/798 kB | 182 kB Progress (4): 180/205 kB | 81 kB | 78/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 2.0 MB/s) 2024-09-14T11:10:04.194 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-14T11:10:04.195 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 893 kB/s) 2024-09-14T11:10:04.195 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-14T11:10:04.199 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 180/205 kB | 95/798 kB Progress (2): 180/205 kB | 111/798 kB Progress (2): 180/205 kB | 128/798 kB Progress (2): 180/205 kB | 144/798 kB Progress (2): 196/205 kB | 144/798 kB Progress (2): 205 kB | 144/798 kB Progress (2): 205 kB | 160/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.1 MB/s) 2024-09-14T11:10:04.199 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-14T11:10:04.210 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 177/798 kB Progress (2): 177/798 kB | 16/151 kB Progress (2): 177/798 kB | 33/151 kB Progress (2): 193/798 kB | 33/151 kB Progress (2): 209/798 kB | 33/151 kB Progress (2): 209/798 kB | 49/151 kB Progress (2): 209/798 kB | 62/151 kB Progress (2): 209/798 kB | 79/151 kB Progress (2): 209/798 kB | 95/151 kB Progress (2): 226/798 kB | 95/151 kB Progress (2): 242/798 kB | 95/151 kB Progress (2): 259/798 kB | 95/151 kB Progress (2): 275/798 kB | 95/151 kB Progress (2): 291/798 kB | 95/151 kB Progress (2): 308/798 kB | 95/151 kB Progress (2): 324/798 kB | 95/151 kB Progress (3): 324/798 kB | 95/151 kB | 16/30 kB Progress (4): 324/798 kB | 95/151 kB | 16/30 kB | 16/27 kB Progress (4): 324/798 kB | 95/151 kB | 30 kB | 16/27 kB Progress (4): 341/798 kB | 95/151 kB | 30 kB | 16/27 kB Progress (4): 341/798 kB | 95/151 kB | 30 kB | 27 kB Progress (4): 357/798 kB | 95/151 kB | 30 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 284 kB/s) 2024-09-14T11:10:04.210 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-14T11:10:04.210 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 255 kB/s) 2024-09-14T11:10:04.210 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-14T11:10:04.213 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 373/798 kB | 95/151 kB Progress (2): 390/798 kB | 95/151 kB Progress (2): 406/798 kB | 95/151 kB Progress (2): 406/798 kB | 111/151 kB Progress (2): 422/798 kB | 111/151 kB Progress (2): 422/798 kB | 128/151 kB Progress (2): 439/798 kB | 128/151 kB Progress (2): 439/798 kB | 144/151 kB Progress (2): 455/798 kB | 144/151 kB Progress (2): 455/798 kB | 151 kB Progress (2): 472/798 kB | 151 kB Progress (3): 472/798 kB | 151 kB | 16/385 kB Progress (3): 488/798 kB | 151 kB | 16/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.4 MB/s) 2024-09-14T11:10:04.213 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 488/798 kB | 33/385 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-14T11:10:04.224 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 488/798 kB | 49/385 kB Progress (2): 488/798 kB | 65/385 kB Progress (2): 488/798 kB | 82/385 kB Progress (2): 488/798 kB | 98/385 kB Progress (2): 488/798 kB | 114/385 kB Progress (2): 488/798 kB | 131/385 kB Progress (2): 488/798 kB | 147/385 kB Progress (2): 488/798 kB | 164/385 kB Progress (2): 488/798 kB | 180/385 kB Progress (2): 488/798 kB | 196/385 kB Progress (2): 488/798 kB | 213/385 kB Progress (2): 488/798 kB | 229/385 kB Progress (2): 488/798 kB | 245/385 kB Progress (2): 488/798 kB | 262/385 kB Progress (2): 504/798 kB | 262/385 kB Progress (2): 521/798 kB | 262/385 kB Progress (2): 537/798 kB | 262/385 kB Progress (2): 554/798 kB | 262/385 kB Progress (2): 570/798 kB | 262/385 kB Progress (2): 586/798 kB | 262/385 kB Progress (2): 603/798 kB | 262/385 kB Progress (2): 619/798 kB | 262/385 kB Progress (2): 635/798 kB | 262/385 kB Progress (2): 652/798 kB | 262/385 kB Progress (2): 668/798 kB | 262/385 kB Progress (2): 685/798 kB | 262/385 kB Progress (2): 701/798 kB | 262/385 kB Progress (2): 717/798 kB | 262/385 kB Progress (2): 734/798 kB | 262/385 kB Progress (2): 750/798 kB | 262/385 kB Progress (2): 766/798 kB | 262/385 kB Progress (2): 783/798 kB | 262/385 kB Progress (2): 798 kB | 262/385 kB Progress (3): 798 kB | 262/385 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.7 MB/s) 2024-09-14T11:10:04.224 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-14T11:10:04.224 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 110 kB/s) 2024-09-14T11:10:04.224 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-14T11:10:04.227 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 262/385 kB | 16/75 kB Progress (2): 262/385 kB | 33/75 kB Progress (2): 278/385 kB | 33/75 kB Progress (2): 295/385 kB | 33/75 kB Progress (2): 295/385 kB | 49/75 kB Progress (2): 311/385 kB | 49/75 kB Progress (2): 311/385 kB | 66/75 kB Progress (2): 327/385 kB | 66/75 kB Progress (2): 327/385 kB | 75 kB Progress (2): 344/385 kB | 75 kB Progress (2): 360/385 kB | 75 kB Progress (2): 376/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 606 kB/s) 2024-09-14T11:10:04.227 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-14T11:10:04.228 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 385 kB Progress (2): 385 kB | 16/780 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 3.1 MB/s) 2024-09-14T11:10:04.228 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-14T11:10:04.244 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 62/780 kB Progress (1): 78/780 kB Progress (1): 94/780 kB Progress (1): 111/780 kB Progress (1): 127/780 kB Progress (1): 144/780 kB Progress (1): 160/780 kB Progress (1): 176/780 kB Progress (1): 193/780 kB Progress (1): 209/780 kB Progress (1): 225/780 kB Progress (1): 242/780 kB Progress (2): 242/780 kB | 16/329 kB Progress (3): 242/780 kB | 16/329 kB | 16/501 kB Progress (3): 242/780 kB | 33/329 kB | 16/501 kB Progress (3): 242/780 kB | 33/329 kB | 33/501 kB Progress (3): 258/780 kB | 33/329 kB | 33/501 kB Progress (3): 258/780 kB | 33/329 kB | 49/501 kB Progress (3): 275/780 kB | 33/329 kB | 49/501 kB Progress (3): 275/780 kB | 33/329 kB | 66/501 kB Progress (3): 291/780 kB | 33/329 kB | 66/501 kB Progress (3): 291/780 kB | 33/329 kB | 79/501 kB Progress (3): 291/780 kB | 49/329 kB | 79/501 kB Progress (3): 291/780 kB | 49/329 kB | 96/501 kB Progress (3): 307/780 kB | 49/329 kB | 96/501 kB Progress (3): 307/780 kB | 49/329 kB | 112/501 kB Progress (3): 324/780 kB | 49/329 kB | 112/501 kB Progress (3): 324/780 kB | 49/329 kB | 128/501 kB Progress (3): 340/780 kB | 49/329 kB | 128/501 kB Progress (3): 340/780 kB | 59/329 kB | 128/501 kB Progress (3): 340/780 kB | 59/329 kB | 145/501 kB Progress (3): 340/780 kB | 67/329 kB | 145/501 kB Progress (3): 356/780 kB | 67/329 kB | 145/501 kB Progress (3): 356/780 kB | 67/329 kB | 161/501 kB Progress (3): 356/780 kB | 67/329 kB | 177/501 kB Progress (3): 373/780 kB | 67/329 kB | 177/501 kB Progress (3): 373/780 kB | 67/329 kB | 194/501 kB Progress (3): 389/780 kB | 67/329 kB | 194/501 kB Progress (3): 389/780 kB | 83/329 kB | 194/501 kB Progress (3): 389/780 kB | 83/329 kB | 210/501 kB Progress (3): 406/780 kB | 83/329 kB | 210/501 kB Progress (4): 406/780 kB | 83/329 kB | 210/501 kB | 16/41 kB Progress (4): 406/780 kB | 83/329 kB | 227/501 kB | 16/41 kB Progress (5): 406/780 kB | 83/329 kB | 227/501 kB | 16/41 kB | 1.4/354 kB Progress (5): 422/780 kB | 83/329 kB | 227/501 kB | 16/41 kB | 1.4/354 kB Progress (5): 422/780 kB | 83/329 kB | 227/501 kB | 33/41 kB | 1.4/354 kB Progress (5): 422/780 kB | 100/329 kB | 227/501 kB | 33/41 kB | 1.4/354 kB Progress (5): 422/780 kB | 100/329 kB | 227/501 kB | 33/41 kB | 6.9/354 kB Progress (5): 422/780 kB | 100/329 kB | 243/501 kB | 33/41 kB | 6.9/354 kB Progress (5): 422/780 kB | 100/329 kB | 243/501 kB | 41 kB | 6.9/354 kB Progress (5): 438/780 kB | 100/329 kB | 243/501 kB | 41 kB | 6.9/354 kB Progress (5): 438/780 kB | 100/329 kB | 243/501 kB | 41 kB | 11/354 kB Progress (5): 438/780 kB | 100/329 kB | 243/501 kB | 41 kB | 15/354 kB Progress (5): 438/780 kB | 100/329 kB | 259/501 kB | 41 kB | 15/354 kB Progress (5): 438/780 kB | 100/329 kB | 259/501 kB | 41 kB | 21/354 kB Progress (5): 455/780 kB | 100/329 kB | 259/501 kB | 41 kB | 21/354 kB Progress (5): 455/780 kB | 100/329 kB | 259/501 kB | 41 kB | 26/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 296 kB/s) 2024-09-14T11:10:04.244 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (4): 455/780 kB | 100/329 kB | 276/501 kB | 26/354 kB Progress (4): 455/780 kB | 100/329 kB | 276/501 kB | 32/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-14T11:10:04.259 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (4): 471/780 kB | 100/329 kB | 276/501 kB | 32/354 kB Progress (4): 471/780 kB | 100/329 kB | 276/501 kB | 37/354 kB Progress (4): 471/780 kB | 100/329 kB | 276/501 kB | 43/354 kB Progress (4): 471/780 kB | 100/329 kB | 292/501 kB | 43/354 kB Progress (4): 471/780 kB | 100/329 kB | 292/501 kB | 48/354 kB Progress (4): 471/780 kB | 100/329 kB | 292/501 kB | 52/354 kB Progress (4): 488/780 kB | 100/329 kB | 292/501 kB | 52/354 kB Progress (4): 488/780 kB | 100/329 kB | 309/501 kB | 52/354 kB Progress (4): 488/780 kB | 100/329 kB | 309/501 kB | 55/354 kB Progress (4): 504/780 kB | 100/329 kB | 309/501 kB | 55/354 kB Progress (4): 504/780 kB | 100/329 kB | 309/501 kB | 59/354 kB Progress (4): 504/780 kB | 100/329 kB | 325/501 kB | 59/354 kB Progress (4): 504/780 kB | 116/329 kB | 325/501 kB | 59/354 kB Progress (4): 504/780 kB | 116/329 kB | 325/501 kB | 61/354 kB Progress (4): 520/780 kB | 116/329 kB | 325/501 kB | 61/354 kB Progress (4): 520/780 kB | 128/329 kB | 325/501 kB | 61/354 kB Progress (4): 520/780 kB | 128/329 kB | 341/501 kB | 61/354 kB Progress (4): 520/780 kB | 128/329 kB | 341/501 kB | 78/354 kB Progress (4): 520/780 kB | 145/329 kB | 341/501 kB | 78/354 kB Progress (4): 537/780 kB | 145/329 kB | 341/501 kB | 78/354 kB Progress (4): 537/780 kB | 145/329 kB | 358/501 kB | 78/354 kB Progress (4): 537/780 kB | 145/329 kB | 358/501 kB | 94/354 kB Progress (4): 537/780 kB | 161/329 kB | 358/501 kB | 94/354 kB Progress (4): 553/780 kB | 161/329 kB | 358/501 kB | 94/354 kB Progress (4): 553/780 kB | 161/329 kB | 374/501 kB | 94/354 kB Progress (5): 553/780 kB | 161/329 kB | 374/501 kB | 94/354 kB | 6.4 kB Progress (5): 553/780 kB | 161/329 kB | 374/501 kB | 111/354 kB | 6.4 kB Progress (5): 553/780 kB | 178/329 kB | 374/501 kB | 111/354 kB | 6.4 kB Progress (5): 553/780 kB | 178/329 kB | 390/501 kB | 111/354 kB | 6.4 kB Progress (5): 569/780 kB | 178/329 kB | 390/501 kB | 111/354 kB | 6.4 kB Progress (5): 569/780 kB | 194/329 kB | 390/501 kB | 111/354 kB | 6.4 kB Progress (5): 569/780 kB | 194/329 kB | 390/501 kB | 127/354 kB | 6.4 kB Progress (5): 569/780 kB | 194/329 kB | 407/501 kB | 127/354 kB | 6.4 kB Progress (5): 586/780 kB | 194/329 kB | 407/501 kB | 127/354 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 41 kB/s) 2024-09-14T11:10:04.259 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-14T11:10:04.262 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (4): 586/780 kB | 210/329 kB | 407/501 kB | 127/354 kB Progress (4): 586/780 kB | 210/329 kB | 423/501 kB | 127/354 kB Progress (4): 586/780 kB | 210/329 kB | 423/501 kB | 143/354 kB Progress (4): 602/780 kB | 210/329 kB | 423/501 kB | 143/354 kB Progress (4): 602/780 kB | 210/329 kB | 440/501 kB | 143/354 kB Progress (4): 602/780 kB | 227/329 kB | 440/501 kB | 143/354 kB Progress (4): 602/780 kB | 227/329 kB | 440/501 kB | 160/354 kB Progress (4): 619/780 kB | 227/329 kB | 440/501 kB | 160/354 kB Progress (4): 619/780 kB | 227/329 kB | 456/501 kB | 160/354 kB Progress (4): 619/780 kB | 243/329 kB | 456/501 kB | 160/354 kB Progress (4): 619/780 kB | 243/329 kB | 456/501 kB | 176/354 kB Progress (4): 619/780 kB | 243/329 kB | 472/501 kB | 176/354 kB Progress (4): 635/780 kB | 243/329 kB | 472/501 kB | 176/354 kB Progress (4): 635/780 kB | 260/329 kB | 472/501 kB | 176/354 kB Progress (4): 635/780 kB | 260/329 kB | 472/501 kB | 193/354 kB Progress (4): 635/780 kB | 260/329 kB | 489/501 kB | 193/354 kB Progress (4): 651/780 kB | 260/329 kB | 489/501 kB | 193/354 kB Progress (4): 651/780 kB | 276/329 kB | 489/501 kB | 193/354 kB Progress (4): 651/780 kB | 276/329 kB | 501 kB | 193/354 kB Progress (4): 651/780 kB | 276/329 kB | 501 kB | 209/354 kB Progress (4): 668/780 kB | 276/329 kB | 501 kB | 209/354 kB Progress (4): 668/780 kB | 292/329 kB | 501 kB | 209/354 kB Progress (4): 668/780 kB | 292/329 kB | 501 kB | 225/354 kB Progress (4): 684/780 kB | 292/329 kB | 501 kB | 225/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 3.2 MB/s) 2024-09-14T11:10:04.262 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 684/780 kB | 292/329 kB | 242/354 kB Progress (3): 684/780 kB | 309/329 kB | 242/354 kB Progress (3): 701/780 kB | 309/329 kB | 242/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-14T11:10:04.262 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 701/780 kB | 309/329 kB | 258/354 kB Progress (3): 701/780 kB | 325/329 kB | 258/354 kB Progress (3): 717/780 kB | 325/329 kB | 258/354 kB Progress (3): 717/780 kB | 329 kB | 258/354 kB Progress (3): 717/780 kB | 329 kB | 274/354 kB Progress (3): 733/780 kB | 329 kB | 274/354 kB Progress (3): 733/780 kB | 329 kB | 291/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 2.1 MB/s) 2024-09-14T11:10:04.262 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 750/780 kB | 291/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-14T11:10:04.263 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 750/780 kB | 307/354 kB Progress (2): 766/780 kB | 307/354 kB Progress (2): 766/780 kB | 324/354 kB Progress (2): 780 kB | 324/354 kB Progress (2): 780 kB | 340/354 kB Progress (2): 780 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.9 MB/s) 2024-09-14T11:10:04.263 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-14T11:10:04.263 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 2.2 MB/s) 2024-09-14T11:10:04.263 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-14T11:10:04.278 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/586 kB Progress (1): 33/586 kB Progress (1): 49/586 kB Progress (1): 62/586 kB Progress (1): 78/586 kB Progress (1): 95/586 kB Progress (1): 111/586 kB Progress (1): 127/586 kB Progress (1): 144/586 kB Progress (1): 160/586 kB Progress (1): 176/586 kB Progress (1): 193/586 kB Progress (1): 209/586 kB Progress (1): 226/586 kB Progress (1): 242/586 kB Progress (1): 258/586 kB Progress (2): 258/586 kB | 16/211 kB Progress (2): 275/586 kB | 16/211 kB Progress (2): 275/586 kB | 33/211 kB Progress (2): 291/586 kB | 33/211 kB Progress (3): 291/586 kB | 33/211 kB | 14 kB Progress (3): 308/586 kB | 33/211 kB | 14 kB Progress (3): 308/586 kB | 49/211 kB | 14 kB Progress (3): 324/586 kB | 49/211 kB | 14 kB Progress (3): 324/586 kB | 66/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 83 kB/s) 2024-09-14T11:10:04.279 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 340/586 kB | 66/211 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-14T11:10:04.279 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 340/586 kB | 81/211 kB Progress (2): 357/586 kB | 81/211 kB Progress (2): 373/586 kB | 81/211 kB Progress (2): 373/586 kB | 98/211 kB Progress (2): 389/586 kB | 98/211 kB Progress (2): 389/586 kB | 114/211 kB Progress (3): 389/586 kB | 114/211 kB | 16/106 kB Progress (4): 389/586 kB | 114/211 kB | 16/106 kB | 6.8 kB Progress (4): 406/586 kB | 114/211 kB | 16/106 kB | 6.8 kB Progress (4): 406/586 kB | 131/211 kB | 16/106 kB | 6.8 kB Progress (4): 406/586 kB | 131/211 kB | 32/106 kB | 6.8 kB Progress (4): 422/586 kB | 131/211 kB | 32/106 kB | 6.8 kB Progress (4): 422/586 kB | 147/211 kB | 32/106 kB | 6.8 kB Progress (4): 422/586 kB | 147/211 kB | 49/106 kB | 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 39 kB/s) 2024-09-14T11:10:04.279 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-14T11:10:04.280 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 439/586 kB | 147/211 kB | 49/106 kB Progress (3): 439/586 kB | 163/211 kB | 49/106 kB Progress (3): 439/586 kB | 163/211 kB | 65/106 kB Progress (3): 455/586 kB | 163/211 kB | 65/106 kB Progress (3): 455/586 kB | 180/211 kB | 65/106 kB Progress (3): 455/586 kB | 180/211 kB | 81/106 kB Progress (3): 471/586 kB | 180/211 kB | 81/106 kB Progress (3): 471/586 kB | 196/211 kB | 81/106 kB Progress (3): 471/586 kB | 196/211 kB | 98/106 kB Progress (3): 488/586 kB | 196/211 kB | 98/106 kB Progress (3): 488/586 kB | 196/211 kB | 106 kB Progress (3): 488/586 kB | 211 kB | 106 kB Progress (3): 504/586 kB | 211 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 604 kB/s) 2024-09-14T11:10:04.280 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.2 MB/s) 2024-09-14T11:10:04.281 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-14T11:10:04.281 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:10:04.282 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 521/586 kB Progress (1): 537/586 kB Progress (1): 553/586 kB Progress (1): 570/586 kB Progress (1): 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 3.3 MB/s) 2024-09-14T11:10:04.282 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-14T11:10:04.296 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/245 kB Progress (1): 33/245 kB Progress (1): 49/245 kB Progress (1): 63/245 kB Progress (1): 79/245 kB Progress (1): 95/245 kB Progress (1): 112/245 kB Progress (1): 128/245 kB Progress (1): 145/245 kB Progress (1): 161/245 kB Progress (2): 161/245 kB | 16/205 kB Progress (2): 177/245 kB | 16/205 kB Progress (2): 177/245 kB | 33/205 kB Progress (2): 194/245 kB | 33/205 kB Progress (2): 210/245 kB | 33/205 kB Progress (2): 210/245 kB | 49/205 kB Progress (2): 226/245 kB | 49/205 kB Progress (2): 226/245 kB | 65/205 kB Progress (2): 243/245 kB | 65/205 kB Progress (2): 245 kB | 65/205 kB Progress (2): 245 kB | 81/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.3 MB/s) 2024-09-14T11:10:04.296 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-14T11:10:04.296 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 98/205 kB Progress (2): 98/205 kB | 15/15 kB Progress (2): 98/205 kB | 15 kB Progress (2): 114/205 kB | 15 kB Progress (3): 114/205 kB | 15 kB | 16/16 kB Progress (3): 114/205 kB | 15 kB | 16 kB Progress (3): 130/205 kB | 15 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 80 kB/s) 2024-09-14T11:10:04.296 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-14T11:10:04.296 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 87 kB/s) 2024-09-14T11:10:04.296 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 147/205 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-14T11:10:04.297 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 163/205 kB Progress (2): 163/205 kB | 6.4 kB Progress (2): 180/205 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 33 kB/s) 2024-09-14T11:10:04.298 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-14T11:10:04.298 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 1.1 MB/s) 2024-09-14T11:10:04.309 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Progress (2): 24 kB | 16/17 kB Progress (2): 24 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 118 kB/s) 2024-09-14T11:10:04.309 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 85 kB/s) 2024-09-14T11:10:04.314 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/184 kB Progress (1): 33/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 875 kB/s) 2024-09-14T11:10:04.325 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 104 kB/s) 2024-09-14T11:10:04.345 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:04.345 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-14T11:10:04.353 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-14T11:10:04.368 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 364 kB/s) 2024-09-14T11:10:04.371 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-14T11:10:04.387 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-14T11:10:04.389 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-14T11:10:04.404 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/43 kB Progress (1): 33/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.9 MB/s) 2024-09-14T11:10:04.409 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-14T11:10:04.423 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 1.0 MB/s) 2024-09-14T11:10:04.430 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-14T11:10:04.447 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 63/153 kB Progress (1): 80/153 kB Progress (1): 96/153 kB Progress (1): 112/153 kB Progress (1): 129/153 kB Progress (1): 145/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 9.0 MB/s) 2024-09-14T11:10:04.447 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-14T11:10:04.464 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 63/215 kB Progress (1): 80/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 129/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 211/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 13 MB/s) 2024-09-14T11:10:04.502 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:04.502 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:10:04.505 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-14T11:10:04.519 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 190 kB/s) 2024-09-14T11:10:04.520 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-14T11:10:04.535 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.6 MB/s) 2024-09-14T11:10:04.538 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-14T11:10:04.552 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 585 kB/s) 2024-09-14T11:10:04.554 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-14T11:10:04.569 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.8 MB/s) 2024-09-14T11:10:04.572 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-14T11:10:04.586 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:10:04.588 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-14T11:10:04.602 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 230 kB/s) 2024-09-14T11:10:04.605 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-14T11:10:04.619 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-14T11:10:04.621 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-14T11:10:04.634 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-14T11:10:04.635 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-14T11:10:04.649 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.1 MB/s) 2024-09-14T11:10:04.651 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-14T11:10:04.665 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-14T11:10:04.667 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-14T11:10:04.681 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 597 kB/s) 2024-09-14T11:10:04.682 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-14T11:10:04.696 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-14T11:10:04.698 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-14T11:10:04.712 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 572 kB/s) 2024-09-14T11:10:04.715 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-14T11:10:04.729 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.4 MB/s) 2024-09-14T11:10:04.733 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-14T11:10:04.747 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-14T11:10:04.749 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-14T11:10:04.764 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 2.2 MB/s) 2024-09-14T11:10:04.768 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-14T11:10:04.781 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 364 kB/s) 2024-09-14T11:10:04.785 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-14T11:10:04.800 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 6.1 MB/s) 2024-09-14T11:10:04.800 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-14T11:10:04.800 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-14T11:10:04.801 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-14T11:10:04.801 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-14T11:10:04.801 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-14T11:10:04.815 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 192 kB/s) 2024-09-14T11:10:04.815 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/55 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-14T11:10:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 16/55 kB | 16/269 kB Progress (2): 33/55 kB | 16/269 kB Progress (3): 33/55 kB | 16/269 kB | 16/41 kB Progress (3): 49/55 kB | 16/269 kB | 16/41 kB Progress (3): 49/55 kB | 33/269 kB | 16/41 kB Progress (3): 55 kB | 33/269 kB | 16/41 kB Progress (3): 55 kB | 33/269 kB | 33/41 kB Progress (4): 55 kB | 33/269 kB | 33/41 kB | 8.5 kB Progress (4): 55 kB | 33/269 kB | 41 kB | 8.5 kB Progress (4): 55 kB | 49/269 kB | 41 kB | 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 3.9 MB/s) 2024-09-14T11:10:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-14T11:10:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 606 kB/s) 2024-09-14T11:10:04.816 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.7 MB/s) 2024-09-14T11:10:04.821 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 62/269 kB Progress (1): 78/269 kB Progress (1): 95/269 kB Progress (1): 111/269 kB Progress (1): 127/269 kB Progress (1): 144/269 kB Progress (1): 160/269 kB Progress (1): 177/269 kB Progress (1): 193/269 kB Progress (1): 209/269 kB Progress (1): 226/269 kB Progress (1): 242/269 kB Progress (1): 258/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 13 MB/s) 2024-09-14T11:10:04.832 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 65/327 kB Progress (2): 65/327 kB | 16/587 kB Progress (2): 81/327 kB | 16/587 kB Progress (2): 81/327 kB | 33/587 kB Progress (2): 98/327 kB | 33/587 kB Progress (2): 98/327 kB | 49/587 kB Progress (2): 114/327 kB | 49/587 kB Progress (2): 114/327 kB | 66/587 kB Progress (2): 130/327 kB | 66/587 kB Progress (2): 130/327 kB | 81/587 kB Progress (2): 147/327 kB | 81/587 kB Progress (2): 147/327 kB | 97/587 kB Progress (2): 163/327 kB | 97/587 kB Progress (2): 163/327 kB | 113/587 kB Progress (2): 179/327 kB | 113/587 kB Progress (2): 179/327 kB | 130/587 kB Progress (2): 196/327 kB | 130/587 kB Progress (2): 196/327 kB | 146/587 kB Progress (2): 212/327 kB | 146/587 kB Progress (2): 212/327 kB | 163/587 kB Progress (2): 229/327 kB | 163/587 kB Progress (2): 229/327 kB | 179/587 kB Progress (2): 245/327 kB | 179/587 kB Progress (2): 245/327 kB | 195/587 kB Progress (2): 261/327 kB | 195/587 kB Progress (2): 261/327 kB | 212/587 kB Progress (2): 278/327 kB | 212/587 kB Progress (2): 278/327 kB | 228/587 kB Progress (2): 294/327 kB | 228/587 kB Progress (2): 294/327 kB | 244/587 kB Progress (2): 311/327 kB | 244/587 kB Progress (2): 311/327 kB | 261/587 kB Progress (2): 327/327 kB | 261/587 kB Progress (2): 327 kB | 261/587 kB Progress (2): 327 kB | 277/587 kB Progress (2): 327 kB | 294/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 11 MB/s) 2024-09-14T11:10:04.836 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 310/587 kB Progress (1): 326/587 kB Progress (1): 343/587 kB Progress (1): 359/587 kB Progress (1): 376/587 kB Progress (1): 392/587 kB Progress (1): 408/587 kB Progress (1): 425/587 kB Progress (1): 441/587 kB Progress (1): 457/587 kB Progress (1): 474/587 kB Progress (1): 490/587 kB Progress (1): 507/587 kB Progress (1): 523/587 kB Progress (1): 539/587 kB Progress (1): 556/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 17 MB/s) 2024-09-14T11:10:04.876 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:10:04.877 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:04.877 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:10:04.882 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-14T11:10:04.897 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-14T11:10:04.899 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-14T11:10:04.913 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 454 kB/s) 2024-09-14T11:10:04.915 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-14T11:10:04.928 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-14T11:10:04.930 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-14T11:10:04.944 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 1.1 MB/s) 2024-09-14T11:10:04.947 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-14T11:10:04.962 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 54 kB/s) 2024-09-14T11:10:04.964 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-14T11:10:04.980 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 265 kB/s) 2024-09-14T11:10:04.983 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-14T11:10:04.997 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.2 MB/s) 2024-09-14T11:10:05.001 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-14T11:10:05.015 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 355 kB/s) 2024-09-14T11:10:05.017 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-14T11:10:05.031 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 276 kB/s) 2024-09-14T11:10:05.034 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-14T11:10:05.048 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-14T11:10:05.050 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-14T11:10:05.064 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 753 kB/s) 2024-09-14T11:10:05.066 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-14T11:10:05.081 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 1.1 MB/s) 2024-09-14T11:10:05.083 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-14T11:10:05.097 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 469 kB/s) 2024-09-14T11:10:05.100 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-14T11:10:05.114 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 70 kB/s) 2024-09-14T11:10:05.116 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-14T11:10:05.131 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 599 kB/s) 2024-09-14T11:10:05.132 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-14T11:10:05.147 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 191 kB/s) 2024-09-14T11:10:05.149 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-14T11:10:05.163 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 402 kB/s) 2024-09-14T11:10:05.166 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-14T11:10:05.180 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-14T11:10:05.183 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-14T11:10:05.197 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 55 kB/s) 2024-09-14T11:10:05.199 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-14T11:10:05.213 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 402 kB/s) 2024-09-14T11:10:05.215 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-14T11:10:05.229 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.7 MB/s) 2024-09-14T11:10:05.233 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-14T11:10:05.247 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 86 kB/s) 2024-09-14T11:10:05.249 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-14T11:10:05.263 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 88 kB/s) 2024-09-14T11:10:05.271 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-14T11:10:05.286 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 967 kB/s) 2024-09-14T11:10:05.286 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-14T11:10:05.286 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-14T11:10:05.286 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-14T11:10:05.287 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-14T11:10:05.287 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-14T11:10:05.300 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.2 kB Progress (2): 4.2 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 301 kB/s) 2024-09-14T11:10:05.301 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-14T11:10:05.301 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 16/55 kB | 16/122 kB Progress (2): 33/55 kB | 16/122 kB Progress (2): 33/55 kB | 33/122 kB Progress (2): 49/55 kB | 33/122 kB Progress (3): 49/55 kB | 33/122 kB | 16/27 kB Progress (3): 55 kB | 33/122 kB | 16/27 kB Progress (4): 55 kB | 33/122 kB | 16/27 kB | 16/334 kB Progress (4): 55 kB | 33/122 kB | 27 kB | 16/334 kB Progress (4): 55 kB | 49/122 kB | 27 kB | 16/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.9 MB/s) 2024-09-14T11:10:05.301 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-14T11:10:05.301 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 49/122 kB | 27 kB | 33/334 kB Progress (3): 66/122 kB | 27 kB | 33/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.9 MB/s) 2024-09-14T11:10:05.301 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-14T11:10:05.302 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 66/122 kB | 49/334 kB Progress (2): 82/122 kB | 49/334 kB Progress (2): 82/122 kB | 65/334 kB Progress (2): 96/122 kB | 65/334 kB Progress (2): 96/122 kB | 82/334 kB Progress (2): 113/122 kB | 82/334 kB Progress (2): 122 kB | 82/334 kB Progress (2): 122 kB | 98/334 kB Progress (2): 122 kB | 114/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 7.7 MB/s) 2024-09-14T11:10:05.305 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 131/334 kB Progress (1): 147/334 kB Progress (1): 164/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 213/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 295/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 18 MB/s) 2024-09-14T11:10:05.314 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/23 kB Progress (3): 4.7 kB | 16/23 kB | 16/267 kB Progress (3): 4.7 kB | 23 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 166 kB/s) 2024-09-14T11:10:05.314 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 23 kB | 33/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 814 kB/s) 2024-09-14T11:10:05.317 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 256/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.6 MB/s) 2024-09-14T11:10:05.378 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-14T11:10:05.379 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-14T11:10:06.058 INFO:tasks.workunit.client.0.smithi002.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:10:06.058 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:06.058 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:10:06.061 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:10:06.061 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:06.061 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:10:06.068 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-14T11:10:06.068 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-14T11:10:06.304 INFO:tasks.workunit.client.0.smithi002.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-14T11:10:06.305 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:06.305 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:10:06.311 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-14T11:10:06.326 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 416 kB/s) 2024-09-14T11:10:06.331 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-14T11:10:06.346 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 235 kB/s) 2024-09-14T11:10:06.350 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-14T11:10:06.365 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 233 kB/s) 2024-09-14T11:10:06.369 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-14T11:10:06.384 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 290 kB/s) 2024-09-14T11:10:06.387 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-14T11:10:06.402 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 236 kB/s) 2024-09-14T11:10:06.405 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-14T11:10:06.419 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 318 kB/s) 2024-09-14T11:10:06.424 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-14T11:10:06.438 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 126 kB/s) 2024-09-14T11:10:06.441 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-14T11:10:06.454 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 169 kB/s) 2024-09-14T11:10:06.456 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-14T11:10:06.470 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 2.0 MB/s) 2024-09-14T11:10:06.473 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-14T11:10:06.487 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 135 kB/s) 2024-09-14T11:10:06.490 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-14T11:10:06.504 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-14T11:10:06.508 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-14T11:10:06.522 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-14T11:10:06.524 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-14T11:10:06.538 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.6 MB/s) 2024-09-14T11:10:06.540 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-14T11:10:06.554 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.7 MB/s) 2024-09-14T11:10:06.556 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-14T11:10:06.570 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-14T11:10:06.573 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-14T11:10:06.587 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 618 kB/s) 2024-09-14T11:10:06.588 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-14T11:10:06.602 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 2.0 MB/s) 2024-09-14T11:10:06.605 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-14T11:10:06.619 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 576 kB/s) 2024-09-14T11:10:06.623 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-14T11:10:06.637 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-14T11:10:06.640 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-14T11:10:06.654 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-14T11:10:06.661 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-14T11:10:06.672 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 110 kB/s) 2024-09-14T11:10:06.673 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-14T11:10:06.686 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 236 kB/s) 2024-09-14T11:10:06.688 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-14T11:10:06.702 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.5 MB/s) 2024-09-14T11:10:06.704 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-14T11:10:06.717 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 520 kB/s) 2024-09-14T11:10:06.719 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-14T11:10:06.732 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 1.0 MB/s) 2024-09-14T11:10:06.736 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-14T11:10:06.750 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-14T11:10:06.751 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-14T11:10:06.764 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 523 kB/s) 2024-09-14T11:10:06.766 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-14T11:10:06.780 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-14T11:10:06.783 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-14T11:10:06.796 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 148 kB/s) 2024-09-14T11:10:06.799 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-14T11:10:06.814 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 159 kB/s) 2024-09-14T11:10:06.817 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-14T11:10:06.831 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-14T11:10:06.835 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-14T11:10:06.849 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 998 kB/s) 2024-09-14T11:10:06.851 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-14T11:10:06.865 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 1.0 MB/s) 2024-09-14T11:10:06.869 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-14T11:10:06.882 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 959 kB/s) 2024-09-14T11:10:06.884 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-14T11:10:06.899 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/4.8 kB Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 299 kB/s) 2024-09-14T11:10:06.901 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-14T11:10:06.915 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 448 kB/s) 2024-09-14T11:10:06.917 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-14T11:10:06.931 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 2.3 MB/s) 2024-09-14T11:10:06.934 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-14T11:10:06.948 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-14T11:10:06.950 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-14T11:10:06.967 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 871 kB/s) 2024-09-14T11:10:06.970 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-14T11:10:06.983 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 54 kB/s) 2024-09-14T11:10:06.985 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-14T11:10:06.999 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 343 kB/s) 2024-09-14T11:10:07.001 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-14T11:10:07.015 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 565 kB/s) 2024-09-14T11:10:07.018 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-14T11:10:07.032 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 200 kB/s) 2024-09-14T11:10:07.035 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-14T11:10:07.049 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 304 kB/s) 2024-09-14T11:10:07.052 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-14T11:10:07.066 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 158 kB/s) 2024-09-14T11:10:07.068 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-14T11:10:07.082 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 267 kB/s) 2024-09-14T11:10:07.084 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-14T11:10:07.098 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 781 kB/s) 2024-09-14T11:10:07.099 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-14T11:10:07.113 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 962 kB/s) 2024-09-14T11:10:07.115 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-14T11:10:07.129 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.3 MB/s) 2024-09-14T11:10:07.131 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-14T11:10:07.144 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 28 kB/s) 2024-09-14T11:10:07.146 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-14T11:10:07.162 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/6.1 kB Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-14T11:10:07.163 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-14T11:10:07.177 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 524 kB/s) 2024-09-14T11:10:07.178 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-14T11:10:07.192 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-14T11:10:07.194 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-14T11:10:07.210 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-14T11:10:07.212 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-14T11:10:07.226 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.5 MB/s) 2024-09-14T11:10:07.228 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-14T11:10:07.245 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/78 kB Progress (1): 21/78 kB Progress (1): 37/78 kB Progress (1): 41/78 kB Progress (1): 58/78 kB Progress (1): 62/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.6 MB/s) 2024-09-14T11:10:07.249 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-14T11:10:07.263 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-14T11:10:07.266 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-14T11:10:07.280 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 435 kB/s) 2024-09-14T11:10:07.282 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-14T11:10:07.295 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 305 kB/s) 2024-09-14T11:10:07.297 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-14T11:10:07.310 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 228 kB/s) 2024-09-14T11:10:07.312 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-14T11:10:07.325 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 2.0 MB/s) 2024-09-14T11:10:07.328 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-14T11:10:07.341 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 169 kB/s) 2024-09-14T11:10:07.347 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-14T11:10:07.365 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 16 MB/s) 2024-09-14T11:10:07.367 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-14T11:10:07.367 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-14T11:10:07.367 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-14T11:10:07.367 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-14T11:10:07.367 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-14T11:10:07.380 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 971 kB/s) 2024-09-14T11:10:07.380 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-14T11:10:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/171 kB Progress (2): 16/171 kB | 16/26 kB Progress (2): 33/171 kB | 16/26 kB Progress (2): 33/171 kB | 26 kB Progress (2): 49/171 kB | 26 kB Progress (3): 49/171 kB | 26 kB | 16/118 kB Progress (3): 64/171 kB | 26 kB | 16/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.6 MB/s) 2024-09-14T11:10:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-14T11:10:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 81/171 kB | 16/118 kB Progress (2): 81/171 kB | 33/118 kB Progress (2): 97/171 kB | 33/118 kB Progress (2): 113/171 kB | 33/118 kB Progress (2): 113/171 kB | 49/118 kB Progress (2): 130/171 kB | 49/118 kB Progress (2): 130/171 kB | 64/118 kB Progress (2): 146/171 kB | 64/118 kB Progress (2): 163/171 kB | 64/118 kB Progress (2): 163/171 kB | 80/118 kB Progress (2): 171 kB | 80/118 kB Progress (2): 171 kB | 97/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 9.5 MB/s) 2024-09-14T11:10:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 97/118 kB | 8.2 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-14T11:10:07.384 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 113/118 kB | 8.2 kB Progress (2): 118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-14T11:10:07.385 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-14T11:10:07.385 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.2 MB/s) 2024-09-14T11:10:07.385 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-14T11:10:07.398 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/146 kB Progress (1): 33/146 kB Progress (1): 49/146 kB Progress (1): 66/146 kB Progress (1): 82/146 kB Progress (1): 98/146 kB Progress (1): 115/146 kB Progress (2): 115/146 kB | 16/136 kB Progress (2): 131/146 kB | 16/136 kB Progress (2): 131/146 kB | 33/136 kB Progress (2): 146 kB | 33/136 kB Progress (2): 146 kB | 49/136 kB Progress (2): 146 kB | 66/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 5.0 MB/s) 2024-09-14T11:10:07.398 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-14T11:10:07.410 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 82/136 kB Progress (1): 98/136 kB Progress (2): 98/136 kB | 16/61 kB Progress (2): 98/136 kB | 33/61 kB Progress (2): 115/136 kB | 33/61 kB Progress (3): 115/136 kB | 33/61 kB | 16/58 kB Progress (3): 115/136 kB | 49/61 kB | 16/58 kB Progress (3): 115/136 kB | 49/61 kB | 33/58 kB Progress (3): 131/136 kB | 49/61 kB | 33/58 kB Progress (4): 131/136 kB | 49/61 kB | 33/58 kB | 16/501 kB Progress (4): 131/136 kB | 61 kB | 33/58 kB | 16/501 kB Progress (4): 136 kB | 61 kB | 33/58 kB | 16/501 kB Progress (4): 136 kB | 61 kB | 49/58 kB | 16/501 kB Progress (4): 136 kB | 61 kB | 49/58 kB | 33/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 33/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 49/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 65/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 81/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 97/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 114/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 130/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 147/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 163/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 179/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 196/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 212/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 229/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 245/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 261/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 278/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 294/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 310/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 327/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 343/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 360/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 376/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 392/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 409/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 425/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 442/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 458/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 474/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 491/501 kB Progress (4): 136 kB | 61 kB | 58 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.4 MB/s) 2024-09-14T11:10:07.410 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.2 MB/s) 2024-09-14T11:10:07.410 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 12 MB/s) 2024-09-14T11:10:07.410 INFO:tasks.workunit.client.0.smithi002.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.3 MB/s) 2024-09-14T11:10:07.411 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-14T11:10:07.411 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/124 kB Progress (1): 33/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 82/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.7 MB/s) 2024-09-14T11:10:07.465 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 25 MB/s) 2024-09-14T11:10:07.565 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:07.566 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-14T11:10:07.569 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-14T11:10:07.584 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 299 kB/s) 2024-09-14T11:10:07.586 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-14T11:10:07.600 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 350 kB/s) 2024-09-14T11:10:07.602 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-14T11:10:07.629 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 1.6 MB/s) 2024-09-14T11:10:07.631 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-14T11:10:07.645 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.5 MB/s) 2024-09-14T11:10:07.648 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-14T11:10:07.662 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 399 kB/s) 2024-09-14T11:10:07.664 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-14T11:10:07.679 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 261 kB/s) 2024-09-14T11:10:07.684 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-14T11:10:07.695 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 430 kB/s) 2024-09-14T11:10:07.697 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-14T11:10:07.711 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 447 kB/s) 2024-09-14T11:10:07.713 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-14T11:10:07.727 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-14T11:10:07.731 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-14T11:10:07.745 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 1.0 MB/s) 2024-09-14T11:10:07.747 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-14T11:10:07.761 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 146 kB/s) 2024-09-14T11:10:07.763 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-14T11:10:07.776 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 587 kB/s) 2024-09-14T11:10:07.778 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-14T11:10:07.792 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.8 MB/s) 2024-09-14T11:10:07.797 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-14T11:10:07.811 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.6 MB/s) 2024-09-14T11:10:07.812 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-14T11:10:07.812 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-14T11:10:07.812 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-14T11:10:07.812 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-14T11:10:07.812 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-14T11:10:07.827 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/26 kB Progress (2): 16/26 kB | 16/79 kB Progress (2): 26 kB | 16/79 kB Progress (3): 26 kB | 16/79 kB | 16/211 kB Progress (3): 26 kB | 33/79 kB | 16/211 kB Progress (4): 26 kB | 33/79 kB | 16/211 kB | 16/58 kB Progress (5): 26 kB | 33/79 kB | 16/211 kB | 16/58 kB | 0/1.0 MB Progress (5): 26 kB | 49/79 kB | 16/211 kB | 16/58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.7 MB/s) 2024-09-14T11:10:07.827 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (4): 49/79 kB | 33/211 kB | 16/58 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-14T11:10:07.829 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (4): 63/79 kB | 33/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 63/79 kB | 49/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 79 kB | 49/211 kB | 16/58 kB | 0/1.0 MB Progress (4): 79 kB | 49/211 kB | 33/58 kB | 0/1.0 MB Progress (4): 79 kB | 63/211 kB | 33/58 kB | 0/1.0 MB Progress (4): 79 kB | 63/211 kB | 33/58 kB | 0/1.0 MB Progress (4): 79 kB | 63/211 kB | 49/58 kB | 0/1.0 MB Progress (4): 79 kB | 79/211 kB | 49/58 kB | 0/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 5.0 MB/s) 2024-09-14T11:10:07.829 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 79/211 kB | 49/58 kB | 0/1.0 MB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-14T11:10:07.829 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 79/211 kB | 58 kB | 0/1.0 MB Progress (3): 95/211 kB | 58 kB | 0/1.0 MB Progress (3): 95/211 kB | 58 kB | 0.1/1.0 MB Progress (3): 112/211 kB | 58 kB | 0.1/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-14T11:10:07.830 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 112/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 128/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 145/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 161/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 177/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.1/1.0 MB Progress (2): 194/211 kB | 0.2/1.0 MB Progress (2): 210/211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Progress (2): 211 kB | 0.2/1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-14T11:10:07.842 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.3/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (2): 0.9/1.0 MB | 15/116 kB Progress (2): 0.9/1.0 MB | 15/116 kB Progress (2): 0.9/1.0 MB | 31/116 kB Progress (2): 0.9/1.0 MB | 31/116 kB Progress (2): 0.9/1.0 MB | 48/116 kB Progress (2): 0.9/1.0 MB | 48/116 kB Progress (2): 0.9/1.0 MB | 64/116 kB Progress (2): 1.0/1.0 MB | 64/116 kB Progress (2): 1.0/1.0 MB | 64/116 kB Progress (2): 1.0/1.0 MB | 78/116 kB Progress (2): 1.0/1.0 MB | 78/116 kB Progress (3): 1.0/1.0 MB | 78/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 95/116 kB | 16/267 kB Progress (3): 1.0/1.0 MB | 95/116 kB | 16/267 kB Progress (3): 1.0 MB | 95/116 kB | 16/267 kB Progress (3): 1.0 MB | 95/116 kB | 32/267 kB Progress (3): 1.0 MB | 111/116 kB | 32/267 kB Progress (3): 1.0 MB | 116 kB | 32/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 34 MB/s) 2024-09-14T11:10:07.842 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 116 kB | 49/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.9 MB/s) 2024-09-14T11:10:07.845 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 63/267 kB Progress (1): 79/267 kB Progress (1): 96/267 kB Progress (1): 112/267 kB Progress (1): 128/267 kB Progress (1): 145/267 kB Progress (1): 161/267 kB Progress (1): 178/267 kB Progress (1): 194/267 kB Progress (1): 210/267 kB Progress (1): 227/267 kB Progress (1): 243/267 kB Progress (1): 260/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 8.1 MB/s) 2024-09-14T11:10:07.997 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-14T11:10:08.026 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:10:08.026 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:10:08.026 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:10:08.027 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Total time: 5.849 s 2024-09-14T11:10:08.027 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Finished at: 2024-09-14T11:10:08Z 2024-09-14T11:10:08.027 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:10:08.049 INFO:tasks.workunit.client.0.smithi002.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-14T11:10:08.059 INFO:tasks.workunit.client.0.smithi002.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-14T11:10:09.075 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Scanning for projects... 2024-09-14T11:10:09.152 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:09.152 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-14T11:10:09.152 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Building jcksum 1.0 2024-09-14T11:10:09.152 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] from pom.xml 2024-09-14T11:10:09.152 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-14T11:10:09.390 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:09.390 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-14T11:10:09.482 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-14T11:10:09.483 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:09.483 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-14T11:10:09.576 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:10:09.576 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:09.576 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-14T11:10:09.578 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-14T11:10:09.578 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:09.578 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-14T11:10:09.583 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-14T11:10:09.583 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:09.584 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-14T11:10:09.764 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-14T11:10:09.959 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-14T11:10:10.147 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 24 kB/s) 2024-09-14T11:10:10.156 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-14T11:10:10.173 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 154 kB/s) 2024-09-14T11:10:10.178 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-14T11:10:10.195 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 166 kB/s) 2024-09-14T11:10:10.200 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-14T11:10:10.216 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 189 kB/s) 2024-09-14T11:10:10.218 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-14T11:10:10.234 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 200 kB/s) 2024-09-14T11:10:10.237 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-14T11:10:10.252 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 105 kB/s) 2024-09-14T11:10:10.254 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-14T11:10:10.271 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 177 kB/s) 2024-09-14T11:10:10.275 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-14T11:10:10.296 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 16/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.3 MB/s) 2024-09-14T11:10:10.299 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-14T11:10:10.299 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-14T11:10:10.299 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-14T11:10:10.299 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-14T11:10:10.300 INFO:tasks.workunit.client.0.smithi002.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-14T11:10:10.318 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 798 kB/s) 2024-09-14T11:10:10.361 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 1.4/189 kB Progress (2): 1.4/189 kB | 1.4/103 kB Progress (3): 1.4/189 kB | 1.4/103 kB | 1.4/169 kB Progress (4): 1.4/189 kB | 1.4/103 kB | 1.4/169 kB | 1.4/7.7 kB Progress (4): 1.4/189 kB | 1.4/103 kB | 2.8/169 kB | 1.4/7.7 kB Progress (4): 1.4/189 kB | 2.8/103 kB | 2.8/169 kB | 1.4/7.7 kB Progress (4): 2.8/189 kB | 2.8/103 kB | 2.8/169 kB | 1.4/7.7 kB Progress (4): 2.8/189 kB | 4.1/103 kB | 2.8/169 kB | 1.4/7.7 kB Progress (4): 2.8/189 kB | 4.1/103 kB | 4.1/169 kB | 1.4/7.7 kB Progress (4): 2.8/189 kB | 4.1/103 kB | 4.1/169 kB | 2.8/7.7 kB Progress (4): 2.8/189 kB | 4.1/103 kB | 5.5/169 kB | 2.8/7.7 kB Progress (4): 2.8/189 kB | 5.5/103 kB | 5.5/169 kB | 2.8/7.7 kB Progress (4): 4.1/189 kB | 5.5/103 kB | 5.5/169 kB | 2.8/7.7 kB Progress (4): 4.1/189 kB | 6.9/103 kB | 5.5/169 kB | 2.8/7.7 kB Progress (4): 4.1/189 kB | 6.9/103 kB | 6.9/169 kB | 2.8/7.7 kB Progress (4): 4.1/189 kB | 6.9/103 kB | 6.9/169 kB | 4.1/7.7 kB Progress (4): 4.1/189 kB | 6.9/103 kB | 8.3/169 kB | 4.1/7.7 kB Progress (4): 4.1/189 kB | 8.3/103 kB | 8.3/169 kB | 4.1/7.7 kB Progress (4): 5.5/189 kB | 8.3/103 kB | 8.3/169 kB | 4.1/7.7 kB Progress (4): 5.5/189 kB | 9.7/103 kB | 8.3/169 kB | 4.1/7.7 kB Progress (4): 5.5/189 kB | 9.7/103 kB | 9.7/169 kB | 4.1/7.7 kB Progress (4): 5.5/189 kB | 9.7/103 kB | 9.7/169 kB | 5.5/7.7 kB Progress (4): 5.5/189 kB | 9.7/103 kB | 11/169 kB | 5.5/7.7 kB Progress (4): 5.5/189 kB | 11/103 kB | 11/169 kB | 5.5/7.7 kB Progress (4): 6.9/189 kB | 11/103 kB | 11/169 kB | 5.5/7.7 kB Progress (4): 6.9/189 kB | 12/103 kB | 11/169 kB | 5.5/7.7 kB Progress (4): 6.9/189 kB | 12/103 kB | 12/169 kB | 5.5/7.7 kB Progress (4): 6.9/189 kB | 12/103 kB | 12/169 kB | 6.9/7.7 kB Progress (4): 6.9/189 kB | 12/103 kB | 14/169 kB | 6.9/7.7 kB Progress (4): 6.9/189 kB | 14/103 kB | 14/169 kB | 6.9/7.7 kB Progress (4): 8.3/189 kB | 14/103 kB | 14/169 kB | 6.9/7.7 kB Progress (4): 8.3/189 kB | 15/103 kB | 14/169 kB | 6.9/7.7 kB Progress (4): 8.3/189 kB | 15/103 kB | 15/169 kB | 6.9/7.7 kB Progress (4): 8.3/189 kB | 15/103 kB | 15/169 kB | 7.7 kB Progress (4): 8.3/189 kB | 15/103 kB | 17/169 kB | 7.7 kB Progress (4): 8.3/189 kB | 16/103 kB | 17/169 kB | 7.7 kB Progress (4): 9.7/189 kB | 16/103 kB | 17/169 kB | 7.7 kB Progress (4): 9.7/189 kB | 18/103 kB | 17/169 kB | 7.7 kB Progress (4): 9.7/189 kB | 18/103 kB | 18/169 kB | 7.7 kB Progress (4): 9.7/189 kB | 19/103 kB | 18/169 kB | 7.7 kB Progress (4): 11/189 kB | 19/103 kB | 18/169 kB | 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 123 kB/s) 2024-09-14T11:10:10.383 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (3): 11/189 kB | 21/103 kB | 18/169 kB Progress (3): 11/189 kB | 21/103 kB | 19/169 kB Progress (3): 11/189 kB | 22/103 kB | 19/169 kB Progress (3): 12/189 kB | 22/103 kB | 19/169 kB Progress (3): 12/189 kB | 23/103 kB | 19/169 kB Progress (3): 12/189 kB | 23/103 kB | 21/169 kB Progress (3): 12/189 kB | 25/103 kB | 21/169 kB Progress (3): 14/189 kB | 25/103 kB | 21/169 kB Progress (3): 14/189 kB | 26/103 kB | 21/169 kB Progress (3): 14/189 kB | 26/103 kB | 22/169 kB Progress (3): 14/189 kB | 27/103 kB | 22/169 kB Progress (3): 15/189 kB | 27/103 kB | 22/169 kB Progress (3): 15/189 kB | 29/103 kB | 22/169 kB Progress (3): 15/189 kB | 29/103 kB | 23/169 kB Progress (3): 15/189 kB | 30/103 kB | 23/169 kB Progress (3): 16/189 kB | 30/103 kB | 23/169 kB Progress (3): 16/189 kB | 32/103 kB | 23/169 kB Progress (3): 16/189 kB | 32/103 kB | 25/169 kB Progress (3): 16/189 kB | 33/103 kB | 25/169 kB Progress (3): 18/189 kB | 33/103 kB | 25/169 kB Progress (3): 18/189 kB | 34/103 kB | 25/169 kB Progress (3): 18/189 kB | 34/103 kB | 26/169 kB Progress (3): 18/189 kB | 36/103 kB | 26/169 kB Progress (3): 19/189 kB | 36/103 kB | 26/169 kB Progress (3): 19/189 kB | 37/103 kB | 26/169 kB Progress (3): 19/189 kB | 37/103 kB | 28/169 kB Progress (3): 19/189 kB | 38/103 kB | 28/169 kB Progress (3): 21/189 kB | 38/103 kB | 28/169 kB Progress (3): 21/189 kB | 40/103 kB | 28/169 kB Progress (3): 21/189 kB | 40/103 kB | 29/169 kB Progress (3): 21/189 kB | 41/103 kB | 29/169 kB Progress (3): 22/189 kB | 41/103 kB | 29/169 kB Progress (3): 22/189 kB | 43/103 kB | 29/169 kB Progress (3): 22/189 kB | 43/103 kB | 30/169 kB Progress (3): 22/189 kB | 44/103 kB | 30/169 kB Progress (3): 23/189 kB | 44/103 kB | 30/169 kB Progress (3): 23/189 kB | 45/103 kB | 30/169 kB Progress (3): 23/189 kB | 45/103 kB | 32/169 kB Progress (3): 23/189 kB | 47/103 kB | 32/169 kB Progress (3): 25/189 kB | 47/103 kB | 32/169 kB Progress (3): 25/189 kB | 48/103 kB | 32/169 kB Progress (3): 25/189 kB | 48/103 kB | 33/169 kB Progress (3): 25/189 kB | 49/103 kB | 33/169 kB Progress (3): 26/189 kB | 49/103 kB | 33/169 kB Progress (3): 26/189 kB | 51/103 kB | 33/169 kB Progress (3): 27/189 kB | 51/103 kB | 33/169 kB Progress (3): 27/189 kB | 52/103 kB | 33/169 kB Progress (3): 29/189 kB | 52/103 kB | 33/169 kB Progress (3): 29/189 kB | 54/103 kB | 33/169 kB Progress (3): 29/189 kB | 54/103 kB | 49/169 kB Progress (3): 29/189 kB | 55/103 kB | 49/169 kB Progress (3): 30/189 kB | 55/103 kB | 49/169 kB Progress (3): 30/189 kB | 56/103 kB | 49/169 kB Progress (3): 31/189 kB | 56/103 kB | 49/169 kB Progress (3): 31/189 kB | 58/103 kB | 49/169 kB Progress (3): 31/189 kB | 59/103 kB | 49/169 kB Progress (3): 31/189 kB | 59/103 kB | 66/169 kB Progress (3): 33/189 kB | 59/103 kB | 66/169 kB Progress (3): 33/189 kB | 61/103 kB | 66/169 kB Progress (3): 34/189 kB | 61/103 kB | 66/169 kB Progress (3): 34/189 kB | 62/103 kB | 66/169 kB Progress (3): 36/189 kB | 62/103 kB | 66/169 kB Progress (3): 36/189 kB | 62/103 kB | 66/169 kB Progress (3): 37/189 kB | 62/103 kB | 66/169 kB Progress (3): 38/189 kB | 62/103 kB | 66/169 kB Progress (3): 38/189 kB | 79/103 kB | 66/169 kB Progress (3): 40/189 kB | 79/103 kB | 66/169 kB Progress (3): 41/189 kB | 79/103 kB | 66/169 kB Progress (3): 42/189 kB | 79/103 kB | 66/169 kB Progress (3): 44/189 kB | 79/103 kB | 66/169 kB Progress (3): 45/189 kB | 79/103 kB | 66/169 kB Progress (3): 47/189 kB | 79/103 kB | 66/169 kB Progress (3): 48/189 kB | 79/103 kB | 66/169 kB Progress (3): 49/189 kB | 79/103 kB | 66/169 kB Progress (3): 51/189 kB | 79/103 kB | 66/169 kB Progress (3): 51/189 kB | 95/103 kB | 66/169 kB Progress (3): 52/189 kB | 95/103 kB | 66/169 kB Progress (3): 52/189 kB | 103 kB | 66/169 kB Progress (3): 52/189 kB | 103 kB | 82/169 kB Progress (3): 53/189 kB | 103 kB | 82/169 kB Progress (3): 55/189 kB | 103 kB | 82/169 kB Progress (3): 55/189 kB | 103 kB | 98/169 kB Progress (3): 56/189 kB | 103 kB | 98/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-14T11:10:10.406 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (2): 58/189 kB | 98/169 kB Progress (2): 59/189 kB | 98/169 kB Progress (2): 60/189 kB | 98/169 kB Progress (2): 62/189 kB | 98/169 kB Progress (2): 63/189 kB | 98/169 kB Progress (2): 64/189 kB | 98/169 kB Progress (2): 81/189 kB | 98/169 kB Progress (2): 97/189 kB | 98/169 kB Progress (2): 97/189 kB | 115/169 kB Progress (2): 112/189 kB | 115/169 kB Progress (2): 128/189 kB | 115/169 kB Progress (2): 128/189 kB | 131/169 kB Progress (2): 128/189 kB | 147/169 kB Progress (2): 128/189 kB | 164/169 kB Progress (2): 145/189 kB | 164/169 kB Progress (2): 145/189 kB | 169 kB Progress (2): 161/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.6 MB/s) 2024-09-14T11:10:10.408 INFO:tasks.workunit.client.0.smithi002.stdout:Progress (1): 178/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 1.7 MB/s) 2024-09-14T11:10:10.422 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:10.422 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:10:10.422 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] T E S T S 2024-09-14T11:10:10.422 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------- 2024-09-14T11:10:10.875 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-14T11:10:10.999 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjects.java: starting test run: 2024-09-14T11:10:11.000 INFO:tasks.workunit.client.0.smithi002.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-14T11:10:11.000 INFO:tasks.workunit.client.0.smithi002.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-14T11:10:11.000 INFO:tasks.workunit.client.0.smithi002.stdout: EndpointUrl=https://smithi002.front.sepia.ceph.com:443 2024-09-14T11:10:11.000 INFO:tasks.workunit.client.0.smithi002.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-14T11:10:11.097 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Environment Variables Read 2024-09-14T11:10:11.398 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: S3 Client Initialized 2024-09-14T11:10:11.398 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Generating File 2024-09-14T11:10:11.398 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: File Generated 2024-09-14T11:10:11.398 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Generating File 2024-09-14T11:10:11.398 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: File Generated 2024-09-14T11:10:11.398 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Generating File 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: File Generated 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Generating File 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: File Generated 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Generating File 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: File Generated 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Generating File 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: File Generated 2024-09-14T11:10:11.498 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Generated Big Files 2024-09-14T11:10:11.744 INFO:tasks.workunit.client.0.smithi002.stdout:HeadBucketResponse() 2024-09-14T11:10:11.744 INFO:tasks.workunit.client.0.smithi002.stdout:sheik is ready 2024-09-14T11:10:11.744 INFO:tasks.workunit.client.0.smithi002.stdout:DEBUG: Test Bucket Created 2024-09-14T11:10:11.798 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-14T11:10:11.898 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-14T11:10:11.991 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-14T11:10:11.998 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-14T11:10:12.085 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-14T11:10:12.098 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-14T11:10:12.198 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-14T11:10:12.298 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-14T11:10:12.399 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-14T11:10:12.499 INFO:tasks.workunit.client.0.smithi002.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-14T11:10:14.004 INFO:tasks.workunit.client.0.smithi002.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-14T11:10:14.404 INFO:tasks.workunit.client.0.smithi002.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-14T11:10:16.446 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-0b 2024-09-14T11:10:16.447 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-8b 2024-09-14T11:10:16.447 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-200b 2024-09-14T11:10:16.448 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-21983b 2024-09-14T11:10:16.449 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-5519b 2024-09-14T11:10:16.450 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-204329b 2024-09-14T11:10:16.451 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-256k 2024-09-14T11:10:16.452 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-1m 2024-09-14T11:10:16.453 INFO:tasks.workunit.client.0.smithi002.stdout:arg: file-1038757b 2024-09-14T11:10:16.488 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-0b 2024-09-14T11:10:16.488 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.508 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-8b 2024-09-14T11:10:16.508 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.602 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-200b 2024-09-14T11:10:16.602 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.608 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-21983b 2024-09-14T11:10:16.661 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.709 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-5519b 2024-09-14T11:10:16.709 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.745 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-204329b 2024-09-14T11:10:16.745 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.777 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-256k 2024-09-14T11:10:16.777 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.809 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-1m 2024-09-14T11:10:16.828 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:16.909 INFO:tasks.workunit.client.0.smithi002.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-14T11:10:16.909 INFO:tasks.workunit.client.0.smithi002.stdout:PutObjectResponse 2024-09-14T11:10:17.009 INFO:tasks.workunit.client.0.smithi002.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-14T11:10:17.209 INFO:tasks.workunit.client.0.smithi002.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-14T11:10:17.610 INFO:tasks.workunit.client.0.smithi002.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-14T11:10:20.019 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.143 s -- in io.ceph.jcksum.PutObjects 2024-09-14T11:10:20.041 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:20.041 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Results: 2024-09-14T11:10:20.041 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:20.041 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-14T11:10:20.041 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] 2024-09-14T11:10:20.044 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:10:20.044 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] BUILD SUCCESS 2024-09-14T11:10:20.044 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:10:20.045 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Total time: 10.989 s 2024-09-14T11:10:20.045 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] Finished at: 2024-09-14T11:10:20Z 2024-09-14T11:10:20.045 INFO:tasks.workunit.client.0.smithi002.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-14T11:10:20.058 INFO:tasks.workunit.client.0.smithi002.stderr:+ exit 2024-09-14T11:10:20.058 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:10:20.058 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:10:20.138 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-14T11:10:20.138 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:10:20.540 DEBUG:teuthology.parallel:result is None 2024-09-14T11:10:20.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:10:20.580 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:10:20.580 DEBUG:teuthology.orchestra.run.smithi002:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:20.649 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:10:20.650 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:10:20.659 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:10:20.659 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:10:20.659 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:20.719 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:10:20.719 INFO:teuthology.orchestra.run.smithi002.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:10:20.720 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:20.789 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:10:20.789 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:10:20.859 INFO:tasks.workunit:timeout=3h 2024-09-14T11:10:20.860 INFO:tasks.workunit:cleanup=True 2024-09-14T11:10:20.860 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:10:20.931 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:11:17.867 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 93% (12043/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:11:18.498 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:11:18.498 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:11:18.498 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:11:18.498 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:11:18.498 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:11:18.499 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:11:18.501 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:11:18.573 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:11:18.574 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:11:18.574 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:11:18.623 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:11:18.673 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:11:18.714 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:11:18.715 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:11:18.715 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:11:18.757 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:11:18.758 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:11:18.758 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:11:18.829 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-14T11:11:18.830 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-14T11:11:18.830 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-14T11:11:18.906 INFO:tasks.workunit.client.0.smithi002.stdout:INFO: fully qualified domain name: smithi002.front.sepia.ceph.com 2024-09-14T11:11:18.906 INFO:tasks.workunit.client.0.smithi002.stdout:== TESTING *ABORTING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-14T11:11:18.906 INFO:tasks.workunit.client.0.smithi002.stdout:== TESTING VERSIONED BUCKET == 2024-09-14T11:11:21.514 INFO:tasks.workunit.client.0.smithi002.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:11:21.701 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting pip 2024-09-14T11:11:21.707 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:11:21.754 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: pip 2024-09-14T11:11:21.754 INFO:tasks.workunit.client.0.smithi002.stdout: Attempting uninstall: pip 2024-09-14T11:11:21.754 INFO:tasks.workunit.client.0.smithi002.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:11:21.917 INFO:tasks.workunit.client.0.smithi002.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:11:21.923 INFO:tasks.workunit.client.0.smithi002.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:11:22.698 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed pip-24.2 2024-09-14T11:11:23.551 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting boto3 2024-09-14T11:11:23.552 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:11:24.104 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:11:24.106 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:11:24.157 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:11:24.158 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:11:24.204 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:11:24.205 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:11:24.255 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:11:24.256 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:11:24.325 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:11:24.326 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:11:24.527 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:11:24.528 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:11:24.533 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:11:24.534 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:11:24.544 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:11:24.545 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:11:24.546 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:11:24.548 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:11:24.549 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:11:24.626 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:11:25.690 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:11:26.130 INFO:tasks.workunit.client.0.smithi002.stdout:INFO: creating user 2024-09-14T11:11:26.445 INFO:tasks.workunit.client.0.smithi002.stdout:{ 2024-09-14T11:11:26.445 INFO:tasks.workunit.client.0.smithi002.stdout: "user_id": "testid", 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "display_name": "M. Tester", 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "email": "tester@ceph.com", 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "suspended": 0, 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "subusers": [], 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "keys": [ 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: { 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "user": "testid", 2024-09-14T11:11:26.446 INFO:tasks.workunit.client.0.smithi002.stdout: "access_key": "0555b35654ad1656d804", 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "active": true, 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "create_date": "2024-09-14T11:11:26.441899Z" 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: } 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: ], 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "swift_keys": [], 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "caps": [], 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "default_placement": "", 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "placement_tags": [], 2024-09-14T11:11:26.447 INFO:tasks.workunit.client.0.smithi002.stdout: "bucket_quota": { 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "enabled": false, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size": -1, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "max_objects": -1 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "user_quota": { 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "enabled": false, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size": -1, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: "max_objects": -1 2024-09-14T11:11:26.448 INFO:tasks.workunit.client.0.smithi002.stdout: }, 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "type": "rgw", 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "account_id": "", 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "path": "/", 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "create_date": "2024-09-14T11:11:26.441889Z", 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "tags": [], 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: "group_ids": [] 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout:} 2024-09-14T11:11:26.449 INFO:tasks.workunit.client.0.smithi002.stdout: 2024-09-14T11:11:33.766 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:33.766 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:33.782 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:33.782 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:33.802 INFO:tasks.workunit.client.0.smithi002.stderr:5+0 records in 2024-09-14T11:11:33.802 INFO:tasks.workunit.client.0.smithi002.stderr:5+0 records out 2024-09-14T11:11:33.802 INFO:tasks.workunit.client.0.smithi002.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0149425 s, 351 MB/s 2024-09-14T11:11:33.806 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:33.806 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:33.863 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:33.863 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:34.049 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:34.049 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:34.232 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:34.232 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:34.417 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:34.417 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:34.602 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:34.602 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:34.783 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:34.784 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:34.971 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:35.153 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:35.154 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:35.332 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:35.332 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:35.517 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:35.517 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:35.697 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:35.697 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:35.886 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:35.886 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:36.074 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:36.249 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:11:36.250 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:11:36.259 INFO:tasks.workunit.client.0.smithi002.stdout:bucket nams is reupload-bkt-121109 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:endpoint is https://smithi002.front.sepia.ceph.com:443 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:start UploadId=2~brktbrZvpJ3ln_JB3LazUf8Pn9_-V5D 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 1 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 1 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 2} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.260 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.261 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.261 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.261 INFO:tasks.workunit.client.0.smithi002.stdout:phase 2 uploaded part {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1} 2024-09-14T11:11:36.261 INFO:tasks.workunit.client.0.smithi002.stdout:aborting multipart upload, parts=[{'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 1}, {'ETag': '"5e4fe5ac4ba796ce580cc80629184371"', 'PartNumber': 2}] 2024-09-14T11:11:37.482 INFO:tasks.workunit.client.0.smithi002.stdout:radosgw-admin bucket radoslist: 2024-09-14T11:11:37.545 INFO:tasks.workunit.client.0.smithi002.stdout:rados ls: 2024-09-14T11:11:37.559 INFO:tasks.workunit.client.0.smithi002.stdout:== PASSED == 2024-09-14T11:11:37.559 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:11:37.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:11:37.638 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-14T11:11:37.638 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:11:38.044 DEBUG:teuthology.parallel:result is None 2024-09-14T11:11:38.044 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:38.087 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:38.087 DEBUG:teuthology.orchestra.run.smithi002:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:11:38.156 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:11:38.157 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-14T11:11:38.170 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'default-branch': 'ceph-master', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-14T11:11:38.171 INFO:tasks.ragweed:Downloading ragweed... 2024-09-14T11:11:38.171 INFO:tasks.ragweed:Using branch 'main' for ragweed 2024-09-14T11:11:38.171 DEBUG:teuthology.orchestra.run.smithi002:> git clone -b main https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:11:38.226 INFO:teuthology.orchestra.run.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:11:38.254 INFO:teuthology.orchestra.run.smithi002.stderr:fatal: Remote branch main not found in upstream origin 2024-09-14T11:11:38.254 DEBUG:teuthology.orchestra.run:got remote process result: 128 2024-09-14T11:11:38.256 INFO:tasks.ragweed:Using branch 'ceph-master' for ragweed 2024-09-14T11:11:38.256 DEBUG:teuthology.orchestra.run.smithi002:> git clone -b ceph-master https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:11:38.326 INFO:teuthology.orchestra.run.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-14T11:11:38.500 INFO:tasks.ragweed:Creating rgw users... 2024-09-14T11:11:38.500 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-14T11:11:38.500 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key FHABLEBNSOJWHVKHJJXQ --secret UcqV06McEVM+kotDTLRubczSq6uDZyHIjC5U5VOLhdzfRwwdwFIk9Q== --email ragweed.client.0+test@test.test --system false 2024-09-14T11:11:38.608 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:38.609 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:38.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.645+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 20 realm 2024-09-14T11:11:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.647+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.648+0000 7f718f12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:38.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.648+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.649+0000 7f718f12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:38.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.649+0000 7f718f12c800 20 searching for the correct realm 2024-09-14T11:11:38.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.652+0000 7f718a64e640 0 -- 172.21.15.2:0/1051014845 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f717c07b030 msgr2=0x7f717c08b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:38.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.656+0000 7f718ae4f640 0 -- 172.21.15.2:0/1051014845 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f718009a920 msgr2=0x7f718007d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:38.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.862+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:38.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 zone default found 2024-09-14T11:11:38.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 4 Realm: () 2024-09-14T11:11:38.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 zonegroup default 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.863+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.864+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.864+0000 7f718f12c800 20 started sync module instance, tier type = 2024-09-14T11:11:38.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.864+0000 7f718f12c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:11:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.874+0000 7f718f12c800 20 add_watcher() i=0 2024-09-14T11:11:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.874+0000 7f718f12c800 20 add_watcher() i=1 2024-09-14T11:11:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.874+0000 7f718f12c800 20 add_watcher() i=2 2024-09-14T11:11:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.874+0000 7f718f12c800 20 add_watcher() i=3 2024-09-14T11:11:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.874+0000 7f718f12c800 20 add_watcher() i=4 2024-09-14T11:11:38.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.874+0000 7f718f12c800 20 add_watcher() i=5 2024-09-14T11:11:38.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.874+0000 7f718f12c800 20 add_watcher() i=6 2024-09-14T11:11:38.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.875+0000 7f718f12c800 20 add_watcher() i=7 2024-09-14T11:11:38.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.875+0000 7f718f12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:38.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f70417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f718f12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f718f12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f718f12c800 5 note: GC not initialized 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f6fbbfff640 20 reqs_thread_entry: start 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f718f12c800 20 init_complete bucket index max shards: 1 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f718f12c800 20 Filter name: none 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f6fb9ffb640 20 reqs_thread_entry: start 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f718f12c800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:11:38.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.877+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 10 cache get: name=default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ : miss 2024-09-14T11:11:38.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.878+0000 7f718f12c800 20 rados->read ofs=0 len=0 2024-09-14T11:11:38.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.879+0000 7f718f12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:38.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.879+0000 7f718f12c800 10 cache put: name=default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ info.flags=0x0 2024-09-14T11:11:38.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.879+0000 7f718f12c800 10 adding default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ to cache LRU end 2024-09-14T11:11:38.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.879+0000 7f718f12c800 10 cache get: name=default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ : hit (negative entry) 2024-09-14T11:11:38.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.879+0000 7f718f12c800 10 cache get: name=default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ : hit (negative entry) 2024-09-14T11:11:38.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.880+0000 7f718f12c800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:11:38.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.880+0000 7f718f12c800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:11:38.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.880+0000 7f718f12c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:11:38.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.881+0000 7f706dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725953 cookie 94748626922752 notifier 5633 bl.length()=675 2024-09-14T11:11:38.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.881+0000 7f706dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-14T11:11:38.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.881+0000 7f706dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:11:38.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.883+0000 7f718f12c800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:38.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.883+0000 7f718f12c800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:11:38.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.883+0000 7f718f12c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:11:38.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.883+0000 7f706dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725895 cookie 94748626916560 notifier 5633 bl.length()=202 2024-09-14T11:11:38.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.883+0000 7f706dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:38.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.883+0000 7f706dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-14T11:11:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.885+0000 7f718f12c800 10 cache put: name=default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ info.flags=0x7 2024-09-14T11:11:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.885+0000 7f718f12c800 10 moving default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ to cache LRU end 2024-09-14T11:11:38.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.885+0000 7f718f12c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:FHABLEBNSOJWHVKHJJXQ, ofs0, ns] 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.885+0000 7f706dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725954 cookie 94748626906784 notifier 5633 bl.length()=190 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.885+0000 7f706dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ info.flags=0x7 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.885+0000 7f706dffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FHABLEBNSOJWHVKHJJXQ to cache LRU end 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "ragweed.client.0", 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:11:38.885 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "ragweed.client.0", 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "FHABLEBNSOJWHVKHJJXQ", 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "UcqV06McEVM+kotDTLRubczSq6uDZyHIjC5U5VOLhdzfRwwdwFIk9Q==", 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:11:38.880856Z" 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:11:38.886 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:11:38.887 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "rgw", 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "", 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:11:38.880842Z", 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:11:38.888 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:11:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.886+0000 7f70417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.889+0000 7f718f12c800 20 remove_watcher() i=0 2024-09-14T11:11:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.889+0000 7f718f12c800 2 removed watcher, disabling cache 2024-09-14T11:11:38.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.890+0000 7f718f12c800 20 remove_watcher() i=1 2024-09-14T11:11:38.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.891+0000 7f718f12c800 20 remove_watcher() i=2 2024-09-14T11:11:38.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.892+0000 7f718f12c800 20 remove_watcher() i=3 2024-09-14T11:11:38.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.893+0000 7f718f12c800 20 remove_watcher() i=4 2024-09-14T11:11:38.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.894+0000 7f718f12c800 20 remove_watcher() i=5 2024-09-14T11:11:38.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.895+0000 7f718f12c800 20 remove_watcher() i=6 2024-09-14T11:11:38.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:38.896+0000 7f718f12c800 20 remove_watcher() i=7 2024-09-14T11:11:38.906 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-14T11:11:38.906 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key RCNHIATHCHKWSNVCLXXL --secret xMaLDbQpeqzpCui1eSXz2rF6sB9r3TfNV1DG78lkGDwKGYKANDOPRA== --email sysuser.client.0+test@test.test --system true 2024-09-14T11:11:38.974 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:11:38.975 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:11:39.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.011+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 20 realm 2024-09-14T11:11:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:11:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.013+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.014+0000 7feacda0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.014+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.014+0000 7feacda0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:11:39.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.014+0000 7feacda0f800 20 searching for the correct realm 2024-09-14T11:11:39.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.018+0000 7feac9993640 0 -- 172.21.15.2:0/3653401372 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7feac0025020 msgr2=0x7feac0061e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:39.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.021+0000 7feac9192640 0 -- 172.21.15.2:0/3653401372 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7feac004ab00 msgr2=0x7feac006bfe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:11:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:11:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:11:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:11:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:11:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:11:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:11:39.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 zone default found 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 4 Realm: () 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 zonegroup default 2024-09-14T11:11:39.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.228+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.229+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.229+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.229+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.229+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.229+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.229+0000 7feacda0f800 20 started sync module instance, tier type = 2024-09-14T11:11:39.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.229+0000 7feacda0f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:11:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.240+0000 7feacda0f800 20 add_watcher() i=0 2024-09-14T11:11:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.240+0000 7feacda0f800 20 add_watcher() i=1 2024-09-14T11:11:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.240+0000 7feacda0f800 20 add_watcher() i=2 2024-09-14T11:11:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.240+0000 7feacda0f800 20 add_watcher() i=3 2024-09-14T11:11:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.240+0000 7feacda0f800 20 add_watcher() i=4 2024-09-14T11:11:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.240+0000 7feacda0f800 20 add_watcher() i=5 2024-09-14T11:11:39.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.240+0000 7feacda0f800 20 add_watcher() i=6 2024-09-14T11:11:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.241+0000 7feacda0f800 20 add_watcher() i=7 2024-09-14T11:11:39.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.241+0000 7feacda0f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:11:39.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7fe97ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7feacda0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7feacda0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7feacda0f800 5 note: GC not initialized 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7fe97efe5640 20 reqs_thread_entry: start 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7feacda0f800 20 init_complete bucket index max shards: 1 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7feacda0f800 20 Filter name: none 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7fe97cfe1640 20 reqs_thread_entry: start 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7feacda0f800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:11:39.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.243+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 cache get: name=default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL : miss 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 20 rados->read ofs=0 len=0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 cache put: name=default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL info.flags=0x0 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 adding default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL to cache LRU end 2024-09-14T11:11:39.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 cache get: name=default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL : hit (negative entry) 2024-09-14T11:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.244+0000 7feacda0f800 10 cache get: name=default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL : hit (negative entry) 2024-09-14T11:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.246+0000 7feacda0f800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.246+0000 7feacda0f800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.246+0000 7feacda0f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.246+0000 7fe9acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725896 cookie 94401471747872 notifier 5904 bl.length()=675 2024-09-14T11:11:39.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.246+0000 7fe9acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-14T11:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.246+0000 7fe9acff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.248+0000 7feacda0f800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.248+0000 7feacda0f800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.248+0000 7feacda0f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.248+0000 7fe9acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725955 cookie 94401471755328 notifier 5904 bl.length()=202 2024-09-14T11:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.248+0000 7fe9acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-14T11:11:39.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.248+0000 7fe9acff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-14T11:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.250+0000 7feacda0f800 10 cache put: name=default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL info.flags=0x7 2024-09-14T11:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.250+0000 7feacda0f800 10 moving default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL to cache LRU end 2024-09-14T11:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.250+0000 7feacda0f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:RCNHIATHCHKWSNVCLXXL, ofs0, ns] 2024-09-14T11:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.250+0000 7fe9acff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1086626725956 cookie 94401471737216 notifier 5904 bl.length()=190 2024-09-14T11:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.250+0000 7fe9acff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL info.flags=0x7 2024-09-14T11:11:39.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.250+0000 7fe9acff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RCNHIATHCHKWSNVCLXXL to cache LRU end 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "sysuser.client.0", 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "sysuser.client.0", 2024-09-14T11:11:39.250 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "RCNHIATHCHKWSNVCLXXL", 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "xMaLDbQpeqzpCui1eSXz2rF6sB9r3TfNV1DG78lkGDwKGYKANDOPRA==", 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:11:39.246455Z" 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "system": true, 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:11:39.251 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:11:39.252 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "rgw", 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "", 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:11:39.246439Z", 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:11:39.253 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:11:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.251+0000 7fe97ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:11:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.254+0000 7feacda0f800 20 remove_watcher() i=0 2024-09-14T11:11:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.254+0000 7feacda0f800 2 removed watcher, disabling cache 2024-09-14T11:11:39.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.255+0000 7feacda0f800 20 remove_watcher() i=1 2024-09-14T11:11:39.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.256+0000 7feacda0f800 20 remove_watcher() i=2 2024-09-14T11:11:39.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.257+0000 7feacda0f800 20 remove_watcher() i=3 2024-09-14T11:11:39.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.259+0000 7feacda0f800 20 remove_watcher() i=4 2024-09-14T11:11:39.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.259+0000 7feacda0f800 20 remove_watcher() i=5 2024-09-14T11:11:39.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.260+0000 7feacda0f800 20 remove_watcher() i=6 2024-09-14T11:11:39.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:11:39.261+0000 7feacda0f800 20 remove_watcher() i=7 2024-09-14T11:11:39.272 INFO:tasks.ragweed:Configuring ragweed... 2024-09-14T11:11:39.272 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:11:39.272 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-14T11:11:39.301 INFO:tasks.ragweed:Configuring boto... 2024-09-14T11:11:39.301 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:11:39.302 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-14T11:11:39.371 DEBUG:teuthology.orchestra.run.smithi002:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-14T11:11:39.566 INFO:teuthology.orchestra.run.smithi002.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-14T11:11:39.734 INFO:teuthology.orchestra.run.smithi002.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-14T11:11:40.340 INFO:teuthology.orchestra.run.smithi002.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:11:46.516 INFO:teuthology.orchestra.run.smithi002.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-14T11:11:49.981 INFO:teuthology.orchestra.run.smithi002.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=9b4a8f9b2500b3fd49936d8b2c5fcc00244250d781191a8dcbba59c9fbb920cf,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:11:49.981 INFO:teuthology.orchestra.run.smithi002.stdout:py run-test-pre: PYTHONHASHSEED='4018821734' 2024-09-14T11:11:49.981 INFO:teuthology.orchestra.run.smithi002.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-14T11:11:50.183 INFO:teuthology.orchestra.run.smithi002.stdout:============================= test session starts ============================== 2024-09-14T11:11:50.184 INFO:teuthology.orchestra.run.smithi002.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-14T11:11:50.184 INFO:teuthology.orchestra.run.smithi002.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:11:50.184 INFO:teuthology.orchestra.run.smithi002.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:11:50.184 INFO:teuthology.orchestra.run.smithi002.stdout:configfile: pytest.ini 2024-09-14T11:11:50.284 INFO:teuthology.orchestra.run.smithi002.stdout:collecting ... collected 9 items 2024-09-14T11:11:50.285 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:11:52.166 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-14T11:11:52.919 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-14T11:11:53.719 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-14T11:11:54.470 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-14T11:11:55.221 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-14T11:12:02.776 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-14T11:12:04.365 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-14T11:12:06.378 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout:=============================== warnings summary =============================== 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout: import imp 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:12:09.519 INFO:teuthology.orchestra.run.smithi002.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:12:09.520 INFO:teuthology.orchestra.run.smithi002.stdout:======================== 9 passed, 1 warning in 19.34s ========================= 2024-09-14T11:12:09.551 INFO:teuthology.orchestra.run.smithi002.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:12:09.551 INFO:teuthology.orchestra.run.smithi002.stdout: py: commands succeeded 2024-09-14T11:12:09.551 INFO:teuthology.orchestra.run.smithi002.stdout: congratulations :) 2024-09-14T11:12:09.570 INFO:tasks.ragweed:Cleaning up boto... 2024-09-14T11:12:09.570 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-14T11:12:09.600 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-14T11:12:09.698 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:09.698 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:09.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.736+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 20 realm 2024-09-14T11:12:09.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:09.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.738+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.739+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:09.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.739+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.739+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:09.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.739+0000 7fa11f525800 20 searching for the correct realm 2024-09-14T11:12:09.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.743+0000 7fa112932640 0 -- 172.21.15.2:0/861195840 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x564b666197a0 msgr2=0x564b6661bc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:09.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.746+0000 7fa11b133640 0 -- 172.21.15.2:0/861195840 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa1040918d0 msgr2=0x7fa1040793f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:09.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:09.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.751+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 zone default found 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 4 Realm: () 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 zonegroup default 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.752+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.753+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.753+0000 7fa11f525800 20 started sync module instance, tier type = 2024-09-14T11:12:09.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.753+0000 7fa11f525800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:12:09.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.762+0000 7fa11f525800 20 add_watcher() i=0 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.762+0000 7fa11f525800 20 add_watcher() i=1 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.762+0000 7fa11f525800 20 add_watcher() i=2 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.762+0000 7fa11f525800 20 add_watcher() i=3 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.762+0000 7fa11f525800 20 add_watcher() i=4 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.762+0000 7fa11f525800 20 add_watcher() i=5 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.762+0000 7fa11f525800 20 add_watcher() i=6 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.763+0000 7fa11f525800 20 add_watcher() i=7 2024-09-14T11:12:09.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.763+0000 7fa11f525800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:09.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.765+0000 7f9fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:09.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.765+0000 7fa11f525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:09.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.765+0000 7fa11f525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:09.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.802+0000 7f9fd0fe1640 20 reqs_thread_entry: start 2024-09-14T11:12:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.802+0000 7fa11f525800 20 init_complete bucket index max shards: 1 2024-09-14T11:12:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.802+0000 7fa11f525800 20 Filter name: none 2024-09-14T11:12:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.802+0000 7f9f4a7fc640 20 reqs_thread_entry: start 2024-09-14T11:12:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.802+0000 7fa11f525800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-14T11:12:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.802+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.803+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:12:09.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.803+0000 7fa11f525800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-14T11:12:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.803+0000 7fa11f525800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-14T11:12:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.803+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.803+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 : miss 2024-09-14T11:12:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.803+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.804+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=426 2024-09-14T11:12:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.804+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 info.flags=0x17 2024-09-14T11:12:09.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.804+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 to cache LRU end 2024-09-14T11:12:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.804+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.804+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:09.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.804+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-14T11:12:09.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x564b666da3a8 s->prefetch_data=0 2024-09-14T11:12:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 10 manifest: total_size = 5003 2024-09-14T11:12:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12453491970733656796 2024-09-14T11:12:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x564b666da3a8 s->prefetch_data=0 2024-09-14T11:12:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666da3a8 2024-09-14T11:12:09.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.805+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5003 stripe_ofs=5003 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12453491970733656796 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.dG2P3XbqwRWbMOWa2N-5j7yiQUPgqU3_0 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.808+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12453491970733656796 2024-09-14T11:12:09.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.809+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-14T11:12:09.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.809+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x564b666da358 s->prefetch_data=0 2024-09-14T11:12:09.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.809+0000 7fa11f525800 10 manifest: total_size = 5204 2024-09-14T11:12:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.809+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17577506893089656642 2024-09-14T11:12:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.809+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x564b666da358 s->prefetch_data=0 2024-09-14T11:12:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.809+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666da358 2024-09-14T11:12:09.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.809+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5204 stripe_ofs=5204 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17577506893089656642 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.2V-iTigtsAgt1qRJ1MBoxTBlqpbAaun_0 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.812+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17577506893089656642 2024-09-14T11:12:09.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.813+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-14T11:12:09.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.813+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.814+0000 7fa11f525800 10 manifest: total_size = 12851 2024-09-14T11:12:09.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.814+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18212379729927954137 2024-09-14T11:12:09.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.814+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.814+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66660838 2024-09-14T11:12:09.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.814+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=12851 stripe_ofs=12851 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18212379729927954137 2024-09-14T11:12:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.ji7vh_a9kkDrqvJIO6q0CMr7jn0gLK3_0 2024-09-14T11:12:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.816+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18212379729927954137 2024-09-14T11:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.817+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.818+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-14T11:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.818+0000 7fa11f525800 10 manifest: total_size = 7415 2024-09-14T11:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.818+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12941658060711248239 2024-09-14T11:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.818+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.818+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66660838 2024-09-14T11:12:09.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.818+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=7415 stripe_ofs=7415 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12941658060711248239 2024-09-14T11:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.DdLH2PJwH4nN_UrjytMzCGl-myMY-J9_0 2024-09-14T11:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.820+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12941658060711248239 2024-09-14T11:12:09.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.821+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-14T11:12:09.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.822+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.822+0000 7fa11f525800 10 manifest: total_size = 13590 2024-09-14T11:12:09.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.822+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12025277438303618826 2024-09-14T11:12:09.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.822+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.822+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66660838 2024-09-14T11:12:09.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.822+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=13590 stripe_ofs=13590 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12025277438303618826 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.iZQ4Smr4W_4mx6hSiROOSD0JQ_UJmY3_0 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.824+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12025277438303618826 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.825+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.825+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-14T11:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.826+0000 7fa11f525800 10 manifest: total_size = 5043 2024-09-14T11:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.826+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11797033889575777325 2024-09-14T11:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.826+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.826+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66660838 2024-09-14T11:12:09.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.826+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5043 stripe_ofs=5043 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11797033889575777325 2024-09-14T11:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.lSEbqTw3O4ms7uw7x1s2XGw9jGypuQT_0 2024-09-14T11:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:09.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.829+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11797033889575777325 2024-09-14T11:12:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.830+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-14T11:12:09.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.830+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.831+0000 7fa11f525800 10 manifest: total_size = 7787 2024-09-14T11:12:09.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.831+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.6245378901898452886 2024-09-14T11:12:09.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.831+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.831+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66660838 2024-09-14T11:12:09.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.831+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=7787 stripe_ofs=7787 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.6245378901898452886 2024-09-14T11:12:09.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.E-SLdz3BybgBu-dOThdWjPRW_D2BdCB_0 2024-09-14T11:12:09.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:12:09.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.833+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.6245378901898452886 2024-09-14T11:12:09.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.835+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-14T11:12:09.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.835+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665f4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.835+0000 7fa11f525800 10 manifest: total_size = 5287 2024-09-14T11:12:09.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.835+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15958432582078233852 2024-09-14T11:12:09.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.835+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665f4a0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.835+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66660838 2024-09-14T11:12:09.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.835+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5287 stripe_ofs=5287 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15958432582078233852 2024-09-14T11:12:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.k7F4fbQ47L7BMxqvMB1EQ1yq4QXuACY_0 2024-09-14T11:12:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:09.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.838+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15958432582078233852 2024-09-14T11:12:09.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.839+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.839+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-14T11:12:09.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.839+0000 7fa11f525800 10 manifest: total_size = 7785 2024-09-14T11:12:09.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.839+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5210233232260918325 2024-09-14T11:12:09.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.840+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060970 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x564b66660838 s->prefetch_data=0 2024-09-14T11:12:09.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.840+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66660838 2024-09-14T11:12:09.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.840+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.4.0 2024-09-14T11:12:09.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=7785 stripe_ofs=7785 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5210233232260918325 2024-09-14T11:12:09.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.rhxGAKITHgINxd8iBZPhlCGy7MKK4ro_0 2024-09-14T11:12:09.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:12:09.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.842+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5210233232260918325 2024-09-14T11:12:09.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-14T11:12:09.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:09.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:09.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:09.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:09.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:09.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:09.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.843+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[17edae97-cd6b-4c90-863d-862429a20cf3.4538.4])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:09.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.845+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-14T11:12:09.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.845+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.845+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=204 2024-09-14T11:12:09.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.845+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-14T11:12:09.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.845+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-14T11:12:09.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.846+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-14T11:12:09.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.846+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-14T11:12:09.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.846+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529737 cookie 94881840212784 notifier 5678 bl.length()=162 2024-09-14T11:12:09.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.848+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 from cache 2024-09-14T11:12:09.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.848+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4, ofs0, ns] 2024-09-14T11:12:09.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.848+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529675 cookie 94881840227168 notifier 5678 bl.length()=219 2024-09-14T11:12:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.850+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 : miss 2024-09-14T11:12:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.850+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.850+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.850+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 info.flags=0x0 2024-09-14T11:12:09.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.850+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/17edae97-cd6b-4c90-863d-862429a20cf3.4538.4 to cache LRU end 2024-09-14T11:12:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.852+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 : miss 2024-09-14T11:12:09.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.852+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=457 2024-09-14T11:12:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 info.flags=0x17 2024-09-14T11:12:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 to cache LRU end 2024-09-14T11:12:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:09.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 2024-09-14T11:12:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:12:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.853+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x564b66665928 s->prefetch_data=0 2024-09-14T11:12:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.854+0000 7fa11f525800 10 manifest: total_size = 1667 2024-09-14T11:12:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.854+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.513442097295932193 2024-09-14T11:12:09.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.854+0000 7fa11f525800 20 get_obj_state: octx=0x564b66661c50 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x564b66665928 s->prefetch_data=0 2024-09-14T11:12:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.854+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66665928 2024-09-14T11:12:09.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.854+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.11.0 2024-09-14T11:12:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:12:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:12:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:09.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.513442097295932193 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.1 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-14T11:12:09.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.2 2024-09-14T11:12:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-14T11:12:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.3 2024-09-14T11:12:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-14T11:12:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.4 2024-09-14T11:12:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1083 2024-09-14T11:12:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.856+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.513442097295932193 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.857+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.857+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.857+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.858+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.858+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.858+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.858+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:09.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.858+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.11])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.859+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-14T11:12:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.859+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.860+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=235 2024-09-14T11:12:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.860+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-14T11:12:09.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.860+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-14T11:12:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.861+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-14T11:12:09.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.861+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-14T11:12:09.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.862+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529718 cookie 94881840214992 notifier 5678 bl.length()=191 2024-09-14T11:12:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.863+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 from cache 2024-09-14T11:12:09.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.863+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11, ofs0, ns] 2024-09-14T11:12:09.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.863+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529676 cookie 94881840227168 notifier 5678 bl.length()=249 2024-09-14T11:12:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.865+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 : miss 2024-09-14T11:12:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.865+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.865+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.865+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 info.flags=0x0 2024-09-14T11:12:09.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.865+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.11 to cache LRU end 2024-09-14T11:12:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.867+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 : miss 2024-09-14T11:12:09.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.867+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=464 2024-09-14T11:12:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 info.flags=0x17 2024-09-14T11:12:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 to cache LRU end 2024-09-14T11:12:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:09.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 2024-09-14T11:12:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:12:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.868+0000 7fa11f525800 20 get_obj_state: octx=0x564b66664ed0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x564b666d9c58 s->prefetch_data=0 2024-09-14T11:12:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.869+0000 7fa11f525800 10 manifest: total_size = 1667 2024-09-14T11:12:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.869+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12850942232017324346 2024-09-14T11:12:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.869+0000 7fa11f525800 20 get_obj_state: octx=0x564b66664ed0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x564b666d9c58 s->prefetch_data=0 2024-09-14T11:12:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.869+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666d9c58 2024-09-14T11:12:09.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.869+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.12.0 2024-09-14T11:12:09.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:09.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:12:09.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:12:09.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=516 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6293004 part_ofs=1548 rule->part_size=119 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12850942232017324346 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.1 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.2 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.3 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.4 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.873+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12850942232017324346 2024-09-14T11:12:09.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.874+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:12:09.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.874+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:09.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.875+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:09.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.875+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:09.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.875+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:09.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.875+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:09.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.875+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:09.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.875+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.12])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:09.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.876+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-14T11:12:09.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.876+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.877+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=242 2024-09-14T11:12:09.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.877+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-14T11:12:09.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.877+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-14T11:12:09.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.878+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-14T11:12:09.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.878+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-14T11:12:09.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.878+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529677 cookie 94881840224480 notifier 5678 bl.length()=198 2024-09-14T11:12:09.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.879+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 from cache 2024-09-14T11:12:09.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.879+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12, ofs0, ns] 2024-09-14T11:12:09.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.880+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529738 cookie 94881840212784 notifier 5678 bl.length()=256 2024-09-14T11:12:09.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.882+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 : miss 2024-09-14T11:12:09.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.882+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.882+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.882+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 info.flags=0x0 2024-09-14T11:12:09.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.882+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.12 to cache LRU end 2024-09-14T11:12:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 : miss 2024-09-14T11:12:09.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=459 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 info.flags=0x17 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 to cache LRU end 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.884+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.885+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo[V-DalAEUpH-lqjO85lQyEbP16hRKDBy] 2024-09-14T11:12:09.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.885+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.10.0 2024-09-14T11:12:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.885+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x564b66669a18 s->prefetch_data=0 2024-09-14T11:12:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.886+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to eagczxwul2tgubwwg1fq10tr2gmyp1u7 2024-09-14T11:12:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.886+0000 7fa11f525800 20 get_obj_state_impl: setting s->olh_tag to mc7ad2lcselebewmuazbipy3mdexsjyh 2024-09-14T11:12:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.886+0000 7fa11f525800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=mc7ad2lcselebewmuazbipy3mdexsjyh 2024-09-14T11:12:09.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.886+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.10.0 2024-09-14T11:12:09.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.10.0 2024-09-14T11:12:09.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-14T11:12:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 olh_log_entry: epoch=3 op=3 key=foo[V-DalAEUpH-lqjO85lQyEbP16hRKDBy] 2024-09-14T11:12:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-multipart-index-versioning.1:_:V-DalAEUpH-lqjO85lQyEbP16hRKDBy_foo state=0x564b666712d8 s->prefetch_data=0 2024-09-14T11:12:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 10 manifest: total_size = 26080 2024-09-14T11:12:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1558470325646227487 2024-09-14T11:12:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-multipart-index-versioning.1:_:V-DalAEUpH-lqjO85lQyEbP16hRKDBy_foo state=0x564b666712d8 s->prefetch_data=0 2024-09-14T11:12:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666712d8 2024-09-14T11:12:09.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.888+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.10.0 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=7671 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7670 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=7670 rules.size()=4 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6299127 part_ofs=7671 rule->part_size=7670 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=15341 stripe_ofs=15341 part_ofs=15341 rule->part_size=7672 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-14T11:12:09.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6306797 part_ofs=15341 rule->part_size=7672 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=23013 stripe_ofs=23013 part_ofs=23013 rule->part_size=3067 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6314469 part_ofs=23013 rule->part_size=3067 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=26080 stripe_ofs=26080 part_ofs=26080 rule->part_size=3067 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1558470325646227487 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.1 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.2 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.3 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-14T11:12:09.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.4 2024-09-14T11:12:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-14T11:12:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.890+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1558470325646227487 2024-09-14T11:12:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.891+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo[V-DalAEUpH-lqjO85lQyEbP16hRKDBy] 2024-09-14T11:12:09.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.893+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x564b66669a18 s->prefetch_data=0 2024-09-14T11:12:09.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.893+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.10.0 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.894+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.10.0 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.894+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.894+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.895+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.895+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.895+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.895+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:09.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.895+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.10])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.896+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-14T11:12:09.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.896+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.896+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=237 2024-09-14T11:12:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.896+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-14T11:12:09.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.896+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-14T11:12:09.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.897+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-14T11:12:09.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.897+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-14T11:12:09.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.898+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529678 cookie 94881840224480 notifier 5678 bl.length()=193 2024-09-14T11:12:09.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.899+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 from cache 2024-09-14T11:12:09.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.899+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10, ofs0, ns] 2024-09-14T11:12:09.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.899+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529701 cookie 94881840235280 notifier 5678 bl.length()=251 2024-09-14T11:12:09.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.901+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 : miss 2024-09-14T11:12:09.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.901+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.901+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.901+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 info.flags=0x0 2024-09-14T11:12:09.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.901+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.10 to cache LRU end 2024-09-14T11:12:09.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.903+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 : miss 2024-09-14T11:12:09.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.903+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.903+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:12:09.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.903+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 info.flags=0x17 2024-09-14T11:12:09.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.903+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 to cache LRU end 2024-09-14T11:12:09.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.903+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.903+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:09.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 2024-09-14T11:12:09.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo 2024-09-14T11:12:09.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665f620 obj=test-client.0-r-test-multipart-simple.1:foo state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 10 manifest: total_size = 886297 2024-09-14T11:12:09.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3884883169024026227 2024-09-14T11:12:09.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665f620 obj=test-client.0-r-test-multipart-simple.1:foo state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.904+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.9.0 2024-09-14T11:12:09.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:12:09.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:12:09.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:12:09.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:12:09.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=246247 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=7030197 part_ofs=738741 rule->part_size=147556 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3884883169024026227 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.1 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 344 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.2 2024-09-14T11:12:09.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 588 2024-09-14T11:12:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.3 2024-09-14T11:12:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 832 2024-09-14T11:12:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.4 2024-09-14T11:12:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1076 2024-09-14T11:12:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.906+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3884883169024026227 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.907+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.908+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.908+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.908+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.908+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.908+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.908+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:09.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.908+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.9])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.910+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-14T11:12:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.910+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.911+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=225 2024-09-14T11:12:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.911+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-14T11:12:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.911+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-14T11:12:09.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.911+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-14T11:12:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.911+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-14T11:12:09.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.912+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529739 cookie 94881840229856 notifier 5678 bl.length()=183 2024-09-14T11:12:09.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.913+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 from cache 2024-09-14T11:12:09.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.913+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9, ofs0, ns] 2024-09-14T11:12:09.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.914+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529719 cookie 94881840214992 notifier 5678 bl.length()=240 2024-09-14T11:12:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.916+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 : miss 2024-09-14T11:12:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.916+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.916+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.916+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 info.flags=0x0 2024-09-14T11:12:09.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.916+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.9 to cache LRU end 2024-09-14T11:12:09.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.918+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 : miss 2024-09-14T11:12:09.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.918+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.919+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:12:09.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.919+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 info.flags=0x17 2024-09-14T11:12:09.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.919+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 to cache LRU end 2024-09-14T11:12:09.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.919+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.919+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:09.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.919+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 2024-09-14T11:12:09.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:12:09.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:12:09.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:12:09.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:12:09.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:12:09.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:12:09.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15111954336380300897 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.920+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15111954336380300897 2024-09-14T11:12:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.b2s6WY3aJUbt4h99swkE8lsqAVhOPro_0 2024-09-14T11:12:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:12:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.922+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15111954336380300897 2024-09-14T11:12:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.923+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:12:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.924+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.924+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.924+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10397549254521201924 2024-09-14T11:12:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.924+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.924+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.924+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10397549254521201924 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.b2s6WY3aJUbt4h99swkE8lsqAVhOPro_0 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.926+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10397549254521201924 2024-09-14T11:12:09.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.927+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:12:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.928+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.928+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.928+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _f8acKmzqOXJllS2tkZnMAUOjPyBnfYz 2024-09-14T11:12:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.928+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.928+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.928+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _f8acKmzqOXJllS2tkZnMAUOjPyBnfYz 2024-09-14T11:12:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.4JxKWpKQdbv9lLSu892tVVJI9mDRKP6_0 2024-09-14T11:12:09.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:12:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.930+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: _f8acKmzqOXJllS2tkZnMAUOjPyBnfYz 2024-09-14T11:12:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.931+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:12:09.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.931+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.932+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.932+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _DUJ3KhpardbryEMjyKGaSVHqL2zFqgw 2024-09-14T11:12:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.932+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.932+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.932+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _DUJ3KhpardbryEMjyKGaSVHqL2zFqgw 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.m1CORFI5zmrBS9jCJo-Vc3OyCpCxE7x_0 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.934+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _DUJ3KhpardbryEMjyKGaSVHqL2zFqgw 2024-09-14T11:12:09.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.935+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:12:09.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.935+0000 7fa11f525800 20 get_obj_state: octx=0x564b66620910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.935+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.935+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4019728867152022263 2024-09-14T11:12:09.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.935+0000 7fa11f525800 20 get_obj_state: octx=0x564b66620910 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.935+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.935+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4019728867152022263 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.M10HvagiBusDZ60MBoVKtPTpcHmbX2G_0 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.938+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4019728867152022263 2024-09-14T11:12:09.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.939+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:12:09.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.939+0000 7fa11f525800 20 get_obj_state: octx=0x564b66626960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.939+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.939+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _abyzf0Gn9pUkd01X8l1FjMuG0kpiavn 2024-09-14T11:12:09.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.939+0000 7fa11f525800 20 get_obj_state: octx=0x564b66626960 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.939+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.939+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _abyzf0Gn9pUkd01X8l1FjMuG0kpiavn 2024-09-14T11:12:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.rvU2epuvUrZDF5I7wz33jguzqRgKT49_0 2024-09-14T11:12:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:12:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.941+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _abyzf0Gn9pUkd01X8l1FjMuG0kpiavn 2024-09-14T11:12:09.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.942+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:12:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.943+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.943+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.943+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5238278203041020352 2024-09-14T11:12:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.943+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400e3c0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.943+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.943+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5238278203041020352 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.M10HvagiBusDZ60MBoVKtPTpcHmbX2G_0 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.945+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5238278203041020352 2024-09-14T11:12:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.946+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:12:09.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.946+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.947+0000 7fa11f525800 10 manifest: total_size = 5242880 2024-09-14T11:12:09.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.947+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _9gV6vDVbNZTBwL5L0skGkETsj-S3tMm 2024-09-14T11:12:09.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.947+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.947+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.947+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _9gV6vDVbNZTBwL5L0skGkETsj-S3tMm 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.-wqEGdeuCiIc9L5p2oKkggPyT8Gwiup_0 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.949+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: _9gV6vDVbNZTBwL5L0skGkETsj-S3tMm 2024-09-14T11:12:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.950+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:12:09.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.951+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10406da30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.951+0000 7fa11f525800 10 manifest: total_size = 2042 2024-09-14T11:12:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.951+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11966027224339076035 2024-09-14T11:12:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.951+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10406da30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.951+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.951+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11966027224339076035 2024-09-14T11:12:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.J2C3YWn8zhoORuSSjyQesD1EVZkZNGw_0 2024-09-14T11:12:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:12:09.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.953+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.11966027224339076035 2024-09-14T11:12:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.954+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:12:09.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.954+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.955+0000 7fa11f525800 10 manifest: total_size = 2042 2024-09-14T11:12:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.955+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _suSBuc9_fvfS0iNZr140feDi4TpWEqu 2024-09-14T11:12:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.955+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004da0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.955+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.955+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _suSBuc9_fvfS0iNZr140feDi4TpWEqu 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.NgR1LtOdKUQ2jTSJmLdGCc3XTJX5TiU_0 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.957+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: _suSBuc9_fvfS0iNZr140feDi4TpWEqu 2024-09-14T11:12:09.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.958+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:12:09.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.958+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10406da30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.958+0000 7fa11f525800 10 manifest: total_size = 2042 2024-09-14T11:12:09.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.958+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _lpjGmOThm35_M2JLNv766-OPHa6kuo1 2024-09-14T11:12:09.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.958+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10406da30 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.958+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.958+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _lpjGmOThm35_M2JLNv766-OPHa6kuo1 2024-09-14T11:12:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.ARV_XqshisJs_tgyBD4Y3ppJAG70ID0_0 2024-09-14T11:12:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:12:09.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.961+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _lpjGmOThm35_M2JLNv766-OPHa6kuo1 2024-09-14T11:12:09.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.962+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:12:09.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.962+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.962+0000 7fa11f525800 10 manifest: total_size = 2042 2024-09-14T11:12:09.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.962+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13398266633677555639 2024-09-14T11:12:09.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.962+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x564b66669958 s->prefetch_data=0 2024-09-14T11:12:09.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.962+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66669958 2024-09-14T11:12:09.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.962+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.15.0 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=2042 stripe_ofs=2042 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13398266633677555639 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.J2C3YWn8zhoORuSSjyQesD1EVZkZNGw_0 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.964+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13398266633677555639 2024-09-14T11:12:09.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.965+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:12:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.966+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.966+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.966+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:09.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.966+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.966+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.966+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:09.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.966+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.15])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.968+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-14T11:12:09.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.968+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.968+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=233 2024-09-14T11:12:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.968+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-14T11:12:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.968+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-14T11:12:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.969+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-14T11:12:09.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.969+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-14T11:12:09.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.970+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529679 cookie 94881840224480 notifier 5678 bl.length()=189 2024-09-14T11:12:09.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.971+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 from cache 2024-09-14T11:12:09.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.971+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15, ofs0, ns] 2024-09-14T11:12:09.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.972+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529702 cookie 94881840235280 notifier 5678 bl.length()=247 2024-09-14T11:12:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.973+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 : miss 2024-09-14T11:12:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.973+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.973+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.973+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 info.flags=0x0 2024-09-14T11:12:09.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.973+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.15 to cache LRU end 2024-09-14T11:12:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.975+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 : miss 2024-09-14T11:12:09.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.975+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=465 2024-09-14T11:12:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 info.flags=0x17 2024-09-14T11:12:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 to cache LRU end 2024-09-14T11:12:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:09.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 2024-09-14T11:12:09.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:12:09.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-14T11:12:09.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-14T11:12:09.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-14T11:12:09.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:12:09.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.976+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x564b66674448 s->prefetch_data=0 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.977+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.977+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.2212497560846202784 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.977+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x564b66674448 s->prefetch_data=0 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.977+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66674448 2024-09-14T11:12:09.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.977+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:09.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:09.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:12:09.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:09.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:09.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.2212497560846202784 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.1 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.2 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-14T11:12:09.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.3 2024-09-14T11:12:09.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-14T11:12:09.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.979+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.2212497560846202784 2024-09-14T11:12:09.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.980+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:12:09.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.980+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x564b66674448 s->prefetch_data=0 2024-09-14T11:12:09.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.981+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.981+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4049832726074066599 2024-09-14T11:12:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.981+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x564b66674448 s->prefetch_data=0 2024-09-14T11:12:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.981+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66674448 2024-09-14T11:12:09.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.981+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:12:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:09.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4049832726074066599 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.1 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.2 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 634 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.3 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 901 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.983+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4049832726074066599 2024-09-14T11:12:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.984+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-14T11:12:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.984+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668970 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.984+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.984+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _XB6qxRpfAXGHC2iH10omIAVE4prAZsq 2024-09-14T11:12:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.984+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668970 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.984+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.984+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:09.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _XB6qxRpfAXGHC2iH10omIAVE4prAZsq 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.rXnJYGHZXOcFLz8HrkdblJfXO2uP2Ua_0 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.rXnJYGHZXOcFLz8HrkdblJfXO2uP2Ua_1 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.986+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _XB6qxRpfAXGHC2iH10omIAVE4prAZsq 2024-09-14T11:12:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.988+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-14T11:12:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.988+0000 7fa11f525800 20 get_obj_state: octx=0x7fa104086960 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.988+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:09.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.988+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _lccKa-0lWSysluseNWsHziYWzfpvcm1 2024-09-14T11:12:09.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.988+0000 7fa11f525800 20 get_obj_state: octx=0x7fa104086960 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.988+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:09.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.988+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:09.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _lccKa-0lWSysluseNWsHziYWzfpvcm1 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.k7X6Z-SV_-wCIyRM4LKcDGf6sPK5ozr_0 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.k7X6Z-SV_-wCIyRM4LKcDGf6sPK5ozr_1 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.990+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _lccKa-0lWSysluseNWsHziYWzfpvcm1 2024-09-14T11:12:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.991+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-14T11:12:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.991+0000 7fa11f525800 20 get_obj_state: octx=0x7fa104086960 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.992+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.992+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10320611883224586263 2024-09-14T11:12:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.992+0000 7fa11f525800 20 get_obj_state: octx=0x7fa104086960 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.992+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:09.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.992+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:12:09.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10320611883224586263 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.1 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.2 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 647 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.3 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 920 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.994+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.10320611883224586263 2024-09-14T11:12:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.995+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:12:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.995+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10406da30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.996+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.996+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _HhYbNT60iMMKk1YWKkFW3Dx8WjG5sXY 2024-09-14T11:12:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.996+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10406da30 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.996+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:09.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.996+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:09.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:09.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:12:09.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _HhYbNT60iMMKk1YWKkFW3Dx8WjG5sXY 2024-09-14T11:12:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.Q2_uXbd-CptCQnVjEbU-Ktfjg15xHOd_0 2024-09-14T11:12:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:12:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.Q2_uXbd-CptCQnVjEbU-Ktfjg15xHOd_1 2024-09-14T11:12:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-14T11:12:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:09.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.998+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _HhYbNT60iMMKk1YWKkFW3Dx8WjG5sXY 2024-09-14T11:12:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.999+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-14T11:12:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.999+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665fc10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.999+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.999+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5199774885726665620 2024-09-14T11:12:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.999+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665fc10 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.999+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:09.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:09.999+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:09.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5199774885726665620 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.1 2024-09-14T11:12:10.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:12:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.2 2024-09-14T11:12:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:12:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.3 2024-09-14T11:12:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:12:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.001+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.5199774885726665620 2024-09-14T11:12:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.002+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-14T11:12:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.003+0000 7fa11f525800 20 get_obj_state: octx=0x564b666da9a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.003+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.003+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _r_bmYYXvEn5eDwS5KmyrOT6iMrbBpqG 2024-09-14T11:12:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.003+0000 7fa11f525800 20 get_obj_state: octx=0x564b666da9a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.003+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:10.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.003+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:10.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _r_bmYYXvEn5eDwS5KmyrOT6iMrbBpqG 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.WmcVSZSIc7su-xtdUEZaMXqZDFr1IS-_0 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.WmcVSZSIc7su-xtdUEZaMXqZDFr1IS-_1 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.005+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _r_bmYYXvEn5eDwS5KmyrOT6iMrbBpqG 2024-09-14T11:12:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.006+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-14T11:12:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.006+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.007+0000 7fa11f525800 10 manifest: total_size = 1087 2024-09-14T11:12:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.007+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17241719805197179826 2024-09-14T11:12:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.007+0000 7fa11f525800 20 get_obj_state: octx=0x564b66668eb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.007+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:10.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.007+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:12:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:12:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:10.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17241719805197179826 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.1 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 365 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.2 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 629 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.3 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 893 2024-09-14T11:12:10.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.009+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17241719805197179826 2024-09-14T11:12:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.010+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:12:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.010+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400eb70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.010+0000 7fa11f525800 10 manifest: total_size = 1087 2024-09-14T11:12:10.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.011+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _FCur7RyL_x_Csc4LMq08OdCTu2LrePM 2024-09-14T11:12:10.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.011+0000 7fa11f525800 20 get_obj_state: octx=0x7fa11400eb70 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.011+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:10.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.011+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _FCur7RyL_x_Csc4LMq08OdCTu2LrePM 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.eA03TOnf3jix1O2v3DSTMuR6WWU8jqr_0 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.012+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: _FCur7RyL_x_Csc4LMq08OdCTu2LrePM 2024-09-14T11:12:10.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.014+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-14T11:12:10.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.014+0000 7fa11f525800 20 get_obj_state: octx=0x564b6662d1e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.014+0000 7fa11f525800 10 manifest: total_size = 1087 2024-09-14T11:12:10.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.014+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to _t5jp52Ezh-7nFO1PzGF3SVe-LOAl3c- 2024-09-14T11:12:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.014+0000 7fa11f525800 20 get_obj_state: octx=0x564b6662d1e0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.014+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:10.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.014+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: _t5jp52Ezh-7nFO1PzGF3SVe-LOAl3c- 2024-09-14T11:12:10.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.RXG5AbCi0zCh8ZP7FQgcfJvXVTiqC1W_0 2024-09-14T11:12:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-14T11:12:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.016+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _t5jp52Ezh-7nFO1PzGF3SVe-LOAl3c- 2024-09-14T11:12:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.017+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665f0f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.017+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-14T11:12:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.018+0000 7fa11f525800 10 manifest: total_size = 1087 2024-09-14T11:12:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.018+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8015968559032740975 2024-09-14T11:12:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.018+0000 7fa11f525800 20 get_obj_state: octx=0x564b6665f0f0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x564b6665dc68 s->prefetch_data=0 2024-09-14T11:12:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.018+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6665dc68 2024-09-14T11:12:10.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.018+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.16.0 2024-09-14T11:12:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=516 2024-09-14T11:12:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-14T11:12:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-14T11:12:10.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291972 part_ofs=516 rule->part_size=516 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6292488 part_ofs=1032 rule->part_size=55 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8015968559032740975 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.1 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.2 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.3 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:12:10.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.020+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8015968559032740975 2024-09-14T11:12:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.021+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:10.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.021+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.021+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.022+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.022+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.022+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.022+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.022+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.16])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.023+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-14T11:12:10.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.023+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.024+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=243 2024-09-14T11:12:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.024+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-14T11:12:10.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.024+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-14T11:12:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.025+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-14T11:12:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.025+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-14T11:12:10.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.025+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529677 cookie 94881840227168 notifier 5678 bl.length()=199 2024-09-14T11:12:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.027+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 from cache 2024-09-14T11:12:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.027+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16, ofs0, ns] 2024-09-14T11:12:10.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.027+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529720 cookie 94881840214992 notifier 5678 bl.length()=257 2024-09-14T11:12:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.028+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 : miss 2024-09-14T11:12:10.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.028+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.029+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.029+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 info.flags=0x0 2024-09-14T11:12:10.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.029+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.16 to cache LRU end 2024-09-14T11:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 : miss 2024-09-14T11:12:10.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 info.flags=0x17 2024-09-14T11:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 to cache LRU end 2024-09-14T11:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:10.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.031+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666d980 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x564b6666c158 s->prefetch_data=0 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15766593546931901669 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666d980 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x564b6666c158 s->prefetch_data=0 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6666c158 2024-09-14T11:12:10.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.032+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.14.0 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:12:10.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15766593546931901669 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-FROZEN.2~nsulaTeQYt43vfqAsfpKenzEelvVNJe.1 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-FROZEN.2~nsulaTeQYt43vfqAsfpKenzEelvVNJe.2 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 635 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-FROZEN.2~nsulaTeQYt43vfqAsfpKenzEelvVNJe.3 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 902 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.034+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15766593546931901669 2024-09-14T11:12:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.036+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:12:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.036+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666d690 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.036+0000 7fa11f525800 10 manifest: total_size = 11534336 2024-09-14T11:12:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.036+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3935199821906043027 2024-09-14T11:12:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.036+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666d690 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.036+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6666bc48 2024-09-14T11:12:10.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.036+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.14.0 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=5242880 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=11534336 part_ofs=5242880 rule->part_size=5242880 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=16777216 part_ofs=10485760 rule->part_size=1048576 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-14T11:12:10.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3935199821906043027 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-LUKEWARM.2~eBj0BjRJD-K99v3_6L8GOgRODXgMMja.1 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-LUKEWARM.2~eBj0BjRJD-K99v3_6L8GOgRODXgMMja.2 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 646 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-LUKEWARM.2~eBj0BjRJD-K99v3_6L8GOgRODXgMMja.3 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 919 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.038+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3935199821906043027 2024-09-14T11:12:10.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.039+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:12:10.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.040+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060bf0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.040+0000 7fa11f525800 10 manifest: total_size = 541681 2024-09-14T11:12:10.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.040+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3902453347711406475 2024-09-14T11:12:10.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.040+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c060bf0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.040+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6666bc48 2024-09-14T11:12:10.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.040+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.14.0 2024-09-14T11:12:10.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:12:10.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6291456 part_ofs=0 rule->part_size=246247 2024-09-14T11:12:10.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-14T11:12:10.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6537703 part_ofs=246247 rule->part_size=246247 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): stripe_ofs=6783950 part_ofs=492494 rule->part_size=49187 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3902453347711406475 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-STANDARD.2~NdtmLmfPfFeM1AW0KSlX_hhleGlL5qT.1 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-STANDARD.2~NdtmLmfPfFeM1AW0KSlX_hhleGlL5qT.2 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-14T11:12:10.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-STANDARD.2~NdtmLmfPfFeM1AW0KSlX_hhleGlL5qT.3 2024-09-14T11:12:10.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-14T11:12:10.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.042+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3902453347711406475 2024-09-14T11:12:10.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.043+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:12:10.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.043+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.043+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.044+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.044+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.044+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.044+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.044+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.14])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.045+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-14T11:12:10.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.045+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.046+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=238 2024-09-14T11:12:10.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.046+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-14T11:12:10.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.046+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-14T11:12:10.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.047+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-14T11:12:10.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.047+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-14T11:12:10.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.047+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529703 cookie 94881840220864 notifier 5678 bl.length()=194 2024-09-14T11:12:10.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.049+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 from cache 2024-09-14T11:12:10.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.049+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14, ofs0, ns] 2024-09-14T11:12:10.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.049+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529721 cookie 94881840214992 notifier 5678 bl.length()=252 2024-09-14T11:12:10.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.050+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 : miss 2024-09-14T11:12:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.050+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.050+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.050+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 info.flags=0x0 2024-09-14T11:12:10.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.050+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.14 to cache LRU end 2024-09-14T11:12:10.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.052+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 : miss 2024-09-14T11:12:10.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.052+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=450 2024-09-14T11:12:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 info.flags=0x17 2024-09-14T11:12:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 to cache LRU end 2024-09-14T11:12:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:10.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 2024-09-14T11:12:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-14T11:12:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-14T11:12:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-14T11:12:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.053+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666d850 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x564b6666c158 s->prefetch_data=0 2024-09-14T11:12:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.054+0000 7fa11f525800 10 manifest: total_size = 10485760 2024-09-14T11:12:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.054+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17195226712446934414 2024-09-14T11:12:10.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.054+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666d850 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x564b6666c158 s->prefetch_data=0 2024-09-14T11:12:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.054+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6666c158 2024-09-14T11:12:10.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.054+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.13.0 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17195226712446934414 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.vSUYp7VFi6p7izhIQq6ZVNLkqISysJN_0 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-14T11:12:10.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.vSUYp7VFi6p7izhIQq6ZVNLkqISysJN_1 2024-09-14T11:12:10.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-14T11:12:10.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.056+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17195226712446934414 2024-09-14T11:12:10.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.057+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-14T11:12:10.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.057+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004560 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.058+0000 7fa11f525800 10 manifest: total_size = 10485760 2024-09-14T11:12:10.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.058+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8677312472159054579 2024-09-14T11:12:10.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.058+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004560 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.058+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6666bc48 2024-09-14T11:12:10.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.058+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.13.0 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.059+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.059+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=6291456 stripe_ofs=6291456 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8677312472159054579 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.tD6g1bEONDjbnm6gJlluaK8w63n6gje_0 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.tD6g1bEONDjbnm6gJlluaK8w63n6gje_1 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.060+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8677312472159054579 2024-09-14T11:12:10.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.061+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-14T11:12:10.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.061+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004da0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.061+0000 7fa11f525800 10 manifest: total_size = 53494 2024-09-14T11:12:10.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.061+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12717773912133260198 2024-09-14T11:12:10.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.061+0000 7fa11f525800 20 get_obj_state: octx=0x7fa114004da0 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x564b6666bc48 s->prefetch_data=0 2024-09-14T11:12:10.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.061+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b6666bc48 2024-09-14T11:12:10.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.061+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.13.0 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=53494 stripe_ofs=53494 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12717773912133260198 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.039AcW6MSFocxnLvtjb9VnK1yhFnVo-_0 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.064+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.12717773912133260198 2024-09-14T11:12:10.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.065+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-14T11:12:10.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.065+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:10.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.065+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:10.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.066+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:10.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.066+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:10.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.066+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:10.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.066+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:10.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.066+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.13])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:10.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.067+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-14T11:12:10.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.067+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.067+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=228 2024-09-14T11:12:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.067+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-14T11:12:10.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.067+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-14T11:12:10.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.069+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-14T11:12:10.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.069+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-14T11:12:10.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.069+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529680 cookie 94881840224480 notifier 5678 bl.length()=184 2024-09-14T11:12:10.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.071+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 from cache 2024-09-14T11:12:10.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.071+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13, ofs0, ns] 2024-09-14T11:12:10.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.071+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529740 cookie 94881840212784 notifier 5678 bl.length()=242 2024-09-14T11:12:10.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.073+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 : miss 2024-09-14T11:12:10.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.073+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.073+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.073+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 info.flags=0x0 2024-09-14T11:12:10.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.073+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.13 to cache LRU end 2024-09-14T11:12:10.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 : miss 2024-09-14T11:12:10.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:12:10.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 info.flags=0x17 2024-09-14T11:12:10.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 to cache LRU end 2024-09-14T11:12:10.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:10.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:10.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.075+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:__ state=0x564b666743a8 s->prefetch_data=0 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 10 manifest: total_size = 0 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.9937897682002810470 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:__ state=0x564b666743a8 s->prefetch_data=0 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666743a8 2024-09-14T11:12:10.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.076+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.6.0 2024-09-14T11:12:10.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.078+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x564b66662f08 s->prefetch_data=0 2024-09-14T11:12:10.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.079+0000 7fa11f525800 10 manifest: total_size = 0 2024-09-14T11:12:10.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.079+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17962063999742797916 2024-09-14T11:12:10.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.079+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x564b66662f08 s->prefetch_data=0 2024-09-14T11:12:10.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.079+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66662f08 2024-09-14T11:12:10.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.079+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.6.0 2024-09-14T11:12:10.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.080+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:12:10.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.081+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:___ state=0x564b66662f08 s->prefetch_data=0 2024-09-14T11:12:10.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.081+0000 7fa11f525800 10 manifest: total_size = 0 2024-09-14T11:12:10.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.081+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14504865044354442668 2024-09-14T11:12:10.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.081+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:___ state=0x564b66662f08 s->prefetch_data=0 2024-09-14T11:12:10.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.081+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66662f08 2024-09-14T11:12:10.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.081+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.6.0 2024-09-14T11:12:10.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.082+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:12:10.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.084+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:obj state=0x564b66662f08 s->prefetch_data=0 2024-09-14T11:12:10.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.084+0000 7fa11f525800 10 manifest: total_size = 0 2024-09-14T11:12:10.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.084+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.14667269396752422098 2024-09-14T11:12:10.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.084+0000 7fa11f525800 20 get_obj_state: octx=0x564b6666ce50 obj=test-client.0-r-test-small-obj-data.1:obj state=0x564b66662f08 s->prefetch_data=0 2024-09-14T11:12:10.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.084+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66662f08 2024-09-14T11:12:10.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.084+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.6.0 2024-09-14T11:12:10.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.085+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:12:10.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.086+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:10.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.086+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:10.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.087+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:12:10.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.088+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:10.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.088+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:10.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.088+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:10.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.088+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:10.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.088+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[17edae97-cd6b-4c90-863d-862429a20cf3.4538.6])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:10.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.089+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-14T11:12:10.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.089+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.089+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:12:10.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.089+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-14T11:12:10.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.089+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-14T11:12:10.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.090+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-14T11:12:10.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.090+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-14T11:12:10.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.090+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529722 cookie 94881840214992 notifier 5678 bl.length()=181 2024-09-14T11:12:10.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.092+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 from cache 2024-09-14T11:12:10.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.092+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:17edae97-cd6b-4c90-863d-862429a20cf3.4538.6, ofs0, ns] 2024-09-14T11:12:10.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.092+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529704 cookie 94881840235280 notifier 5678 bl.length()=238 2024-09-14T11:12:10.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.093+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 : miss 2024-09-14T11:12:10.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.093+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.094+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.094+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 info.flags=0x0 2024-09-14T11:12:10.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.094+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/17edae97-cd6b-4c90-863d-862429a20cf3.4538.6 to cache LRU end 2024-09-14T11:12:10.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 : miss 2024-09-14T11:12:10.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:12:10.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 info.flags=0x17 2024-09-14T11:12:10.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 to cache LRU end 2024-09-14T11:12:10.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:10.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:10.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.096+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 2024-09-14T11:12:10.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:12:10.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:12:10.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:12:10.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:12:10.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 20 get_obj_state: octx=0x564b666db030 obj=test-client.0-r-test-small-obj-data.2:__ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 10 manifest: total_size = 24595 2024-09-14T11:12:10.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1045062330657505740 2024-09-14T11:12:10.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 20 get_obj_state: octx=0x564b666db030 obj=test-client.0-r-test-small-obj-data.2:__ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666748b8 2024-09-14T11:12:10.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.097+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.7.0 2024-09-14T11:12:10.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=24595 stripe_ofs=24595 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1045062330657505740 2024-09-14T11:12:10.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.Yp8hpinIyGOS_YbJIKad4hi3lBAuKmy_0 2024-09-14T11:12:10.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:12:10.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.099+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1045062330657505740 2024-09-14T11:12:10.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.101+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:12:10.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.101+0000 7fa11f525800 20 get_obj_state: octx=0x564b666db030 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.101+0000 7fa11f525800 10 manifest: total_size = 527 2024-09-14T11:12:10.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.101+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4793071143775487310 2024-09-14T11:12:10.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.101+0000 7fa11f525800 20 get_obj_state: octx=0x564b666db030 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.101+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666748b8 2024-09-14T11:12:10.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.101+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.7.0 2024-09-14T11:12:10.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4793071143775487310 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.KwZ0FuwsFMaXodcq7cZFTuevgw483b7_0 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.103+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.4793071143775487310 2024-09-14T11:12:10.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.104+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:12:10.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.104+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c0628b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x564b666743a8 s->prefetch_data=0 2024-09-14T11:12:10.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.105+0000 7fa11f525800 10 manifest: total_size = 527 2024-09-14T11:12:10.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.105+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8817427760586469460 2024-09-14T11:12:10.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.105+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c0628b0 obj=test-client.0-r-test-small-obj-data.2:___ state=0x564b666743a8 s->prefetch_data=0 2024-09-14T11:12:10.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.105+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666743a8 2024-09-14T11:12:10.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.105+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.7.0 2024-09-14T11:12:10.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=527 stripe_ofs=527 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8817427760586469460 2024-09-14T11:12:10.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.9DBr5TuL6OHgJpMhfQ-mi35NNTy37pN_0 2024-09-14T11:12:10.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:12:10.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.107+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8817427760586469460 2024-09-14T11:12:10.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.108+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:12:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.109+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c0628b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x564b666743a8 s->prefetch_data=0 2024-09-14T11:12:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.109+0000 7fa11f525800 10 manifest: total_size = 2078 2024-09-14T11:12:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.109+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3306364220879110563 2024-09-14T11:12:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.109+0000 7fa11f525800 20 get_obj_state: octx=0x7fa10c0628b0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x564b666743a8 s->prefetch_data=0 2024-09-14T11:12:10.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.109+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666743a8 2024-09-14T11:12:10.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.109+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.7.0 2024-09-14T11:12:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=2078 stripe_ofs=2078 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3306364220879110563 2024-09-14T11:12:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.oTI-aep3Yi1I4TRqIT96_YitR6-gao2_0 2024-09-14T11:12:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:12:10.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.111+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3306364220879110563 2024-09-14T11:12:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.112+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:12:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.112+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:10.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.112+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.113+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.113+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.113+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.113+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:10.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.113+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[17edae97-cd6b-4c90-863d-862429a20cf3.4538.7])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.114+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-14T11:12:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.114+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.114+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:12:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.114+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-14T11:12:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.114+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-14T11:12:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.115+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-14T11:12:10.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.115+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-14T11:12:10.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.116+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529723 cookie 94881840214992 notifier 5678 bl.length()=181 2024-09-14T11:12:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.117+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 from cache 2024-09-14T11:12:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.117+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7, ofs0, ns] 2024-09-14T11:12:10.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.117+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529705 cookie 94881840235280 notifier 5678 bl.length()=238 2024-09-14T11:12:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.119+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 : miss 2024-09-14T11:12:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.119+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.119+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.119+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 info.flags=0x0 2024-09-14T11:12:10.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.119+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/17edae97-cd6b-4c90-863d-862429a20cf3.4538.7 to cache LRU end 2024-09-14T11:12:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.121+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 : miss 2024-09-14T11:12:10.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.121+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=445 2024-09-14T11:12:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 info.flags=0x17 2024-09-14T11:12:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 to cache LRU end 2024-09-14T11:12:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:12:10.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 cls_bucket_list_unordered: got __ 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 cls_bucket_list_unordered: got __ _ 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 cls_bucket_list_unordered: got ___ 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 cls_bucket_list_unordered: got obj 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 10 manifest: total_size = 1048576 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18256556092746850536 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666748b8 2024-09-14T11:12:10.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.122+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.8.0 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18256556092746850536 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.zGY8gC5hqqAvQq8OcSTSRxkej9-5tlr_0 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.125+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18256556092746850536 2024-09-14T11:12:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.126+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.126+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=__ 2024-09-14T11:12:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.126+0000 7fa11f525800 10 manifest: total_size = 1048576 2024-09-14T11:12:10.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.126+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.348590994551660059 2024-09-14T11:12:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.126+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x564b666748b8 s->prefetch_data=0 2024-09-14T11:12:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.126+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b666748b8 2024-09-14T11:12:10.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.126+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.8.0 2024-09-14T11:12:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=1048576 stripe_ofs=1048576 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.348590994551660059 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.59AzdRw-8PfGyq1PPXoJbu7JAeEwhOf_0 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 327 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.128+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.348590994551660059 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.129+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=__ _ 2024-09-14T11:12:10.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.129+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x564b66662408 s->prefetch_data=0 2024-09-14T11:12:10.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.130+0000 7fa11f525800 10 manifest: total_size = 4134 2024-09-14T11:12:10.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.130+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.2871663515520457041 2024-09-14T11:12:10.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.130+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x564b66662408 s->prefetch_data=0 2024-09-14T11:12:10.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.130+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66662408 2024-09-14T11:12:10.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.130+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.8.0 2024-09-14T11:12:10.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.2871663515520457041 2024-09-14T11:12:10.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.YHS6eWOS67vdvRFL5AKel1RrFOeP9e7_0 2024-09-14T11:12:10.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 328 2024-09-14T11:12:10.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.133+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.2871663515520457041 2024-09-14T11:12:10.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.134+0000 7f9ffeffd640 20 handle_completion(): completion ok for obj=___ 2024-09-14T11:12:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.135+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x564b66662408 s->prefetch_data=0 2024-09-14T11:12:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.135+0000 7fa11f525800 10 manifest: total_size = 4134 2024-09-14T11:12:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.135+0000 7fa11f525800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15898495071331177064 2024-09-14T11:12:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.135+0000 7fa11f525800 20 get_obj_state: octx=0x7fa1040637a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x564b66662408 s->prefetch_data=0 2024-09-14T11:12:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.135+0000 7fa11f525800 20 prepare_atomic_modification: state is not atomic. state=0x564b66662408 2024-09-14T11:12:10.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.135+0000 7fa11f525800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.8.0 2024-09-14T11:12:10.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 RGWObjManifest::operator++(): result: ofs=4134 stripe_ofs=4134 part_ofs=0 rule->part_size=0 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15898495071331177064 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.2JyAl9hluhGhCrZXHh9txTeLA0D-rUf_0 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 329 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.137+0000 7fa11f525800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.15898495071331177064 2024-09-14T11:12:10.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.138+0000 7f9ffe7fc640 20 handle_completion(): completion ok for obj=obj 2024-09-14T11:12:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.138+0000 7fa11f525800 20 list_objects_ordered: starting attempt 1 2024-09-14T11:12:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.138+0000 7fa11f525800 10 cls_bucket_list_ordered: request from each of 1 shard(s) for 1001 entries to get 1001 total entries 2024-09-14T11:12:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.139+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-14T11:12:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.139+0000 7fa11f525800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-14T11:12:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.139+0000 7fa11f525800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-14T11:12:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.139+0000 7fa11f525800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-14T11:12:10.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.139+0000 7fa11f525800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[17edae97-cd6b-4c90-863d-862429a20cf3.4538.8])"; uploads.size()=0; is_truncated=0 2024-09-14T11:12:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.140+0000 7fa11f525800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-14T11:12:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.140+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.140+0000 7fa11f525800 20 rados_obj.operate() r=0 bl.length=223 2024-09-14T11:12:10.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.140+0000 7fa11f525800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-14T11:12:10.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.140+0000 7fa11f525800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-14T11:12:10.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.141+0000 7fa11f525800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-14T11:12:10.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.141+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-14T11:12:10.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.142+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529724 cookie 94881840214992 notifier 5678 bl.length()=181 2024-09-14T11:12:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.143+0000 7fa11f525800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 from cache 2024-09-14T11:12:10.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.143+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8, ofs0, ns] 2024-09-14T11:12:10.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.144+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529706 cookie 94881840235280 notifier 5678 bl.length()=238 2024-09-14T11:12:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.145+0000 7fa11f525800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 : miss 2024-09-14T11:12:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.145+0000 7fa11f525800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.145+0000 7fa11f525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.145+0000 7fa11f525800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 info.flags=0x0 2024-09-14T11:12:10.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.145+0000 7fa11f525800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/17edae97-cd6b-4c90-863d-862429a20cf3.4538.8 to cache LRU end 2024-09-14T11:12:10.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.147+0000 7fa11f525800 10 removing key index: FHABLEBNSOJWHVKHJJXQ 2024-09-14T11:12:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.148+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:FHABLEBNSOJWHVKHJJXQ, ofs0, ns] 2024-09-14T11:12:10.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.148+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529741 cookie 94881840212784 notifier 5678 bl.length()=170 2024-09-14T11:12:10.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.149+0000 7fa11f525800 10 removing email index: ragweed.client.0+test@test.test 2024-09-14T11:12:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.150+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-14T11:12:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.150+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529681 cookie 94881840224480 notifier 5678 bl.length()=182 2024-09-14T11:12:10.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.150+0000 7fa11f525800 10 removing user buckets index 2024-09-14T11:12:10.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.151+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-14T11:12:10.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.152+0000 7f9ffeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529707 cookie 94881840220864 notifier 5678 bl.length()=173 2024-09-14T11:12:10.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.152+0000 7fa11f525800 10 removing user index: ragweed.client.0 2024-09-14T11:12:10.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.153+0000 7fa11f525800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-14T11:12:10.151 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.153+0000 7fa11f525800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-14T11:12:10.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.154+0000 7f9ffe7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529742 cookie 94881840229856 notifier 5678 bl.length()=165 2024-09-14T11:12:10.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.155+0000 7f9fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.157+0000 7fa11f525800 20 remove_watcher() i=0 2024-09-14T11:12:10.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.157+0000 7fa11f525800 2 removed watcher, disabling cache 2024-09-14T11:12:10.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.158+0000 7fa11f525800 20 remove_watcher() i=1 2024-09-14T11:12:10.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.159+0000 7fa11f525800 20 remove_watcher() i=2 2024-09-14T11:12:10.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.160+0000 7fa11f525800 20 remove_watcher() i=3 2024-09-14T11:12:10.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.161+0000 7fa11f525800 20 remove_watcher() i=4 2024-09-14T11:12:10.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.162+0000 7fa11f525800 20 remove_watcher() i=5 2024-09-14T11:12:10.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.162+0000 7fa11f525800 20 remove_watcher() i=6 2024-09-14T11:12:10.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.163+0000 7fa11f525800 20 remove_watcher() i=7 2024-09-14T11:12:10.173 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-14T11:12:10.231 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:12:10.231 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:12:10.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.268+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 20 realm 2024-09-14T11:12:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:12:10.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.270+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.271+0000 7fb498494800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.271+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.271+0000 7fb498494800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:12:10.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.271+0000 7fb498494800 20 searching for the correct realm 2024-09-14T11:12:10.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.275+0000 7fb49677f640 0 -- 172.21.15.2:0/673596706 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fb48c044040 msgr2=0x7fb48c012500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:10.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.278+0000 7fb495f7e640 0 -- 172.21.15.2:0/673596706 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fb48c018070 msgr2=0x7fb48c0771a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:12:10.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:12:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:12:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:12:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:12:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:12:10.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:12:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.485+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 zone default found 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 4 Realm: () 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 zonegroup default 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.486+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.487+0000 7fb498494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.487+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.487+0000 7fb498494800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:12:10.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.487+0000 7fb498494800 20 started sync module instance, tier type = 2024-09-14T11:12:10.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.487+0000 7fb498494800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:12:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=0 2024-09-14T11:12:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=1 2024-09-14T11:12:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=2 2024-09-14T11:12:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=3 2024-09-14T11:12:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=4 2024-09-14T11:12:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=5 2024-09-14T11:12:10.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=6 2024-09-14T11:12:10.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 20 add_watcher() i=7 2024-09-14T11:12:10.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.496+0000 7fb498494800 2 all 8 watchers are set, enabling cache 2024-09-14T11:12:10.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.498+0000 7fb3477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:10.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.498+0000 7fb498494800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:12:10.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.498+0000 7fb498494800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:12:10.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.532+0000 7fb3467fc640 20 reqs_thread_entry: start 2024-09-14T11:12:10.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.532+0000 7fb498494800 20 init_complete bucket index max shards: 1 2024-09-14T11:12:10.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.533+0000 7fb498494800 20 Filter name: none 2024-09-14T11:12:10.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.533+0000 7fb2b7fff640 20 reqs_thread_entry: start 2024-09-14T11:12:10.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.533+0000 7fb498494800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-14T11:12:10.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.533+0000 7fb498494800 20 rados->read ofs=0 len=0 2024-09-14T11:12:10.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.533+0000 7fb498494800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:12:10.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.534+0000 7fb498494800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-14T11:12:10.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.534+0000 7fb498494800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-14T11:12:10.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.534+0000 7fb498494800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:12:10.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.534+0000 7fb498494800 10 removing key index: RCNHIATHCHKWSNVCLXXL 2024-09-14T11:12:10.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.535+0000 7fb498494800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:RCNHIATHCHKWSNVCLXXL, ofs0, ns] 2024-09-14T11:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.536+0000 7fb3797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529743 cookie 94711995460528 notifier 5696 bl.length()=170 2024-09-14T11:12:10.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.536+0000 7fb498494800 10 removing email index: sysuser.client.0+test@test.test 2024-09-14T11:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.537+0000 7fb498494800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-14T11:12:10.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.537+0000 7fb3797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529744 cookie 94711995463360 notifier 5696 bl.length()=182 2024-09-14T11:12:10.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.538+0000 7fb498494800 10 removing user buckets index 2024-09-14T11:12:10.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.539+0000 7fb498494800 10 removing user index: sysuser.client.0 2024-09-14T11:12:10.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.540+0000 7fb498494800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-14T11:12:10.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.540+0000 7fb498494800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-14T11:12:10.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.540+0000 7fb3797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1112396529682 cookie 94711995465904 notifier 5696 bl.length()=165 2024-09-14T11:12:10.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.541+0000 7fb3477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:12:10.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.543+0000 7fb498494800 20 remove_watcher() i=0 2024-09-14T11:12:10.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.543+0000 7fb498494800 2 removed watcher, disabling cache 2024-09-14T11:12:10.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.544+0000 7fb498494800 20 remove_watcher() i=1 2024-09-14T11:12:10.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.545+0000 7fb498494800 20 remove_watcher() i=2 2024-09-14T11:12:10.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.546+0000 7fb498494800 20 remove_watcher() i=3 2024-09-14T11:12:10.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.547+0000 7fb498494800 20 remove_watcher() i=4 2024-09-14T11:12:10.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.548+0000 7fb498494800 20 remove_watcher() i=5 2024-09-14T11:12:10.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.549+0000 7fb498494800 20 remove_watcher() i=6 2024-09-14T11:12:10.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:12:10.550+0000 7fb498494800 20 remove_watcher() i=7 2024-09-14T11:12:10.560 INFO:tasks.ragweed:Removing ragweed... 2024-09-14T11:12:10.561 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-14T11:12:10.639 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:12:10.654 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:12:10.655 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:12:10.655 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:10.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:12:10.685 INFO:teuthology.orchestra.run.smithi002.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:12:10.685 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:10.755 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:12:10.755 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:12:10.824 INFO:tasks.workunit:timeout=3h 2024-09-14T11:12:10.824 INFO:tasks.workunit:cleanup=True 2024-09-14T11:12:10.828 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:12:10.896 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:13:08.106 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 94% (12222/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:13:08.225 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:08.226 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:13:08.227 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:13:08.297 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:13:08.300 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:13:08.300 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:13:08.350 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:13:08.400 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:13:08.440 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:13:08.441 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:13:08.441 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:13:08.482 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:13:08.485 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:13:08.485 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:13:08.555 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-14T11:13:08.556 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-14T11:13:08.556 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:13:08.630 INFO:tasks.workunit.client.0.smithi002.stderr:+ ulimit -c 0 2024-09-14T11:13:08.630 INFO:tasks.workunit.client.0.smithi002.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-14T11:13:08.630 INFO:tasks.workunit.client.0.smithi002.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:13:08.630 INFO:tasks.workunit.client.0.smithi002.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ deactivate nondestructive 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ hash -r 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:13:10.956 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ export VIRTUAL_ENV 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ export PATH 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ PS1='(rgw) ' 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ export PS1 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:++ hash -r 2024-09-14T11:13:10.957 INFO:tasks.workunit.client.0.smithi002.stderr:+ pip install pip --upgrade 2024-09-14T11:13:11.193 INFO:tasks.workunit.client.0.smithi002.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:13:11.369 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting pip 2024-09-14T11:13:11.375 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:13:11.421 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: pip 2024-09-14T11:13:11.421 INFO:tasks.workunit.client.0.smithi002.stdout: Attempting uninstall: pip 2024-09-14T11:13:11.421 INFO:tasks.workunit.client.0.smithi002.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:13:11.583 INFO:tasks.workunit.client.0.smithi002.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:13:11.588 INFO:tasks.workunit.client.0.smithi002.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:13:12.357 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed pip-24.2 2024-09-14T11:13:12.406 INFO:tasks.workunit.client.0.smithi002.stderr:+ pip install boto3 2024-09-14T11:13:13.217 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting boto3 2024-09-14T11:13:13.218 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:13:13.773 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:13:13.774 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:13:13.825 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:13:13.826 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:13:13.872 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:13:13.874 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:13:13.923 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:13:13.924 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:13:14.000 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:13:14.001 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:13:14.145 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:13:14.146 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:13:14.151 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:13:14.152 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:13:14.161 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:13:14.163 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:13:14.164 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:13:14.165 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:13:14.167 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:13:14.243 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:13:15.317 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:13:15.434 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-14T11:13:15.564 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-14T11:13:15.601 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:15.601 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:15.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.643+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.644+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.644+0000 7f8ceae14800 20 realm 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.644+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.644+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.644+0000 7f8ceae14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.644+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.645+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.645+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.645+0000 7f8ceae14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:15.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.645+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.646+0000 7f8ceae14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:15.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.646+0000 7f8ceae14800 20 searching for the correct realm 2024-09-14T11:13:15.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.650+0000 7f8ce5cca640 0 -- 172.21.15.2:0/454001424 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8cd8001c20 msgr2=0x7f8cd80a0970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:15.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.654+0000 7f8ce5cca640 0 -- 172.21.15.2:0/454001424 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8bb0087100 msgr2=0x7f8bb0089530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:15.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.658+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:15.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 zone default found 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 4 Realm: () 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 zonegroup default 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.659+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.660+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.660+0000 7f8ceae14800 20 started sync module instance, tier type = 2024-09-14T11:13:15.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.660+0000 7f8ceae14800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:15.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.669+0000 7f8ceae14800 20 add_watcher() i=0 2024-09-14T11:13:15.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.669+0000 7f8ceae14800 20 add_watcher() i=1 2024-09-14T11:13:15.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.669+0000 7f8ceae14800 20 add_watcher() i=2 2024-09-14T11:13:15.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.669+0000 7f8ceae14800 20 add_watcher() i=3 2024-09-14T11:13:15.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.669+0000 7f8ceae14800 20 add_watcher() i=4 2024-09-14T11:13:15.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.669+0000 7f8ceae14800 20 add_watcher() i=5 2024-09-14T11:13:15.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.669+0000 7f8ceae14800 20 add_watcher() i=6 2024-09-14T11:13:15.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.670+0000 7f8ceae14800 20 add_watcher() i=7 2024-09-14T11:13:15.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.670+0000 7f8ceae14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:15.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.672+0000 7f8b9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:15.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.672+0000 7f8ceae14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:15.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.672+0000 7f8ceae14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:15.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.672+0000 7f8ceae14800 5 note: GC not initialized 2024-09-14T11:13:15.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8b177fe640 20 reqs_thread_entry: start 2024-09-14T11:13:15.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:15.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 20 Filter name: none 2024-09-14T11:13:15.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8b157fa640 20 reqs_thread_entry: start 2024-09-14T11:13:15.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-14T11:13:15.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:13:15.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.673+0000 7f8ceae14800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-14T11:13:15.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.675+0000 7f8ceae14800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:13:15.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.675+0000 7f8ceae14800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:13:15.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.675+0000 7f8ceae14800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-14T11:13:15.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.675+0000 7f8bc9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94902424167584 notifier 5711 bl.length()=569 2024-09-14T11:13:15.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.675+0000 7f8bc9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-14T11:13:15.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.675+0000 7f8bc9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-14T11:13:15.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.677+0000 7f8ceae14800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:13:15.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.677+0000 7f8ceae14800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:13:15.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.677+0000 7f8ceae14800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-14T11:13:15.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.677+0000 7f8bc9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464301 cookie 94902424173024 notifier 5711 bl.length()=180 2024-09-14T11:13:15.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.677+0000 7f8bc9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-14T11:13:15.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.677+0000 7f8bc9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-14T11:13:15.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.678+0000 7f8b9cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:15.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.681+0000 7f8ceae14800 20 remove_watcher() i=0 2024-09-14T11:13:15.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.681+0000 7f8ceae14800 2 removed watcher, disabling cache 2024-09-14T11:13:15.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.682+0000 7f8ceae14800 20 remove_watcher() i=1 2024-09-14T11:13:15.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.683+0000 7f8ceae14800 20 remove_watcher() i=2 2024-09-14T11:13:15.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.684+0000 7f8ceae14800 20 remove_watcher() i=3 2024-09-14T11:13:15.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.685+0000 7f8ceae14800 20 remove_watcher() i=4 2024-09-14T11:13:15.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.686+0000 7f8ceae14800 20 remove_watcher() i=5 2024-09-14T11:13:15.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.687+0000 7f8ceae14800 20 remove_watcher() i=6 2024-09-14T11:13:15.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:15.688+0000 7f8ceae14800 20 remove_watcher() i=7 2024-09-14T11:13:29.491 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:29.491 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:29.537 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:29.537 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:29.549 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:29.549 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:29.562 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:29.562 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:29.568 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:29.568 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:29.610 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:29.611 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:29.652 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard add 2024-09-14T11:13:29.652 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:29.654 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:13:29.686 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:29.686 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:29.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.730+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 20 realm 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:29.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.732+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.733+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:29.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.733+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.734+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:29.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.734+0000 7f9fec696800 20 searching for the correct realm 2024-09-14T11:13:29.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.737+0000 7f9fe997f640 0 -- 172.21.15.2:0/1817999447 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f9fdc01f070 msgr2=0x7f9fdc0690c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:29.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.741+0000 7f9fea180640 0 -- 172.21.15.2:0/1817999447 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f9fe0064920 msgr2=0x7f9fe00a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:29.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.947+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 zone default found 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 4 Realm: () 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 zonegroup default 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.948+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.949+0000 7f9fec696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:29.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.949+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.949+0000 7f9fec696800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:29.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.949+0000 7f9fec696800 20 started sync module instance, tier type = 2024-09-14T11:13:29.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.949+0000 7f9fec696800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.959+0000 7f9fec696800 20 add_watcher() i=0 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.959+0000 7f9fec696800 20 add_watcher() i=1 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.959+0000 7f9fec696800 20 add_watcher() i=2 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.959+0000 7f9fec696800 20 add_watcher() i=3 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.959+0000 7f9fec696800 20 add_watcher() i=4 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.959+0000 7f9fec696800 20 add_watcher() i=5 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.959+0000 7f9fec696800 20 add_watcher() i=6 2024-09-14T11:13:29.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.960+0000 7f9fec696800 20 add_watcher() i=7 2024-09-14T11:13:29.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.960+0000 7f9fec696800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:29.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.962+0000 7f9ea0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:29.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9fec696800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:29.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9fec696800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9fec696800 5 note: GC not initialized 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9e1b7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9fec696800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9fec696800 20 Filter name: none 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9e197fa640 20 reqs_thread_entry: start 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.963+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.964+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:29.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.964+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.965+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:29.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.965+0000 7f9fec696800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:29.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.965+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.965+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:29.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.965+0000 7f9fec696800 20 rados->read ofs=0 len=0 2024-09-14T11:13:29.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.966+0000 7f9fec696800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:29.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.966+0000 7f9fec696800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:29.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.967+0000 7f9ea0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:29.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.970+0000 7f9fec696800 20 remove_watcher() i=0 2024-09-14T11:13:29.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.970+0000 7f9fec696800 2 removed watcher, disabling cache 2024-09-14T11:13:29.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.971+0000 7f9fec696800 20 remove_watcher() i=1 2024-09-14T11:13:29.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.972+0000 7f9fec696800 20 remove_watcher() i=2 2024-09-14T11:13:29.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.973+0000 7f9fec696800 20 remove_watcher() i=3 2024-09-14T11:13:29.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.974+0000 7f9fec696800 20 remove_watcher() i=4 2024-09-14T11:13:29.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.975+0000 7f9fec696800 20 remove_watcher() i=5 2024-09-14T11:13:29.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.976+0000 7f9fec696800 20 remove_watcher() i=6 2024-09-14T11:13:29.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:29.977+0000 7f9fec696800 20 remove_watcher() i=7 2024-09-14T11:13:29.987 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:29.987 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:29.988 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-14T11:13:29.988 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:29.989 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 2 2024-09-14T11:13:30.021 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:30.021 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:30.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.062+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.064+0000 7f9292b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.064+0000 7f9292b46800 20 realm 2024-09-14T11:13:30.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.064+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.065+0000 7f9292b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.065+0000 7f9292b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:30.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.065+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.065+0000 7f9292b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.065+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.066+0000 7f9292b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:30.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.066+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.066+0000 7f9292b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:30.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.066+0000 7f9292b46800 20 searching for the correct realm 2024-09-14T11:13:30.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.071+0000 7f9290e31640 0 -- 172.21.15.2:0/595469023 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f9284001c20 msgr2=0x7f9284062aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:30.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.277+0000 7f9290630640 0 -- 172.21.15.2:0/595469023 >> [v2:172.21.15.86:6810/3386010674,v1:172.21.15.86:6811/3386010674] conn(0x560a95cd0fe0 msgr2=0x560a95cd3410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.279+0000 7f9292b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.279+0000 7f9292b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.279+0000 7f9292b46800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.279+0000 7f9292b46800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.279+0000 7f9292b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.279+0000 7f9292b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.279+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 zone default found 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 4 Realm: () 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 zonegroup default 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.280+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.281+0000 7f9292b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.281+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.281+0000 7f9292b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.281+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.281+0000 7f9292b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.281+0000 7f9292b46800 20 started sync module instance, tier type = 2024-09-14T11:13:30.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.281+0000 7f9292b46800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:30.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.291+0000 7f9292b46800 20 add_watcher() i=0 2024-09-14T11:13:30.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.291+0000 7f9292b46800 20 add_watcher() i=1 2024-09-14T11:13:30.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.291+0000 7f9292b46800 20 add_watcher() i=2 2024-09-14T11:13:30.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.291+0000 7f9292b46800 20 add_watcher() i=3 2024-09-14T11:13:30.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.291+0000 7f9292b46800 20 add_watcher() i=4 2024-09-14T11:13:30.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.291+0000 7f9292b46800 20 add_watcher() i=5 2024-09-14T11:13:30.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.291+0000 7f9292b46800 20 add_watcher() i=6 2024-09-14T11:13:30.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.292+0000 7f9292b46800 20 add_watcher() i=7 2024-09-14T11:13:30.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.292+0000 7f9292b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:30.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.294+0000 7f9146fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:30.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.294+0000 7f9292b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:30.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.294+0000 7f9292b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:30.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.294+0000 7f9292b46800 5 note: GC not initialized 2024-09-14T11:13:30.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.294+0000 7f9145fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:30.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.294+0000 7f9292b46800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:30.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 20 Filter name: none 2024-09-14T11:13:30.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f90b77fe640 20 reqs_thread_entry: start 2024-09-14T11:13:30.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:13:30.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.295+0000 7f9292b46800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.296+0000 7f9292b46800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.296+0000 7f9292b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.296+0000 7f9292b46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.296+0000 7f9292b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.296+0000 7f9292b46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.296+0000 7f9292b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:30.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.298+0000 7f9146fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:30.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.301+0000 7f9292b46800 20 remove_watcher() i=0 2024-09-14T11:13:30.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.301+0000 7f9292b46800 2 removed watcher, disabling cache 2024-09-14T11:13:30.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.302+0000 7f9292b46800 20 remove_watcher() i=1 2024-09-14T11:13:30.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.303+0000 7f9292b46800 20 remove_watcher() i=2 2024-09-14T11:13:30.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.304+0000 7f9292b46800 20 remove_watcher() i=3 2024-09-14T11:13:30.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.305+0000 7f9292b46800 20 remove_watcher() i=4 2024-09-14T11:13:30.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.306+0000 7f9292b46800 20 remove_watcher() i=5 2024-09-14T11:13:30.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.307+0000 7f9292b46800 20 remove_watcher() i=6 2024-09-14T11:13:30.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.308+0000 7f9292b46800 20 remove_watcher() i=7 2024-09-14T11:13:30.319 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshard list 2024-09-14T11:13:30.347 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:30.347 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:30.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.388+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 20 realm 2024-09-14T11:13:30.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:30.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.391+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.392+0000 7f833ef25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:30.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.392+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.392+0000 7f833ef25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:30.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.392+0000 7f833ef25800 20 searching for the correct realm 2024-09-14T11:13:30.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.396+0000 7f833a332640 0 -- 172.21.15.2:0/2304709491 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f832c0abd30 msgr2=0x7f832c0ce460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:30.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.400+0000 7f833a332640 0 -- 172.21.15.2:0/2304709491 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f82040870d0 msgr2=0x7f8204089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 zone default found 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 4 Realm: () 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 zonegroup default 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.405+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.406+0000 7f833ef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.406+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.406+0000 7f833ef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.406+0000 7f833ef25800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.406+0000 7f833ef25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.406+0000 7f833ef25800 20 started sync module instance, tier type = 2024-09-14T11:13:30.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.406+0000 7f833ef25800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:30.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.415+0000 7f833ef25800 20 add_watcher() i=0 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.415+0000 7f833ef25800 20 add_watcher() i=1 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.415+0000 7f833ef25800 20 add_watcher() i=2 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.415+0000 7f833ef25800 20 add_watcher() i=3 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.415+0000 7f833ef25800 20 add_watcher() i=4 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.415+0000 7f833ef25800 20 add_watcher() i=5 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.415+0000 7f833ef25800 20 add_watcher() i=6 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.416+0000 7f833ef25800 20 add_watcher() i=7 2024-09-14T11:13:30.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.416+0000 7f833ef25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:30.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.419+0000 7f81f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:30.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.420+0000 7f833ef25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:30.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.420+0000 7f833ef25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:30.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.420+0000 7f833ef25800 5 note: GC not initialized 2024-09-14T11:13:30.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.420+0000 7f816bfff640 20 reqs_thread_entry: start 2024-09-14T11:13:30.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.420+0000 7f833ef25800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:30.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.420+0000 7f833ef25800 20 Filter name: none 2024-09-14T11:13:30.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.420+0000 7f8169ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:30.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.426+0000 7f81f17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:30.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.429+0000 7f833ef25800 20 remove_watcher() i=0 2024-09-14T11:13:30.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.429+0000 7f833ef25800 2 removed watcher, disabling cache 2024-09-14T11:13:30.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.430+0000 7f833ef25800 20 remove_watcher() i=1 2024-09-14T11:13:30.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.432+0000 7f833ef25800 20 remove_watcher() i=2 2024-09-14T11:13:30.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.433+0000 7f833ef25800 20 remove_watcher() i=3 2024-09-14T11:13:30.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.434+0000 7f833ef25800 20 remove_watcher() i=4 2024-09-14T11:13:30.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.435+0000 7f833ef25800 20 remove_watcher() i=5 2024-09-14T11:13:30.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.436+0000 7f833ef25800 20 remove_watcher() i=6 2024-09-14T11:13:30.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.437+0000 7f833ef25800 20 remove_watcher() i=7 2024-09-14T11:13:30.446 INFO:tasks.workunit.client.0.smithi002.stderr:bucket name a-bucket 2024-09-14T11:13:30.447 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard process 2024-09-14T11:13:30.447 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:30.448 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshard process 2024-09-14T11:13:30.476 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:30.476 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:30.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.517+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 20 realm 2024-09-14T11:13:30.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:30.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.519+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.520+0000 7fa1d8887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:30.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.520+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.520+0000 7fa1d8887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:30.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.520+0000 7fa1d8887800 20 searching for the correct realm 2024-09-14T11:13:30.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.524+0000 7fa1d5b70640 0 -- 172.21.15.2:0/4268893377 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x56138b7e2630 msgr2=0x56138b7e4af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:30.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.527+0000 7fa1d6371640 0 -- 172.21.15.2:0/4268893377 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa1c003ca00 msgr2=0x7fa1c0023420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.531+0000 7fa1d8887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.531+0000 7fa1d8887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.531+0000 7fa1d8887800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.531+0000 7fa1d8887800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.531+0000 7fa1d8887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.531+0000 7fa1d8887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.531+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:30.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 zone default found 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 4 Realm: () 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 zonegroup default 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.532+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.533+0000 7fa1d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.533+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.533+0000 7fa1d8887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.533+0000 7fa1d8887800 20 started sync module instance, tier type = 2024-09-14T11:13:30.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.533+0000 7fa1d8887800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:30.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=0 2024-09-14T11:13:30.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=1 2024-09-14T11:13:30.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=2 2024-09-14T11:13:30.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=3 2024-09-14T11:13:30.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=4 2024-09-14T11:13:30.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=5 2024-09-14T11:13:30.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=6 2024-09-14T11:13:30.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 20 add_watcher() i=7 2024-09-14T11:13:30.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.543+0000 7fa1d8887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:30.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.545+0000 7fa08cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.545+0000 7fa1d8887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.545+0000 7fa1d8887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.545+0000 7fa1d8887800 5 note: GC not initialized 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.546+0000 7fa0077fe640 20 reqs_thread_entry: start 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.546+0000 7fa1d8887800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.546+0000 7fa1d8887800 20 Filter name: none 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.546+0000 7fa0057fa640 20 reqs_thread_entry: start 2024-09-14T11:13:30.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.546+0000 7fa1d8887800 20 processing logshard = reshard.0000000000 2024-09-14T11:13:30.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.549+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:13:30.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.549+0000 7fa1d8887800 20 processing logshard = reshard.0000000001 2024-09-14T11:13:30.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.551+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:13:30.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.551+0000 7fa1d8887800 20 processing logshard = reshard.0000000002 2024-09-14T11:13:30.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.553+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:13:30.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.553+0000 7fa1d8887800 20 processing logshard = reshard.0000000003 2024-09-14T11:13:30.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.556+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:13:30.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.556+0000 7fa1d8887800 20 processing logshard = reshard.0000000004 2024-09-14T11:13:30.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.558+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:13:30.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.558+0000 7fa1d8887800 20 processing logshard = reshard.0000000005 2024-09-14T11:13:30.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.561+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:13:30.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.561+0000 7fa1d8887800 20 processing logshard = reshard.0000000006 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.562+0000 7fa1d8887800 20 process_entry resharding a-bucket 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.562+0000 7fa1d8887800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.562+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 20 rados->read ofs=0 len=0 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:30.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.563+0000 7fa1d8887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.568+0000 7fa1d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.568+0000 7fa1d8887800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.568+0000 7fa1d8887800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.568+0000 7fa1d8887800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa0b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464272 cookie 94641944687440 notifier 6048 bl.length()=827 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa0b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa0b9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa0b9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:13:30.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:13:30.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:13:30.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.569+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:13:30.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.571+0000 7fa1d8887800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.0 2024-09-14T11:13:30.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.571+0000 7fa1d8887800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.0 2024-09-14T11:13:30.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.571+0000 7fa1d8887800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.1 2024-09-14T11:13:30.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.571+0000 7fa1d8887800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.1 2024-09-14T11:13:30.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.571+0000 7fa1d8887800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.0 2024-09-14T11:13:30.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.572+0000 7fa1d8887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:30.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.572+0000 7fa1d8887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.573+0000 7fa1d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.573+0000 7fa1d8887800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.573+0000 7fa1d8887800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.573+0000 7fa1d8887800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa0b9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464273 cookie 94641944687440 notifier 6048 bl.length()=827 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa0b9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa0b9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa0b9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:13:30.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:13:30.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:13:30.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.574+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:13:30.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.575+0000 7fa1d8887800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.0 2024-09-14T11:13:30.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.576+0000 7fa1d8887800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:30.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.576+0000 7fa1d8887800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.577+0000 7fa1d8887800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.577+0000 7fa1d8887800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.577+0000 7fa1d8887800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.577+0000 7fa1d8887800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa0b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464274 cookie 94641944687440 notifier 6048 bl.length()=795 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa0b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa0b97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:30.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa0b97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:30.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:13:30.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:13:30.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:13:30.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.578+0000 7fa1d8887800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:13:30.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.579+0000 7fa1d8887800 1 execute INFO: reshard of bucket "a-bucket" from 1 shards to 2 shards completed successfully 2024-09-14T11:13:30.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.580+0000 7fa1d8887800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:13:30.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.582+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:13:30.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.582+0000 7fa1d8887800 20 processing logshard = reshard.0000000007 2024-09-14T11:13:30.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.584+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:13:30.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.584+0000 7fa1d8887800 20 processing logshard = reshard.0000000008 2024-09-14T11:13:30.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.588+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:13:30.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.588+0000 7fa1d8887800 20 processing logshard = reshard.0000000009 2024-09-14T11:13:30.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.590+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:13:30.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.590+0000 7fa1d8887800 20 processing logshard = reshard.0000000010 2024-09-14T11:13:30.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.592+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:13:30.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.592+0000 7fa1d8887800 20 processing logshard = reshard.0000000011 2024-09-14T11:13:30.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.595+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:13:30.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.595+0000 7fa1d8887800 20 processing logshard = reshard.0000000012 2024-09-14T11:13:30.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.597+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:13:30.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.597+0000 7fa1d8887800 20 processing logshard = reshard.0000000013 2024-09-14T11:13:30.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.600+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:13:30.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.600+0000 7fa1d8887800 20 processing logshard = reshard.0000000014 2024-09-14T11:13:30.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.602+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:13:30.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.602+0000 7fa1d8887800 20 processing logshard = reshard.0000000015 2024-09-14T11:13:30.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.604+0000 7fa1d8887800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:13:30.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.605+0000 7fa08cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:30.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.607+0000 7fa1d8887800 20 remove_watcher() i=0 2024-09-14T11:13:30.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.607+0000 7fa1d8887800 2 removed watcher, disabling cache 2024-09-14T11:13:30.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.608+0000 7fa1d8887800 20 remove_watcher() i=1 2024-09-14T11:13:30.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.609+0000 7fa1d8887800 20 remove_watcher() i=2 2024-09-14T11:13:30.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.610+0000 7fa1d8887800 20 remove_watcher() i=3 2024-09-14T11:13:30.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.611+0000 7fa1d8887800 20 remove_watcher() i=4 2024-09-14T11:13:30.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.612+0000 7fa1d8887800 20 remove_watcher() i=5 2024-09-14T11:13:30.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.613+0000 7fa1d8887800 20 remove_watcher() i=6 2024-09-14T11:13:30.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:30.614+0000 7fa1d8887800 20 remove_watcher() i=7 2024-09-14T11:13:35.631 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:13:35.665 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:35.665 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:35.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.713+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 20 realm 2024-09-14T11:13:35.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:35.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.715+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.716+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:35.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.716+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.716+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:35.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.716+0000 7ff921d22800 20 searching for the correct realm 2024-09-14T11:13:35.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.720+0000 7ff91d101640 0 -- 172.21.15.2:0/2306956491 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7ff91009d070 msgr2=0x7ff9100bb5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:35.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.724+0000 7ff91d902640 0 -- 172.21.15.2:0/2306956491 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ff914042fd0 msgr2=0x7ff914069fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.931+0000 7ff921d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.931+0000 7ff921d22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.931+0000 7ff921d22800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.931+0000 7ff921d22800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.931+0000 7ff921d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.931+0000 7ff921d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.931+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 zone default found 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 4 Realm: () 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:35.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 zonegroup default 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.932+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.933+0000 7ff921d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.933+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.933+0000 7ff921d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.933+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.934+0000 7ff921d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.934+0000 7ff921d22800 20 started sync module instance, tier type = 2024-09-14T11:13:35.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.934+0000 7ff921d22800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:35.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.945+0000 7ff921d22800 20 add_watcher() i=0 2024-09-14T11:13:35.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.945+0000 7ff921d22800 20 add_watcher() i=1 2024-09-14T11:13:35.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.945+0000 7ff921d22800 20 add_watcher() i=2 2024-09-14T11:13:35.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.945+0000 7ff921d22800 20 add_watcher() i=3 2024-09-14T11:13:35.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.945+0000 7ff921d22800 20 add_watcher() i=4 2024-09-14T11:13:35.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.945+0000 7ff921d22800 20 add_watcher() i=5 2024-09-14T11:13:35.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.945+0000 7ff921d22800 20 add_watcher() i=6 2024-09-14T11:13:35.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.946+0000 7ff921d22800 20 add_watcher() i=7 2024-09-14T11:13:35.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.946+0000 7ff921d22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:35.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.948+0000 7ff7c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:35.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.948+0000 7ff921d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:35.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.948+0000 7ff921d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:35.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.948+0000 7ff921d22800 5 note: GC not initialized 2024-09-14T11:13:35.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.949+0000 7ff7c67fc640 20 reqs_thread_entry: start 2024-09-14T11:13:35.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.949+0000 7ff921d22800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:35.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.949+0000 7ff921d22800 20 Filter name: none 2024-09-14T11:13:35.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.949+0000 7ff743fff640 20 reqs_thread_entry: start 2024-09-14T11:13:35.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.949+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.950+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:35.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.950+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.950+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:35.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.950+0000 7ff921d22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:35.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.950+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.951+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:35.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.951+0000 7ff921d22800 20 rados->read ofs=0 len=0 2024-09-14T11:13:35.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.951+0000 7ff921d22800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:35.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.951+0000 7ff921d22800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:35.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.953+0000 7ff7c77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:35.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.955+0000 7ff921d22800 20 remove_watcher() i=0 2024-09-14T11:13:35.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.955+0000 7ff921d22800 2 removed watcher, disabling cache 2024-09-14T11:13:35.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.957+0000 7ff921d22800 20 remove_watcher() i=1 2024-09-14T11:13:35.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.958+0000 7ff921d22800 20 remove_watcher() i=2 2024-09-14T11:13:35.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.959+0000 7ff921d22800 20 remove_watcher() i=3 2024-09-14T11:13:35.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.961+0000 7ff921d22800 20 remove_watcher() i=4 2024-09-14T11:13:35.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.962+0000 7ff921d22800 20 remove_watcher() i=5 2024-09-14T11:13:35.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.963+0000 7ff921d22800 20 remove_watcher() i=6 2024-09-14T11:13:35.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:35.964+0000 7ff921d22800 20 remove_watcher() i=7 2024-09-14T11:13:35.976 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:35.976 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:35.976 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-14T11:13:35.976 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:35.976 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard add non empty bucket 2024-09-14T11:13:35.976 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:35.981 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:35.981 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:35.991 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:35.991 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:35.998 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:35.999 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:36.006 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:36.006 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:36.014 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:36.014 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:36.022 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:36.022 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:36.029 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:36.029 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:36.037 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:36.037 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:36.044 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:13:36.074 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:36.074 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:36.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.116+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 20 realm 2024-09-14T11:13:36.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:36.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.118+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.119+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.119+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.119+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:36.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.119+0000 7fb6f413c800 20 searching for the correct realm 2024-09-14T11:13:36.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.123+0000 7fb6ef680640 0 -- 172.21.15.2:0/3165320223 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fb6e005f0c0 msgr2=0x7fb6e008c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.126+0000 7fb6f0682640 0 -- 172.21.15.2:0/3165320223 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7fb6e400b040 msgr2=0x7fb6e400b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:36.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:36.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.130+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 zone default found 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 4 Realm: () 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 zonegroup default 2024-09-14T11:13:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.131+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.132+0000 7fb6f413c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.132+0000 7fb6f413c800 20 started sync module instance, tier type = 2024-09-14T11:13:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.132+0000 7fb6f413c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:36.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.140+0000 7fb6f413c800 20 add_watcher() i=0 2024-09-14T11:13:36.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.140+0000 7fb6f413c800 20 add_watcher() i=1 2024-09-14T11:13:36.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.140+0000 7fb6f413c800 20 add_watcher() i=2 2024-09-14T11:13:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.140+0000 7fb6f413c800 20 add_watcher() i=3 2024-09-14T11:13:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.140+0000 7fb6f413c800 20 add_watcher() i=4 2024-09-14T11:13:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.140+0000 7fb6f413c800 20 add_watcher() i=5 2024-09-14T11:13:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.140+0000 7fb6f413c800 20 add_watcher() i=6 2024-09-14T11:13:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.141+0000 7fb6f413c800 20 add_watcher() i=7 2024-09-14T11:13:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.141+0000 7fb6f413c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:36.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb5a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb6f413c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb6f413c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb6f413c800 5 note: GC not initialized 2024-09-14T11:13:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb5a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb6f413c800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb6f413c800 20 Filter name: none 2024-09-14T11:13:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb51e7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.143+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.144+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:36.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.144+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.145+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:36.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.145+0000 7fb6f413c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:36.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.145+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.145+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:36.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.145+0000 7fb6f413c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.145+0000 7fb6f413c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:36.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.145+0000 7fb6f413c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:36.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.147+0000 7fb5a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.149+0000 7fb6f413c800 20 remove_watcher() i=0 2024-09-14T11:13:36.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.149+0000 7fb6f413c800 2 removed watcher, disabling cache 2024-09-14T11:13:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.150+0000 7fb6f413c800 20 remove_watcher() i=1 2024-09-14T11:13:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.151+0000 7fb6f413c800 20 remove_watcher() i=2 2024-09-14T11:13:36.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.152+0000 7fb6f413c800 20 remove_watcher() i=3 2024-09-14T11:13:36.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.154+0000 7fb6f413c800 20 remove_watcher() i=4 2024-09-14T11:13:36.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.155+0000 7fb6f413c800 20 remove_watcher() i=5 2024-09-14T11:13:36.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.155+0000 7fb6f413c800 20 remove_watcher() i=6 2024-09-14T11:13:36.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.156+0000 7fb6f413c800 20 remove_watcher() i=7 2024-09-14T11:13:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:36.166 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:36.166 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 8 size_kb: 1 num_shards: 2 2024-09-14T11:13:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:36.168 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 3 2024-09-14T11:13:36.199 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:36.199 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:36.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.239+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 20 realm 2024-09-14T11:13:36.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:36.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.241+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.242+0000 7f2c52542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.242+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.242+0000 7f2c52542800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:36.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.242+0000 7f2c52542800 20 searching for the correct realm 2024-09-14T11:13:36.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.246+0000 7f2c4da85640 0 -- 172.21.15.2:0/3113876487 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55e7a166cb10 msgr2=0x55e7a166efd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:36.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.249+0000 7f2c4e286640 0 -- 172.21.15.2:0/3113876487 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2c44017970 msgr2=0x7f2c440983f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:36.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:36.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:36.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:36.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:36.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:36.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:36.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.254+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:36.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 zone default found 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 4 Realm: () 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 zonegroup default 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.255+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.256+0000 7f2c52542800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.256+0000 7f2c52542800 20 started sync module instance, tier type = 2024-09-14T11:13:36.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.256+0000 7f2c52542800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:36.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.264+0000 7f2c52542800 20 add_watcher() i=0 2024-09-14T11:13:36.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.264+0000 7f2c52542800 20 add_watcher() i=1 2024-09-14T11:13:36.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.264+0000 7f2c52542800 20 add_watcher() i=2 2024-09-14T11:13:36.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.264+0000 7f2c52542800 20 add_watcher() i=3 2024-09-14T11:13:36.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.264+0000 7f2c52542800 20 add_watcher() i=4 2024-09-14T11:13:36.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.264+0000 7f2c52542800 20 add_watcher() i=5 2024-09-14T11:13:36.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.264+0000 7f2c52542800 20 add_watcher() i=6 2024-09-14T11:13:36.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.265+0000 7f2c52542800 20 add_watcher() i=7 2024-09-14T11:13:36.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.265+0000 7f2c52542800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:36.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.267+0000 7f2b057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.267+0000 7f2c52542800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.267+0000 7f2c52542800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.267+0000 7f2c52542800 5 note: GC not initialized 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.267+0000 7f2aff7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.267+0000 7f2c52542800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.267+0000 7f2c52542800 20 Filter name: none 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2afd7fa640 20 reqs_thread_entry: start 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2c52542800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:13:36.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2c52542800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2c52542800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2c52542800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2c52542800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.268+0000 7f2c52542800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.269+0000 7f2c52542800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.269+0000 7f2c52542800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.269+0000 7f2c52542800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.269+0000 7f2c52542800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.269+0000 7f2c52542800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.269+0000 7f2c52542800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:36.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.271+0000 7f2b057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.273+0000 7f2c52542800 20 remove_watcher() i=0 2024-09-14T11:13:36.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.273+0000 7f2c52542800 2 removed watcher, disabling cache 2024-09-14T11:13:36.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.274+0000 7f2c52542800 20 remove_watcher() i=1 2024-09-14T11:13:36.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.275+0000 7f2c52542800 20 remove_watcher() i=2 2024-09-14T11:13:36.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.276+0000 7f2c52542800 20 remove_watcher() i=3 2024-09-14T11:13:36.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.277+0000 7f2c52542800 20 remove_watcher() i=4 2024-09-14T11:13:36.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.278+0000 7f2c52542800 20 remove_watcher() i=5 2024-09-14T11:13:36.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.279+0000 7f2c52542800 20 remove_watcher() i=6 2024-09-14T11:13:36.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.280+0000 7f2c52542800 20 remove_watcher() i=7 2024-09-14T11:13:36.291 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshard list 2024-09-14T11:13:36.318 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:36.318 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:36.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.359+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 20 realm 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.361+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.362+0000 7f1f4852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.362+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.363+0000 7f1f4852c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:36.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.363+0000 7f1f4852c800 20 searching for the correct realm 2024-09-14T11:13:36.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.366+0000 7f1f3bfff640 0 -- 172.21.15.2:0/1858815265 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f1f34063070 msgr2=0x7f1f340039b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:36.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.370+0000 7f1f3bfff640 0 -- 172.21.15.2:0/1858815265 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f1e0c0870d0 msgr2=0x7f1e0c089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:36.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.373+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 zone default found 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 4 Realm: () 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 zonegroup default 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.374+0000 7f1f4852c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.375+0000 7f1f4852c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.375+0000 7f1f4852c800 20 started sync module instance, tier type = 2024-09-14T11:13:36.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.375+0000 7f1f4852c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:36.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.383+0000 7f1f4852c800 20 add_watcher() i=0 2024-09-14T11:13:36.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.383+0000 7f1f4852c800 20 add_watcher() i=1 2024-09-14T11:13:36.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.383+0000 7f1f4852c800 20 add_watcher() i=2 2024-09-14T11:13:36.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.383+0000 7f1f4852c800 20 add_watcher() i=3 2024-09-14T11:13:36.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.383+0000 7f1f4852c800 20 add_watcher() i=4 2024-09-14T11:13:36.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.383+0000 7f1f4852c800 20 add_watcher() i=5 2024-09-14T11:13:36.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.383+0000 7f1f4852c800 20 add_watcher() i=6 2024-09-14T11:13:36.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.384+0000 7f1f4852c800 20 add_watcher() i=7 2024-09-14T11:13:36.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.384+0000 7f1f4852c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:36.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.386+0000 7f1dfafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.386+0000 7f1f4852c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:36.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.386+0000 7f1f4852c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:36.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.386+0000 7f1f4852c800 5 note: GC not initialized 2024-09-14T11:13:36.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.386+0000 7f1df9fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:36.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.386+0000 7f1f4852c800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:36.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.387+0000 7f1f4852c800 20 Filter name: none 2024-09-14T11:13:36.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.387+0000 7f1d6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:36.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.392+0000 7f1dfafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.394+0000 7f1f4852c800 20 remove_watcher() i=0 2024-09-14T11:13:36.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.394+0000 7f1f4852c800 2 removed watcher, disabling cache 2024-09-14T11:13:36.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.395+0000 7f1f4852c800 20 remove_watcher() i=1 2024-09-14T11:13:36.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.396+0000 7f1f4852c800 20 remove_watcher() i=2 2024-09-14T11:13:36.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.397+0000 7f1f4852c800 20 remove_watcher() i=3 2024-09-14T11:13:36.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.398+0000 7f1f4852c800 20 remove_watcher() i=4 2024-09-14T11:13:36.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.399+0000 7f1f4852c800 20 remove_watcher() i=5 2024-09-14T11:13:36.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.400+0000 7f1f4852c800 20 remove_watcher() i=6 2024-09-14T11:13:36.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.401+0000 7f1f4852c800 20 remove_watcher() i=7 2024-09-14T11:13:36.411 INFO:tasks.workunit.client.0.smithi002.stderr:bucket name a-bucket 2024-09-14T11:13:36.411 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard process non empty bucket 2024-09-14T11:13:36.411 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:36.412 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshard process 2024-09-14T11:13:36.439 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:36.439 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:36.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.481+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 20 realm 2024-09-14T11:13:36.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:36.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.483+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.484+0000 7ff6f9d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.484+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.484+0000 7ff6f9d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:36.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.484+0000 7ff6f9d2a800 20 searching for the correct realm 2024-09-14T11:13:36.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.487+0000 7ff6f524e640 0 -- 172.21.15.2:0/595328676 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7ff6e8051070 msgr2=0x7ff6e80890d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:36.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.491+0000 7ff6f5a4f640 0 -- 172.21.15.2:0/595328676 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ff6ec06cb30 msgr2=0x7ff6ec0b0160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:36.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:36.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:36.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:36.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:36.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.698+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 zone default found 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 4 Realm: () 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 zonegroup default 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.699+0000 7ff6f9d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.700+0000 7ff6f9d2a800 20 started sync module instance, tier type = 2024-09-14T11:13:36.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.700+0000 7ff6f9d2a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:36.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.708+0000 7ff6f9d2a800 20 add_watcher() i=0 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.708+0000 7ff6f9d2a800 20 add_watcher() i=1 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.708+0000 7ff6f9d2a800 20 add_watcher() i=2 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.708+0000 7ff6f9d2a800 20 add_watcher() i=3 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.708+0000 7ff6f9d2a800 20 add_watcher() i=4 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.708+0000 7ff6f9d2a800 20 add_watcher() i=5 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.708+0000 7ff6f9d2a800 20 add_watcher() i=6 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.709+0000 7ff6f9d2a800 20 add_watcher() i=7 2024-09-14T11:13:36.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.709+0000 7ff6f9d2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:36.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.711+0000 7ff5a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.711+0000 7ff6f9d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.711+0000 7ff6f9d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.711+0000 7ff6f9d2a800 5 note: GC not initialized 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.711+0000 7ff5a6ffd640 20 reqs_thread_entry: start 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.711+0000 7ff6f9d2a800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.712+0000 7ff6f9d2a800 20 Filter name: none 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.712+0000 7ff5a4ff9640 20 reqs_thread_entry: start 2024-09-14T11:13:36.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.712+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000000 2024-09-14T11:13:36.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.714+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-14T11:13:36.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.714+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000001 2024-09-14T11:13:36.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.717+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-14T11:13:36.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.717+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000002 2024-09-14T11:13:36.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.719+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-14T11:13:36.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.719+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000003 2024-09-14T11:13:36.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.721+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-14T11:13:36.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.721+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000004 2024-09-14T11:13:36.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.724+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-14T11:13:36.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.724+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000005 2024-09-14T11:13:36.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.727+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-14T11:13:36.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.727+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000006 2024-09-14T11:13:36.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.728+0000 7ff6f9d2a800 20 process_entry resharding a-bucket 2024-09-14T11:13:36.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.728+0000 7ff6f9d2a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:13:36.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.728+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.729+0000 7ff6f9d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:36.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.735+0000 7ff6f9d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.735+0000 7ff6f9d2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.735+0000 7ff6f9d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.735+0000 7ff6f9d2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:13:36.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff5d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464275 cookie 94006656420320 notifier 5864 bl.length()=827 2024-09-14T11:13:36.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff5d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff5d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff5d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:13:36.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:13:36.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:13:36.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.736+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:13:36.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:13:36.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:13:36.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:13:36.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:13:36.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:13:36.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:13:36.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.0 2024-09-14T11:13:36.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.0 2024-09-14T11:13:36.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.1 2024-09-14T11:13:36.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.739+0000 7ff6f9d2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.1 2024-09-14T11:13:36.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.741+0000 7ff6f9d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:36.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.741+0000 7ff6f9d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff6f9d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff6f9d2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff6f9d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff6f9d2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff5d8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464276 cookie 94006656420320 notifier 5864 bl.length()=827 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff5d8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff5d8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.742+0000 7ff5d8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.743+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:13:36.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.743+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:13:36.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.743+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:13:36.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.743+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:13:36.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.744+0000 7ff6f9d2a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.0 2024-09-14T11:13:36.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.744+0000 7ff6f9d2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.0 2024-09-14T11:13:36.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.744+0000 7ff6f9d2a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.1 2024-09-14T11:13:36.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.744+0000 7ff6f9d2a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.1.1 2024-09-14T11:13:36.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.745+0000 7ff6f9d2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:36.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.745+0000 7ff6f9d2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:13:36.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff5d97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464277 cookie 94006656420320 notifier 5864 bl.length()=795 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff5d97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff5d97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff5d97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.746+0000 7ff6f9d2a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:13:36.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.747+0000 7ff6f9d2a800 1 execute INFO: reshard of bucket "a-bucket" from 2 shards to 3 shards completed successfully 2024-09-14T11:13:36.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.748+0000 7ff6f9d2a800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-14T11:13:36.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.750+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-14T11:13:36.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.750+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000007 2024-09-14T11:13:36.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.753+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-14T11:13:36.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.753+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000008 2024-09-14T11:13:36.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.755+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-14T11:13:36.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.755+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000009 2024-09-14T11:13:36.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.757+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-14T11:13:36.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.757+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000010 2024-09-14T11:13:36.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.760+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-14T11:13:36.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.760+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000011 2024-09-14T11:13:36.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.762+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-14T11:13:36.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.762+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000012 2024-09-14T11:13:36.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.765+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-14T11:13:36.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.765+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000013 2024-09-14T11:13:36.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.767+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-14T11:13:36.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.767+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000014 2024-09-14T11:13:36.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.769+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-14T11:13:36.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.769+0000 7ff6f9d2a800 20 processing logshard = reshard.0000000015 2024-09-14T11:13:36.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.772+0000 7ff6f9d2a800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-14T11:13:36.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.773+0000 7ff5a7fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:36.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.775+0000 7ff6f9d2a800 20 remove_watcher() i=0 2024-09-14T11:13:36.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.775+0000 7ff6f9d2a800 2 removed watcher, disabling cache 2024-09-14T11:13:36.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.777+0000 7ff6f9d2a800 20 remove_watcher() i=1 2024-09-14T11:13:36.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.778+0000 7ff6f9d2a800 20 remove_watcher() i=2 2024-09-14T11:13:36.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.779+0000 7ff6f9d2a800 20 remove_watcher() i=3 2024-09-14T11:13:36.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.780+0000 7ff6f9d2a800 20 remove_watcher() i=4 2024-09-14T11:13:36.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.781+0000 7ff6f9d2a800 20 remove_watcher() i=5 2024-09-14T11:13:36.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.782+0000 7ff6f9d2a800 20 remove_watcher() i=6 2024-09-14T11:13:36.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.783+0000 7ff6f9d2a800 20 remove_watcher() i=7 2024-09-14T11:13:36.793 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:13:36.822 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:36.822 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:36.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.863+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 20 realm 2024-09-14T11:13:36.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:36.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:36.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.865+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.866+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:36.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.866+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:36.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.866+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:36.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.866+0000 7f2e3b410800 20 searching for the correct realm 2024-09-14T11:13:36.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.871+0000 7f2e372cc640 0 -- 172.21.15.2:0/3663963152 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f2e2c062140 msgr2=0x7f2e2c085a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:36.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:36.874+0000 7f2e36acb640 0 -- 172.21.15.2:0/3663963152 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2e2c08a950 msgr2=0x7f2e2c089130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:37.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:37.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.080+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:37.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 zone default found 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 4 Realm: () 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 zonegroup default 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 started sync module instance, tier type = 2024-09-14T11:13:37.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.081+0000 7f2e3b410800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:37.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.091+0000 7f2e3b410800 20 add_watcher() i=0 2024-09-14T11:13:37.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.091+0000 7f2e3b410800 20 add_watcher() i=1 2024-09-14T11:13:37.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.091+0000 7f2e3b410800 20 add_watcher() i=2 2024-09-14T11:13:37.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.091+0000 7f2e3b410800 20 add_watcher() i=3 2024-09-14T11:13:37.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.091+0000 7f2e3b410800 20 add_watcher() i=4 2024-09-14T11:13:37.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.091+0000 7f2e3b410800 20 add_watcher() i=5 2024-09-14T11:13:37.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.091+0000 7f2e3b410800 20 add_watcher() i=6 2024-09-14T11:13:37.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.092+0000 7f2e3b410800 20 add_watcher() i=7 2024-09-14T11:13:37.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.092+0000 7f2e3b410800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:37.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.093+0000 7f2ced7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2e3b410800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:37.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2e3b410800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:37.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2e3b410800 5 note: GC not initialized 2024-09-14T11:13:37.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2c67fff640 20 reqs_thread_entry: start 2024-09-14T11:13:37.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2e3b410800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:37.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2e3b410800 20 Filter name: none 2024-09-14T11:13:37.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2c65ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:37.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.094+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.095+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:37.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.095+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.095+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:37.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.095+0000 7f2e3b410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:37.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.095+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.096+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:13:37.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.096+0000 7f2e3b410800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.096+0000 7f2e3b410800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:13:37.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.096+0000 7f2e3b410800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:37.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.097+0000 7f2ced7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.099+0000 7f2e3b410800 20 remove_watcher() i=0 2024-09-14T11:13:37.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.099+0000 7f2e3b410800 2 removed watcher, disabling cache 2024-09-14T11:13:37.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.100+0000 7f2e3b410800 20 remove_watcher() i=1 2024-09-14T11:13:37.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.101+0000 7f2e3b410800 20 remove_watcher() i=2 2024-09-14T11:13:37.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.102+0000 7f2e3b410800 20 remove_watcher() i=3 2024-09-14T11:13:37.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.103+0000 7f2e3b410800 20 remove_watcher() i=4 2024-09-14T11:13:37.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.104+0000 7f2e3b410800 20 remove_watcher() i=5 2024-09-14T11:13:37.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.105+0000 7f2e3b410800 20 remove_watcher() i=6 2024-09-14T11:13:37.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.106+0000 7f2e3b410800 20 remove_watcher() i=7 2024-09-14T11:13:37.116 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:37.116 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:37.116 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-14T11:13:37.116 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:37.116 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-14T11:13:37.116 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:37.118 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.118 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.129 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.129 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.171 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.171 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.179 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.179 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.186 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.186 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.193 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.193 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.200 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.200 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.207 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.207 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.214 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.214 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.221 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.221 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.228 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.228 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.235 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.235 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.242 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.242 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.249 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.249 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.257 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.257 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.264 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.264 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.271 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.271 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.278 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.278 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.285 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.285 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.293 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.293 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.301 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.301 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.308 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:37.308 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:37.315 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:13:37.344 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:37.345 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:37.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.386+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 20 realm 2024-09-14T11:13:37.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:37.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.388+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.389+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:37.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.389+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.389+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:37.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.389+0000 7fb92c00f800 20 searching for the correct realm 2024-09-14T11:13:37.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.393+0000 7fb926f21640 0 -- 172.21.15.2:0/1459282852 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x560e2a3ab7b0 msgr2=0x560e2a3adc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:37.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.396+0000 7fb927722640 0 -- 172.21.15.2:0/1459282852 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fb91c08e960 msgr2=0x7fb91c064460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:37.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:37.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:37.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:37.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:37.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:37.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:37.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:37.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 zone default found 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 4 Realm: () 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 zonegroup default 2024-09-14T11:13:37.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.401+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.402+0000 7fb92c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.402+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.402+0000 7fb92c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.402+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.402+0000 7fb92c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.402+0000 7fb92c00f800 20 started sync module instance, tier type = 2024-09-14T11:13:37.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.402+0000 7fb92c00f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:37.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.411+0000 7fb92c00f800 20 add_watcher() i=0 2024-09-14T11:13:37.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.411+0000 7fb92c00f800 20 add_watcher() i=1 2024-09-14T11:13:37.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.411+0000 7fb92c00f800 20 add_watcher() i=2 2024-09-14T11:13:37.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.411+0000 7fb92c00f800 20 add_watcher() i=3 2024-09-14T11:13:37.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.411+0000 7fb92c00f800 20 add_watcher() i=4 2024-09-14T11:13:37.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.411+0000 7fb92c00f800 20 add_watcher() i=5 2024-09-14T11:13:37.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.411+0000 7fb92c00f800 20 add_watcher() i=6 2024-09-14T11:13:37.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.412+0000 7fb92c00f800 20 add_watcher() i=7 2024-09-14T11:13:37.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.412+0000 7fb92c00f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:37.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.413+0000 7fb7ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb92c00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb92c00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb92c00f800 5 note: GC not initialized 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb7dcfe1640 20 reqs_thread_entry: start 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb92c00f800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb92c00f800 20 Filter name: none 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb7567fc640 20 reqs_thread_entry: start 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.414+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.415+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:37.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.415+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.415+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:37.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.416+0000 7fb92c00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:37.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.416+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.416+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:37.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.416+0000 7fb92c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.416+0000 7fb92c00f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:37.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.416+0000 7fb92c00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:37.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.418+0000 7fb7ddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.420+0000 7fb92c00f800 20 remove_watcher() i=0 2024-09-14T11:13:37.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.420+0000 7fb92c00f800 2 removed watcher, disabling cache 2024-09-14T11:13:37.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.421+0000 7fb92c00f800 20 remove_watcher() i=1 2024-09-14T11:13:37.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.422+0000 7fb92c00f800 20 remove_watcher() i=2 2024-09-14T11:13:37.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.423+0000 7fb92c00f800 20 remove_watcher() i=3 2024-09-14T11:13:37.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.424+0000 7fb92c00f800 20 remove_watcher() i=4 2024-09-14T11:13:37.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.425+0000 7fb92c00f800 20 remove_watcher() i=5 2024-09-14T11:13:37.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.425+0000 7fb92c00f800 20 remove_watcher() i=6 2024-09-14T11:13:37.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.426+0000 7fb92c00f800 20 remove_watcher() i=7 2024-09-14T11:13:37.436 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:37.436 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:37.436 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-init-index id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:13:37.436 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:37.437 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-14T11:13:37.473 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:37.473 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:37.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.515+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.516+0000 7f2147e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.516+0000 7f2147e14800 20 realm 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.516+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.516+0000 7f2147e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.516+0000 7f2147e14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.516+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.517+0000 7f2147e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.517+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.518+0000 7f2147e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:37.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.518+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.518+0000 7f2147e14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:37.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.518+0000 7f2147e14800 20 searching for the correct realm 2024-09-14T11:13:37.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.520+0000 7f2142ddf640 0 -- 172.21.15.2:0/3828916704 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f213405a060 msgr2=0x7f213401a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:37.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.725+0000 7f21435e0640 0 -- 172.21.15.2:0/3828916704 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2138001b30 msgr2=0x7f21380da140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:37.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.931+0000 7f2147e14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:37.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.931+0000 7f2147e14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:37.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.931+0000 7f2147e14800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:37.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.931+0000 7f2147e14800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:37.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.931+0000 7f2147e14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:37.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.931+0000 7f2147e14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:37.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.931+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:37.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 zone default found 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 4 Realm: () 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:37.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 zonegroup default 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.932+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.933+0000 7f2147e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.933+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.933+0000 7f2147e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.933+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.933+0000 7f2147e14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.933+0000 7f2147e14800 20 started sync module instance, tier type = 2024-09-14T11:13:37.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.933+0000 7f2147e14800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:37.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.944+0000 7f2147e14800 20 add_watcher() i=0 2024-09-14T11:13:37.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.944+0000 7f2147e14800 20 add_watcher() i=1 2024-09-14T11:13:37.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.944+0000 7f2147e14800 20 add_watcher() i=2 2024-09-14T11:13:37.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.944+0000 7f2147e14800 20 add_watcher() i=3 2024-09-14T11:13:37.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.944+0000 7f2147e14800 20 add_watcher() i=4 2024-09-14T11:13:37.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.944+0000 7f2147e14800 20 add_watcher() i=5 2024-09-14T11:13:37.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.944+0000 7f2147e14800 20 add_watcher() i=6 2024-09-14T11:13:37.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.945+0000 7f2147e14800 20 add_watcher() i=7 2024-09-14T11:13:37.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.945+0000 7f2147e14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:37.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.947+0000 7f1ff9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.947+0000 7f2147e14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.947+0000 7f2147e14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.947+0000 7f2147e14800 5 note: GC not initialized 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.947+0000 7f1ff8fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 20 Filter name: none 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f1f727fc640 20 reqs_thread_entry: start 2024-09-14T11:13:37.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:13:37.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:37.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 : miss 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.948+0000 7f2147e14800 20 rados->read ofs=0 len=0 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.949+0000 7f2147e14800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.949+0000 7f2147e14800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.949+0000 7f2147e14800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.949+0000 7f2147e14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.949+0000 7f2147e14800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.949+0000 7f2147e14800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 2024-09-14T11:13:37.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.950+0000 7f2147e14800 -1 Injecting error=-5 at location=init_index 2024-09-14T11:13:37.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.950+0000 7f2147e14800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-14T11:13:37.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.952+0000 7f1ff9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:37.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.955+0000 7f2147e14800 20 remove_watcher() i=0 2024-09-14T11:13:37.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.955+0000 7f2147e14800 2 removed watcher, disabling cache 2024-09-14T11:13:37.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.956+0000 7f2147e14800 20 remove_watcher() i=1 2024-09-14T11:13:37.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.957+0000 7f2147e14800 20 remove_watcher() i=2 2024-09-14T11:13:37.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.958+0000 7f2147e14800 20 remove_watcher() i=3 2024-09-14T11:13:37.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.959+0000 7f2147e14800 20 remove_watcher() i=4 2024-09-14T11:13:37.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.961+0000 7f2147e14800 20 remove_watcher() i=5 2024-09-14T11:13:37.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.962+0000 7f2147e14800 20 remove_watcher() i=6 2024-09-14T11:13:37.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:37.963+0000 7f2147e14800 20 remove_watcher() i=7 2024-09-14T11:13:37.975 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:13:38.006 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:38.006 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:38.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.050+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.052+0000 7f7e8192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.052+0000 7f7e8192e800 20 realm 2024-09-14T11:13:38.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.052+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.053+0000 7f7e8192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.053+0000 7f7e8192e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:38.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.053+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.053+0000 7f7e8192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.053+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.054+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.054+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.054+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:38.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.054+0000 7f7e8192e800 20 searching for the correct realm 2024-09-14T11:13:38.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.056+0000 7f7e7d6dd640 0 -- 172.21.15.2:0/1383079166 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f7e7801f040 msgr2=0x7f7e78065550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.262+0000 7f7e7dede640 0 -- 172.21.15.2:0/1383079166 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f7e7403b070 msgr2=0x7f7e7404a410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:38.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:38.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:38.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:38.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:38.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:38.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.268+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:38.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 20 zone default found 2024-09-14T11:13:38.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 4 Realm: () 2024-09-14T11:13:38.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 20 zonegroup default 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.269+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.270+0000 7f7e8192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.270+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.270+0000 7f7e8192e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.270+0000 7f7e8192e800 20 started sync module instance, tier type = 2024-09-14T11:13:38.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.270+0000 7f7e8192e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:38.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.280+0000 7f7e8192e800 20 add_watcher() i=0 2024-09-14T11:13:38.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.280+0000 7f7e8192e800 20 add_watcher() i=1 2024-09-14T11:13:38.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.280+0000 7f7e8192e800 20 add_watcher() i=2 2024-09-14T11:13:38.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.280+0000 7f7e8192e800 20 add_watcher() i=3 2024-09-14T11:13:38.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.280+0000 7f7e8192e800 20 add_watcher() i=4 2024-09-14T11:13:38.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.280+0000 7f7e8192e800 20 add_watcher() i=5 2024-09-14T11:13:38.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.280+0000 7f7e8192e800 20 add_watcher() i=6 2024-09-14T11:13:38.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.281+0000 7f7e8192e800 20 add_watcher() i=7 2024-09-14T11:13:38.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.281+0000 7f7e8192e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:38.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.283+0000 7f7d337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.283+0000 7f7e8192e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.283+0000 7f7e8192e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.283+0000 7f7e8192e800 5 note: GC not initialized 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.283+0000 7f7d327e4640 20 reqs_thread_entry: start 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.283+0000 7f7e8192e800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.284+0000 7f7e8192e800 20 Filter name: none 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.284+0000 7f7ca3fff640 20 reqs_thread_entry: start 2024-09-14T11:13:38.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.284+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.284+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:38.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.284+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.285+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:38.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.285+0000 7f7e8192e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:38.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.285+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.285+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:38.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.285+0000 7f7e8192e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.286+0000 7f7e8192e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:38.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.286+0000 7f7e8192e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:38.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.287+0000 7f7d337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.290+0000 7f7e8192e800 20 remove_watcher() i=0 2024-09-14T11:13:38.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.290+0000 7f7e8192e800 2 removed watcher, disabling cache 2024-09-14T11:13:38.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.291+0000 7f7e8192e800 20 remove_watcher() i=1 2024-09-14T11:13:38.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.292+0000 7f7e8192e800 20 remove_watcher() i=2 2024-09-14T11:13:38.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.293+0000 7f7e8192e800 20 remove_watcher() i=3 2024-09-14T11:13:38.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.294+0000 7f7e8192e800 20 remove_watcher() i=4 2024-09-14T11:13:38.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.295+0000 7f7e8192e800 20 remove_watcher() i=5 2024-09-14T11:13:38.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.296+0000 7f7e8192e800 20 remove_watcher() i=6 2024-09-14T11:13:38.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.297+0000 7f7e8192e800 20 remove_watcher() i=7 2024-09-14T11:13:38.307 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:38.307 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:38.307 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-init-index id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:13:38.308 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:38.310 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.310 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:38.318 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:38.318 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:38.361 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:38.393 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:38.394 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:38.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.435+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 20 realm 2024-09-14T11:13:38.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:38.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.436+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.437+0000 7f1d626bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.437+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.437+0000 7f1d626bb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:38.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.437+0000 7f1d626bb800 20 searching for the correct realm 2024-09-14T11:13:38.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.440+0000 7f1d5f9a4640 0 -- 172.21.15.2:0/3850458204 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f1d5007c070 msgr2=0x7f1d5008a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.444+0000 7f1d601a5640 0 -- 172.21.15.2:0/3850458204 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1d5405aa00 msgr2=0x7f1d54072550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:38.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.651+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 zone default found 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 4 Realm: () 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 zonegroup default 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.652+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.653+0000 7f1d626bb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.653+0000 7f1d626bb800 20 started sync module instance, tier type = 2024-09-14T11:13:38.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.653+0000 7f1d626bb800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.662+0000 7f1d626bb800 20 add_watcher() i=0 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.662+0000 7f1d626bb800 20 add_watcher() i=1 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.662+0000 7f1d626bb800 20 add_watcher() i=2 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.662+0000 7f1d626bb800 20 add_watcher() i=3 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.662+0000 7f1d626bb800 20 add_watcher() i=4 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.662+0000 7f1d626bb800 20 add_watcher() i=5 2024-09-14T11:13:38.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.662+0000 7f1d626bb800 20 add_watcher() i=6 2024-09-14T11:13:38.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.663+0000 7f1d626bb800 20 add_watcher() i=7 2024-09-14T11:13:38.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.663+0000 7f1d626bb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:38.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.664+0000 7f1c16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1d626bb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1d626bb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1d626bb800 5 note: GC not initialized 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1c15fdb640 20 reqs_thread_entry: start 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1d626bb800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1d626bb800 20 Filter name: none 2024-09-14T11:13:38.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1b877fe640 20 reqs_thread_entry: start 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1d626bb800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.665+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 : miss 2024-09-14T11:13:38.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:38.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.666+0000 7f1d626bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 2024-09-14T11:13:38.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1d626bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:38.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1d626bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:38.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1d626bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1d626bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19, ofs0, ns] 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1c377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 93963790794896 notifier 5948 bl.length()=911 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1c377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1c377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.670+0000 7f1c377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.671+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): orig_sources= new_sources= 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.671+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): potential sources added=[] removed=[] 2024-09-14T11:13:38.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.671+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): orig_dests= new_dests= 2024-09-14T11:13:38.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.671+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): potential dests added=[] removed=[] 2024-09-14T11:13:38.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.674+0000 7f1d626bb800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.19.1.0 2024-09-14T11:13:38.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.674+0000 7f1d626bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.19.1.0 2024-09-14T11:13:38.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.674+0000 7f1d626bb800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.19.1.1 2024-09-14T11:13:38.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.674+0000 7f1d626bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.19.1.1 2024-09-14T11:13:38.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.674+0000 7f1d626bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.19.0 2024-09-14T11:13:38.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.676+0000 7f1d626bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:38.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.676+0000 7f1d626bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 2024-09-14T11:13:38.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.677+0000 7f1d626bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:38.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.677+0000 7f1d626bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:38.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.677+0000 7f1d626bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:38.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.677+0000 7f1d626bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19, ofs0, ns] 2024-09-14T11:13:38.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1c36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 93963790794896 notifier 5948 bl.length()=911 2024-09-14T11:13:38.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1c36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:38.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1c36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:38.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1c36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:38.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): orig_sources= new_sources= 2024-09-14T11:13:38.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): potential sources added=[] removed=[] 2024-09-14T11:13:38.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): orig_dests= new_dests= 2024-09-14T11:13:38.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.678+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): potential dests added=[] removed=[] 2024-09-14T11:13:38.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.679+0000 7f1d626bb800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.19.0 2024-09-14T11:13:38.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.680+0000 7f1d626bb800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:38.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.680+0000 7f1d626bb800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 2024-09-14T11:13:38.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1d626bb800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:38.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1d626bb800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:38.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1d626bb800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1d626bb800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19, ofs0, ns] 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1c36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464305 cookie 93963790794896 notifier 5948 bl.length()=879 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1c36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 info.flags=0x17 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1c36ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 to cache LRU end 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.681+0000 7f1c36ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.682+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): orig_sources= new_sources= 2024-09-14T11:13:38.680 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.682+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): potential sources added=[] removed=[] 2024-09-14T11:13:38.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.682+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): orig_dests= new_dests= 2024-09-14T11:13:38.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.682+0000 7f1d626bb800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.19]): potential dests added=[] removed=[] 2024-09-14T11:13:38.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.683+0000 7f1d626bb800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-14T11:13:38.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.684+0000 7f1c16fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:38.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.686+0000 7f1d626bb800 20 remove_watcher() i=0 2024-09-14T11:13:38.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.686+0000 7f1d626bb800 2 removed watcher, disabling cache 2024-09-14T11:13:38.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.688+0000 7f1d626bb800 20 remove_watcher() i=1 2024-09-14T11:13:38.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.689+0000 7f1d626bb800 20 remove_watcher() i=2 2024-09-14T11:13:38.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.690+0000 7f1d626bb800 20 remove_watcher() i=3 2024-09-14T11:13:38.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.691+0000 7f1d626bb800 20 remove_watcher() i=4 2024-09-14T11:13:38.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.692+0000 7f1d626bb800 20 remove_watcher() i=5 2024-09-14T11:13:38.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.693+0000 7f1d626bb800 20 remove_watcher() i=6 2024-09-14T11:13:38.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.694+0000 7f1d626bb800 20 remove_watcher() i=7 2024-09-14T11:13:38.706 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:13:38.735 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:38.735 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:38.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.776+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 realm 2024-09-14T11:13:38.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:38.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.778+0000 7fc9f8130800 20 searching for the correct realm 2024-09-14T11:13:38.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.781+0000 7fc9f35bb640 0 -- 172.21.15.2:0/1113627661 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fc9e40702b0 msgr2=0x7fc9e40643d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:38.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:38.987+0000 7fc9f3dbc640 0 -- 172.21.15.2:0/1113627661 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fc9e802c610 msgr2=0x7fc9e80473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:39.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.193+0000 7fc9f8130800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:39.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.193+0000 7fc9f8130800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:39.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.193+0000 7fc9f8130800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.193+0000 7fc9f8130800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.193+0000 7fc9f8130800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.193+0000 7fc9f8130800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:39.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 zone default found 2024-09-14T11:13:39.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 4 Realm: () 2024-09-14T11:13:39.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:39.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 zonegroup default 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.194+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.195+0000 7fc9f8130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.195+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.195+0000 7fc9f8130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.195+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.195+0000 7fc9f8130800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.195+0000 7fc9f8130800 20 started sync module instance, tier type = 2024-09-14T11:13:39.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.195+0000 7fc9f8130800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:39.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.205+0000 7fc9f8130800 20 add_watcher() i=0 2024-09-14T11:13:39.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.205+0000 7fc9f8130800 20 add_watcher() i=1 2024-09-14T11:13:39.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.205+0000 7fc9f8130800 20 add_watcher() i=2 2024-09-14T11:13:39.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.205+0000 7fc9f8130800 20 add_watcher() i=3 2024-09-14T11:13:39.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.205+0000 7fc9f8130800 20 add_watcher() i=4 2024-09-14T11:13:39.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.205+0000 7fc9f8130800 20 add_watcher() i=5 2024-09-14T11:13:39.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.205+0000 7fc9f8130800 20 add_watcher() i=6 2024-09-14T11:13:39.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.206+0000 7fc9f8130800 20 add_watcher() i=7 2024-09-14T11:13:39.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.206+0000 7fc9f8130800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:39.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.208+0000 7fc8a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.208+0000 7fc9f8130800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.208+0000 7fc9f8130800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.208+0000 7fc9f8130800 5 note: GC not initialized 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.208+0000 7fc8a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.208+0000 7fc9f8130800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.209+0000 7fc9f8130800 20 Filter name: none 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.209+0000 7fc8227fc640 20 reqs_thread_entry: start 2024-09-14T11:13:39.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.209+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.209+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:39.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.209+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.210+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:39.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.210+0000 7fc9f8130800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:39.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.210+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.210+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:39.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.210+0000 7fc9f8130800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.211+0000 7fc9f8130800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:39.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.211+0000 7fc9f8130800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:39.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.212+0000 7fc8a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.214+0000 7fc9f8130800 20 remove_watcher() i=0 2024-09-14T11:13:39.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.214+0000 7fc9f8130800 2 removed watcher, disabling cache 2024-09-14T11:13:39.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.215+0000 7fc9f8130800 20 remove_watcher() i=1 2024-09-14T11:13:39.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.216+0000 7fc9f8130800 20 remove_watcher() i=2 2024-09-14T11:13:39.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.218+0000 7fc9f8130800 20 remove_watcher() i=3 2024-09-14T11:13:39.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.219+0000 7fc9f8130800 20 remove_watcher() i=4 2024-09-14T11:13:39.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.220+0000 7fc9f8130800 20 remove_watcher() i=5 2024-09-14T11:13:39.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.221+0000 7fc9f8130800 20 remove_watcher() i=6 2024-09-14T11:13:39.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.222+0000 7fc9f8130800 20 remove_watcher() i=7 2024-09-14T11:13:39.233 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:39.233 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:39.233 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-init-index id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.19 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:13:39.233 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:39.236 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.236 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.240 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.240 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.283 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.284 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.297 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-14T11:13:39.297 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:39.298 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.298 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.307 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.307 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.349 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.349 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.356 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.356 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.363 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.363 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.370 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.370 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.378 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.378 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.385 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.385 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.392 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.392 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.399 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.399 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.405 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.405 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.412 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.412 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.419 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.419 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.426 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.426 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.433 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.433 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.440 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.440 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.447 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.447 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.455 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.455 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.461 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.461 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.469 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.469 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.476 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.476 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.484 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:39.484 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:39.492 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:13:39.521 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:39.521 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:39.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.561+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 20 realm 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.563+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.564+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.564+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.564+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:39.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.564+0000 7f24f6346800 20 searching for the correct realm 2024-09-14T11:13:39.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.567+0000 7f24f3636640 0 -- 172.21.15.2:0/3706846885 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f24e4027040 msgr2=0x7f24e4046740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:39.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.571+0000 7f24f3e37640 0 -- 172.21.15.2:0/3706846885 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f24e8061ac0 msgr2=0x7f24e80441f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:39.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:39.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:39.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:39.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.778+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 20 zone default found 2024-09-14T11:13:39.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 4 Realm: () 2024-09-14T11:13:39.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:39.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:39.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:39.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 20 zonegroup default 2024-09-14T11:13:39.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.779+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.780+0000 7f24f6346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.780+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.780+0000 7f24f6346800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.780+0000 7f24f6346800 20 started sync module instance, tier type = 2024-09-14T11:13:39.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.780+0000 7f24f6346800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:39.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.791+0000 7f24f6346800 20 add_watcher() i=0 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.791+0000 7f24f6346800 20 add_watcher() i=1 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.791+0000 7f24f6346800 20 add_watcher() i=2 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.791+0000 7f24f6346800 20 add_watcher() i=3 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.791+0000 7f24f6346800 20 add_watcher() i=4 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.791+0000 7f24f6346800 20 add_watcher() i=5 2024-09-14T11:13:39.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.791+0000 7f24f6346800 20 add_watcher() i=6 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.792+0000 7f24f6346800 20 add_watcher() i=7 2024-09-14T11:13:39.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.792+0000 7f24f6346800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.794+0000 7f23a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.794+0000 7f24f6346800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.794+0000 7f24f6346800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.794+0000 7f24f6346800 5 note: GC not initialized 2024-09-14T11:13:39.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.794+0000 7f23a8fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:39.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.795+0000 7f24f6346800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:39.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.795+0000 7f24f6346800 20 Filter name: none 2024-09-14T11:13:39.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.795+0000 7f23227fc640 20 reqs_thread_entry: start 2024-09-14T11:13:39.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.795+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.796+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:39.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.796+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.796+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:39.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.796+0000 7f24f6346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:39.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.797+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.797+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:39.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.797+0000 7f24f6346800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.797+0000 7f24f6346800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:39.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.797+0000 7f24f6346800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:39.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.799+0000 7f23a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:39.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.801+0000 7f24f6346800 20 remove_watcher() i=0 2024-09-14T11:13:39.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.801+0000 7f24f6346800 2 removed watcher, disabling cache 2024-09-14T11:13:39.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.803+0000 7f24f6346800 20 remove_watcher() i=1 2024-09-14T11:13:39.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.804+0000 7f24f6346800 20 remove_watcher() i=2 2024-09-14T11:13:39.805 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.805+0000 7f24f6346800 20 remove_watcher() i=3 2024-09-14T11:13:39.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.808+0000 7f24f6346800 20 remove_watcher() i=4 2024-09-14T11:13:39.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.809+0000 7f24f6346800 20 remove_watcher() i=5 2024-09-14T11:13:39.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.810+0000 7f24f6346800 20 remove_watcher() i=6 2024-09-14T11:13:39.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.811+0000 7f24f6346800 20 remove_watcher() i=7 2024-09-14T11:13:39.822 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:39.822 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:39.822 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-init-index id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:13:39.823 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:39.824 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-14T11:13:39.861 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:39.861 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:39.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.903+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.904+0000 7fdd32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.904+0000 7fdd32d2e800 20 realm 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.904+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.904+0000 7fdd32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.904+0000 7fdd32d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.904+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.905+0000 7fdd32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:39.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.905+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.905+0000 7fdd32d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:39.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.905+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:39.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.906+0000 7fdd32d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:39.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.906+0000 7fdd32d2e800 20 searching for the correct realm 2024-09-14T11:13:39.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.908+0000 7fdd2e16a640 0 -- 172.21.15.2:0/3138337617 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fdd20068040 msgr2=0x7fdd2007ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:39.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:39.912+0000 7fdd2e96b640 0 -- 172.21.15.2:0/3138337617 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fdd24037c40 msgr2=0x7fdd240809a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:40.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:40.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:40.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:40.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:40.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:40.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:40.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.118+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:40.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 zone default found 2024-09-14T11:13:40.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 4 Realm: () 2024-09-14T11:13:40.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:40.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 zonegroup default 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.119+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.120+0000 7fdd32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.120+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.120+0000 7fdd32d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.120+0000 7fdd32d2e800 20 started sync module instance, tier type = 2024-09-14T11:13:40.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.120+0000 7fdd32d2e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:40.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.130+0000 7fdd32d2e800 20 add_watcher() i=0 2024-09-14T11:13:40.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.130+0000 7fdd32d2e800 20 add_watcher() i=1 2024-09-14T11:13:40.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.130+0000 7fdd32d2e800 20 add_watcher() i=2 2024-09-14T11:13:40.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.130+0000 7fdd32d2e800 20 add_watcher() i=3 2024-09-14T11:13:40.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.130+0000 7fdd32d2e800 20 add_watcher() i=4 2024-09-14T11:13:40.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.130+0000 7fdd32d2e800 20 add_watcher() i=5 2024-09-14T11:13:40.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.130+0000 7fdd32d2e800 20 add_watcher() i=6 2024-09-14T11:13:40.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.131+0000 7fdd32d2e800 20 add_watcher() i=7 2024-09-14T11:13:40.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.131+0000 7fdd32d2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:40.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.132+0000 7fdbe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdd32d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:40.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdd32d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:40.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdd32d2e800 5 note: GC not initialized 2024-09-14T11:13:40.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdb5ffff640 20 reqs_thread_entry: start 2024-09-14T11:13:40.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdd32d2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:40.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdd32d2e800 20 Filter name: none 2024-09-14T11:13:40.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdb5dffb640 20 reqs_thread_entry: start 2024-09-14T11:13:40.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdd32d2e800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-14T11:13:40.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.133+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 : miss 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 info.flags=0x17 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 to cache LRU end 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:40.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.134+0000 7fdd32d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 2024-09-14T11:13:40.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.136+0000 7fdd32d2e800 -1 Injecting error=-95 at location=init_index 2024-09-14T11:13:40.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.136+0000 7fdd32d2e800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:13:40.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdd32d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 info.flags=0x17 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdd32d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 to cache LRU end 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdd32d2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdd32d2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20, ofs0, ns] 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdc127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 94254371623968 notifier 5999 bl.length()=911 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdc127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 info.flags=0x17 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdc127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 to cache LRU end 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.138+0000 7fdc127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.139+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): orig_sources= new_sources= 2024-09-14T11:13:40.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.139+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): potential sources added=[] removed=[] 2024-09-14T11:13:40.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.139+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): orig_dests= new_dests= 2024-09-14T11:13:40.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.139+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): potential dests added=[] removed=[] 2024-09-14T11:13:40.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.140+0000 7fdd32d2e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.20.1.0 2024-09-14T11:13:40.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.140+0000 7fdd32d2e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.20.1.0 2024-09-14T11:13:40.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.140+0000 7fdd32d2e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.20.1.1 2024-09-14T11:13:40.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.140+0000 7fdd32d2e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.20.1.1 2024-09-14T11:13:40.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.140+0000 7fdd32d2e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.20.0 2024-09-14T11:13:40.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.142+0000 7fdd32d2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 : hit (requested=0x17, cached=0x17) 2024-09-14T11:13:40.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.142+0000 7fdd32d2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 2024-09-14T11:13:40.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdd32d2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 info.flags=0x17 2024-09-14T11:13:40.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdd32d2e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 to cache LRU end 2024-09-14T11:13:40.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdd32d2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:40.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdd32d2e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20, ofs0, ns] 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdc11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94254371623968 notifier 5999 bl.length()=879 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdc11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 info.flags=0x17 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdc11ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 to cache LRU end 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.143+0000 7fdc11ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.144+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): orig_sources= new_sources= 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.144+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): potential sources added=[] removed=[] 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.144+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): orig_dests= new_dests= 2024-09-14T11:13:40.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.144+0000 7fdd32d2e800 20 handle_bi_update(): bucket=:error-at-init-index[17edae97-cd6b-4c90-863d-862429a20cf3.4538.20]): potential dests added=[] removed=[] 2024-09-14T11:13:40.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.145+0000 7fdd32d2e800 1 execute INFO: reshard of bucket "error-at-init-index" from 1 shards to 2 shards completed successfully 2024-09-14T11:13:40.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.146+0000 7fdbe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.149+0000 7fdd32d2e800 20 remove_watcher() i=0 2024-09-14T11:13:40.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.149+0000 7fdd32d2e800 2 removed watcher, disabling cache 2024-09-14T11:13:40.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.150+0000 7fdd32d2e800 20 remove_watcher() i=1 2024-09-14T11:13:40.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.151+0000 7fdd32d2e800 20 remove_watcher() i=2 2024-09-14T11:13:40.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.153+0000 7fdd32d2e800 20 remove_watcher() i=3 2024-09-14T11:13:40.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.154+0000 7fdd32d2e800 20 remove_watcher() i=4 2024-09-14T11:13:40.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.155+0000 7fdd32d2e800 20 remove_watcher() i=5 2024-09-14T11:13:40.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.156+0000 7fdd32d2e800 20 remove_watcher() i=6 2024-09-14T11:13:40.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.158+0000 7fdd32d2e800 20 remove_watcher() i=7 2024-09-14T11:13:40.170 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-14T11:13:40.199 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:40.199 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:40.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.239+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 20 realm 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:40.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.241+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.242+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.242+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.242+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:40.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.242+0000 7f199512c800 20 searching for the correct realm 2024-09-14T11:13:40.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.245+0000 7f1991650640 0 -- 172.21.15.2:0/3845226967 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55e5d97141f0 msgr2=0x55e5d9716680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:40.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.249+0000 7f1990e4f640 0 -- 172.21.15.2:0/3845226967 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f197c007ee0 msgr2=0x7f197c0647d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.253+0000 7f199512c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.253+0000 7f199512c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.253+0000 7f199512c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.253+0000 7f199512c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.253+0000 7f199512c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.253+0000 7f199512c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.253+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 zone default found 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 4 Realm: () 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 zonegroup default 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.254+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.255+0000 7f199512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.255+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.255+0000 7f199512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.255+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.255 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.255+0000 7f199512c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.255+0000 7f199512c800 20 started sync module instance, tier type = 2024-09-14T11:13:40.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.255+0000 7f199512c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:40.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.264+0000 7f199512c800 20 add_watcher() i=0 2024-09-14T11:13:40.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.264+0000 7f199512c800 20 add_watcher() i=1 2024-09-14T11:13:40.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.264+0000 7f199512c800 20 add_watcher() i=2 2024-09-14T11:13:40.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.264+0000 7f199512c800 20 add_watcher() i=3 2024-09-14T11:13:40.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.264+0000 7f199512c800 20 add_watcher() i=4 2024-09-14T11:13:40.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.264+0000 7f199512c800 20 add_watcher() i=5 2024-09-14T11:13:40.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.264+0000 7f199512c800 20 add_watcher() i=6 2024-09-14T11:13:40.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.265+0000 7f199512c800 20 add_watcher() i=7 2024-09-14T11:13:40.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.265+0000 7f199512c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:40.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.266+0000 7f1846fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.266+0000 7f199512c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:40.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.266+0000 7f199512c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:40.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.266+0000 7f199512c800 5 note: GC not initialized 2024-09-14T11:13:40.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.267+0000 7f1845fe3640 20 reqs_thread_entry: start 2024-09-14T11:13:40.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.267+0000 7f199512c800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:40.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.267+0000 7f199512c800 20 Filter name: none 2024-09-14T11:13:40.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.267+0000 7f17b77fe640 20 reqs_thread_entry: start 2024-09-14T11:13:40.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.267+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.267+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:40.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.267+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.268+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:40.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.268+0000 7f199512c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:40.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.268+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.268+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:13:40.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.268+0000 7f199512c800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.269+0000 7f199512c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:13:40.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.269+0000 7f199512c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:40.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.270+0000 7f1846fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.272+0000 7f199512c800 20 remove_watcher() i=0 2024-09-14T11:13:40.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.272+0000 7f199512c800 2 removed watcher, disabling cache 2024-09-14T11:13:40.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.273+0000 7f199512c800 20 remove_watcher() i=1 2024-09-14T11:13:40.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.274+0000 7f199512c800 20 remove_watcher() i=2 2024-09-14T11:13:40.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.275+0000 7f199512c800 20 remove_watcher() i=3 2024-09-14T11:13:40.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.276+0000 7f199512c800 20 remove_watcher() i=4 2024-09-14T11:13:40.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.276+0000 7f199512c800 20 remove_watcher() i=5 2024-09-14T11:13:40.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.277+0000 7f199512c800 20 remove_watcher() i=6 2024-09-14T11:13:40.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.279+0000 7f199512c800 20 remove_watcher() i=7 2024-09-14T11:13:40.290 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:40.290 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:40.290 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-init-index id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.20 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:13:40.290 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:40.292 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.293 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.295 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.295 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.338 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.339 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.352 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at init_index 2024-09-14T11:13:40.352 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:40.353 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.354 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.363 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.363 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.406 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.406 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.414 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.414 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.422 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.422 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.430 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.430 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.437 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.445 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.445 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.452 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.452 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.459 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.459 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.466 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.474 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.474 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.481 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.481 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.489 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.489 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.497 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.497 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.504 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.504 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.512 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.512 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.520 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.520 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.527 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.527 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.534 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.534 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.541 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.541 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.548 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:40.549 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:40.556 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:13:40.587 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:40.587 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:40.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.627+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 20 realm 2024-09-14T11:13:40.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:40.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.629+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.630+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.630+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.630+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:40.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.630+0000 7fb4bdf1f800 20 searching for the correct realm 2024-09-14T11:13:40.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.633+0000 7fb4ba4a3640 0 -- 172.21.15.2:0/2181704185 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fb4a4077070 msgr2=0x7fb4a40593e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.637+0000 7fb4b9ca2640 0 -- 172.21.15.2:0/2181704185 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fb4a4059970 msgr2=0x7fb4a40e5920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.641+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 zone default found 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 4 Realm: () 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 zonegroup default 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.642+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.643+0000 7fb4bdf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.643+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.643+0000 7fb4bdf1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.643+0000 7fb4bdf1f800 20 started sync module instance, tier type = 2024-09-14T11:13:40.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.643+0000 7fb4bdf1f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:40.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.651+0000 7fb4bdf1f800 20 add_watcher() i=0 2024-09-14T11:13:40.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.651+0000 7fb4bdf1f800 20 add_watcher() i=1 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.651+0000 7fb4bdf1f800 20 add_watcher() i=2 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.651+0000 7fb4bdf1f800 20 add_watcher() i=3 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.651+0000 7fb4bdf1f800 20 add_watcher() i=4 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.651+0000 7fb4bdf1f800 20 add_watcher() i=5 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.651+0000 7fb4bdf1f800 20 add_watcher() i=6 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.652+0000 7fb4bdf1f800 20 add_watcher() i=7 2024-09-14T11:13:40.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.652+0000 7fb4bdf1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:40.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb36b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb4bdf1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb4bdf1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb4bdf1f800 5 note: GC not initialized 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb36a7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb4bdf1f800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb4bdf1f800 20 Filter name: none 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.654+0000 7fb2dffff640 20 reqs_thread_entry: start 2024-09-14T11:13:40.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.655+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.655+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.655+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.655+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.655+0000 7fb4bdf1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.656+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.656+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:40.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.656+0000 7fb4bdf1f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.656+0000 7fb4bdf1f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:40.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.656+0000 7fb4bdf1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:40.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.657+0000 7fb36b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.659+0000 7fb4bdf1f800 20 remove_watcher() i=0 2024-09-14T11:13:40.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.659+0000 7fb4bdf1f800 2 removed watcher, disabling cache 2024-09-14T11:13:40.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.661+0000 7fb4bdf1f800 20 remove_watcher() i=1 2024-09-14T11:13:40.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.662+0000 7fb4bdf1f800 20 remove_watcher() i=2 2024-09-14T11:13:40.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.663+0000 7fb4bdf1f800 20 remove_watcher() i=3 2024-09-14T11:13:40.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.664+0000 7fb4bdf1f800 20 remove_watcher() i=4 2024-09-14T11:13:40.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.665+0000 7fb4bdf1f800 20 remove_watcher() i=5 2024-09-14T11:13:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.665+0000 7fb4bdf1f800 20 remove_watcher() i=6 2024-09-14T11:13:40.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.666+0000 7fb4bdf1f800 20 remove_watcher() i=7 2024-09-14T11:13:40.677 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:40.677 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:40.677 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-init-indext id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:13:40.677 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:40.678 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-14T11:13:40.713 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:40.713 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:40.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.753+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 20 realm 2024-09-14T11:13:40.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:40.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.756+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.756+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.756+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:40.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.756+0000 7f533082f800 20 searching for the correct realm 2024-09-14T11:13:40.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.759+0000 7f5325b18640 0 -- 172.21.15.2:0/547105855 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f5320045440 msgr2=0x7f53200458a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.762+0000 7f532e319640 0 -- 172.21.15.2:0/547105855 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f53180916a0 msgr2=0x7f531806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 zone default found 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 4 Realm: () 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 zonegroup default 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.969+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.969+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:40.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.969+0000 7f533082f800 20 started sync module instance, tier type = 2024-09-14T11:13:40.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.969+0000 7f533082f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:40.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=0 2024-09-14T11:13:40.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=1 2024-09-14T11:13:40.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=2 2024-09-14T11:13:40.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=3 2024-09-14T11:13:40.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=4 2024-09-14T11:13:40.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=5 2024-09-14T11:13:40.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=6 2024-09-14T11:13:40.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.979+0000 7f533082f800 20 add_watcher() i=7 2024-09-14T11:13:40.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.979+0000 7f533082f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:40.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.981+0000 7f51e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:40.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.981+0000 7f533082f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:40.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.981+0000 7f533082f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:40.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.981+0000 7f533082f800 5 note: GC not initialized 2024-09-14T11:13:40.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.981+0000 7f515f7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:40.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:40.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 20 Filter name: none 2024-09-14T11:13:40.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f515d7fa640 20 reqs_thread_entry: start 2024-09-14T11:13:40.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:13:40.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 : miss 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.982+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.983+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.983+0000 7f533082f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.983+0000 7f533082f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.983+0000 7f533082f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.983+0000 7f533082f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:40.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.983+0000 7f533082f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 2024-09-14T11:13:40.984 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f533082f800 time 2024-09-14T11:13:40.986216+0000 2024-09-14T11:13:40.984 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:40.984 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:40.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5333d8c76a] 2024-09-14T11:13:40.984 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:40.984 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.985+0000 7f533082f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f533082f800 time 2024-09-14T11:13:40.986216+0000 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5333d8c76a] 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:40.985 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:13:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f533082f800 thread_name:radosgw-admin 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5332a3e6f0] 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5332a8b99c] 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5333d8c7c4] 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:41.000 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:40.986+0000 7f533082f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f533082f800 thread_name:radosgw-admin 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5332a3e6f0] 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5332a8b99c] 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5333d8c7c4] 2024-09-14T11:13:41.001 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: dump: 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.002 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.003 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: dump: 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:13:40.736+0000 7f533082f800 5 monclient: authenticate success, global_id 6038 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:13:40.736+0000 7f533082f800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:13:40.736+0000 7f533082f800 4 set_mon_vals no callback set 2024-09-14T11:13:41.004 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:13:40.736+0000 7f533082f800 10 monclient: shutdown 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:13:40.736+0000 7f533082f800 5 asok(0x5584e4e72270) unregister_commands rotate-key 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:13:40.737+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.005 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding auth protocol: cephx 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding auth protocol: cephx 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding auth protocol: cephx 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.006 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:13:40.737+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: starting msgr at 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: starting objecter 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:13:40.737+0000 7f533082f800 5 asok(0x5584e4e72270) register_command objecter_requests hook 0x5584e50942e0 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: setting wanted keys 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: calling monclient init 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding auth protocol: cephx 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding auth protocol: cephx 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding auth protocol: cephx 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.007 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:13:40.737+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:13:40.737+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:13:40.737+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key hook 0x5584e50914d8 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.008 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e4f1d4a0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e4f3dd30 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e5094620 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.291036s 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e4f3dd30 auth_method 0 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e5094620 auth_method 0 2024-09-14T11:13:41.009 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e4f1d4a0 auth_method 0 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.010 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6321 payload 824 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:13:40.738+0000 7f5325b18640 1 monclient: found mon.noname-a 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: dump: 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.011 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: dump: 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.012 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:13:40.738+0000 7f533082f800 5 monclient: authenticate success, global_id 6321 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:13:40.738+0000 7f521c608640 4 set_mon_vals no callback set 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:13:41.013 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:13:40.738+0000 7f533082f800 1 librados: init done 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:13:40.741+0000 7f521ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:13:40.741+0000 7f521ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:13:40.741+0000 7f521ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:13:40.741+0000 7f532e319640 10 monclient: get_auth_request con 0x7f5214077230 auth_method 0 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:13:40.741+0000 7f532eb1a640 10 monclient: get_auth_request con 0x5584e50bb2f0 auth_method 0 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:13:40.742+0000 7f532e319640 10 monclient: get_auth_request con 0x5584e50de310 auth_method 0 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:13:40.743+0000 7f5325b18640 10 monclient: get_auth_request con 0x5584e50e33f0 auth_method 0 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:13:40.744+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:13:40.744+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:13:40.744+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.014 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding auth protocol: cephx 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding auth protocol: cephx 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding auth protocol: cephx 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.015 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:13:40.744+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:13:40.744+0000 7f533082f800 5 asok(0x5584e4e72270) register_command objecter_requests cmddesc objecter_requests hook 0x5584e50ea960 EEXIST 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:13:40.744+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.016 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding auth protocol: cephx 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding auth protocol: cephx 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding auth protocol: cephx 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.017 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:13:40.744+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:13:40.745+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:13:40.745+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key cmddesc rotate-key hook 0x5584e50e6570 EEXIST 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e510ec80 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e510f060 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e510d990 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.298286s 2024-09-14T11:13:41.018 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e510f060 auth_method 0 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e510d990 auth_method 0 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.019 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e510ec80 auth_method 0 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:13:40.745+0000 7f5325b18640 1 monclient: found mon.noname-c 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: dump: 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.020 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.021 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: dump: 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:13:40.745+0000 7f533082f800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.022 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:13:40.745+0000 7f532f31b640 4 set_mon_vals no callback set 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:13:40.746+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:13:40.746+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:13:40.747+0000 7f5213fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:13:40.747+0000 7f5213fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:13:40.747+0000 7f5213fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:13:40.747+0000 7f532e319640 10 monclient: get_auth_request con 0x7f5208077140 auth_method 0 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:13:40.747+0000 7f533082f800 10 monclient: get_monmap_and_config 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:13:40.747+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:13:40.747+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:13:40.747+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.023 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding auth protocol: cephx 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding auth protocol: cephx 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding auth protocol: cephx 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.024 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:13:40.748+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding auth protocol: cephx 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding auth protocol: cephx 2024-09-14T11:13:41.025 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding auth protocol: cephx 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:13:40.748+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.026 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:13:40.748+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:13:40.748+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key cmddesc rotate-key hook 0x7ffdb1b68b58 EEXIST 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e51631d0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e5153b20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e515e600 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.301996s 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e5153b20 auth_method 0 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.027 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e515e600 auth_method 0 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e51631d0 auth_method 0 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.028 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6047 payload 274 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:13:40.749+0000 7f5325b18640 1 monclient: found mon.noname-c 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: dump: 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.029 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.030 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: dump: 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:13:40.749+0000 7f533082f800 5 monclient: authenticate success, global_id 6047 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:13:40.749+0000 7f533082f800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:13:40.749+0000 7f533082f800 4 set_mon_vals no callback set 2024-09-14T11:13:41.031 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: shutdown 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:13:40.750+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.032 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding auth protocol: cephx 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding auth protocol: cephx 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding auth protocol: cephx 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.033 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:13:40.750+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: starting msgr at 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: starting objecter 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:13:40.750+0000 7f533082f800 5 asok(0x5584e4e72270) register_command objecter_requests cmddesc objecter_requests hook 0x5584e51603d0 EEXIST 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: setting wanted keys 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: calling monclient init 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding auth protocol: cephx 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding auth protocol: cephx 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding auth protocol: cephx 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.034 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:13:40.750+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:13:40.751+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:13:40.751+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key cmddesc rotate-key hook 0x5584e5123688 EEXIST 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.035 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e5153b20 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e515e600 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e51631d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.304269s 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e515e600 auth_method 0 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.036 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e51631d0 auth_method 0 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e5153b20 auth_method 0 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.037 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:13:40.751+0000 7f5325b18640 1 monclient: found mon.noname-c 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: dump: 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.038 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: dump: 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.039 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:13:40.751+0000 7f533082f800 5 monclient: authenticate success, global_id 6050 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:13:40.751+0000 7f5211ffb640 4 set_mon_vals no callback set 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:13:40.752+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:13:40.752+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:13:40.752+0000 7f533082f800 1 librados: init done 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:13:40.752+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cr dump hook 0x5584e51535e8 2024-09-14T11:13:41.040 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:13:40.753+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:13:40.754+0000 7f51fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:13:40.754+0000 7f51fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:13:40.754+0000 7f51fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:13:40.754+0000 7f532e319640 10 monclient: get_auth_request con 0x7f51f8077260 auth_method 0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:13:40.754+0000 7f532eb1a640 10 monclient: get_auth_request con 0x5584e517ce90 auth_method 0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:13:40.755+0000 7f533082f800 20 realm 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:13:40.755+0000 7f533082f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.041 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:13:40.755+0000 7f532e319640 10 monclient: get_auth_request con 0x5584e51810c0 auth_method 0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:13:40.756+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:13:40.756+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:13:40.756+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:13:40.756+0000 7f533082f800 20 searching for the correct realm 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:13:40.756+0000 7f5325b18640 10 monclient: get_auth_request con 0x5584e5186380 auth_method 0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:13:40.757+0000 7f532eb1a640 10 monclient: get_auth_request con 0x7f531801e020 auth_method 0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:13:40.758+0000 7f532e319640 10 monclient: get_auth_request con 0x7f5328087400 auth_method 0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:13:40.759+0000 7f5325b18640 10 monclient: get_auth_request con 0x7f5320045440 auth_method 0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:13:40.759+0000 7f5325b18640 0 -- 172.21.15.2:0/547105855 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f5320045440 msgr2=0x7f53200458a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:13:40.759+0000 7f51fffff640 1 client.6050.objecter ms_handle_reset 0x7f5320045440 session 0x7f532001c630 osd.4 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:13:40.759+0000 7f51fffff640 10 monclient: _renew_subs 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:13:40.759+0000 7f51fffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:13:40.759+0000 7f5325b18640 10 monclient: get_auth_request con 0x7f51f8087080 auth_method 0 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:13:40.760+0000 7f532eb1a640 10 monclient: get_auth_request con 0x7f5318043070 auth_method 0 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:13:40.762+0000 7f532e319640 10 monclient: get_auth_request con 0x7f53180916a0 auth_method 0 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:13:40.762+0000 7f532e319640 0 -- 172.21.15.2:0/547105855 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f53180916a0 msgr2=0x7f531806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:13:40.963+0000 7f532e319640 10 monclient: get_auth_request con 0x7f53180916a0 auth_method 0 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.043 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:13:40.968+0000 7f533082f800 20 zone default found 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:13:40.968+0000 7f533082f800 4 Realm: () 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:13:40.968+0000 7f533082f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:13:40.968+0000 7f533082f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:13:40.968+0000 7f533082f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:13:40.968+0000 7f533082f800 20 zonegroup default 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:13:40.969+0000 7f533082f800 20 started sync module instance, tier type = 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:13:40.969+0000 7f533082f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=0 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=1 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=2 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=3 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=4 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=5 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=6 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:13:40.979+0000 7f533082f800 20 add_watcher() i=7 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:13:40.979+0000 7f533082f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding auth protocol: cephx 2024-09-14T11:13:41.045 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding auth protocol: cephx 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding auth protocol: cephx 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:13:40.981+0000 7f51e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.046 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:13:40.981+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:13:40.981+0000 7f533082f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:13:40.981+0000 7f533082f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache list hook 0x5584e515ab40 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache inspect hook 0x5584e515ab40 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache erase hook 0x5584e515ab40 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache zap hook 0x5584e515ab40 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:13:40.981+0000 7f533082f800 5 note: GC not initialized 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:13:40.981+0000 7f515f7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace show hook 0x7f5318086040 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace history hook 0x7f5318086040 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace active hook 0x7f5318086040 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace active_short hook 0x7f5318086040 2024-09-14T11:13:41.047 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:13:40.982+0000 7f533082f800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:13:40.982+0000 7f533082f800 20 Filter name: none 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:13:40.982+0000 7f515d7fa640 20 reqs_thread_entry: start 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:13:40.982+0000 7f533082f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:13:40.982+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:13:40.982+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:13:40.982+0000 7f533082f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:13:40.982+0000 7f533082f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:13:40.982+0000 7f533082f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 : miss 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:13:40.982+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:13:40.983+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:13:40.983+0000 7f533082f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:13:40.983+0000 7f533082f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:13:41.048 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:13:40.983+0000 7f533082f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:13:40.983+0000 7f533082f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:13:40.983+0000 7f533082f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:13:40.985+0000 7f533082f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f533082f800 time 2024-09-14T11:13:40.986216+0000 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5333d8c76a] 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:41.049 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:13:40.986+0000 7f533082f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f533082f800 thread_name:radosgw-admin 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5332a3e6f0] 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5332a8b99c] 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5333d8c7c4] 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:41.050 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:13:41.051 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:13:41.052 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:13:41.053 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:13:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:13:41.055 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:13:41.056 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:13:41.057 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f515d7fa640 / http_manager 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f515f7fe640 / http_manager 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f51e4fe1640 / rgw_dt_lg_renew 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f51fffff640 / ms_dispatch 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5211ffb640 / io_context_pool 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5213fff640 / ms_dispatch 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f521ae05640 / ms_dispatch 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f521c608640 / io_context_pool 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5325b18640 / msgr-worker-2 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f532e319640 / msgr-worker-1 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f532eb1a640 / msgr-worker-0 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f532f31b640 / io_context_pool 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: 7f533082f800 / radosgw-admin 2024-09-14T11:13:41.058 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.89065.log 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: dump: 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.059 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:13:40.736+0000 7f521c608640 10 monclient: dump: 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.060 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:13:40.736+0000 7f533082f800 5 monclient: authenticate success, global_id 6038 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:13:40.736+0000 7f533082f800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:13:40.736+0000 7f533082f800 4 set_mon_vals no callback set 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:13:40.736+0000 7f533082f800 10 monclient: shutdown 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:13:40.736+0000 7f533082f800 5 asok(0x5584e4e72270) unregister_commands rotate-key 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:13:40.737+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.061 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding auth protocol: cephx 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding auth protocol: cephx 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding auth protocol: cephx 2024-09-14T11:13:41.062 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: crc 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5096fc0) adding con mode: secure 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:13:40.737+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.063 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: starting msgr at 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: starting objecter 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:13:40.737+0000 7f533082f800 5 asok(0x5584e4e72270) register_command objecter_requests hook 0x5584e50942e0 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: setting wanted keys 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:13:40.737+0000 7f533082f800 1 librados: calling monclient init 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding auth protocol: cephx 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding auth protocol: cephx 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding auth protocol: cephx 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.064 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: crc 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:13:40.737+0000 7f533082f800 5 AuthRegistry(0x5584e5091390) adding con mode: secure 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:13:40.737+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:13:40.737+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:13:40.737+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key hook 0x5584e50914d8 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:13:40.737+0000 7f533082f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e4f1d4a0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e4f3dd30 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.065 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e5094620 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.291036s 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e4f3dd30 auth_method 0 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e5094620 auth_method 0 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.066 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e4f1d4a0 auth_method 0 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:13:40.738+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:13:40.738+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.067 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6321 payload 824 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:13:40.738+0000 7f5325b18640 1 monclient: found mon.noname-a 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:13:40.738+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: dump: 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.068 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:13:40.738+0000 7f521ae05640 10 monclient: dump: 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.069 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:13:40.738+0000 7f533082f800 5 monclient: authenticate success, global_id 6321 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:13:40.738+0000 7f521c608640 4 set_mon_vals no callback set 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:13:40.738+0000 7f533082f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:13:40.738+0000 7f533082f800 1 librados: init done 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:13:40.741+0000 7f521ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:13:40.741+0000 7f521ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:13:40.741+0000 7f521ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.070 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:13:40.741+0000 7f532e319640 10 monclient: get_auth_request con 0x7f5214077230 auth_method 0 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:13:40.741+0000 7f532eb1a640 10 monclient: get_auth_request con 0x5584e50bb2f0 auth_method 0 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:13:40.742+0000 7f532e319640 10 monclient: get_auth_request con 0x5584e50de310 auth_method 0 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:13:40.743+0000 7f5325b18640 10 monclient: get_auth_request con 0x5584e50e33f0 auth_method 0 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:13:40.744+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:13:40.744+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:13:40.744+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.071 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding auth protocol: cephx 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding auth protocol: cephx 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding auth protocol: cephx 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.072 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: crc 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e7470) adding con mode: secure 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:13:40.744+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:13:40.744+0000 7f533082f800 5 asok(0x5584e4e72270) register_command objecter_requests cmddesc objecter_requests hook 0x5584e50ea960 EEXIST 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:13:40.744+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding auth protocol: cephx 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding auth protocol: cephx 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding auth protocol: cephx 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.073 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: crc 2024-09-14T11:13:41.074 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:13:40.744+0000 7f533082f800 5 AuthRegistry(0x5584e50e6428) adding con mode: secure 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:13:40.744+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:13:40.745+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:13:40.745+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key cmddesc rotate-key hook 0x5584e50e6570 EEXIST 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e510ec80 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e510f060 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e510d990 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.298286s 2024-09-14T11:13:41.075 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e510f060 auth_method 0 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e510d990 auth_method 0 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.076 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:13:40.745+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e510ec80 auth_method 0 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:13:40.745+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6044 payload 824 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:13:40.745+0000 7f5325b18640 1 monclient: found mon.noname-c 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:13:40.745+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: dump: 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.077 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:13:40.745+0000 7f5213fff640 10 monclient: dump: 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.078 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:13:40.745+0000 7f533082f800 5 monclient: authenticate success, global_id 6044 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:13:40.745+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:13:40.745+0000 7f532f31b640 4 set_mon_vals no callback set 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:13:40.746+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.079 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:13:40.746+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:13:40.747+0000 7f5213fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:13:40.747+0000 7f5213fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:13:40.747+0000 7f5213fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:13:40.747+0000 7f532e319640 10 monclient: get_auth_request con 0x7f5208077140 auth_method 0 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:13:40.747+0000 7f533082f800 10 monclient: get_monmap_and_config 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:13:40.747+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:13:40.747+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:13:40.747+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.080 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding auth protocol: cephx 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding auth protocol: cephx 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding auth protocol: cephx 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.081 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: crc 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x5584e512ebb0) adding con mode: secure 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:13:40.748+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding auth protocol: cephx 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding auth protocol: cephx 2024-09-14T11:13:41.082 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding auth protocol: cephx 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: crc 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:13:40.748+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68a10) adding con mode: secure 2024-09-14T11:13:41.083 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:13:40.748+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:13:40.748+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:13:40.748+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key cmddesc rotate-key hook 0x7ffdb1b68b58 EEXIST 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e51631d0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e5153b20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e515e600 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:13:40.748+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.301996s 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e5153b20 auth_method 0 2024-09-14T11:13:41.084 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e515e600 auth_method 0 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e51631d0 auth_method 0 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.085 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:13:40.749+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:13:40.749+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6047 payload 274 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:13:40.749+0000 7f5325b18640 1 monclient: found mon.noname-c 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:13:40.749+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: dump: 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.086 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.087 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:13:40.749+0000 7f5211ffb640 10 monclient: dump: 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:13:40.749+0000 7f533082f800 5 monclient: authenticate success, global_id 6047 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:13:40.749+0000 7f533082f800 10 monclient: get_monmap_and_config success 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:13:40.749+0000 7f533082f800 4 set_mon_vals no callback set 2024-09-14T11:13:41.088 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: shutdown 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: build_initial_monmap 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:13:40.750+0000 7f533082f800 1 build_initial for_mkfs: 0 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: monmap: 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.089 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding auth protocol: cephx 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding auth protocol: cephx 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding auth protocol: cephx 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: crc 2024-09-14T11:13:41.090 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5132730) adding con mode: secure 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:13:40.750+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: starting msgr at 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: starting objecter 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:13:40.750+0000 7f533082f800 5 asok(0x5584e4e72270) register_command objecter_requests cmddesc objecter_requests hook 0x5584e51603d0 EEXIST 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: setting wanted keys 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:13:40.750+0000 7f533082f800 1 librados: calling monclient init 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:13:40.750+0000 7f533082f800 10 monclient: init 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding auth protocol: cephx 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding auth protocol: cephx 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding auth protocol: cephx 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.091 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: crc 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:13:40.750+0000 7f533082f800 5 AuthRegistry(0x5584e5123540) adding con mode: secure 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:13:40.750+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:13:40.751+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:13:40.751+0000 7f533082f800 5 asok(0x5584e4e72270) register_command rotate-key cmddesc rotate-key hook 0x5584e5123688 EEXIST 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _reopen_session rank -1 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:13:41.092 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): picked mon.noname-b con 0x5584e5153b20 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): picked mon.noname-c con 0x5584e515e600 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): picked mon.noname-a con 0x5584e51631d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): _renew_subs 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient(hunting): authenticate will time out at 1847.304269s 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): get_auth_request con 0x5584e515e600 auth_method 0 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): get_auth_request con 0x5584e51631d0 auth_method 0 2024-09-14T11:13:41.093 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): get_auth_request con 0x5584e5153b20 auth_method 0 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:13:40.751+0000 7f532eb1a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:13:41.094 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:13:40.751+0000 7f532e319640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient(hunting): handle_auth_done global_id 6050 payload 824 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient: _finish_hunting 0 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:13:40.751+0000 7f5325b18640 1 monclient: found mon.noname-c 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:13:40.751+0000 7f5325b18640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: dump: 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.095 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: _finish_auth 0 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: _check_auth_tickets 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:13:40.751+0000 7f51fffff640 10 monclient: dump: 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:13:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:13:40.751+0000 7f533082f800 5 monclient: authenticate success, global_id 6050 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:13:40.751+0000 7f5211ffb640 4 set_mon_vals no callback set 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:13:40.751+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:13:40.752+0000 7f533082f800 10 monclient: _renew_subs 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:13:40.752+0000 7f533082f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:13:40.752+0000 7f533082f800 1 librados: init done 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:13:40.752+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cr dump hook 0x5584e51535e8 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:13:40.753+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:13:40.754+0000 7f51fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:13:40.754+0000 7f51fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:13:40.754+0000 7f51fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:13:40.754+0000 7f532e319640 10 monclient: get_auth_request con 0x7f51f8077260 auth_method 0 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:13:40.754+0000 7f532eb1a640 10 monclient: get_auth_request con 0x5584e517ce90 auth_method 0 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:13:40.755+0000 7f533082f800 20 realm 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.098 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:13:40.755+0000 7f533082f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:13:40.755+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:13:40.755+0000 7f532e319640 10 monclient: get_auth_request con 0x5584e51810c0 auth_method 0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:13:40.756+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:13:40.756+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:13:40.756+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:13:40.756+0000 7f533082f800 20 searching for the correct realm 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:13:40.756+0000 7f5325b18640 10 monclient: get_auth_request con 0x5584e5186380 auth_method 0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:13:40.757+0000 7f532eb1a640 10 monclient: get_auth_request con 0x7f531801e020 auth_method 0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:13:40.758+0000 7f532e319640 10 monclient: get_auth_request con 0x7f5328087400 auth_method 0 2024-09-14T11:13:41.099 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:13:40.759+0000 7f5325b18640 10 monclient: get_auth_request con 0x7f5320045440 auth_method 0 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:13:40.759+0000 7f5325b18640 0 -- 172.21.15.2:0/547105855 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f5320045440 msgr2=0x7f53200458a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:13:40.759+0000 7f51fffff640 1 client.6050.objecter ms_handle_reset 0x7f5320045440 session 0x7f532001c630 osd.4 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:13:40.759+0000 7f51fffff640 10 monclient: _renew_subs 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:13:40.759+0000 7f51fffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:13:40.759+0000 7f5325b18640 10 monclient: get_auth_request con 0x7f51f8087080 auth_method 0 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:13:40.760+0000 7f532eb1a640 10 monclient: get_auth_request con 0x7f5318043070 auth_method 0 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:13:40.762+0000 7f532e319640 10 monclient: get_auth_request con 0x7f53180916a0 auth_method 0 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:13:40.762+0000 7f532e319640 0 -- 172.21.15.2:0/547105855 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f53180916a0 msgr2=0x7f531806a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:13:40.963+0000 7f532e319640 10 monclient: get_auth_request con 0x7f53180916a0 auth_method 0 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:41.100 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:13:40.968+0000 7f533082f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:13:40.968+0000 7f533082f800 20 zone default found 2024-09-14T11:13:41.101 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:13:40.968+0000 7f533082f800 4 Realm: () 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:13:40.968+0000 7f533082f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:13:40.968+0000 7f533082f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:13:40.968+0000 7f533082f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:13:40.968+0000 7f533082f800 20 zonegroup default 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:13:40.968+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:13:40.969+0000 7f533082f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.102 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:13:40.969+0000 7f533082f800 20 started sync module instance, tier type = 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:13:40.969+0000 7f533082f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=0 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=1 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=2 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=3 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=4 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=5 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:13:40.978+0000 7f533082f800 20 add_watcher() i=6 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:13:40.979+0000 7f533082f800 20 add_watcher() i=7 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:13:40.979+0000 7f533082f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding auth protocol: cephx 2024-09-14T11:13:41.103 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding auth protocol: cephx 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding auth protocol: cephx 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: crc 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:13:40.981+0000 7f51e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:13:40.981+0000 7f533082f800 5 AuthRegistry(0x7ffdb1b68ef0) adding con mode: secure 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:13:40.981+0000 7f533082f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:13:40.981+0000 7f533082f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:13:40.981+0000 7f533082f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache list hook 0x5584e515ab40 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache inspect hook 0x5584e515ab40 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache erase hook 0x5584e515ab40 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:13:40.981+0000 7f533082f800 5 asok(0x5584e4e72270) register_command cache zap hook 0x5584e515ab40 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:13:40.981+0000 7f533082f800 5 note: GC not initialized 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:13:40.981+0000 7f515f7fe640 20 reqs_thread_entry: start 2024-09-14T11:13:41.105 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace show hook 0x7f5318086040 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace history hook 0x7f5318086040 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace active hook 0x7f5318086040 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:13:40.982+0000 7f533082f800 5 asok(0x5584e4e72270) register_command sync trace active_short hook 0x7f5318086040 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:13:40.982+0000 7f533082f800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:13:40.982+0000 7f533082f800 20 Filter name: none 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:13:40.982+0000 7f515d7fa640 20 reqs_thread_entry: start 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:13:40.982+0000 7f533082f800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:13:40.982+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:13:40.982+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:13:40.982+0000 7f533082f800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:13:40.982+0000 7f533082f800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:13:41.106 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:13:40.982+0000 7f533082f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 : miss 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:13:40.982+0000 7f533082f800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:13:40.983+0000 7f533082f800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:13:40.983+0000 7f533082f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:13:40.983+0000 7f533082f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:13:40.983+0000 7f533082f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:13:40.983+0000 7f533082f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:13:40.983+0000 7f533082f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:13:40.985+0000 7f533082f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f533082f800 time 2024-09-14T11:13:40.986216+0000 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:41.107 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5333d8c76a] 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:13:40.986+0000 7f533082f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f533082f800 thread_name:radosgw-admin 2024-09-14T11:13:41.108 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5332a3e6f0] 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5332a8b99c] 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5333d8c7c4] 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5333d8c928] 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5584e39fd0b1] 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd882d4) [0x5584e3f102d4] 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5584e3a0cefd] 2024-09-14T11:13:41.109 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5332a29590] 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:13:41.110 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:13:41.112 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:13:41.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:13:41.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:13:41.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:13:41.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:13:41.117 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:13:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7f515d7fa640 / http_manager 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7f515f7fe640 / http_manager 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7f51e4fe1640 / rgw_dt_lg_renew 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7f51fffff640 / ms_dispatch 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5211ffb640 / io_context_pool 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5213fff640 / ms_dispatch 2024-09-14T11:13:41.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7f521ae05640 / ms_dispatch 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: 7f521c608640 / io_context_pool 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5325b18640 / msgr-worker-2 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: 7f532e319640 / msgr-worker-1 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: 7f532eb1a640 / msgr-worker-0 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: 7f532f31b640 / io_context_pool 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: 7f533082f800 / radosgw-admin 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:13:40.987907Z_9032db88-3442-4d61-808c-d331803ae09a/log 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:13:41.120 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.065+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.066+0000 7fe95eb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.066+0000 7fe95eb36800 20 realm 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.066+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.067+0000 7fe95eb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.067+0000 7fe95eb36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.067+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.067+0000 7fe95eb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.067+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.068+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.068+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.068+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.068+0000 7fe95eb36800 20 searching for the correct realm 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.071+0000 7fe95b0b8640 0 -- 172.21.15.2:0/1711433368 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fe950089040 msgr2=0x7fe95009d9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.123 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.074+0000 7fe95a8b7640 0 -- 172.21.15.2:0/1711433368 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fe950093910 msgr2=0x7fe950059050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.280+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 zone default found 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 4 Realm: () 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 zonegroup default 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.281+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.282+0000 7fe95eb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.282+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.282+0000 7fe95eb36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.282+0000 7fe95eb36800 20 started sync module instance, tier type = 2024-09-14T11:13:41.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.282+0000 7fe95eb36800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:41.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.291+0000 7fe95eb36800 20 add_watcher() i=0 2024-09-14T11:13:41.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.291+0000 7fe95eb36800 20 add_watcher() i=1 2024-09-14T11:13:41.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.291+0000 7fe95eb36800 20 add_watcher() i=2 2024-09-14T11:13:41.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.291+0000 7fe95eb36800 20 add_watcher() i=3 2024-09-14T11:13:41.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.291+0000 7fe95eb36800 20 add_watcher() i=4 2024-09-14T11:13:41.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.291+0000 7fe95eb36800 20 add_watcher() i=5 2024-09-14T11:13:41.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.291+0000 7fe95eb36800 20 add_watcher() i=6 2024-09-14T11:13:41.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.292+0000 7fe95eb36800 20 add_watcher() i=7 2024-09-14T11:13:41.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.292+0000 7fe95eb36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:41.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.294+0000 7fe8117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.294+0000 7fe95eb36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.294+0000 7fe95eb36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.294+0000 7fe95eb36800 5 note: GC not initialized 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.294+0000 7fe78bfff640 20 reqs_thread_entry: start 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.295+0000 7fe95eb36800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.295+0000 7fe95eb36800 20 Filter name: none 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.295+0000 7fe789ffb640 20 reqs_thread_entry: start 2024-09-14T11:13:41.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.295+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.295+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:41.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.295+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.296+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:41.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.296+0000 7fe95eb36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:41.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.296+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.296+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:41.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.296+0000 7fe95eb36800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.296+0000 7fe95eb36800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:41.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.296+0000 7fe95eb36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:13:41.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.298+0000 7fe8117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.300+0000 7fe95eb36800 20 remove_watcher() i=0 2024-09-14T11:13:41.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.300+0000 7fe95eb36800 2 removed watcher, disabling cache 2024-09-14T11:13:41.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.301+0000 7fe95eb36800 20 remove_watcher() i=1 2024-09-14T11:13:41.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.301+0000 7fe95eb36800 20 remove_watcher() i=2 2024-09-14T11:13:41.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.303+0000 7fe95eb36800 20 remove_watcher() i=3 2024-09-14T11:13:41.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.304+0000 7fe95eb36800 20 remove_watcher() i=4 2024-09-14T11:13:41.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.305+0000 7fe95eb36800 20 remove_watcher() i=5 2024-09-14T11:13:41.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.306+0000 7fe95eb36800 20 remove_watcher() i=6 2024-09-14T11:13:41.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.307+0000 7fe95eb36800 20 remove_watcher() i=7 2024-09-14T11:13:41.318 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.318 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:13:41.318 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-init-indext id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:13:41.318 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:13:41.320 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.320 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:41.328 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:13:41.328 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:13:41.371 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:13:41.403 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:13:41.403 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:13:41.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.443+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 20 realm 2024-09-14T11:13:41.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:13:41.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.445+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.446+0000 7f16b4812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.446+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.446+0000 7f16b4812800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:13:41.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.446+0000 7f16b4812800 20 searching for the correct realm 2024-09-14T11:13:41.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.449+0000 7f16af6ca640 0 -- 172.21.15.2:0/1397698715 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f16a001a050 msgr2=0x7f16a0056940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:13:41.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.654+0000 7f16afecb640 0 -- 172.21.15.2:0/1397698715 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f16a403b060 msgr2=0x7f16a4062a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.860+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:13:41.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 zone default found 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 4 Realm: () 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 zonegroup default 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.861+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.862+0000 7f16b4812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.862+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.862+0000 7f16b4812800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:13:41.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.862+0000 7f16b4812800 20 started sync module instance, tier type = 2024-09-14T11:13:41.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.862+0000 7f16b4812800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:13:41.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.871+0000 7f16b4812800 20 add_watcher() i=0 2024-09-14T11:13:41.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.871+0000 7f16b4812800 20 add_watcher() i=1 2024-09-14T11:13:41.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.871+0000 7f16b4812800 20 add_watcher() i=2 2024-09-14T11:13:41.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.871+0000 7f16b4812800 20 add_watcher() i=3 2024-09-14T11:13:41.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.871+0000 7f16b4812800 20 add_watcher() i=4 2024-09-14T11:13:41.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.871+0000 7f16b4812800 20 add_watcher() i=5 2024-09-14T11:13:41.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.871+0000 7f16b4812800 20 add_watcher() i=6 2024-09-14T11:13:41.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.872+0000 7f16b4812800 20 add_watcher() i=7 2024-09-14T11:13:41.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.872+0000 7f16b4812800 2 all 8 watchers are set, enabling cache 2024-09-14T11:13:41.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.874+0000 7f1565fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.874+0000 7f16b4812800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.874+0000 7f16b4812800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.874+0000 7f16b4812800 5 note: GC not initialized 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.874+0000 7f1564fe1640 20 reqs_thread_entry: start 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.874+0000 7f16b4812800 20 init_complete bucket index max shards: 1 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.874+0000 7f16b4812800 20 Filter name: none 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f14de7fc640 20 reqs_thread_entry: start 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f16b4812800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:13:41.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f16b4812800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:13:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f16b4812800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:13:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f16b4812800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:13:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f16b4812800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 : miss 2024-09-14T11:13:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.875+0000 7f16b4812800 20 rados->read ofs=0 len=0 2024-09-14T11:13:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.876+0000 7f16b4812800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:13:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.876+0000 7f16b4812800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:13:41.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.876+0000 7f16b4812800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:13:41.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.876+0000 7f16b4812800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:13:41.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.876+0000 7f16b4812800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:13:41.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.876+0000 7f16b4812800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 2024-09-14T11:13:41.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.877+0000 7f16b4812800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to be held by another RGW process; skipping for now 2024-09-14T11:13:41.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.878+0000 7f1565fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:13:41.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.880+0000 7f16b4812800 20 remove_watcher() i=0 2024-09-14T11:13:41.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.880+0000 7f16b4812800 2 removed watcher, disabling cache 2024-09-14T11:13:41.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.881+0000 7f16b4812800 20 remove_watcher() i=1 2024-09-14T11:13:41.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.882+0000 7f16b4812800 20 remove_watcher() i=2 2024-09-14T11:13:41.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.883+0000 7f16b4812800 20 remove_watcher() i=3 2024-09-14T11:13:41.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.884+0000 7f16b4812800 20 remove_watcher() i=4 2024-09-14T11:13:41.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.885+0000 7f16b4812800 20 remove_watcher() i=5 2024-09-14T11:13:41.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.886+0000 7f16b4812800 20 remove_watcher() i=6 2024-09-14T11:13:41.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:13:41.887+0000 7f16b4812800 20 remove_watcher() i=7 2024-09-14T11:13:41.898 INFO:tasks.workunit.client.0.smithi002.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:14:11.931 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:14:11.968 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:11.968 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:12.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.016+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 20 realm 2024-09-14T11:14:12.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:12.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.018+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.019+0000 7f623d012800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:12.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.019+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.019+0000 7f623d012800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:12.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.020+0000 7f623d012800 20 searching for the correct realm 2024-09-14T11:14:12.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.023+0000 7f6237eca640 0 -- 172.21.15.2:0/1001619824 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f6228071ad0 msgr2=0x7f6228068a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:12.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.027+0000 7f62386cb640 0 -- 172.21.15.2:0/1001619824 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f622c056b20 msgr2=0x7f622c09f970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.235+0000 7f623d012800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.235+0000 7f623d012800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.235+0000 7f623d012800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.235+0000 7f623d012800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.235+0000 7f623d012800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.235+0000 7f623d012800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.235+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.236+0000 7f623d012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.236+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.236+0000 7f623d012800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.236+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 zone default found 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 4 Realm: () 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 zonegroup default 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.237+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.238+0000 7f623d012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.238+0000 7f623d012800 20 started sync module instance, tier type = 2024-09-14T11:14:12.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.238+0000 7f623d012800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:12.247 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.249+0000 7f623d012800 20 add_watcher() i=0 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.249+0000 7f623d012800 20 add_watcher() i=1 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.249+0000 7f623d012800 20 add_watcher() i=2 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.249+0000 7f623d012800 20 add_watcher() i=3 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.249+0000 7f623d012800 20 add_watcher() i=4 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.249+0000 7f623d012800 20 add_watcher() i=5 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.249+0000 7f623d012800 20 add_watcher() i=6 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.250+0000 7f623d012800 20 add_watcher() i=7 2024-09-14T11:14:12.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.250+0000 7f623d012800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:12.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.252+0000 7f60ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:12.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f623d012800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:12.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f623d012800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:12.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f623d012800 5 note: GC not initialized 2024-09-14T11:14:12.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f60ed7e2640 20 reqs_thread_entry: start 2024-09-14T11:14:12.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f623d012800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:12.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f623d012800 20 Filter name: none 2024-09-14T11:14:12.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f605effd640 20 reqs_thread_entry: start 2024-09-14T11:14:12.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f623d012800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-14T11:14:12.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.253+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.254+0000 7f623d012800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.254+0000 7f623d012800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.254+0000 7f623d012800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.254+0000 7f623d012800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 : miss 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.254+0000 7f623d012800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.255+0000 7f623d012800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.255+0000 7f623d012800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.255+0000 7f623d012800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.255+0000 7f623d012800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.255+0000 7f623d012800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:12.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.255+0000 7f623d012800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 2024-09-14T11:14:12.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f623d012800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:14:12.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f623d012800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:14:12.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f623d012800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:12.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f623d012800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21, ofs0, ns] 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f610f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464312 cookie 93837952315488 notifier 6387 bl.length()=913 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f610f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f610f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.259+0000 7f610f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.260+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): orig_sources= new_sources= 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.260+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): potential sources added=[] removed=[] 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.260+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): orig_dests= new_dests= 2024-09-14T11:14:12.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.260+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): potential dests added=[] removed=[] 2024-09-14T11:14:12.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.262+0000 7f623d012800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.21.1.0 2024-09-14T11:14:12.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.262+0000 7f623d012800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.21.1.0 2024-09-14T11:14:12.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.262+0000 7f623d012800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.21.1.1 2024-09-14T11:14:12.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.262+0000 7f623d012800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.21.1.1 2024-09-14T11:14:12.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.262+0000 7f623d012800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.21.0 2024-09-14T11:14:12.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.265+0000 7f623d012800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:12.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.265+0000 7f623d012800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 2024-09-14T11:14:12.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f623d012800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:14:12.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f623d012800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:14:12.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f623d012800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:12.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f623d012800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21, ofs0, ns] 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f610f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464313 cookie 93837952315488 notifier 6387 bl.length()=913 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f610f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f610f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.267+0000 7f610f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.268+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): orig_sources= new_sources= 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.268+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): potential sources added=[] removed=[] 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.268+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): orig_dests= new_dests= 2024-09-14T11:14:12.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.268+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): potential dests added=[] removed=[] 2024-09-14T11:14:12.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.269+0000 7f623d012800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.21.0 2024-09-14T11:14:12.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.269+0000 7f623d012800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:12.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.269+0000 7f623d012800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 2024-09-14T11:14:12.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.271+0000 7f623d012800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:14:12.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.271+0000 7f623d012800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:14:12.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.271+0000 7f623d012800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.271+0000 7f623d012800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21, ofs0, ns] 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f610f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 93837952315488 notifier 6387 bl.length()=881 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f610f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 info.flags=0x17 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f610f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 to cache LRU end 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f610f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): orig_sources= new_sources= 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): potential sources added=[] removed=[] 2024-09-14T11:14:12.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): orig_dests= new_dests= 2024-09-14T11:14:12.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.272+0000 7f623d012800 20 handle_bi_update(): bucket=:abort-at-init-indext[17edae97-cd6b-4c90-863d-862429a20cf3.4538.21]): potential dests added=[] removed=[] 2024-09-14T11:14:12.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.273+0000 7f623d012800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 1 shards to 2 shards completed successfully 2024-09-14T11:14:12.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.275+0000 7f60ee7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:12.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.278+0000 7f623d012800 20 remove_watcher() i=0 2024-09-14T11:14:12.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.278+0000 7f623d012800 2 removed watcher, disabling cache 2024-09-14T11:14:12.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.279+0000 7f623d012800 20 remove_watcher() i=1 2024-09-14T11:14:12.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.280+0000 7f623d012800 20 remove_watcher() i=2 2024-09-14T11:14:12.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.281+0000 7f623d012800 20 remove_watcher() i=3 2024-09-14T11:14:12.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.283+0000 7f623d012800 20 remove_watcher() i=4 2024-09-14T11:14:12.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.284+0000 7f623d012800 20 remove_watcher() i=5 2024-09-14T11:14:12.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.285+0000 7f623d012800 20 remove_watcher() i=6 2024-09-14T11:14:12.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.286+0000 7f623d012800 20 remove_watcher() i=7 2024-09-14T11:14:12.299 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-14T11:14:12.329 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:12.329 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:12.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.371+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.373+0000 7fd4ed539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.373+0000 7fd4ed539800 20 realm 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.373+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.374+0000 7fd4ed539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.374+0000 7fd4ed539800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.374+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.374+0000 7fd4ed539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.374+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.577+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:12.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.577+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.577+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:12.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.577+0000 7fd4ed539800 20 searching for the correct realm 2024-09-14T11:14:12.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.581+0000 7fd4e99c8640 0 -- 172.21.15.2:0/1263545147 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fd4e0030040 msgr2=0x7fd4e003e930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:12.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.585+0000 7fd4e91c7640 0 -- 172.21.15.2:0/1263545147 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd4e002f920 msgr2=0x7fd4e004d400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.792+0000 7fd4ed539800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.792+0000 7fd4ed539800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.792+0000 7fd4ed539800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.792+0000 7fd4ed539800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.792+0000 7fd4ed539800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.792+0000 7fd4ed539800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.792+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 zone default found 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 4 Realm: () 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 zonegroup default 2024-09-14T11:14:12.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.793+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.794+0000 7fd4ed539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.794+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.794+0000 7fd4ed539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.794+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.794+0000 7fd4ed539800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:12.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.794+0000 7fd4ed539800 20 started sync module instance, tier type = 2024-09-14T11:14:12.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.794+0000 7fd4ed539800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:12.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.805+0000 7fd4ed539800 20 add_watcher() i=0 2024-09-14T11:14:12.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.805+0000 7fd4ed539800 20 add_watcher() i=1 2024-09-14T11:14:12.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.805+0000 7fd4ed539800 20 add_watcher() i=2 2024-09-14T11:14:12.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.805+0000 7fd4ed539800 20 add_watcher() i=3 2024-09-14T11:14:12.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.805+0000 7fd4ed539800 20 add_watcher() i=4 2024-09-14T11:14:12.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.805+0000 7fd4ed539800 20 add_watcher() i=5 2024-09-14T11:14:12.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.805+0000 7fd4ed539800 20 add_watcher() i=6 2024-09-14T11:14:12.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.806+0000 7fd4ed539800 20 add_watcher() i=7 2024-09-14T11:14:12.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.806+0000 7fd4ed539800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:12.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.808+0000 7fd39f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:12.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.808+0000 7fd4ed539800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:12.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.808+0000 7fd4ed539800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:12.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.808+0000 7fd4ed539800 5 note: GC not initialized 2024-09-14T11:14:12.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.809+0000 7fd39e7e4640 20 reqs_thread_entry: start 2024-09-14T11:14:12.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.809+0000 7fd4ed539800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:12.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.809+0000 7fd4ed539800 20 Filter name: none 2024-09-14T11:14:12.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.809+0000 7fd30ffff640 20 reqs_thread_entry: start 2024-09-14T11:14:12.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.809+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.809+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:14:12.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.810+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.810+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:14:12.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.810+0000 7fd4ed539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:12.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.810+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.811+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=188 2024-09-14T11:14:12.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.811+0000 7fd4ed539800 20 rados->read ofs=0 len=0 2024-09-14T11:14:12.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.811+0000 7fd4ed539800 20 rados_obj.operate() r=0 bl.length=410 2024-09-14T11:14:12.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.811+0000 7fd4ed539800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:12.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.813+0000 7fd39f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:12.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.815+0000 7fd4ed539800 20 remove_watcher() i=0 2024-09-14T11:14:12.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.815+0000 7fd4ed539800 2 removed watcher, disabling cache 2024-09-14T11:14:12.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.817+0000 7fd4ed539800 20 remove_watcher() i=1 2024-09-14T11:14:12.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.818+0000 7fd4ed539800 20 remove_watcher() i=2 2024-09-14T11:14:12.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.819+0000 7fd4ed539800 20 remove_watcher() i=3 2024-09-14T11:14:12.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.821+0000 7fd4ed539800 20 remove_watcher() i=4 2024-09-14T11:14:12.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.822+0000 7fd4ed539800 20 remove_watcher() i=5 2024-09-14T11:14:12.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.823+0000 7fd4ed539800 20 remove_watcher() i=6 2024-09-14T11:14:12.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:12.824+0000 7fd4ed539800 20 remove_watcher() i=7 2024-09-14T11:14:12.835 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:12.835 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:12.835 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-init-indext id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.21 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:14:12.835 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:12.837 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.837 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.841 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.841 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.883 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.884 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.898 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-14T11:14:12.898 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:12.899 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.899 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.910 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.910 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.952 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.953 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.960 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.960 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.968 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.968 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.976 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.976 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.983 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.983 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:12.992 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:12.992 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.000 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.000 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.007 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.008 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.015 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.015 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.022 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.022 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.029 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.030 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.037 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.037 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.044 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.044 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.051 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.052 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.058 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.059 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.065 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.066 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.072 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.073 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.080 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.080 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.088 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.088 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.095 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:13.095 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:13.103 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:14:13.132 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:13.133 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:13.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.173+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 20 realm 2024-09-14T11:14:13.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:13.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.176+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.177+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:13.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.177+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.177+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:13.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.177+0000 7f9f2c00f800 20 searching for the correct realm 2024-09-14T11:14:13.178 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.180+0000 7f9f27f23640 0 -- 172.21.15.2:0/1988069573 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f9f1c01a070 msgr2=0x7f9f1c066ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:13.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.183+0000 7f9f27722640 0 -- 172.21.15.2:0/1988069573 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f9f1c01ab20 msgr2=0x7f9f1c08a740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.188+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:13.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 zone default found 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 4 Realm: () 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 zonegroup default 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.189+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.190+0000 7f9f2c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.190+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.190+0000 7f9f2c00f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.190+0000 7f9f2c00f800 20 started sync module instance, tier type = 2024-09-14T11:14:13.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.190+0000 7f9f2c00f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:13.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.198+0000 7f9f2c00f800 20 add_watcher() i=0 2024-09-14T11:14:13.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.198+0000 7f9f2c00f800 20 add_watcher() i=1 2024-09-14T11:14:13.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.198+0000 7f9f2c00f800 20 add_watcher() i=2 2024-09-14T11:14:13.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.198+0000 7f9f2c00f800 20 add_watcher() i=3 2024-09-14T11:14:13.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.198+0000 7f9f2c00f800 20 add_watcher() i=4 2024-09-14T11:14:13.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.198+0000 7f9f2c00f800 20 add_watcher() i=5 2024-09-14T11:14:13.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.198+0000 7f9f2c00f800 20 add_watcher() i=6 2024-09-14T11:14:13.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.199+0000 7f9f2c00f800 20 add_watcher() i=7 2024-09-14T11:14:13.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.199+0000 7f9f2c00f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:13.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.201+0000 7f9dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.201+0000 7f9f2c00f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.201+0000 7f9f2c00f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.201+0000 7f9f2c00f800 5 note: GC not initialized 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.201+0000 7f9ddcfe1640 20 reqs_thread_entry: start 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.201+0000 7f9f2c00f800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.201+0000 7f9f2c00f800 20 Filter name: none 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.202+0000 7f9d567fc640 20 reqs_thread_entry: start 2024-09-14T11:14:13.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.202+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.202+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:13.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.202+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.203+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:13.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.203+0000 7f9f2c00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:13.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.203+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.203+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:13.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.203+0000 7f9f2c00f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.203+0000 7f9f2c00f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:13.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.203+0000 7f9f2c00f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:13.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.205+0000 7f9dddfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:13.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.206+0000 7f9f2c00f800 20 remove_watcher() i=0 2024-09-14T11:14:13.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.206+0000 7f9f2c00f800 2 removed watcher, disabling cache 2024-09-14T11:14:13.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.207+0000 7f9f2c00f800 20 remove_watcher() i=1 2024-09-14T11:14:13.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.208+0000 7f9f2c00f800 20 remove_watcher() i=2 2024-09-14T11:14:13.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.209+0000 7f9f2c00f800 20 remove_watcher() i=3 2024-09-14T11:14:13.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.210+0000 7f9f2c00f800 20 remove_watcher() i=4 2024-09-14T11:14:13.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.211+0000 7f9f2c00f800 20 remove_watcher() i=5 2024-09-14T11:14:13.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.212+0000 7f9f2c00f800 20 remove_watcher() i=6 2024-09-14T11:14:13.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.213+0000 7f9f2c00f800 20 remove_watcher() i=7 2024-09-14T11:14:13.223 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:13.223 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:13.223 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:13.223 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:13.225 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-14T11:14:13.259 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:13.259 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:13.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.484+0000 7fc06fbf6640 0 --2- 172.21.15.2:0/1417082790 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x5609812257d0 0x56098137fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:14:13.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.502+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 20 realm 2024-09-14T11:14:13.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:13.502 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.504+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.505+0000 7fc07210c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:13.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.505+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.505+0000 7fc07210c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:13.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.505+0000 7fc07210c800 20 searching for the correct realm 2024-09-14T11:14:13.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.508+0000 7fc06f3f5640 0 -- 172.21.15.2:0/3070699576 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fc060079030 msgr2=0x7fc0600691a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:13.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.714+0000 7fc06fbf6640 0 -- 172.21.15.2:0/3070699576 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fc06406b3e0 msgr2=0x7fc06406b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:13.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.920+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:13.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 zone default found 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 4 Realm: () 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 zonegroup default 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.921+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.922+0000 7fc07210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.922+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.922+0000 7fc07210c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:13.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.922+0000 7fc07210c800 20 started sync module instance, tier type = 2024-09-14T11:14:13.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.922+0000 7fc07210c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:13.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.931+0000 7fc07210c800 20 add_watcher() i=0 2024-09-14T11:14:13.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.931+0000 7fc07210c800 20 add_watcher() i=1 2024-09-14T11:14:13.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.931+0000 7fc07210c800 20 add_watcher() i=2 2024-09-14T11:14:13.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.931+0000 7fc07210c800 20 add_watcher() i=3 2024-09-14T11:14:13.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.931+0000 7fc07210c800 20 add_watcher() i=4 2024-09-14T11:14:13.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.931+0000 7fc07210c800 20 add_watcher() i=5 2024-09-14T11:14:13.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.931+0000 7fc07210c800 20 add_watcher() i=6 2024-09-14T11:14:13.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.932+0000 7fc07210c800 20 add_watcher() i=7 2024-09-14T11:14:13.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.932+0000 7fc07210c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:13.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fbf25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fc07210c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fc07210c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fc07210c800 5 note: GC not initialized 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fbf24fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fc07210c800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fc07210c800 20 Filter name: none 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.934+0000 7fbe9e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:14:13.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:13.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:14:13.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 : miss 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:13.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.935+0000 7fc07210c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 2024-09-14T11:14:13.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.938+0000 7fc07210c800 -1 Injecting error=-5 at location=set_target_layout 2024-09-14T11:14:13.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.938+0000 7fc07210c800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-14T11:14:13.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.941+0000 7fbf25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:13.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.943+0000 7fc07210c800 20 remove_watcher() i=0 2024-09-14T11:14:13.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.943+0000 7fc07210c800 2 removed watcher, disabling cache 2024-09-14T11:14:13.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.944+0000 7fc07210c800 20 remove_watcher() i=1 2024-09-14T11:14:13.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.945+0000 7fc07210c800 20 remove_watcher() i=2 2024-09-14T11:14:13.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.946+0000 7fc07210c800 20 remove_watcher() i=3 2024-09-14T11:14:13.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.947+0000 7fc07210c800 20 remove_watcher() i=4 2024-09-14T11:14:13.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.948+0000 7fc07210c800 20 remove_watcher() i=5 2024-09-14T11:14:13.947 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.949+0000 7fc07210c800 20 remove_watcher() i=6 2024-09-14T11:14:13.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:13.950+0000 7fc07210c800 20 remove_watcher() i=7 2024-09-14T11:14:13.961 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:14:13.992 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:13.992 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:14.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.219+0000 7fa2a9898640 0 --2- 172.21.15.2:0/1774107640 >> [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] conn(0x560f3bb1b5f0 0x560f3baecc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:14:14.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.235+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.236+0000 7fa2ac5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.236+0000 7fa2ac5af800 20 realm 2024-09-14T11:14:14.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.236+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.237+0000 7fa2ac5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.237+0000 7fa2ac5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:14.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.237+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.237+0000 7fa2ac5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.237+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.238+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.238+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.238+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:14.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.238+0000 7fa2ac5af800 20 searching for the correct realm 2024-09-14T11:14:14.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.239+0000 7fa2a9898640 0 -- 172.21.15.2:0/4181180272 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x560f3bbd6da0 msgr2=0x560f3bbd91d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:14.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.242+0000 7fa2aa89a640 0 -- 172.21.15.2:0/4181180272 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x560f3bbcd870 msgr2=0x560f3bbcfc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:14.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:14.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:14.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:14.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:14.248 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:14.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:14.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.249 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.250+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 zone default found 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 4 Realm: () 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:14.250 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 zonegroup default 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.251+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.252+0000 7fa2ac5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.252+0000 7fa2ac5af800 20 started sync module instance, tier type = 2024-09-14T11:14:14.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.252+0000 7fa2ac5af800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.260+0000 7fa2ac5af800 20 add_watcher() i=0 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.260+0000 7fa2ac5af800 20 add_watcher() i=1 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.260+0000 7fa2ac5af800 20 add_watcher() i=2 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.260+0000 7fa2ac5af800 20 add_watcher() i=3 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.260+0000 7fa2ac5af800 20 add_watcher() i=4 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.260+0000 7fa2ac5af800 20 add_watcher() i=5 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.260+0000 7fa2ac5af800 20 add_watcher() i=6 2024-09-14T11:14:14.259 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.261+0000 7fa2ac5af800 20 add_watcher() i=7 2024-09-14T11:14:14.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.261+0000 7fa2ac5af800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:14.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.263+0000 7fa160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.263+0000 7fa2ac5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.263+0000 7fa2ac5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.263+0000 7fa2ac5af800 5 note: GC not initialized 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.263+0000 7fa0db7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.264+0000 7fa2ac5af800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.264+0000 7fa2ac5af800 20 Filter name: none 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.264+0000 7fa0d97fa640 20 reqs_thread_entry: start 2024-09-14T11:14:14.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.264+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.264+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:14.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.264+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.264+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.265+0000 7fa2ac5af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.265+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.265+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.265+0000 7fa2ac5af800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.265+0000 7fa2ac5af800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.265+0000 7fa2ac5af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:14.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.266+0000 7fa160fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:14.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.269+0000 7fa2ac5af800 20 remove_watcher() i=0 2024-09-14T11:14:14.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.269+0000 7fa2ac5af800 2 removed watcher, disabling cache 2024-09-14T11:14:14.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.270+0000 7fa2ac5af800 20 remove_watcher() i=1 2024-09-14T11:14:14.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.271+0000 7fa2ac5af800 20 remove_watcher() i=2 2024-09-14T11:14:14.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.271+0000 7fa2ac5af800 20 remove_watcher() i=3 2024-09-14T11:14:14.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.272+0000 7fa2ac5af800 20 remove_watcher() i=4 2024-09-14T11:14:14.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.273+0000 7fa2ac5af800 20 remove_watcher() i=5 2024-09-14T11:14:14.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.274+0000 7fa2ac5af800 20 remove_watcher() i=6 2024-09-14T11:14:14.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.275+0000 7fa2ac5af800 20 remove_watcher() i=7 2024-09-14T11:14:14.285 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:14.285 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:14.285 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:14.285 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:14.286 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.286 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.294 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.295 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.338 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:14:14.370 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:14.370 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:14.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.412+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.413+0000 7f8bc5498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.413+0000 7f8bc5498800 20 realm 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.413+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.413+0000 7f8bc5498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.413+0000 7f8bc5498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.413+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.414+0000 7f8bc5498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.414+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.414+0000 7f8bc5498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.414+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.415+0000 7f8bc5498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:14.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.415+0000 7f8bc5498800 20 searching for the correct realm 2024-09-14T11:14:14.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.417+0000 7f8bc2781640 0 -- 172.21.15.2:0/2380973237 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8bb40a2070 msgr2=0x7f8bb408f160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:14.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.421+0000 7f8bc2f82640 0 -- 172.21.15.2:0/2380973237 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f8bb804c9e0 msgr2=0x7f8bb80836c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:14.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.628+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:14.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 zone default found 2024-09-14T11:14:14.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 4 Realm: () 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 zonegroup default 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.629+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.630+0000 7f8bc5498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.630+0000 7f8bc5498800 20 started sync module instance, tier type = 2024-09-14T11:14:14.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.630+0000 7f8bc5498800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:14.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.639+0000 7f8bc5498800 20 add_watcher() i=0 2024-09-14T11:14:14.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.639+0000 7f8bc5498800 20 add_watcher() i=1 2024-09-14T11:14:14.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.639+0000 7f8bc5498800 20 add_watcher() i=2 2024-09-14T11:14:14.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.639+0000 7f8bc5498800 20 add_watcher() i=3 2024-09-14T11:14:14.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.639+0000 7f8bc5498800 20 add_watcher() i=4 2024-09-14T11:14:14.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.639+0000 7f8bc5498800 20 add_watcher() i=5 2024-09-14T11:14:14.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.639+0000 7f8bc5498800 20 add_watcher() i=6 2024-09-14T11:14:14.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.640+0000 7f8bc5498800 20 add_watcher() i=7 2024-09-14T11:14:14.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.640+0000 7f8bc5498800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:14.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.641+0000 7f8a797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:14.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f8bc5498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:14.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f8bc5498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:14.640 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f8bc5498800 5 note: GC not initialized 2024-09-14T11:14:14.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f89f3fff640 20 reqs_thread_entry: start 2024-09-14T11:14:14.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f8bc5498800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:14.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f8bc5498800 20 Filter name: none 2024-09-14T11:14:14.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f89f1ffb640 20 reqs_thread_entry: start 2024-09-14T11:14:14.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f8bc5498800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:14:14.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.642+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 : miss 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:14.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:14.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.643+0000 7f8bc5498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 2024-09-14T11:14:14.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8bc5498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:14.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8bc5498800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:14.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8bc5498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:14.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8bc5498800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22, ofs0, ns] 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8aa67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94087429403680 notifier 6185 bl.length()=925 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8aa67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8aa67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.647+0000 7f8aa67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.648+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): orig_sources= new_sources= 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.648+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): potential sources added=[] removed=[] 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.648+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): orig_dests= new_dests= 2024-09-14T11:14:14.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.648+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): potential dests added=[] removed=[] 2024-09-14T11:14:14.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.650+0000 7f8bc5498800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.22.1.0 2024-09-14T11:14:14.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.650+0000 7f8bc5498800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.22.1.0 2024-09-14T11:14:14.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.650+0000 7f8bc5498800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.22.1.1 2024-09-14T11:14:14.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.650+0000 7f8bc5498800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.22.1.1 2024-09-14T11:14:14.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.650+0000 7f8bc5498800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.22.0 2024-09-14T11:14:14.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.652+0000 7f8bc5498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:14.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.652+0000 7f8bc5498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.653+0000 7f8bc5498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.653+0000 7f8bc5498800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.653+0000 7f8bc5498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.653+0000 7f8bc5498800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22, ofs0, ns] 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8aa5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94087429403680 notifier 6185 bl.length()=925 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8aa5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8aa5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:14.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8aa5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:14.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): orig_sources= new_sources= 2024-09-14T11:14:14.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): potential sources added=[] removed=[] 2024-09-14T11:14:14.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): orig_dests= new_dests= 2024-09-14T11:14:14.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.654+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): potential dests added=[] removed=[] 2024-09-14T11:14:14.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.655+0000 7f8bc5498800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.22.0 2024-09-14T11:14:14.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.656+0000 7f8bc5498800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:14.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.656+0000 7f8bc5498800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22, ofs0, ns] 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8aa67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464282 cookie 94087429403680 notifier 6185 bl.length()=893 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8aa67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 info.flags=0x17 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8aa67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 to cache LRU end 2024-09-14T11:14:14.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8aa67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:14.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): orig_sources= new_sources= 2024-09-14T11:14:14.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): potential sources added=[] removed=[] 2024-09-14T11:14:14.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): orig_dests= new_dests= 2024-09-14T11:14:14.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.657+0000 7f8bc5498800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.22]): potential dests added=[] removed=[] 2024-09-14T11:14:14.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.658+0000 7f8bc5498800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:14:14.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.661+0000 7f8a797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:14.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.663+0000 7f8bc5498800 20 remove_watcher() i=0 2024-09-14T11:14:14.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.663+0000 7f8bc5498800 2 removed watcher, disabling cache 2024-09-14T11:14:14.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.664+0000 7f8bc5498800 20 remove_watcher() i=1 2024-09-14T11:14:14.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.665+0000 7f8bc5498800 20 remove_watcher() i=2 2024-09-14T11:14:14.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.666+0000 7f8bc5498800 20 remove_watcher() i=3 2024-09-14T11:14:14.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.667+0000 7f8bc5498800 20 remove_watcher() i=4 2024-09-14T11:14:14.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.668+0000 7f8bc5498800 20 remove_watcher() i=5 2024-09-14T11:14:14.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.669+0000 7f8bc5498800 20 remove_watcher() i=6 2024-09-14T11:14:14.668 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.670+0000 7f8bc5498800 20 remove_watcher() i=7 2024-09-14T11:14:14.680 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:14:14.710 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:14.710 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:14.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.750+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.752+0000 7fa956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.752+0000 7fa956b36800 20 realm 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.752+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.753+0000 7fa956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.753+0000 7fa956b36800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.753+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.753+0000 7fa956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.753+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.754+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.754+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.754+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:14.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.754+0000 7fa956b36800 20 searching for the correct realm 2024-09-14T11:14:14.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.758+0000 7fa9520b6640 0 -- 172.21.15.2:0/3769513035 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x563d81cf59b0 msgr2=0x563d81cf7da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:14.759 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.761+0000 7fa9528b7640 0 -- 172.21.15.2:0/3769513035 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa948073900 msgr2=0x7fa948061400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:14.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:14.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:14.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:14.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:14.763 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:14.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:14.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:14.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.765+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:14.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 zone default found 2024-09-14T11:14:14.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 4 Realm: () 2024-09-14T11:14:14.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:14.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 zonegroup default 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 started sync module instance, tier type = 2024-09-14T11:14:14.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.766+0000 7fa956b36800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.775+0000 7fa956b36800 20 add_watcher() i=0 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.775+0000 7fa956b36800 20 add_watcher() i=1 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.775+0000 7fa956b36800 20 add_watcher() i=2 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.775+0000 7fa956b36800 20 add_watcher() i=3 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.775+0000 7fa956b36800 20 add_watcher() i=4 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.775+0000 7fa956b36800 20 add_watcher() i=5 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.775+0000 7fa956b36800 20 add_watcher() i=6 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.776+0000 7fa956b36800 20 add_watcher() i=7 2024-09-14T11:14:14.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.776+0000 7fa956b36800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:14.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.778+0000 7fa8097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:14.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.778+0000 7fa956b36800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:14.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.778+0000 7fa956b36800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:14.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.778+0000 7fa956b36800 5 note: GC not initialized 2024-09-14T11:14:14.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.779+0000 7fa783fff640 20 reqs_thread_entry: start 2024-09-14T11:14:14.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.779+0000 7fa956b36800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:14.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.779+0000 7fa956b36800 20 Filter name: none 2024-09-14T11:14:14.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.779+0000 7fa781ffb640 20 reqs_thread_entry: start 2024-09-14T11:14:14.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.779+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.779+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:14.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.779+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.780+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:14.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.780+0000 7fa956b36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:14.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.780+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.780+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:14.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.780+0000 7fa956b36800 20 rados->read ofs=0 len=0 2024-09-14T11:14:14.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.780+0000 7fa956b36800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:14.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.780+0000 7fa956b36800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:14.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.782+0000 7fa8097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:14.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.784+0000 7fa956b36800 20 remove_watcher() i=0 2024-09-14T11:14:14.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.784+0000 7fa956b36800 2 removed watcher, disabling cache 2024-09-14T11:14:14.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.785+0000 7fa956b36800 20 remove_watcher() i=1 2024-09-14T11:14:14.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.786+0000 7fa956b36800 20 remove_watcher() i=2 2024-09-14T11:14:14.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.787+0000 7fa956b36800 20 remove_watcher() i=3 2024-09-14T11:14:14.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.788+0000 7fa956b36800 20 remove_watcher() i=4 2024-09-14T11:14:14.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.789+0000 7fa956b36800 20 remove_watcher() i=5 2024-09-14T11:14:14.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.790+0000 7fa956b36800 20 remove_watcher() i=6 2024-09-14T11:14:14.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:14.791+0000 7fa956b36800 20 remove_watcher() i=7 2024-09-14T11:14:14.800 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:14.800 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:14.800 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.22 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:14:14.800 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:14.802 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.802 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.805 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.805 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.849 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.849 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.865 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-14T11:14:14.865 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:14.866 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.866 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.875 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.875 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.917 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.917 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.924 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.924 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.930 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.931 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.937 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.937 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.944 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.944 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.951 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.951 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.958 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.958 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.964 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.965 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.971 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.971 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.978 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.978 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.985 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.985 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:14.992 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:14.993 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.000 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.000 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.007 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.007 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.015 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.015 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.021 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.022 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.029 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.029 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.035 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.036 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.042 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.042 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.049 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.049 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.057 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:14:15.086 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.086 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.126+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.128+0000 7fb9ba92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.128+0000 7fb9ba92a800 20 realm 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.128+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.128+0000 7fb9ba92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.128+0000 7fb9ba92a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.128+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.129+0000 7fb9ba92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.129+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.129+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.129+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.130+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:15.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.130+0000 7fb9ba92a800 20 searching for the correct realm 2024-09-14T11:14:15.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.133+0000 7fb9b5d60640 0 -- 172.21.15.2:0/1920494855 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55845f8fe220 msgr2=0x55845f9006b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.137+0000 7fb9b5d60640 0 -- 172.21.15.2:0/1920494855 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x55845f69afd0 msgr2=0x7fb9b006e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.140+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:15.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 zone default found 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 4 Realm: () 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 zonegroup default 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.141+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.142+0000 7fb9ba92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.142+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.142+0000 7fb9ba92a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.142+0000 7fb9ba92a800 20 started sync module instance, tier type = 2024-09-14T11:14:15.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.142+0000 7fb9ba92a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:15.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.151+0000 7fb9ba92a800 20 add_watcher() i=0 2024-09-14T11:14:15.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.151+0000 7fb9ba92a800 20 add_watcher() i=1 2024-09-14T11:14:15.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.151+0000 7fb9ba92a800 20 add_watcher() i=2 2024-09-14T11:14:15.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.151+0000 7fb9ba92a800 20 add_watcher() i=3 2024-09-14T11:14:15.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.151+0000 7fb9ba92a800 20 add_watcher() i=4 2024-09-14T11:14:15.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.151+0000 7fb9ba92a800 20 add_watcher() i=5 2024-09-14T11:14:15.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.151+0000 7fb9ba92a800 20 add_watcher() i=6 2024-09-14T11:14:15.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.152+0000 7fb9ba92a800 20 add_watcher() i=7 2024-09-14T11:14:15.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.152+0000 7fb9ba92a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:15.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.153+0000 7fb86cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb9ba92a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb9ba92a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb9ba92a800 5 note: GC not initialized 2024-09-14T11:14:15.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb7e77fe640 20 reqs_thread_entry: start 2024-09-14T11:14:15.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb9ba92a800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:15.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb9ba92a800 20 Filter name: none 2024-09-14T11:14:15.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb7e57fa640 20 reqs_thread_entry: start 2024-09-14T11:14:15.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.154+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.155+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.155+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.155+0000 7fb9ba92a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.155+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.155+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.155+0000 7fb9ba92a800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.156+0000 7fb9ba92a800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:15.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.156+0000 7fb9ba92a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:15.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.157+0000 7fb86cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.159+0000 7fb9ba92a800 20 remove_watcher() i=0 2024-09-14T11:14:15.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.159+0000 7fb9ba92a800 2 removed watcher, disabling cache 2024-09-14T11:14:15.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.161+0000 7fb9ba92a800 20 remove_watcher() i=1 2024-09-14T11:14:15.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.162+0000 7fb9ba92a800 20 remove_watcher() i=2 2024-09-14T11:14:15.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.163+0000 7fb9ba92a800 20 remove_watcher() i=3 2024-09-14T11:14:15.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.163+0000 7fb9ba92a800 20 remove_watcher() i=4 2024-09-14T11:14:15.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.164+0000 7fb9ba92a800 20 remove_watcher() i=5 2024-09-14T11:14:15.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.165+0000 7fb9ba92a800 20 remove_watcher() i=6 2024-09-14T11:14:15.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.166+0000 7fb9ba92a800 20 remove_watcher() i=7 2024-09-14T11:14:15.176 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:15.176 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:15.176 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:15.176 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:15.177 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-14T11:14:15.214 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.215 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.256+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.257+0000 7f0a23b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.257+0000 7f0a23b25800 20 realm 2024-09-14T11:14:15.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.257+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.258+0000 7f0a23b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.258+0000 7f0a23b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:15.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.258+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.258+0000 7f0a23b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.258+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.259+0000 7f0a23b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.259+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.259+0000 7f0a23b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:15.258 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.259+0000 7f0a23b25800 20 searching for the correct realm 2024-09-14T11:14:15.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.262+0000 7f0a1ff34640 0 -- 172.21.15.2:0/4043123388 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f0a1402b410 msgr2=0x7f0a1402b890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.265+0000 7f0a1ef32640 0 -- 172.21.15.2:0/4043123388 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f0a1006d070 msgr2=0x7f0a1006e940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.270+0000 7f0a23b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.270+0000 7f0a23b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.270+0000 7f0a23b25800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.270+0000 7f0a23b25800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.270+0000 7f0a23b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.270+0000 7f0a23b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.270+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 zone default found 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 4 Realm: () 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 zonegroup default 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.271+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.272+0000 7f0a23b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.272+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.272+0000 7f0a23b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.272+0000 7f0a23b25800 20 started sync module instance, tier type = 2024-09-14T11:14:15.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.272+0000 7f0a23b25800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:15.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.281+0000 7f0a23b25800 20 add_watcher() i=0 2024-09-14T11:14:15.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.281+0000 7f0a23b25800 20 add_watcher() i=1 2024-09-14T11:14:15.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.281+0000 7f0a23b25800 20 add_watcher() i=2 2024-09-14T11:14:15.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.281+0000 7f0a23b25800 20 add_watcher() i=3 2024-09-14T11:14:15.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.281+0000 7f0a23b25800 20 add_watcher() i=4 2024-09-14T11:14:15.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.281+0000 7f0a23b25800 20 add_watcher() i=5 2024-09-14T11:14:15.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.281+0000 7f0a23b25800 20 add_watcher() i=6 2024-09-14T11:14:15.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.282+0000 7f0a23b25800 20 add_watcher() i=7 2024-09-14T11:14:15.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.282+0000 7f0a23b25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:15.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.283+0000 7f08d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f0a23b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f0a23b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f0a23b25800 5 note: GC not initialized 2024-09-14T11:14:15.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f08d4fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:15.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f0a23b25800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:15.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f0a23b25800 20 Filter name: none 2024-09-14T11:14:15.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f084e7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:15.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f0a23b25800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.284+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 : miss 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 info.flags=0x17 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 to cache LRU end 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:15.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.285+0000 7f0a23b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 2024-09-14T11:14:15.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.288+0000 7f0a23b25800 -1 Injecting error=-125 at location=set_target_layout 2024-09-14T11:14:15.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0a23b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 info.flags=0x17 2024-09-14T11:14:15.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0a23b25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 to cache LRU end 2024-09-14T11:14:15.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0a23b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:15.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0a23b25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23, ofs0, ns] 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0902ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94608649064544 notifier 6239 bl.length()=925 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0902ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 info.flags=0x17 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0902ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 to cache LRU end 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.289+0000 7f0902ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.290+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): orig_sources= new_sources= 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.290+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): potential sources added=[] removed=[] 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.290+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): orig_dests= new_dests= 2024-09-14T11:14:15.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.290+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): potential dests added=[] removed=[] 2024-09-14T11:14:15.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.292+0000 7f0a23b25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.23.1.0 2024-09-14T11:14:15.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.292+0000 7f0a23b25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.23.1.0 2024-09-14T11:14:15.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.292+0000 7f0a23b25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.23.1.1 2024-09-14T11:14:15.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.292+0000 7f0a23b25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.23.1.1 2024-09-14T11:14:15.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.292+0000 7f0a23b25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.23.0 2024-09-14T11:14:15.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.294+0000 7f0a23b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:15.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.294+0000 7f0a23b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 2024-09-14T11:14:15.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.295+0000 7f0a23b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 info.flags=0x17 2024-09-14T11:14:15.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.295+0000 7f0a23b25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 to cache LRU end 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.295+0000 7f0a23b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.295+0000 7f0a23b25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23, ofs0, ns] 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0902ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464288 cookie 94608649064544 notifier 6239 bl.length()=925 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0902ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 info.flags=0x17 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0902ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 to cache LRU end 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0902ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): orig_sources= new_sources= 2024-09-14T11:14:15.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): potential sources added=[] removed=[] 2024-09-14T11:14:15.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): orig_dests= new_dests= 2024-09-14T11:14:15.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.296+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): potential dests added=[] removed=[] 2024-09-14T11:14:15.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.297+0000 7f0a23b25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.23.0 2024-09-14T11:14:15.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.297+0000 7f0a23b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:15.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.297+0000 7f0a23b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 2024-09-14T11:14:15.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.298+0000 7f0a23b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 info.flags=0x17 2024-09-14T11:14:15.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.298+0000 7f0a23b25800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 to cache LRU end 2024-09-14T11:14:15.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.298+0000 7f0a23b25800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:15.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.298+0000 7f0a23b25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23, ofs0, ns] 2024-09-14T11:14:15.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f09027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464289 cookie 94608649064544 notifier 6239 bl.length()=893 2024-09-14T11:14:15.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f09027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 info.flags=0x17 2024-09-14T11:14:15.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f09027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 to cache LRU end 2024-09-14T11:14:15.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f09027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:15.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): orig_sources= new_sources= 2024-09-14T11:14:15.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): potential sources added=[] removed=[] 2024-09-14T11:14:15.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): orig_dests= new_dests= 2024-09-14T11:14:15.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.299+0000 7f0a23b25800 20 handle_bi_update(): bucket=:error-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.23]): potential dests added=[] removed=[] 2024-09-14T11:14:15.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.300+0000 7f0a23b25800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:14:15.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.302+0000 7f08d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.304+0000 7f0a23b25800 20 remove_watcher() i=0 2024-09-14T11:14:15.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.304+0000 7f0a23b25800 2 removed watcher, disabling cache 2024-09-14T11:14:15.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.305+0000 7f0a23b25800 20 remove_watcher() i=1 2024-09-14T11:14:15.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.306+0000 7f0a23b25800 20 remove_watcher() i=2 2024-09-14T11:14:15.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.307+0000 7f0a23b25800 20 remove_watcher() i=3 2024-09-14T11:14:15.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.308+0000 7f0a23b25800 20 remove_watcher() i=4 2024-09-14T11:14:15.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.309+0000 7f0a23b25800 20 remove_watcher() i=5 2024-09-14T11:14:15.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.310+0000 7f0a23b25800 20 remove_watcher() i=6 2024-09-14T11:14:15.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.310+0000 7f0a23b25800 20 remove_watcher() i=7 2024-09-14T11:14:15.321 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-14T11:14:15.351 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.351 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.391+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.393+0000 7f763b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.393+0000 7f763b698800 20 realm 2024-09-14T11:14:15.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.393+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.394+0000 7f763b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.394+0000 7f763b698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:15.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.394+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.394+0000 7f763b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.394+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.395+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.395+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.395+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:15.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.395+0000 7f763b698800 20 searching for the correct realm 2024-09-14T11:14:15.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.398+0000 7f7638981640 0 -- 172.21.15.2:0/1721835933 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f762c0e7910 msgr2=0x7f762c0693c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.401+0000 7f7639182640 0 -- 172.21.15.2:0/1721835933 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f7624060910 msgr2=0x7f7624035400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.607+0000 7f763b698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:15.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.607+0000 7f763b698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:15.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.607+0000 7f763b698800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:15.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.607+0000 7f763b698800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:15.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.607+0000 7f763b698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:15.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.607+0000 7f763b698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:15.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.608+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.608+0000 7f763b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.608+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.608+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.608+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 20 zone default found 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 4 Realm: () 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 20 zonegroup default 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.609+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.610+0000 7f763b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.610+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.610+0000 7f763b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.610+0000 7f763b698800 20 started sync module instance, tier type = 2024-09-14T11:14:15.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.610+0000 7f763b698800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:15.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.619+0000 7f763b698800 20 add_watcher() i=0 2024-09-14T11:14:15.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.619+0000 7f763b698800 20 add_watcher() i=1 2024-09-14T11:14:15.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.619+0000 7f763b698800 20 add_watcher() i=2 2024-09-14T11:14:15.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.619+0000 7f763b698800 20 add_watcher() i=3 2024-09-14T11:14:15.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.619+0000 7f763b698800 20 add_watcher() i=4 2024-09-14T11:14:15.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.619+0000 7f763b698800 20 add_watcher() i=5 2024-09-14T11:14:15.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.619+0000 7f763b698800 20 add_watcher() i=6 2024-09-14T11:14:15.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.620+0000 7f763b698800 20 add_watcher() i=7 2024-09-14T11:14:15.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.620+0000 7f763b698800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:15.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.621+0000 7f74ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f763b698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:15.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f763b698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:15.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f763b698800 5 note: GC not initialized 2024-09-14T11:14:15.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f74ee7e4640 20 reqs_thread_entry: start 2024-09-14T11:14:15.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f763b698800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:15.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f763b698800 20 Filter name: none 2024-09-14T11:14:15.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f745ffff640 20 reqs_thread_entry: start 2024-09-14T11:14:15.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.622+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.623+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:15.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.623+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.623+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:15.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.623+0000 7f763b698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:15.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.623+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.624+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:15.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.624+0000 7f763b698800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.624+0000 7f763b698800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:15.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.624+0000 7f763b698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:15.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.626+0000 7f74ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:15.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.628+0000 7f763b698800 20 remove_watcher() i=0 2024-09-14T11:14:15.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.628+0000 7f763b698800 2 removed watcher, disabling cache 2024-09-14T11:14:15.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.629+0000 7f763b698800 20 remove_watcher() i=1 2024-09-14T11:14:15.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.630+0000 7f763b698800 20 remove_watcher() i=2 2024-09-14T11:14:15.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.631+0000 7f763b698800 20 remove_watcher() i=3 2024-09-14T11:14:15.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.632+0000 7f763b698800 20 remove_watcher() i=4 2024-09-14T11:14:15.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.633+0000 7f763b698800 20 remove_watcher() i=5 2024-09-14T11:14:15.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.634+0000 7f763b698800 20 remove_watcher() i=6 2024-09-14T11:14:15.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.635+0000 7f763b698800 20 remove_watcher() i=7 2024-09-14T11:14:15.644 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:15.644 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:15.644 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.23 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:14:15.644 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:15.646 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.646 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.649 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.649 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.693 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.693 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.707 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-14T11:14:15.707 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:15.708 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.709 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.718 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.719 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.762 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.762 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.768 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.769 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.775 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.776 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.783 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.783 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.790 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.790 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.798 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.798 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.806 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.806 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.813 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.813 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.820 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.820 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.828 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.828 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.835 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.835 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.842 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.842 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.850 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.850 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.857 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.857 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.864 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.864 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.871 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.871 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.877 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.878 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.885 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.886 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.893 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.893 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.901 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:15.901 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:15.909 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:14:15.938 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:15.938 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:15.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.979+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.980+0000 7f3b2cd3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.980+0000 7f3b2cd3b800 20 realm 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.980+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.980+0000 7f3b2cd3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.980+0000 7f3b2cd3b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.980+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.981+0000 7f3b2cd3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:15.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.981+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.982+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:15.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.982+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:15.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.982+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:15.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.982+0000 7f3b2cd3b800 20 searching for the correct realm 2024-09-14T11:14:15.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.985+0000 7f3b23fff640 0 -- 172.21.15.2:0/2026641714 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f3b1c044040 msgr2=0x7f3b1c046950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:15.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:15.988+0000 7f3b28a25640 0 -- 172.21.15.2:0/2026641714 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3b1407d3a0 msgr2=0x7f3b140219e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:16.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:16.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:16.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.195+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:16.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 zone default found 2024-09-14T11:14:16.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 4 Realm: () 2024-09-14T11:14:16.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 zonegroup default 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 started sync module instance, tier type = 2024-09-14T11:14:16.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.196+0000 7f3b2cd3b800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:16.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.205+0000 7f3b2cd3b800 20 add_watcher() i=0 2024-09-14T11:14:16.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.205+0000 7f3b2cd3b800 20 add_watcher() i=1 2024-09-14T11:14:16.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.205+0000 7f3b2cd3b800 20 add_watcher() i=2 2024-09-14T11:14:16.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.205+0000 7f3b2cd3b800 20 add_watcher() i=3 2024-09-14T11:14:16.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.205+0000 7f3b2cd3b800 20 add_watcher() i=4 2024-09-14T11:14:16.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.205+0000 7f3b2cd3b800 20 add_watcher() i=5 2024-09-14T11:14:16.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.205+0000 7f3b2cd3b800 20 add_watcher() i=6 2024-09-14T11:14:16.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.206+0000 7f3b2cd3b800 20 add_watcher() i=7 2024-09-14T11:14:16.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.206+0000 7f3b2cd3b800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:16.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.208+0000 7f39defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:16.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.208+0000 7f3b2cd3b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:16.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.208+0000 7f3b2cd3b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:16.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.208+0000 7f3b2cd3b800 5 note: GC not initialized 2024-09-14T11:14:16.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.209+0000 7f39ddfe3640 20 reqs_thread_entry: start 2024-09-14T11:14:16.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.209+0000 7f3b2cd3b800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:16.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.209+0000 7f3b2cd3b800 20 Filter name: none 2024-09-14T11:14:16.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.209+0000 7f394f7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:16.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.209+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.210+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:16.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.210+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.210+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:16.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.210+0000 7f3b2cd3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:16.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.210+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.211+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:16.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.211+0000 7f3b2cd3b800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.211+0000 7f3b2cd3b800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:16.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.211+0000 7f3b2cd3b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:16.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.212+0000 7f39defe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:16.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.214+0000 7f3b2cd3b800 20 remove_watcher() i=0 2024-09-14T11:14:16.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.214+0000 7f3b2cd3b800 2 removed watcher, disabling cache 2024-09-14T11:14:16.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.215+0000 7f3b2cd3b800 20 remove_watcher() i=1 2024-09-14T11:14:16.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.216+0000 7f3b2cd3b800 20 remove_watcher() i=2 2024-09-14T11:14:16.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.218+0000 7f3b2cd3b800 20 remove_watcher() i=3 2024-09-14T11:14:16.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.219+0000 7f3b2cd3b800 20 remove_watcher() i=4 2024-09-14T11:14:16.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.220+0000 7f3b2cd3b800 20 remove_watcher() i=5 2024-09-14T11:14:16.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.221+0000 7f3b2cd3b800 20 remove_watcher() i=6 2024-09-14T11:14:16.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.222+0000 7f3b2cd3b800 20 remove_watcher() i=7 2024-09-14T11:14:16.231 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.231 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:16.231 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:16.231 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.233 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-14T11:14:16.268 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:16.268 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:16.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.308+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 20 realm 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.311+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:16.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.311+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.312+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:16.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.312+0000 7f478972f800 20 searching for the correct realm 2024-09-14T11:14:16.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.315+0000 7f4784c75640 0 -- 172.21.15.2:0/3824493808 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f477802b470 msgr2=0x7f477802b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:16.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.318+0000 7f4785476640 0 -- 172.21.15.2:0/3824493808 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f477c0de000 msgr2=0x7f477c0a9440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.926+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 zone default found 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 4 Realm: () 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 zonegroup default 2024-09-14T11:14:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.928+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.928+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.928+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.928+0000 7f478972f800 20 started sync module instance, tier type = 2024-09-14T11:14:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.928+0000 7f478972f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:16.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=0 2024-09-14T11:14:16.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=1 2024-09-14T11:14:16.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=2 2024-09-14T11:14:16.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=3 2024-09-14T11:14:16.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=4 2024-09-14T11:14:16.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=5 2024-09-14T11:14:16.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=6 2024-09-14T11:14:16.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.939+0000 7f478972f800 20 add_watcher() i=7 2024-09-14T11:14:16.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.939+0000 7f478972f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:16.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.941+0000 7f463b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:16.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.941+0000 7f478972f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:16.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.941+0000 7f478972f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:16.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.941+0000 7f478972f800 5 note: GC not initialized 2024-09-14T11:14:16.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.941+0000 7f463a7e4640 20 reqs_thread_entry: start 2024-09-14T11:14:16.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:16.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 20 Filter name: none 2024-09-14T11:14:16.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f45abfff640 20 reqs_thread_entry: start 2024-09-14T11:14:16.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:14:16.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:16.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:14:16.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:14:16.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 : miss 2024-09-14T11:14:16.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.942+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:16.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.943+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:16.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.943+0000 7f478972f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:16.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.943+0000 7f478972f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:16.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.943+0000 7f478972f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:16.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.943+0000 7f478972f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:16.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.943+0000 7f478972f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 2024-09-14T11:14:16.943 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f478972f800 time 2024-09-14T11:14:16.946508+0000 2024-09-14T11:14:16.943 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:16.944 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f478af8c76a] 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.946+0000 7f478972f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f478972f800 time 2024-09-14T11:14:16.946508+0000 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:16.945 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f478af8c76a] 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:16.946 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.947 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:14:16.947 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f478972f800 thread_name:radosgw-admin 2024-09-14T11:14:16.961 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4789c3e6f0] 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4789c8b99c] 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f478af8c7c4] 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:16.962 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:16.947+0000 7f478972f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f478972f800 thread_name:radosgw-admin 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4789c3e6f0] 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4789c8b99c] 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:16.963 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f478af8c7c4] 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:16.964 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: dump: 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.965 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:14:16.291+0000 7f478972f800 5 monclient: authenticate success, global_id 6278 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:14:16.291+0000 7f478972f800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:14:16.291+0000 7f478972f800 4 set_mon_vals no callback set 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: shutdown 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:14:16.292+0000 7f478972f800 5 asok(0x55b316c61270) unregister_commands rotate-key 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:14:16.292+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:16.966 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding auth protocol: cephx 2024-09-14T11:14:16.967 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding auth protocol: cephx 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding auth protocol: cephx 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:16.968 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:14:16.292+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: starting msgr at 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: starting objecter 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:14:16.292+0000 7f478972f800 5 asok(0x55b316c61270) register_command objecter_requests hook 0x55b316eb33f0 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: setting wanted keys 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: calling monclient init 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding auth protocol: cephx 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding auth protocol: cephx 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding auth protocol: cephx 2024-09-14T11:14:16.969 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:16.970 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:14:16.293+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:14:16.293+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:14:16.293+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key hook 0x55b316e81818 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316d0c7a0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316dc48d0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316dca9c0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.971 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.845469s 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316dca9c0 auth_method 0 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316dc48d0 auth_method 0 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316d0c7a0 auth_method 0 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.972 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.973 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:14:16.293+0000 7f4784c75640 1 monclient: found mon.noname-c 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: dump: 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:16.974 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: _finish_auth 0 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: _check_auth_tickets 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: dump: 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:16.975 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:14:16.294+0000 7f478972f800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:16.976 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:14:16.294+0000 7f4673606640 4 set_mon_vals no callback set 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:14:16.294+0000 7f478972f800 1 librados: init done 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:14:16.296+0000 7f4671e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:14:16.296+0000 7f4671e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:14:16.296+0000 7f4671e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:14:16.296+0000 7f4785476640 10 monclient: get_auth_request con 0x7f466c077230 auth_method 0 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:14:16.296+0000 7f4785c77640 10 monclient: get_auth_request con 0x55b316ea9ef0 auth_method 0 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:14:16.297+0000 7f4785476640 10 monclient: get_auth_request con 0x55b316ecd020 auth_method 0 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:14:16.298+0000 7f4784c75640 10 monclient: get_auth_request con 0x55b316ed2100 auth_method 0 2024-09-14T11:14:16.977 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:14:16.299+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:14:16.299+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:14:16.299+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:16.978 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding auth protocol: cephx 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding auth protocol: cephx 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding auth protocol: cephx 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:16.979 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:14:16.299+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:14:16.299+0000 7f478972f800 5 asok(0x55b316c61270) register_command objecter_requests cmddesc objecter_requests hook 0x55b316ed9770 EEXIST 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:14:16.299+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding auth protocol: cephx 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding auth protocol: cephx 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding auth protocol: cephx 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:16.980 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:14:16.300+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:14:16.300+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.981 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:14:16.300+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key cmddesc rotate-key hook 0x55b316ed5280 EEXIST 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316efda90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316efde70 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316efc7a0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.852320s 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316efc7a0 auth_method 0 2024-09-14T11:14:16.982 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316efde70 auth_method 0 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.983 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316efda90 auth_method 0 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6567 payload 824 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:14:16.300+0000 7f4784c75640 1 monclient: found mon.noname-a 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:14:16.984 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: dump: 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:16.985 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: _finish_auth 0 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: _check_auth_tickets 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: dump: 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.986 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:14:16.301+0000 7f478972f800 5 monclient: authenticate success, global_id 6567 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:14:16.301+0000 7f4786478640 4 set_mon_vals no callback set 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:14:16.302+0000 7f466affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:16.987 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:14:16.302+0000 7f466affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:14:16.302+0000 7f466affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:14:16.303+0000 7f4785476640 10 monclient: get_auth_request con 0x7f4660077140 auth_method 0 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: get_monmap_and_config 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:14:16.303+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:16.988 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding auth protocol: cephx 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding auth protocol: cephx 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding auth protocol: cephx 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:16.989 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:14:16.303+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding auth protocol: cephx 2024-09-14T11:14:16.990 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding auth protocol: cephx 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding auth protocol: cephx 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:16.991 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:14:16.303+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:14:16.304+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:14:16.304+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key cmddesc rotate-key hook 0x7ffccd217ee8 EEXIST 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316f51ce0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316f42630 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316f4d110 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.992 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.856258s 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316f42630 auth_method 0 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316f51ce0 auth_method 0 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.993 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316f4d110 auth_method 0 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.994 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6287 payload 274 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:14:16.304+0000 7f4784c75640 1 monclient: found mon.noname-c 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:16.995 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: dump: 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.996 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: _finish_auth 0 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:14:16.304+0000 7f478972f800 5 monclient: authenticate success, global_id 6287 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:14:16.304+0000 7f478972f800 4 set_mon_vals no callback set 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: dump: 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:16.997 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:14:16.305+0000 7f478972f800 10 monclient: shutdown 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:14:16.305+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:14:16.305+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:14:16.305+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:16.998 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding auth protocol: cephx 2024-09-14T11:14:16.999 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding auth protocol: cephx 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding auth protocol: cephx 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.000 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:14:16.305+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:14:16.305+0000 7f478972f800 1 librados: starting msgr at 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:14:16.305+0000 7f478972f800 1 librados: starting objecter 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:14:16.305+0000 7f478972f800 5 asok(0x55b316c61270) register_command objecter_requests cmddesc objecter_requests hook 0x55b316f4d4f0 EEXIST 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:14:16.306+0000 7f478972f800 1 librados: setting wanted keys 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:14:16.306+0000 7f478972f800 1 librados: calling monclient init 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding auth protocol: cephx 2024-09-14T11:14:17.001 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding auth protocol: cephx 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding auth protocol: cephx 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.002 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:14:16.306+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:14:16.306+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:14:16.306+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key cmddesc rotate-key hook 0x55b316f12498 EEXIST 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316f42630 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316f4d110 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316f51ce0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.003 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.858591s 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316f4d110 auth_method 0 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316f42630 auth_method 0 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.004 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316f51ce0 auth_method 0 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.005 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:14:16.306+0000 7f4784c75640 1 monclient: found mon.noname-c 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: dump: 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.006 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: _finish_auth 0 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:17.007 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.008 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:17.008 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: dump: 2024-09-14T11:14:17.008 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.008 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.008 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.008 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.008 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:14:16.307+0000 7f478972f800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:14:16.307+0000 7f4668ff9640 4 set_mon_vals no callback set 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.009 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:14:16.307+0000 7f478972f800 1 librados: init done 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:14:16.307+0000 7f478972f800 5 asok(0x55b316c61270) register_command cr dump hook 0x7f477c0a41a8 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:14:16.308+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:14:16.309+0000 7f4656ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:14:16.309+0000 7f4656ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:14:16.309+0000 7f4656ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:14:16.309+0000 7f4785476640 10 monclient: get_auth_request con 0x7f4650077230 auth_method 0 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:14:16.309+0000 7f4785c77640 10 monclient: get_auth_request con 0x55b316f6b7e0 auth_method 0 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:14:16.310+0000 7f478972f800 20 realm 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.010 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:14:16.310+0000 7f478972f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:14:16.311+0000 7f4785476640 10 monclient: get_auth_request con 0x55b316f6fb40 auth_method 0 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:14:16.311+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:14:16.311+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:14:16.312+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:14:16.312+0000 7f478972f800 20 searching for the correct realm 2024-09-14T11:14:17.011 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:14:16.312+0000 7f4784c75640 10 monclient: get_auth_request con 0x55b316f74ca0 auth_method 0 2024-09-14T11:14:17.012 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:14:16.313+0000 7f4785c77640 10 monclient: get_auth_request con 0x7f477c08d030 auth_method 0 2024-09-14T11:14:17.013 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:14:16.313+0000 7f4785476640 10 monclient: get_auth_request con 0x7f4780022040 auth_method 0 2024-09-14T11:14:17.013 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:14:16.314+0000 7f4784c75640 10 monclient: get_auth_request con 0x7f477802b470 auth_method 0 2024-09-14T11:14:17.013 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:14:16.315+0000 7f4784c75640 0 -- 172.21.15.2:0/3824493808 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f477802b470 msgr2=0x7f477802b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:17.013 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:14:16.315+0000 7f4656ffd640 1 client.6290.objecter ms_handle_reset 0x7f477802b470 session 0x7f477802ce40 osd.4 2024-09-14T11:14:17.013 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:14:16.315+0000 7f4656ffd640 10 monclient: _renew_subs 2024-09-14T11:14:17.013 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:14:16.315+0000 7f4656ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.013 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:14:16.315+0000 7f4784c75640 10 monclient: get_auth_request con 0x7f46500870d0 auth_method 0 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:14:16.316+0000 7f4785c77640 10 monclient: get_auth_request con 0x7f477c007390 auth_method 0 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:14:16.318+0000 7f4785476640 10 monclient: get_auth_request con 0x7f477c0de000 auth_method 0 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:14:16.318+0000 7f4785476640 0 -- 172.21.15.2:0/3824493808 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f477c0de000 msgr2=0x7f477c0a9440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:14:16.520+0000 7f4785476640 10 monclient: get_auth_request con 0x7f477c0de000 auth_method 0 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:14:16.921+0000 7f4785476640 10 monclient: get_auth_request con 0x7f477c0de000 auth_method 0 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:17.014 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:14:16.926+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:14:16.926+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:14:16.927+0000 7f478972f800 20 zone default found 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:14:16.927+0000 7f478972f800 4 Realm: () 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:14:16.927+0000 7f478972f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:14:16.927+0000 7f478972f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:14:16.927+0000 7f478972f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:14:16.927+0000 7f478972f800 20 zonegroup default 2024-09-14T11:14:17.015 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:14:16.928+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:14:16.928+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:14:16.928+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:14:16.928+0000 7f478972f800 20 started sync module instance, tier type = 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:14:16.928+0000 7f478972f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=0 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=1 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=2 2024-09-14T11:14:17.016 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=3 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=4 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=5 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=6 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:14:16.939+0000 7f478972f800 20 add_watcher() i=7 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:14:16.939+0000 7f478972f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding auth protocol: cephx 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding auth protocol: cephx 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding auth protocol: cephx 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.017 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:14:16.941+0000 7f463b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:14:16.941+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.018 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:14:16.941+0000 7f478972f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:14:16.941+0000 7f478972f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache list hook 0x55b316f45ca0 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache inspect hook 0x55b316f45ca0 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache erase hook 0x55b316f45ca0 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache zap hook 0x55b316f45ca0 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:14:16.941+0000 7f478972f800 5 note: GC not initialized 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:14:16.941+0000 7f463a7e4640 20 reqs_thread_entry: start 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace show hook 0x7f477c0b1030 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace history hook 0x7f477c0b1030 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace active hook 0x7f477c0b1030 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace active_short hook 0x7f477c0b1030 2024-09-14T11:14:17.019 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:14:16.942+0000 7f478972f800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:14:16.942+0000 7f478972f800 20 Filter name: none 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:14:16.942+0000 7f45abfff640 20 reqs_thread_entry: start 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:14:16.942+0000 7f478972f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:14:16.942+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:14:16.942+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:14:16.942+0000 7f478972f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:14:16.942+0000 7f478972f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:14:16.942+0000 7f478972f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 : miss 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:14:16.942+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:14:16.943+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:14:16.943+0000 7f478972f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:14:16.943+0000 7f478972f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:17.020 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:14:16.943+0000 7f478972f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:14:16.943+0000 7f478972f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:14:16.943+0000 7f478972f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:14:16.946+0000 7f478972f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f478972f800 time 2024-09-14T11:14:16.946508+0000 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f478af8c76a] 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:17.021 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:14:16.947+0000 7f478972f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f478972f800 thread_name:radosgw-admin 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.022 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4789c3e6f0] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4789c8b99c] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f478af8c7c4] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:17.023 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:14:17.024 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:17.025 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:14:17.026 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:17.027 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:14:17.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:14:17.029 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:17.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:17.031 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr: 7f45abfff640 / http_manager 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr: 7f463a7e4640 / http_manager 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr: 7f463b7e6640 / rgw_dt_lg_renew 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4656ffd640 / ms_dispatch 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4668ff9640 / io_context_pool 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr: 7f466affd640 / ms_dispatch 2024-09-14T11:14:17.032 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4671e03640 / ms_dispatch 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4673606640 / io_context_pool 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4784c75640 / msgr-worker-2 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4785476640 / msgr-worker-1 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4785c77640 / msgr-worker-0 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4786478640 / io_context_pool 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: 7f478972f800 / radosgw-admin 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.97311.log 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:14:17.033 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:14:16.291+0000 7f4673606640 10 monclient: dump: 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.034 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:14:16.291+0000 7f478972f800 5 monclient: authenticate success, global_id 6278 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:14:16.291+0000 7f478972f800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:14:16.291+0000 7f478972f800 4 set_mon_vals no callback set 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: shutdown 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:14:16.292+0000 7f478972f800 5 asok(0x55b316c61270) unregister_commands rotate-key 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:14:16.292+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:17.035 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding auth protocol: cephx 2024-09-14T11:14:17.036 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding auth protocol: cephx 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding auth protocol: cephx 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:17.037 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: crc 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e87380) adding con mode: secure 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:14:16.292+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: starting msgr at 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: starting objecter 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:14:16.292+0000 7f478972f800 5 asok(0x55b316c61270) register_command objecter_requests hook 0x55b316eb33f0 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: setting wanted keys 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:14:16.292+0000 7f478972f800 1 librados: calling monclient init 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:14:16.292+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding auth protocol: cephx 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding auth protocol: cephx 2024-09-14T11:14:17.038 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding auth protocol: cephx 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:17.039 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: crc 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:14:16.292+0000 7f478972f800 5 AuthRegistry(0x55b316e816d0) adding con mode: secure 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:14:16.293+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:14:16.293+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:14:16.293+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key hook 0x55b316e81818 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316d0c7a0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316dc48d0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316dca9c0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.040 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:14:16.293+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.845469s 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316dca9c0 auth_method 0 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316dc48d0 auth_method 0 2024-09-14T11:14:17.041 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316d0c7a0 auth_method 0 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:14:16.293+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.042 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:14:16.293+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6281 payload 824 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:14:16.293+0000 7f4784c75640 1 monclient: found mon.noname-c 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:14:16.293+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.043 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: dump: 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.044 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: _finish_auth 0 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: _check_auth_tickets 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:14:16.294+0000 7f4671e03640 10 monclient: dump: 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.045 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:14:16.294+0000 7f478972f800 5 monclient: authenticate success, global_id 6281 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:14:16.294+0000 7f4673606640 4 set_mon_vals no callback set 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.046 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:14:16.294+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:14:16.294+0000 7f478972f800 1 librados: init done 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:14:16.296+0000 7f4671e03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:14:16.296+0000 7f4671e03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:14:16.296+0000 7f4671e03640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:14:16.296+0000 7f4785476640 10 monclient: get_auth_request con 0x7f466c077230 auth_method 0 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:14:16.296+0000 7f4785c77640 10 monclient: get_auth_request con 0x55b316ea9ef0 auth_method 0 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:14:16.297+0000 7f4785476640 10 monclient: get_auth_request con 0x55b316ecd020 auth_method 0 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:14:16.298+0000 7f4784c75640 10 monclient: get_auth_request con 0x55b316ed2100 auth_method 0 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:14:16.299+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:14:16.299+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:14:16.299+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:17.047 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding auth protocol: cephx 2024-09-14T11:14:17.048 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding auth protocol: cephx 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding auth protocol: cephx 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:17.049 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: crc 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed6350) adding con mode: secure 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:14:16.299+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:14:16.299+0000 7f478972f800 5 asok(0x55b316c61270) register_command objecter_requests cmddesc objecter_requests hook 0x55b316ed9770 EEXIST 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:14:16.299+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding auth protocol: cephx 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding auth protocol: cephx 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding auth protocol: cephx 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:17.050 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: crc 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:14:16.299+0000 7f478972f800 5 AuthRegistry(0x55b316ed5138) adding con mode: secure 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:14:16.300+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:14:16.300+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.051 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:14:16.300+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key cmddesc rotate-key hook 0x55b316ed5280 EEXIST 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316efda90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316efde70 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316efc7a0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:17.052 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:14:16.300+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.852320s 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316efc7a0 auth_method 0 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316efde70 auth_method 0 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.053 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:14:16.300+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316efda90 auth_method 0 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.054 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:14:16.300+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6567 payload 824 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:14:16.300+0000 7f4784c75640 1 monclient: found mon.noname-a 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:14:16.300+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: dump: 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.055 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:14:16.300+0000 7f466affd640 10 monclient: _finish_auth 0 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: _check_auth_tickets 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:14:16.301+0000 7f466affd640 10 monclient: dump: 2024-09-14T11:14:17.056 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:14:16.301+0000 7f478972f800 5 monclient: authenticate success, global_id 6567 2024-09-14T11:14:17.057 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:14:16.301+0000 7f4786478640 4 set_mon_vals no callback set 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:14:16.301+0000 7f478972f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:14:16.302+0000 7f466affd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:14:16.302+0000 7f466affd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:14:16.302+0000 7f466affd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:14:16.303+0000 7f4785476640 10 monclient: get_auth_request con 0x7f4660077140 auth_method 0 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: get_monmap_and_config 2024-09-14T11:14:17.058 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:14:16.303+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:17.059 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding auth protocol: cephx 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding auth protocol: cephx 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding auth protocol: cephx 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:17.060 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:17.061 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:17.061 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:17.061 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: crc 2024-09-14T11:14:17.061 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x55b316f1d6c0) adding con mode: secure 2024-09-14T11:14:17.061 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:14:16.303+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.061 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:14:16.303+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:17.061 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding auth protocol: cephx 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding auth protocol: cephx 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding auth protocol: cephx 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:17.062 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: crc 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:14:16.303+0000 7f478972f800 5 AuthRegistry(0x7ffccd217da0) adding con mode: secure 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:14:16.303+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:14:16.304+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:14:16.304+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key cmddesc rotate-key hook 0x7ffccd217ee8 EEXIST 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316f51ce0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316f42630 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:17.063 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316f4d110 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.856258s 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316f42630 auth_method 0 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.064 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316f51ce0 auth_method 0 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316f4d110 auth_method 0 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.065 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:14:16.304+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:14:16.304+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6287 payload 274 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:14:16.304+0000 7f4784c75640 1 monclient: found mon.noname-c 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:14:16.304+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.066 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: dump: 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.067 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: _finish_auth 0 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:14:16.304+0000 7f478972f800 5 monclient: authenticate success, global_id 6287 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:14:16.304+0000 7f478972f800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:14:16.304+0000 7f478972f800 4 set_mon_vals no callback set 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:14:16.304+0000 7f4668ff9640 10 monclient: dump: 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.068 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:14:16.305+0000 7f478972f800 10 monclient: shutdown 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:14:16.305+0000 7f478972f800 10 monclient: build_initial_monmap 2024-09-14T11:14:17.069 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:14:16.305+0000 7f478972f800 1 build_initial for_mkfs: 0 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:14:16.305+0000 7f478972f800 10 monclient: monmap: 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:17.070 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding auth protocol: cephx 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding auth protocol: cephx 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding auth protocol: cephx 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.071 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: crc 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:14:16.305+0000 7f478972f800 5 AuthRegistry(0x55b316f21240) adding con mode: secure 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:14:16.305+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:14:16.305+0000 7f478972f800 1 librados: starting msgr at 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:14:16.305+0000 7f478972f800 1 librados: starting objecter 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:14:16.305+0000 7f478972f800 5 asok(0x55b316c61270) register_command objecter_requests cmddesc objecter_requests hook 0x55b316f4d4f0 EEXIST 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:14:16.306+0000 7f478972f800 1 librados: setting wanted keys 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:14:16.306+0000 7f478972f800 1 librados: calling monclient init 2024-09-14T11:14:17.072 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient: init 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding auth protocol: cephx 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding auth protocol: cephx 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding auth protocol: cephx 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.073 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: crc 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:14:16.306+0000 7f478972f800 5 AuthRegistry(0x55b316f12350) adding con mode: secure 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:14:16.306+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:14:16.306+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:14:16.306+0000 7f478972f800 5 asok(0x55b316c61270) register_command rotate-key cmddesc rotate-key hook 0x55b316f12498 EEXIST 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): picked mon.noname-a con 0x55b316f42630 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): picked mon.noname-c con 0x55b316f4d110 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): picked mon.noname-b con 0x55b316f51ce0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:17.074 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:14:16.306+0000 7f478972f800 10 monclient(hunting): authenticate will time out at 1882.858591s 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): get_auth_request con 0x55b316f4d110 auth_method 0 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): get_auth_request con 0x55b316f42630 auth_method 0 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.075 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:14:16.306+0000 7f4785476640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): get_auth_request con 0x55b316f51ce0 auth_method 0 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:17.076 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:14:16.306+0000 7f4785c77640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient(hunting): handle_auth_done global_id 6290 payload 824 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient: _finish_hunting 0 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:14:16.306+0000 7f4784c75640 1 monclient: found mon.noname-c 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:14:16.306+0000 7f4784c75640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: dump: 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.077 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: _finish_auth 0 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:17.078 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:14:16.307+0000 7f4656ffd640 10 monclient: dump: 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.079 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:14:16.307+0000 7f478972f800 5 monclient: authenticate success, global_id 6290 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:14:16.307+0000 7f4668ff9640 4 set_mon_vals no callback set 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _renew_subs 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:14:16.307+0000 7f478972f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:14:16.307+0000 7f478972f800 1 librados: init done 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:14:16.307+0000 7f478972f800 5 asok(0x55b316c61270) register_command cr dump hook 0x7f477c0a41a8 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:14:16.308+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.080 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:14:16.309+0000 7f4656ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:14:16.309+0000 7f4656ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:14:16.309+0000 7f4656ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:14:16.309+0000 7f4785476640 10 monclient: get_auth_request con 0x7f4650077230 auth_method 0 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:14:16.309+0000 7f4785c77640 10 monclient: get_auth_request con 0x55b316f6b7e0 auth_method 0 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:14:16.310+0000 7f478972f800 20 realm 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:14:16.310+0000 7f478972f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.081 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:14:16.310+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:14:16.311+0000 7f4785476640 10 monclient: get_auth_request con 0x55b316f6fb40 auth_method 0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:14:16.311+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:14:16.311+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:14:16.312+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:14:16.312+0000 7f478972f800 20 searching for the correct realm 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:14:16.312+0000 7f4784c75640 10 monclient: get_auth_request con 0x55b316f74ca0 auth_method 0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:14:16.313+0000 7f4785c77640 10 monclient: get_auth_request con 0x7f477c08d030 auth_method 0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:14:16.313+0000 7f4785476640 10 monclient: get_auth_request con 0x7f4780022040 auth_method 0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:14:16.314+0000 7f4784c75640 10 monclient: get_auth_request con 0x7f477802b470 auth_method 0 2024-09-14T11:14:17.082 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:14:16.315+0000 7f4784c75640 0 -- 172.21.15.2:0/3824493808 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f477802b470 msgr2=0x7f477802b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:14:16.315+0000 7f4656ffd640 1 client.6290.objecter ms_handle_reset 0x7f477802b470 session 0x7f477802ce40 osd.4 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:14:16.315+0000 7f4656ffd640 10 monclient: _renew_subs 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:14:16.315+0000 7f4656ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:14:16.315+0000 7f4784c75640 10 monclient: get_auth_request con 0x7f46500870d0 auth_method 0 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:14:16.316+0000 7f4785c77640 10 monclient: get_auth_request con 0x7f477c007390 auth_method 0 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:14:16.318+0000 7f4785476640 10 monclient: get_auth_request con 0x7f477c0de000 auth_method 0 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:14:16.318+0000 7f4785476640 0 -- 172.21.15.2:0/3824493808 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f477c0de000 msgr2=0x7f477c0a9440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:14:16.520+0000 7f4785476640 10 monclient: get_auth_request con 0x7f477c0de000 auth_method 0 2024-09-14T11:14:17.083 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:14:16.921+0000 7f4785476640 10 monclient: get_auth_request con 0x7f477c0de000 auth_method 0 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:14:16.926+0000 7f478972f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:14:16.926+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:14:16.926+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.084 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:14:16.927+0000 7f478972f800 20 zone default found 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:14:16.927+0000 7f478972f800 4 Realm: () 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:14:16.927+0000 7f478972f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:14:16.927+0000 7f478972f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:14:16.927+0000 7f478972f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:14:16.927+0000 7f478972f800 20 zonegroup default 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:14:16.927+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:14:16.928+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.085 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:14:16.928+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:14:16.928+0000 7f478972f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:14:16.928+0000 7f478972f800 20 started sync module instance, tier type = 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:14:16.928+0000 7f478972f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=0 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=1 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=2 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=3 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=4 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=5 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:14:16.938+0000 7f478972f800 20 add_watcher() i=6 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:14:16.939+0000 7f478972f800 20 add_watcher() i=7 2024-09-14T11:14:17.086 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:14:16.939+0000 7f478972f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding auth protocol: cephx 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding auth protocol: cephx 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding auth protocol: cephx 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.087 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: crc 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:14:16.941+0000 7f478972f800 5 AuthRegistry(0x7ffccd218280) adding con mode: secure 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:14:16.941+0000 7f463b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:14:16.941+0000 7f478972f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:14:16.941+0000 7f478972f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:14:16.941+0000 7f478972f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache list hook 0x55b316f45ca0 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache inspect hook 0x55b316f45ca0 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache erase hook 0x55b316f45ca0 2024-09-14T11:14:17.088 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:14:16.941+0000 7f478972f800 5 asok(0x55b316c61270) register_command cache zap hook 0x55b316f45ca0 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:14:16.941+0000 7f478972f800 5 note: GC not initialized 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:14:16.941+0000 7f463a7e4640 20 reqs_thread_entry: start 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace show hook 0x7f477c0b1030 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace history hook 0x7f477c0b1030 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace active hook 0x7f477c0b1030 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:14:16.942+0000 7f478972f800 5 asok(0x55b316c61270) register_command sync trace active_short hook 0x7f477c0b1030 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:14:16.942+0000 7f478972f800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:14:16.942+0000 7f478972f800 20 Filter name: none 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:14:16.942+0000 7f45abfff640 20 reqs_thread_entry: start 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:14:16.942+0000 7f478972f800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:14:17.089 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:14:16.942+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:14:16.942+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:14:16.942+0000 7f478972f800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:14:16.942+0000 7f478972f800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:14:16.942+0000 7f478972f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 : miss 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:14:16.942+0000 7f478972f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:14:16.943+0000 7f478972f800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:14:16.943+0000 7f478972f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:14:16.943+0000 7f478972f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:14:16.943+0000 7f478972f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:14:16.943+0000 7f478972f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:14:16.943+0000 7f478972f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 2024-09-14T11:14:17.090 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:14:16.946+0000 7f478972f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f478972f800 time 2024-09-14T11:14:16.946508+0000 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f478af8c76a] 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:17.091 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:14:16.947+0000 7f478972f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f478972f800 thread_name:radosgw-admin 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f4789c3e6f0] 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f4789c8b99c] 2024-09-14T11:14:17.092 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f478af8c7c4] 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f478af8c928] 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b3156bb0b1] 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd88418) [0x55b315bce418] 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b3156caefd] 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f4789c29590] 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:17.093 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:17.094 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:17.095 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:14:17.096 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:17.097 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:14:17.098 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:14:17.099 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:17.100 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:14:17.101 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 7f45abfff640 / http_manager 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 7f463a7e4640 / http_manager 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 7f463b7e6640 / rgw_dt_lg_renew 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4656ffd640 / ms_dispatch 2024-09-14T11:14:17.102 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4668ff9640 / io_context_pool 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f466affd640 / ms_dispatch 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4671e03640 / ms_dispatch 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4673606640 / io_context_pool 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4784c75640 / msgr-worker-2 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4785476640 / msgr-worker-1 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4785c77640 / msgr-worker-0 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f4786478640 / io_context_pool 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: 7f478972f800 / radosgw-admin 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:14:16.948214Z_1bd5359a-4f15-49f6-92d7-e0fdfd0a022a/log 2024-09-14T11:14:17.103 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:14:17.104 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:14:17.109 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:17.109 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:17.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.028+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.030+0000 7f5cd7d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.030+0000 7f5cd7d39800 20 realm 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.030+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.030+0000 7f5cd7d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.030+0000 7f5cd7d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.030+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.031+0000 7f5cd7d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.031+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.032+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.032+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.032+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.032+0000 7f5cd7d39800 20 searching for the correct realm 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.035+0000 7f5cd31c6640 0 -- 172.21.15.2:0/720400359 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x560a0f37d840 msgr2=0x560a0f37fc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.039+0000 7f5cd39c7640 0 -- 172.21.15.2:0/720400359 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f5cc8061400 msgr2=0x7f5cc8061880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:17.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.043+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 zone default found 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 4 Realm: () 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 zonegroup default 2024-09-14T11:14:17.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.044+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.045+0000 7f5cd7d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.045+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.045+0000 7f5cd7d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.045+0000 7f5cd7d39800 20 started sync module instance, tier type = 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.045+0000 7f5cd7d39800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.054+0000 7f5cd7d39800 20 add_watcher() i=0 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.054+0000 7f5cd7d39800 20 add_watcher() i=1 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.054+0000 7f5cd7d39800 20 add_watcher() i=2 2024-09-14T11:14:17.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.054+0000 7f5cd7d39800 20 add_watcher() i=3 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.054+0000 7f5cd7d39800 20 add_watcher() i=4 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.054+0000 7f5cd7d39800 20 add_watcher() i=5 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.054+0000 7f5cd7d39800 20 add_watcher() i=6 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.055+0000 7f5cd7d39800 20 add_watcher() i=7 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.055+0000 7f5cd7d39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.057+0000 7f5b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.057+0000 7f5cd7d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.057+0000 7f5cd7d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.057+0000 7f5cd7d39800 5 note: GC not initialized 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.057+0000 7f5b88fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:17.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.057+0000 7f5cd7d39800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.057+0000 7f5cd7d39800 20 Filter name: none 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.058+0000 7f5b027fc640 20 reqs_thread_entry: start 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.058+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.058+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.058+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.059+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.059+0000 7f5cd7d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.059+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.059+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.059+0000 7f5cd7d39800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.060+0000 7f5cd7d39800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.060+0000 7f5cd7d39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.061+0000 7f5b89fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:17.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.063+0000 7f5cd7d39800 20 remove_watcher() i=0 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.063+0000 7f5cd7d39800 2 removed watcher, disabling cache 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.064+0000 7f5cd7d39800 20 remove_watcher() i=1 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.065+0000 7f5cd7d39800 20 remove_watcher() i=2 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.066+0000 7f5cd7d39800 20 remove_watcher() i=3 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.067+0000 7f5cd7d39800 20 remove_watcher() i=4 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.068+0000 7f5cd7d39800 20 remove_watcher() i=5 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.069+0000 7f5cd7d39800 20 remove_watcher() i=6 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.070+0000 7f5cd7d39800 20 remove_watcher() i=7 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:17.116 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:17.117 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:17.117 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:17.117 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:17.117 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:17.117 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:17.132 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:14:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:17.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.205+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.206+0000 7f42ef20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.206+0000 7f42ef20e800 20 realm 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.206+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.207+0000 7f42ef20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.207+0000 7f42ef20e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.207+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.207+0000 7f42ef20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.207+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.208+0000 7f42ef20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.208+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.208+0000 7f42ef20e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.208+0000 7f42ef20e800 20 searching for the correct realm 2024-09-14T11:14:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.211+0000 7f42ea16a640 0 -- 172.21.15.2:0/3946180011 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x556633f21a80 msgr2=0x556633f23f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:17.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.214+0000 7f42ea96b640 0 -- 172.21.15.2:0/3946180011 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f42d40c2b80 msgr2=0x7f42d40e50b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:17.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:17.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:17.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.219+0000 7f42ef20e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:17.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 zone default found 2024-09-14T11:14:17.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 4 Realm: () 2024-09-14T11:14:17.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 zonegroup default 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 started sync module instance, tier type = 2024-09-14T11:14:17.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.220+0000 7f42ef20e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:17.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.229+0000 7f42ef20e800 20 add_watcher() i=0 2024-09-14T11:14:17.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.229+0000 7f42ef20e800 20 add_watcher() i=1 2024-09-14T11:14:17.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.229+0000 7f42ef20e800 20 add_watcher() i=2 2024-09-14T11:14:17.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.229+0000 7f42ef20e800 20 add_watcher() i=3 2024-09-14T11:14:17.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.229+0000 7f42ef20e800 20 add_watcher() i=4 2024-09-14T11:14:17.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.229+0000 7f42ef20e800 20 add_watcher() i=5 2024-09-14T11:14:17.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.229+0000 7f42ef20e800 20 add_watcher() i=6 2024-09-14T11:14:17.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.230+0000 7f42ef20e800 20 add_watcher() i=7 2024-09-14T11:14:17.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.230+0000 7f42ef20e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:17.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.231+0000 7f41a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f42ef20e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f42ef20e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f42ef20e800 5 note: GC not initialized 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f41a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f42ef20e800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f42ef20e800 20 Filter name: none 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f4199ffb640 20 reqs_thread_entry: start 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f42ef20e800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:14:17.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.232+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:17.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:14:17.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:14:17.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 : miss 2024-09-14T11:14:17.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:17.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:17.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:17.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:17.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:17.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:17.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.233+0000 7f42ef20e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 2024-09-14T11:14:17.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.234+0000 7f42ef20e800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to be held by another RGW process; skipping for now 2024-09-14T11:14:17.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.235+0000 7f41a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:17.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.237+0000 7f42ef20e800 20 remove_watcher() i=0 2024-09-14T11:14:17.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.237+0000 7f42ef20e800 2 removed watcher, disabling cache 2024-09-14T11:14:17.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.238+0000 7f42ef20e800 20 remove_watcher() i=1 2024-09-14T11:14:17.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.239+0000 7f42ef20e800 20 remove_watcher() i=2 2024-09-14T11:14:17.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.240+0000 7f42ef20e800 20 remove_watcher() i=3 2024-09-14T11:14:17.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.241+0000 7f42ef20e800 20 remove_watcher() i=4 2024-09-14T11:14:17.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.242+0000 7f42ef20e800 20 remove_watcher() i=5 2024-09-14T11:14:17.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.243+0000 7f42ef20e800 20 remove_watcher() i=6 2024-09-14T11:14:17.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:17.244+0000 7f42ef20e800 20 remove_watcher() i=7 2024-09-14T11:14:17.253 INFO:tasks.workunit.client.0.smithi002.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:14:47.256 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:14:47.293 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:47.293 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:47.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.340+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 20 realm 2024-09-14T11:14:47.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:47.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.342+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.343+0000 7f5246b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:47.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.343+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.344+0000 7f5246b40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:47.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.344+0000 7f5246b40800 20 searching for the correct realm 2024-09-14T11:14:47.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.347+0000 7f523bfff640 0 -- 172.21.15.2:0/4029626173 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f5234064be0 msgr2=0x7f5234089420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:47.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.351+0000 7f5242886640 0 -- 172.21.15.2:0/4029626173 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f522c0438c0 msgr2=0x7f522c09a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.558+0000 7f5246b40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.558+0000 7f5246b40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.558+0000 7f5246b40800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.558+0000 7f5246b40800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.558+0000 7f5246b40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.558+0000 7f5246b40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.558+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:47.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:47.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 zone default found 2024-09-14T11:14:47.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 4 Realm: () 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 zonegroup default 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.559+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.560+0000 7f5246b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.560+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.560+0000 7f5246b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.560+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.560+0000 7f5246b40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.561+0000 7f5246b40800 20 started sync module instance, tier type = 2024-09-14T11:14:47.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.561+0000 7f5246b40800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:47.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.571+0000 7f5246b40800 20 add_watcher() i=0 2024-09-14T11:14:47.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.571+0000 7f5246b40800 20 add_watcher() i=1 2024-09-14T11:14:47.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.571+0000 7f5246b40800 20 add_watcher() i=2 2024-09-14T11:14:47.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.571+0000 7f5246b40800 20 add_watcher() i=3 2024-09-14T11:14:47.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.571+0000 7f5246b40800 20 add_watcher() i=4 2024-09-14T11:14:47.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.571+0000 7f5246b40800 20 add_watcher() i=5 2024-09-14T11:14:47.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.571+0000 7f5246b40800 20 add_watcher() i=6 2024-09-14T11:14:47.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.572+0000 7f5246b40800 20 add_watcher() i=7 2024-09-14T11:14:47.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.572+0000 7f5246b40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:47.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.574+0000 7f50f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5246b40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:47.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5246b40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5246b40800 5 note: GC not initialized 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5073fff640 20 reqs_thread_entry: start 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5246b40800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5246b40800 20 Filter name: none 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5071ffb640 20 reqs_thread_entry: start 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5246b40800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.575+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.576+0000 7f5246b40800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.576+0000 7f5246b40800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-14T11:14:47.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.576+0000 7f5246b40800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.576+0000 7f5246b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 : miss 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.576+0000 7f5246b40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.577+0000 7f5246b40800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.577+0000 7f5246b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.577+0000 7f5246b40800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.577+0000 7f5246b40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.577+0000 7f5246b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:47.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.577+0000 7f5246b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 2024-09-14T11:14:47.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5246b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:47.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5246b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5246b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5246b40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24, ofs0, ns] 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5125ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464341 cookie 94801548144048 notifier 6338 bl.length()=925 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5125ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5125ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.581+0000 7f5125ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.582+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): orig_sources= new_sources= 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.582+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): potential sources added=[] removed=[] 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.582+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): orig_dests= new_dests= 2024-09-14T11:14:47.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.582+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): potential dests added=[] removed=[] 2024-09-14T11:14:47.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.585+0000 7f5246b40800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.24.1.0 2024-09-14T11:14:47.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.585+0000 7f5246b40800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.24.1.0 2024-09-14T11:14:47.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.585+0000 7f5246b40800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.24.1.1 2024-09-14T11:14:47.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.585+0000 7f5246b40800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.24.1.1 2024-09-14T11:14:47.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.585+0000 7f5246b40800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.24.0 2024-09-14T11:14:47.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.587+0000 7f5246b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:47.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.587+0000 7f5246b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.588+0000 7f5246b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.588+0000 7f5246b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.588+0000 7f5246b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.588+0000 7f5246b40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24, ofs0, ns] 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5125ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464342 cookie 94801548144048 notifier 6338 bl.length()=925 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5125ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5125ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:47.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5125ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:47.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): orig_sources= new_sources= 2024-09-14T11:14:47.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): potential sources added=[] removed=[] 2024-09-14T11:14:47.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): orig_dests= new_dests= 2024-09-14T11:14:47.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.589+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): potential dests added=[] removed=[] 2024-09-14T11:14:47.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.591+0000 7f5246b40800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.24.0 2024-09-14T11:14:47.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.591+0000 7f5246b40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:47.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.591+0000 7f5246b40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 2024-09-14T11:14:47.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.592+0000 7f5246b40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:47.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.592+0000 7f5246b40800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:47.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.592+0000 7f5246b40800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:47.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.592+0000 7f5246b40800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24, ofs0, ns] 2024-09-14T11:14:47.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5125ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464343 cookie 94801548144048 notifier 6338 bl.length()=893 2024-09-14T11:14:47.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5125ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 info.flags=0x17 2024-09-14T11:14:47.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5125ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 to cache LRU end 2024-09-14T11:14:47.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5125ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:47.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): orig_sources= new_sources= 2024-09-14T11:14:47.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): potential sources added=[] removed=[] 2024-09-14T11:14:47.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): orig_dests= new_dests= 2024-09-14T11:14:47.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.593+0000 7f5246b40800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.24]): potential dests added=[] removed=[] 2024-09-14T11:14:47.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.594+0000 7f5246b40800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:14:47.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.597+0000 7f50f97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.599+0000 7f5246b40800 20 remove_watcher() i=0 2024-09-14T11:14:47.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.599+0000 7f5246b40800 2 removed watcher, disabling cache 2024-09-14T11:14:47.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.600+0000 7f5246b40800 20 remove_watcher() i=1 2024-09-14T11:14:47.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.602+0000 7f5246b40800 20 remove_watcher() i=2 2024-09-14T11:14:47.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.603+0000 7f5246b40800 20 remove_watcher() i=3 2024-09-14T11:14:47.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.604+0000 7f5246b40800 20 remove_watcher() i=4 2024-09-14T11:14:47.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.605+0000 7f5246b40800 20 remove_watcher() i=5 2024-09-14T11:14:47.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.606+0000 7f5246b40800 20 remove_watcher() i=6 2024-09-14T11:14:47.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.607+0000 7f5246b40800 20 remove_watcher() i=7 2024-09-14T11:14:47.619 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-14T11:14:47.649 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:47.649 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:47.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.691+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 20 realm 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.693+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.694+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:47.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.694+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.695+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:47.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.695+0000 7fdb28613800 20 searching for the correct realm 2024-09-14T11:14:47.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.698+0000 7fdb24593640 0 -- 172.21.15.2:0/1584263222 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fdb0c089960 msgr2=0x7fdb0c07b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:47.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.702+0000 7fdb23d92640 0 -- 172.21.15.2:0/1584263222 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fdb0c09a920 msgr2=0x7fdb0c0633d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.909+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:47.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:47.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 20 zone default found 2024-09-14T11:14:47.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 4 Realm: () 2024-09-14T11:14:47.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:47.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 20 zonegroup default 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.910+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.911+0000 7fdb28613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.911+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.911+0000 7fdb28613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.911+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.911+0000 7fdb28613800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:47.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.911+0000 7fdb28613800 20 started sync module instance, tier type = 2024-09-14T11:14:47.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.911+0000 7fdb28613800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:47.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.921+0000 7fdb28613800 20 add_watcher() i=0 2024-09-14T11:14:47.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.921+0000 7fdb28613800 20 add_watcher() i=1 2024-09-14T11:14:47.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.921+0000 7fdb28613800 20 add_watcher() i=2 2024-09-14T11:14:47.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.921+0000 7fdb28613800 20 add_watcher() i=3 2024-09-14T11:14:47.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.921+0000 7fdb28613800 20 add_watcher() i=4 2024-09-14T11:14:47.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.921+0000 7fdb28613800 20 add_watcher() i=5 2024-09-14T11:14:47.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.921+0000 7fdb28613800 20 add_watcher() i=6 2024-09-14T11:14:47.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.922+0000 7fdb28613800 20 add_watcher() i=7 2024-09-14T11:14:47.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.922+0000 7fdb28613800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:47.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.924+0000 7fd9da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.924+0000 7fdb28613800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:47.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.924+0000 7fdb28613800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:47.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.925+0000 7fdb28613800 5 note: GC not initialized 2024-09-14T11:14:47.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.925+0000 7fd9d97e2640 20 reqs_thread_entry: start 2024-09-14T11:14:47.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.925+0000 7fdb28613800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:47.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.925+0000 7fdb28613800 20 Filter name: none 2024-09-14T11:14:47.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.925+0000 7fd9d27fc640 20 reqs_thread_entry: start 2024-09-14T11:14:47.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.925+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.926+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:47.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.926+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.926+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:47.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.926+0000 7fdb28613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:47.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.926+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.927+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=194 2024-09-14T11:14:47.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.927+0000 7fdb28613800 20 rados->read ofs=0 len=0 2024-09-14T11:14:47.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.927+0000 7fdb28613800 20 rados_obj.operate() r=0 bl.length=416 2024-09-14T11:14:47.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.927+0000 7fdb28613800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:47.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.929+0000 7fd9da7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:47.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.931+0000 7fdb28613800 20 remove_watcher() i=0 2024-09-14T11:14:47.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.931+0000 7fdb28613800 2 removed watcher, disabling cache 2024-09-14T11:14:47.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.933+0000 7fdb28613800 20 remove_watcher() i=1 2024-09-14T11:14:47.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.934+0000 7fdb28613800 20 remove_watcher() i=2 2024-09-14T11:14:47.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.935+0000 7fdb28613800 20 remove_watcher() i=3 2024-09-14T11:14:47.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.936+0000 7fdb28613800 20 remove_watcher() i=4 2024-09-14T11:14:47.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.937+0000 7fdb28613800 20 remove_watcher() i=5 2024-09-14T11:14:47.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.938+0000 7fdb28613800 20 remove_watcher() i=6 2024-09-14T11:14:47.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:47.939+0000 7fdb28613800 20 remove_watcher() i=7 2024-09-14T11:14:47.948 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:47.948 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:47.948 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-set-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.24 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:14:47.948 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:47.950 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:47.951 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:47.954 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:47.954 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:47.997 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:47.997 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.013 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-14T11:14:48.013 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:48.014 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.014 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.025 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.025 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.067 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.067 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.075 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.075 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.082 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.082 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.089 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.089 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.097 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.097 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.104 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.104 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.111 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.111 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.118 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.119 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.125 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.125 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.132 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.132 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.140 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.140 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.147 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.147 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.154 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.154 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.161 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.162 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.168 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.168 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.209 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.210 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.217 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.217 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.224 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.224 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.230 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.231 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.237 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:48.237 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:48.245 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:14:48.274 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:48.274 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:48.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.315+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.316+0000 7f157f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.316+0000 7f157f40f800 20 realm 2024-09-14T11:14:48.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.316+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.317+0000 7f157f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.317+0000 7f157f40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:48.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.317+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.317+0000 7f157f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.317+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.318+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.318+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.318+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:48.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.318+0000 7f157f40f800 20 searching for the correct realm 2024-09-14T11:14:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.321+0000 7f157c6ff640 0 -- 172.21.15.2:0/3657465255 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f156c06c070 msgr2=0x7f156c0904c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.325+0000 7f157cf00640 0 -- 172.21.15.2:0/3657465255 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f15700463e0 msgr2=0x7f1570046860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.532+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:48.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 zone default found 2024-09-14T11:14:48.532 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 4 Realm: () 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 zonegroup default 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.533+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.534+0000 7f157f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.534+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.534+0000 7f157f40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.534+0000 7f157f40f800 20 started sync module instance, tier type = 2024-09-14T11:14:48.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.534+0000 7f157f40f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:48.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.543+0000 7f157f40f800 20 add_watcher() i=0 2024-09-14T11:14:48.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.543+0000 7f157f40f800 20 add_watcher() i=1 2024-09-14T11:14:48.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.543+0000 7f157f40f800 20 add_watcher() i=2 2024-09-14T11:14:48.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.543+0000 7f157f40f800 20 add_watcher() i=3 2024-09-14T11:14:48.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.543+0000 7f157f40f800 20 add_watcher() i=4 2024-09-14T11:14:48.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.543+0000 7f157f40f800 20 add_watcher() i=5 2024-09-14T11:14:48.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.543+0000 7f157f40f800 20 add_watcher() i=6 2024-09-14T11:14:48.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.544+0000 7f157f40f800 20 add_watcher() i=7 2024-09-14T11:14:48.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.544+0000 7f157f40f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:48.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.545+0000 7f1432fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f157f40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:48.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f157f40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:48.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f157f40f800 5 note: GC not initialized 2024-09-14T11:14:48.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f1431fe3640 20 reqs_thread_entry: start 2024-09-14T11:14:48.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f157f40f800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:48.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f157f40f800 20 Filter name: none 2024-09-14T11:14:48.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f13a37fe640 20 reqs_thread_entry: start 2024-09-14T11:14:48.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.546+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.547+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.547+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.547+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.547+0000 7f157f40f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.547+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.548+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.548+0000 7f157f40f800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.548+0000 7f157f40f800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:48.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.548+0000 7f157f40f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:48.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.549+0000 7f1432fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.551+0000 7f157f40f800 20 remove_watcher() i=0 2024-09-14T11:14:48.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.551+0000 7f157f40f800 2 removed watcher, disabling cache 2024-09-14T11:14:48.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.553+0000 7f157f40f800 20 remove_watcher() i=1 2024-09-14T11:14:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.554+0000 7f157f40f800 20 remove_watcher() i=2 2024-09-14T11:14:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.554+0000 7f157f40f800 20 remove_watcher() i=3 2024-09-14T11:14:48.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.555+0000 7f157f40f800 20 remove_watcher() i=4 2024-09-14T11:14:48.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.556+0000 7f157f40f800 20 remove_watcher() i=5 2024-09-14T11:14:48.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.557+0000 7f157f40f800 20 remove_watcher() i=6 2024-09-14T11:14:48.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.558+0000 7f157f40f800 20 remove_watcher() i=7 2024-09-14T11:14:48.568 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:48.568 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:48.568 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:48.569 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:48.570 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-14T11:14:48.605 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:48.605 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:48.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.646+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 20 realm 2024-09-14T11:14:48.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:48.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.648+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.649+0000 7fb3cca96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.649+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.649+0000 7fb3cca96800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:48.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.649+0000 7fb3cca96800 20 searching for the correct realm 2024-09-14T11:14:48.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.653+0000 7fb3c9d7f640 0 -- 172.21.15.2:0/936770202 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x555d5f6c6400 msgr2=0x555d5f6c88c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.656+0000 7fb3c9d7f640 0 -- 172.21.15.2:0/936770202 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fb3bc080bc0 msgr2=0x7fb3bc069910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:48.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:48.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.660+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 zone default found 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 4 Realm: () 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:48.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 zonegroup default 2024-09-14T11:14:48.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.661+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.662+0000 7fb3cca96800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.662+0000 7fb3cca96800 20 started sync module instance, tier type = 2024-09-14T11:14:48.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.662+0000 7fb3cca96800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:48.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.670+0000 7fb3cca96800 20 add_watcher() i=0 2024-09-14T11:14:48.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.670+0000 7fb3cca96800 20 add_watcher() i=1 2024-09-14T11:14:48.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.670+0000 7fb3cca96800 20 add_watcher() i=2 2024-09-14T11:14:48.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.670+0000 7fb3cca96800 20 add_watcher() i=3 2024-09-14T11:14:48.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.670+0000 7fb3cca96800 20 add_watcher() i=4 2024-09-14T11:14:48.669 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.670+0000 7fb3cca96800 20 add_watcher() i=5 2024-09-14T11:14:48.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.671+0000 7fb3cca96800 20 add_watcher() i=6 2024-09-14T11:14:48.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.671+0000 7fb3cca96800 20 add_watcher() i=7 2024-09-14T11:14:48.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.671+0000 7fb3cca96800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:48.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.673+0000 7fb280fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb3cca96800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:48.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb3cca96800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:48.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb3cca96800 5 note: GC not initialized 2024-09-14T11:14:48.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb1fb7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:48.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb3cca96800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:48.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb3cca96800 20 Filter name: none 2024-09-14T11:14:48.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb1f97fa640 20 reqs_thread_entry: start 2024-09-14T11:14:48.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb3cca96800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:14:48.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.674+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 : miss 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:48.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.675+0000 7fb3cca96800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 2024-09-14T11:14:48.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:48.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:48.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:48.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25, ofs0, ns] 2024-09-14T11:14:48.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb2adffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464320 cookie 93859521246640 notifier 6386 bl.length()=939 2024-09-14T11:14:48.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb2adffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:48.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb2adffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:48.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb2adffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:48.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_sources= new_sources= 2024-09-14T11:14:48.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential sources added=[] removed=[] 2024-09-14T11:14:48.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_dests= new_dests= 2024-09-14T11:14:48.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential dests added=[] removed=[] 2024-09-14T11:14:48.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-14T11:14:48.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.679+0000 7fb3cca96800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-14T11:14:48.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.681+0000 7fb280fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:48.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.683+0000 7fb3cca96800 20 remove_watcher() i=0 2024-09-14T11:14:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.683+0000 7fb3cca96800 2 removed watcher, disabling cache 2024-09-14T11:14:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.684+0000 7fb3cca96800 20 remove_watcher() i=1 2024-09-14T11:14:48.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.685+0000 7fb3cca96800 20 remove_watcher() i=2 2024-09-14T11:14:48.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.686+0000 7fb3cca96800 20 remove_watcher() i=3 2024-09-14T11:14:48.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.687+0000 7fb3cca96800 20 remove_watcher() i=4 2024-09-14T11:14:48.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.688+0000 7fb3cca96800 20 remove_watcher() i=5 2024-09-14T11:14:48.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.689+0000 7fb3cca96800 20 remove_watcher() i=6 2024-09-14T11:14:48.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.690+0000 7fb3cca96800 20 remove_watcher() i=7 2024-09-14T11:14:48.701 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:14:48.730 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:48.731 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:48.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.771+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 20 realm 2024-09-14T11:14:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.773+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.774+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:48.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.774+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:48.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.774+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:48.773 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.774+0000 7f9ff0d75800 20 searching for the correct realm 2024-09-14T11:14:48.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.777+0000 7f9fee065640 0 -- 172.21.15.2:0/3941511916 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f9fe003bb60 msgr2=0x7f9fe006a5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:48.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:48.982+0000 7f9fee866640 0 -- 172.21.15.2:0/3941511916 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f9fe407e040 msgr2=0x7f9fe407e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:49.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:49.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:49.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:49.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:49.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:49.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:49.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:49.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.189+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 20 zone default found 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 4 Realm: () 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 20 zonegroup default 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.190+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.191+0000 7f9ff0d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.191+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.191+0000 7f9ff0d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.191+0000 7f9ff0d75800 20 started sync module instance, tier type = 2024-09-14T11:14:49.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.191+0000 7f9ff0d75800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:49.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.200+0000 7f9ff0d75800 20 add_watcher() i=0 2024-09-14T11:14:49.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.200+0000 7f9ff0d75800 20 add_watcher() i=1 2024-09-14T11:14:49.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.200+0000 7f9ff0d75800 20 add_watcher() i=2 2024-09-14T11:14:49.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.200+0000 7f9ff0d75800 20 add_watcher() i=3 2024-09-14T11:14:49.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.200+0000 7f9ff0d75800 20 add_watcher() i=4 2024-09-14T11:14:49.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.200+0000 7f9ff0d75800 20 add_watcher() i=5 2024-09-14T11:14:49.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.200+0000 7f9ff0d75800 20 add_watcher() i=6 2024-09-14T11:14:49.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.201+0000 7f9ff0d75800 20 add_watcher() i=7 2024-09-14T11:14:49.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.201+0000 7f9ff0d75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:49.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.202+0000 7f9ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:49.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9ff0d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:49.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9ff0d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:49.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9ff0d75800 5 note: GC not initialized 2024-09-14T11:14:49.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9e1ffff640 20 reqs_thread_entry: start 2024-09-14T11:14:49.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9ff0d75800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:49.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9ff0d75800 20 Filter name: none 2024-09-14T11:14:49.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9e1dffb640 20 reqs_thread_entry: start 2024-09-14T11:14:49.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.203+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.204+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:49.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.204+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.204+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:14:49.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.204+0000 7f9ff0d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:49.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.204+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.205+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:49.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.205+0000 7f9ff0d75800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.205+0000 7f9ff0d75800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:14:49.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.205+0000 7f9ff0d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:49.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.207+0000 7f9ea57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:49.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.209+0000 7f9ff0d75800 20 remove_watcher() i=0 2024-09-14T11:14:49.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.209+0000 7f9ff0d75800 2 removed watcher, disabling cache 2024-09-14T11:14:49.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.210+0000 7f9ff0d75800 20 remove_watcher() i=1 2024-09-14T11:14:49.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.211+0000 7f9ff0d75800 20 remove_watcher() i=2 2024-09-14T11:14:49.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.212+0000 7f9ff0d75800 20 remove_watcher() i=3 2024-09-14T11:14:49.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.213+0000 7f9ff0d75800 20 remove_watcher() i=4 2024-09-14T11:14:49.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.214+0000 7f9ff0d75800 20 remove_watcher() i=5 2024-09-14T11:14:49.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.215+0000 7f9ff0d75800 20 remove_watcher() i=6 2024-09-14T11:14:49.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.216+0000 7f9ff0d75800 20 remove_watcher() i=7 2024-09-14T11:14:49.225 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:49.226 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:49.226 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:49.226 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:49.228 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.228 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.235 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.235 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.278 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:14:49.312 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:49.313 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:49.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.353+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.355+0000 7f99b3098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.355+0000 7f99b3098800 20 realm 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.355+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.355+0000 7f99b3098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.355+0000 7f99b3098800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.355+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.356+0000 7f99b3098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.356+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.356+0000 7f99b3098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.356+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.357+0000 7f99b3098800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.357+0000 7f99b3098800 20 searching for the correct realm 2024-09-14T11:14:49.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.360+0000 7f99b1383640 0 -- 172.21.15.2:0/478415123 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f99a40bf160 msgr2=0x7f99a40c71b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.363+0000 7f99b0b82640 0 -- 172.21.15.2:0/478415123 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f99a40a6c00 msgr2=0x7f99a40bf620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:49.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 zone default found 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 4 Realm: () 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 zonegroup default 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.368+0000 7f99b3098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.369+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.369+0000 7f99b3098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.369+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.369+0000 7f99b3098800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.369+0000 7f99b3098800 20 started sync module instance, tier type = 2024-09-14T11:14:49.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.369+0000 7f99b3098800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:49.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.377+0000 7f99b3098800 20 add_watcher() i=0 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.377+0000 7f99b3098800 20 add_watcher() i=1 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.377+0000 7f99b3098800 20 add_watcher() i=2 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.377+0000 7f99b3098800 20 add_watcher() i=3 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.377+0000 7f99b3098800 20 add_watcher() i=4 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.377+0000 7f99b3098800 20 add_watcher() i=5 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.377+0000 7f99b3098800 20 add_watcher() i=6 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.378+0000 7f99b3098800 20 add_watcher() i=7 2024-09-14T11:14:49.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.378+0000 7f99b3098800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:49.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.380+0000 7f9866fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:49.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.380+0000 7f99b3098800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:49.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.380+0000 7f99b3098800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:49.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.380+0000 7f99b3098800 5 note: GC not initialized 2024-09-14T11:14:49.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f9865fe3640 20 reqs_thread_entry: start 2024-09-14T11:14:49.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:49.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 20 Filter name: none 2024-09-14T11:14:49.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f97d77fe640 20 reqs_thread_entry: start 2024-09-14T11:14:49.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:14:49.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:49.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 : miss 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.381+0000 7f99b3098800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.382+0000 7f99b3098800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.382+0000 7f99b3098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.382+0000 7f99b3098800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.382+0000 7f99b3098800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.382+0000 7f99b3098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.382+0000 7f99b3098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 2024-09-14T11:14:49.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.383+0000 7f99b3098800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25, ofs0, ns] 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f9887fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94214729011712 notifier 6419 bl.length()=939 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f9887fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f9887fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:49.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f9887fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:49.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_sources= new_sources= 2024-09-14T11:14:49.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential sources added=[] removed=[] 2024-09-14T11:14:49.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_dests= new_dests= 2024-09-14T11:14:49.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.389+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential dests added=[] removed=[] 2024-09-14T11:14:49.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.391+0000 7f99b3098800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.25.2.0 2024-09-14T11:14:49.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.391+0000 7f99b3098800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.25.2.0 2024-09-14T11:14:49.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.391+0000 7f99b3098800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.25.2.1 2024-09-14T11:14:49.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.391+0000 7f99b3098800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.25.2.1 2024-09-14T11:14:49.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.391+0000 7f99b3098800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.25.0 2024-09-14T11:14:49.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.394+0000 7f99b3098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:49.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.394+0000 7f99b3098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f99b3098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f99b3098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f99b3098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f99b3098800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25, ofs0, ns] 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f9887fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464322 cookie 94214729011712 notifier 6419 bl.length()=939 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f9887fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f9887fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:49.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.395+0000 7f9887fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:49.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.396+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_sources= new_sources= 2024-09-14T11:14:49.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.396+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential sources added=[] removed=[] 2024-09-14T11:14:49.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.396+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_dests= new_dests= 2024-09-14T11:14:49.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.396+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential dests added=[] removed=[] 2024-09-14T11:14:49.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.397+0000 7f99b3098800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.25.0 2024-09-14T11:14:49.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.397+0000 7f99b3098800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:49.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.398+0000 7f99b3098800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25, ofs0, ns] 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f9887fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94214729011712 notifier 6419 bl.length()=907 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f9887fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 info.flags=0x17 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f9887fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 to cache LRU end 2024-09-14T11:14:49.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f9887fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:49.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_sources= new_sources= 2024-09-14T11:14:49.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential sources added=[] removed=[] 2024-09-14T11:14:49.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): orig_dests= new_dests= 2024-09-14T11:14:49.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.399+0000 7f99b3098800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.25]): potential dests added=[] removed=[] 2024-09-14T11:14:49.399 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.400+0000 7f99b3098800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-14T11:14:49.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.402+0000 7f9866fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:49.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.404+0000 7f99b3098800 20 remove_watcher() i=0 2024-09-14T11:14:49.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.404+0000 7f99b3098800 2 removed watcher, disabling cache 2024-09-14T11:14:49.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.406+0000 7f99b3098800 20 remove_watcher() i=1 2024-09-14T11:14:49.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.407+0000 7f99b3098800 20 remove_watcher() i=2 2024-09-14T11:14:49.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.408+0000 7f99b3098800 20 remove_watcher() i=3 2024-09-14T11:14:49.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.409+0000 7f99b3098800 20 remove_watcher() i=4 2024-09-14T11:14:49.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.410+0000 7f99b3098800 20 remove_watcher() i=5 2024-09-14T11:14:49.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.411+0000 7f99b3098800 20 remove_watcher() i=6 2024-09-14T11:14:49.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.412+0000 7f99b3098800 20 remove_watcher() i=7 2024-09-14T11:14:49.423 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:14:49.452 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:49.452 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:49.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.492+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 20 realm 2024-09-14T11:14:49.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:49.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.494+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.495+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:49.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.495+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.495+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:49.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.495+0000 7f240aa14800 20 searching for the correct realm 2024-09-14T11:14:49.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.499+0000 7f24069e1640 0 -- 172.21.15.2:0/3639717412 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f23fc03b950 msgr2=0x7f23fc01c3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:49.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.502+0000 7f24061e0640 0 -- 172.21.15.2:0/3639717412 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f23fc04a410 msgr2=0x7f23fc04a870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:49.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:49.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:49.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:49.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:49.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:49.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:49.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:49.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.709+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:49.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 20 zone default found 2024-09-14T11:14:49.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 4 Realm: () 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 20 zonegroup default 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.710+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.711+0000 7f240aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.711+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.711+0000 7f240aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.711+0000 7f240aa14800 20 started sync module instance, tier type = 2024-09-14T11:14:49.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.711+0000 7f240aa14800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:49.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.720+0000 7f240aa14800 20 add_watcher() i=0 2024-09-14T11:14:49.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.720+0000 7f240aa14800 20 add_watcher() i=1 2024-09-14T11:14:49.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.720+0000 7f240aa14800 20 add_watcher() i=2 2024-09-14T11:14:49.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.720+0000 7f240aa14800 20 add_watcher() i=3 2024-09-14T11:14:49.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.720+0000 7f240aa14800 20 add_watcher() i=4 2024-09-14T11:14:49.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.720+0000 7f240aa14800 20 add_watcher() i=5 2024-09-14T11:14:49.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.720+0000 7f240aa14800 20 add_watcher() i=6 2024-09-14T11:14:49.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.721+0000 7f240aa14800 20 add_watcher() i=7 2024-09-14T11:14:49.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.721+0000 7f240aa14800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:49.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f22bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f240aa14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f240aa14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f240aa14800 5 note: GC not initialized 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f22377fe640 20 reqs_thread_entry: start 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f240aa14800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f240aa14800 20 Filter name: none 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.723+0000 7f22357fa640 20 reqs_thread_entry: start 2024-09-14T11:14:49.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.724+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.724+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:49.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.724+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.724+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:49.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.724+0000 7f240aa14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:49.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.724+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.725+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:49.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.725+0000 7f240aa14800 20 rados->read ofs=0 len=0 2024-09-14T11:14:49.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.725+0000 7f240aa14800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:49.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.725+0000 7f240aa14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:49.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.726+0000 7f22bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:49.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.728+0000 7f240aa14800 20 remove_watcher() i=0 2024-09-14T11:14:49.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.728+0000 7f240aa14800 2 removed watcher, disabling cache 2024-09-14T11:14:49.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.729+0000 7f240aa14800 20 remove_watcher() i=1 2024-09-14T11:14:49.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.731+0000 7f240aa14800 20 remove_watcher() i=2 2024-09-14T11:14:49.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.732+0000 7f240aa14800 20 remove_watcher() i=3 2024-09-14T11:14:49.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.733+0000 7f240aa14800 20 remove_watcher() i=4 2024-09-14T11:14:49.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.734+0000 7f240aa14800 20 remove_watcher() i=5 2024-09-14T11:14:49.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.735+0000 7f240aa14800 20 remove_watcher() i=6 2024-09-14T11:14:49.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:49.736+0000 7f240aa14800 20 remove_watcher() i=7 2024-09-14T11:14:49.745 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:49.745 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:49.745 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.25 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:14:49.745 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:49.747 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.747 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.751 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.751 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.794 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.794 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.808 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-14T11:14:49.808 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:49.809 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.809 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.818 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.818 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.860 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.860 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.867 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.867 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.873 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.873 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.879 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.880 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.886 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.886 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.893 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.893 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.900 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.900 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.906 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.906 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.914 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.914 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.921 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.921 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.927 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.927 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.934 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.934 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.941 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.941 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.948 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.948 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.955 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.955 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.962 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.962 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.969 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.969 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.975 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.975 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.982 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.982 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.989 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:49.989 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:49.996 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:14:50.025 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:50.025 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:50.064 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.066+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 20 realm 2024-09-14T11:14:50.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:50.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.068+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.069+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.069+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.069+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:50.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.069+0000 7f372ea20800 20 searching for the correct realm 2024-09-14T11:14:50.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.072+0000 7f372bd09640 0 -- 172.21.15.2:0/2498482880 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f371c07c070 msgr2=0x7f371c088410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:50.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.277+0000 7f372c50a640 0 -- 172.21.15.2:0/2498482880 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3720090040 msgr2=0x7f3720090520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:50.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.483+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:50.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 zone default found 2024-09-14T11:14:50.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 4 Realm: () 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 zonegroup default 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.484+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.485+0000 7f372ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.485+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.485+0000 7f372ea20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.485+0000 7f372ea20800 20 started sync module instance, tier type = 2024-09-14T11:14:50.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.485+0000 7f372ea20800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:50.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.495+0000 7f372ea20800 20 add_watcher() i=0 2024-09-14T11:14:50.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.495+0000 7f372ea20800 20 add_watcher() i=1 2024-09-14T11:14:50.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.495+0000 7f372ea20800 20 add_watcher() i=2 2024-09-14T11:14:50.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.495+0000 7f372ea20800 20 add_watcher() i=3 2024-09-14T11:14:50.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.495+0000 7f372ea20800 20 add_watcher() i=4 2024-09-14T11:14:50.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.495+0000 7f372ea20800 20 add_watcher() i=5 2024-09-14T11:14:50.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.495+0000 7f372ea20800 20 add_watcher() i=6 2024-09-14T11:14:50.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.496+0000 7f372ea20800 20 add_watcher() i=7 2024-09-14T11:14:50.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.496+0000 7f372ea20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:50.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.498+0000 7f35e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.498+0000 7f372ea20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.498+0000 7f372ea20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.498+0000 7f372ea20800 5 note: GC not initialized 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.498+0000 7f35e1fdb640 20 reqs_thread_entry: start 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.499+0000 7f372ea20800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.499+0000 7f372ea20800 20 Filter name: none 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.499+0000 7f35537fe640 20 reqs_thread_entry: start 2024-09-14T11:14:50.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.499+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.500+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:50.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.500+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.500+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:50.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.500+0000 7f372ea20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:50.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.500+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.501+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:50.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.501+0000 7f372ea20800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.501+0000 7f372ea20800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:50.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.501+0000 7f372ea20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:50.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.503+0000 7f35e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.505+0000 7f372ea20800 20 remove_watcher() i=0 2024-09-14T11:14:50.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.505+0000 7f372ea20800 2 removed watcher, disabling cache 2024-09-14T11:14:50.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.506+0000 7f372ea20800 20 remove_watcher() i=1 2024-09-14T11:14:50.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.507+0000 7f372ea20800 20 remove_watcher() i=2 2024-09-14T11:14:50.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.508+0000 7f372ea20800 20 remove_watcher() i=3 2024-09-14T11:14:50.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.509+0000 7f372ea20800 20 remove_watcher() i=4 2024-09-14T11:14:50.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.510+0000 7f372ea20800 20 remove_watcher() i=5 2024-09-14T11:14:50.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.511+0000 7f372ea20800 20 remove_watcher() i=6 2024-09-14T11:14:50.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.512+0000 7f372ea20800 20 remove_watcher() i=7 2024-09-14T11:14:50.523 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:50.523 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:50.523 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:50.523 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:50.525 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-14T11:14:50.563 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:50.564 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.608+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 20 realm 2024-09-14T11:14:50.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:50.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.609+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.610+0000 7fd2a7919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.610+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.610+0000 7fd2a7919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.610+0000 7fd2a7919800 20 searching for the correct realm 2024-09-14T11:14:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.614+0000 7fd2a5c04640 0 -- 172.21.15.2:0/1056893561 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fd29c017050 msgr2=0x7fd29c025920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:50.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.617+0000 7fd2a5403640 0 -- 172.21.15.2:0/1056893561 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd29c035490 msgr2=0x7fd29c0358f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:50.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.823+0000 7fd2a7919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:50.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.823+0000 7fd2a7919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:50.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.823+0000 7fd2a7919800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:50.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.823+0000 7fd2a7919800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:50.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.823+0000 7fd2a7919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:50.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.823+0000 7fd2a7919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:50.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.824+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.824+0000 7fd2a7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.824+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 zone default found 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 4 Realm: () 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 zonegroup default 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.825+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.826+0000 7fd2a7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.826+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.826+0000 7fd2a7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.826+0000 7fd2a7919800 20 started sync module instance, tier type = 2024-09-14T11:14:50.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.826+0000 7fd2a7919800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:50.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.835+0000 7fd2a7919800 20 add_watcher() i=0 2024-09-14T11:14:50.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.835+0000 7fd2a7919800 20 add_watcher() i=1 2024-09-14T11:14:50.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.835+0000 7fd2a7919800 20 add_watcher() i=2 2024-09-14T11:14:50.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.835+0000 7fd2a7919800 20 add_watcher() i=3 2024-09-14T11:14:50.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.835+0000 7fd2a7919800 20 add_watcher() i=4 2024-09-14T11:14:50.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.835+0000 7fd2a7919800 20 add_watcher() i=5 2024-09-14T11:14:50.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.835+0000 7fd2a7919800 20 add_watcher() i=6 2024-09-14T11:14:50.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.836+0000 7fd2a7919800 20 add_watcher() i=7 2024-09-14T11:14:50.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.836+0000 7fd2a7919800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:50.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.839+0000 7fd15bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.839+0000 7fd2a7919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:50.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.839+0000 7fd2a7919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:50.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.839+0000 7fd2a7919800 5 note: GC not initialized 2024-09-14T11:14:50.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd15afe5640 20 reqs_thread_entry: start 2024-09-14T11:14:50.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:50.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 20 Filter name: none 2024-09-14T11:14:50.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd158fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:50.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-14T11:14:50.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 : miss 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.840+0000 7fd2a7919800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.841+0000 7fd2a7919800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.841+0000 7fd2a7919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 info.flags=0x17 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.841+0000 7fd2a7919800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 to cache LRU end 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.841+0000 7fd2a7919800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.841+0000 7fd2a7919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:50.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.841+0000 7fd2a7919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.844+0000 7fd2a7919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 info.flags=0x17 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.844+0000 7fd2a7919800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 to cache LRU end 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.844+0000 7fd2a7919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.844+0000 7fd2a7919800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26, ofs0, ns] 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd188ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464326 cookie 94717429174208 notifier 6789 bl.length()=939 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd188ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 info.flags=0x17 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd188ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 to cache LRU end 2024-09-14T11:14:50.843 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd188ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:50.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): orig_sources= new_sources= 2024-09-14T11:14:50.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): potential sources added=[] removed=[] 2024-09-14T11:14:50.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): orig_dests= new_dests= 2024-09-14T11:14:50.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): potential dests added=[] removed=[] 2024-09-14T11:14:50.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd2a7919800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-14T11:14:50.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.845+0000 7fd2a7919800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-14T11:14:50.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.846+0000 7fd2a7919800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.26.1.0 2024-09-14T11:14:50.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.846+0000 7fd2a7919800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.26.1.0 2024-09-14T11:14:50.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.846+0000 7fd2a7919800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.26.1.1 2024-09-14T11:14:50.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.846+0000 7fd2a7919800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.26.1.1 2024-09-14T11:14:50.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.846+0000 7fd2a7919800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.26.0 2024-09-14T11:14:50.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.849+0000 7fd2a7919800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 : hit (requested=0x17, cached=0x17) 2024-09-14T11:14:50.847 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.849+0000 7fd2a7919800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 2024-09-14T11:14:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 info.flags=0x17 2024-09-14T11:14:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 to cache LRU end 2024-09-14T11:14:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:50.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26, ofs0, ns] 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd177fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94717429174208 notifier 6789 bl.length()=907 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd177fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 info.flags=0x17 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd177fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 to cache LRU end 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd177fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): orig_sources= new_sources= 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): potential sources added=[] removed=[] 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): orig_dests= new_dests= 2024-09-14T11:14:50.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.850+0000 7fd2a7919800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.26]): potential dests added=[] removed=[] 2024-09-14T11:14:50.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.852+0000 7fd2a7919800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-14T11:14:50.852 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.854+0000 7fd15bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:50.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.856+0000 7fd2a7919800 20 remove_watcher() i=0 2024-09-14T11:14:50.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.856+0000 7fd2a7919800 2 removed watcher, disabling cache 2024-09-14T11:14:50.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.857+0000 7fd2a7919800 20 remove_watcher() i=1 2024-09-14T11:14:50.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.858+0000 7fd2a7919800 20 remove_watcher() i=2 2024-09-14T11:14:50.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.859+0000 7fd2a7919800 20 remove_watcher() i=3 2024-09-14T11:14:50.858 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.860+0000 7fd2a7919800 20 remove_watcher() i=4 2024-09-14T11:14:50.859 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.861+0000 7fd2a7919800 20 remove_watcher() i=5 2024-09-14T11:14:50.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.862+0000 7fd2a7919800 20 remove_watcher() i=6 2024-09-14T11:14:50.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.863+0000 7fd2a7919800 20 remove_watcher() i=7 2024-09-14T11:14:50.874 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-14T11:14:50.904 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:50.904 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:50.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.944+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 20 realm 2024-09-14T11:14:50.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.946+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.947+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:50.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.947+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:50.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.947+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:50.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:50.947+0000 7fa02d526800 20 searching for the correct realm 2024-09-14T11:14:51.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.152+0000 7fa028ad5640 0 -- 172.21.15.2:0/3503234820 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fa01c001c20 msgr2=0x7fa01c068590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:51.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.559+0000 7fa0292d6640 0 -- 172.21.15.2:0/3503234820 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa02004b3f0 msgr2=0x7fa02004b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:51.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.767+0000 7fa02d526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:51.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.767+0000 7fa02d526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:51.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.767+0000 7fa02d526800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:51.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.767+0000 7fa02d526800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:51.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.767+0000 7fa02d526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:51.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.767+0000 7fa02d526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:51.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.768+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.768+0000 7fa02d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.768+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.768+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.768+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 20 zone default found 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 4 Realm: () 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 20 zonegroup default 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.769+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.770+0000 7fa02d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.770+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.770+0000 7fa02d526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:51.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.770+0000 7fa02d526800 20 started sync module instance, tier type = 2024-09-14T11:14:51.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.770+0000 7fa02d526800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.781+0000 7fa02d526800 20 add_watcher() i=0 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.781+0000 7fa02d526800 20 add_watcher() i=1 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.781+0000 7fa02d526800 20 add_watcher() i=2 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.781+0000 7fa02d526800 20 add_watcher() i=3 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.781+0000 7fa02d526800 20 add_watcher() i=4 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.781+0000 7fa02d526800 20 add_watcher() i=5 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.781+0000 7fa02d526800 20 add_watcher() i=6 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.782+0000 7fa02d526800 20 add_watcher() i=7 2024-09-14T11:14:51.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.782+0000 7fa02d526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:51.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.784+0000 7f9edffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.785+0000 7fa02d526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.785+0000 7fa02d526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.785+0000 7fa02d526800 5 note: GC not initialized 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.785+0000 7f9edefe5640 20 reqs_thread_entry: start 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.785+0000 7fa02d526800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.785+0000 7fa02d526800 20 Filter name: none 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.785+0000 7f9edcfe1640 20 reqs_thread_entry: start 2024-09-14T11:14:51.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.786+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.786+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:51.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.786+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.787+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:51.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.787+0000 7fa02d526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:51.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.787+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.787+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:51.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.787+0000 7fa02d526800 20 rados->read ofs=0 len=0 2024-09-14T11:14:51.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.788+0000 7fa02d526800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:51.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.788+0000 7fa02d526800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:51.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.789+0000 7f9edffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.792+0000 7fa02d526800 20 remove_watcher() i=0 2024-09-14T11:14:51.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.792+0000 7fa02d526800 2 removed watcher, disabling cache 2024-09-14T11:14:51.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.793+0000 7fa02d526800 20 remove_watcher() i=1 2024-09-14T11:14:51.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.794+0000 7fa02d526800 20 remove_watcher() i=2 2024-09-14T11:14:51.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.796+0000 7fa02d526800 20 remove_watcher() i=3 2024-09-14T11:14:51.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.797+0000 7fa02d526800 20 remove_watcher() i=4 2024-09-14T11:14:51.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.798+0000 7fa02d526800 20 remove_watcher() i=5 2024-09-14T11:14:51.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.799+0000 7fa02d526800 20 remove_watcher() i=6 2024-09-14T11:14:51.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:51.800+0000 7fa02d526800 20 remove_watcher() i=7 2024-09-14T11:14:51.812 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:51.812 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:51.812 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.26 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:14:51.812 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:51.814 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.814 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.818 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.818 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.861 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.861 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.876 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-14T11:14:51.876 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:51.877 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.877 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.887 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.887 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.930 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.930 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.940 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.940 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.948 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.948 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.955 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.956 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.962 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.963 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.970 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.970 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.977 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.977 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.984 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.984 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.991 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.991 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:51.999 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:51.999 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.006 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.006 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.013 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.013 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.021 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.021 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.028 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.028 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.036 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.036 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.043 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.043 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.050 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.050 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.058 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.058 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.066 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.066 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.073 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:52.073 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:52.080 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:14:52.109 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:52.110 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:52.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.151+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.152+0000 7f6ba1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.152+0000 7f6ba1c40800 20 realm 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.152+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.153+0000 7f6ba1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.153+0000 7f6ba1c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.153+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.153+0000 7f6ba1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.153+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.154+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.154+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.154+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.154+0000 7f6ba1c40800 20 searching for the correct realm 2024-09-14T11:14:52.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.156+0000 7f6b9ef29640 0 -- 172.21.15.2:0/2315605431 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f6b90086070 msgr2=0x7f6b9009d420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:52.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.362+0000 7f6b9f72a640 0 -- 172.21.15.2:0/2315605431 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f6b94046430 msgr2=0x7f6b94048620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:52.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.568+0000 7f6ba1c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.568+0000 7f6ba1c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.568+0000 7f6ba1c40800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.568+0000 7f6ba1c40800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.568+0000 7f6ba1c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.568+0000 7f6ba1c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 zone default found 2024-09-14T11:14:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 4 Realm: () 2024-09-14T11:14:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:52.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 zonegroup default 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.569+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.570+0000 7f6ba1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.570+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.570+0000 7f6ba1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.570+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.570+0000 7f6ba1c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.570+0000 7f6ba1c40800 20 started sync module instance, tier type = 2024-09-14T11:14:52.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.570+0000 7f6ba1c40800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:52.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.580+0000 7f6ba1c40800 20 add_watcher() i=0 2024-09-14T11:14:52.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.580+0000 7f6ba1c40800 20 add_watcher() i=1 2024-09-14T11:14:52.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.580+0000 7f6ba1c40800 20 add_watcher() i=2 2024-09-14T11:14:52.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.580+0000 7f6ba1c40800 20 add_watcher() i=3 2024-09-14T11:14:52.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.580+0000 7f6ba1c40800 20 add_watcher() i=4 2024-09-14T11:14:52.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.580+0000 7f6ba1c40800 20 add_watcher() i=5 2024-09-14T11:14:52.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.580+0000 7f6ba1c40800 20 add_watcher() i=6 2024-09-14T11:14:52.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.581+0000 7f6ba1c40800 20 add_watcher() i=7 2024-09-14T11:14:52.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.581+0000 7f6ba1c40800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.582+0000 7f6a55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f6ba1c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f6ba1c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f6ba1c40800 5 note: GC not initialized 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f6a54fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f6ba1c40800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f6ba1c40800 20 Filter name: none 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f69ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:52.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.583+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.584+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:52.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.584+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.585+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:52.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.585+0000 7f6ba1c40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:52.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.585+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.585+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:52.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.585+0000 7f6ba1c40800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.585+0000 7f6ba1c40800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:52.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.585+0000 7f6ba1c40800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:52.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.587+0000 7f6a55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.589+0000 7f6ba1c40800 20 remove_watcher() i=0 2024-09-14T11:14:52.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.589+0000 7f6ba1c40800 2 removed watcher, disabling cache 2024-09-14T11:14:52.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.590+0000 7f6ba1c40800 20 remove_watcher() i=1 2024-09-14T11:14:52.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.591+0000 7f6ba1c40800 20 remove_watcher() i=2 2024-09-14T11:14:52.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.592+0000 7f6ba1c40800 20 remove_watcher() i=3 2024-09-14T11:14:52.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.593+0000 7f6ba1c40800 20 remove_watcher() i=4 2024-09-14T11:14:52.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.594+0000 7f6ba1c40800 20 remove_watcher() i=5 2024-09-14T11:14:52.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.596+0000 7f6ba1c40800 20 remove_watcher() i=6 2024-09-14T11:14:52.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.597+0000 7f6ba1c40800 20 remove_watcher() i=7 2024-09-14T11:14:52.606 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.606 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:52.607 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:52.607 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.608 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-14T11:14:52.644 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:52.644 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:52.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.685+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 realm 2024-09-14T11:14:52.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 searching for the correct realm 2024-09-14T11:14:52.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.692+0000 7f3e3c4de640 0 -- 172.21.15.2:0/3377105795 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f3e30017050 msgr2=0x7f3e30084150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.695+0000 7f3e3bcdd640 0 -- 172.21.15.2:0/3377105795 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3e30031b60 msgr2=0x7f3e300732f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:52.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 zone default found 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 Realm: () 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 zonegroup default 2024-09-14T11:14:52.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 started sync module instance, tier type = 2024-09-14T11:14:52.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=0 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=1 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=2 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=3 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=4 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=5 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=6 2024-09-14T11:14:52.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=7 2024-09-14T11:14:52.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.913+0000 7f3e3ff2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.915+0000 7f3cf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.915+0000 7f3e3ff2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.915+0000 7f3e3ff2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 note: GC not initialized 2024-09-14T11:14:52.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3cf0fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:52.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:52.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 Filter name: none 2024-09-14T11:14:52.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3c6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 : miss 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.917+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:52.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 2024-09-14T11:14:52.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:52.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:52.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:52.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27, ofs0, ns] 2024-09-14T11:14:52.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94181868154256 notifier 6518 bl.length()=939 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_sources= new_sources= 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential sources added=[] removed=[] 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_dests= new_dests= 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential dests added=[] removed=[] 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e3ff2e800 time 2024-09-14T11:14:52.922526+0000 2024-09-14T11:14:52.920 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e4178c76a] 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:52.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.922+0000 7f3e3ff2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e3ff2e800 time 2024-09-14T11:14:52.922526+0000 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e4178c76a] 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.922 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:14:52.923 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f3e3ff2e800 thread_name:radosgw-admin 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e4043e6f0] 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e4048b99c] 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e4178c7c4] 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:52.936 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:52.923+0000 7f3e3ff2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f3e3ff2e800 thread_name:radosgw-admin 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e4043e6f0] 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e4048b99c] 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e4178c7c4] 2024-09-14T11:14:52.937 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) unregister_commands rotate-key 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.938 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding auth protocol: cephx 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding auth protocol: cephx 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding auth protocol: cephx 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.939 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: starting msgr at 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: starting objecter 2024-09-14T11:14:52.940 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command objecter_requests hook 0x55a86cbc4cb0 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: setting wanted keys 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: calling monclient init 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding auth protocol: cephx 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding auth protocol: cephx 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding auth protocol: cephx 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.941 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key hook 0x55a86cbc1398 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86ca39ab0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cb03a50 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cb07aa0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.942 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.221949s 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86ca39ab0 auth_method 0 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cb03a50 auth_method 0 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cb07aa0 auth_method 0 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.943 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_done global_id 6831 payload 824 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 1 monclient: found mon.noname-a 2024-09-14T11:14:52.944 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: dump: 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.945 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: dump: 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.946 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6831 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:14:52.670+0000 7f3d29e0b640 4 set_mon_vals no callback set 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 1 librados: init done 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:14:52.672+0000 7f3d23fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:14:52.672+0000 7f3d23fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:14:52.672+0000 7f3d23fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:14:52.672+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x7f3d24077230 auth_method 0 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:14:52.673+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x55a86cbe9b00 auth_method 0 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:14:52.673+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x55a86cc0cbc0 auth_method 0 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:14:52.675+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x55a86cc11c50 auth_method 0 2024-09-14T11:14:52.947 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding auth protocol: cephx 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding auth protocol: cephx 2024-09-14T11:14:52.948 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding auth protocol: cephx 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.949 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55a86cc1b460 EEXIST 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding auth protocol: cephx 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding auth protocol: cephx 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding auth protocol: cephx 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:52.950 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key cmddesc rotate-key hook 0x55a86cc14d20 EEXIST 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cc3fcd0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cc41f20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86cc544a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.229092s 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cc41f20 auth_method 0 2024-09-14T11:14:52.951 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cc544a0 auth_method 0 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86cc3fcd0 auth_method 0 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.952 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_done global_id 6512 payload 824 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: dump: 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.953 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: dump: 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.954 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6512 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:14:52.677+0000 7f3e3ccdf640 4 set_mon_vals no callback set 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:14:52.679+0000 7f3d217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:14:52.679+0000 7f3d217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:14:52.679+0000 7f3d217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:52.955 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:14:52.680+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3d14077140 auth_method 0 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: get_monmap_and_config 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.956 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding auth protocol: cephx 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding auth protocol: cephx 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding auth protocol: cephx 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:52.957 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding auth protocol: cephx 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding auth protocol: cephx 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding auth protocol: cephx 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:52.958 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key cmddesc rotate-key hook 0x7ffc0cdf5948 EEXIST 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cc93c50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86cc63a60 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cc8f010 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.959 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.233273s 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cc63a60 auth_method 0 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cc8f010 auth_method 0 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86cc93c50 auth_method 0 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.960 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_done global_id 6837 payload 274 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 1 monclient: found mon.noname-a 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:14:52.961 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: dump: 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:14:52.962 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: dump: 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6837 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 4 set_mon_vals no callback set 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 10 monclient: shutdown 2024-09-14T11:14:52.963 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding auth protocol: cephx 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding auth protocol: cephx 2024-09-14T11:14:52.964 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding auth protocol: cephx 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.965 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 1 librados: starting msgr at 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 1 librados: starting objecter 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55a86cc63760 EEXIST 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 1 librados: setting wanted keys 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 1 librados: calling monclient init 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding auth protocol: cephx 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding auth protocol: cephx 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding auth protocol: cephx 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:52.966 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key cmddesc rotate-key hook 0x55a86cc3e178 EEXIST 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86cc63a60 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:52.967 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cc8f010 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cc93c50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.235567s 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cc8f010 auth_method 0 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86cc63a60 auth_method 0 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.968 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cc93c50 auth_method 0 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.969 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 1 monclient: found mon.noname-c 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: dump: 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.970 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: dump: 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.971 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6518 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:14:52.684+0000 7f3d1affd640 4 set_mon_vals no callback set 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 1 librados: init done 2024-09-14T11:14:52.972 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cr dump hook 0x55a86cc94048 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:14:52.685+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:14:52.686+0000 7f3d197fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:14:52.686+0000 7f3d197fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:14:52.686+0000 7f3d197fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:14:52.686+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3d04077260 auth_method 0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:14:52.686+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x55a86ccad6e0 auth_method 0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 realm 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.973 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:14:52.688+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x55a86ccb1a70 auth_method 0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 searching for the correct realm 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:14:52.689+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x55a86ccb6bf0 auth_method 0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:14:52.689+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x7f3e30017050 auth_method 0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:14:52.690+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3e34055410 auth_method 0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:14:52.691+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x7f3e2c07cb70 auth_method 0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:14:52.692+0000 7f3e3c4de640 0 -- 172.21.15.2:0/3377105795 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f3e30017050 msgr2=0x7f3e30084150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:14:52.692+0000 7f3d197fa640 1 client.6518.objecter ms_handle_reset 0x7f3e30017050 session 0x7f3e3001ae70 osd.7 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:14:52.692+0000 7f3d197fa640 10 monclient: _renew_subs 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:14:52.692+0000 7f3d197fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:52.974 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:14:52.692+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x7f3d04087180 auth_method 0 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:14:52.693+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x7f3e300690f0 auth_method 0 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:14:52.695+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3e30031b60 auth_method 0 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:14:52.695+0000 7f3e3bcdd640 0 -- 172.21.15.2:0/3377105795 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3e30031b60 msgr2=0x7f3e300732f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:14:52.896+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3e30031b60 auth_method 0 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:52.975 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 zone default found 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 Realm: () 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 zonegroup default 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:52.976 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 started sync module instance, tier type = 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=0 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=1 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=2 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=3 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=4 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=5 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=6 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=7 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding auth protocol: cephx 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding auth protocol: cephx 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding auth protocol: cephx 2024-09-14T11:14:52.977 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:14:52.915+0000 7f3cf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:52.978 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache list hook 0x55a86cc84780 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache inspect hook 0x55a86cc84780 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache erase hook 0x55a86cc84780 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache zap hook 0x55a86cc84780 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 note: GC not initialized 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:14:52.916+0000 7f3cf0fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace show hook 0x7f3e34065040 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace history hook 0x7f3e34065040 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace active hook 0x7f3e34065040 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace active_short hook 0x7f3e34065040 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 Filter name: none 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:14:52.916+0000 7f3c6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.979 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 : miss 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:52.980 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27, ofs0, ns] 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94181868154256 notifier 6518 bl.length()=939 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_sources= new_sources= 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential sources added=[] removed=[] 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_dests= new_dests= 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential dests added=[] removed=[] 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:14:52.922+0000 7f3e3ff2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e3ff2e800 time 2024-09-14T11:14:52.922526+0000 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.981 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e4178c76a] 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:14:52.923+0000 7f3e3ff2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f3e3ff2e800 thread_name:radosgw-admin 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e4043e6f0] 2024-09-14T11:14:52.982 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e4048b99c] 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e4178c7c4] 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:52.983 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:14:52.984 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:14:52.985 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:14:52.986 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:14:52.987 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:52.988 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:52.989 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3c6a7fc640 / http_manager 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3cf0fe1640 / http_manager 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3cf1fe3640 / rgw_dt_lg_renew 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d197fa640 / ms_dispatch 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d1affd640 / io_context_pool 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d217fa640 / ms_dispatch 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d23fff640 / ms_dispatch 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d29e0b640 / io_context_pool 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3b4dc640 / msgr-worker-2 2024-09-14T11:14:52.990 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3bcdd640 / msgr-worker-1 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3c4de640 / msgr-worker-0 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3ccdf640 / io_context_pool 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3ff2e800 / radosgw-admin 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.105557.log 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) unregister_commands rotate-key 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:52.991 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding auth protocol: cephx 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding auth protocol: cephx 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding auth protocol: cephx 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.992 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: crc 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:14:52.668+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc6eb0) adding con mode: secure 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: starting msgr at 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: starting objecter 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command objecter_requests hook 0x55a86cbc4cb0 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: setting wanted keys 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 1 librados: calling monclient init 2024-09-14T11:14:52.993 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding auth protocol: cephx 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding auth protocol: cephx 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding auth protocol: cephx 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.994 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: crc 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cbc1250) adding con mode: secure 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key hook 0x55a86cbc1398 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86ca39ab0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cb03a50 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cb07aa0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:14:52.669+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.221949s 2024-09-14T11:14:52.995 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86ca39ab0 auth_method 0 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cb03a50 auth_method 0 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cb07aa0 auth_method 0 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.996 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:14:52.670+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:14:52.670+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_done global_id 6831 payload 824 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient: _finish_hunting 0 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 1 monclient: found mon.noname-a 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:14:52.670+0000 7f3e3bcdd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: dump: 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.997 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: _finish_auth 0 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: _check_auth_tickets 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:14:52.670+0000 7f3d23fff640 10 monclient: dump: 2024-09-14T11:14:52.998 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6831 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:14:52.670+0000 7f3d29e0b640 4 set_mon_vals no callback set 2024-09-14T11:14:52.999 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:14:52.670+0000 7f3e3ff2e800 1 librados: init done 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:14:52.672+0000 7f3d23fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:14:52.672+0000 7f3d23fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:14:52.672+0000 7f3d23fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:14:52.672+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x7f3d24077230 auth_method 0 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:14:52.673+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x55a86cbe9b00 auth_method 0 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:14:52.673+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x55a86cc0cbc0 auth_method 0 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:14:52.675+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x55a86cc11c50 auth_method 0 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:53.000 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding auth protocol: cephx 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding auth protocol: cephx 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding auth protocol: cephx 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:14:52.675+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:53.001 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: crc 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc15d30) adding con mode: secure 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55a86cc1b460 EEXIST 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding auth protocol: cephx 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding auth protocol: cephx 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding auth protocol: cephx 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:53.002 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: crc 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc14bd8) adding con mode: secure 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:14:52.676+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key cmddesc rotate-key hook 0x55a86cc14d20 EEXIST 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:14:53.003 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cc3fcd0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cc41f20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86cc544a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.229092s 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cc41f20 auth_method 0 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cc544a0 auth_method 0 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.004 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:14:52.677+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86cc3fcd0 auth_method 0 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:14:52.677+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_done global_id 6512 payload 824 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 1 monclient: found mon.noname-c 2024-09-14T11:14:53.005 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:14:52.677+0000 7f3e3b4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: dump: 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: _finish_auth 0 2024-09-14T11:14:53.006 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: _check_auth_tickets 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:14:52.677+0000 7f3d217fa640 10 monclient: dump: 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.007 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6512 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:14:52.677+0000 7f3e3ccdf640 4 set_mon_vals no callback set 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:14:52.677+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:14:52.679+0000 7f3d217fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:14:52.679+0000 7f3d217fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:14:52.679+0000 7f3d217fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:14:52.680+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3d14077140 auth_method 0 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: get_monmap_and_config 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:53.008 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding auth protocol: cephx 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding auth protocol: cephx 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding auth protocol: cephx 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:53.009 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: crc 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc5f610) adding con mode: secure 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding auth protocol: cephx 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding auth protocol: cephx 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding auth protocol: cephx 2024-09-14T11:14:53.010 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: crc 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5800) adding con mode: secure 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:14:52.680+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key cmddesc rotate-key hook 0x7ffc0cdf5948 EEXIST 2024-09-14T11:14:53.011 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cc93c50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86cc63a60 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cc8f010 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.233273s 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cc63a60 auth_method 0 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.012 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cc8f010 auth_method 0 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86cc93c50 auth_method 0 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.013 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:14:52.681+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:14:52.681+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_done global_id 6837 payload 274 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 1 monclient: found mon.noname-a 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:14:52.681+0000 7f3e3b4dc640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: dump: 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:53.014 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: _finish_auth 0 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: _check_auth_tickets 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:53.015 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:14:52.681+0000 7f3d1affd640 10 monclient: dump: 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6837 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 10 monclient: get_monmap_and_config success 2024-09-14T11:14:53.016 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:14:52.681+0000 7f3e3ff2e800 4 set_mon_vals no callback set 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 10 monclient: shutdown 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 10 monclient: build_initial_monmap 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 1 build_initial for_mkfs: 0 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 10 monclient: monmap: 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:14:53.017 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding auth protocol: cephx 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding auth protocol: cephx 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding auth protocol: cephx 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:53.018 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: crc 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc648a0) adding con mode: secure 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 1 librados: starting msgr at 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 1 librados: starting objecter 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:14:52.682+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command objecter_requests cmddesc objecter_requests hook 0x55a86cc63760 EEXIST 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 1 librados: setting wanted keys 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 1 librados: calling monclient init 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient: init 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding auth protocol: cephx 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding auth protocol: cephx 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding auth protocol: cephx 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:53.019 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: crc 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 AuthRegistry(0x55a86cc3e030) adding con mode: secure 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command rotate-key cmddesc rotate-key hook 0x55a86cc3e178 EEXIST 2024-09-14T11:14:53.020 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient: _reopen_session rank -1 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-a con 0x55a86cc63a60 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-c con 0x55a86cc8f010 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): picked mon.noname-b con 0x55a86cc93c50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): start opening mon connection 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): _renew_subs 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:14:52.683+0000 7f3e3ff2e800 10 monclient(hunting): authenticate will time out at 1919.235567s 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request con 0x55a86cc8f010 auth_method 0 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.021 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request con 0x55a86cc63a60 auth_method 0 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:14:52.683+0000 7f3e3bcdd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request con 0x55a86cc93c50 auth_method 0 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:14:53.022 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:14:52.683+0000 7f3e3c4de640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient(hunting): handle_auth_done global_id 6518 payload 824 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient: _finish_hunting 0 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 1 monclient: found mon.noname-c 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:14:52.683+0000 7f3e3b4dc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: dump: 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.023 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: _finish_auth 0 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: _check_auth_tickets 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:14:52.684+0000 7f3d197fa640 10 monclient: dump: 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:14:53.024 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 5 monclient: authenticate success, global_id 6518 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:14:52.684+0000 7f3d1affd640 4 set_mon_vals no callback set 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _renew_subs 2024-09-14T11:14:53.025 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 1 librados: init done 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:14:52.684+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cr dump hook 0x55a86cc94048 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:14:52.685+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:14:52.686+0000 7f3d197fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:14:52.686+0000 7f3d197fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:14:52.686+0000 7f3d197fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:14:52.686+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3d04077260 auth_method 0 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:14:52.686+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x55a86ccad6e0 auth_method 0 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 realm 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.026 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:14:52.687+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:14:52.688+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x55a86ccb1a70 auth_method 0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:14:52.688+0000 7f3e3ff2e800 20 searching for the correct realm 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:14:52.689+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x55a86ccb6bf0 auth_method 0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:14:52.689+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x7f3e30017050 auth_method 0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:14:52.690+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3e34055410 auth_method 0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:14:52.691+0000 7f3e3b4dc640 10 monclient: get_auth_request con 0x7f3e2c07cb70 auth_method 0 2024-09-14T11:14:53.027 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:14:52.692+0000 7f3e3c4de640 0 -- 172.21.15.2:0/3377105795 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f3e30017050 msgr2=0x7f3e30084150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:14:52.692+0000 7f3d197fa640 1 client.6518.objecter ms_handle_reset 0x7f3e30017050 session 0x7f3e3001ae70 osd.7 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:14:52.692+0000 7f3d197fa640 10 monclient: _renew_subs 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:14:52.692+0000 7f3d197fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:14:52.692+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x7f3d04087180 auth_method 0 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:14:52.693+0000 7f3e3c4de640 10 monclient: get_auth_request con 0x7f3e300690f0 auth_method 0 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:14:52.695+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3e30031b60 auth_method 0 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:14:52.695+0000 7f3e3bcdd640 0 -- 172.21.15.2:0/3377105795 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3e30031b60 msgr2=0x7f3e300732f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:14:52.896+0000 7f3e3bcdd640 10 monclient: get_auth_request con 0x7f3e30031b60 auth_method 0 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:53.028 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:14:52.901+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 zone default found 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 Realm: () 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 zonegroup default 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:14:52.902+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.029 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:14:52.903+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 started sync module instance, tier type = 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:14:52.904+0000 7f3e3ff2e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=0 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=1 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=2 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=3 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=4 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=5 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=6 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 20 add_watcher() i=7 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:14:52.913+0000 7f3e3ff2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:53.030 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding auth protocol: cephx 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding auth protocol: cephx 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding auth protocol: cephx 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: crc 2024-09-14T11:14:53.031 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 AuthRegistry(0x7ffc0cdf5ce0) adding con mode: secure 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:14:52.915+0000 7f3cf1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache list hook 0x55a86cc84780 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache inspect hook 0x55a86cc84780 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache erase hook 0x55a86cc84780 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command cache zap hook 0x55a86cc84780 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:14:52.915+0000 7f3e3ff2e800 5 note: GC not initialized 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:14:52.916+0000 7f3cf0fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace show hook 0x7f3e34065040 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace history hook 0x7f3e34065040 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace active hook 0x7f3e34065040 2024-09-14T11:14:53.032 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 5 asok(0x55a86c9a1270) register_command sync trace active_short hook 0x7f3e34065040 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 Filter name: none 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:14:52.916+0000 7f3c6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 : miss 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:14:52.916+0000 7f3e3ff2e800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:53.033 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:14:52.917+0000 7f3e3ff2e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27, ofs0, ns] 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464347 cookie 94181868154256 notifier 6518 bl.length()=939 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:14:52.921+0000 7f3d1affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_sources= new_sources= 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential sources added=[] removed=[] 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_dests= new_dests= 2024-09-14T11:14:53.034 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:14:52.921+0000 7f3e3ff2e800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential dests added=[] removed=[] 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:14:52.922+0000 7f3e3ff2e800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3e3ff2e800 time 2024-09-14T11:14:52.922526+0000 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3e4178c76a] 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:14:52.923+0000 7f3e3ff2e800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f3e3ff2e800 thread_name:radosgw-admin 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3e4043e6f0] 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3e4048b99c] 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3e4178c7c4] 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f3e4178c928] 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a86a3ec0b1] 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8900e) [0x55a86a90000e] 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55a86a3fbefd] 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:14:53.036 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3e40429590] 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:14:53.037 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:14:53.038 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:14:53.039 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:14:53.040 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:14:53.041 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:14:53.042 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3c6a7fc640 / http_manager 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3cf0fe1640 / http_manager 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3cf1fe3640 / rgw_dt_lg_renew 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d197fa640 / ms_dispatch 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d1affd640 / io_context_pool 2024-09-14T11:14:53.043 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d217fa640 / ms_dispatch 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d23fff640 / ms_dispatch 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3d29e0b640 / io_context_pool 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3b4dc640 / msgr-worker-2 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3bcdd640 / msgr-worker-1 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3c4de640 / msgr-worker-0 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3ccdf640 / io_context_pool 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: 7f3e3ff2e800 / radosgw-admin 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:14:52.924219Z_8216204b-700f-4844-866d-5d488e13694c/log 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:14:53.044 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.002+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.003+0000 7fc3fce12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.003+0000 7fc3fce12800 20 realm 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.003+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.004+0000 7fc3fce12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.004+0000 7fc3fce12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.004+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.004+0000 7fc3fce12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.004+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.004+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.004+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.005+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.005+0000 7fc3fce12800 20 searching for the correct realm 2024-09-14T11:14:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.008+0000 7fc3f7cca640 0 -- 172.21.15.2:0/3500924732 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fc3e8086070 msgr2=0x7fc3e80d49c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:53.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.011+0000 7fc3f84cb640 0 -- 172.21.15.2:0/3500924732 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fc3ec04e8f0 msgr2=0x7fc3ec0353c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:14:53.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.216+0000 7fc3fce12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:53.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.216+0000 7fc3fce12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:53.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.216+0000 7fc3fce12800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:53.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.216+0000 7fc3fce12800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:53.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.216+0000 7fc3fce12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:53.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.216+0000 7fc3fce12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.216+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 zone default found 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 4 Realm: () 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 zonegroup default 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.217+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.218+0000 7fc3fce12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.218+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.218+0000 7fc3fce12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.218+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.218+0000 7fc3fce12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.218+0000 7fc3fce12800 20 started sync module instance, tier type = 2024-09-14T11:14:53.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.218+0000 7fc3fce12800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.228+0000 7fc3fce12800 20 add_watcher() i=0 2024-09-14T11:14:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.228+0000 7fc3fce12800 20 add_watcher() i=1 2024-09-14T11:14:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.228+0000 7fc3fce12800 20 add_watcher() i=2 2024-09-14T11:14:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.228+0000 7fc3fce12800 20 add_watcher() i=3 2024-09-14T11:14:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.228+0000 7fc3fce12800 20 add_watcher() i=4 2024-09-14T11:14:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.228+0000 7fc3fce12800 20 add_watcher() i=5 2024-09-14T11:14:53.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.228+0000 7fc3fce12800 20 add_watcher() i=6 2024-09-14T11:14:53.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.229+0000 7fc3fce12800 20 add_watcher() i=7 2024-09-14T11:14:53.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.229+0000 7fc3fce12800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:53.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.231+0000 7fc2aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.231+0000 7fc3fce12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.231+0000 7fc3fce12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.231+0000 7fc3fce12800 5 note: GC not initialized 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.232+0000 7fc2adfdb640 20 reqs_thread_entry: start 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.232+0000 7fc3fce12800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.232+0000 7fc3fce12800 20 Filter name: none 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.232+0000 7fc21f7fe640 20 reqs_thread_entry: start 2024-09-14T11:14:53.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.232+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.233+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:53.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.233+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.233+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:14:53.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.233+0000 7fc3fce12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:53.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.233+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.233+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:53.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.233+0000 7fc3fce12800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.234+0000 7fc3fce12800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:14:53.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.234+0000 7fc3fce12800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:14:53.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.235+0000 7fc2aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:53.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.237+0000 7fc3fce12800 20 remove_watcher() i=0 2024-09-14T11:14:53.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.237+0000 7fc3fce12800 2 removed watcher, disabling cache 2024-09-14T11:14:53.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.238+0000 7fc3fce12800 20 remove_watcher() i=1 2024-09-14T11:14:53.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.239+0000 7fc3fce12800 20 remove_watcher() i=2 2024-09-14T11:14:53.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.240+0000 7fc3fce12800 20 remove_watcher() i=3 2024-09-14T11:14:53.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.241+0000 7fc3fce12800 20 remove_watcher() i=4 2024-09-14T11:14:53.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.242+0000 7fc3fce12800 20 remove_watcher() i=5 2024-09-14T11:14:53.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.243+0000 7fc3fce12800 20 remove_watcher() i=6 2024-09-14T11:14:53.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.244+0000 7fc3fce12800 20 remove_watcher() i=7 2024-09-14T11:14:53.253 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.253 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:14:53.254 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:14:53.254 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:14:53.255 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:53.255 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:53.263 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:14:53.263 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:14:53.307 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:14:53.340 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:14:53.340 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:14:53.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.382+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 20 realm 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.384+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.385+0000 7f88d590c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:53.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.385+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.385+0000 7f88d590c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:14:53.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.385+0000 7f88d590c800 20 searching for the correct realm 2024-09-14T11:14:53.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.389+0000 7f88d2bf5640 0 -- 172.21.15.2:0/1933146495 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x5650e34e3b40 msgr2=0x5650e34e6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:53.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.392+0000 7f88d33f6640 0 -- 172.21.15.2:0/1933146495 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f88c80ce850 msgr2=0x7f88c80aa680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:14:53.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:14:53.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:14:53.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:14:53.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:14:53.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:14:53.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:14:53.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.396+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 zone default found 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 4 Realm: () 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:14:53.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 zonegroup default 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 started sync module instance, tier type = 2024-09-14T11:14:53.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.397+0000 7f88d590c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:14:53.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.406+0000 7f88d590c800 20 add_watcher() i=0 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.406+0000 7f88d590c800 20 add_watcher() i=1 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.406+0000 7f88d590c800 20 add_watcher() i=2 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.406+0000 7f88d590c800 20 add_watcher() i=3 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.406+0000 7f88d590c800 20 add_watcher() i=4 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.406+0000 7f88d590c800 20 add_watcher() i=5 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.406+0000 7f88d590c800 20 add_watcher() i=6 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.407+0000 7f88d590c800 20 add_watcher() i=7 2024-09-14T11:14:53.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.407+0000 7f88d590c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:14:53.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.409+0000 7f8789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.409+0000 7f88d590c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.409+0000 7f88d590c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.409+0000 7f88d590c800 5 note: GC not initialized 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.409+0000 7f8788fe1640 20 reqs_thread_entry: start 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.409+0000 7f88d590c800 20 init_complete bucket index max shards: 1 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.409+0000 7f88d590c800 20 Filter name: none 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f87027fc640 20 reqs_thread_entry: start 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:14:53.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:14:53.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:14:53.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 : miss 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 20 rados->read ofs=0 len=0 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:14:53.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.410+0000 7f88d590c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 2024-09-14T11:14:53.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.411+0000 7f88d590c800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to be held by another RGW process; skipping for now 2024-09-14T11:14:53.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.412+0000 7f8789fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:14:53.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.415+0000 7f88d590c800 20 remove_watcher() i=0 2024-09-14T11:14:53.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.415+0000 7f88d590c800 2 removed watcher, disabling cache 2024-09-14T11:14:53.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.417+0000 7f88d590c800 20 remove_watcher() i=1 2024-09-14T11:14:53.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.418+0000 7f88d590c800 20 remove_watcher() i=2 2024-09-14T11:14:53.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.419+0000 7f88d590c800 20 remove_watcher() i=3 2024-09-14T11:14:53.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.420+0000 7f88d590c800 20 remove_watcher() i=4 2024-09-14T11:14:53.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.420+0000 7f88d590c800 20 remove_watcher() i=5 2024-09-14T11:14:53.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.421+0000 7f88d590c800 20 remove_watcher() i=6 2024-09-14T11:14:53.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:14:53.423+0000 7f88d590c800 20 remove_watcher() i=7 2024-09-14T11:14:53.432 INFO:tasks.workunit.client.0.smithi002.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:15:23.464 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:15:23.501 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:23.501 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:23.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.548+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.549+0000 7f8363724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.549+0000 7f8363724800 20 realm 2024-09-14T11:15:23.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.549+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.550+0000 7f8363724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.550+0000 7f8363724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:23.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.550+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.550+0000 7f8363724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.550+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.551+0000 7f8363724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:23.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.551+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.551+0000 7f8363724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:23.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.551+0000 7f8363724800 20 searching for the correct realm 2024-09-14T11:15:23.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.554+0000 7f835ec67640 0 -- 172.21.15.2:0/3883797833 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8350022b80 msgr2=0x7f835006b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:23.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.558+0000 7f835f468640 0 -- 172.21.15.2:0/3883797833 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f8354096910 msgr2=0x7f83540863c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:23.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:23.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:23.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:23.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:23.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:23.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:23.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:23.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.767+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:23.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 zone default found 2024-09-14T11:15:23.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 4 Realm: () 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 zonegroup default 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.768+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.769+0000 7f8363724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.769+0000 7f8363724800 20 started sync module instance, tier type = 2024-09-14T11:15:23.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.769+0000 7f8363724800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:23.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.781+0000 7f8363724800 20 add_watcher() i=0 2024-09-14T11:15:23.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.781+0000 7f8363724800 20 add_watcher() i=1 2024-09-14T11:15:23.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.781+0000 7f8363724800 20 add_watcher() i=2 2024-09-14T11:15:23.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.781+0000 7f8363724800 20 add_watcher() i=3 2024-09-14T11:15:23.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.781+0000 7f8363724800 20 add_watcher() i=4 2024-09-14T11:15:23.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.781+0000 7f8363724800 20 add_watcher() i=5 2024-09-14T11:15:23.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.781+0000 7f8363724800 20 add_watcher() i=6 2024-09-14T11:15:23.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.782+0000 7f8363724800 20 add_watcher() i=7 2024-09-14T11:15:23.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.782+0000 7f8363724800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:23.782 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.784+0000 7f8215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:23.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.784+0000 7f8363724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:23.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.784+0000 7f8363724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:23.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.784+0000 7f8363724800 5 note: GC not initialized 2024-09-14T11:15:23.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.784+0000 7f8214fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:23.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.784+0000 7f8363724800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:23.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.784+0000 7f8363724800 20 Filter name: none 2024-09-14T11:15:23.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f818e7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:23.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f8363724800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-14T11:15:23.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f8363724800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f8363724800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f8363724800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f8363724800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 : miss 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.785+0000 7f8363724800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.786+0000 7f8363724800 20 rados_obj.operate() r=0 bl.length=455 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.786+0000 7f8363724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.786+0000 7f8363724800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.786+0000 7f8363724800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:23.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.786+0000 7f8363724800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:23.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.786+0000 7f8363724800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 2024-09-14T11:15:23.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.787+0000 7f8363724800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:23.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.791+0000 7f8363724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:15:23.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.791+0000 7f8363724800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:15:23.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.791+0000 7f8363724800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:23.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.791+0000 7f8363724800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27, ofs0, ns] 2024-09-14T11:15:23.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8242ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464348 cookie 93991581150496 notifier 6566 bl.length()=939 2024-09-14T11:15:23.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8242ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:15:23.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8242ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:15:23.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8242ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:23.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_sources= new_sources= 2024-09-14T11:15:23.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential sources added=[] removed=[] 2024-09-14T11:15:23.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_dests= new_dests= 2024-09-14T11:15:23.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.792+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential dests added=[] removed=[] 2024-09-14T11:15:23.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.795+0000 7f8363724800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.27.2.0 2024-09-14T11:15:23.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.795+0000 7f8363724800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.27.2.0 2024-09-14T11:15:23.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.795+0000 7f8363724800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.27.2.1 2024-09-14T11:15:23.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.795+0000 7f8363724800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.27.2.1 2024-09-14T11:15:23.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.795+0000 7f8363724800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.27.0 2024-09-14T11:15:23.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.798+0000 7f8363724800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:23.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.798+0000 7f8363724800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 2024-09-14T11:15:23.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.799+0000 7f8363724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:15:23.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.799+0000 7f8363724800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:15:23.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.799+0000 7f8363724800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:23.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.799+0000 7f8363724800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27, ofs0, ns] 2024-09-14T11:15:23.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f82427fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464349 cookie 93991581150496 notifier 6566 bl.length()=939 2024-09-14T11:15:23.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f82427fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:15:23.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f82427fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:15:23.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f82427fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:23.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_sources= new_sources= 2024-09-14T11:15:23.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential sources added=[] removed=[] 2024-09-14T11:15:23.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_dests= new_dests= 2024-09-14T11:15:23.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.800+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential dests added=[] removed=[] 2024-09-14T11:15:23.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.802+0000 7f8363724800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.27.0 2024-09-14T11:15:23.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.802+0000 7f8363724800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:23.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.802+0000 7f8363724800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 2024-09-14T11:15:23.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.803+0000 7f8363724800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:15:23.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.803+0000 7f8363724800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:15:23.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.803+0000 7f8363724800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:23.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.803+0000 7f8363724800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27, ofs0, ns] 2024-09-14T11:15:23.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8242ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464350 cookie 93991581150496 notifier 6566 bl.length()=907 2024-09-14T11:15:23.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8242ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 info.flags=0x17 2024-09-14T11:15:23.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8242ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 to cache LRU end 2024-09-14T11:15:23.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8242ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:23.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_sources= new_sources= 2024-09-14T11:15:23.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential sources added=[] removed=[] 2024-09-14T11:15:23.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): orig_dests= new_dests= 2024-09-14T11:15:23.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.804+0000 7f8363724800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[17edae97-cd6b-4c90-863d-862429a20cf3.4538.27]): potential dests added=[] removed=[] 2024-09-14T11:15:23.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.806+0000 7f8363724800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 1 shards to 2 shards completed successfully 2024-09-14T11:15:23.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.808+0000 7f8215fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:23.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.810+0000 7f8363724800 20 remove_watcher() i=0 2024-09-14T11:15:23.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.810+0000 7f8363724800 2 removed watcher, disabling cache 2024-09-14T11:15:23.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.811+0000 7f8363724800 20 remove_watcher() i=1 2024-09-14T11:15:23.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.812+0000 7f8363724800 20 remove_watcher() i=2 2024-09-14T11:15:23.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.813+0000 7f8363724800 20 remove_watcher() i=3 2024-09-14T11:15:23.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.814+0000 7f8363724800 20 remove_watcher() i=4 2024-09-14T11:15:23.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.815+0000 7f8363724800 20 remove_watcher() i=5 2024-09-14T11:15:23.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.817+0000 7f8363724800 20 remove_watcher() i=6 2024-09-14T11:15:23.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.818+0000 7f8363724800 20 remove_watcher() i=7 2024-09-14T11:15:23.829 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-14T11:15:23.859 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:23.860 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:23.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.902+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 20 realm 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:23.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.904+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.905+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:23.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.905+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:23.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.906+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:23.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.906+0000 7f1a2e40e800 20 searching for the correct realm 2024-09-14T11:15:23.907 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.909+0000 7f1a2a36c640 0 -- 172.21.15.2:0/235233271 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f1a20078040 msgr2=0x7f1a20068450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:23.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:23.913+0000 7f1a29b6b640 0 -- 172.21.15.2:0/235233271 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1a20078930 msgr2=0x7f1a20091400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:24.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.120+0000 7f1a2e40e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:24.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.120+0000 7f1a2e40e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:24.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.120+0000 7f1a2e40e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:24.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.120+0000 7f1a2e40e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:24.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.120+0000 7f1a2e40e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:24.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.120+0000 7f1a2e40e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:24.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.120+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:24.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 zone default found 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 4 Realm: () 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 zonegroup default 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.121+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.122+0000 7f1a2e40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.122+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.122+0000 7f1a2e40e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.122+0000 7f1a2e40e800 20 started sync module instance, tier type = 2024-09-14T11:15:24.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.122+0000 7f1a2e40e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:24.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.131+0000 7f1a2e40e800 20 add_watcher() i=0 2024-09-14T11:15:24.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.131+0000 7f1a2e40e800 20 add_watcher() i=1 2024-09-14T11:15:24.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.131+0000 7f1a2e40e800 20 add_watcher() i=2 2024-09-14T11:15:24.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.131+0000 7f1a2e40e800 20 add_watcher() i=3 2024-09-14T11:15:24.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.131+0000 7f1a2e40e800 20 add_watcher() i=4 2024-09-14T11:15:24.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.131+0000 7f1a2e40e800 20 add_watcher() i=5 2024-09-14T11:15:24.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.131+0000 7f1a2e40e800 20 add_watcher() i=6 2024-09-14T11:15:24.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.132+0000 7f1a2e40e800 20 add_watcher() i=7 2024-09-14T11:15:24.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.132+0000 7f1a2e40e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:24.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.134+0000 7f18db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:24.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.134+0000 7f1a2e40e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:24.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.134+0000 7f1a2e40e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:24.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.134+0000 7f1a2e40e800 5 note: GC not initialized 2024-09-14T11:15:24.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.135+0000 7f18da7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:24.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.135+0000 7f1a2e40e800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:24.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.135+0000 7f1a2e40e800 20 Filter name: none 2024-09-14T11:15:24.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.135+0000 7f184bfff640 20 reqs_thread_entry: start 2024-09-14T11:15:24.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.135+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.136+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:15:24.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.136+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.136+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:15:24.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.136+0000 7f1a2e40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:24.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.136+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.137+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-14T11:15:24.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.137+0000 7f1a2e40e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.138+0000 7f1a2e40e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-14T11:15:24.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.138+0000 7f1a2e40e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:24.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.139+0000 7f18db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:24.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.141+0000 7f1a2e40e800 20 remove_watcher() i=0 2024-09-14T11:15:24.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.141+0000 7f1a2e40e800 2 removed watcher, disabling cache 2024-09-14T11:15:24.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.142+0000 7f1a2e40e800 20 remove_watcher() i=1 2024-09-14T11:15:24.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.143+0000 7f1a2e40e800 20 remove_watcher() i=2 2024-09-14T11:15:24.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.145+0000 7f1a2e40e800 20 remove_watcher() i=3 2024-09-14T11:15:24.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.146+0000 7f1a2e40e800 20 remove_watcher() i=4 2024-09-14T11:15:24.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.147+0000 7f1a2e40e800 20 remove_watcher() i=5 2024-09-14T11:15:24.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.148+0000 7f1a2e40e800 20 remove_watcher() i=6 2024-09-14T11:15:24.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.149+0000 7f1a2e40e800 20 remove_watcher() i=7 2024-09-14T11:15:24.159 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:24.159 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:24.159 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-trim-reshard-log-entries id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.27 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:15:24.159 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:24.162 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.162 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.165 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.165 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.208 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.209 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.222 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-14T11:15:24.223 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:24.224 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.224 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.234 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.234 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.277 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.277 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.285 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.285 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.292 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.293 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.300 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.300 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.307 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.307 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.315 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.315 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.322 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.322 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.329 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.329 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.337 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.344 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.344 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.352 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.352 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.359 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.359 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.367 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.367 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.374 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.374 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.382 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.382 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.389 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.389 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.397 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.397 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.404 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.404 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.412 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.412 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.419 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:24.419 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:24.426 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:15:24.455 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:24.455 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:24.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.496+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 20 realm 2024-09-14T11:15:24.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:24.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.498+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.499+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:24.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.499+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.499+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:24.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.499+0000 7f19f4e2f800 20 searching for the correct realm 2024-09-14T11:15:24.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.502+0000 7f19ebfff640 0 -- 172.21.15.2:0/386697351 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f19e4028c30 msgr2=0x7f19e4073910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:24.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.708+0000 7f19f2919640 0 -- 172.21.15.2:0/386697351 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f19dc0773b0 msgr2=0x7f19dc097410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:24.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:24.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:24.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:24.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:24.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:24.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:24.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.915+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 zone default found 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 4 Realm: () 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 zonegroup default 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.916+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.917+0000 7f19f4e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:24.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.917+0000 7f19f4e2f800 20 started sync module instance, tier type = 2024-09-14T11:15:24.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.917+0000 7f19f4e2f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.926+0000 7f19f4e2f800 20 add_watcher() i=0 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.926+0000 7f19f4e2f800 20 add_watcher() i=1 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.926+0000 7f19f4e2f800 20 add_watcher() i=2 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.926+0000 7f19f4e2f800 20 add_watcher() i=3 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.926+0000 7f19f4e2f800 20 add_watcher() i=4 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.926+0000 7f19f4e2f800 20 add_watcher() i=5 2024-09-14T11:15:24.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.926+0000 7f19f4e2f800 20 add_watcher() i=6 2024-09-14T11:15:24.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.927+0000 7f19f4e2f800 20 add_watcher() i=7 2024-09-14T11:15:24.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.927+0000 7f19f4e2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:24.926 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.928+0000 7f18a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:24.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f19f4e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:24.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f19f4e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:24.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f19f4e2f800 5 note: GC not initialized 2024-09-14T11:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f1823fff640 20 reqs_thread_entry: start 2024-09-14T11:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f19f4e2f800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f19f4e2f800 20 Filter name: none 2024-09-14T11:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f1821ffb640 20 reqs_thread_entry: start 2024-09-14T11:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.929+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.930+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:24.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.930+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.931+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:24.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.931+0000 7f19f4e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:24.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.931+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.931+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:24.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.931+0000 7f19f4e2f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:24.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.932+0000 7f19f4e2f800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:24.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.932+0000 7f19f4e2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:24.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.933+0000 7f18a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:24.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.935+0000 7f19f4e2f800 20 remove_watcher() i=0 2024-09-14T11:15:24.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.935+0000 7f19f4e2f800 2 removed watcher, disabling cache 2024-09-14T11:15:24.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.936+0000 7f19f4e2f800 20 remove_watcher() i=1 2024-09-14T11:15:24.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.937+0000 7f19f4e2f800 20 remove_watcher() i=2 2024-09-14T11:15:24.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.938+0000 7f19f4e2f800 20 remove_watcher() i=3 2024-09-14T11:15:24.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.939+0000 7f19f4e2f800 20 remove_watcher() i=4 2024-09-14T11:15:24.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.940+0000 7f19f4e2f800 20 remove_watcher() i=5 2024-09-14T11:15:24.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.941+0000 7f19f4e2f800 20 remove_watcher() i=6 2024-09-14T11:15:24.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:24.942+0000 7f19f4e2f800 20 remove_watcher() i=7 2024-09-14T11:15:24.952 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:24.952 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:24.952 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-block-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:15:24.952 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:24.953 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-14T11:15:24.989 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:24.989 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:25.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.030+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.031+0000 7ff1d0e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.031+0000 7ff1d0e0e800 20 realm 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.031+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.032+0000 7ff1d0e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.032+0000 7ff1d0e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.032+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.032+0000 7ff1d0e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.032+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.033+0000 7ff1d0e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.033+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.033+0000 7ff1d0e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.033+0000 7ff1d0e0e800 20 searching for the correct realm 2024-09-14T11:15:25.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.036+0000 7ff1cbdbb640 0 -- 172.21.15.2:0/3116102397 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55de25f42440 msgr2=0x55de25f44900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.039+0000 7ff1cc5bc640 0 -- 172.21.15.2:0/3116102397 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ff1c006ed20 msgr2=0x7ff1c00a70b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.043+0000 7ff1d0e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:25.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.043+0000 7ff1d0e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:25.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.043+0000 7ff1d0e0e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:25.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.043+0000 7ff1d0e0e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:25.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.043+0000 7ff1d0e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:25.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.043+0000 7ff1d0e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:25.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.043+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 zone default found 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 4 Realm: () 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 zonegroup default 2024-09-14T11:15:25.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.044+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.045+0000 7ff1d0e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.045+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.045+0000 7ff1d0e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.045+0000 7ff1d0e0e800 20 started sync module instance, tier type = 2024-09-14T11:15:25.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.045+0000 7ff1d0e0e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.054+0000 7ff1d0e0e800 20 add_watcher() i=0 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.054+0000 7ff1d0e0e800 20 add_watcher() i=1 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.054+0000 7ff1d0e0e800 20 add_watcher() i=2 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.054+0000 7ff1d0e0e800 20 add_watcher() i=3 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.054+0000 7ff1d0e0e800 20 add_watcher() i=4 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.054+0000 7ff1d0e0e800 20 add_watcher() i=5 2024-09-14T11:15:25.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.054+0000 7ff1d0e0e800 20 add_watcher() i=6 2024-09-14T11:15:25.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.055+0000 7ff1d0e0e800 20 add_watcher() i=7 2024-09-14T11:15:25.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.055+0000 7ff1d0e0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:25.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.056+0000 7ff082fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff1d0e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff1d0e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff1d0e0e800 5 note: GC not initialized 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff081fdb640 20 reqs_thread_entry: start 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff1d0e0e800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff1d0e0e800 20 Filter name: none 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7feff37fe640 20 reqs_thread_entry: start 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff1d0e0e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:15:25.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.057+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 : miss 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:25.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:25.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.058+0000 7ff1d0e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff1d0e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff1d0e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff1d0e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff1d0e0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28, ofs0, ns] 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff0a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464330 cookie 94412607861456 notifier 6617 bl.length()=915 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff0a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff0a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.062+0000 7ff0a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.063+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_sources= new_sources= 2024-09-14T11:15:25.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.063+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential sources added=[] removed=[] 2024-09-14T11:15:25.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.063+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_dests= new_dests= 2024-09-14T11:15:25.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.063+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential dests added=[] removed=[] 2024-09-14T11:15:25.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.065+0000 7ff1d0e0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.0 2024-09-14T11:15:25.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.065+0000 7ff1d0e0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.0 2024-09-14T11:15:25.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.065+0000 7ff1d0e0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.1 2024-09-14T11:15:25.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.065+0000 7ff1d0e0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.1 2024-09-14T11:15:25.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.065+0000 7ff1d0e0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.0 2024-09-14T11:15:25.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.067+0000 7ff1d0e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:25.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.067+0000 7ff1d0e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28, ofs0, ns] 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff0a37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94412607861456 notifier 6617 bl.length()=915 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff0a37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff0a37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff0a37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_sources= new_sources= 2024-09-14T11:15:25.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential sources added=[] removed=[] 2024-09-14T11:15:25.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_dests= new_dests= 2024-09-14T11:15:25.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential dests added=[] removed=[] 2024-09-14T11:15:25.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 -1 Injecting error=-5 at location=block_writes 2024-09-14T11:15:25.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.069+0000 7ff1d0e0e800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:15:25.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.071+0000 7ff1d0e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:25.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.071+0000 7ff1d0e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 2024-09-14T11:15:25.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28, ofs0, ns] 2024-09-14T11:15:25.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff0a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94412607861456 notifier 6617 bl.length()=883 2024-09-14T11:15:25.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff0a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff0a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff0a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_sources= new_sources= 2024-09-14T11:15:25.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential sources added=[] removed=[] 2024-09-14T11:15:25.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_dests= new_dests= 2024-09-14T11:15:25.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.073+0000 7ff1d0e0e800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential dests added=[] removed=[] 2024-09-14T11:15:25.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.074+0000 7ff1d0e0e800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-14T11:15:25.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.076+0000 7ff082fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.079+0000 7ff1d0e0e800 20 remove_watcher() i=0 2024-09-14T11:15:25.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.079+0000 7ff1d0e0e800 2 removed watcher, disabling cache 2024-09-14T11:15:25.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.079+0000 7ff1d0e0e800 20 remove_watcher() i=1 2024-09-14T11:15:25.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.080+0000 7ff1d0e0e800 20 remove_watcher() i=2 2024-09-14T11:15:25.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.082+0000 7ff1d0e0e800 20 remove_watcher() i=3 2024-09-14T11:15:25.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.083+0000 7ff1d0e0e800 20 remove_watcher() i=4 2024-09-14T11:15:25.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.084+0000 7ff1d0e0e800 20 remove_watcher() i=5 2024-09-14T11:15:25.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.085+0000 7ff1d0e0e800 20 remove_watcher() i=6 2024-09-14T11:15:25.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.085+0000 7ff1d0e0e800 20 remove_watcher() i=7 2024-09-14T11:15:25.096 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:15:25.125 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:25.125 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:25.166 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.167+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.169+0000 7fe224b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.169+0000 7fe224b3a800 20 realm 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.169+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.169+0000 7fe224b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.169+0000 7fe224b3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.169+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.170+0000 7fe224b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.170+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.170+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.170+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.171+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.171+0000 7fe224b3a800 20 searching for the correct realm 2024-09-14T11:15:25.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.174+0000 7fe2210bc640 0 -- 172.21.15.2:0/1241439504 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fe214011c50 msgr2=0x7fe214049430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.177+0000 7fe2208bb640 0 -- 172.21.15.2:0/1241439504 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fe214060320 msgr2=0x7fe214049430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:25.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:25.180 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:25.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 zone default found 2024-09-14T11:15:25.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 4 Realm: () 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 zonegroup default 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.182+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.183+0000 7fe224b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.183+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.183+0000 7fe224b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.183+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.183+0000 7fe224b3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.183+0000 7fe224b3a800 20 started sync module instance, tier type = 2024-09-14T11:15:25.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.183+0000 7fe224b3a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:25.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.192+0000 7fe224b3a800 20 add_watcher() i=0 2024-09-14T11:15:25.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.192+0000 7fe224b3a800 20 add_watcher() i=1 2024-09-14T11:15:25.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.192+0000 7fe224b3a800 20 add_watcher() i=2 2024-09-14T11:15:25.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.192+0000 7fe224b3a800 20 add_watcher() i=3 2024-09-14T11:15:25.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.192+0000 7fe224b3a800 20 add_watcher() i=4 2024-09-14T11:15:25.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.192+0000 7fe224b3a800 20 add_watcher() i=5 2024-09-14T11:15:25.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.192+0000 7fe224b3a800 20 add_watcher() i=6 2024-09-14T11:15:25.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.193+0000 7fe224b3a800 20 add_watcher() i=7 2024-09-14T11:15:25.191 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.193+0000 7fe224b3a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:25.192 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.194+0000 7fe0d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.194+0000 7fe224b3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:25.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.194+0000 7fe224b3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:25.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.195+0000 7fe224b3a800 5 note: GC not initialized 2024-09-14T11:15:25.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.195+0000 7fe0d5fe3640 20 reqs_thread_entry: start 2024-09-14T11:15:25.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.195+0000 7fe224b3a800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:25.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.195+0000 7fe224b3a800 20 Filter name: none 2024-09-14T11:15:25.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.195+0000 7fe0477fe640 20 reqs_thread_entry: start 2024-09-14T11:15:25.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.195+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.196+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.196+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.196+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.196+0000 7fe224b3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.196+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.196+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:25.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.196+0000 7fe224b3a800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.197+0000 7fe224b3a800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:25.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.197+0000 7fe224b3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:25.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.198+0000 7fe0d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.200+0000 7fe224b3a800 20 remove_watcher() i=0 2024-09-14T11:15:25.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.200+0000 7fe224b3a800 2 removed watcher, disabling cache 2024-09-14T11:15:25.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.201+0000 7fe224b3a800 20 remove_watcher() i=1 2024-09-14T11:15:25.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.202+0000 7fe224b3a800 20 remove_watcher() i=2 2024-09-14T11:15:25.201 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.203+0000 7fe224b3a800 20 remove_watcher() i=3 2024-09-14T11:15:25.202 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.204+0000 7fe224b3a800 20 remove_watcher() i=4 2024-09-14T11:15:25.203 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.205+0000 7fe224b3a800 20 remove_watcher() i=5 2024-09-14T11:15:25.204 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.206+0000 7fe224b3a800 20 remove_watcher() i=6 2024-09-14T11:15:25.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.207+0000 7fe224b3a800 20 remove_watcher() i=7 2024-09-14T11:15:25.217 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:25.217 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:25.217 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-block-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:15:25.217 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:25.218 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:25.218 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:25.225 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:25.225 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:25.269 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:25.303 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:25.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.345+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 20 realm 2024-09-14T11:15:25.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.347+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.348+0000 7fef8d332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.348+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.348+0000 7fef8d332800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.348+0000 7fef8d332800 20 searching for the correct realm 2024-09-14T11:15:25.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.350+0000 7fef88fbc640 0 -- 172.21.15.2:0/1005912650 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7fef8005b040 msgr2=0x7fef800079d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.556+0000 7fef897bd640 0 -- 172.21.15.2:0/1005912650 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fef7c076030 msgr2=0x7fef7c084050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:25.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:25.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:25.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:25.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:25.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:25.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.562+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 20 zone default found 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 4 Realm: () 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 20 zonegroup default 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.563+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.564+0000 7fef8d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.564+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.564+0000 7fef8d332800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.564+0000 7fef8d332800 20 started sync module instance, tier type = 2024-09-14T11:15:25.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.564+0000 7fef8d332800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:25.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.573+0000 7fef8d332800 20 add_watcher() i=0 2024-09-14T11:15:25.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.573+0000 7fef8d332800 20 add_watcher() i=1 2024-09-14T11:15:25.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.573+0000 7fef8d332800 20 add_watcher() i=2 2024-09-14T11:15:25.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.573+0000 7fef8d332800 20 add_watcher() i=3 2024-09-14T11:15:25.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.573+0000 7fef8d332800 20 add_watcher() i=4 2024-09-14T11:15:25.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.573+0000 7fef8d332800 20 add_watcher() i=5 2024-09-14T11:15:25.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.573+0000 7fef8d332800 20 add_watcher() i=6 2024-09-14T11:15:25.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.574+0000 7fef8d332800 20 add_watcher() i=7 2024-09-14T11:15:25.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.574+0000 7fef8d332800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:25.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.576+0000 7fee3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.576+0000 7fef8d332800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:25.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.576+0000 7fef8d332800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:25.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.576+0000 7fef8d332800 5 note: GC not initialized 2024-09-14T11:15:25.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.576+0000 7fee3e7e4640 20 reqs_thread_entry: start 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.576+0000 7fef8d332800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 20 Filter name: none 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fee377fe640 20 reqs_thread_entry: start 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 : miss 2024-09-14T11:15:25.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:25.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:25.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.577+0000 7fef8d332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 2024-09-14T11:15:25.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fef8d332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fef8d332800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fef8d332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fef8d332800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28, ofs0, ns] 2024-09-14T11:15:25.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fee5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 93991302538864 notifier 6987 bl.length()=915 2024-09-14T11:15:25.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fee5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fee5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.581+0000 7fee5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.582+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_sources= new_sources= 2024-09-14T11:15:25.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.582+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential sources added=[] removed=[] 2024-09-14T11:15:25.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.582+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_dests= new_dests= 2024-09-14T11:15:25.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.582+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential dests added=[] removed=[] 2024-09-14T11:15:25.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.584+0000 7fef8d332800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.0 2024-09-14T11:15:25.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.584+0000 7fef8d332800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.0 2024-09-14T11:15:25.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.584+0000 7fef8d332800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.1 2024-09-14T11:15:25.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.584+0000 7fef8d332800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.1.1 2024-09-14T11:15:25.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.584+0000 7fef8d332800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.0 2024-09-14T11:15:25.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.586+0000 7fef8d332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:25.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.586+0000 7fef8d332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.587+0000 7fef8d332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.587+0000 7fef8d332800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.587+0000 7fef8d332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.587+0000 7fef8d332800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28, ofs0, ns] 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fee5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464334 cookie 93991302538864 notifier 6987 bl.length()=915 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fee5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fee5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fee5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_sources= new_sources= 2024-09-14T11:15:25.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential sources added=[] removed=[] 2024-09-14T11:15:25.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_dests= new_dests= 2024-09-14T11:15:25.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.588+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential dests added=[] removed=[] 2024-09-14T11:15:25.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.589+0000 7fef8d332800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.28.0 2024-09-14T11:15:25.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.589+0000 7fef8d332800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:25.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.589+0000 7fef8d332800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 2024-09-14T11:15:25.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28, ofs0, ns] 2024-09-14T11:15:25.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fee5ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464335 cookie 93991302538864 notifier 6987 bl.length()=883 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fee5ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 info.flags=0x17 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fee5ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 to cache LRU end 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fee5ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_sources= new_sources= 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential sources added=[] removed=[] 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): orig_dests= new_dests= 2024-09-14T11:15:25.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.591+0000 7fef8d332800 20 handle_bi_update(): bucket=:error-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.28]): potential dests added=[] removed=[] 2024-09-14T11:15:25.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.592+0000 7fef8d332800 1 execute INFO: reshard of bucket "error-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:15:25.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.594+0000 7fee3f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:25.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.596+0000 7fef8d332800 20 remove_watcher() i=0 2024-09-14T11:15:25.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.596+0000 7fef8d332800 2 removed watcher, disabling cache 2024-09-14T11:15:25.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.597+0000 7fef8d332800 20 remove_watcher() i=1 2024-09-14T11:15:25.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.598+0000 7fef8d332800 20 remove_watcher() i=2 2024-09-14T11:15:25.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.599+0000 7fef8d332800 20 remove_watcher() i=3 2024-09-14T11:15:25.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.600+0000 7fef8d332800 20 remove_watcher() i=4 2024-09-14T11:15:25.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.601+0000 7fef8d332800 20 remove_watcher() i=5 2024-09-14T11:15:25.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.602+0000 7fef8d332800 20 remove_watcher() i=6 2024-09-14T11:15:25.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.603+0000 7fef8d332800 20 remove_watcher() i=7 2024-09-14T11:15:25.614 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-14T11:15:25.643 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:25.643 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:25.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.684+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.686+0000 7ffaa9f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.686+0000 7ffaa9f37800 20 realm 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.686+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.686+0000 7ffaa9f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.686+0000 7ffaa9f37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.686+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.687+0000 7ffaa9f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:25.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.687+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.687+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:25.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.687+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:25.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.688+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:25.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.688+0000 7ffaa9f37800 20 searching for the correct realm 2024-09-14T11:15:25.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.689+0000 7ffaa6422640 0 -- 172.21.15.2:0/3045697983 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7ffa9c082b00 msgr2=0x7ffa9c067300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:25.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:25.894+0000 7ffaa6422640 0 -- 172.21.15.2:0/3045697983 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7ffa9c07e040 msgr2=0x7ffa9c08ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:26.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.305+0000 7ffaa9f37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:26.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.305+0000 7ffaa9f37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:26.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.305+0000 7ffaa9f37800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:26.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.305+0000 7ffaa9f37800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:26.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.305+0000 7ffaa9f37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:26.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.305+0000 7ffaa9f37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:26.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.305+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.306+0000 7ffaa9f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.306+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.306+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.306+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 zone default found 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 4 Realm: () 2024-09-14T11:15:26.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 zonegroup default 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.307+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.308+0000 7ffaa9f37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.308+0000 7ffaa9f37800 20 started sync module instance, tier type = 2024-09-14T11:15:26.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.308+0000 7ffaa9f37800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.317+0000 7ffaa9f37800 20 add_watcher() i=0 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.317+0000 7ffaa9f37800 20 add_watcher() i=1 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.317+0000 7ffaa9f37800 20 add_watcher() i=2 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.317+0000 7ffaa9f37800 20 add_watcher() i=3 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.317+0000 7ffaa9f37800 20 add_watcher() i=4 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.317+0000 7ffaa9f37800 20 add_watcher() i=5 2024-09-14T11:15:26.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.317+0000 7ffaa9f37800 20 add_watcher() i=6 2024-09-14T11:15:26.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.318+0000 7ffaa9f37800 20 add_watcher() i=7 2024-09-14T11:15:26.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.318+0000 7ffaa9f37800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:26.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.320+0000 7ff9537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:26.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ffaa9f37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:26.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ffaa9f37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:26.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ffaa9f37800 5 note: GC not initialized 2024-09-14T11:15:26.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ff9527fc640 20 reqs_thread_entry: start 2024-09-14T11:15:26.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ffaa9f37800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:26.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ffaa9f37800 20 Filter name: none 2024-09-14T11:15:26.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ff8c3fff640 20 reqs_thread_entry: start 2024-09-14T11:15:26.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.321+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.322+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:26.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.322+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.322+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:26.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.322+0000 7ffaa9f37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:26.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.322+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.323+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:26.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.323+0000 7ffaa9f37800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.323+0000 7ffaa9f37800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:26.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.323+0000 7ffaa9f37800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:26.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.325+0000 7ff9537fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:26.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.327+0000 7ffaa9f37800 20 remove_watcher() i=0 2024-09-14T11:15:26.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.327+0000 7ffaa9f37800 2 removed watcher, disabling cache 2024-09-14T11:15:26.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.328+0000 7ffaa9f37800 20 remove_watcher() i=1 2024-09-14T11:15:26.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.329+0000 7ffaa9f37800 20 remove_watcher() i=2 2024-09-14T11:15:26.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.330+0000 7ffaa9f37800 20 remove_watcher() i=3 2024-09-14T11:15:26.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.332+0000 7ffaa9f37800 20 remove_watcher() i=4 2024-09-14T11:15:26.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.333+0000 7ffaa9f37800 20 remove_watcher() i=5 2024-09-14T11:15:26.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.334+0000 7ffaa9f37800 20 remove_watcher() i=6 2024-09-14T11:15:26.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.335+0000 7ffaa9f37800 20 remove_watcher() i=7 2024-09-14T11:15:26.346 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:26.346 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:26.346 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-block-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.28 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:15:26.346 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:26.348 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.348 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.352 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.352 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.395 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.395 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.411 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at block_writes 2024-09-14T11:15:26.411 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:26.412 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.412 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.422 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.422 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.465 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.465 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.473 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.473 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.481 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.481 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.490 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.490 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.497 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.497 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.505 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.505 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.512 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.512 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.519 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.519 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.527 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.527 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.533 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.533 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.540 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.540 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.548 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.548 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.555 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.555 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.562 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.562 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.569 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.569 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.576 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.576 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.583 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.583 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.590 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.590 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.598 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.598 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.605 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:26.605 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:26.613 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:15:26.642 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:26.642 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:26.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.684+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.685+0000 7f43ff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.685+0000 7f43ff52c800 20 realm 2024-09-14T11:15:26.684 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.685+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.685+0000 7f43ff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.685+0000 7f43ff52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:26.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.685+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.686+0000 7f43ff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.686+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.686+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:26.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.686+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.687+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:26.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.687+0000 7f43ff52c800 20 searching for the correct realm 2024-09-14T11:15:26.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.690+0000 7f43faa4e640 0 -- 172.21.15.2:0/1401206712 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f43ec08c040 msgr2=0x7f43ec090a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:26.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.693+0000 7f43fb24f640 0 -- 172.21.15.2:0/1401206712 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f43f00a8400 msgr2=0x7f43f00a8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:26.898 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 zone default found 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 4 Realm: () 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 zonegroup default 2024-09-14T11:15:26.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.900+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.901+0000 7f43ff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.901+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.901+0000 7f43ff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.901+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.901+0000 7f43ff52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:26.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.901+0000 7f43ff52c800 20 started sync module instance, tier type = 2024-09-14T11:15:26.901 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.901+0000 7f43ff52c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:26.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.910+0000 7f43ff52c800 20 add_watcher() i=0 2024-09-14T11:15:26.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.910+0000 7f43ff52c800 20 add_watcher() i=1 2024-09-14T11:15:26.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.910+0000 7f43ff52c800 20 add_watcher() i=2 2024-09-14T11:15:26.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.910+0000 7f43ff52c800 20 add_watcher() i=3 2024-09-14T11:15:26.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.910+0000 7f43ff52c800 20 add_watcher() i=4 2024-09-14T11:15:26.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.910+0000 7f43ff52c800 20 add_watcher() i=5 2024-09-14T11:15:26.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.910+0000 7f43ff52c800 20 add_watcher() i=6 2024-09-14T11:15:26.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.911+0000 7f43ff52c800 20 add_watcher() i=7 2024-09-14T11:15:26.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.911+0000 7f43ff52c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:26.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.913+0000 7f42b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.913+0000 7f43ff52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.913+0000 7f43ff52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.913+0000 7f43ff52c800 5 note: GC not initialized 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.913+0000 7f42b0fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.914+0000 7f43ff52c800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.914+0000 7f43ff52c800 20 Filter name: none 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.914+0000 7f422a7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:26.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.914+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.914+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:26.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.914+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.915+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:26.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.915+0000 7f43ff52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:26.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.915+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.915+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:26.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.915+0000 7f43ff52c800 20 rados->read ofs=0 len=0 2024-09-14T11:15:26.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.915+0000 7f43ff52c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:26.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.915+0000 7f43ff52c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:26.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.917+0000 7f42b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:26.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.919+0000 7f43ff52c800 20 remove_watcher() i=0 2024-09-14T11:15:26.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.919+0000 7f43ff52c800 2 removed watcher, disabling cache 2024-09-14T11:15:26.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.920+0000 7f43ff52c800 20 remove_watcher() i=1 2024-09-14T11:15:26.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.921+0000 7f43ff52c800 20 remove_watcher() i=2 2024-09-14T11:15:26.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.922+0000 7f43ff52c800 20 remove_watcher() i=3 2024-09-14T11:15:26.921 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.923+0000 7f43ff52c800 20 remove_watcher() i=4 2024-09-14T11:15:26.922 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.924+0000 7f43ff52c800 20 remove_watcher() i=5 2024-09-14T11:15:26.923 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.925+0000 7f43ff52c800 20 remove_watcher() i=6 2024-09-14T11:15:26.924 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:26.926+0000 7f43ff52c800 20 remove_watcher() i=7 2024-09-14T11:15:26.935 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:26.935 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:26.935 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-block-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:15:26.935 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:26.937 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-14T11:15:26.971 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:26.971 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:27.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.013+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.014+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.014+0000 7ffb04140800 20 realm 2024-09-14T11:15:27.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.014+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.015+0000 7ffb04140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:27.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.014 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:27.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.016+0000 7ffb04140800 20 searching for the correct realm 2024-09-14T11:15:27.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.019+0000 7ffaff6ec640 0 -- 172.21.15.2:0/3833248084 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55992bef55c0 msgr2=0x55992bef7a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.023+0000 7ffaffeed640 0 -- 172.21.15.2:0/3833248084 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ffaf40a3920 msgr2=0x7ffaf4085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:27.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:27.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:27.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:27.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:27.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:27.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 zone default found 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 4 Realm: () 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:27.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 zonegroup default 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.029+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.029+0000 7ffb04140800 20 started sync module instance, tier type = 2024-09-14T11:15:27.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.029+0000 7ffb04140800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:27.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=0 2024-09-14T11:15:27.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=1 2024-09-14T11:15:27.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=2 2024-09-14T11:15:27.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=3 2024-09-14T11:15:27.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=4 2024-09-14T11:15:27.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=5 2024-09-14T11:15:27.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=6 2024-09-14T11:15:27.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.038+0000 7ffb04140800 20 add_watcher() i=7 2024-09-14T11:15:27.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.038+0000 7ffb04140800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:27.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.040+0000 7ff9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.040+0000 7ffb04140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.040+0000 7ffb04140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.040+0000 7ffb04140800 5 note: GC not initialized 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.040+0000 7ff9b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.040+0000 7ffb04140800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.040+0000 7ffb04140800 20 Filter name: none 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ff92e7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:15:27.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:27.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:15:27.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : miss 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.041+0000 7ffb04140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:27.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:27.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 94116355468400 notifier 7041 bl.length()=915 2024-09-14T11:15:27.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:27.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:27.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:27.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:27.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.049+0000 7ffb04140800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.0 2024-09-14T11:15:27.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.0 2024-09-14T11:15:27.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.049+0000 7ffb04140800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.1 2024-09-14T11:15:27.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.1 2024-09-14T11:15:27.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.0 2024-09-14T11:15:27.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.051+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:27.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.051+0000 7ffb04140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:27.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.052+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.050 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.052+0000 7ffb04140800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.052+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.052+0000 7ffb04140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:27.051 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94116355468400 notifier 7041 bl.length()=915 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffb04140800 time 2024-09-14T11:15:27.054294+0000 2024-09-14T11:15:27.052 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:27.067 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.067 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffb0598c76a] 2024-09-14T11:15:27.067 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.067 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.067 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.067 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.054+0000 7ffb04140800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffb04140800 time 2024-09-14T11:15:27.054294+0000 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffb0598c76a] 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.068 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7ffb04140800 thread_name:radosgw-admin 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffb0463e6f0] 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffb0468b99c] 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:15:27.069 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffb0598c7c4] 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.055+0000 7ffb04140800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7ffb04140800 thread_name:radosgw-admin 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.070 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffb0463e6f0] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffb0468b99c] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffb0598c7c4] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:15:27.071 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be038e0) adding con mode: crc 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be038e0) adding con mode: secure 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:15:26.996+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: starting msgr at 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: starting objecter 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command objecter_requests hook 0x55992be33530 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: setting wanted keys 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: calling monclient init 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding auth protocol: cephx 2024-09-14T11:15:27.072 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding auth protocol: cephx 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding auth protocol: cephx 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.073 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:15:26.996+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:15:26.996+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key hook 0x55992be01728 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992bc8b690 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992bcaea60 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992bd4a6d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.549023s 2024-09-14T11:15:27.074 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992bd4a6d0 auth_method 0 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992bcaea60 auth_method 0 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992bc8b690 auth_method 0 2024-09-14T11:15:27.075 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_done global_id 7032 payload 824 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:15:26.997+0000 7ffb006ee640 1 monclient: found mon.noname-a 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: dump: 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.076 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: dump: 2024-09-14T11:15:27.077 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:15:26.997+0000 7ffb04140800 5 monclient: authenticate success, global_id 7032 2024-09-14T11:15:27.078 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:15:26.997+0000 7ff9ede0b640 4 set_mon_vals no callback set 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:15:26.997+0000 7ffb04140800 1 librados: init done 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:15:26.999+0000 7ff9e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:15:26.999+0000 7ff9e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:15:26.999+0000 7ff9e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:15:27.000+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ff9e8077230 auth_method 0 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:15:27.000+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992be29f50 auth_method 0 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:15:27.001+0000 7ffaffeed640 10 monclient: get_auth_request con 0x55992be4cf50 auth_method 0 2024-09-14T11:15:27.079 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:15:27.002+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992be51fe0 auth_method 0 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:15:27.003+0000 7ffb04140800 10 monclient: build_initial_monmap 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:15:27.003+0000 7ffb04140800 1 build_initial for_mkfs: 0 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:15:27.003+0000 7ffb04140800 10 monclient: monmap: 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:15:27.080 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding auth protocol: cephx 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding auth protocol: cephx 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding auth protocol: cephx 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.081 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:15:27.003+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command objecter_requests cmddesc objecter_requests hook 0x55992be59a60 EEXIST 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:15:27.003+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding auth protocol: cephx 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding auth protocol: cephx 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding auth protocol: cephx 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.082 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:15:27.003+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:15:27.004+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:15:27.004+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key cmddesc rotate-key hook 0x55992be551d0 EEXIST 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:15:27.083 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992be7d750 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992be7fa20 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992be7bf20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.556203s 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992be7fa20 auth_method 0 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992be7bf20 auth_method 0 2024-09-14T11:15:27.084 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992be7d750 auth_method 0 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.085 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_done global_id 6689 payload 824 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:15:27.004+0000 7ffb006ee640 1 monclient: found mon.noname-c 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: dump: 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.086 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: dump: 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.087 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:15:27.005+0000 7ffb04140800 5 monclient: authenticate success, global_id 6689 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:15:27.005+0000 7ffb00eef640 4 set_mon_vals no callback set 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:15:27.088 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:15:27.007+0000 7ff9e57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:15:27.007+0000 7ff9e57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:15:27.007+0000 7ff9e57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:15:27.007+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ff9d8077140 auth_method 0 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:15:27.007+0000 7ffb04140800 10 monclient: get_monmap_and_config 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:15:27.007+0000 7ffb04140800 10 monclient: build_initial_monmap 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:15:27.007+0000 7ffb04140800 1 build_initial for_mkfs: 0 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:15:27.007+0000 7ffb04140800 10 monclient: monmap: 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:15:27.089 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding auth protocol: cephx 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding auth protocol: cephx 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding auth protocol: cephx 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.090 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:15:27.008+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding auth protocol: cephx 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding auth protocol: cephx 2024-09-14T11:15:27.091 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding auth protocol: cephx 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:15:27.008+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.092 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:15:27.008+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key cmddesc rotate-key hook 0x7fff3bb8dcd8 EEXIST 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992bed1cc0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992bea1ad0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992becd080 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.560718s 2024-09-14T11:15:27.093 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992bea1ad0 auth_method 0 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992becd080 auth_method 0 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992bed1cc0 auth_method 0 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.094 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_done global_id 7038 payload 274 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 1 monclient: found mon.noname-a 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.095 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: dump: 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.096 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:15:27.009+0000 7ffb04140800 5 monclient: authenticate success, global_id 7038 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:15:27.009+0000 7ffb04140800 10 monclient: get_monmap_and_config success 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:15:27.009+0000 7ffb04140800 4 set_mon_vals no callback set 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: dump: 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.097 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:15:27.009+0000 7ffb04140800 10 monclient: shutdown 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:15:27.010+0000 7ffb04140800 10 monclient: build_initial_monmap 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 build_initial for_mkfs: 0 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:15:27.010+0000 7ffb04140800 10 monclient: monmap: 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:15:27.098 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding auth protocol: cephx 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding auth protocol: cephx 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding auth protocol: cephx 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.099 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:15:27.010+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: starting msgr at 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: starting objecter 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command objecter_requests cmddesc objecter_requests hook 0x55992be9d310 EEXIST 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: setting wanted keys 2024-09-14T11:15:27.100 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: calling monclient init 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:15:27.010+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding auth protocol: cephx 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding auth protocol: cephx 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding auth protocol: cephx 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.101 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:15:27.010+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:15:27.010+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:15:27.011+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key cmddesc rotate-key hook 0x55992be95648 EEXIST 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992bea1ad0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992becd080 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992bed1cc0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.102 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.563085s 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992bed1cc0 auth_method 0 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992bea1ad0 auth_method 0 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.103 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992becd080 auth_method 0 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_done global_id 7041 payload 824 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:15:27.011+0000 7ffb006ee640 1 monclient: found mon.noname-a 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.104 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: dump: 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.105 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:15:27.011+0000 7ffb04140800 5 monclient: authenticate success, global_id 7041 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:15:27.011+0000 7ff9deffd640 4 set_mon_vals no callback set 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: dump: 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.106 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:15:27.011+0000 7ffb04140800 1 librados: init done 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:15:27.011+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cr dump hook 0x55992bedf568 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:15:27.013+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:15:27.013+0000 7ff9dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:15:27.013+0000 7ff9dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:15:27.013+0000 7ff9dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.107 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:15:27.014+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ff9c80773d0 auth_method 0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:15:27.014+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992beec0d0 auth_method 0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:15:27.014+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:15:27.014+0000 7ffb04140800 20 realm 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:15:27.014+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:15:27.015+0000 7ffb04140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:15:27.015+0000 7ffaffeed640 10 monclient: get_auth_request con 0x55992bef0440 auth_method 0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:27.108 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 searching for the correct realm 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:15:27.016+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992bef55c0 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:15:27.017+0000 7ffb006ee640 10 monclient: get_auth_request con 0x7ffaf406db90 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:15:27.018+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ffaf8065020 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:15:27.018+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x7ffaf003e030 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:15:27.019+0000 7ffaff6ec640 0 -- 172.21.15.2:0/3833248084 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55992bef55c0 msgr2=0x55992bef7a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:15:27.019+0000 7ff9dd7fa640 1 client.7041.objecter ms_handle_reset 0x55992bef55c0 session 0x55992bef4f40 osd.3 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:15:27.019+0000 7ff9dd7fa640 10 monclient: _renew_subs 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:15:27.019+0000 7ff9dd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:15:27.020+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x7ff9c8087270 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:15:27.020+0000 7ffb006ee640 10 monclient: get_auth_request con 0x7ffaf4061400 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:15:27.022+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ffaf40a3920 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:15:27.023+0000 7ffaffeed640 0 -- 172.21.15.2:0/3833248084 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ffaf40a3920 msgr2=0x7ffaf4085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:15:27.023+0000 7ff9dd7fa640 1 client.7041.objecter ms_handle_reset 0x7ffaf40a3920 session 0x7ffaf407ddd0 osd.0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:15:27.023+0000 7ffaffeed640 10 monclient: get_auth_request con 0x55992bef55c0 auth_method 0 2024-09-14T11:15:27.109 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 zone default found 2024-09-14T11:15:27.110 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:15:27.028+0000 7ffb04140800 4 Realm: () 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:15:27.028+0000 7ffb04140800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:15:27.028+0000 7ffb04140800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:15:27.028+0000 7ffb04140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 zonegroup default 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:15:27.029+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:15:27.029+0000 7ffb04140800 20 started sync module instance, tier type = 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:15:27.029+0000 7ffb04140800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=0 2024-09-14T11:15:27.111 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=1 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=2 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=3 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=4 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=5 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=6 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:15:27.038+0000 7ffb04140800 20 add_watcher() i=7 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:15:27.038+0000 7ffb04140800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding auth protocol: cephx 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding auth protocol: cephx 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding auth protocol: cephx 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.112 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:15:27.040+0000 7ff9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:15:27.040+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:27.113 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache list hook 0x55992beca910 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache inspect hook 0x55992beca910 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache erase hook 0x55992beca910 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache zap hook 0x55992beca910 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 note: GC not initialized 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:15:27.040+0000 7ff9b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace show hook 0x7ffaf404ea10 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace history hook 0x7ffaf404ea10 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace active hook 0x7ffaf404ea10 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace active_short hook 0x7ffaf404ea10 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 Filter name: none 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:15:27.041+0000 7ff92e7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:27.114 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : miss 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.115 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 94116355468400 notifier 7041 bl.length()=915 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:15:27.049+0000 7ffb04140800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.0 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.0 2024-09-14T11:15:27.116 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:15:27.049+0000 7ffb04140800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.1 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.1 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.0 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:15:27.051+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:15:27.051+0000 7ffb04140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94116355468400 notifier 7041 bl.length()=915 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.117 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:15:27.054+0000 7ffb04140800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffb04140800 time 2024-09-14T11:15:27.054294+0000 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffb0598c76a] 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.118 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:15:27.055+0000 7ffb04140800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7ffb04140800 thread_name:radosgw-admin 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffb0463e6f0] 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffb0468b99c] 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffb0598c7c4] 2024-09-14T11:15:27.119 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:15:27.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:15:27.121 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:15:27.122 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:15:27.123 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:15:27.124 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:27.125 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:15:27.126 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff92e7fc640 / http_manager 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9b4fe1640 / http_manager 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9b5fe3640 / rgw_dt_lg_renew 2024-09-14T11:15:27.127 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9dd7fa640 / ms_dispatch 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9deffd640 / io_context_pool 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9e57fa640 / ms_dispatch 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9e7fff640 / ms_dispatch 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9ede0b640 / io_context_pool 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffaff6ec640 / msgr-worker-2 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffaffeed640 / msgr-worker-1 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffb006ee640 / msgr-worker-0 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffb00eef640 / io_context_pool 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffb04140800 / radosgw-admin 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.112037.log 2024-09-14T11:15:27.128 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be038e0) adding con mode: crc 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be038e0) adding con mode: secure 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:15:26.996+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: starting msgr at 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: starting objecter 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command objecter_requests hook 0x55992be33530 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: setting wanted keys 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:15:26.996+0000 7ffb04140800 1 librados: calling monclient init 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding auth protocol: cephx 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding auth protocol: cephx 2024-09-14T11:15:27.129 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding auth protocol: cephx 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: crc 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 AuthRegistry(0x55992be015e0) adding con mode: secure 2024-09-14T11:15:27.130 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:15:26.996+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:15:26.996+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:15:26.996+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key hook 0x55992be01728 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992bc8b690 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:15:26.996+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992bcaea60 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992bd4a6d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.549023s 2024-09-14T11:15:27.131 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992bd4a6d0 auth_method 0 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992bcaea60 auth_method 0 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.132 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:15:26.997+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992bc8b690 auth_method 0 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:15:26.997+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient(hunting): handle_auth_done global_id 7032 payload 824 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:15:26.997+0000 7ffb006ee640 1 monclient: found mon.noname-a 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:15:26.997+0000 7ffb006ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: dump: 2024-09-14T11:15:27.133 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.134 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:15:26.997+0000 7ff9e7fff640 10 monclient: dump: 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:15:26.997+0000 7ffb04140800 5 monclient: authenticate success, global_id 7032 2024-09-14T11:15:27.135 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:15:26.997+0000 7ff9ede0b640 4 set_mon_vals no callback set 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:15:26.997+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:15:26.997+0000 7ffb04140800 1 librados: init done 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:15:26.999+0000 7ff9e7fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:15:26.999+0000 7ff9e7fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:15:26.999+0000 7ff9e7fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:15:27.000+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ff9e8077230 auth_method 0 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:15:27.000+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992be29f50 auth_method 0 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:15:27.001+0000 7ffaffeed640 10 monclient: get_auth_request con 0x55992be4cf50 auth_method 0 2024-09-14T11:15:27.136 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:15:27.002+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992be51fe0 auth_method 0 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:15:27.003+0000 7ffb04140800 10 monclient: build_initial_monmap 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:15:27.003+0000 7ffb04140800 1 build_initial for_mkfs: 0 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:15:27.003+0000 7ffb04140800 10 monclient: monmap: 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.137 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding auth protocol: cephx 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding auth protocol: cephx 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding auth protocol: cephx 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.138 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: crc 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be560d0) adding con mode: secure 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:15:27.003+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command objecter_requests cmddesc objecter_requests hook 0x55992be59a60 EEXIST 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:15:27.003+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding auth protocol: cephx 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding auth protocol: cephx 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding auth protocol: cephx 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.139 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: crc 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:15:27.003+0000 7ffb04140800 5 AuthRegistry(0x55992be55088) adding con mode: secure 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:15:27.003+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:15:27.004+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:15:27.004+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key cmddesc rotate-key hook 0x55992be551d0 EEXIST 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992be7d750 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.140 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992be7fa20 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992be7bf20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:15:27.004+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.556203s 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992be7fa20 auth_method 0 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992be7bf20 auth_method 0 2024-09-14T11:15:27.141 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992be7d750 auth_method 0 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:15:27.004+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.142 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:15:27.004+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient(hunting): handle_auth_done global_id 6689 payload 824 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:15:27.004+0000 7ffb006ee640 1 monclient: found mon.noname-c 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:15:27.004+0000 7ffb006ee640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: dump: 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.143 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:15:27.005+0000 7ff9e57fa640 10 monclient: dump: 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.144 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:15:27.005+0000 7ffb04140800 5 monclient: authenticate success, global_id 6689 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:15:27.005+0000 7ffb00eef640 4 set_mon_vals no callback set 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:15:27.145 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:15:27.005+0000 7ffb04140800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:15:27.007+0000 7ff9e57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:15:27.007+0000 7ff9e57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:15:27.007+0000 7ff9e57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:15:27.007+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ff9d8077140 auth_method 0 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:15:27.007+0000 7ffb04140800 10 monclient: get_monmap_and_config 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:15:27.007+0000 7ffb04140800 10 monclient: build_initial_monmap 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:15:27.007+0000 7ffb04140800 1 build_initial for_mkfs: 0 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:15:27.007+0000 7ffb04140800 10 monclient: monmap: 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:15:27.146 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding auth protocol: cephx 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding auth protocol: cephx 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding auth protocol: cephx 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.147 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: crc 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:15:27.007+0000 7ffb04140800 5 AuthRegistry(0x55992be9d620) adding con mode: secure 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:15:27.008+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding auth protocol: cephx 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding auth protocol: cephx 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding auth protocol: cephx 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.148 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: crc 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8db90) adding con mode: secure 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:15:27.008+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:15:27.008+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.149 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:15:27.008+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key cmddesc rotate-key hook 0x7fff3bb8dcd8 EEXIST 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992bed1cc0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992bea1ad0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992becd080 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:15:27.008+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.560718s 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992bea1ad0 auth_method 0 2024-09-14T11:15:27.150 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992becd080 auth_method 0 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992bed1cc0 auth_method 0 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:15:27.008+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.151 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:15:27.008+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:15:27.008+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 10 monclient(hunting): handle_auth_done global_id 7038 payload 274 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 1 monclient: found mon.noname-a 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:15:27.009+0000 7ffaff6ec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:27.152 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: dump: 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.153 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:15:27.009+0000 7ffb04140800 5 monclient: authenticate success, global_id 7038 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:15:27.009+0000 7ffb04140800 10 monclient: get_monmap_and_config success 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:15:27.009+0000 7ffb04140800 4 set_mon_vals no callback set 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:15:27.009+0000 7ff9deffd640 10 monclient: dump: 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.154 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:15:27.009+0000 7ffb04140800 10 monclient: shutdown 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:15:27.010+0000 7ffb04140800 10 monclient: build_initial_monmap 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 build_initial for_mkfs: 0 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:15:27.010+0000 7ffb04140800 10 monclient: monmap: 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:15:27.155 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding auth protocol: cephx 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding auth protocol: cephx 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding auth protocol: cephx 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.156 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: crc 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992bea2910) adding con mode: secure 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:15:27.010+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: starting msgr at 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: starting objecter 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command objecter_requests cmddesc objecter_requests hook 0x55992be9d310 EEXIST 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: setting wanted keys 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:15:27.010+0000 7ffb04140800 1 librados: calling monclient init 2024-09-14T11:15:27.157 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:15:27.010+0000 7ffb04140800 10 monclient: init 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding auth protocol: cephx 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding auth protocol: cephx 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding auth protocol: cephx 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.158 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: crc 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:15:27.010+0000 7ffb04140800 5 AuthRegistry(0x55992be95500) adding con mode: secure 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:15:27.010+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:15:27.010+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:15:27.011+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command rotate-key cmddesc rotate-key hook 0x55992be95648 EEXIST 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _reopen_session rank -1 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-c con 0x55992bea1ad0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-b con 0x55992becd080 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): picked mon.noname-a con 0x55992bed1cc0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.159 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): start opening mon connection 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): _renew_subs 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient(hunting): authenticate will time out at 1953.563085s 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): get_auth_request con 0x55992bed1cc0 auth_method 0 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): get_auth_request con 0x55992bea1ad0 auth_method 0 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.160 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:15:27.011+0000 7ffaffeed640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request con 0x55992becd080 auth_method 0 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:15:27.011+0000 7ffaff6ec640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient(hunting): handle_auth_done global_id 7041 payload 824 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient: _finish_hunting 0 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:15:27.011+0000 7ffb006ee640 1 monclient: found mon.noname-a 2024-09-14T11:15:27.161 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:15:27.011+0000 7ffb006ee640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: dump: 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.162 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: _finish_auth 0 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: _check_auth_tickets 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:15:27.011+0000 7ffb04140800 5 monclient: authenticate success, global_id 7041 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:15:27.011+0000 7ff9deffd640 4 set_mon_vals no callback set 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:15:27.011+0000 7ff9dd7fa640 10 monclient: dump: 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.163 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _renew_subs 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:15:27.011+0000 7ffb04140800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:15:27.011+0000 7ffb04140800 1 librados: init done 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:15:27.011+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cr dump hook 0x55992bedf568 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:15:27.013+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:15:27.013+0000 7ff9dd7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:15:27.164 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:15:27.013+0000 7ff9dd7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:15:27.013+0000 7ff9dd7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:15:27.014+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ff9c80773d0 auth_method 0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:15:27.014+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992beec0d0 auth_method 0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:15:27.014+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:15:27.014+0000 7ffb04140800 20 realm 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:15:27.014+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:15:27.015+0000 7ffb04140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:15:27.015+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.165 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:15:27.015+0000 7ffaffeed640 10 monclient: get_auth_request con 0x55992bef0440 auth_method 0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:15:27.016+0000 7ffb04140800 20 searching for the correct realm 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:15:27.016+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x55992bef55c0 auth_method 0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:15:27.017+0000 7ffb006ee640 10 monclient: get_auth_request con 0x7ffaf406db90 auth_method 0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:15:27.018+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ffaf8065020 auth_method 0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:15:27.018+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x7ffaf003e030 auth_method 0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:15:27.019+0000 7ffaff6ec640 0 -- 172.21.15.2:0/3833248084 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55992bef55c0 msgr2=0x55992bef7a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:15:27.019+0000 7ff9dd7fa640 1 client.7041.objecter ms_handle_reset 0x55992bef55c0 session 0x55992bef4f40 osd.3 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:15:27.019+0000 7ff9dd7fa640 10 monclient: _renew_subs 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:15:27.019+0000 7ff9dd7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:15:27.020+0000 7ffaff6ec640 10 monclient: get_auth_request con 0x7ff9c8087270 auth_method 0 2024-09-14T11:15:27.166 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:15:27.020+0000 7ffb006ee640 10 monclient: get_auth_request con 0x7ffaf4061400 auth_method 0 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:15:27.022+0000 7ffaffeed640 10 monclient: get_auth_request con 0x7ffaf40a3920 auth_method 0 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:15:27.023+0000 7ffaffeed640 0 -- 172.21.15.2:0/3833248084 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ffaf40a3920 msgr2=0x7ffaf4085400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:15:27.023+0000 7ff9dd7fa640 1 client.7041.objecter ms_handle_reset 0x7ffaf40a3920 session 0x7ffaf407ddd0 osd.0 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:15:27.023+0000 7ffaffeed640 10 monclient: get_auth_request con 0x55992bef55c0 auth_method 0 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.167 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:15:27.027+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 zone default found 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:15:27.028+0000 7ffb04140800 4 Realm: () 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:15:27.028+0000 7ffb04140800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:15:27.028+0000 7ffb04140800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:15:27.028+0000 7ffb04140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 zonegroup default 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.168 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:15:27.028+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:15:27.029+0000 7ffb04140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:15:27.029+0000 7ffb04140800 20 started sync module instance, tier type = 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:15:27.029+0000 7ffb04140800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=0 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=1 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=2 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=3 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=4 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=5 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:15:27.037+0000 7ffb04140800 20 add_watcher() i=6 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:15:27.038+0000 7ffb04140800 20 add_watcher() i=7 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:15:27.038+0000 7ffb04140800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding auth protocol: cephx 2024-09-14T11:15:27.169 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding auth protocol: cephx 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding auth protocol: cephx 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: crc 2024-09-14T11:15:27.170 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 AuthRegistry(0x7fff3bb8e070) adding con mode: secure 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:15:27.040+0000 7ff9b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:15:27.040+0000 7ffb04140800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache list hook 0x55992beca910 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache inspect hook 0x55992beca910 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache erase hook 0x55992beca910 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command cache zap hook 0x55992beca910 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 note: GC not initialized 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:15:27.040+0000 7ff9b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace show hook 0x7ffaf404ea10 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace history hook 0x7ffaf404ea10 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace active hook 0x7ffaf404ea10 2024-09-14T11:15:27.171 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:15:27.040+0000 7ffb04140800 5 asok(0x55992bbe1270) register_command sync trace active_short hook 0x7ffaf404ea10 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:15:27.040+0000 7ffb04140800 20 Filter name: none 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:15:27.041+0000 7ff92e7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : miss 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:15:27.041+0000 7ffb04140800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:27.172 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:15:27.041+0000 7ffb04140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:15:27.046+0000 7ffb04140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464355 cookie 94116355468400 notifier 7041 bl.length()=915 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:15:27.046+0000 7ff9deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:27.173 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:15:27.046+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:15:27.049+0000 7ffb04140800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.0 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.0 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:15:27.049+0000 7ffb04140800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.1 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.1.1 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:15:27.049+0000 7ffb04140800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.0 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:15:27.051+0000 7ffb04140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:15:27.051+0000 7ffb04140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:15:27.052+0000 7ffb04140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:27.174 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464356 cookie 94116355468400 notifier 7041 bl.length()=915 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:15:27.053+0000 7ff9deffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:15:27.053+0000 7ffb04140800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:15:27.054+0000 7ffb04140800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffb04140800 time 2024-09-14T11:15:27.054294+0000 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7ffb0598c76a] 2024-09-14T11:15:27.175 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:15:27.055+0000 7ffb04140800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7ffb04140800 thread_name:radosgw-admin 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7ffb0463e6f0] 2024-09-14T11:15:27.176 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7ffb0468b99c] 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7ffb0598c7c4] 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7ffb0598c928] 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55992b03b0b1] 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x189e) [0x55992b04a18e] 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55992b04afc4] 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7ffb04629590] 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:15:27.177 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:15:27.178 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:15:27.179 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:15:27.180 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:15:27.181 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:15:27.182 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:15:27.183 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:15:27.184 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff92e7fc640 / http_manager 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9b4fe1640 / http_manager 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9b5fe3640 / rgw_dt_lg_renew 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9dd7fa640 / ms_dispatch 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9deffd640 / io_context_pool 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9e57fa640 / ms_dispatch 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9e7fff640 / ms_dispatch 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ff9ede0b640 / io_context_pool 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffaff6ec640 / msgr-worker-2 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffaffeed640 / msgr-worker-1 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffb006ee640 / msgr-worker-0 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffb00eef640 / io_context_pool 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7ffb04140800 / radosgw-admin 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:15:27.185 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:15:27.186 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:15:27.055985Z_ce68b0ce-9ba2-49ab-853f-88aec46c0c10/log 2024-09-14T11:15:27.186 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:15:27.186 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:15:27.187 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:27.187 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.134+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 20 realm 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.136+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.137+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.137+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.188 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.137+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:27.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.138+0000 7f2c9aa20800 20 searching for the correct realm 2024-09-14T11:15:27.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.141+0000 7f2c98d0b640 0 -- 172.21.15.2:0/3389959575 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f2c8c06d5e0 msgr2=0x7f2c8c06c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.189 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.144+0000 7f2c9850a640 0 -- 172.21.15.2:0/3389959575 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2c8c06c5e0 msgr2=0x7f2c8c0761a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.350+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 20 zone default found 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 4 Realm: () 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 20 zonegroup default 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.351+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.352+0000 7f2c9aa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.352+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.352+0000 7f2c9aa20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.352+0000 7f2c9aa20800 20 started sync module instance, tier type = 2024-09-14T11:15:27.352 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.352+0000 7f2c9aa20800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:27.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.360+0000 7f2c9aa20800 20 add_watcher() i=0 2024-09-14T11:15:27.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.360+0000 7f2c9aa20800 20 add_watcher() i=1 2024-09-14T11:15:27.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.360+0000 7f2c9aa20800 20 add_watcher() i=2 2024-09-14T11:15:27.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.360+0000 7f2c9aa20800 20 add_watcher() i=3 2024-09-14T11:15:27.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.360+0000 7f2c9aa20800 20 add_watcher() i=4 2024-09-14T11:15:27.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.360+0000 7f2c9aa20800 20 add_watcher() i=5 2024-09-14T11:15:27.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.360+0000 7f2c9aa20800 20 add_watcher() i=6 2024-09-14T11:15:27.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.361+0000 7f2c9aa20800 20 add_watcher() i=7 2024-09-14T11:15:27.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.361+0000 7f2c9aa20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:27.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.363+0000 7f2b4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:27.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:27.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:27.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 5 note: GC not initialized 2024-09-14T11:15:27.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2b4dfdb640 20 reqs_thread_entry: start 2024-09-14T11:15:27.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:27.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 20 Filter name: none 2024-09-14T11:15:27.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2abf7fe640 20 reqs_thread_entry: start 2024-09-14T11:15:27.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.364+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.365+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.365+0000 7f2c9aa20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.365+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.365+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.365+0000 7f2c9aa20800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.366+0000 7f2c9aa20800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:15:27.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.366+0000 7f2c9aa20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:27.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.367+0000 7f2b4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:27.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.369+0000 7f2c9aa20800 20 remove_watcher() i=0 2024-09-14T11:15:27.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.369+0000 7f2c9aa20800 2 removed watcher, disabling cache 2024-09-14T11:15:27.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.370+0000 7f2c9aa20800 20 remove_watcher() i=1 2024-09-14T11:15:27.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.371+0000 7f2c9aa20800 20 remove_watcher() i=2 2024-09-14T11:15:27.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.372+0000 7f2c9aa20800 20 remove_watcher() i=3 2024-09-14T11:15:27.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.373+0000 7f2c9aa20800 20 remove_watcher() i=4 2024-09-14T11:15:27.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.374+0000 7f2c9aa20800 20 remove_watcher() i=5 2024-09-14T11:15:27.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.375+0000 7f2c9aa20800 20 remove_watcher() i=6 2024-09-14T11:15:27.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.376+0000 7f2c9aa20800 20 remove_watcher() i=7 2024-09-14T11:15:27.385 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.385 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:27.385 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-block-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:15:27.385 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:27.387 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:27.387 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:27.395 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:27.395 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:27.438 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:15:27.472 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:27.472 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:27.511 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.513+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 20 realm 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.514 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.515+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.516+0000 7fdb39d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.516+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.516+0000 7fdb39d26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:27.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.516+0000 7fdb39d26800 20 searching for the correct realm 2024-09-14T11:15:27.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.519+0000 7fdb3624c640 0 -- 172.21.15.2:0/991908267 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fdb2c085980 msgr2=0x7fdb2c086400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.523+0000 7fdb35a4b640 0 -- 172.21.15.2:0/991908267 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fdb2c095920 msgr2=0x7fdb2c0933f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:27.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:27.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:27.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.730+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:27.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 zone default found 2024-09-14T11:15:27.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 4 Realm: () 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 zonegroup default 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.731+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.732+0000 7fdb39d26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.732+0000 7fdb39d26800 20 started sync module instance, tier type = 2024-09-14T11:15:27.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.732+0000 7fdb39d26800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:27.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.741+0000 7fdb39d26800 20 add_watcher() i=0 2024-09-14T11:15:27.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.741+0000 7fdb39d26800 20 add_watcher() i=1 2024-09-14T11:15:27.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.741+0000 7fdb39d26800 20 add_watcher() i=2 2024-09-14T11:15:27.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.741+0000 7fdb39d26800 20 add_watcher() i=3 2024-09-14T11:15:27.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.741+0000 7fdb39d26800 20 add_watcher() i=4 2024-09-14T11:15:27.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.741+0000 7fdb39d26800 20 add_watcher() i=5 2024-09-14T11:15:27.739 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.741+0000 7fdb39d26800 20 add_watcher() i=6 2024-09-14T11:15:27.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.742+0000 7fdb39d26800 20 add_watcher() i=7 2024-09-14T11:15:27.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.742+0000 7fdb39d26800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:27.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.743+0000 7fd9e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:27.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fdb39d26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:27.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fdb39d26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:27.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fdb39d26800 5 note: GC not initialized 2024-09-14T11:15:27.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fd9e67fc640 20 reqs_thread_entry: start 2024-09-14T11:15:27.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fdb39d26800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:27.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fdb39d26800 20 Filter name: none 2024-09-14T11:15:27.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fd957fff640 20 reqs_thread_entry: start 2024-09-14T11:15:27.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fdb39d26800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:15:27.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.744+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : miss 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 20 rados->read ofs=0 len=0 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:27.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.745+0000 7fdb39d26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:27.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.746+0000 7fdb39d26800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to be held by another RGW process; skipping for now 2024-09-14T11:15:27.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.747+0000 7fd9e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:27.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.749+0000 7fdb39d26800 20 remove_watcher() i=0 2024-09-14T11:15:27.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.749+0000 7fdb39d26800 2 removed watcher, disabling cache 2024-09-14T11:15:27.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.750+0000 7fdb39d26800 20 remove_watcher() i=1 2024-09-14T11:15:27.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.751+0000 7fdb39d26800 20 remove_watcher() i=2 2024-09-14T11:15:27.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.752+0000 7fdb39d26800 20 remove_watcher() i=3 2024-09-14T11:15:27.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.753+0000 7fdb39d26800 20 remove_watcher() i=4 2024-09-14T11:15:27.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.754+0000 7fdb39d26800 20 remove_watcher() i=5 2024-09-14T11:15:27.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.755+0000 7fdb39d26800 20 remove_watcher() i=6 2024-09-14T11:15:27.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:27.756+0000 7fdb39d26800 20 remove_watcher() i=7 2024-09-14T11:15:27.766 INFO:tasks.workunit.client.0.smithi002.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:15:57.800 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:15:57.835 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:57.835 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:57.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.882+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.884+0000 7fd18020f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.884+0000 7fd18020f800 20 realm 2024-09-14T11:15:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.884+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.884+0000 7fd18020f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.884+0000 7fd18020f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.884+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.885+0000 7fd18020f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:57.884 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.885+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.886+0000 7fd18020f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:57.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.886+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:57.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.886+0000 7fd18020f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:57.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.886+0000 7fd18020f800 20 searching for the correct realm 2024-09-14T11:15:57.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.889+0000 7fd17b121640 0 -- 172.21.15.2:0/3024265435 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fd16c027040 msgr2=0x7fd16c026410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:57.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:57.894+0000 7fd17b922640 0 -- 172.21.15.2:0/3024265435 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd1700c9390 msgr2=0x7fd1700c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.102+0000 7fd18020f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.102+0000 7fd18020f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.102+0000 7fd18020f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.102+0000 7fd18020f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.102+0000 7fd18020f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.102+0000 7fd18020f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.102+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:58.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 20 zone default found 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 4 Realm: () 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.103+0000 7fd18020f800 20 zonegroup default 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.104+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.104+0000 7fd18020f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.104+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.104+0000 7fd18020f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.104+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.105+0000 7fd18020f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.105+0000 7fd18020f800 20 started sync module instance, tier type = 2024-09-14T11:15:58.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.105+0000 7fd18020f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:58.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.115+0000 7fd18020f800 20 add_watcher() i=0 2024-09-14T11:15:58.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.115+0000 7fd18020f800 20 add_watcher() i=1 2024-09-14T11:15:58.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.115+0000 7fd18020f800 20 add_watcher() i=2 2024-09-14T11:15:58.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.115+0000 7fd18020f800 20 add_watcher() i=3 2024-09-14T11:15:58.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.115+0000 7fd18020f800 20 add_watcher() i=4 2024-09-14T11:15:58.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.115+0000 7fd18020f800 20 add_watcher() i=5 2024-09-14T11:15:58.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.115+0000 7fd18020f800 20 add_watcher() i=6 2024-09-14T11:15:58.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.116+0000 7fd18020f800 20 add_watcher() i=7 2024-09-14T11:15:58.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.116+0000 7fd18020f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:58.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.118+0000 7fd031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:58.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.119+0000 7fd18020f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:58.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.119+0000 7fd18020f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:58.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.119+0000 7fd18020f800 5 note: GC not initialized 2024-09-14T11:15:58.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.119+0000 7fd030fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:58.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.119+0000 7fd18020f800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:58.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.119+0000 7fd18020f800 20 Filter name: none 2024-09-14T11:15:58.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fcfaa7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:58.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-14T11:15:58.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:58.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-14T11:15:58.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-14T11:15:58.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : miss 2024-09-14T11:15:58.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.120 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-14T11:15:58.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:58.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:58.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:58.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.120+0000 7fd18020f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:58.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.121+0000 7fd18020f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:58.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.122+0000 7fd18020f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:15:58.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd18020f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:58.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd18020f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:58.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd18020f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:58.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd18020f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd05affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464357 cookie 94570799069120 notifier 6749 bl.length()=915 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd05affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd05affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.127+0000 7fd05affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.128+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.128+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.128+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:58.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.128+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:58.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.133+0000 7fd18020f800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.2.0 2024-09-14T11:15:58.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.133+0000 7fd18020f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.2.0 2024-09-14T11:15:58.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.133+0000 7fd18020f800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.2.1 2024-09-14T11:15:58.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.133+0000 7fd18020f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.2.1 2024-09-14T11:15:58.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.133+0000 7fd18020f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.0 2024-09-14T11:15:58.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.135+0000 7fd18020f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:58.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.135+0000 7fd18020f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:58.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd18020f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:58.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd18020f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:58.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd18020f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:58.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd18020f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd05a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464358 cookie 94570799069120 notifier 6749 bl.length()=915 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd05a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd05a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.137+0000 7fd05a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.138+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.138+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.138+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:58.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.138+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:58.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.139+0000 7fd18020f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.29.0 2024-09-14T11:15:58.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.140+0000 7fd18020f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:58.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.140+0000 7fd18020f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 2024-09-14T11:15:58.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.141+0000 7fd18020f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:58.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.141+0000 7fd18020f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.141+0000 7fd18020f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.141+0000 7fd18020f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29, ofs0, ns] 2024-09-14T11:15:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd05affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464359 cookie 94570799069120 notifier 6749 bl.length()=883 2024-09-14T11:15:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd05affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 info.flags=0x17 2024-09-14T11:15:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd05affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 to cache LRU end 2024-09-14T11:15:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd05affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:58.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_sources= new_sources= 2024-09-14T11:15:58.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential sources added=[] removed=[] 2024-09-14T11:15:58.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): orig_dests= new_dests= 2024-09-14T11:15:58.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.142+0000 7fd18020f800 20 handle_bi_update(): bucket=:abort-at-block-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.29]): potential dests added=[] removed=[] 2024-09-14T11:15:58.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.143+0000 7fd18020f800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:15:58.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.146+0000 7fd031fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:58.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.148+0000 7fd18020f800 20 remove_watcher() i=0 2024-09-14T11:15:58.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.148+0000 7fd18020f800 2 removed watcher, disabling cache 2024-09-14T11:15:58.148 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.149+0000 7fd18020f800 20 remove_watcher() i=1 2024-09-14T11:15:58.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.150+0000 7fd18020f800 20 remove_watcher() i=2 2024-09-14T11:15:58.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.151+0000 7fd18020f800 20 remove_watcher() i=3 2024-09-14T11:15:58.151 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.152+0000 7fd18020f800 20 remove_watcher() i=4 2024-09-14T11:15:58.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.154+0000 7fd18020f800 20 remove_watcher() i=5 2024-09-14T11:15:58.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.155+0000 7fd18020f800 20 remove_watcher() i=6 2024-09-14T11:15:58.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.156+0000 7fd18020f800 20 remove_watcher() i=7 2024-09-14T11:15:58.169 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-14T11:15:58.200 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:58.200 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:58.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.241+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 20 realm 2024-09-14T11:15:58.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:58.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.243+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.244+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:58.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.244+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.244+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:58.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.244+0000 7efef9d25800 20 searching for the correct realm 2024-09-14T11:15:58.246 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.247+0000 7efef5132640 0 -- 172.21.15.2:0/1523201723 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7efee8079c20 msgr2=0x7efee80aead0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:58.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.454+0000 7efef5933640 0 -- 172.21.15.2:0/1523201723 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7efeec0832b0 msgr2=0x7efeec0870c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.660+0000 7efef9d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.660+0000 7efef9d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.660+0000 7efef9d25800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.660+0000 7efef9d25800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.660+0000 7efef9d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.660+0000 7efef9d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.660+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 zone default found 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 4 Realm: () 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 zonegroup default 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.661+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.662+0000 7efef9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.662+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.662+0000 7efef9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.662+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.662+0000 7efef9d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:58.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.662+0000 7efef9d25800 20 started sync module instance, tier type = 2024-09-14T11:15:58.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.662+0000 7efef9d25800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.672+0000 7efef9d25800 20 add_watcher() i=0 2024-09-14T11:15:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.672+0000 7efef9d25800 20 add_watcher() i=1 2024-09-14T11:15:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.672+0000 7efef9d25800 20 add_watcher() i=2 2024-09-14T11:15:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.672+0000 7efef9d25800 20 add_watcher() i=3 2024-09-14T11:15:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.672+0000 7efef9d25800 20 add_watcher() i=4 2024-09-14T11:15:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.672+0000 7efef9d25800 20 add_watcher() i=5 2024-09-14T11:15:58.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.672+0000 7efef9d25800 20 add_watcher() i=6 2024-09-14T11:15:58.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.673+0000 7efef9d25800 20 add_watcher() i=7 2024-09-14T11:15:58.673 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.673+0000 7efef9d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:58.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.675+0000 7efda77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:58.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efef9d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:58.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efef9d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:58.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efef9d25800 5 note: GC not initialized 2024-09-14T11:15:58.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efda67fc640 20 reqs_thread_entry: start 2024-09-14T11:15:58.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efef9d25800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:58.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efef9d25800 20 Filter name: none 2024-09-14T11:15:58.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efd17fff640 20 reqs_thread_entry: start 2024-09-14T11:15:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.676+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.677+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.677+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.677+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.677+0000 7efef9d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.677+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.678+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:15:58.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.678+0000 7efef9d25800 20 rados->read ofs=0 len=0 2024-09-14T11:15:58.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.678+0000 7efef9d25800 20 rados_obj.operate() r=0 bl.length=411 2024-09-14T11:15:58.678 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.678+0000 7efef9d25800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:58.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.679+0000 7efda77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:58.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.682+0000 7efef9d25800 20 remove_watcher() i=0 2024-09-14T11:15:58.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.682+0000 7efef9d25800 2 removed watcher, disabling cache 2024-09-14T11:15:58.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.683+0000 7efef9d25800 20 remove_watcher() i=1 2024-09-14T11:15:58.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.684+0000 7efef9d25800 20 remove_watcher() i=2 2024-09-14T11:15:58.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.686+0000 7efef9d25800 20 remove_watcher() i=3 2024-09-14T11:15:58.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.687+0000 7efef9d25800 20 remove_watcher() i=4 2024-09-14T11:15:58.687 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.688+0000 7efef9d25800 20 remove_watcher() i=5 2024-09-14T11:15:58.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.689+0000 7efef9d25800 20 remove_watcher() i=6 2024-09-14T11:15:58.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:58.690+0000 7efef9d25800 20 remove_watcher() i=7 2024-09-14T11:15:58.700 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:58.700 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:58.701 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-block-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.29 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:15:58.701 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:58.703 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.703 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.706 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.706 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.749 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.749 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.763 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-14T11:15:58.763 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:58.764 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.764 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.775 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.775 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.818 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.818 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.826 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.826 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.833 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.834 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.841 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.841 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.848 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.848 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.856 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.856 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.865 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.865 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.872 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.872 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.880 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.880 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.887 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.888 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.895 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.895 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.903 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.903 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.910 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.910 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.917 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.917 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.924 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.924 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.931 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.931 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.939 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.939 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.946 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.946 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.953 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.953 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.961 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:58.961 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:58.968 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:15:58.997 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:58.997 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:59.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.036+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.038+0000 7f994380d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.038+0000 7f994380d800 20 realm 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.038+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.039+0000 7f994380d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.039+0000 7f994380d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.039+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.039+0000 7f994380d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.039+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.039+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.039+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.040+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:59.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.040+0000 7f994380d800 20 searching for the correct realm 2024-09-14T11:15:59.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.043+0000 7f9940af6640 0 -- 172.21.15.2:0/646212586 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f993402f040 msgr2=0x7f9934020450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.046+0000 7f99412f7640 0 -- 172.21.15.2:0/646212586 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f99380723f0 msgr2=0x7f993808f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.251+0000 7f994380d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.251+0000 7f994380d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.251+0000 7f994380d800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.251+0000 7f994380d800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.251+0000 7f994380d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.251+0000 7f994380d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.251+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.251 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.252 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 zone default found 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 4 Realm: () 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 zonegroup default 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.252+0000 7f994380d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.253+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.253+0000 7f994380d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.253+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.253+0000 7f994380d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.253+0000 7f994380d800 20 started sync module instance, tier type = 2024-09-14T11:15:59.254 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.253+0000 7f994380d800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:59.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.262+0000 7f994380d800 20 add_watcher() i=0 2024-09-14T11:15:59.261 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.262+0000 7f994380d800 20 add_watcher() i=1 2024-09-14T11:15:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.262+0000 7f994380d800 20 add_watcher() i=2 2024-09-14T11:15:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.262+0000 7f994380d800 20 add_watcher() i=3 2024-09-14T11:15:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.262+0000 7f994380d800 20 add_watcher() i=4 2024-09-14T11:15:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.262+0000 7f994380d800 20 add_watcher() i=5 2024-09-14T11:15:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.262+0000 7f994380d800 20 add_watcher() i=6 2024-09-14T11:15:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.263+0000 7f994380d800 20 add_watcher() i=7 2024-09-14T11:15:59.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.263+0000 7f994380d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:59.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.265+0000 7f97f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.265+0000 7f994380d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.265+0000 7f994380d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.265+0000 7f994380d800 5 note: GC not initialized 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.266+0000 7f97f6fe5640 20 reqs_thread_entry: start 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.266+0000 7f994380d800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.266+0000 7f994380d800 20 Filter name: none 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.266+0000 7f97f4fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:59.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.266+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.266+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:15:59.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.266+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.267+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:15:59.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.267+0000 7f994380d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:59.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.267+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.268+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:15:59.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.268+0000 7f994380d800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.268+0000 7f994380d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:15:59.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.268+0000 7f994380d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:59.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.269+0000 7f97f7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.272+0000 7f994380d800 20 remove_watcher() i=0 2024-09-14T11:15:59.271 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.272+0000 7f994380d800 2 removed watcher, disabling cache 2024-09-14T11:15:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.273+0000 7f994380d800 20 remove_watcher() i=1 2024-09-14T11:15:59.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.274+0000 7f994380d800 20 remove_watcher() i=2 2024-09-14T11:15:59.274 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.275+0000 7f994380d800 20 remove_watcher() i=3 2024-09-14T11:15:59.275 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.276+0000 7f994380d800 20 remove_watcher() i=4 2024-09-14T11:15:59.276 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.277+0000 7f994380d800 20 remove_watcher() i=5 2024-09-14T11:15:59.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.278+0000 7f994380d800 20 remove_watcher() i=6 2024-09-14T11:15:59.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.279+0000 7f994380d800 20 remove_watcher() i=7 2024-09-14T11:15:59.289 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:59.289 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:59.290 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:15:59.290 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:59.291 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-14T11:15:59.326 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:59.326 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:59.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.367+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.368+0000 7f06ed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.368+0000 7f06ed746800 20 realm 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.368+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.368+0000 7f06ed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.368+0000 7f06ed746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.368+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.369+0000 7f06ed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.369+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.370+0000 7f06ed746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.370+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.370+0000 7f06ed746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:59.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.370+0000 7f06ed746800 20 searching for the correct realm 2024-09-14T11:15:59.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.372+0000 7f06eb237640 0 -- 172.21.15.2:0/3635458175 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f06e4073070 msgr2=0x7f06e40a7d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:59.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.576+0000 7f06eba38640 0 -- 172.21.15.2:0/3635458175 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f06e006bb30 msgr2=0x7f06e0061300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:59.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:59.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:59.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:59.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:59.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:59.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.582 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.582+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 zone default found 2024-09-14T11:15:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 4 Realm: () 2024-09-14T11:15:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:59.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 zonegroup default 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.583+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.584+0000 7f06ed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.584+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.584+0000 7f06ed746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.584+0000 7f06ed746800 20 started sync module instance, tier type = 2024-09-14T11:15:59.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.584+0000 7f06ed746800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.593+0000 7f06ed746800 20 add_watcher() i=0 2024-09-14T11:15:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.593+0000 7f06ed746800 20 add_watcher() i=1 2024-09-14T11:15:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.593+0000 7f06ed746800 20 add_watcher() i=2 2024-09-14T11:15:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.593+0000 7f06ed746800 20 add_watcher() i=3 2024-09-14T11:15:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.593+0000 7f06ed746800 20 add_watcher() i=4 2024-09-14T11:15:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.593+0000 7f06ed746800 20 add_watcher() i=5 2024-09-14T11:15:59.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.593+0000 7f06ed746800 20 add_watcher() i=6 2024-09-14T11:15:59.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.594+0000 7f06ed746800 20 add_watcher() i=7 2024-09-14T11:15:59.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.594+0000 7f06ed746800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:59.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.595+0000 7f05a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.595+0000 7f06ed746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:59.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.595+0000 7f06ed746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:59.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.596+0000 7f06ed746800 5 note: GC not initialized 2024-09-14T11:15:59.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.596+0000 7f05a0fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:59.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.596+0000 7f06ed746800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:59.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.596+0000 7f06ed746800 20 Filter name: none 2024-09-14T11:15:59.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.596+0000 7f051a7fc640 20 reqs_thread_entry: start 2024-09-14T11:15:59.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.596+0000 7f06ed746800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:15:59.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.596+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 : miss 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:59.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.597+0000 7f06ed746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 2024-09-14T11:15:59.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f06ed746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:15:59.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f06ed746800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:15:59.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f06ed746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:59.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f06ed746800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30, ofs0, ns] 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f05ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464364 cookie 94896121067568 notifier 7149 bl.length()=931 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f05ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f05ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.601+0000 7f05ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.602+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_sources= new_sources= 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.602+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential sources added=[] removed=[] 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.602+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_dests= new_dests= 2024-09-14T11:15:59.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.602+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential dests added=[] removed=[] 2024-09-14T11:15:59.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.604+0000 7f06ed746800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.1.0 2024-09-14T11:15:59.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.604+0000 7f06ed746800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.1.0 2024-09-14T11:15:59.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.604+0000 7f06ed746800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.1.1 2024-09-14T11:15:59.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.604+0000 7f06ed746800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.1.1 2024-09-14T11:15:59.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.604+0000 7f06ed746800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.0 2024-09-14T11:15:59.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.606+0000 7f06ed746800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:15:59.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.606+0000 7f06ed746800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 2024-09-14T11:15:59.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f06ed746800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:15:59.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f06ed746800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:15:59.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f06ed746800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:59.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f06ed746800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30, ofs0, ns] 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f05ceffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464365 cookie 94896121067568 notifier 7149 bl.length()=931 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f05ceffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f05ceffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.607+0000 7f05ceffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.608+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_sources= new_sources= 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.608+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential sources added=[] removed=[] 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.608+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_dests= new_dests= 2024-09-14T11:15:59.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.608+0000 7f06ed746800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential dests added=[] removed=[] 2024-09-14T11:15:59.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.609+0000 7f06ed746800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.0 2024-09-14T11:15:59.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.609+0000 7f06ed746800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-14T11:15:59.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.609+0000 7f06ed746800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-14T11:15:59.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.612+0000 7f05a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.614+0000 7f06ed746800 20 remove_watcher() i=0 2024-09-14T11:15:59.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.614+0000 7f06ed746800 2 removed watcher, disabling cache 2024-09-14T11:15:59.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.615+0000 7f06ed746800 20 remove_watcher() i=1 2024-09-14T11:15:59.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.616+0000 7f06ed746800 20 remove_watcher() i=2 2024-09-14T11:15:59.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.617+0000 7f06ed746800 20 remove_watcher() i=3 2024-09-14T11:15:59.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.618+0000 7f06ed746800 20 remove_watcher() i=4 2024-09-14T11:15:59.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.619+0000 7f06ed746800 20 remove_watcher() i=5 2024-09-14T11:15:59.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.620+0000 7f06ed746800 20 remove_watcher() i=6 2024-09-14T11:15:59.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.621+0000 7f06ed746800 20 remove_watcher() i=7 2024-09-14T11:15:59.633 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:15:59.662 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:15:59.663 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:15:59.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.702+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.704+0000 7f33d7528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.704+0000 7f33d7528800 20 realm 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.704+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.704+0000 7f33d7528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.704+0000 7f33d7528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.704+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.705+0000 7f33d7528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.705+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.705+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.705+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.706+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:15:59.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.706+0000 7f33d7528800 20 searching for the correct realm 2024-09-14T11:15:59.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.708+0000 7f33d2a6e640 0 -- 172.21.15.2:0/3110242617 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f33c4041070 msgr2=0x7f33c40419e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:15:59.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.712+0000 7f33d326f640 0 -- 172.21.15.2:0/3110242617 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f33c806c4e0 msgr2=0x7f33c80a2270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:15:59.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:15:59.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:15:59.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:15:59.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:15:59.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:15:59.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:15:59.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.918+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 zone default found 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 4 Realm: () 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 zonegroup default 2024-09-14T11:15:59.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:15:59.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 started sync module instance, tier type = 2024-09-14T11:15:59.920 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.919+0000 7f33d7528800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:15:59.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.928+0000 7f33d7528800 20 add_watcher() i=0 2024-09-14T11:15:59.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.928+0000 7f33d7528800 20 add_watcher() i=1 2024-09-14T11:15:59.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.928+0000 7f33d7528800 20 add_watcher() i=2 2024-09-14T11:15:59.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.928+0000 7f33d7528800 20 add_watcher() i=3 2024-09-14T11:15:59.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.928+0000 7f33d7528800 20 add_watcher() i=4 2024-09-14T11:15:59.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.928+0000 7f33d7528800 20 add_watcher() i=5 2024-09-14T11:15:59.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.928+0000 7f33d7528800 20 add_watcher() i=6 2024-09-14T11:15:59.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.929+0000 7f33d7528800 20 add_watcher() i=7 2024-09-14T11:15:59.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.929+0000 7f33d7528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:15:59.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f3289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f33d7528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f33d7528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f33d7528800 5 note: GC not initialized 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f3288fe1640 20 reqs_thread_entry: start 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f33d7528800 20 init_complete bucket index max shards: 1 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f33d7528800 20 Filter name: none 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f32027fc640 20 reqs_thread_entry: start 2024-09-14T11:15:59.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.931+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.932+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:15:59.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.932+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.933+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:15:59.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.933+0000 7f33d7528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:59.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.933+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.933+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:15:59.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.933+0000 7f33d7528800 20 rados->read ofs=0 len=0 2024-09-14T11:15:59.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.933+0000 7f33d7528800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:15:59.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.933+0000 7f33d7528800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:15:59.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.935+0000 7f3289fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:15:59.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.937+0000 7f33d7528800 20 remove_watcher() i=0 2024-09-14T11:15:59.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.937+0000 7f33d7528800 2 removed watcher, disabling cache 2024-09-14T11:15:59.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.938+0000 7f33d7528800 20 remove_watcher() i=1 2024-09-14T11:15:59.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.939+0000 7f33d7528800 20 remove_watcher() i=2 2024-09-14T11:15:59.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.940+0000 7f33d7528800 20 remove_watcher() i=3 2024-09-14T11:15:59.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.940+0000 7f33d7528800 20 remove_watcher() i=4 2024-09-14T11:15:59.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.941+0000 7f33d7528800 20 remove_watcher() i=5 2024-09-14T11:15:59.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.942+0000 7f33d7528800 20 remove_watcher() i=6 2024-09-14T11:15:59.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:15:59.943+0000 7f33d7528800 20 remove_watcher() i=7 2024-09-14T11:15:59.953 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:59.954 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:15:59.954 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:15:59.954 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:15:59.955 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:59.955 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:15:59.963 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:15:59.963 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.006 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:16:00.038 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:00.038 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:00.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.078+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 20 realm 2024-09-14T11:16:00.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.080+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.081+0000 7f3985c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.081+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.081+0000 7f3985c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:00.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.081+0000 7f3985c13800 20 searching for the correct realm 2024-09-14T11:16:00.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.084+0000 7f3980b47640 0 -- 172.21.15.2:0/1389925078 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55b33da1c770 msgr2=0x55b33da1ec30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:00.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.087+0000 7f3981348640 0 -- 172.21.15.2:0/1389925078 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f397802f910 msgr2=0x7f397805a400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.092+0000 7f3985c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.093 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 zone default found 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 4 Realm: () 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 zonegroup default 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.093+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.094+0000 7f3985c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.094+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.094+0000 7f3985c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.094+0000 7f3985c13800 20 started sync module instance, tier type = 2024-09-14T11:16:00.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.094+0000 7f3985c13800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:00.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.304+0000 7f3985c13800 20 add_watcher() i=0 2024-09-14T11:16:00.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.304+0000 7f3985c13800 20 add_watcher() i=1 2024-09-14T11:16:00.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.304+0000 7f3985c13800 20 add_watcher() i=2 2024-09-14T11:16:00.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.304+0000 7f3985c13800 20 add_watcher() i=3 2024-09-14T11:16:00.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.304+0000 7f3985c13800 20 add_watcher() i=4 2024-09-14T11:16:00.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.304+0000 7f3985c13800 20 add_watcher() i=5 2024-09-14T11:16:00.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.304+0000 7f3985c13800 20 add_watcher() i=6 2024-09-14T11:16:00.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.305+0000 7f3985c13800 20 add_watcher() i=7 2024-09-14T11:16:00.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.305+0000 7f3985c13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:00.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.307+0000 7f38377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.307+0000 7f3985c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.307+0000 7f3985c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.307+0000 7f3985c13800 5 note: GC not initialized 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.307+0000 7f38367e4640 20 reqs_thread_entry: start 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 20 Filter name: none 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f37a7fff640 20 reqs_thread_entry: start 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:16:00.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:00.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:16:00.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:16:00.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 : miss 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.308+0000 7f3985c13800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.309+0000 7f3985c13800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.309+0000 7f3985c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.309+0000 7f3985c13800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.309+0000 7f3985c13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.309+0000 7f3985c13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.309+0000 7f3985c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 2024-09-14T11:16:00.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.310+0000 7f3985c13800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:16:00.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.313+0000 7f3985c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:16:00.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.313+0000 7f3985c13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:16:00.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.313+0000 7f3985c13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:00.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.313+0000 7f3985c13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30, ofs0, ns] 2024-09-14T11:16:00.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3857fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464366 cookie 94228321539808 notifier 7185 bl.length()=931 2024-09-14T11:16:00.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3857fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:16:00.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3857fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:16:00.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3857fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:00.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_sources= new_sources= 2024-09-14T11:16:00.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential sources added=[] removed=[] 2024-09-14T11:16:00.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_dests= new_dests= 2024-09-14T11:16:00.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.314+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential dests added=[] removed=[] 2024-09-14T11:16:00.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.317+0000 7f3985c13800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.2.0 2024-09-14T11:16:00.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.317+0000 7f3985c13800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.2.0 2024-09-14T11:16:00.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.317+0000 7f3985c13800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.2.1 2024-09-14T11:16:00.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.317+0000 7f3985c13800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.2.1 2024-09-14T11:16:00.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.317+0000 7f3985c13800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.0 2024-09-14T11:16:00.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.319+0000 7f3985c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:00.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.319+0000 7f3985c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 2024-09-14T11:16:00.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:16:00.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:16:00.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:00.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30, ofs0, ns] 2024-09-14T11:16:00.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3864ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464367 cookie 94228321539808 notifier 7185 bl.length()=931 2024-09-14T11:16:00.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3864ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:16:00.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3864ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:16:00.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3864ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:00.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_sources= new_sources= 2024-09-14T11:16:00.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential sources added=[] removed=[] 2024-09-14T11:16:00.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_dests= new_dests= 2024-09-14T11:16:00.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.321+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential dests added=[] removed=[] 2024-09-14T11:16:00.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.323+0000 7f3985c13800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.30.0 2024-09-14T11:16:00.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.323+0000 7f3985c13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:00.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.323+0000 7f3985c13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 2024-09-14T11:16:00.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.324+0000 7f3985c13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:16:00.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.324+0000 7f3985c13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:16:00.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.324+0000 7f3985c13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:00.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.324+0000 7f3985c13800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30, ofs0, ns] 2024-09-14T11:16:00.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3864ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464368 cookie 94228321539808 notifier 7185 bl.length()=899 2024-09-14T11:16:00.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3864ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 info.flags=0x17 2024-09-14T11:16:00.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3864ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 to cache LRU end 2024-09-14T11:16:00.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3864ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:00.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_sources= new_sources= 2024-09-14T11:16:00.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential sources added=[] removed=[] 2024-09-14T11:16:00.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): orig_dests= new_dests= 2024-09-14T11:16:00.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.325+0000 7f3985c13800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.30]): potential dests added=[] removed=[] 2024-09-14T11:16:00.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.326+0000 7f3985c13800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:16:00.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.328+0000 7f38377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:00.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.330+0000 7f3985c13800 20 remove_watcher() i=0 2024-09-14T11:16:00.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.330+0000 7f3985c13800 2 removed watcher, disabling cache 2024-09-14T11:16:00.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.331+0000 7f3985c13800 20 remove_watcher() i=1 2024-09-14T11:16:00.331 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.332+0000 7f3985c13800 20 remove_watcher() i=2 2024-09-14T11:16:00.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.333+0000 7f3985c13800 20 remove_watcher() i=3 2024-09-14T11:16:00.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.334+0000 7f3985c13800 20 remove_watcher() i=4 2024-09-14T11:16:00.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.335+0000 7f3985c13800 20 remove_watcher() i=5 2024-09-14T11:16:00.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.336+0000 7f3985c13800 20 remove_watcher() i=6 2024-09-14T11:16:00.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.337+0000 7f3985c13800 20 remove_watcher() i=7 2024-09-14T11:16:00.349 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:16:00.379 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:00.379 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:00.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.419+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 20 realm 2024-09-14T11:16:00.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:00.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.421+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.422+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:00.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.422+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.422+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:00.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.422+0000 7f254e298800 20 searching for the correct realm 2024-09-14T11:16:00.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.425+0000 7f254b581640 0 -- 172.21.15.2:0/1857958094 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f253c06d060 msgr2=0x7f253c05ba30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:00.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.429+0000 7f254bd82640 0 -- 172.21.15.2:0/1857958094 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2540016910 msgr2=0x7f2540030450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:00.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.635+0000 7f254e298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:00.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.635+0000 7f254e298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:00.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.635+0000 7f254e298800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:00.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.635+0000 7f254e298800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:00.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.635+0000 7f254e298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:00.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.635+0000 7f254e298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:00.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.635+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:00.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 zone default found 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 4 Realm: () 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 zonegroup default 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.636+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.637+0000 7f254e298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.637+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.637+0000 7f254e298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:00.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.637+0000 7f254e298800 20 started sync module instance, tier type = 2024-09-14T11:16:00.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.637+0000 7f254e298800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.646+0000 7f254e298800 20 add_watcher() i=0 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.646+0000 7f254e298800 20 add_watcher() i=1 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.646+0000 7f254e298800 20 add_watcher() i=2 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.646+0000 7f254e298800 20 add_watcher() i=3 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.646+0000 7f254e298800 20 add_watcher() i=4 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.646+0000 7f254e298800 20 add_watcher() i=5 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.646+0000 7f254e298800 20 add_watcher() i=6 2024-09-14T11:16:00.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.647+0000 7f254e298800 20 add_watcher() i=7 2024-09-14T11:16:00.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.647+0000 7f254e298800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:00.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.649+0000 7f2401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:00.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.649+0000 7f254e298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:00.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.649+0000 7f254e298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:00.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.649+0000 7f254e298800 5 note: GC not initialized 2024-09-14T11:16:00.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.650+0000 7f2400fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:00.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.650+0000 7f254e298800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:00.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.650+0000 7f254e298800 20 Filter name: none 2024-09-14T11:16:00.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.650+0000 7f237a7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:00.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.650+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.650+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.650+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.651+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.651+0000 7f254e298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.651+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.651+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.651+0000 7f254e298800 20 rados->read ofs=0 len=0 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.652+0000 7f254e298800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:00.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.652+0000 7f254e298800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:00.652 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.653+0000 7f2401fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:00.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.655+0000 7f254e298800 20 remove_watcher() i=0 2024-09-14T11:16:00.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.655+0000 7f254e298800 2 removed watcher, disabling cache 2024-09-14T11:16:00.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.656+0000 7f254e298800 20 remove_watcher() i=1 2024-09-14T11:16:00.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.657+0000 7f254e298800 20 remove_watcher() i=2 2024-09-14T11:16:00.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.658+0000 7f254e298800 20 remove_watcher() i=3 2024-09-14T11:16:00.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.659+0000 7f254e298800 20 remove_watcher() i=4 2024-09-14T11:16:00.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.660+0000 7f254e298800 20 remove_watcher() i=5 2024-09-14T11:16:00.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.661+0000 7f254e298800 20 remove_watcher() i=6 2024-09-14T11:16:00.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:00.662+0000 7f254e298800 20 remove_watcher() i=7 2024-09-14T11:16:00.673 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:00.673 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:00.673 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.30 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:16:00.673 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:00.675 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.675 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.678 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.722 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.722 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.735 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-14T11:16:00.735 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:00.736 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.736 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.746 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.746 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.788 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.788 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.795 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.795 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.802 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.802 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.810 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.810 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.816 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.817 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.825 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.825 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.832 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.832 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.839 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.839 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.846 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.846 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.852 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.852 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.859 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.859 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.866 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.866 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.874 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.874 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.882 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.882 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.889 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.889 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.897 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.897 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.905 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.905 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.912 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.912 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.918 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.918 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.924 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:00.924 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:00.933 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:16:00.962 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:00.962 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:01.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.001+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 20 realm 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.003+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.004+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:01.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.004+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.004+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:01.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.004+0000 7f57e0122800 20 searching for the correct realm 2024-09-14T11:16:01.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.007+0000 7f57dc503640 0 -- 172.21.15.2:0/1675176500 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f57d0033070 msgr2=0x7f57d001bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:01.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.010+0000 7f57dbd02640 0 -- 172.21.15.2:0/1675176500 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f57d007fb90 msgr2=0x7f57d0067c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:01.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:01.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:01.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:01.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:01.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.217+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 zone default found 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 4 Realm: () 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 zonegroup default 2024-09-14T11:16:01.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.218+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.219+0000 7f57e0122800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.219+0000 7f57e0122800 20 started sync module instance, tier type = 2024-09-14T11:16:01.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.219+0000 7f57e0122800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:01.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.228+0000 7f57e0122800 20 add_watcher() i=0 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.228+0000 7f57e0122800 20 add_watcher() i=1 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.228+0000 7f57e0122800 20 add_watcher() i=2 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.228+0000 7f57e0122800 20 add_watcher() i=3 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.228+0000 7f57e0122800 20 add_watcher() i=4 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.228+0000 7f57e0122800 20 add_watcher() i=5 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.228+0000 7f57e0122800 20 add_watcher() i=6 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.229+0000 7f57e0122800 20 add_watcher() i=7 2024-09-14T11:16:01.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.229+0000 7f57e0122800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:01.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.231+0000 7f5691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:01.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.231+0000 7f57e0122800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:01.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.231+0000 7f57e0122800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:01.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.231+0000 7f57e0122800 5 note: GC not initialized 2024-09-14T11:16:01.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.232+0000 7f5690fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:01.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.232+0000 7f57e0122800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:01.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.232+0000 7f57e0122800 20 Filter name: none 2024-09-14T11:16:01.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.232+0000 7f560a7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:01.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.232+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.233+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:01.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.233+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.233+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:01.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.233+0000 7f57e0122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:01.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.234+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.234+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:01.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.234+0000 7f57e0122800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.234+0000 7f57e0122800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:01.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.234+0000 7f57e0122800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:01.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.236+0000 7f5691fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:01.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.238+0000 7f57e0122800 20 remove_watcher() i=0 2024-09-14T11:16:01.237 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.238+0000 7f57e0122800 2 removed watcher, disabling cache 2024-09-14T11:16:01.238 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.239+0000 7f57e0122800 20 remove_watcher() i=1 2024-09-14T11:16:01.239 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.240+0000 7f57e0122800 20 remove_watcher() i=2 2024-09-14T11:16:01.240 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.241+0000 7f57e0122800 20 remove_watcher() i=3 2024-09-14T11:16:01.241 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.242+0000 7f57e0122800 20 remove_watcher() i=4 2024-09-14T11:16:01.242 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.243+0000 7f57e0122800 20 remove_watcher() i=5 2024-09-14T11:16:01.243 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.244+0000 7f57e0122800 20 remove_watcher() i=6 2024-09-14T11:16:01.244 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.245+0000 7f57e0122800 20 remove_watcher() i=7 2024-09-14T11:16:01.256 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:01.256 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:01.256 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:16:01.256 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:01.257 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-14T11:16:01.294 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:01.294 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:01.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.334+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 20 realm 2024-09-14T11:16:01.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:01.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.336+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.337+0000 7f3e19292800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:01.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.337+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.337+0000 7f3e19292800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:01.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.337+0000 7f3e19292800 20 searching for the correct realm 2024-09-14T11:16:01.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.341+0000 7f3e1757d640 0 -- 172.21.15.2:0/2979376026 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f3e0c096b00 msgr2=0x7f3e0c095400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:01.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.344+0000 7f3e16d7c640 0 -- 172.21.15.2:0/2979376026 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3e0c00eaf0 msgr2=0x7f3e0c090a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:01.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:01.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:01.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:01.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:01.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:01.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:01.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.550+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:01.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:01.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 zone default found 2024-09-14T11:16:01.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 4 Realm: () 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 zonegroup default 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.551+0000 7f3e19292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.552+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.552+0000 7f3e19292800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.552+0000 7f3e19292800 20 started sync module instance, tier type = 2024-09-14T11:16:01.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.552+0000 7f3e19292800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:01.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.561+0000 7f3e19292800 20 add_watcher() i=0 2024-09-14T11:16:01.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.561+0000 7f3e19292800 20 add_watcher() i=1 2024-09-14T11:16:01.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.561+0000 7f3e19292800 20 add_watcher() i=2 2024-09-14T11:16:01.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.561+0000 7f3e19292800 20 add_watcher() i=3 2024-09-14T11:16:01.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.561+0000 7f3e19292800 20 add_watcher() i=4 2024-09-14T11:16:01.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.561+0000 7f3e19292800 20 add_watcher() i=5 2024-09-14T11:16:01.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.561+0000 7f3e19292800 20 add_watcher() i=6 2024-09-14T11:16:01.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.562+0000 7f3e19292800 20 add_watcher() i=7 2024-09-14T11:16:01.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.562+0000 7f3e19292800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:01.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.563+0000 7f3ccd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:01.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3e19292800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3e19292800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3e19292800 5 note: GC not initialized 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3c47fff640 20 reqs_thread_entry: start 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3e19292800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3e19292800 20 Filter name: none 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3c45ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3e19292800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-14T11:16:01.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.564+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 : miss 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 info.flags=0x17 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 to cache LRU end 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:01.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.565+0000 7f3e19292800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.569+0000 7f3e19292800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 info.flags=0x17 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.569+0000 7f3e19292800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 to cache LRU end 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.569+0000 7f3e19292800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.569+0000 7f3e19292800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31, ofs0, ns] 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3cfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464373 cookie 94762325865024 notifier 6884 bl.length()=931 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3cfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 info.flags=0x17 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3cfa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 to cache LRU end 2024-09-14T11:16:01.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3cfa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:01.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): orig_sources= new_sources= 2024-09-14T11:16:01.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): potential sources added=[] removed=[] 2024-09-14T11:16:01.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): orig_dests= new_dests= 2024-09-14T11:16:01.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.570+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): potential dests added=[] removed=[] 2024-09-14T11:16:01.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.572+0000 7f3e19292800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.31.1.0 2024-09-14T11:16:01.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.572+0000 7f3e19292800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.31.1.0 2024-09-14T11:16:01.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.572+0000 7f3e19292800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.31.1.1 2024-09-14T11:16:01.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.572+0000 7f3e19292800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.31.1.1 2024-09-14T11:16:01.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.572+0000 7f3e19292800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.31.0 2024-09-14T11:16:01.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.574+0000 7f3e19292800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:01.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.574+0000 7f3e19292800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 2024-09-14T11:16:01.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.575+0000 7f3e19292800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 info.flags=0x17 2024-09-14T11:16:01.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.575+0000 7f3e19292800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 to cache LRU end 2024-09-14T11:16:01.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.575+0000 7f3e19292800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.575+0000 7f3e19292800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31, ofs0, ns] 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3cfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464374 cookie 94762325865024 notifier 6884 bl.length()=931 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3cfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 info.flags=0x17 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3cfa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 to cache LRU end 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3cfa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): orig_sources= new_sources= 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): potential sources added=[] removed=[] 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): orig_dests= new_dests= 2024-09-14T11:16:01.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.576+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): potential dests added=[] removed=[] 2024-09-14T11:16:01.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.577+0000 7f3e19292800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.31.0 2024-09-14T11:16:01.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.577+0000 7f3e19292800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-14T11:16:01.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.577+0000 7f3e19292800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:01.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.577+0000 7f3e19292800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 2024-09-14T11:16:01.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 info.flags=0x17 2024-09-14T11:16:01.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 to cache LRU end 2024-09-14T11:16:01.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:01.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31, ofs0, ns] 2024-09-14T11:16:01.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3cf9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464375 cookie 94762325865024 notifier 6884 bl.length()=899 2024-09-14T11:16:01.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3cf9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 info.flags=0x17 2024-09-14T11:16:01.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3cf9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 to cache LRU end 2024-09-14T11:16:01.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3cf9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:01.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): orig_sources= new_sources= 2024-09-14T11:16:01.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): potential sources added=[] removed=[] 2024-09-14T11:16:01.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): orig_dests= new_dests= 2024-09-14T11:16:01.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.579+0000 7f3e19292800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.31]): potential dests added=[] removed=[] 2024-09-14T11:16:01.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.580+0000 7f3e19292800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:16:01.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.582+0000 7f3ccd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:01.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.585+0000 7f3e19292800 20 remove_watcher() i=0 2024-09-14T11:16:01.584 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.585+0000 7f3e19292800 2 removed watcher, disabling cache 2024-09-14T11:16:01.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.586+0000 7f3e19292800 20 remove_watcher() i=1 2024-09-14T11:16:01.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.586+0000 7f3e19292800 20 remove_watcher() i=2 2024-09-14T11:16:01.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.588+0000 7f3e19292800 20 remove_watcher() i=3 2024-09-14T11:16:01.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.589+0000 7f3e19292800 20 remove_watcher() i=4 2024-09-14T11:16:01.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.589+0000 7f3e19292800 20 remove_watcher() i=5 2024-09-14T11:16:01.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.590+0000 7f3e19292800 20 remove_watcher() i=6 2024-09-14T11:16:01.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.591+0000 7f3e19292800 20 remove_watcher() i=7 2024-09-14T11:16:01.603 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-14T11:16:01.633 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:01.633 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:01.672 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.672+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 20 realm 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.674+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.675+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:01.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.675+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.676+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:01.675 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.676+0000 7f879840d800 20 searching for the correct realm 2024-09-14T11:16:01.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.678+0000 7f87956f6640 0 -- 172.21.15.2:0/53505787 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8788046040 msgr2=0x7f8788046930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:01.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.682+0000 7f8795ef7640 0 -- 172.21.15.2:0/53505787 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f87800938b0 msgr2=0x7f87800662a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:01.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:01.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:01.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:01.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:01.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:01.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:01.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.888 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.888+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:01.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:01.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 zone default found 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 4 Realm: () 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 zonegroup default 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.889+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.890+0000 7f879840d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.890+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.890+0000 7f879840d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.890+0000 7f879840d800 20 started sync module instance, tier type = 2024-09-14T11:16:01.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.890+0000 7f879840d800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:01.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.900+0000 7f879840d800 20 add_watcher() i=0 2024-09-14T11:16:01.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.900+0000 7f879840d800 20 add_watcher() i=1 2024-09-14T11:16:01.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.900+0000 7f879840d800 20 add_watcher() i=2 2024-09-14T11:16:01.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.900+0000 7f879840d800 20 add_watcher() i=3 2024-09-14T11:16:01.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.900+0000 7f879840d800 20 add_watcher() i=4 2024-09-14T11:16:01.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.900+0000 7f879840d800 20 add_watcher() i=5 2024-09-14T11:16:01.899 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.900+0000 7f879840d800 20 add_watcher() i=6 2024-09-14T11:16:01.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.901+0000 7f879840d800 20 add_watcher() i=7 2024-09-14T11:16:01.900 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.901+0000 7f879840d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:01.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f863f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f879840d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f879840d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f879840d800 5 note: GC not initialized 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f863e7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f879840d800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f879840d800 20 Filter name: none 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.903+0000 7f85b7fff640 20 reqs_thread_entry: start 2024-09-14T11:16:01.903 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.904+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.904+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:01.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.904+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.905+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:01.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.905+0000 7f879840d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:01.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.905+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.906+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:01.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.906+0000 7f879840d800 20 rados->read ofs=0 len=0 2024-09-14T11:16:01.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.906+0000 7f879840d800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:01.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.906+0000 7f879840d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:01.906 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.907+0000 7f863f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:01.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.909+0000 7f879840d800 20 remove_watcher() i=0 2024-09-14T11:16:01.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.909+0000 7f879840d800 2 removed watcher, disabling cache 2024-09-14T11:16:01.909 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.910+0000 7f879840d800 20 remove_watcher() i=1 2024-09-14T11:16:01.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.911+0000 7f879840d800 20 remove_watcher() i=2 2024-09-14T11:16:01.911 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.912+0000 7f879840d800 20 remove_watcher() i=3 2024-09-14T11:16:01.912 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.913+0000 7f879840d800 20 remove_watcher() i=4 2024-09-14T11:16:01.913 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.914+0000 7f879840d800 20 remove_watcher() i=5 2024-09-14T11:16:01.914 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.915+0000 7f879840d800 20 remove_watcher() i=6 2024-09-14T11:16:01.915 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:01.916+0000 7f879840d800 20 remove_watcher() i=7 2024-09-14T11:16:01.927 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:01.927 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:01.927 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.31 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:16:01.927 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:01.929 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:01.929 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:01.932 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:01.932 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:01.976 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:01.976 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:01.989 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-14T11:16:01.989 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:01.991 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:01.991 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.000 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.000 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.043 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.043 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.051 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.051 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.058 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.058 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.065 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.065 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.072 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.072 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.079 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.079 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.086 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.086 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.093 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.093 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.100 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.100 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.107 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.107 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.114 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.114 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.121 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.121 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.127 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.128 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.135 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.135 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.142 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.142 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.149 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.150 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.156 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.157 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.164 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.164 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.171 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.171 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.178 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.178 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:02.186 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:16:02.215 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:02.215 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:02.253 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.254+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 20 realm 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.256 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.256+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.257+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.257+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.257+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:02.257 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.257+0000 7f2273063800 20 searching for the correct realm 2024-09-14T11:16:02.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.261+0000 7f2270353640 0 -- 172.21.15.2:0/2921086634 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55b270ea3b40 msgr2=0x55b270ea5f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.264+0000 7f2270b54640 0 -- 172.21.15.2:0/2921086634 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f226409fb10 msgr2=0x7f2264018810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:02.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:02.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:02.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:02.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:02.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:02.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.268 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.268+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:02.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 zone default found 2024-09-14T11:16:02.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 4 Realm: () 2024-09-14T11:16:02.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 zonegroup default 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.269+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.271+0000 7f2273063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.271+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.271+0000 7f2273063800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.271+0000 7f2273063800 20 started sync module instance, tier type = 2024-09-14T11:16:02.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.271+0000 7f2273063800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:02.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.278+0000 7f2273063800 20 add_watcher() i=0 2024-09-14T11:16:02.277 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.278+0000 7f2273063800 20 add_watcher() i=1 2024-09-14T11:16:02.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.278+0000 7f2273063800 20 add_watcher() i=2 2024-09-14T11:16:02.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.278+0000 7f2273063800 20 add_watcher() i=3 2024-09-14T11:16:02.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.278+0000 7f2273063800 20 add_watcher() i=4 2024-09-14T11:16:02.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.278+0000 7f2273063800 20 add_watcher() i=5 2024-09-14T11:16:02.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.278+0000 7f2273063800 20 add_watcher() i=6 2024-09-14T11:16:02.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.279+0000 7f2273063800 20 add_watcher() i=7 2024-09-14T11:16:02.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.279+0000 7f2273063800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:02.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.280+0000 7f21277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f2273063800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f2273063800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f2273063800 5 note: GC not initialized 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f21267e4640 20 reqs_thread_entry: start 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f2273063800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f2273063800 20 Filter name: none 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f211f7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:02.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.281+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.282+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:02.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.282+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.282+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:02.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.282+0000 7f2273063800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:02.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.282+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.282+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:02.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.282+0000 7f2273063800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.283+0000 7f2273063800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:02.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.283+0000 7f2273063800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:02.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.284+0000 7f21277e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:02.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.287+0000 7f2273063800 20 remove_watcher() i=0 2024-09-14T11:16:02.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.287+0000 7f2273063800 2 removed watcher, disabling cache 2024-09-14T11:16:02.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.288+0000 7f2273063800 20 remove_watcher() i=1 2024-09-14T11:16:02.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.289+0000 7f2273063800 20 remove_watcher() i=2 2024-09-14T11:16:02.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.290+0000 7f2273063800 20 remove_watcher() i=3 2024-09-14T11:16:02.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.291+0000 7f2273063800 20 remove_watcher() i=4 2024-09-14T11:16:02.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.292+0000 7f2273063800 20 remove_watcher() i=5 2024-09-14T11:16:02.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.293+0000 7f2273063800 20 remove_watcher() i=6 2024-09-14T11:16:02.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.294+0000 7f2273063800 20 remove_watcher() i=7 2024-09-14T11:16:02.304 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.304 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:02.304 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:16:02.304 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.306 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-14T11:16:02.341 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:02.341 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:02.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.381+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 20 realm 2024-09-14T11:16:02.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:02.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:02.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.384+0000 7f81b232c800 20 searching for the correct realm 2024-09-14T11:16:02.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.387+0000 7f81ad8d9640 0 -- 172.21.15.2:0/2938532322 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f81a002d040 msgr2=0x7f81a0073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.390+0000 7f81ae0da640 0 -- 172.21.15.2:0/2938532322 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f81a4095350 msgr2=0x7f81a4090290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.595+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 zone default found 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 4 Realm: () 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 zonegroup default 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.597+0000 7f81b232c800 20 started sync module instance, tier type = 2024-09-14T11:16:02.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.597+0000 7f81b232c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:02.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=0 2024-09-14T11:16:02.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=1 2024-09-14T11:16:02.605 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=2 2024-09-14T11:16:02.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=3 2024-09-14T11:16:02.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=4 2024-09-14T11:16:02.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=5 2024-09-14T11:16:02.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=6 2024-09-14T11:16:02.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.607+0000 7f81b232c800 20 add_watcher() i=7 2024-09-14T11:16:02.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.607+0000 7f81b232c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:02.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.609+0000 7f8064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.609+0000 7f81b232c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.609+0000 7f81b232c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.609+0000 7f81b232c800 5 note: GC not initialized 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.609+0000 7f7fdf7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.609+0000 7f81b232c800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.609+0000 7f81b232c800 20 Filter name: none 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f7fdd7fa640 20 reqs_thread_entry: start 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:16:02.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:02.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:16:02.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:16:02.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : miss 2024-09-14T11:16:02.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:02.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:02.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.610+0000 7f81b232c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:02.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94355198950608 notifier 7290 bl.length()=931 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:02.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:02.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.617+0000 7f81b232c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:02.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:02.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.617+0000 7f81b232c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:02.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:02.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:02.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.619+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:02.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.619+0000 7f81b232c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:02.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f81b232c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f81b232c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94355198950608 notifier 7290 bl.length()=931 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:02.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:02.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:02.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:02.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.622+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:02.621 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81b232c800 time 2024-09-14T11:16:02.624397+0000 2024-09-14T11:16:02.621 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:02.622 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.622 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f81b3b8c76a] 2024-09-14T11:16:02.622 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.622 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.622 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.622 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.623+0000 7f81b232c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81b232c800 time 2024-09-14T11:16:02.624397+0000 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f81b3b8c76a] 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.623 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:02.624 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:02.624 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.624 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:16:02.624 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f81b232c800 thread_name:radosgw-admin 2024-09-14T11:16:02.641 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f81b283e6f0] 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f81b288b99c] 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f81b3b8c7c4] 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.625+0000 7f81b232c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:02.642 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f81b232c800 thread_name:radosgw-admin 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f81b283e6f0] 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f81b288b99c] 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f81b3b8c7c4] 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:02.643 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:16:02.364+0000 7f81b232c800 1 librados: setting wanted keys 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:16:02.364+0000 7f81b232c800 1 librados: calling monclient init 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:16:02.364+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding auth protocol: cephx 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding auth protocol: cephx 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding auth protocol: cephx 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.644 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:16:02.364+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:16:02.365+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:16:02.365+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key hook 0x55d0c80e1588 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c7f59ab0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c8023a50 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c8027aa0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.645 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.918233s 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c8023a50 auth_method 0 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c8027aa0 auth_method 0 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.646 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c7f59ab0 auth_method 0 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_done global_id 6926 payload 824 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 1 monclient: found mon.noname-c 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.647 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: dump: 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.648 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: dump: 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:16:02.365+0000 7f81b232c800 5 monclient: authenticate success, global_id 6926 2024-09-14T11:16:02.649 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:16:02.365+0000 7f809c608640 4 set_mon_vals no callback set 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:16:02.365+0000 7f81b232c800 1 librados: init done 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:16:02.367+0000 7f809ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:16:02.367+0000 7f809ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:16:02.367+0000 7f809ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:16:02.368+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f8094077260 auth_method 0 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:16:02.368+0000 7f81ae8db640 10 monclient: get_auth_request con 0x55d0c810a340 auth_method 0 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:16:02.369+0000 7f81ae0da640 10 monclient: get_auth_request con 0x55d0c812cdf0 auth_method 0 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:16:02.370+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x55d0c8131e80 auth_method 0 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:16:02.371+0000 7f81b232c800 10 monclient: build_initial_monmap 2024-09-14T11:16:02.650 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:16:02.371+0000 7f81b232c800 1 build_initial for_mkfs: 0 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:16:02.371+0000 7f81b232c800 10 monclient: monmap: 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding auth protocol: cephx 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding auth protocol: cephx 2024-09-14T11:16:02.651 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding auth protocol: cephx 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:16:02.371+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command objecter_requests cmddesc objecter_requests hook 0x55d0c81394c0 EEXIST 2024-09-14T11:16:02.652 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:16:02.371+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding auth protocol: cephx 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding auth protocol: cephx 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding auth protocol: cephx 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.653 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:16:02.371+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:16:02.372+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:16:02.372+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key cmddesc rotate-key hook 0x55d0c8134f90 EEXIST 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c815d7e0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c815dbc0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c815c4f0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.925148s 2024-09-14T11:16:02.654 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c815d7e0 auth_method 0 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c815dbc0 auth_method 0 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c815c4f0 auth_method 0 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.655 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_done global_id 6929 payload 824 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:16:02.372+0000 7f81ae0da640 1 monclient: found mon.noname-c 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.656 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: dump: 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.657 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:16:02.372+0000 7f81b232c800 5 monclient: authenticate success, global_id 6929 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:16:02.373+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:16:02.373+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: dump: 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.658 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:16:02.373+0000 7f81af0dc640 4 set_mon_vals no callback set 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:16:02.374+0000 7f8093fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:16:02.374+0000 7f8093fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:16:02.374+0000 7f8093fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:16:02.375+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x7f80880772e0 auth_method 0 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:16:02.375+0000 7f81b232c800 10 monclient: get_monmap_and_config 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:16:02.375+0000 7f81b232c800 10 monclient: build_initial_monmap 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:16:02.375+0000 7f81b232c800 1 build_initial for_mkfs: 0 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:16:02.375+0000 7f81b232c800 10 monclient: monmap: 2024-09-14T11:16:02.659 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding auth protocol: cephx 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding auth protocol: cephx 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding auth protocol: cephx 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.660 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:16:02.376+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.661 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding auth protocol: cephx 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding auth protocol: cephx 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding auth protocol: cephx 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.662 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:16:02.376+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:16:02.376+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key cmddesc rotate-key hook 0x7fff290e00b8 EEXIST 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c81b1c90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c81a25e0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c81ad0c0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.663 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.929967s 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c81a25e0 auth_method 0 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c81ad0c0 auth_method 0 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c81b1c90 auth_method 0 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.664 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_done global_id 7287 payload 274 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 1 monclient: found mon.noname-a 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: dump: 2024-09-14T11:16:02.665 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:16:02.377+0000 7f81b232c800 5 monclient: authenticate success, global_id 7287 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:16:02.377+0000 7f81b232c800 10 monclient: get_monmap_and_config success 2024-09-14T11:16:02.666 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:16:02.377+0000 7f81b232c800 4 set_mon_vals no callback set 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: dump: 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.667 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: shutdown 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: build_initial_monmap 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 build_initial for_mkfs: 0 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: monmap: 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding auth protocol: cephx 2024-09-14T11:16:02.668 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding auth protocol: cephx 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding auth protocol: cephx 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:16:02.378+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: starting msgr at 2024-09-14T11:16:02.669 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: starting objecter 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command objecter_requests cmddesc objecter_requests hook 0x55d0c8180f20 EEXIST 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: setting wanted keys 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: calling monclient init 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding auth protocol: cephx 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding auth protocol: cephx 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding auth protocol: cephx 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.670 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:16:02.379+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:16:02.379+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:16:02.379+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key cmddesc rotate-key hook 0x55d0c81721e8 EEXIST 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c81a25e0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c81ad0c0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.671 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c81b1c90 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.932488s 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c81b1c90 auth_method 0 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c81ad0c0 auth_method 0 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c81a25e0 auth_method 0 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.672 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_done global_id 7290 payload 824 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 1 monclient: found mon.noname-a 2024-09-14T11:16:02.673 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: dump: 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.674 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: dump: 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.675 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:16:02.380+0000 7f81b232c800 5 monclient: authenticate success, global_id 7290 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:16:02.380+0000 7f8091ffb640 4 set_mon_vals no callback set 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:16:02.380+0000 7f81b232c800 1 librados: init done 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:16:02.380+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cr dump hook 0x55d0c81abd08 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:16:02.381+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:16:02.382+0000 7f807ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:16:02.382+0000 7f807ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:16:02.382+0000 7f807ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:16:02.382+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f8078077230 auth_method 0 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:16:02.382+0000 7f81ae8db640 10 monclient: get_auth_request con 0x55d0c81cbf70 auth_method 0 2024-09-14T11:16:02.676 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 realm 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:16:02.383+0000 7f81b232c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:16:02.383+0000 7f81ae0da640 10 monclient: get_auth_request con 0x55d0c81d03a0 auth_method 0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 searching for the correct realm 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:16:02.384+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x55d0c81d5510 auth_method 0 2024-09-14T11:16:02.677 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:16:02.385+0000 7f81ae8db640 10 monclient: get_auth_request con 0x7f81a4093c20 auth_method 0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:16:02.386+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f81a8066790 auth_method 0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:16:02.386+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x7f81a002d040 auth_method 0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:16:02.387+0000 7f81ad8d9640 0 -- 172.21.15.2:0/2938532322 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f81a002d040 msgr2=0x7f81a0073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:16:02.387+0000 7f807ffff640 1 client.7290.objecter ms_handle_reset 0x7f81a002d040 session 0x7f81a0033040 osd.4 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:16:02.387+0000 7f807ffff640 10 monclient: _renew_subs 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:16:02.387+0000 7f807ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:16:02.387+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x7f80780870d0 auth_method 0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:16:02.388+0000 7f81ae8db640 10 monclient: get_auth_request con 0x7f81a4018070 auth_method 0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:16:02.390+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f81a4095350 auth_method 0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:16:02.390+0000 7f81ae0da640 0 -- 172.21.15.2:0/2938532322 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f81a4095350 msgr2=0x7f81a4090290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:16:02.592+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f81a4095350 auth_method 0 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:02.678 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 zone default found 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:16:02.596+0000 7f81b232c800 4 Realm: () 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:16:02.596+0000 7f81b232c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:16:02.596+0000 7f81b232c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:16:02.596+0000 7f81b232c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 zonegroup default 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.679 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 started sync module instance, tier type = 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=0 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=1 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=2 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=3 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=4 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=5 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=6 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:16:02.607+0000 7f81b232c800 20 add_watcher() i=7 2024-09-14T11:16:02.680 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:16:02.607+0000 7f81b232c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding auth protocol: cephx 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding auth protocol: cephx 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding auth protocol: cephx 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:16:02.609+0000 7f8064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.681 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:16:02.609+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache list hook 0x55d0c81a4b60 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache inspect hook 0x55d0c81a4b60 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache erase hook 0x55d0c81a4b60 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache zap hook 0x55d0c81a4b60 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 note: GC not initialized 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:16:02.609+0000 7f7fdf7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace show hook 0x7f81a4001260 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace history hook 0x7f81a4001260 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace active hook 0x7f81a4001260 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace active_short hook 0x7f81a4001260 2024-09-14T11:16:02.682 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 Filter name: none 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:16:02.610+0000 7f7fdd7fa640 20 reqs_thread_entry: start 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : miss 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.683 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94355198950608 notifier 7290 bl.length()=931 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:16:02.617+0000 7f81b232c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:02.684 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:16:02.617+0000 7f81b232c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:16:02.619+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:16:02.619+0000 7f81b232c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94355198950608 notifier 7290 bl.length()=931 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:02.685 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:16:02.622+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:16:02.623+0000 7f81b232c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81b232c800 time 2024-09-14T11:16:02.624397+0000 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f81b3b8c76a] 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.686 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:16:02.625+0000 7f81b232c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f81b232c800 thread_name:radosgw-admin 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f81b283e6f0] 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f81b288b99c] 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f81b3b8c7c4] 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:02.687 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:16:02.688 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:16:02.689 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:16:02.690 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:16:02.691 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:16:02.692 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:16:02.693 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f7fdd7fa640 / http_manager 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f7fdf7fe640 / http_manager 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8064fe1640 / rgw_dt_lg_renew 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f807ffff640 / ms_dispatch 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8091ffb640 / io_context_pool 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8093fff640 / ms_dispatch 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f809ae05640 / ms_dispatch 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f809c608640 / io_context_pool 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81ad8d9640 / msgr-worker-2 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81ae0da640 / msgr-worker-1 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81ae8db640 / msgr-worker-0 2024-09-14T11:16:02.694 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81af0dc640 / io_context_pool 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81b232c800 / radosgw-admin 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.120283.log 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:16:02.364+0000 7f81b232c800 1 librados: setting wanted keys 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:16:02.364+0000 7f81b232c800 1 librados: calling monclient init 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:16:02.364+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding auth protocol: cephx 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding auth protocol: cephx 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding auth protocol: cephx 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.695 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: crc 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:16:02.364+0000 7f81b232c800 5 AuthRegistry(0x55d0c80e1440) adding con mode: secure 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:16:02.364+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:16:02.365+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:16:02.365+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key hook 0x55d0c80e1588 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:16:02.696 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c7f59ab0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c8023a50 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c8027aa0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.918233s 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c8023a50 auth_method 0 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c8027aa0 auth_method 0 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.697 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c7f59ab0 auth_method 0 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:16:02.365+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:16:02.365+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_done global_id 6926 payload 824 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.698 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 1 monclient: found mon.noname-c 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:16:02.365+0000 7f81ad8d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: dump: 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.699 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:16:02.365+0000 7f809ae05640 10 monclient: dump: 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.700 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:16:02.365+0000 7f81b232c800 5 monclient: authenticate success, global_id 6926 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:16:02.365+0000 7f809c608640 4 set_mon_vals no callback set 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:16:02.365+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:16:02.365+0000 7f81b232c800 1 librados: init done 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:16:02.367+0000 7f809ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:16:02.367+0000 7f809ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:16:02.367+0000 7f809ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:16:02.368+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f8094077260 auth_method 0 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:16:02.368+0000 7f81ae8db640 10 monclient: get_auth_request con 0x55d0c810a340 auth_method 0 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:16:02.369+0000 7f81ae0da640 10 monclient: get_auth_request con 0x55d0c812cdf0 auth_method 0 2024-09-14T11:16:02.701 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:16:02.370+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x55d0c8131e80 auth_method 0 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:16:02.371+0000 7f81b232c800 10 monclient: build_initial_monmap 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:16:02.371+0000 7f81b232c800 1 build_initial for_mkfs: 0 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:16:02.371+0000 7f81b232c800 10 monclient: monmap: 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding auth protocol: cephx 2024-09-14T11:16:02.702 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding auth protocol: cephx 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding auth protocol: cephx 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: crc 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8136060) adding con mode: secure 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:16:02.371+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.703 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command objecter_requests cmddesc objecter_requests hook 0x55d0c81394c0 EEXIST 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:16:02.371+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding auth protocol: cephx 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding auth protocol: cephx 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding auth protocol: cephx 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.704 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: crc 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:16:02.371+0000 7f81b232c800 5 AuthRegistry(0x55d0c8134e48) adding con mode: secure 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:16:02.371+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:16:02.372+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:16:02.372+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key cmddesc rotate-key hook 0x55d0c8134f90 EEXIST 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c815d7e0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c815dbc0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c815c4f0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.705 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.925148s 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c815d7e0 auth_method 0 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c815dbc0 auth_method 0 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c815c4f0 auth_method 0 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.706 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:16:02.372+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:16:02.372+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient(hunting): handle_auth_done global_id 6929 payload 824 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:16:02.372+0000 7f81ae0da640 1 monclient: found mon.noname-c 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:16:02.372+0000 7f81ae0da640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: dump: 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.707 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:16:02.372+0000 7f8093fff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:16:02.372+0000 7f81b232c800 5 monclient: authenticate success, global_id 6929 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:16:02.372+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:16:02.373+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:16:02.373+0000 7f81b232c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:02.708 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:16:02.373+0000 7f8093fff640 10 monclient: dump: 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:16:02.373+0000 7f81af0dc640 4 set_mon_vals no callback set 2024-09-14T11:16:02.709 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:16:02.374+0000 7f8093fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:16:02.374+0000 7f8093fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:16:02.374+0000 7f8093fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:16:02.375+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x7f80880772e0 auth_method 0 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:16:02.375+0000 7f81b232c800 10 monclient: get_monmap_and_config 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:16:02.375+0000 7f81b232c800 10 monclient: build_initial_monmap 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:16:02.375+0000 7f81b232c800 1 build_initial for_mkfs: 0 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:16:02.375+0000 7f81b232c800 10 monclient: monmap: 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:02.710 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding auth protocol: cephx 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding auth protocol: cephx 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding auth protocol: cephx 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.711 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: crc 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:16:02.375+0000 7f81b232c800 5 AuthRegistry(0x55d0c817d6d0) adding con mode: secure 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:16:02.376+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding auth protocol: cephx 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding auth protocol: cephx 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding auth protocol: cephx 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.712 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: crc 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 AuthRegistry(0x7fff290dff70) adding con mode: secure 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:16:02.376+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:16:02.376+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:16:02.376+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key cmddesc rotate-key hook 0x7fff290e00b8 EEXIST 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c81b1c90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c81a25e0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.713 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c81ad0c0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:16:02.376+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.929967s 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c81a25e0 auth_method 0 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c81ad0c0 auth_method 0 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.714 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c81b1c90 auth_method 0 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:16:02.377+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:16:02.377+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_done global_id 7287 payload 274 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.715 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 1 monclient: found mon.noname-a 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:16:02.377+0000 7f81ad8d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: dump: 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.716 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:16:02.377+0000 7f81b232c800 5 monclient: authenticate success, global_id 7287 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:16:02.377+0000 7f81b232c800 10 monclient: get_monmap_and_config success 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:16:02.377+0000 7f81b232c800 4 set_mon_vals no callback set 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:16:02.377+0000 7f8091ffb640 10 monclient: dump: 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.717 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: shutdown 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: build_initial_monmap 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 build_initial for_mkfs: 0 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: monmap: 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.718 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding auth protocol: cephx 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding auth protocol: cephx 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding auth protocol: cephx 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.719 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: crc 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81811f0) adding con mode: secure 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:16:02.378+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: starting msgr at 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: starting objecter 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command objecter_requests cmddesc objecter_requests hook 0x55d0c8180f20 EEXIST 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: setting wanted keys 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:16:02.378+0000 7f81b232c800 1 librados: calling monclient init 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:16:02.378+0000 7f81b232c800 10 monclient: init 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding auth protocol: cephx 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding auth protocol: cephx 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding auth protocol: cephx 2024-09-14T11:16:02.720 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: crc 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:16:02.378+0000 7f81b232c800 5 AuthRegistry(0x55d0c81720a0) adding con mode: secure 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:16:02.379+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:16:02.379+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:16:02.379+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command rotate-key cmddesc rotate-key hook 0x55d0c81721e8 EEXIST 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:02.721 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-b con 0x55d0c81a25e0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-a con 0x55d0c81ad0c0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): picked mon.noname-c con 0x55d0c81b1c90 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:16:02.379+0000 7f81b232c800 10 monclient(hunting): authenticate will time out at 1988.932488s 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): get_auth_request con 0x55d0c81b1c90 auth_method 0 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request con 0x55d0c81ad0c0 auth_method 0 2024-09-14T11:16:02.722 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): get_auth_request con 0x55d0c81a25e0 auth_method 0 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:16:02.379+0000 7f81ae8db640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:02.723 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:16:02.379+0000 7f81ae0da640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient(hunting): handle_auth_done global_id 7290 payload 824 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 1 monclient: found mon.noname-a 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:16:02.379+0000 7f81ad8d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: dump: 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.724 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: _finish_auth 0 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:16:02.380+0000 7f807ffff640 10 monclient: dump: 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:02.725 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:16:02.380+0000 7f81b232c800 5 monclient: authenticate success, global_id 7290 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:16:02.380+0000 7f8091ffb640 4 set_mon_vals no callback set 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _renew_subs 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:16:02.380+0000 7f81b232c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:16:02.380+0000 7f81b232c800 1 librados: init done 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:16:02.380+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cr dump hook 0x55d0c81abd08 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:16:02.381+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.726 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:16:02.382+0000 7f807ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:16:02.382+0000 7f807ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:16:02.382+0000 7f807ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:16:02.382+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f8078077230 auth_method 0 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:16:02.382+0000 7f81ae8db640 10 monclient: get_auth_request con 0x55d0c81cbf70 auth_method 0 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 realm 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:16:02.383+0000 7f81b232c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.727 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:16:02.383+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:16:02.383+0000 7f81ae0da640 10 monclient: get_auth_request con 0x55d0c81d03a0 auth_method 0 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:16:02.384+0000 7f81b232c800 20 searching for the correct realm 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:16:02.384+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x55d0c81d5510 auth_method 0 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:16:02.385+0000 7f81ae8db640 10 monclient: get_auth_request con 0x7f81a4093c20 auth_method 0 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:16:02.386+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f81a8066790 auth_method 0 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:16:02.386+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x7f81a002d040 auth_method 0 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:16:02.387+0000 7f81ad8d9640 0 -- 172.21.15.2:0/2938532322 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f81a002d040 msgr2=0x7f81a0073c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:16:02.387+0000 7f807ffff640 1 client.7290.objecter ms_handle_reset 0x7f81a002d040 session 0x7f81a0033040 osd.4 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:16:02.387+0000 7f807ffff640 10 monclient: _renew_subs 2024-09-14T11:16:02.728 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:16:02.387+0000 7f807ffff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:16:02.387+0000 7f81ad8d9640 10 monclient: get_auth_request con 0x7f80780870d0 auth_method 0 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:16:02.388+0000 7f81ae8db640 10 monclient: get_auth_request con 0x7f81a4018070 auth_method 0 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:16:02.390+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f81a4095350 auth_method 0 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:16:02.390+0000 7f81ae0da640 0 -- 172.21.15.2:0/2938532322 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f81a4095350 msgr2=0x7f81a4090290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:16:02.592+0000 7f81ae0da640 10 monclient: get_auth_request con 0x7f81a4095350 auth_method 0 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:16:02.595+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.729 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 zone default found 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:16:02.596+0000 7f81b232c800 4 Realm: () 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:16:02.596+0000 7f81b232c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:16:02.596+0000 7f81b232c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:16:02.596+0000 7f81b232c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 zonegroup default 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:16:02.596+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.730 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 started sync module instance, tier type = 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:16:02.597+0000 7f81b232c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=0 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=1 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=2 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=3 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=4 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=5 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:16:02.606+0000 7f81b232c800 20 add_watcher() i=6 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:16:02.607+0000 7f81b232c800 20 add_watcher() i=7 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:16:02.607+0000 7f81b232c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding auth protocol: cephx 2024-09-14T11:16:02.731 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding auth protocol: cephx 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding auth protocol: cephx 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:16:02.609+0000 7f8064fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:02.732 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: crc 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 AuthRegistry(0x7fff290e0450) adding con mode: secure 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:16:02.609+0000 7f81b232c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache list hook 0x55d0c81a4b60 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache inspect hook 0x55d0c81a4b60 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache erase hook 0x55d0c81a4b60 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command cache zap hook 0x55d0c81a4b60 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 note: GC not initialized 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:16:02.609+0000 7f7fdf7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace show hook 0x7f81a4001260 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace history hook 0x7f81a4001260 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace active hook 0x7f81a4001260 2024-09-14T11:16:02.733 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:16:02.609+0000 7f81b232c800 5 asok(0x55d0c7ec1270) register_command sync trace active_short hook 0x7f81a4001260 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:16:02.609+0000 7f81b232c800 20 Filter name: none 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:16:02.610+0000 7f7fdd7fa640 20 reqs_thread_entry: start 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : miss 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:16:02.610+0000 7f81b232c800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.734 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:16:02.610+0000 7f81b232c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:16:02.614+0000 7f81b232c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464299 cookie 94355198950608 notifier 7290 bl.length()=931 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:16:02.614+0000 7f8091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:02.735 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:16:02.614+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:16:02.617+0000 7f81b232c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:16:02.617+0000 7f81b232c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:16:02.617+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:16:02.619+0000 7f81b232c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:16:02.619+0000 7f81b232c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.736 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:16:02.620+0000 7f81b232c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464300 cookie 94355198950608 notifier 7290 bl.length()=931 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:16:02.620+0000 7f8091ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:16:02.621+0000 7f81b232c800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:16:02.622+0000 7f81b232c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:16:02.623+0000 7f81b232c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f81b232c800 time 2024-09-14T11:16:02.624397+0000 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.737 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f81b3b8c76a] 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:16:02.625+0000 7f81b232c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f81b232c800 thread_name:radosgw-admin 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f81b283e6f0] 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f81b288b99c] 2024-09-14T11:16:02.738 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f81b3b8c7c4] 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f81b3b8c928] 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d0c6f620b1] 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x55d0c6f72217] 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f81b2829590] 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:16:02.739 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:16:02.740 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:16:02.741 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:16:02.742 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:16:02.743 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:16:02.744 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:16:02.745 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f7fdd7fa640 / http_manager 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f7fdf7fe640 / http_manager 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8064fe1640 / rgw_dt_lg_renew 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f807ffff640 / ms_dispatch 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8091ffb640 / io_context_pool 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8093fff640 / ms_dispatch 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f809ae05640 / ms_dispatch 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f809c608640 / io_context_pool 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81ad8d9640 / msgr-worker-2 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81ae0da640 / msgr-worker-1 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81ae8db640 / msgr-worker-0 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81af0dc640 / io_context_pool 2024-09-14T11:16:02.746 INFO:tasks.workunit.client.0.smithi002.stderr: 7f81b232c800 / radosgw-admin 2024-09-14T11:16:02.747 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:16:02.747 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:16:02.747 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:16:02.625815Z_8b2272b1-98ef-4f26-83ae-7c3383f808c8/log 2024-09-14T11:16:02.747 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:16:02.747 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:16:02.748 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:02.748 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:02.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.702+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 20 realm 2024-09-14T11:16:02.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.704+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.705+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.705+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.705+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.705+0000 7f18c2cb7800 20 searching for the correct realm 2024-09-14T11:16:02.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.707+0000 7f18c07a1640 0 -- 172.21.15.2:0/3193387424 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f18b8022070 msgr2=0x7f18b8060880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.910 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.912+0000 7f18c0fa2640 0 -- 172.21.15.2:0/3193387424 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f18b4027040 msgr2=0x7f18b40681f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:02.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:02.916 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:02.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:02.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:02.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:02.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:02.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.917 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.918+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:02.918 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 zone default found 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 4 Realm: () 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 zonegroup default 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.919+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.920+0000 7f18c2cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.920+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.920+0000 7f18c2cb7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.920+0000 7f18c2cb7800 20 started sync module instance, tier type = 2024-09-14T11:16:02.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.920+0000 7f18c2cb7800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:02.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.929+0000 7f18c2cb7800 20 add_watcher() i=0 2024-09-14T11:16:02.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.929+0000 7f18c2cb7800 20 add_watcher() i=1 2024-09-14T11:16:02.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.929+0000 7f18c2cb7800 20 add_watcher() i=2 2024-09-14T11:16:02.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.929+0000 7f18c2cb7800 20 add_watcher() i=3 2024-09-14T11:16:02.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.929+0000 7f18c2cb7800 20 add_watcher() i=4 2024-09-14T11:16:02.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.929+0000 7f18c2cb7800 20 add_watcher() i=5 2024-09-14T11:16:02.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.929+0000 7f18c2cb7800 20 add_watcher() i=6 2024-09-14T11:16:02.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.930+0000 7f18c2cb7800 20 add_watcher() i=7 2024-09-14T11:16:02.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.930+0000 7f18c2cb7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:02.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.932+0000 7f1776fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:02.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.932+0000 7f18c2cb7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:02.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.932+0000 7f18c2cb7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:02.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.932+0000 7f18c2cb7800 5 note: GC not initialized 2024-09-14T11:16:02.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.932+0000 7f1775fdb640 20 reqs_thread_entry: start 2024-09-14T11:16:02.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.933+0000 7f18c2cb7800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:02.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.933+0000 7f18c2cb7800 20 Filter name: none 2024-09-14T11:16:02.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.933+0000 7f16e77fe640 20 reqs_thread_entry: start 2024-09-14T11:16:02.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.933+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.933+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:02.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.933+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.934+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:16:02.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.934+0000 7f18c2cb7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:02.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.934+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.934+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:02.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.934+0000 7f18c2cb7800 20 rados->read ofs=0 len=0 2024-09-14T11:16:02.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.934+0000 7f18c2cb7800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:16:02.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.934+0000 7f18c2cb7800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:02.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.936+0000 7f1776fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:02.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.938+0000 7f18c2cb7800 20 remove_watcher() i=0 2024-09-14T11:16:02.936 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.938+0000 7f18c2cb7800 2 removed watcher, disabling cache 2024-09-14T11:16:02.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.939+0000 7f18c2cb7800 20 remove_watcher() i=1 2024-09-14T11:16:02.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.939+0000 7f18c2cb7800 20 remove_watcher() i=2 2024-09-14T11:16:02.938 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.940+0000 7f18c2cb7800 20 remove_watcher() i=3 2024-09-14T11:16:02.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.942+0000 7f18c2cb7800 20 remove_watcher() i=4 2024-09-14T11:16:02.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.942+0000 7f18c2cb7800 20 remove_watcher() i=5 2024-09-14T11:16:02.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.943+0000 7f18c2cb7800 20 remove_watcher() i=6 2024-09-14T11:16:02.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:02.944+0000 7f18c2cb7800 20 remove_watcher() i=7 2024-09-14T11:16:02.954 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.954 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:02.954 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:16:02.954 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:02.956 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:02.956 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:32.994 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:32.995 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.038 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:16:33.075 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:33.075 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:33.119 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.121+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.122+0000 7f204913a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.122+0000 7f204913a800 20 realm 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.122+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.122+0000 7f204913a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.122+0000 7f204913a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.122+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.123+0000 7f204913a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.121 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.123+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.124+0000 7f204913a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:33.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.124+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.124+0000 7f204913a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:33.122 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.124+0000 7f204913a800 20 searching for the correct realm 2024-09-14T11:16:33.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.127+0000 7f20446ba640 0 -- 172.21.15.2:0/388343931 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f203406b070 msgr2=0x7f20340b2860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:33.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.132+0000 7f2044ebb640 0 -- 172.21.15.2:0/388343931 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2038066960 msgr2=0x7f20380653e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:33.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.339+0000 7f204913a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:33.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.339+0000 7f204913a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:33.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.339+0000 7f204913a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:33.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.339+0000 7f204913a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:33.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.339+0000 7f204913a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:33.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.339+0000 7f204913a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:33.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.339+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.340+0000 7f204913a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.340+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.340+0000 7f204913a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.340+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 20 zone default found 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 4 Realm: () 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 20 zonegroup default 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.341+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.342+0000 7f204913a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.342+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.342+0000 7f204913a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.342+0000 7f204913a800 20 started sync module instance, tier type = 2024-09-14T11:16:33.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.342+0000 7f204913a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.352+0000 7f204913a800 20 add_watcher() i=0 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.352+0000 7f204913a800 20 add_watcher() i=1 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.352+0000 7f204913a800 20 add_watcher() i=2 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.352+0000 7f204913a800 20 add_watcher() i=3 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.352+0000 7f204913a800 20 add_watcher() i=4 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.352+0000 7f204913a800 20 add_watcher() i=5 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.352+0000 7f204913a800 20 add_watcher() i=6 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.353+0000 7f204913a800 20 add_watcher() i=7 2024-09-14T11:16:33.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.353+0000 7f204913a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:33.353 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.355+0000 7f1efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:33.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f204913a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:33.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f204913a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:33.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f204913a800 5 note: GC not initialized 2024-09-14T11:16:33.354 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f1ef9fe3640 20 reqs_thread_entry: start 2024-09-14T11:16:33.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f204913a800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:33.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f204913a800 20 Filter name: none 2024-09-14T11:16:33.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f1e6b7fe640 20 reqs_thread_entry: start 2024-09-14T11:16:33.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f204913a800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-14T11:16:33.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.356+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : miss 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:33.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.357+0000 7f204913a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.361+0000 7f204913a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.361+0000 7f204913a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.361+0000 7f204913a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.361+0000 7f204913a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f1f1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464302 cookie 94626813101264 notifier 6968 bl.length()=931 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f1f1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f1f1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:33.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f1f1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:33.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:33.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:33.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:33.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.362+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:33.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.365+0000 7f204913a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:33.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.365+0000 7f204913a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.0 2024-09-14T11:16:33.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.365+0000 7f204913a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:33.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.365+0000 7f204913a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.1.1 2024-09-14T11:16:33.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.365+0000 7f204913a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:33.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.367+0000 7f204913a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:33.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.367+0000 7f204913a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:33.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:33.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:33.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:33.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:33.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f1f1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464303 cookie 94626813101264 notifier 6968 bl.length()=931 2024-09-14T11:16:33.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f1f1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:33.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f1f1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:33.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f1f1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:33.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:33.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:33.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:33.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.369+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:33.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.371+0000 7f204913a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.32.0 2024-09-14T11:16:33.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.371+0000 7f204913a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:33.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.371+0000 7f204913a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 2024-09-14T11:16:33.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.372+0000 7f204913a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:33.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f204913a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:33.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f204913a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:33.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f204913a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32, ofs0, ns] 2024-09-14T11:16:33.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f1f1bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464304 cookie 94626813101264 notifier 6968 bl.length()=899 2024-09-14T11:16:33.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f1f1bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 info.flags=0x17 2024-09-14T11:16:33.371 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f1f1bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 to cache LRU end 2024-09-14T11:16:33.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f1f1bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:33.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_sources= new_sources= 2024-09-14T11:16:33.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential sources added=[] removed=[] 2024-09-14T11:16:33.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): orig_dests= new_dests= 2024-09-14T11:16:33.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.373+0000 7f204913a800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[17edae97-cd6b-4c90-863d-862429a20cf3.4538.32]): potential dests added=[] removed=[] 2024-09-14T11:16:33.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.375+0000 7f204913a800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 1 shards to 2 shards completed successfully 2024-09-14T11:16:33.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.377+0000 7f1efafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:33.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.379+0000 7f204913a800 20 remove_watcher() i=0 2024-09-14T11:16:33.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.379+0000 7f204913a800 2 removed watcher, disabling cache 2024-09-14T11:16:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.381+0000 7f204913a800 20 remove_watcher() i=1 2024-09-14T11:16:33.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.382+0000 7f204913a800 20 remove_watcher() i=2 2024-09-14T11:16:33.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.383+0000 7f204913a800 20 remove_watcher() i=3 2024-09-14T11:16:33.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.384+0000 7f204913a800 20 remove_watcher() i=4 2024-09-14T11:16:33.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.385+0000 7f204913a800 20 remove_watcher() i=5 2024-09-14T11:16:33.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.386+0000 7f204913a800 20 remove_watcher() i=6 2024-09-14T11:16:33.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.387+0000 7f204913a800 20 remove_watcher() i=7 2024-09-14T11:16:33.398 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-14T11:16:33.430 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:33.430 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:33.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.473+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.473 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 20 realm 2024-09-14T11:16:33.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:33.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.475+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.477+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:33.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.477+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.477+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:33.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.477+0000 7f6be1fa2800 20 searching for the correct realm 2024-09-14T11:16:33.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.478+0000 7f6be028d640 0 -- 172.21.15.2:0/4228284376 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f6bc8069070 msgr2=0x7f6bc80ae9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:33.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.482+0000 7f6be028d640 0 -- 172.21.15.2:0/4228284376 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f6bc8060070 msgr2=0x7f6bc80bb380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:33.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.690+0000 7f6be1fa2800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:33.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.690+0000 7f6be1fa2800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:33.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.690+0000 7f6be1fa2800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:33.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.690+0000 7f6be1fa2800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:33.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.690+0000 7f6be1fa2800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:33.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.690+0000 7f6be1fa2800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:33.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.690+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.691+0000 7f6be1fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.691+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.691+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:33.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.691+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 zone default found 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 4 Realm: () 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 zonegroup default 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.692+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.693+0000 7f6be1fa2800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:33.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.693+0000 7f6be1fa2800 20 started sync module instance, tier type = 2024-09-14T11:16:33.692 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.693+0000 7f6be1fa2800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:33.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=0 2024-09-14T11:16:33.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=1 2024-09-14T11:16:33.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=2 2024-09-14T11:16:33.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=3 2024-09-14T11:16:33.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=4 2024-09-14T11:16:33.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=5 2024-09-14T11:16:33.701 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=6 2024-09-14T11:16:33.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 20 add_watcher() i=7 2024-09-14T11:16:33.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.703+0000 7f6be1fa2800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:33.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.705+0000 7f6a95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:33.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.705+0000 7f6be1fa2800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:33.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.705+0000 7f6be1fa2800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:33.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.705+0000 7f6be1fa2800 5 note: GC not initialized 2024-09-14T11:16:33.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.706+0000 7f6a94fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:33.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.706+0000 7f6be1fa2800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:33.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.706+0000 7f6be1fa2800 20 Filter name: none 2024-09-14T11:16:33.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.706+0000 7f6a0e7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:33.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.706+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.706+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.706+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.707+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.707+0000 7f6be1fa2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.707+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.707+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.707+0000 7f6be1fa2800 20 rados->read ofs=0 len=0 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.708+0000 7f6be1fa2800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:16:33.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.708+0000 7f6be1fa2800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:33.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.709+0000 7f6a95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:33.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.712+0000 7f6be1fa2800 20 remove_watcher() i=0 2024-09-14T11:16:33.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.712+0000 7f6be1fa2800 2 removed watcher, disabling cache 2024-09-14T11:16:33.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.713+0000 7f6be1fa2800 20 remove_watcher() i=1 2024-09-14T11:16:33.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.714+0000 7f6be1fa2800 20 remove_watcher() i=2 2024-09-14T11:16:33.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.715+0000 7f6be1fa2800 20 remove_watcher() i=3 2024-09-14T11:16:33.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.716+0000 7f6be1fa2800 20 remove_watcher() i=4 2024-09-14T11:16:33.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.717+0000 7f6be1fa2800 20 remove_watcher() i=5 2024-09-14T11:16:33.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.718+0000 7f6be1fa2800 20 remove_watcher() i=6 2024-09-14T11:16:33.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:33.719+0000 7f6be1fa2800 20 remove_watcher() i=7 2024-09-14T11:16:33.729 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:33.729 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:33.729 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-commit-target-layout id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.32 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:16:33.729 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:33.731 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.732 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.735 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.735 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.778 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.779 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.793 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-14T11:16:33.793 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:33.794 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.794 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.805 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.805 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.847 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.847 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.855 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.856 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.863 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.863 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.871 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.871 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.879 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.879 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.886 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.886 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.894 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.895 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.902 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.902 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.944 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.945 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.953 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.953 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.960 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.960 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.967 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.967 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.973 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.974 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.981 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.981 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.988 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.988 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:33.995 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:33.996 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:34.003 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:34.003 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:34.010 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:34.010 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:34.017 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:34.017 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:34.024 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:34.025 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:34.033 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:16:34.062 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:34.062 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:34.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.102+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 20 realm 2024-09-14T11:16:34.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:34.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.104+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.105+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.105+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.105+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:34.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.105+0000 7f0003e10800 20 searching for the correct realm 2024-09-14T11:16:34.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.108+0000 7efffedbb640 0 -- 172.21.15.2:0/3650630022 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x560767e1df80 msgr2=0x560767e20370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:34.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.112+0000 7effff5bc640 0 -- 172.21.15.2:0/3650630022 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7efff409e770 msgr2=0x7efff4043ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 zone default found 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 4 Realm: () 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 zonegroup default 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.117+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.118+0000 7f0003e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.118+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.118+0000 7f0003e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.117 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.118+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.118+0000 7f0003e10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.118+0000 7f0003e10800 20 started sync module instance, tier type = 2024-09-14T11:16:34.118 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.118+0000 7f0003e10800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:34.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.127+0000 7f0003e10800 20 add_watcher() i=0 2024-09-14T11:16:34.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.127+0000 7f0003e10800 20 add_watcher() i=1 2024-09-14T11:16:34.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.127+0000 7f0003e10800 20 add_watcher() i=2 2024-09-14T11:16:34.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.127+0000 7f0003e10800 20 add_watcher() i=3 2024-09-14T11:16:34.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.127+0000 7f0003e10800 20 add_watcher() i=4 2024-09-14T11:16:34.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.127+0000 7f0003e10800 20 add_watcher() i=5 2024-09-14T11:16:34.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.127+0000 7f0003e10800 20 add_watcher() i=6 2024-09-14T11:16:34.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.128+0000 7f0003e10800 20 add_watcher() i=7 2024-09-14T11:16:34.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.128+0000 7f0003e10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:34.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.129+0000 7efeb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7f0003e10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:34.128 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7f0003e10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:34.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7f0003e10800 5 note: GC not initialized 2024-09-14T11:16:34.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7efeb4fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:34.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7f0003e10800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:34.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7f0003e10800 20 Filter name: none 2024-09-14T11:16:34.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7efe2e7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:34.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.130+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.131+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.131+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.131+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.131+0000 7f0003e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.131+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.131+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.131+0000 7f0003e10800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.130 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.132+0000 7f0003e10800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:34.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.132+0000 7f0003e10800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:34.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.133+0000 7efeb5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.135+0000 7f0003e10800 20 remove_watcher() i=0 2024-09-14T11:16:34.133 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.135+0000 7f0003e10800 2 removed watcher, disabling cache 2024-09-14T11:16:34.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.136+0000 7f0003e10800 20 remove_watcher() i=1 2024-09-14T11:16:34.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.137+0000 7f0003e10800 20 remove_watcher() i=2 2024-09-14T11:16:34.136 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.138+0000 7f0003e10800 20 remove_watcher() i=3 2024-09-14T11:16:34.137 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.139+0000 7f0003e10800 20 remove_watcher() i=4 2024-09-14T11:16:34.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.140+0000 7f0003e10800 20 remove_watcher() i=5 2024-09-14T11:16:34.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.141+0000 7f0003e10800 20 remove_watcher() i=6 2024-09-14T11:16:34.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.142+0000 7f0003e10800 20 remove_watcher() i=7 2024-09-14T11:16:34.151 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:34.151 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:34.151 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-do-reshard id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:16:34.151 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:34.153 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-14T11:16:34.187 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:34.188 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:34.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.228+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 20 realm 2024-09-14T11:16:34.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:34.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.230+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.231+0000 7f4ebe140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.231+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.231+0000 7f4ebe140800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:34.230 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.231+0000 7f4ebe140800 20 searching for the correct realm 2024-09-14T11:16:34.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.234+0000 7f4eb9685640 0 -- 172.21.15.2:0/336612308 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f4eac04d490 msgr2=0x7f4eac04d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:34.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.238+0000 7f4eb9e86640 0 -- 172.21.15.2:0/336612308 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f4eb0065ea0 msgr2=0x7f4eb0045040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:34.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.443+0000 7f4ebe140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:34.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.443+0000 7f4ebe140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:34.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.443+0000 7f4ebe140800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:34.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.443+0000 7f4ebe140800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:34.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.443+0000 7f4ebe140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.443+0000 7f4ebe140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.443+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:34.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 zone default found 2024-09-14T11:16:34.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 4 Realm: () 2024-09-14T11:16:34.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:34.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:34.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:34.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 zonegroup default 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.444+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.445+0000 7f4ebe140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.445+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.445+0000 7f4ebe140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.445+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.445+0000 7f4ebe140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.445+0000 7f4ebe140800 20 started sync module instance, tier type = 2024-09-14T11:16:34.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.445+0000 7f4ebe140800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:34.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.454+0000 7f4ebe140800 20 add_watcher() i=0 2024-09-14T11:16:34.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.454+0000 7f4ebe140800 20 add_watcher() i=1 2024-09-14T11:16:34.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.454+0000 7f4ebe140800 20 add_watcher() i=2 2024-09-14T11:16:34.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.454+0000 7f4ebe140800 20 add_watcher() i=3 2024-09-14T11:16:34.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.454+0000 7f4ebe140800 20 add_watcher() i=4 2024-09-14T11:16:34.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.454+0000 7f4ebe140800 20 add_watcher() i=5 2024-09-14T11:16:34.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.454+0000 7f4ebe140800 20 add_watcher() i=6 2024-09-14T11:16:34.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.455+0000 7f4ebe140800 20 add_watcher() i=7 2024-09-14T11:16:34.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.455+0000 7f4ebe140800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:34.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.456+0000 7f4d6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4ebe140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:34.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4ebe140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:34.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4ebe140800 5 note: GC not initialized 2024-09-14T11:16:34.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4d6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:34.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4ebe140800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:34.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4ebe140800 20 Filter name: none 2024-09-14T11:16:34.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4cdbfff640 20 reqs_thread_entry: start 2024-09-14T11:16:34.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4ebe140800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:16:34.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.457+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 : miss 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.458+0000 7f4ebe140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 2024-09-14T11:16:34.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4ebe140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4ebe140800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4ebe140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4ebe140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33, ofs0, ns] 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464380 cookie 94359803673104 notifier 7019 bl.length()=911 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4d9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4d9d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.462+0000 7f4d9d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.463+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_sources= new_sources= 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.463+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential sources added=[] removed=[] 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.463+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_dests= new_dests= 2024-09-14T11:16:34.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.463+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential dests added=[] removed=[] 2024-09-14T11:16:34.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.465+0000 7f4ebe140800 -1 Injecting error=-5 at location=do_reshard 2024-09-14T11:16:34.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.468+0000 7f4ebe140800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:34.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.468+0000 7f4ebe140800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 2024-09-14T11:16:34.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.469+0000 7f4ebe140800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.469+0000 7f4ebe140800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.469+0000 7f4ebe140800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.469+0000 7f4ebe140800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33, ofs0, ns] 2024-09-14T11:16:34.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.470+0000 7f4d9d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464381 cookie 94359803673104 notifier 7019 bl.length()=879 2024-09-14T11:16:34.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.470+0000 7f4d9d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.470+0000 7f4d9d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.470+0000 7f4d9d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.471+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_sources= new_sources= 2024-09-14T11:16:34.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.471+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential sources added=[] removed=[] 2024-09-14T11:16:34.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.471+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_dests= new_dests= 2024-09-14T11:16:34.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.471+0000 7f4ebe140800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential dests added=[] removed=[] 2024-09-14T11:16:34.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.471+0000 7f4ebe140800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-14T11:16:34.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.473+0000 7f4d6b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.475+0000 7f4ebe140800 20 remove_watcher() i=0 2024-09-14T11:16:34.474 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.475+0000 7f4ebe140800 2 removed watcher, disabling cache 2024-09-14T11:16:34.475 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.476+0000 7f4ebe140800 20 remove_watcher() i=1 2024-09-14T11:16:34.476 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.476+0000 7f4ebe140800 20 remove_watcher() i=2 2024-09-14T11:16:34.477 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.478+0000 7f4ebe140800 20 remove_watcher() i=3 2024-09-14T11:16:34.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.479+0000 7f4ebe140800 20 remove_watcher() i=4 2024-09-14T11:16:34.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.479+0000 7f4ebe140800 20 remove_watcher() i=5 2024-09-14T11:16:34.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.481+0000 7f4ebe140800 20 remove_watcher() i=6 2024-09-14T11:16:34.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.482+0000 7f4ebe140800 20 remove_watcher() i=7 2024-09-14T11:16:34.494 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:16:34.523 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:34.523 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:34.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.562+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.564+0000 7f5d61e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.564+0000 7f5d61e87800 20 realm 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.564+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.565+0000 7f5d61e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.565+0000 7f5d61e87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.565+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.565+0000 7f5d61e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.565+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.566+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.566+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.566+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:34.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.566+0000 7f5d61e87800 20 searching for the correct realm 2024-09-14T11:16:34.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.569+0000 7f5d57fff640 0 -- 172.21.15.2:0/1675132838 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f5d50090030 msgr2=0x7f5d500095e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:34.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.572+0000 7f5d5f971640 0 -- 172.21.15.2:0/1675132838 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f5d480b7b80 msgr2=0x7f5d480bb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.777+0000 7f5d61e87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.777+0000 7f5d61e87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.777+0000 7f5d61e87800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.777+0000 7f5d61e87800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.777+0000 7f5d61e87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.777+0000 7f5d61e87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.777+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 zone default found 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 4 Realm: () 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 zonegroup default 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.778+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.779+0000 7f5d61e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.779+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.779+0000 7f5d61e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.779+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.779+0000 7f5d61e87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.779+0000 7f5d61e87800 20 started sync module instance, tier type = 2024-09-14T11:16:34.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.779+0000 7f5d61e87800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:34.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=0 2024-09-14T11:16:34.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=1 2024-09-14T11:16:34.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=2 2024-09-14T11:16:34.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=3 2024-09-14T11:16:34.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=4 2024-09-14T11:16:34.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=5 2024-09-14T11:16:34.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=6 2024-09-14T11:16:34.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 20 add_watcher() i=7 2024-09-14T11:16:34.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.789+0000 7f5d61e87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.791+0000 7f5c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.791+0000 7f5d61e87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.791+0000 7f5d61e87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.791+0000 7f5d61e87800 5 note: GC not initialized 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.791+0000 7f5c14fe1640 20 reqs_thread_entry: start 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.792+0000 7f5d61e87800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.792+0000 7f5d61e87800 20 Filter name: none 2024-09-14T11:16:34.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.792+0000 7f5b8e7fc640 20 reqs_thread_entry: start 2024-09-14T11:16:34.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.792+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.792+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.792+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.793+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.793+0000 7f5d61e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.793+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.793+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.793+0000 7f5d61e87800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.793+0000 7f5d61e87800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:34.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.793+0000 7f5d61e87800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:34.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.795+0000 7f5c15fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.797+0000 7f5d61e87800 20 remove_watcher() i=0 2024-09-14T11:16:34.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.797+0000 7f5d61e87800 2 removed watcher, disabling cache 2024-09-14T11:16:34.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.798+0000 7f5d61e87800 20 remove_watcher() i=1 2024-09-14T11:16:34.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.799+0000 7f5d61e87800 20 remove_watcher() i=2 2024-09-14T11:16:34.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.800+0000 7f5d61e87800 20 remove_watcher() i=3 2024-09-14T11:16:34.800 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.801+0000 7f5d61e87800 20 remove_watcher() i=4 2024-09-14T11:16:34.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.802+0000 7f5d61e87800 20 remove_watcher() i=5 2024-09-14T11:16:34.802 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.803+0000 7f5d61e87800 20 remove_watcher() i=6 2024-09-14T11:16:34.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.804+0000 7f5d61e87800 20 remove_watcher() i=7 2024-09-14T11:16:34.814 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:34.814 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:34.814 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-do-reshard id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:16:34.814 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:34.816 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:34.816 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:34.823 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:34.823 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:34.867 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:16:34.899 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:34.900 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:34.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.940+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 20 realm 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.941+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.942+0000 7fb2c4d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.942+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.943+0000 7fb2c4d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:34.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.943+0000 7fb2c4d46800 20 searching for the correct realm 2024-09-14T11:16:34.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.946+0000 7fb2c2036640 0 -- 172.21.15.2:0/3194976603 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x563c0d571b30 msgr2=0x563c0d573ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:34.948 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.949+0000 7fb2c2837640 0 -- 172.21.15.2:0/3194976603 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fb2b80a3cd0 msgr2=0x7fb2b80ad620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:34.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:34.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:34.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:34.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.953+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 zone default found 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 4 Realm: () 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 zonegroup default 2024-09-14T11:16:34.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.954+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.955+0000 7fb2c4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.955+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.955+0000 7fb2c4d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:34.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.955+0000 7fb2c4d46800 20 started sync module instance, tier type = 2024-09-14T11:16:34.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.955+0000 7fb2c4d46800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:34.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.964+0000 7fb2c4d46800 20 add_watcher() i=0 2024-09-14T11:16:34.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.964+0000 7fb2c4d46800 20 add_watcher() i=1 2024-09-14T11:16:34.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.964+0000 7fb2c4d46800 20 add_watcher() i=2 2024-09-14T11:16:34.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.964+0000 7fb2c4d46800 20 add_watcher() i=3 2024-09-14T11:16:34.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.964+0000 7fb2c4d46800 20 add_watcher() i=4 2024-09-14T11:16:34.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.964+0000 7fb2c4d46800 20 add_watcher() i=5 2024-09-14T11:16:34.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.964+0000 7fb2c4d46800 20 add_watcher() i=6 2024-09-14T11:16:34.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.965+0000 7fb2c4d46800 20 add_watcher() i=7 2024-09-14T11:16:34.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.965+0000 7fb2c4d46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.966+0000 7fb1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.966+0000 7fb2c4d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.966+0000 7fb2c4d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.966+0000 7fb2c4d46800 5 note: GC not initialized 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb0f3fff640 20 reqs_thread_entry: start 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 20 Filter name: none 2024-09-14T11:16:34.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb0f1ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:34.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-14T11:16:34.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:34.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-14T11:16:34.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-14T11:16:34.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 : miss 2024-09-14T11:16:34.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.967+0000 7fb2c4d46800 20 rados->read ofs=0 len=0 2024-09-14T11:16:34.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.968+0000 7fb2c4d46800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:34.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.968+0000 7fb2c4d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.968+0000 7fb2c4d46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.968+0000 7fb2c4d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:34.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.968+0000 7fb2c4d46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.968+0000 7fb2c4d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 2024-09-14T11:16:34.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb2c4d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb2c4d46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb2c4d46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb2c4d46800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33, ofs0, ns] 2024-09-14T11:16:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464382 cookie 94815921844880 notifier 7416 bl.length()=911 2024-09-14T11:16:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb1a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.971+0000 7fb1a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.972+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_sources= new_sources= 2024-09-14T11:16:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.972+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential sources added=[] removed=[] 2024-09-14T11:16:34.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.972+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_dests= new_dests= 2024-09-14T11:16:34.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.972+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential dests added=[] removed=[] 2024-09-14T11:16:34.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.974+0000 7fb2c4d46800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.33.1.0 2024-09-14T11:16:34.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.974+0000 7fb2c4d46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.33.1.0 2024-09-14T11:16:34.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.974+0000 7fb2c4d46800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.33.1.1 2024-09-14T11:16:34.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.974+0000 7fb2c4d46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.33.1.1 2024-09-14T11:16:34.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.974+0000 7fb2c4d46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.33.0 2024-09-14T11:16:34.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.976+0000 7fb2c4d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:34.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.976+0000 7fb2c4d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.977+0000 7fb2c4d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.977+0000 7fb2c4d46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.977+0000 7fb2c4d46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.977+0000 7fb2c4d46800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33, ofs0, ns] 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb1a67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464383 cookie 94815921844880 notifier 7416 bl.length()=911 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb1a67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb1a67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb1a67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_sources= new_sources= 2024-09-14T11:16:34.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential sources added=[] removed=[] 2024-09-14T11:16:34.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_dests= new_dests= 2024-09-14T11:16:34.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.978+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential dests added=[] removed=[] 2024-09-14T11:16:34.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.979+0000 7fb2c4d46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.33.0 2024-09-14T11:16:34.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.979+0000 7fb2c4d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 : hit (requested=0x17, cached=0x17) 2024-09-14T11:16:34.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.979+0000 7fb2c4d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 2024-09-14T11:16:34.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.980+0000 7fb2c4d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.980+0000 7fb2c4d46800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.980+0000 7fb2c4d46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.980+0000 7fb2c4d46800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33, ofs0, ns] 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb1a5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464384 cookie 94815921844880 notifier 7416 bl.length()=879 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb1a5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 info.flags=0x17 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb1a5ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 to cache LRU end 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb1a5ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_sources= new_sources= 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential sources added=[] removed=[] 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): orig_dests= new_dests= 2024-09-14T11:16:34.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.981+0000 7fb2c4d46800 20 handle_bi_update(): bucket=:error-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.33]): potential dests added=[] removed=[] 2024-09-14T11:16:34.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.982+0000 7fb2c4d46800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-14T11:16:34.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.984+0000 7fb1797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:34.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.986+0000 7fb2c4d46800 20 remove_watcher() i=0 2024-09-14T11:16:34.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.986+0000 7fb2c4d46800 2 removed watcher, disabling cache 2024-09-14T11:16:34.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.987+0000 7fb2c4d46800 20 remove_watcher() i=1 2024-09-14T11:16:34.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.988+0000 7fb2c4d46800 20 remove_watcher() i=2 2024-09-14T11:16:34.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.989+0000 7fb2c4d46800 20 remove_watcher() i=3 2024-09-14T11:16:34.989 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.990+0000 7fb2c4d46800 20 remove_watcher() i=4 2024-09-14T11:16:34.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.991+0000 7fb2c4d46800 20 remove_watcher() i=5 2024-09-14T11:16:34.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.992+0000 7fb2c4d46800 20 remove_watcher() i=6 2024-09-14T11:16:34.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:34.993+0000 7fb2c4d46800 20 remove_watcher() i=7 2024-09-14T11:16:35.005 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-14T11:16:35.034 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:35.034 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:35.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.073+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.075+0000 7fc215d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.075+0000 7fc215d1f800 20 realm 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.075+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.075+0000 7fc215d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.075+0000 7fc215d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.076+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.076+0000 7fc215d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.076+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.076+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.076+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.077+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:35.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.077+0000 7fc215d1f800 20 searching for the correct realm 2024-09-14T11:16:35.079 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.080+0000 7fc2112a1640 0 -- 172.21.15.2:0/4130064201 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x56347063b000 msgr2=0x56347063d490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.083+0000 7fc211aa2640 0 -- 172.21.15.2:0/4130064201 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fc1fc063070 msgr2=0x7fc1fc07b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.087+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.088+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.088+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:35.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 zone default found 2024-09-14T11:16:35.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 4 Realm: () 2024-09-14T11:16:35.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:35.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 zonegroup default 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.089+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.090+0000 7fc215d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.090+0000 7fc215d1f800 20 started sync module instance, tier type = 2024-09-14T11:16:35.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.090+0000 7fc215d1f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.098+0000 7fc215d1f800 20 add_watcher() i=0 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.098+0000 7fc215d1f800 20 add_watcher() i=1 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.098+0000 7fc215d1f800 20 add_watcher() i=2 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.098+0000 7fc215d1f800 20 add_watcher() i=3 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.098+0000 7fc215d1f800 20 add_watcher() i=4 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.098+0000 7fc215d1f800 20 add_watcher() i=5 2024-09-14T11:16:35.098 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.098+0000 7fc215d1f800 20 add_watcher() i=6 2024-09-14T11:16:35.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.099+0000 7fc215d1f800 20 add_watcher() i=7 2024-09-14T11:16:35.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.099+0000 7fc215d1f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:35.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.101+0000 7fc0c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.101+0000 7fc215d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:35.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.101+0000 7fc215d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:35.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc215d1f800 5 note: GC not initialized 2024-09-14T11:16:35.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc0c27fc640 20 reqs_thread_entry: start 2024-09-14T11:16:35.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc215d1f800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:35.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc215d1f800 20 Filter name: none 2024-09-14T11:16:35.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc033fff640 20 reqs_thread_entry: start 2024-09-14T11:16:35.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:35.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.102+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.103+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.103+0000 7fc215d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.103+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.103+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.103+0000 7fc215d1f800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.103+0000 7fc215d1f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:35.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.103+0000 7fc215d1f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:35.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.105+0000 7fc0c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:35.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.107+0000 7fc215d1f800 20 remove_watcher() i=0 2024-09-14T11:16:35.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.107+0000 7fc215d1f800 2 removed watcher, disabling cache 2024-09-14T11:16:35.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.108+0000 7fc215d1f800 20 remove_watcher() i=1 2024-09-14T11:16:35.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.109+0000 7fc215d1f800 20 remove_watcher() i=2 2024-09-14T11:16:35.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.110+0000 7fc215d1f800 20 remove_watcher() i=3 2024-09-14T11:16:35.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.111+0000 7fc215d1f800 20 remove_watcher() i=4 2024-09-14T11:16:35.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.112+0000 7fc215d1f800 20 remove_watcher() i=5 2024-09-14T11:16:35.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.113+0000 7fc215d1f800 20 remove_watcher() i=6 2024-09-14T11:16:35.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.114+0000 7fc215d1f800 20 remove_watcher() i=7 2024-09-14T11:16:35.124 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:35.125 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:35.125 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-do-reshard id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.33 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:16:35.125 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:35.127 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.127 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.130 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.130 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.172 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.173 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.186 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-14T11:16:35.186 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:35.187 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.187 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.199 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.199 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.242 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.242 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.250 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.250 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.258 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.258 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.265 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.265 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.272 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.272 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.280 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.281 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.288 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.288 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.295 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.295 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.302 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.302 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.309 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.309 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.316 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.316 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.323 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.323 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.330 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.330 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.337 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.337 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.345 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.345 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.352 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.352 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.360 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.360 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.368 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.368 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.375 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.375 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.383 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:35.383 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:35.390 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:16:35.421 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:35.421 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:35.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.662+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 20 realm 2024-09-14T11:16:35.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.663 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:35.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:35.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.664+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.665+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:35.664 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.665+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:35.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.665+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:35.665 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.665+0000 7fe31b087800 20 searching for the correct realm 2024-09-14T11:16:35.667 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.668+0000 7fe313fff640 0 -- 172.21.15.2:0/825627868 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fe30c093940 msgr2=0x7fe30c087410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.671 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.672+0000 7fe318b71640 0 -- 172.21.15.2:0/825627868 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fe30407fbd0 msgr2=0x7fe30406f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:35.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:36.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:36.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:36.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:36.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:36.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:36.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.878+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 20 zone default found 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 4 Realm: () 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 20 zonegroup default 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.052 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.879+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.880+0000 7fe31b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.880+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.880+0000 7fe31b087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.880+0000 7fe31b087800 20 started sync module instance, tier type = 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.880+0000 7fe31b087800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.891+0000 7fe31b087800 20 add_watcher() i=0 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.891+0000 7fe31b087800 20 add_watcher() i=1 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.891+0000 7fe31b087800 20 add_watcher() i=2 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.891+0000 7fe31b087800 20 add_watcher() i=3 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.891+0000 7fe31b087800 20 add_watcher() i=4 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.891+0000 7fe31b087800 20 add_watcher() i=5 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.891+0000 7fe31b087800 20 add_watcher() i=6 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.892+0000 7fe31b087800 20 add_watcher() i=7 2024-09-14T11:16:36.053 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.892+0000 7fe31b087800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe1cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe31b087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe31b087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe31b087800 5 note: GC not initialized 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe1ce7e4640 20 reqs_thread_entry: start 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe31b087800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe31b087800 20 Filter name: none 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.894+0000 7fe1c7fff640 20 reqs_thread_entry: start 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.895+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.895+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.895+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.896+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.896+0000 7fe31b087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:36.054 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.896+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.896+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.896+0000 7fe31b087800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.896+0000 7fe31b087800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.896+0000 7fe31b087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.898+0000 7fe1cf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.901+0000 7fe31b087800 20 remove_watcher() i=0 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.901+0000 7fe31b087800 2 removed watcher, disabling cache 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.902+0000 7fe31b087800 20 remove_watcher() i=1 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.903+0000 7fe31b087800 20 remove_watcher() i=2 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.904+0000 7fe31b087800 20 remove_watcher() i=3 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.905+0000 7fe31b087800 20 remove_watcher() i=4 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.906+0000 7fe31b087800 20 remove_watcher() i=5 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.907+0000 7fe31b087800 20 remove_watcher() i=6 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.908+0000 7fe31b087800 20 remove_watcher() i=7 2024-09-14T11:16:36.055 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-do-reshard id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.996+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 20 realm 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.056 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.998+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.998+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.999+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:35.999+0000 7f13b6726800 20 searching for the correct realm 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.002+0000 7f13b1bd8640 0 -- 172.21.15.2:0/1154929678 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f13a40771e0 msgr2=0x7f13a400b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.006+0000 7f13b1bd8640 0 -- 172.21.15.2:0/1154929678 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f127c0870d0 msgr2=0x7f127c089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.057 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 zone default found 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 4 Realm: () 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 zonegroup default 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.058 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.012+0000 7f13b6726800 20 started sync module instance, tier type = 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.012+0000 7f13b6726800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=0 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=1 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=2 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=3 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=4 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=5 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=6 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.023+0000 7f13b6726800 20 add_watcher() i=7 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.023+0000 7f13b6726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:36.059 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.024+0000 7f1268fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f13b6726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f13b6726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f13b6726800 5 note: GC not initialized 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f11e37fe640 20 reqs_thread_entry: start 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f13b6726800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f13b6726800 20 Filter name: none 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f11e17fa640 20 reqs_thread_entry: start 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f13b6726800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.025+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:16:36.060 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 : miss 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.026+0000 7f13b6726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34, ofs0, ns] 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464267 cookie 94174987344576 notifier 7109 bl.length()=911 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.061 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_sources= new_sources= 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential sources added=[] removed=[] 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_dests= new_dests= 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential dests added=[] removed=[] 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f13b6726800 time 2024-09-14T11:16:36.035509+0000 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13b7d8c76a] 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.062 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.034+0000 7f13b6726800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f13b6726800 time 2024-09-14T11:16:36.035509+0000 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13b7d8c76a] 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:36.063 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f13b6726800 thread_name:radosgw-admin 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f13b6a3e6f0] 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f13b6a8b99c] 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13b7d8c7c4] 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:36.064 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.035+0000 7f13b6726800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f13b6726800 thread_name:radosgw-admin 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f13b6a3e6f0] 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f13b6a8b99c] 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13b7d8c7c4] 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.065 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: dump: 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.066 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:16:35.978+0000 7f13b6726800 5 monclient: authenticate success, global_id 7097 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:16:35.978+0000 7f13b6726800 10 monclient: get_monmap_and_config success 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:16:35.978+0000 7f13b6726800 4 set_mon_vals no callback set 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: dump: 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.067 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:16:35.979+0000 7f13b6726800 10 monclient: shutdown 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 asok(0x55a6d278f270) unregister_commands rotate-key 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:16:35.979+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:16:35.979+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:16:35.979+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.068 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.069 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding auth protocol: cephx 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding auth protocol: cephx 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding auth protocol: cephx 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.070 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:16:35.979+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:16:35.979+0000 7f13b6726800 1 librados: starting msgr at 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:16:35.979+0000 7f13b6726800 1 librados: starting objecter 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command objecter_requests hook 0x55a6d29b31b0 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:16:35.980+0000 7f13b6726800 1 librados: setting wanted keys 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:16:35.980+0000 7f13b6726800 1 librados: calling monclient init 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding auth protocol: cephx 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding auth protocol: cephx 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding auth protocol: cephx 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.071 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:16:35.980+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:16:35.980+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key hook 0x55a6d29af6d8 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:16:36.072 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d283a7a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d28f2700 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d28f8b90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.533680s 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d283a7a0 auth_method 0 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d28f2700 auth_method 0 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.073 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_done global_id 7464 payload 824 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:16:35.981+0000 7f13b23d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:16:35.981+0000 7f13b23d9640 1 monclient: found mon.noname-a 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:16:35.981+0000 7f13b23d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:36.074 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: dump: 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:36.075 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: dump: 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:16:35.981+0000 7f13b6726800 5 monclient: authenticate success, global_id 7464 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:36.076 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:16:35.981+0000 7f12a0608640 4 set_mon_vals no callback set 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:16:35.981+0000 7f13b6726800 1 librados: init done 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:16:35.983+0000 7f129ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:16:35.983+0000 7f129ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:16:35.983+0000 7f129ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:16:35.983+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f1298077230 auth_method 0 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:16:35.983+0000 7f13b2bda640 10 monclient: get_auth_request con 0x55a6d29d8100 auth_method 0 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:16:35.984+0000 7f13b23d9640 10 monclient: get_auth_request con 0x55a6d29fb100 auth_method 0 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:16:35.985+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x55a6d2a007b0 auth_method 0 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:16:35.986+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:16:35.986+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:16:35.986+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.077 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding auth protocol: cephx 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding auth protocol: cephx 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding auth protocol: cephx 2024-09-14T11:16:36.078 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:16:35.986+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command objecter_requests cmddesc objecter_requests hook 0x55a6d2a07d20 EEXIST 2024-09-14T11:16:36.079 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding auth protocol: cephx 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding auth protocol: cephx 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding auth protocol: cephx 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.080 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:16:35.987+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:16:35.987+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key cmddesc rotate-key hook 0x55a6d2a037e0 EEXIST 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d2a2c040 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d2a2c420 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d2a2ad50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.081 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.540620s 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d2a2c420 auth_method 0 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d2a2c040 auth_method 0 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.082 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): get_auth_request con 0x55a6d2a2ad50 auth_method 0 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_done global_id 7103 payload 824 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:16:35.988+0000 7f13b1bd8640 1 monclient: found mon.noname-c 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:16:35.988+0000 7f13b1bd8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:36.083 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: dump: 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.084 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: dump: 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:16:35.988+0000 7f13b6726800 5 monclient: authenticate success, global_id 7103 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.085 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:16:35.988+0000 7f13b33db640 4 set_mon_vals no callback set 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:16:35.990+0000 7f1297fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:16:35.990+0000 7f1297fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:16:35.990+0000 7f1297fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:16:35.990+0000 7f13b6726800 10 monclient: get_monmap_and_config 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:16:35.990+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:16:35.990+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:16:35.990+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.086 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding auth protocol: cephx 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding auth protocol: cephx 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding auth protocol: cephx 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.087 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:16:35.990+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f128c077140 auth_method 0 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:16:35.991+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding auth protocol: cephx 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding auth protocol: cephx 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding auth protocol: cephx 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.088 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:16:35.991+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:16:35.991+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key cmddesc rotate-key hook 0x7ffe5d66b6f8 EEXIST 2024-09-14T11:16:36.089 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d2a80380 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d2a80760 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d2a85b70 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.544885s 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d2a80380 auth_method 0 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.090 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d2a80760 auth_method 0 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_done global_id 7106 payload 274 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:16:35.992+0000 7f13b23d9640 1 monclient: found mon.noname-c 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.091 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: dump: 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.092 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: dump: 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.093 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:16:35.992+0000 7f13b6726800 5 monclient: authenticate success, global_id 7106 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:16:35.992+0000 7f13b6726800 10 monclient: get_monmap_and_config success 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:16:35.992+0000 7f13b6726800 4 set_mon_vals no callback set 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:16:35.992+0000 7f13b6726800 10 monclient: shutdown 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:16:35.993+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:16:35.993+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.094 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding auth protocol: cephx 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding auth protocol: cephx 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding auth protocol: cephx 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.095 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:16:35.993+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: starting msgr at 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: starting objecter 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command objecter_requests cmddesc objecter_requests hook 0x55a6d2a2e140 EEXIST 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: setting wanted keys 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: calling monclient init 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:16:35.993+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.096 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding auth protocol: cephx 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding auth protocol: cephx 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding auth protocol: cephx 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.097 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:16:35.993+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:16:35.993+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:16:35.994+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key cmddesc rotate-key hook 0x55a6d2a40a48 EEXIST 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d2a80380 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d2a85b70 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d2a73930 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.098 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.547092s 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d2a85b70 auth_method 0 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): get_auth_request con 0x55a6d2a73930 auth_method 0 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.099 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d2a80380 auth_method 0 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_done global_id 7109 payload 824 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 1 monclient: found mon.noname-c 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: dump: 2024-09-14T11:16:36.100 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.101 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: dump: 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:16:35.994+0000 7f13b6726800 5 monclient: authenticate success, global_id 7109 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:16:35.994+0000 7f1295ffb640 4 set_mon_vals no callback set 2024-09-14T11:16:36.102 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:16:35.994+0000 7f13b6726800 1 librados: init done 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:16:35.994+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cr dump hook 0x55a6d2a8df48 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:16:35.996+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:16:35.996+0000 7f1283fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:16:35.996+0000 7f1283fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:16:35.996+0000 7f1283fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:16:35.996+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f127c077230 auth_method 0 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:16:35.997+0000 7f13b2bda640 10 monclient: get_auth_request con 0x55a6d2a9b2f0 auth_method 0 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 realm 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.103 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:16:35.997+0000 7f13b6726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:16:35.998+0000 7f13b23d9640 10 monclient: get_auth_request con 0x55a6d2a9f550 auth_method 0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:16:35.998+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:16:35.998+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:16:35.999+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:16:35.999+0000 7f13b6726800 20 searching for the correct realm 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:16:35.999+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x55a6d2aa4800 auth_method 0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:16:35.999+0000 7f13b2bda640 10 monclient: get_auth_request con 0x7f13a8075f20 auth_method 0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:16:36.000+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f13ac068410 auth_method 0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:16:36.001+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f13a40771e0 auth_method 0 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:16:36.002+0000 7f13b1bd8640 0 -- 172.21.15.2:0/1154929678 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f13a40771e0 msgr2=0x7f13a400b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:36.104 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:16:36.002+0000 7f1283fff640 1 client.7109.objecter ms_handle_reset 0x7f13a40771e0 session 0x7f13a408e040 osd.4 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:16:36.002+0000 7f1283fff640 10 monclient: _renew_subs 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:16:36.002+0000 7f1283fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:16:36.002+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f127c0870d0 auth_method 0 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:16:36.003+0000 7f13b2bda640 10 monclient: get_auth_request con 0x7f13a808b820 auth_method 0 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:16:36.005+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f13a807a0b0 auth_method 0 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:16:36.006+0000 7f13b1bd8640 0 -- 172.21.15.2:0/1154929678 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f127c0870d0 msgr2=0x7f127c089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:16:36.006+0000 7f1283fff640 1 client.7109.objecter ms_handle_reset 0x7f127c0870d0 session 0x7f13a408e040 osd.4 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:16:36.006+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f13a40771e0 auth_method 0 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:36.105 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 zone default found 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:16:36.011+0000 7f13b6726800 4 Realm: () 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:16:36.011+0000 7f13b6726800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:16:36.011+0000 7f13b6726800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:16:36.011+0000 7f13b6726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 zonegroup default 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.106 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 started sync module instance, tier type = 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=0 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=1 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=2 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=3 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=4 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=5 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=6 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:16:36.022+0000 7f1283fff640 1 client.7109.objecter ms_handle_reset 0x7f13a807a0b0 session 0x7f13a80a53f0 osd.0 2024-09-14T11:16:36.107 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:16:36.022+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f127c0870d0 auth_method 0 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:16:36.023+0000 7f13b6726800 20 add_watcher() i=7 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:16:36.023+0000 7f13b6726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding auth protocol: cephx 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding auth protocol: cephx 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding auth protocol: cephx 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.108 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:16:36.024+0000 7f1268fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:16:36.025+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache list hook 0x55a6d2a73d10 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache inspect hook 0x55a6d2a73d10 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache erase hook 0x55a6d2a73d10 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache zap hook 0x55a6d2a73d10 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 note: GC not initialized 2024-09-14T11:16:36.109 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:16:36.025+0000 7f11e37fe640 20 reqs_thread_entry: start 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace show hook 0x7f13a4086040 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace history hook 0x7f13a4086040 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace active hook 0x7f13a4086040 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace active_short hook 0x7f13a4086040 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 Filter name: none 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:16:36.025+0000 7f11e17fa640 20 reqs_thread_entry: start 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:16:36.025+0000 7f13b6726800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 : miss 2024-09-14T11:16:36.110 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34, ofs0, ns] 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464267 cookie 94174987344576 notifier 7109 bl.length()=911 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.111 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_sources= new_sources= 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential sources added=[] removed=[] 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_dests= new_dests= 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential dests added=[] removed=[] 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:16:36.034+0000 7f13b6726800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f13b6726800 time 2024-09-14T11:16:36.035509+0000 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13b7d8c76a] 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:36.112 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:16:36.035+0000 7f13b6726800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f13b6726800 thread_name:radosgw-admin 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f13b6a3e6f0] 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f13b6a8b99c] 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13b7d8c7c4] 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.113 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:16:36.114 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:16:36.115 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:16:36.116 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:16:36.117 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:16:36.118 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:16:36.119 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:16:36.120 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f11e17fa640 / http_manager 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f11e37fe640 / http_manager 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1268fe1640 / rgw_dt_lg_renew 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1283fff640 / ms_dispatch 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1295ffb640 / io_context_pool 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1297fff640 / ms_dispatch 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f129ee05640 / ms_dispatch 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f12a0608640 / io_context_pool 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b1bd8640 / msgr-worker-2 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b23d9640 / msgr-worker-1 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b2bda640 / msgr-worker-0 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b33db640 / io_context_pool 2024-09-14T11:16:36.121 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b6726800 / radosgw-admin 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.126174.log 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: dump: 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.122 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:16:35.978+0000 7f13b6726800 5 monclient: authenticate success, global_id 7097 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:16:35.978+0000 7f13b6726800 10 monclient: get_monmap_and_config success 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:16:35.978+0000 7f13b6726800 4 set_mon_vals no callback set 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:16:35.978+0000 7f12a0608640 10 monclient: dump: 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.123 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:16:35.979+0000 7f13b6726800 10 monclient: shutdown 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 asok(0x55a6d278f270) unregister_commands rotate-key 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:16:35.979+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:16:35.979+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:16:35.979+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.124 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding auth protocol: cephx 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding auth protocol: cephx 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding auth protocol: cephx 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.125 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: crc 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:16:35.979+0000 7f13b6726800 5 AuthRegistry(0x55a6d29b5280) adding con mode: secure 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:16:35.979+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:16:35.979+0000 7f13b6726800 1 librados: starting msgr at 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:16:35.979+0000 7f13b6726800 1 librados: starting objecter 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command objecter_requests hook 0x55a6d29b31b0 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:16:35.980+0000 7f13b6726800 1 librados: setting wanted keys 2024-09-14T11:16:36.126 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:16:35.980+0000 7f13b6726800 1 librados: calling monclient init 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding auth protocol: cephx 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding auth protocol: cephx 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding auth protocol: cephx 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.127 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: crc 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 AuthRegistry(0x55a6d29af590) adding con mode: secure 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:16:35.980+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:16:35.980+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:16:35.980+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key hook 0x55a6d29af6d8 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d283a7a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d28f2700 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d28f8b90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.128 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:16:35.980+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.533680s 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d283a7a0 auth_method 0 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d28f2700 auth_method 0 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.129 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:16:35.980+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:16:35.980+0000 7f13b23d9640 10 monclient(hunting): handle_auth_done global_id 7464 payload 824 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:16:35.981+0000 7f13b23d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:16:35.981+0000 7f13b23d9640 1 monclient: found mon.noname-a 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:16:35.981+0000 7f13b23d9640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: dump: 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.130 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:16:35.981+0000 7f129ee05640 10 monclient: dump: 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.131 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:16:35.981+0000 7f13b6726800 5 monclient: authenticate success, global_id 7464 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:16:35.981+0000 7f12a0608640 4 set_mon_vals no callback set 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.132 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:16:35.981+0000 7f13b6726800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:16:35.981+0000 7f13b6726800 1 librados: init done 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:16:35.983+0000 7f129ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:16:35.983+0000 7f129ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:16:35.983+0000 7f129ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:16:35.983+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f1298077230 auth_method 0 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:16:35.983+0000 7f13b2bda640 10 monclient: get_auth_request con 0x55a6d29d8100 auth_method 0 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:16:35.984+0000 7f13b23d9640 10 monclient: get_auth_request con 0x55a6d29fb100 auth_method 0 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:16:35.985+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x55a6d2a007b0 auth_method 0 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:16:35.986+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:16:35.986+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:16:35.986+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.133 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding auth protocol: cephx 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding auth protocol: cephx 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding auth protocol: cephx 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.134 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: crc 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a047f0) adding con mode: secure 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:16:35.986+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:16:35.986+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command objecter_requests cmddesc objecter_requests hook 0x55a6d2a07d20 EEXIST 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding auth protocol: cephx 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding auth protocol: cephx 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding auth protocol: cephx 2024-09-14T11:16:36.135 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: crc 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a03698) adding con mode: secure 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:16:35.987+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:16:35.987+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:16:35.987+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key cmddesc rotate-key hook 0x55a6d2a037e0 EEXIST 2024-09-14T11:16:36.136 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d2a2c040 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d2a2c420 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d2a2ad50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:16:35.987+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.540620s 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d2a2c420 auth_method 0 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.137 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d2a2c040 auth_method 0 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:16:35.987+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): get_auth_request con 0x55a6d2a2ad50 auth_method 0 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.138 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:16:35.987+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_done global_id 7103 payload 824 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:16:35.987+0000 7f13b1bd8640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:16:35.988+0000 7f13b1bd8640 1 monclient: found mon.noname-c 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:16:35.988+0000 7f13b1bd8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: dump: 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.139 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:16:35.988+0000 7f1297fff640 10 monclient: dump: 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.140 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:16:35.988+0000 7f13b6726800 5 monclient: authenticate success, global_id 7103 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:16:35.988+0000 7f13b33db640 4 set_mon_vals no callback set 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:16:35.988+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:16:35.990+0000 7f1297fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:16:35.990+0000 7f1297fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.141 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:16:35.990+0000 7f1297fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:16:35.990+0000 7f13b6726800 10 monclient: get_monmap_and_config 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:16:35.990+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:16:35.990+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:16:35.990+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.142 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding auth protocol: cephx 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding auth protocol: cephx 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding auth protocol: cephx 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.143 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: crc 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:16:35.990+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a4bf90) adding con mode: secure 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:16:35.990+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f128c077140 auth_method 0 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:16:35.991+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding auth protocol: cephx 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding auth protocol: cephx 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding auth protocol: cephx 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.144 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: crc 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66b5b0) adding con mode: secure 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:16:35.991+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:16:35.991+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:16:35.991+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key cmddesc rotate-key hook 0x7ffe5d66b6f8 EEXIST 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d2a80380 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d2a80760 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d2a85b70 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.145 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:16:35.991+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.544885s 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d2a80380 auth_method 0 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:16:35.991+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d2a80760 auth_method 0 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.146 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:16:35.992+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient(hunting): handle_auth_done global_id 7106 payload 274 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:16:35.992+0000 7f13b23d9640 1 monclient: found mon.noname-c 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:16:35.992+0000 7f13b23d9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: dump: 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.147 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:16:35.992+0000 7f1295ffb640 10 monclient: dump: 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.148 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:16:35.992+0000 7f13b6726800 5 monclient: authenticate success, global_id 7106 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:16:35.992+0000 7f13b6726800 10 monclient: get_monmap_and_config success 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:16:35.992+0000 7f13b6726800 4 set_mon_vals no callback set 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:16:35.992+0000 7f13b6726800 10 monclient: shutdown 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:16:35.993+0000 7f13b6726800 10 monclient: build_initial_monmap 2024-09-14T11:16:36.149 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 build_initial for_mkfs: 0 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:16:35.993+0000 7f13b6726800 10 monclient: monmap: 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding auth protocol: cephx 2024-09-14T11:16:36.150 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding auth protocol: cephx 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding auth protocol: cephx 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: crc 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a853a0) adding con mode: secure 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:16:35.993+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.151 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: starting msgr at 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: starting objecter 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command objecter_requests cmddesc objecter_requests hook 0x55a6d2a2e140 EEXIST 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: setting wanted keys 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:16:35.993+0000 7f13b6726800 1 librados: calling monclient init 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:16:35.993+0000 7f13b6726800 10 monclient: init 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding auth protocol: cephx 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding auth protocol: cephx 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding auth protocol: cephx 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.152 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: crc 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:16:35.993+0000 7f13b6726800 5 AuthRegistry(0x55a6d2a40900) adding con mode: secure 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:16:35.993+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:16:35.993+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:16:35.994+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command rotate-key cmddesc rotate-key hook 0x55a6d2a40a48 EEXIST 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _reopen_session rank -1 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-b con 0x55a6d2a80380 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:16:36.153 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-c con 0x55a6d2a85b70 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): picked mon.noname-a con 0x55a6d2a73930 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): start opening mon connection 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): _renew_subs 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient(hunting): authenticate will time out at 2022.547092s 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request con 0x55a6d2a85b70 auth_method 0 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): get_auth_request con 0x55a6d2a73930 auth_method 0 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.154 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:16:35.994+0000 7f13b2bda640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): get_auth_request con 0x55a6d2a80380 auth_method 0 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:16:35.994+0000 7f13b23d9640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient(hunting): handle_auth_done global_id 7109 payload 824 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient: _finish_hunting 0 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 1 monclient: found mon.noname-c 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:16:35.994+0000 7f13b1bd8640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:16:36.155 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: dump: 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: _finish_auth 0 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: _check_auth_tickets 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:16:36.156 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:16:35.994+0000 7f1283fff640 10 monclient: dump: 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:16:35.994+0000 7f13b6726800 5 monclient: authenticate success, global_id 7109 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.157 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:16:35.994+0000 7f1295ffb640 4 set_mon_vals no callback set 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _renew_subs 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:16:35.994+0000 7f13b6726800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:16:35.994+0000 7f13b6726800 1 librados: init done 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:16:35.994+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cr dump hook 0x55a6d2a8df48 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:16:35.996+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:16:35.996+0000 7f1283fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:16:35.996+0000 7f1283fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:16:35.996+0000 7f1283fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:16:35.996+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f127c077230 auth_method 0 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:16:35.997+0000 7f13b2bda640 10 monclient: get_auth_request con 0x55a6d2a9b2f0 auth_method 0 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 realm 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.158 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:16:35.997+0000 7f13b6726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:16:35.997+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:16:35.998+0000 7f13b23d9640 10 monclient: get_auth_request con 0x55a6d2a9f550 auth_method 0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:16:35.998+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:16:35.998+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:16:35.999+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:16:35.999+0000 7f13b6726800 20 searching for the correct realm 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:16:35.999+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x55a6d2aa4800 auth_method 0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:16:35.999+0000 7f13b2bda640 10 monclient: get_auth_request con 0x7f13a8075f20 auth_method 0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:16:36.000+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f13ac068410 auth_method 0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:16:36.001+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f13a40771e0 auth_method 0 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:16:36.002+0000 7f13b1bd8640 0 -- 172.21.15.2:0/1154929678 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f13a40771e0 msgr2=0x7f13a400b730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:16:36.159 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:16:36.002+0000 7f1283fff640 1 client.7109.objecter ms_handle_reset 0x7f13a40771e0 session 0x7f13a408e040 osd.4 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:16:36.002+0000 7f1283fff640 10 monclient: _renew_subs 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:16:36.002+0000 7f1283fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:16:36.002+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f127c0870d0 auth_method 0 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:16:36.003+0000 7f13b2bda640 10 monclient: get_auth_request con 0x7f13a808b820 auth_method 0 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:16:36.005+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f13a807a0b0 auth_method 0 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:16:36.006+0000 7f13b1bd8640 0 -- 172.21.15.2:0/1154929678 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f127c0870d0 msgr2=0x7f127c089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:16:36.006+0000 7f1283fff640 1 client.7109.objecter ms_handle_reset 0x7f127c0870d0 session 0x7f13a408e040 osd.4 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:16:36.006+0000 7f13b1bd8640 10 monclient: get_auth_request con 0x7f13a40771e0 auth_method 0 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:36.160 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:16:36.010+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 zone default found 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:16:36.011+0000 7f13b6726800 4 Realm: () 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:16:36.011+0000 7f13b6726800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:16:36.011+0000 7f13b6726800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:16:36.011+0000 7f13b6726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 zonegroup default 2024-09-14T11:16:36.161 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:16:36.011+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 started sync module instance, tier type = 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:16:36.012+0000 7f13b6726800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=0 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=1 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=2 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=3 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=4 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=5 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:16:36.022+0000 7f13b6726800 20 add_watcher() i=6 2024-09-14T11:16:36.162 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:16:36.022+0000 7f1283fff640 1 client.7109.objecter ms_handle_reset 0x7f13a807a0b0 session 0x7f13a80a53f0 osd.0 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:16:36.022+0000 7f13b23d9640 10 monclient: get_auth_request con 0x7f127c0870d0 auth_method 0 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:16:36.023+0000 7f13b6726800 20 add_watcher() i=7 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:16:36.023+0000 7f13b6726800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding auth protocol: cephx 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding auth protocol: cephx 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding auth protocol: cephx 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:16:36.024+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.163 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:16:36.024+0000 7f1268fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: crc 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 AuthRegistry(0x7ffe5d66ba90) adding con mode: secure 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:16:36.025+0000 7f13b6726800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache list hook 0x55a6d2a73d10 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache inspect hook 0x55a6d2a73d10 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache erase hook 0x55a6d2a73d10 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command cache zap hook 0x55a6d2a73d10 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 note: GC not initialized 2024-09-14T11:16:36.164 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:16:36.025+0000 7f11e37fe640 20 reqs_thread_entry: start 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace show hook 0x7f13a4086040 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace history hook 0x7f13a4086040 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace active hook 0x7f13a4086040 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:16:36.025+0000 7f13b6726800 5 asok(0x55a6d278f270) register_command sync trace active_short hook 0x7f13a4086040 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 Filter name: none 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:16:36.025+0000 7f11e17fa640 20 reqs_thread_entry: start 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:16:36.025+0000 7f13b6726800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:16:36.025+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:16:36.165 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 : miss 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:16:36.026+0000 7f13b6726800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:16:36.026+0000 7f13b6726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:16:36.031+0000 7f13b6726800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34, ofs0, ns] 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464267 cookie 94174987344576 notifier 7109 bl.length()=911 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.166 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:16:36.031+0000 7f1295ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_sources= new_sources= 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential sources added=[] removed=[] 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_dests= new_dests= 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:16:36.031+0000 7f13b6726800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential dests added=[] removed=[] 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:16:36.034+0000 7f13b6726800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f13b6726800 time 2024-09-14T11:16:36.035509+0000 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f13b7d8c76a] 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.167 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:16:36.035+0000 7f13b6726800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f13b6726800 thread_name:radosgw-admin 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f13b6a3e6f0] 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f13b6a8b99c] 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f13b7d8c7c4] 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f13b7d8c928] 2024-09-14T11:16:36.168 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55a6d1bd60b1] 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55a6d1be5f6a] 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f13b6a29590] 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:16:36.169 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:16:36.170 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:16:36.171 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:16:36.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:16:36.173 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:16:36.174 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:16:36.175 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f11e17fa640 / http_manager 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f11e37fe640 / http_manager 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1268fe1640 / rgw_dt_lg_renew 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1283fff640 / ms_dispatch 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1295ffb640 / io_context_pool 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1297fff640 / ms_dispatch 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f129ee05640 / ms_dispatch 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f12a0608640 / io_context_pool 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b1bd8640 / msgr-worker-2 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b23d9640 / msgr-worker-1 2024-09-14T11:16:36.176 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b2bda640 / msgr-worker-0 2024-09-14T11:16:36.177 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b33db640 / io_context_pool 2024-09-14T11:16:36.177 INFO:tasks.workunit.client.0.smithi002.stderr: 7f13b6726800 / radosgw-admin 2024-09-14T11:16:36.177 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:16:36.177 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:16:36.177 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:16:36.036919Z_2f22546f-0e33-4a5d-8d9f-e02963cb9b8c/log 2024-09-14T11:16:36.177 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:16:36.177 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:16:36.181 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:36.181 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:36.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.113+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 20 realm 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.115+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.116+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.116+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.116+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.116+0000 7f855720e800 20 searching for the correct realm 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.120+0000 7f8552058640 0 -- 172.21.15.2:0/3975255685 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x5590991e4580 msgr2=0x5590991e69f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.123+0000 7f8552859640 0 -- 172.21.15.2:0/3975255685 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f8548098040 msgr2=0x7f854806ba50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.127+0000 7f855720e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:36.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.127+0000 7f855720e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.127+0000 7f855720e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.127+0000 7f855720e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.127+0000 7f855720e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.127+0000 7f855720e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.127+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 zone default found 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 4 Realm: () 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:36.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 zonegroup default 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.128+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.129+0000 7f855720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.129+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.129+0000 7f855720e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.129+0000 7f855720e800 20 started sync module instance, tier type = 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.129+0000 7f855720e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.138+0000 7f855720e800 20 add_watcher() i=0 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.138+0000 7f855720e800 20 add_watcher() i=1 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.138+0000 7f855720e800 20 add_watcher() i=2 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.138+0000 7f855720e800 20 add_watcher() i=3 2024-09-14T11:16:36.184 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.138+0000 7f855720e800 20 add_watcher() i=4 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.138+0000 7f855720e800 20 add_watcher() i=5 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.138+0000 7f855720e800 20 add_watcher() i=6 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.140+0000 7f855720e800 20 add_watcher() i=7 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.140+0000 7f855720e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f84097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f855720e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f855720e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f855720e800 5 note: GC not initialized 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f8383fff640 20 reqs_thread_entry: start 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f855720e800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f855720e800 20 Filter name: none 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f8381ffb640 20 reqs_thread_entry: start 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.142+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.143+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.185 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.143+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.143+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.143+0000 7f855720e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.143+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.144+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.144+0000 7f855720e800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.144+0000 7f855720e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.144+0000 7f855720e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.145+0000 7f84097e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.147+0000 7f855720e800 20 remove_watcher() i=0 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.147+0000 7f855720e800 2 removed watcher, disabling cache 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.148+0000 7f855720e800 20 remove_watcher() i=1 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.149+0000 7f855720e800 20 remove_watcher() i=2 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.151+0000 7f855720e800 20 remove_watcher() i=3 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.152+0000 7f855720e800 20 remove_watcher() i=4 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.153+0000 7f855720e800 20 remove_watcher() i=5 2024-09-14T11:16:36.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.154+0000 7f855720e800 20 remove_watcher() i=6 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.155+0000 7f855720e800 20 remove_watcher() i=7 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-do-reshard id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:16:36.187 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:16:36.218 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:16:36.250 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:16:36.251 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:16:36.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.291+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 20 realm 2024-09-14T11:16:36.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:16:36.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.293+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.294+0000 7f404d540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.294+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.294+0000 7f404d540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:16:36.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.294+0000 7f404d540800 20 searching for the correct realm 2024-09-14T11:16:36.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.297+0000 7f4049aee640 0 -- 172.21.15.2:0/1369584130 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f40400700d0 msgr2=0x7f4040083040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.300+0000 7f40492ed640 0 -- 172.21.15.2:0/1369584130 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f404008b8d0 msgr2=0x7f404008f7d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:16:36.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:16:36.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:16:36.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:16:36.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:16:36.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:16:36.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.506+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 20 zone default found 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 4 Realm: () 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 20 zonegroup default 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.507+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.508+0000 7f404d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.508+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.508+0000 7f404d540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:16:36.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.508+0000 7f404d540800 20 started sync module instance, tier type = 2024-09-14T11:16:36.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.508+0000 7f404d540800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:16:36.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=0 2024-09-14T11:16:36.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=1 2024-09-14T11:16:36.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=2 2024-09-14T11:16:36.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=3 2024-09-14T11:16:36.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=4 2024-09-14T11:16:36.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=5 2024-09-14T11:16:36.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=6 2024-09-14T11:16:36.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 20 add_watcher() i=7 2024-09-14T11:16:36.517 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.517+0000 7f404d540800 2 all 8 watchers are set, enabling cache 2024-09-14T11:16:36.518 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.519+0000 7f3eff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f404d540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:16:36.519 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f404d540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:16:36.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f404d540800 5 note: GC not initialized 2024-09-14T11:16:36.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f3efe7e4640 20 reqs_thread_entry: start 2024-09-14T11:16:36.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f404d540800 20 init_complete bucket index max shards: 1 2024-09-14T11:16:36.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f404d540800 20 Filter name: none 2024-09-14T11:16:36.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f3e6ffff640 20 reqs_thread_entry: start 2024-09-14T11:16:36.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f404d540800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:16:36.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.520+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:16:36.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:16:36.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:16:36.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 : miss 2024-09-14T11:16:36.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 20 rados->read ofs=0 len=0 2024-09-14T11:16:36.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:16:36.521 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:16:36.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:16:36.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:16:36.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:16:36.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.521+0000 7f404d540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 2024-09-14T11:16:36.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.522+0000 7f404d540800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to be held by another RGW process; skipping for now 2024-09-14T11:16:36.522 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.523+0000 7f3eff7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:16:36.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.525+0000 7f404d540800 20 remove_watcher() i=0 2024-09-14T11:16:36.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.525+0000 7f404d540800 2 removed watcher, disabling cache 2024-09-14T11:16:36.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.526+0000 7f404d540800 20 remove_watcher() i=1 2024-09-14T11:16:36.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.527+0000 7f404d540800 20 remove_watcher() i=2 2024-09-14T11:16:36.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.528+0000 7f404d540800 20 remove_watcher() i=3 2024-09-14T11:16:36.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.529+0000 7f404d540800 20 remove_watcher() i=4 2024-09-14T11:16:36.529 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.530+0000 7f404d540800 20 remove_watcher() i=5 2024-09-14T11:16:36.530 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.531+0000 7f404d540800 20 remove_watcher() i=6 2024-09-14T11:16:36.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:16:36.532+0000 7f404d540800 20 remove_watcher() i=7 2024-09-14T11:16:36.542 INFO:tasks.workunit.client.0.smithi002.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:17:06.575 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:06.612 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:06.612 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:06.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.660+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 20 realm 2024-09-14T11:17:06.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:06.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.662+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.663+0000 7fb7cfe0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:06.661 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.663+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.663+0000 7fb7cfe0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:06.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.663+0000 7fb7cfe0e800 20 searching for the correct realm 2024-09-14T11:17:06.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.668+0000 7fb7cac58640 0 -- 172.21.15.2:0/4257324004 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fb7bc078950 msgr2=0x7fb7bc04df10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:06.670 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.672+0000 7fb7cac58640 0 -- 172.21.15.2:0/4257324004 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fb6940870d0 msgr2=0x7fb694089500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.674 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 zone default found 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 4 Realm: () 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:06.676 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 zonegroup default 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.676+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.677+0000 7fb7cfe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.677+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.677+0000 7fb7cfe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.677+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.677+0000 7fb7cfe0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.677+0000 7fb7cfe0e800 20 started sync module instance, tier type = 2024-09-14T11:17:06.677 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.677+0000 7fb7cfe0e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:06.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.687+0000 7fb7cfe0e800 20 add_watcher() i=0 2024-09-14T11:17:06.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.687+0000 7fb7cfe0e800 20 add_watcher() i=1 2024-09-14T11:17:06.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.687+0000 7fb7cfe0e800 20 add_watcher() i=2 2024-09-14T11:17:06.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.687+0000 7fb7cfe0e800 20 add_watcher() i=3 2024-09-14T11:17:06.685 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.687+0000 7fb7cfe0e800 20 add_watcher() i=4 2024-09-14T11:17:06.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.687+0000 7fb7cfe0e800 20 add_watcher() i=5 2024-09-14T11:17:06.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.687+0000 7fb7cfe0e800 20 add_watcher() i=6 2024-09-14T11:17:06.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.688+0000 7fb7cfe0e800 20 add_watcher() i=7 2024-09-14T11:17:06.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.688+0000 7fb7cfe0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:06.688 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.690+0000 7fb6827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.690+0000 7fb7cfe0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.690+0000 7fb7cfe0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.690+0000 7fb7cfe0e800 5 note: GC not initialized 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.690+0000 7fb6817e2640 20 reqs_thread_entry: start 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.690+0000 7fb7cfe0e800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.690+0000 7fb7cfe0e800 20 Filter name: none 2024-09-14T11:17:06.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb67a7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:06.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-14T11:17:06.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:17:06.690 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 : miss 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 20 rados_obj.operate() r=0 bl.length=441 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.691+0000 7fb7cfe0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 2024-09-14T11:17:06.691 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.693+0000 7fb7cfe0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:17:06.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:17:06.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:17:06.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:06.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34, ofs0, ns] 2024-09-14T11:17:06.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb6aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464268 cookie 94794053315040 notifier 7521 bl.length()=911 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb6aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb6aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb6aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_sources= new_sources= 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential sources added=[] removed=[] 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_dests= new_dests= 2024-09-14T11:17:06.697 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.698+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential dests added=[] removed=[] 2024-09-14T11:17:06.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.702+0000 7fb7cfe0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.34.2.0 2024-09-14T11:17:06.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.702+0000 7fb7cfe0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.34.2.0 2024-09-14T11:17:06.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.702+0000 7fb7cfe0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.34.2.1 2024-09-14T11:17:06.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.702+0000 7fb7cfe0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.34.2.1 2024-09-14T11:17:06.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.702+0000 7fb7cfe0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.34.0 2024-09-14T11:17:06.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.704+0000 7fb7cfe0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:06.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.704+0000 7fb7cfe0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 2024-09-14T11:17:06.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:17:06.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:17:06.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:06.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34, ofs0, ns] 2024-09-14T11:17:06.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb6ae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464269 cookie 94794053315040 notifier 7521 bl.length()=911 2024-09-14T11:17:06.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb6ae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:17:06.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb6ae7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:17:06.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb6ae7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:06.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_sources= new_sources= 2024-09-14T11:17:06.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential sources added=[] removed=[] 2024-09-14T11:17:06.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_dests= new_dests= 2024-09-14T11:17:06.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.706+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential dests added=[] removed=[] 2024-09-14T11:17:06.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.707+0000 7fb7cfe0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.34.0 2024-09-14T11:17:06.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.708+0000 7fb7cfe0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:06.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.708+0000 7fb7cfe0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb7cfe0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb7cfe0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb7cfe0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb7cfe0e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34, ofs0, ns] 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb6aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464270 cookie 94794053315040 notifier 7521 bl.length()=879 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb6aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 info.flags=0x17 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb6aeffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 to cache LRU end 2024-09-14T11:17:06.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.709+0000 7fb6aeffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:06.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.710+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_sources= new_sources= 2024-09-14T11:17:06.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.710+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential sources added=[] removed=[] 2024-09-14T11:17:06.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.710+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): orig_dests= new_dests= 2024-09-14T11:17:06.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.710+0000 7fb7cfe0e800 20 handle_bi_update(): bucket=:abort-at-do-reshard[17edae97-cd6b-4c90-863d-862429a20cf3.4538.34]): potential dests added=[] removed=[] 2024-09-14T11:17:06.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.711+0000 7fb7cfe0e800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 1 shards to 2 shards completed successfully 2024-09-14T11:17:06.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.713+0000 7fb6827e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:06.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.716+0000 7fb7cfe0e800 20 remove_watcher() i=0 2024-09-14T11:17:06.714 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.716+0000 7fb7cfe0e800 2 removed watcher, disabling cache 2024-09-14T11:17:06.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.717+0000 7fb7cfe0e800 20 remove_watcher() i=1 2024-09-14T11:17:06.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.718+0000 7fb7cfe0e800 20 remove_watcher() i=2 2024-09-14T11:17:06.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.719+0000 7fb7cfe0e800 20 remove_watcher() i=3 2024-09-14T11:17:06.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.720+0000 7fb7cfe0e800 20 remove_watcher() i=4 2024-09-14T11:17:06.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.721+0000 7fb7cfe0e800 20 remove_watcher() i=5 2024-09-14T11:17:06.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.722+0000 7fb7cfe0e800 20 remove_watcher() i=6 2024-09-14T11:17:06.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.723+0000 7fb7cfe0e800 20 remove_watcher() i=7 2024-09-14T11:17:06.734 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-14T11:17:06.764 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:06.764 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:06.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.805+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 20 realm 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:06.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.807+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.808+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:06.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.808+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:06.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.808+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:06.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.808+0000 7f669cb0c800 20 searching for the correct realm 2024-09-14T11:17:06.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.812+0000 7f669adfe640 0 -- 172.21.15.2:0/3038205335 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f669007ec20 msgr2=0x7f669006e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:06.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:06.816+0000 7f669a5fd640 0 -- 172.21.15.2:0/3038205335 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f669003bb80 msgr2=0x7f6690036ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:07.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:07.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.023+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 zone default found 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 4 Realm: () 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:07.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 zonegroup default 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.024+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.025+0000 7f669cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.025+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.025+0000 7f669cb0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.025+0000 7f669cb0c800 20 started sync module instance, tier type = 2024-09-14T11:17:07.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.025+0000 7f669cb0c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:07.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.034+0000 7f669cb0c800 20 add_watcher() i=0 2024-09-14T11:17:07.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.034+0000 7f669cb0c800 20 add_watcher() i=1 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.034+0000 7f669cb0c800 20 add_watcher() i=2 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.034+0000 7f669cb0c800 20 add_watcher() i=3 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.034+0000 7f669cb0c800 20 add_watcher() i=4 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.034+0000 7f669cb0c800 20 add_watcher() i=5 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.034+0000 7f669cb0c800 20 add_watcher() i=6 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.035+0000 7f669cb0c800 20 add_watcher() i=7 2024-09-14T11:17:07.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.035+0000 7f669cb0c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:07.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.037+0000 7f6550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f669cb0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:07.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f669cb0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f669cb0c800 5 note: GC not initialized 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f64cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f669cb0c800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f669cb0c800 20 Filter name: none 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f64c97fa640 20 reqs_thread_entry: start 2024-09-14T11:17:07.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.038+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.039+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:17:07.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.039+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.039+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:17:07.039 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.039+0000 7f669cb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:07.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.039+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.040+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-14T11:17:07.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.040+0000 7f669cb0c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.040+0000 7f669cb0c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-14T11:17:07.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.040+0000 7f669cb0c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:07.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.041+0000 7f6550fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.044+0000 7f669cb0c800 20 remove_watcher() i=0 2024-09-14T11:17:07.042 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.044+0000 7f669cb0c800 2 removed watcher, disabling cache 2024-09-14T11:17:07.043 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.045+0000 7f669cb0c800 20 remove_watcher() i=1 2024-09-14T11:17:07.044 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.046+0000 7f669cb0c800 20 remove_watcher() i=2 2024-09-14T11:17:07.045 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.047+0000 7f669cb0c800 20 remove_watcher() i=3 2024-09-14T11:17:07.046 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.048+0000 7f669cb0c800 20 remove_watcher() i=4 2024-09-14T11:17:07.047 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.049+0000 7f669cb0c800 20 remove_watcher() i=5 2024-09-14T11:17:07.048 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.050+0000 7f669cb0c800 20 remove_watcher() i=6 2024-09-14T11:17:07.049 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.051+0000 7f669cb0c800 20 remove_watcher() i=7 2024-09-14T11:17:07.060 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:07.061 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:07.061 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-do-reshard id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.34 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:17:07.061 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:07.063 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.063 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.066 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.067 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.109 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.110 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.124 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-14T11:17:07.124 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:07.125 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.125 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.136 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.136 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.179 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.179 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.188 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.188 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.195 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.196 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.204 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.204 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.213 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.213 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.220 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.220 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.227 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.228 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.235 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.235 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.242 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.243 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.251 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.251 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.259 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.259 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.266 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.266 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.273 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.274 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.282 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.282 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.290 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.290 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.297 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.297 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.305 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.306 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.313 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.313 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.320 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.320 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.327 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:07.327 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:07.335 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:17:07.364 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:07.364 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:07.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.405+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 20 realm 2024-09-14T11:17:07.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:07.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.407+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.408+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.408+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.409+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:07.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.409+0000 7f7751146800 20 searching for the correct realm 2024-09-14T11:17:07.411 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.412+0000 7f774e42f640 0 -- 172.21.15.2:0/1341979881 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x561f494139f0 msgr2=0x561f49415e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.416+0000 7f774e42f640 0 -- 172.21.15.2:0/1341979881 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f7740061040 msgr2=0x7f7740055410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:07.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:07.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:07.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.420+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 zone default found 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 4 Realm: () 2024-09-14T11:17:07.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:07.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:07.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:07.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 zonegroup default 2024-09-14T11:17:07.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.421+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.422+0000 7f7751146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.422+0000 7f7751146800 20 started sync module instance, tier type = 2024-09-14T11:17:07.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.422+0000 7f7751146800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:07.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.430+0000 7f7751146800 20 add_watcher() i=0 2024-09-14T11:17:07.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.430+0000 7f7751146800 20 add_watcher() i=1 2024-09-14T11:17:07.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.430+0000 7f7751146800 20 add_watcher() i=2 2024-09-14T11:17:07.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.430+0000 7f7751146800 20 add_watcher() i=3 2024-09-14T11:17:07.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.430+0000 7f7751146800 20 add_watcher() i=4 2024-09-14T11:17:07.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.430+0000 7f7751146800 20 add_watcher() i=5 2024-09-14T11:17:07.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.430+0000 7f7751146800 20 add_watcher() i=6 2024-09-14T11:17:07.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.431+0000 7f7751146800 20 add_watcher() i=7 2024-09-14T11:17:07.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.431+0000 7f7751146800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:07.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.432+0000 7f76057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f7751146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f7751146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f7751146800 5 note: GC not initialized 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f757ffff640 20 reqs_thread_entry: start 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f7751146800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f7751146800 20 Filter name: none 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f757dffb640 20 reqs_thread_entry: start 2024-09-14T11:17:07.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.433+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.434+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.434+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.435+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.435+0000 7f7751146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.435+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.435+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:07.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.435+0000 7f7751146800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.435+0000 7f7751146800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:07.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.435+0000 7f7751146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:07.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.437+0000 7f76057e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.439+0000 7f7751146800 20 remove_watcher() i=0 2024-09-14T11:17:07.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.439+0000 7f7751146800 2 removed watcher, disabling cache 2024-09-14T11:17:07.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.440+0000 7f7751146800 20 remove_watcher() i=1 2024-09-14T11:17:07.439 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.441+0000 7f7751146800 20 remove_watcher() i=2 2024-09-14T11:17:07.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.442+0000 7f7751146800 20 remove_watcher() i=3 2024-09-14T11:17:07.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.443+0000 7f7751146800 20 remove_watcher() i=4 2024-09-14T11:17:07.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.444+0000 7f7751146800 20 remove_watcher() i=5 2024-09-14T11:17:07.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.445+0000 7f7751146800 20 remove_watcher() i=6 2024-09-14T11:17:07.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.446+0000 7f7751146800 20 remove_watcher() i=7 2024-09-14T11:17:07.455 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:07.455 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:07.456 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-logrecord-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:07.456 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:07.457 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-14T11:17:07.492 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:07.492 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:07.531 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.533+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.534+0000 7fd63182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.534+0000 7fd63182f800 20 realm 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.534+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.534+0000 7fd63182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.534+0000 7fd63182f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.534+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.533 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.535+0000 7fd63182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.535+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.535+0000 7fd63182f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.535+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.536+0000 7fd63182f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:07.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.536+0000 7fd63182f800 20 searching for the correct realm 2024-09-14T11:17:07.537 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.539+0000 7fd62eb18640 0 -- 172.21.15.2:0/3122163325 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55baf3ff79b0 msgr2=0x55baf3ff9e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:07.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.543+0000 7fd62f319640 0 -- 172.21.15.2:0/3122163325 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd624085470 msgr2=0x7fd6240858d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:07.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:07.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:07.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:07.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:07.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:07.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:07.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.547+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 zone default found 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 4 Realm: () 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 zonegroup default 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.548+0000 7fd63182f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.549+0000 7fd63182f800 20 started sync module instance, tier type = 2024-09-14T11:17:07.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.549+0000 7fd63182f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:07.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.557+0000 7fd63182f800 20 add_watcher() i=0 2024-09-14T11:17:07.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.557+0000 7fd63182f800 20 add_watcher() i=1 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.557+0000 7fd63182f800 20 add_watcher() i=2 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.557+0000 7fd63182f800 20 add_watcher() i=3 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.557+0000 7fd63182f800 20 add_watcher() i=4 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.557+0000 7fd63182f800 20 add_watcher() i=5 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.557+0000 7fd63182f800 20 add_watcher() i=6 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.558+0000 7fd63182f800 20 add_watcher() i=7 2024-09-14T11:17:07.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.558+0000 7fd63182f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:07.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd4e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd63182f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:07.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd63182f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:07.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd63182f800 5 note: GC not initialized 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd4e4fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd63182f800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd63182f800 20 Filter name: none 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd45e7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd63182f800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.560+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:07.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 : miss 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:07.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.561+0000 7fd63182f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.565+0000 7fd63182f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.565+0000 7fd63182f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.565+0000 7fd63182f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.565+0000 7fd63182f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35, ofs0, ns] 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd512ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464307 cookie 94261445896496 notifier 7217 bl.length()=923 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd512ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd512ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:07.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd512ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_sources= new_sources= 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential sources added=[] removed=[] 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_dests= new_dests= 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.566+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential dests added=[] removed=[] 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.567+0000 7fd63182f800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-14T11:17:07.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.567+0000 7fd63182f800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-14T11:17:07.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.569+0000 7fd63182f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:07.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.569+0000 7fd63182f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.570+0000 7fd63182f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.570+0000 7fd63182f800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.570+0000 7fd63182f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.570+0000 7fd63182f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35, ofs0, ns] 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd5127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464308 cookie 94261445896496 notifier 7217 bl.length()=891 2024-09-14T11:17:07.569 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd5127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:07.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd5127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:07.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd5127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:07.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_sources= new_sources= 2024-09-14T11:17:07.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential sources added=[] removed=[] 2024-09-14T11:17:07.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_dests= new_dests= 2024-09-14T11:17:07.570 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.571+0000 7fd63182f800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential dests added=[] removed=[] 2024-09-14T11:17:07.571 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.573+0000 7fd4e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:07.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.575+0000 7fd63182f800 20 remove_watcher() i=0 2024-09-14T11:17:07.573 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.575+0000 7fd63182f800 2 removed watcher, disabling cache 2024-09-14T11:17:07.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.576+0000 7fd63182f800 20 remove_watcher() i=1 2024-09-14T11:17:07.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.577+0000 7fd63182f800 20 remove_watcher() i=2 2024-09-14T11:17:07.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.578+0000 7fd63182f800 20 remove_watcher() i=3 2024-09-14T11:17:07.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.579+0000 7fd63182f800 20 remove_watcher() i=4 2024-09-14T11:17:07.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.580+0000 7fd63182f800 20 remove_watcher() i=5 2024-09-14T11:17:07.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.580+0000 7fd63182f800 20 remove_watcher() i=6 2024-09-14T11:17:07.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.581+0000 7fd63182f800 20 remove_watcher() i=7 2024-09-14T11:17:07.592 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:17:07.622 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:07.622 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:07.862 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.864+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 20 realm 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:07.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.866+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.867+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:07.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.867+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:07.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.867+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:07.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.868+0000 7f32fc11f800 20 searching for the correct realm 2024-09-14T11:17:07.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:07.870+0000 7f32f76a1640 0 -- 172.21.15.2:0/963905615 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f32e8079c20 msgr2=0x7f32e807d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.077+0000 7f32f7ea2640 0 -- 172.21.15.2:0/963905615 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f32e009fb90 msgr2=0x7f32e0069ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.284+0000 7f32fc11f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.284+0000 7f32fc11f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.284+0000 7f32fc11f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.284+0000 7f32fc11f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.284+0000 7f32fc11f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.284+0000 7f32fc11f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:08.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.284+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.285+0000 7f32fc11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.285+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.285+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.285+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 zone default found 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 4 Realm: () 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:08.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 zonegroup default 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.286+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.287+0000 7f32fc11f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.287+0000 7f32fc11f800 20 started sync module instance, tier type = 2024-09-14T11:17:08.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.287+0000 7f32fc11f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:08.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.296+0000 7f32fc11f800 20 add_watcher() i=0 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.296+0000 7f32fc11f800 20 add_watcher() i=1 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.296+0000 7f32fc11f800 20 add_watcher() i=2 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.296+0000 7f32fc11f800 20 add_watcher() i=3 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.296+0000 7f32fc11f800 20 add_watcher() i=4 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.296+0000 7f32fc11f800 20 add_watcher() i=5 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.296+0000 7f32fc11f800 20 add_watcher() i=6 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.297+0000 7f32fc11f800 20 add_watcher() i=7 2024-09-14T11:17:08.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.297+0000 7f32fc11f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:08.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.299+0000 7f31adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.299+0000 7f32fc11f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:08.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.299+0000 7f32fc11f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:08.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.300+0000 7f32fc11f800 5 note: GC not initialized 2024-09-14T11:17:08.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.300+0000 7f31acfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:08.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.300+0000 7f32fc11f800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:08.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.300+0000 7f32fc11f800 20 Filter name: none 2024-09-14T11:17:08.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.300+0000 7f31267fc640 20 reqs_thread_entry: start 2024-09-14T11:17:08.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.300+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.301+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:08.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.301+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.301+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:08.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.301+0000 7f32fc11f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:08.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.301+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.302+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:08.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.302+0000 7f32fc11f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.302+0000 7f32fc11f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:08.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.302+0000 7f32fc11f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:08.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.304+0000 7f31adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.306+0000 7f32fc11f800 20 remove_watcher() i=0 2024-09-14T11:17:08.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.306+0000 7f32fc11f800 2 removed watcher, disabling cache 2024-09-14T11:17:08.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.308+0000 7f32fc11f800 20 remove_watcher() i=1 2024-09-14T11:17:08.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.309+0000 7f32fc11f800 20 remove_watcher() i=2 2024-09-14T11:17:08.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.310+0000 7f32fc11f800 20 remove_watcher() i=3 2024-09-14T11:17:08.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.311+0000 7f32fc11f800 20 remove_watcher() i=4 2024-09-14T11:17:08.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.312+0000 7f32fc11f800 20 remove_watcher() i=5 2024-09-14T11:17:08.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.313+0000 7f32fc11f800 20 remove_watcher() i=6 2024-09-14T11:17:08.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.314+0000 7f32fc11f800 20 remove_watcher() i=7 2024-09-14T11:17:08.325 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:08.325 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:08.325 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-logrecord-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:08.325 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:08.327 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:08.335 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:08.335 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:08.378 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:08.412 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:08.412 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:08.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.454+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.456+0000 7fba35d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.456+0000 7fba35d39800 20 realm 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.456+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.456+0000 7fba35d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.456+0000 7fba35d39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.456+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.457+0000 7fba35d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.455 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.457+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.458+0000 7fba35d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.458+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.458+0000 7fba35d39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:08.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.458+0000 7fba35d39800 20 searching for the correct realm 2024-09-14T11:17:08.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.461+0000 7fba311c6640 0 -- 172.21.15.2:0/1906585717 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55f965299df0 msgr2=0x55f96529c2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.466+0000 7fba319c7640 0 -- 172.21.15.2:0/1906585717 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fba2808ebe0 msgr2=0x7fba28082a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:08.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:08.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:08.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:08.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:08.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:08.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.470+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:08.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 zone default found 2024-09-14T11:17:08.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 4 Realm: () 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 zonegroup default 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.471+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.472+0000 7fba35d39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.472+0000 7fba35d39800 20 started sync module instance, tier type = 2024-09-14T11:17:08.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.472+0000 7fba35d39800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:08.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.480+0000 7fba35d39800 20 add_watcher() i=0 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.480+0000 7fba35d39800 20 add_watcher() i=1 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.480+0000 7fba35d39800 20 add_watcher() i=2 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.480+0000 7fba35d39800 20 add_watcher() i=3 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.480+0000 7fba35d39800 20 add_watcher() i=4 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.480+0000 7fba35d39800 20 add_watcher() i=5 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.480+0000 7fba35d39800 20 add_watcher() i=6 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.481+0000 7fba35d39800 20 add_watcher() i=7 2024-09-14T11:17:08.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.481+0000 7fba35d39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:08.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.483+0000 7fb8e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.483+0000 7fba35d39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.483+0000 7fba35d39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.483+0000 7fba35d39800 5 note: GC not initialized 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.483+0000 7fb8e27fc640 20 reqs_thread_entry: start 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.483+0000 7fba35d39800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.483+0000 7fba35d39800 20 Filter name: none 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fb853fff640 20 reqs_thread_entry: start 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fba35d39800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-14T11:17:08.482 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fba35d39800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fba35d39800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fba35d39800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fba35d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 : miss 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.484+0000 7fba35d39800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.485+0000 7fba35d39800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.485+0000 7fba35d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:08.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.485+0000 7fba35d39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:08.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.485+0000 7fba35d39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:08.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.485+0000 7fba35d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:08.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.485+0000 7fba35d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 2024-09-14T11:17:08.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.488+0000 7fba35d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:08.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.488+0000 7fba35d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:08.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.488+0000 7fba35d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:08.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.488+0000 7fba35d39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35, ofs0, ns] 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fb9157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464309 cookie 94529632465408 notifier 7608 bl.length()=923 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fb9157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fb9157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fb9157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_sources= new_sources= 2024-09-14T11:17:08.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential sources added=[] removed=[] 2024-09-14T11:17:08.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_dests= new_dests= 2024-09-14T11:17:08.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.489+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential dests added=[] removed=[] 2024-09-14T11:17:08.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.492+0000 7fba35d39800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.35.1.0 2024-09-14T11:17:08.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.492+0000 7fba35d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.35.1.0 2024-09-14T11:17:08.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.492+0000 7fba35d39800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.35.1.1 2024-09-14T11:17:08.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.492+0000 7fba35d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.35.1.1 2024-09-14T11:17:08.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.492+0000 7fba35d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.35.0 2024-09-14T11:17:08.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.494+0000 7fba35d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:08.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.494+0000 7fba35d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 2024-09-14T11:17:08.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:08.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:08.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:08.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35, ofs0, ns] 2024-09-14T11:17:08.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fb9157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464310 cookie 94529632465408 notifier 7608 bl.length()=923 2024-09-14T11:17:08.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fb9157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:08.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fb9157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:08.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fb9157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:08.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_sources= new_sources= 2024-09-14T11:17:08.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential sources added=[] removed=[] 2024-09-14T11:17:08.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_dests= new_dests= 2024-09-14T11:17:08.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.496+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential dests added=[] removed=[] 2024-09-14T11:17:08.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.497+0000 7fba35d39800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.35.0 2024-09-14T11:17:08.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.498+0000 7fba35d39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:08.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.498+0000 7fba35d39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.499+0000 7fba35d39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.499+0000 7fba35d39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.499+0000 7fba35d39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.499+0000 7fba35d39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35, ofs0, ns] 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fb9157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464311 cookie 94529632465408 notifier 7608 bl.length()=891 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fb9157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 info.flags=0x17 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fb9157fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 to cache LRU end 2024-09-14T11:17:08.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fb9157fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:08.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_sources= new_sources= 2024-09-14T11:17:08.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential sources added=[] removed=[] 2024-09-14T11:17:08.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): orig_dests= new_dests= 2024-09-14T11:17:08.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.500+0000 7fba35d39800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.35]): potential dests added=[] removed=[] 2024-09-14T11:17:08.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.501+0000 7fba35d39800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:17:08.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.503+0000 7fb8e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:08.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.505+0000 7fba35d39800 20 remove_watcher() i=0 2024-09-14T11:17:08.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.505+0000 7fba35d39800 2 removed watcher, disabling cache 2024-09-14T11:17:08.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.506+0000 7fba35d39800 20 remove_watcher() i=1 2024-09-14T11:17:08.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.507+0000 7fba35d39800 20 remove_watcher() i=2 2024-09-14T11:17:08.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.508+0000 7fba35d39800 20 remove_watcher() i=3 2024-09-14T11:17:08.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.510+0000 7fba35d39800 20 remove_watcher() i=4 2024-09-14T11:17:08.509 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.511+0000 7fba35d39800 20 remove_watcher() i=5 2024-09-14T11:17:08.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.512+0000 7fba35d39800 20 remove_watcher() i=6 2024-09-14T11:17:08.510 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.512+0000 7fba35d39800 20 remove_watcher() i=7 2024-09-14T11:17:08.524 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-14T11:17:08.553 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:08.553 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:08.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.593+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.595+0000 7f898171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.595+0000 7f898171f800 20 realm 2024-09-14T11:17:08.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.595+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.596+0000 7f898171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.596+0000 7f898171f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:08.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.596+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.596+0000 7f898171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:08.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.596+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.597+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:08.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.597+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:08.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.597+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:08.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.597+0000 7f898171f800 20 searching for the correct realm 2024-09-14T11:17:08.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.599+0000 7f897cca1640 0 -- 172.21.15.2:0/91062447 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f897007bc20 msgr2=0x7f897003b9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:08.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:08.805+0000 7f897d4a2640 0 -- 172.21.15.2:0/91062447 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f897401b040 msgr2=0x7f8974075310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:09.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.011+0000 7f898171f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:09.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.011+0000 7f898171f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:09.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.011+0000 7f898171f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:09.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.011+0000 7f898171f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:09.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.011+0000 7f898171f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:09.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.011+0000 7f898171f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:09.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.011+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 zone default found 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 4 Realm: () 2024-09-14T11:17:09.012 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 zonegroup default 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.012+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.013+0000 7f898171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.013+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.013+0000 7f898171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.013+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.013+0000 7f898171f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.013+0000 7f898171f800 20 started sync module instance, tier type = 2024-09-14T11:17:09.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.013+0000 7f898171f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.023+0000 7f898171f800 20 add_watcher() i=0 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.023+0000 7f898171f800 20 add_watcher() i=1 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.023+0000 7f898171f800 20 add_watcher() i=2 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.023+0000 7f898171f800 20 add_watcher() i=3 2024-09-14T11:17:09.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.023+0000 7f898171f800 20 add_watcher() i=4 2024-09-14T11:17:09.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.023+0000 7f898171f800 20 add_watcher() i=5 2024-09-14T11:17:09.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.023+0000 7f898171f800 20 add_watcher() i=6 2024-09-14T11:17:09.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.024+0000 7f898171f800 20 add_watcher() i=7 2024-09-14T11:17:09.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.024+0000 7f898171f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:09.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f88337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:09.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f898171f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:09.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f898171f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:09.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f898171f800 5 note: GC not initialized 2024-09-14T11:17:09.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f88327e4640 20 reqs_thread_entry: start 2024-09-14T11:17:09.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f898171f800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:09.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f898171f800 20 Filter name: none 2024-09-14T11:17:09.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.026+0000 7f87a3fff640 20 reqs_thread_entry: start 2024-09-14T11:17:09.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.027+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.027+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.027+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.028+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.028+0000 7f898171f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.028+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.028+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:09.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.028+0000 7f898171f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.028+0000 7f898171f800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:09.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.028+0000 7f898171f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:09.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.030+0000 7f88337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:09.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.032+0000 7f898171f800 20 remove_watcher() i=0 2024-09-14T11:17:09.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.032+0000 7f898171f800 2 removed watcher, disabling cache 2024-09-14T11:17:09.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.033+0000 7f898171f800 20 remove_watcher() i=1 2024-09-14T11:17:09.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.034+0000 7f898171f800 20 remove_watcher() i=2 2024-09-14T11:17:09.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.035+0000 7f898171f800 20 remove_watcher() i=3 2024-09-14T11:17:09.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.037+0000 7f898171f800 20 remove_watcher() i=4 2024-09-14T11:17:09.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.038+0000 7f898171f800 20 remove_watcher() i=5 2024-09-14T11:17:09.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.038+0000 7f898171f800 20 remove_watcher() i=6 2024-09-14T11:17:09.038 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.039+0000 7f898171f800 20 remove_watcher() i=7 2024-09-14T11:17:09.049 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.049 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:09.049 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-logrecord-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.35 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:17:09.049 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.051 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.051 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.055 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.055 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.097 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.098 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.112 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-14T11:17:09.113 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.114 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.114 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.124 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.124 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.167 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.167 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.175 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.175 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.183 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.183 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.191 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.192 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.199 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.199 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.206 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.206 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.214 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.214 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.221 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.221 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.228 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.228 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.235 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.236 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.243 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.243 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.250 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.250 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.257 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.258 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.265 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.265 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.272 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.272 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.279 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.279 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.286 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.286 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.293 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.293 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.301 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.301 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.308 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:09.308 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:09.316 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:17:09.345 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:09.345 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:09.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.387+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 20 realm 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.389+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.390+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:09.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.390+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.391+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:09.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.391+0000 7f1037325800 20 searching for the correct realm 2024-09-14T11:17:09.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.394+0000 7f1033734640 0 -- 172.21.15.2:0/2788565546 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f1028071e40 msgr2=0x7f102807e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:09.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.600+0000 7f1032f33640 0 -- 172.21.15.2:0/2788565546 >> [v2:172.21.15.86:6810/3386010674,v1:172.21.15.86:6811/3386010674] conn(0x5622273cbf90 msgr2=0x5622273ce380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.602+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:09.602 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 zone default found 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 4 Realm: () 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 zonegroup default 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.603+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.604+0000 7f1037325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.604+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.604+0000 7f1037325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.604+0000 7f1037325800 20 started sync module instance, tier type = 2024-09-14T11:17:09.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.604+0000 7f1037325800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.613+0000 7f1037325800 20 add_watcher() i=0 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.613+0000 7f1037325800 20 add_watcher() i=1 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.613+0000 7f1037325800 20 add_watcher() i=2 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.613+0000 7f1037325800 20 add_watcher() i=3 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.613+0000 7f1037325800 20 add_watcher() i=4 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.613+0000 7f1037325800 20 add_watcher() i=5 2024-09-14T11:17:09.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.613+0000 7f1037325800 20 add_watcher() i=6 2024-09-14T11:17:09.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.614+0000 7f1037325800 20 add_watcher() i=7 2024-09-14T11:17:09.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.614+0000 7f1037325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.615+0000 7f0ee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f1037325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f1037325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f1037325800 5 note: GC not initialized 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f0e63fff640 20 reqs_thread_entry: start 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f1037325800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:09.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f1037325800 20 Filter name: none 2024-09-14T11:17:09.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f0e61ffb640 20 reqs_thread_entry: start 2024-09-14T11:17:09.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.616+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.617+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:09.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.617+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.617+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:09.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.617+0000 7f1037325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:09.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.617+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.618+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:09.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.618+0000 7f1037325800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.618+0000 7f1037325800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:09.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.618+0000 7f1037325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:09.617 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.619+0000 7f0ee97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:09.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.621+0000 7f1037325800 20 remove_watcher() i=0 2024-09-14T11:17:09.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.621+0000 7f1037325800 2 removed watcher, disabling cache 2024-09-14T11:17:09.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.622+0000 7f1037325800 20 remove_watcher() i=1 2024-09-14T11:17:09.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.623+0000 7f1037325800 20 remove_watcher() i=2 2024-09-14T11:17:09.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.624+0000 7f1037325800 20 remove_watcher() i=3 2024-09-14T11:17:09.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.625+0000 7f1037325800 20 remove_watcher() i=4 2024-09-14T11:17:09.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.626+0000 7f1037325800 20 remove_watcher() i=5 2024-09-14T11:17:09.625 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.627+0000 7f1037325800 20 remove_watcher() i=6 2024-09-14T11:17:09.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.628+0000 7f1037325800 20 remove_watcher() i=7 2024-09-14T11:17:09.637 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.637 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:09.637 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-logrecord-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:09.638 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.639 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:17:09.674 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:09.674 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:09.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.715+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 20 realm 2024-09-14T11:17:09.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:09.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:09.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:09.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.718+0000 7f146d12c800 20 searching for the correct realm 2024-09-14T11:17:09.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.721+0000 7f1463fff640 0 -- 172.21.15.2:0/3016551329 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f145c082070 msgr2=0x7f145c08b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:09.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.725+0000 7f1468e4f640 0 -- 172.21.15.2:0/3016551329 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1454077820 msgr2=0x7f1454071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:09.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:09.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:09.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.931+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:09.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 zone default found 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 4 Realm: () 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 zonegroup default 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.932 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:09.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.933+0000 7f146d12c800 20 started sync module instance, tier type = 2024-09-14T11:17:09.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.933+0000 7f146d12c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:09.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=0 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=1 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=2 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=3 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=4 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=5 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=6 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.943+0000 7f146d12c800 20 add_watcher() i=7 2024-09-14T11:17:09.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.943+0000 7f146d12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.945+0000 7f131f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.945+0000 7f146d12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.945+0000 7f146d12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:09.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.945+0000 7f146d12c800 5 note: GC not initialized 2024-09-14T11:17:09.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.945+0000 7f131e7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:09.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.945+0000 7f146d12c800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 20 Filter name: none 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f1317fff640 20 reqs_thread_entry: start 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 : miss 2024-09-14T11:17:09.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:09.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.947+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:09.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.947+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:09.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.947+0000 7f146d12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:09.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.947+0000 7f146d12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:09.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.947+0000 7f146d12c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:09.946 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.947+0000 7f146d12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.950+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.950+0000 7f146d12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.950+0000 7f146d12c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.950+0000 7f146d12c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36, ofs0, ns] 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.950+0000 7f133ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94110352063728 notifier 7304 bl.length()=923 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:09.949 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:09.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_sources= new_sources= 2024-09-14T11:17:09.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential sources added=[] removed=[] 2024-09-14T11:17:09.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_dests= new_dests= 2024-09-14T11:17:09.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential dests added=[] removed=[] 2024-09-14T11:17:09.950 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f146d12c800 time 2024-09-14T11:17:09.953483+0000 2024-09-14T11:17:09.950 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:09.951 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:09.951 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f146e98c76a] 2024-09-14T11:17:09.951 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f146d12c800 thread_name:radosgw-admin 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.953+0000 7f146d12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f146d12c800 time 2024-09-14T11:17:09.953483+0000 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.952 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f146e98c76a] 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:09.953 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f146d63e6f0] 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f146d68b99c] 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f146e98c7c4] 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:09.967 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:09.954+0000 7f146d12c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f146d12c800 thread_name:radosgw-admin 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f146d63e6f0] 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f146d68b99c] 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f146e98c7c4] 2024-09-14T11:17:09.968 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:17:09.697+0000 7f146d12c800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:17:09.697+0000 7f146d12c800 4 set_mon_vals no callback set 2024-09-14T11:17:09.969 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:17:09.698+0000 7f146d12c800 10 monclient: shutdown 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 asok(0x5597c5e91270) unregister_commands rotate-key 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:17:09.698+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:17:09.698+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:17:09.698+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding auth protocol: cephx 2024-09-14T11:17:09.970 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding auth protocol: cephx 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding auth protocol: cephx 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:17:09.699+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.971 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: starting msgr at 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: starting objecter 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command objecter_requests hook 0x5597c60e3400 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: setting wanted keys 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: calling monclient init 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding auth protocol: cephx 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding auth protocol: cephx 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding auth protocol: cephx 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:09.972 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:17:09.699+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:17:09.699+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key hook 0x5597c60b13c8 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c5f29ab0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c5ff3a50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:09.973 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c5ff7aa0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.251963s 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c5ff7aa0 auth_method 0 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c5f29ab0 auth_method 0 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:09.974 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c5ff3a50 auth_method 0 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_done global_id 7656 payload 824 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient: _finish_hunting 0 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:17:09.700+0000 7f1468e4f640 1 monclient: found mon.noname-a 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:09.975 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: dump: 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: _finish_auth 0 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: _check_auth_tickets 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:09.976 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: dump: 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:17:09.700+0000 7f146d12c800 5 monclient: authenticate success, global_id 7656 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:09.977 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:17:09.700+0000 7f1356e05640 4 set_mon_vals no callback set 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:17:09.700+0000 7f146d12c800 1 librados: init done 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:17:09.702+0000 7f1355602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:17:09.702+0000 7f1355602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:17:09.702+0000 7f1355602640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:17:09.703+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f1350077230 auth_method 0 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:17:09.703+0000 7f1469650640 10 monclient: get_auth_request con 0x5597c60f9cf0 auth_method 0 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:17:09.704+0000 7f1468e4f640 10 monclient: get_auth_request con 0x5597c60fced0 auth_method 0 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:17:09.705+0000 7f1463fff640 10 monclient: get_auth_request con 0x5597c6101f60 auth_method 0 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:17:09.705+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:17:09.705+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:17:09.705+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:09.978 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding auth protocol: cephx 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding auth protocol: cephx 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding auth protocol: cephx 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:09.979 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:17:09.706+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command objecter_requests cmddesc objecter_requests hook 0x5597c6109290 EEXIST 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:17:09.706+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:09.980 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding auth protocol: cephx 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding auth protocol: cephx 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding auth protocol: cephx 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:09.981 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:17:09.706+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:17:09.706+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key cmddesc rotate-key hook 0x5597c6104e60 EEXIST 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:17:09.706+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c612d5b0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c612d990 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c612c2c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.982 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.259059s 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c612d5b0 auth_method 0 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c612d990 auth_method 0 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:09.983 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c612c2c0 auth_method 0 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_done global_id 7659 payload 824 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient: _finish_hunting 0 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:17:09.707+0000 7f1468e4f640 1 monclient: found mon.noname-a 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: dump: 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:09.984 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: dump: 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:09.985 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:17:09.707+0000 7f146d12c800 5 monclient: authenticate success, global_id 7659 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:17:09.707+0000 7f1469e51640 4 set_mon_vals no callback set 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:09.986 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:17:09.709+0000 7f134e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:17:09.709+0000 7f134e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:17:09.709+0000 7f134e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:17:09.709+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f1340077140 auth_method 0 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:17:09.709+0000 7f146d12c800 10 monclient: get_monmap_and_config 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:17:09.709+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:17:09.709+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:17:09.709+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:09.987 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding auth protocol: cephx 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding auth protocol: cephx 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding auth protocol: cephx 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:09.988 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:17:09.710+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding auth protocol: cephx 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding auth protocol: cephx 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding auth protocol: cephx 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:09.989 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:17:09.710+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:17:09.710+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key cmddesc rotate-key hook 0x7ffc2fc24eb8 EEXIST 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:17:09.990 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c61515d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c617c040 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c617d3f0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.262775s 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c617c040 auth_method 0 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c61515d0 auth_method 0 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.991 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c617d3f0 auth_method 0 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:09.992 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:17:09.711+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:17:09.711+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:17:09.711+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:17:09.711+0000 7f1463fff640 10 monclient(hunting): handle_auth_done global_id 7301 payload 274 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:17:09.711+0000 7f1463fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:17:09.711+0000 7f1463fff640 1 monclient: found mon.noname-c 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:17:09.711+0000 7f1463fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: dump: 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:09.993 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: _finish_auth 0 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:09.994 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: dump: 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:17:09.711+0000 7f146d12c800 5 monclient: authenticate success, global_id 7301 2024-09-14T11:17:09.995 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:17:09.711+0000 7f146d12c800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:17:09.711+0000 7f146d12c800 4 set_mon_vals no callback set 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:17:09.711+0000 7f146d12c800 10 monclient: shutdown 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:17:09.712+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:17:09.712+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:09.996 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding auth protocol: cephx 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding auth protocol: cephx 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding auth protocol: cephx 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:09.997 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:17:09.712+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: starting msgr at 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: starting objecter 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command objecter_requests cmddesc objecter_requests hook 0x5597c614ff40 EEXIST 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: setting wanted keys 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: calling monclient init 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:17:09.712+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding auth protocol: cephx 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding auth protocol: cephx 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding auth protocol: cephx 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:09.998 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:17:09.712+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:17:09.712+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:17:09.713+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key cmddesc rotate-key hook 0x5597c6141fb8 EEXIST 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c61515d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:09.999 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c617d3f0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c617a2b0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.265111s 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c61515d0 auth_method 0 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c617d3f0 auth_method 0 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.000 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c617a2b0 auth_method 0 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.001 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_done global_id 7304 payload 824 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:17:09.713+0000 7f1463fff640 1 monclient: found mon.noname-c 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: dump: 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.002 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: dump: 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.003 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:17:09.713+0000 7f146d12c800 5 monclient: authenticate success, global_id 7304 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:17:09.713+0000 7f133ffff640 4 set_mon_vals no callback set 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:17:09.713+0000 7f146d12c800 1 librados: init done 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:17:09.713+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cr dump hook 0x5597c617a988 2024-09-14T11:17:10.004 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:17:09.715+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:17:09.716+0000 7f133e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:17:09.716+0000 7f133e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:17:09.716+0000 7f133e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:17:09.716+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1334077230 auth_method 0 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:17:09.716+0000 7f1469650640 10 monclient: get_auth_request con 0x5597c619c350 auth_method 0 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 realm 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:17:09.717+0000 7f146d12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.005 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:17:09.718+0000 7f1468e4f640 10 monclient: get_auth_request con 0x5597c61a0580 auth_method 0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 searching for the correct realm 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:17:09.719+0000 7f1463fff640 10 monclient: get_auth_request con 0x5597c61a5850 auth_method 0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:17:09.719+0000 7f1469650640 10 monclient: get_auth_request con 0x7f1454039070 auth_method 0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:17:09.720+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1464069040 auth_method 0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:17:09.721+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f145c082070 auth_method 0 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:17:09.721+0000 7f1463fff640 0 -- 172.21.15.2:0/3016551329 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f145c082070 msgr2=0x7f145c08b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:17:09.721+0000 7f133e7fc640 1 client.7304.objecter ms_handle_reset 0x7f145c082070 session 0x7f145c091070 osd.4 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:17:09.721+0000 7f133e7fc640 10 monclient: _renew_subs 2024-09-14T11:17:10.006 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:17:09.721+0000 7f133e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:17:09.721+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f13340870d0 auth_method 0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:17:09.722+0000 7f1469650640 10 monclient: get_auth_request con 0x7f145406e630 auth_method 0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:17:09.725+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1454077820 auth_method 0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:17:09.725+0000 7f1468e4f640 0 -- 172.21.15.2:0/3016551329 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1454077820 msgr2=0x7f1454071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:17:09.926+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1454077820 auth_method 0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.007 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 zone default found 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:17:09.932+0000 7f146d12c800 4 Realm: () 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:17:09.932+0000 7f146d12c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:17:09.932+0000 7f146d12c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:17:09.932+0000 7f146d12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 zonegroup default 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.008 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 started sync module instance, tier type = 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=0 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=1 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=2 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=3 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=4 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=5 2024-09-14T11:17:10.009 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=6 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:17:09.943+0000 7f146d12c800 20 add_watcher() i=7 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:17:09.943+0000 7f146d12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding auth protocol: cephx 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding auth protocol: cephx 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding auth protocol: cephx 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.010 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:17:09.945+0000 7f131f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:17:09.945+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:17:09.945+0000 7f146d12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:17:09.945+0000 7f146d12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache list hook 0x5597c617a060 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache inspect hook 0x5597c617a060 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache erase hook 0x5597c617a060 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache zap hook 0x5597c617a060 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 note: GC not initialized 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:17:09.945+0000 7f131e7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace show hook 0x7f14540165f0 2024-09-14T11:17:10.011 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace history hook 0x7f14540165f0 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace active hook 0x7f14540165f0 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace active_short hook 0x7f14540165f0 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:17:09.945+0000 7f146d12c800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 Filter name: none 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:17:09.946+0000 7f1317fff640 20 reqs_thread_entry: start 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 : miss 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.012 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:17:09.947+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36, ofs0, ns] 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:17:09.950+0000 7f133ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94110352063728 notifier 7304 bl.length()=923 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:10.013 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_sources= new_sources= 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential sources added=[] removed=[] 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_dests= new_dests= 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential dests added=[] removed=[] 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:17:09.953+0000 7f146d12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f146d12c800 time 2024-09-14T11:17:09.953483+0000 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f146e98c76a] 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:10.014 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:17:09.954+0000 7f146d12c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f146d12c800 thread_name:radosgw-admin 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f146d63e6f0] 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f146d68b99c] 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f146e98c7c4] 2024-09-14T11:17:10.015 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:17:10.016 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:17:10.017 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:17:10.018 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:10.019 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:17:10.020 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:10.021 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:10.022 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1317fff640 / http_manager 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f131e7e4640 / http_manager 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f131f7e6640 / rgw_dt_lg_renew 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f133e7fc640 / ms_dispatch 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f133ffff640 / io_context_pool 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f134e7fc640 / ms_dispatch 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1355602640 / ms_dispatch 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1356e05640 / io_context_pool 2024-09-14T11:17:10.023 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1463fff640 / msgr-worker-2 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1468e4f640 / msgr-worker-1 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1469650640 / msgr-worker-0 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1469e51640 / io_context_pool 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: 7f146d12c800 / radosgw-admin 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.132653.log 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:17:09.697+0000 7f146d12c800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:17:09.697+0000 7f146d12c800 4 set_mon_vals no callback set 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:17:09.698+0000 7f146d12c800 10 monclient: shutdown 2024-09-14T11:17:10.024 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 asok(0x5597c5e91270) unregister_commands rotate-key 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:17:09.698+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:17:09.698+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:17:09.698+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:10.025 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding auth protocol: cephx 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding auth protocol: cephx 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding auth protocol: cephx 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: crc 2024-09-14T11:17:10.026 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:17:09.698+0000 7f146d12c800 5 AuthRegistry(0x5597c60b6f10) adding con mode: secure 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:17:09.699+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: starting msgr at 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: starting objecter 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command objecter_requests hook 0x5597c60e3400 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: setting wanted keys 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:17:09.699+0000 7f146d12c800 1 librados: calling monclient init 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding auth protocol: cephx 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding auth protocol: cephx 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding auth protocol: cephx 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:10.027 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: crc 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 AuthRegistry(0x5597c60b1280) adding con mode: secure 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:17:09.699+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:17:09.699+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:17:09.699+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key hook 0x5597c60b13c8 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:17:10.028 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c5f29ab0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c5ff3a50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c5ff7aa0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:17:09.699+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.251963s 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c5ff7aa0 auth_method 0 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c5f29ab0 auth_method 0 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.029 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:17:09.700+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c5ff3a50 auth_method 0 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:17:09.700+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient(hunting): handle_auth_done global_id 7656 payload 824 2024-09-14T11:17:10.030 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient: _finish_hunting 0 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:17:09.700+0000 7f1468e4f640 1 monclient: found mon.noname-a 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:17:09.700+0000 7f1468e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: dump: 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.031 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: _finish_auth 0 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: _check_auth_tickets 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:17:09.700+0000 7f1355602640 10 monclient: dump: 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.032 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:17:09.700+0000 7f146d12c800 5 monclient: authenticate success, global_id 7656 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:17:09.700+0000 7f1356e05640 4 set_mon_vals no callback set 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:17:09.700+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:17:09.700+0000 7f146d12c800 1 librados: init done 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:17:09.702+0000 7f1355602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:17:09.702+0000 7f1355602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:17:09.702+0000 7f1355602640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.033 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:17:09.703+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f1350077230 auth_method 0 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:17:09.703+0000 7f1469650640 10 monclient: get_auth_request con 0x5597c60f9cf0 auth_method 0 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:17:09.704+0000 7f1468e4f640 10 monclient: get_auth_request con 0x5597c60fced0 auth_method 0 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:17:09.705+0000 7f1463fff640 10 monclient: get_auth_request con 0x5597c6101f60 auth_method 0 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:17:09.705+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:17:09.705+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:17:09.705+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.034 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding auth protocol: cephx 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding auth protocol: cephx 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding auth protocol: cephx 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:10.035 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: crc 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:17:09.705+0000 7f146d12c800 5 AuthRegistry(0x5597c6105d60) adding con mode: secure 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:17:09.706+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command objecter_requests cmddesc objecter_requests hook 0x5597c6109290 EEXIST 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:17:09.706+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding auth protocol: cephx 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding auth protocol: cephx 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding auth protocol: cephx 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:10.036 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: crc 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 AuthRegistry(0x5597c6104d18) adding con mode: secure 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:17:09.706+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:17:09.706+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:17:09.706+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key cmddesc rotate-key hook 0x5597c6104e60 EEXIST 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:17:09.706+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c612d5b0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c612d990 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:10.037 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c612c2c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.259059s 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c612d5b0 auth_method 0 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c612d990 auth_method 0 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.038 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:17:09.707+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c612c2c0 auth_method 0 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:17:09.707+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient(hunting): handle_auth_done global_id 7659 payload 824 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient: _finish_hunting 0 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:17:09.707+0000 7f1468e4f640 1 monclient: found mon.noname-a 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:17:09.707+0000 7f1468e4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:10.039 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: dump: 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:10.040 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:17:09.707+0000 7f134e7fc640 10 monclient: dump: 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:17:09.707+0000 7f146d12c800 5 monclient: authenticate success, global_id 7659 2024-09-14T11:17:10.041 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:17:09.707+0000 7f1469e51640 4 set_mon_vals no callback set 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:17:09.707+0000 7f146d12c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:17:09.709+0000 7f134e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:17:09.709+0000 7f134e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:17:09.709+0000 7f134e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:17:09.709+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f1340077140 auth_method 0 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:17:09.709+0000 7f146d12c800 10 monclient: get_monmap_and_config 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:17:09.709+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:17:09.709+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:17:09.709+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:10.042 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding auth protocol: cephx 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding auth protocol: cephx 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding auth protocol: cephx 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:10.043 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: crc 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:17:09.709+0000 7f146d12c800 5 AuthRegistry(0x5597c614d440) adding con mode: secure 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:17:09.710+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding auth protocol: cephx 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding auth protocol: cephx 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding auth protocol: cephx 2024-09-14T11:17:10.044 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: crc 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc24d70) adding con mode: secure 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:17:09.710+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:17:09.710+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.045 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:17:09.710+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key cmddesc rotate-key hook 0x7ffc2fc24eb8 EEXIST 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c61515d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c617c040 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c617d3f0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:17:09.710+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.262775s 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c617c040 auth_method 0 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.046 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c61515d0 auth_method 0 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c617d3f0 auth_method 0 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:17:09.710+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:17:09.710+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:17:09.710+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.047 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:17:09.711+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:17:09.711+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:17:09.711+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:17:09.711+0000 7f1463fff640 10 monclient(hunting): handle_auth_done global_id 7301 payload 274 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:17:09.711+0000 7f1463fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:17:09.711+0000 7f1463fff640 1 monclient: found mon.noname-c 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:17:09.711+0000 7f1463fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: dump: 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.048 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: _finish_auth 0 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:17:09.711+0000 7f133ffff640 10 monclient: dump: 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.049 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:17:09.711+0000 7f146d12c800 5 monclient: authenticate success, global_id 7301 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:17:09.711+0000 7f146d12c800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:17:09.711+0000 7f146d12c800 4 set_mon_vals no callback set 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:17:09.711+0000 7f146d12c800 10 monclient: shutdown 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:17:09.712+0000 7f146d12c800 10 monclient: build_initial_monmap 2024-09-14T11:17:10.050 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 build_initial for_mkfs: 0 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:17:09.712+0000 7f146d12c800 10 monclient: monmap: 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding auth protocol: cephx 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding auth protocol: cephx 2024-09-14T11:17:10.051 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding auth protocol: cephx 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: crc 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c61521b0) adding con mode: secure 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:17:09.712+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.052 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: starting msgr at 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: starting objecter 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command objecter_requests cmddesc objecter_requests hook 0x5597c614ff40 EEXIST 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: setting wanted keys 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:17:09.712+0000 7f146d12c800 1 librados: calling monclient init 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:17:09.712+0000 7f146d12c800 10 monclient: init 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding auth protocol: cephx 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding auth protocol: cephx 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding auth protocol: cephx 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:10.053 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: crc 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:17:09.712+0000 7f146d12c800 5 AuthRegistry(0x5597c6141e70) adding con mode: secure 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:17:09.712+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:17:09.712+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:17:09.713+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command rotate-key cmddesc rotate-key hook 0x5597c6141fb8 EEXIST 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-a con 0x5597c61515d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-c con 0x5597c617d3f0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:10.054 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): picked mon.noname-b con 0x5597c617a2b0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient(hunting): authenticate will time out at 2056.265111s 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): get_auth_request con 0x5597c61515d0 auth_method 0 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): get_auth_request con 0x5597c617d3f0 auth_method 0 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.055 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:17:09.713+0000 7f1468e4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): get_auth_request con 0x5597c617a2b0 auth_method 0 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:17:09.713+0000 7f1469650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient(hunting): handle_auth_done global_id 7304 payload 824 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient: _finish_hunting 0 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:17:09.713+0000 7f1463fff640 1 monclient: found mon.noname-c 2024-09-14T11:17:10.056 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:17:09.713+0000 7f1463fff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: dump: 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.057 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: _finish_auth 0 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:17:09.713+0000 7f133e7fc640 10 monclient: dump: 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:10.058 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:17:09.713+0000 7f146d12c800 5 monclient: authenticate success, global_id 7304 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:17:09.713+0000 7f133ffff640 4 set_mon_vals no callback set 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _renew_subs 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:17:09.713+0000 7f146d12c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:17:09.713+0000 7f146d12c800 1 librados: init done 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:17:09.713+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cr dump hook 0x5597c617a988 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:17:09.715+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:17:09.716+0000 7f133e7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:17:09.716+0000 7f133e7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:17:09.716+0000 7f133e7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:10.059 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:17:09.716+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1334077230 auth_method 0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:17:09.716+0000 7f1469650640 10 monclient: get_auth_request con 0x5597c619c350 auth_method 0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 realm 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:17:09.717+0000 7f146d12c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:17:09.717+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:17:09.718+0000 7f1468e4f640 10 monclient: get_auth_request con 0x5597c61a0580 auth_method 0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:10.060 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:17:09.718+0000 7f146d12c800 20 searching for the correct realm 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:17:09.719+0000 7f1463fff640 10 monclient: get_auth_request con 0x5597c61a5850 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:17:09.719+0000 7f1469650640 10 monclient: get_auth_request con 0x7f1454039070 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:17:09.720+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1464069040 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:17:09.721+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f145c082070 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:17:09.721+0000 7f1463fff640 0 -- 172.21.15.2:0/3016551329 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f145c082070 msgr2=0x7f145c08b6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:17:09.721+0000 7f133e7fc640 1 client.7304.objecter ms_handle_reset 0x7f145c082070 session 0x7f145c091070 osd.4 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:17:09.721+0000 7f133e7fc640 10 monclient: _renew_subs 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:17:09.721+0000 7f133e7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:17:09.721+0000 7f1463fff640 10 monclient: get_auth_request con 0x7f13340870d0 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:17:09.722+0000 7f1469650640 10 monclient: get_auth_request con 0x7f145406e630 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:17:09.725+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1454077820 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:17:09.725+0000 7f1468e4f640 0 -- 172.21.15.2:0/3016551329 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1454077820 msgr2=0x7f1454071660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:17:09.926+0000 7f1468e4f640 10 monclient: get_auth_request con 0x7f1454077820 auth_method 0 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:10.061 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:17:09.931+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 zone default found 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:17:09.932+0000 7f146d12c800 4 Realm: () 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:17:09.932+0000 7f146d12c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:10.062 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:17:09.932+0000 7f146d12c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:17:09.932+0000 7f146d12c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 zonegroup default 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:17:09.932+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 started sync module instance, tier type = 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:17:09.933+0000 7f146d12c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=0 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=1 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=2 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=3 2024-09-14T11:17:10.063 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=4 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=5 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:17:09.942+0000 7f146d12c800 20 add_watcher() i=6 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:17:09.943+0000 7f146d12c800 20 add_watcher() i=7 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:17:09.943+0000 7f146d12c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding auth protocol: cephx 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding auth protocol: cephx 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding auth protocol: cephx 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.064 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: crc 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 AuthRegistry(0x7ffc2fc25250) adding con mode: secure 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:17:09.945+0000 7f131f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:17:09.945+0000 7f146d12c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:17:09.945+0000 7f146d12c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:17:09.945+0000 7f146d12c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache list hook 0x5597c617a060 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache inspect hook 0x5597c617a060 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache erase hook 0x5597c617a060 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command cache zap hook 0x5597c617a060 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 note: GC not initialized 2024-09-14T11:17:10.065 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:17:09.945+0000 7f131e7e4640 20 reqs_thread_entry: start 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace show hook 0x7f14540165f0 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace history hook 0x7f14540165f0 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace active hook 0x7f14540165f0 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:17:09.945+0000 7f146d12c800 5 asok(0x5597c5e91270) register_command sync trace active_short hook 0x7f14540165f0 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:17:09.945+0000 7f146d12c800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 Filter name: none 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:17:09.946+0000 7f1317fff640 20 reqs_thread_entry: start 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:17:09.946+0000 7f146d12c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 : miss 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:17:09.946+0000 7f146d12c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.066 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:17:09.947+0000 7f146d12c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:17:09.947+0000 7f146d12c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:17:09.950+0000 7f146d12c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36, ofs0, ns] 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:17:09.950+0000 7f133ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464278 cookie 94110352063728 notifier 7304 bl.length()=923 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:17:09.951+0000 7f133ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:10.067 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_sources= new_sources= 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential sources added=[] removed=[] 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_dests= new_dests= 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:17:09.951+0000 7f146d12c800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential dests added=[] removed=[] 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:17:09.953+0000 7f146d12c800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f146d12c800 time 2024-09-14T11:17:09.953483+0000 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f146e98c76a] 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:10.068 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:17:09.954+0000 7f146d12c800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f146d12c800 thread_name:radosgw-admin 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f146d63e6f0] 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f146d68b99c] 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f146e98c7c4] 2024-09-14T11:17:10.069 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f146e98c928] 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5597c47e50b1] 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x5597c4cf907c] 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5597c47f4efd] 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f146d629590] 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:17:10.070 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:10.071 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:17:10.072 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:17:10.073 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:17:10.074 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:17:10.075 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1317fff640 / http_manager 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 7f131e7e4640 / http_manager 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 7f131f7e6640 / rgw_dt_lg_renew 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 7f133e7fc640 / ms_dispatch 2024-09-14T11:17:10.076 INFO:tasks.workunit.client.0.smithi002.stderr: 7f133ffff640 / io_context_pool 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f134e7fc640 / ms_dispatch 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1355602640 / ms_dispatch 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1356e05640 / io_context_pool 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1463fff640 / msgr-worker-2 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1468e4f640 / msgr-worker-1 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1469650640 / msgr-worker-0 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f1469e51640 / io_context_pool 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: 7f146d12c800 / radosgw-admin 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:17:09.955143Z_aedc9ab7-b0c0-4eef-8523-1f22c8049345/log 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:17:10.077 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.032+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.034+0000 7fb5d9d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.034+0000 7fb5d9d75800 20 realm 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.034+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.034+0000 7fb5d9d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.034+0000 7fb5d9d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.034+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.035+0000 7fb5d9d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.035+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.035+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.035+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.036+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.036+0000 7fb5d9d75800 20 searching for the correct realm 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.039+0000 7fb5d705e640 0 -- 172.21.15.2:0/2441878802 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x5633e05febb0 msgr2=0x5633e0600fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.042+0000 7fb5d785f640 0 -- 172.21.15.2:0/2441878802 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fb5cc08a750 msgr2=0x7fb5cc06de20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:10.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.047+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 zone default found 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 4 Realm: () 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 zonegroup default 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.084 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.048+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.049+0000 7fb5d9d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.049+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.049+0000 7fb5d9d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.049+0000 7fb5d9d75800 20 started sync module instance, tier type = 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.049+0000 7fb5d9d75800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.057+0000 7fb5d9d75800 20 add_watcher() i=0 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.057+0000 7fb5d9d75800 20 add_watcher() i=1 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.057+0000 7fb5d9d75800 20 add_watcher() i=2 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.057+0000 7fb5d9d75800 20 add_watcher() i=3 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.057+0000 7fb5d9d75800 20 add_watcher() i=4 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.057+0000 7fb5d9d75800 20 add_watcher() i=5 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.057+0000 7fb5d9d75800 20 add_watcher() i=6 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.058+0000 7fb5d9d75800 20 add_watcher() i=7 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.058+0000 7fb5d9d75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:10.085 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.060+0000 7fb48dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.060+0000 7fb5d9d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.060+0000 7fb5d9d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.060+0000 7fb5d9d75800 5 note: GC not initialized 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.060+0000 7fb48cfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.060+0000 7fb5d9d75800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.061+0000 7fb5d9d75800 20 Filter name: none 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.061+0000 7fb4067fc640 20 reqs_thread_entry: start 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.061+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.061+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.061+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.062+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.062+0000 7fb5d9d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.062+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.062+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:10.086 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.062+0000 7fb5d9d75800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.063+0000 7fb5d9d75800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.063+0000 7fb5d9d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.064+0000 7fb48dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.066+0000 7fb5d9d75800 20 remove_watcher() i=0 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.066+0000 7fb5d9d75800 2 removed watcher, disabling cache 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.067+0000 7fb5d9d75800 20 remove_watcher() i=1 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.068+0000 7fb5d9d75800 20 remove_watcher() i=2 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.069+0000 7fb5d9d75800 20 remove_watcher() i=3 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.070+0000 7fb5d9d75800 20 remove_watcher() i=4 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.071+0000 7fb5d9d75800 20 remove_watcher() i=5 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.071+0000 7fb5d9d75800 20 remove_watcher() i=6 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.072+0000 7fb5d9d75800 20 remove_watcher() i=7 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.087 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:10.088 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-logrecord-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:10.088 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:10.088 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:10.088 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:10.091 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:10.091 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:10.134 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:10.166 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:10.166 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:10.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.207+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 20 realm 2024-09-14T11:17:10.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:10.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.209+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.210+0000 7f729e720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.210+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.210+0000 7f729e720800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:10.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.210+0000 7f729e720800 20 searching for the correct realm 2024-09-14T11:17:10.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.213+0000 7f729ab03640 0 -- 172.21.15.2:0/3990404129 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f729001e030 msgr2=0x7f729004fa90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:10.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.217+0000 7f729a302640 0 -- 172.21.15.2:0/3990404129 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f7290099b20 msgr2=0x7f72900780e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:10.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:10.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:10.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:10.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:10.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:10.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:10.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.423+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 zone default found 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 4 Realm: () 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:10.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 zonegroup default 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.424+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.425+0000 7f729e720800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.425+0000 7f729e720800 20 started sync module instance, tier type = 2024-09-14T11:17:10.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.425+0000 7f729e720800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.433+0000 7f729e720800 20 add_watcher() i=0 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.433+0000 7f729e720800 20 add_watcher() i=1 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.433+0000 7f729e720800 20 add_watcher() i=2 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.433+0000 7f729e720800 20 add_watcher() i=3 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.433+0000 7f729e720800 20 add_watcher() i=4 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.433+0000 7f729e720800 20 add_watcher() i=5 2024-09-14T11:17:10.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.433+0000 7f729e720800 20 add_watcher() i=6 2024-09-14T11:17:10.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.434+0000 7f729e720800 20 add_watcher() i=7 2024-09-14T11:17:10.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.434+0000 7f729e720800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:10.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.436+0000 7f7150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.436+0000 7f729e720800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.436+0000 7f729e720800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.436+0000 7f729e720800 5 note: GC not initialized 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f70cb7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:10.435 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 20 Filter name: none 2024-09-14T11:17:10.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f70c97fa640 20 reqs_thread_entry: start 2024-09-14T11:17:10.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:17:10.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:10.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:17:10.436 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 : miss 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.437+0000 7f729e720800 20 rados->read ofs=0 len=0 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.438+0000 7f729e720800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.438+0000 7f729e720800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.438+0000 7f729e720800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.438+0000 7f729e720800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.438+0000 7f729e720800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.438+0000 7f729e720800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 2024-09-14T11:17:10.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.439+0000 7f729e720800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to be held by another RGW process; skipping for now 2024-09-14T11:17:10.438 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.440+0000 7f7150fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:10.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.442+0000 7f729e720800 20 remove_watcher() i=0 2024-09-14T11:17:10.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.442+0000 7f729e720800 2 removed watcher, disabling cache 2024-09-14T11:17:10.441 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.443+0000 7f729e720800 20 remove_watcher() i=1 2024-09-14T11:17:10.442 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.444+0000 7f729e720800 20 remove_watcher() i=2 2024-09-14T11:17:10.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.445+0000 7f729e720800 20 remove_watcher() i=3 2024-09-14T11:17:10.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.446+0000 7f729e720800 20 remove_watcher() i=4 2024-09-14T11:17:10.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.447+0000 7f729e720800 20 remove_watcher() i=5 2024-09-14T11:17:10.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.448+0000 7f729e720800 20 remove_watcher() i=6 2024-09-14T11:17:10.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:10.449+0000 7f729e720800 20 remove_watcher() i=7 2024-09-14T11:17:10.458 INFO:tasks.workunit.client.0.smithi002.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:17:40.488 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:40.526 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:40.526 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:40.572 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.573+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.575+0000 7f2295925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.575+0000 7f2295925800 20 realm 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.575+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.576+0000 7f2295925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.576+0000 7f2295925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.576+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.576+0000 7f2295925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.576+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.577+0000 7f2295925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:40.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.577+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.577+0000 7f2295925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:40.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.577+0000 7f2295925800 20 searching for the correct realm 2024-09-14T11:17:40.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.580+0000 7f22915b5640 0 -- 172.21.15.2:0/988274484 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f228c01f060 msgr2=0x7f228c048ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:40.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.786+0000 7f2291db6640 0 -- 172.21.15.2:0/988274484 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f227c047020 msgr2=0x7f227c06b0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.793+0000 7f2295925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.793+0000 7f2295925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.793+0000 7f2295925800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.793+0000 7f2295925800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.793+0000 7f2295925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.793+0000 7f2295925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.793+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:40.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.793 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 zone default found 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 4 Realm: () 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 zonegroup default 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.794+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.795+0000 7f2295925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.795+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.795+0000 7f2295925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.795+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.796+0000 7f2295925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.796+0000 7f2295925800 20 started sync module instance, tier type = 2024-09-14T11:17:40.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.796+0000 7f2295925800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:40.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.806+0000 7f2295925800 20 add_watcher() i=0 2024-09-14T11:17:40.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.806+0000 7f2295925800 20 add_watcher() i=1 2024-09-14T11:17:40.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.806+0000 7f2295925800 20 add_watcher() i=2 2024-09-14T11:17:40.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.806+0000 7f2295925800 20 add_watcher() i=3 2024-09-14T11:17:40.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.806+0000 7f2295925800 20 add_watcher() i=4 2024-09-14T11:17:40.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.806+0000 7f2295925800 20 add_watcher() i=5 2024-09-14T11:17:40.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.806+0000 7f2295925800 20 add_watcher() i=6 2024-09-14T11:17:40.805 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.807+0000 7f2295925800 20 add_watcher() i=7 2024-09-14T11:17:40.805 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.807+0000 7f2295925800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.809+0000 7f21477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.809+0000 7f2295925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.809+0000 7f2295925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.809+0000 7f2295925800 5 note: GC not initialized 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.809+0000 7f21467e4640 20 reqs_thread_entry: start 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.809+0000 7f2295925800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 20 Filter name: none 2024-09-14T11:17:40.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f20b7fff640 20 reqs_thread_entry: start 2024-09-14T11:17:40.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-14T11:17:40.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 : miss 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.810+0000 7f2295925800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.811+0000 7f2295925800 20 rados_obj.operate() r=0 bl.length=447 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.811+0000 7f2295925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.811+0000 7f2295925800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.811+0000 7f2295925800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.811+0000 7f2295925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:40.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.811+0000 7f2295925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 2024-09-14T11:17:40.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.812+0000 7f2295925800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:17:40.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:40.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:40.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:40.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36, ofs0, ns] 2024-09-14T11:17:40.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2174ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464279 cookie 94584685878000 notifier 7722 bl.length()=923 2024-09-14T11:17:40.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2174ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:40.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2174ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:40.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2174ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:40.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_sources= new_sources= 2024-09-14T11:17:40.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential sources added=[] removed=[] 2024-09-14T11:17:40.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_dests= new_dests= 2024-09-14T11:17:40.818 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.818+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential dests added=[] removed=[] 2024-09-14T11:17:40.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.821+0000 7f2295925800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.36.2.0 2024-09-14T11:17:40.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.821+0000 7f2295925800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.36.2.0 2024-09-14T11:17:40.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.821+0000 7f2295925800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.36.2.1 2024-09-14T11:17:40.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.821+0000 7f2295925800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.36.2.1 2024-09-14T11:17:40.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.821+0000 7f2295925800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.36.0 2024-09-14T11:17:40.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.824+0000 7f2295925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:40.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.824+0000 7f2295925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 2024-09-14T11:17:40.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2295925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:40.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2295925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:40.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2295925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:40.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2295925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36, ofs0, ns] 2024-09-14T11:17:40.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2174ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464280 cookie 94584685878000 notifier 7722 bl.length()=923 2024-09-14T11:17:40.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2174ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:40.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2174ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:40.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.825+0000 7f2174ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:40.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.826+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_sources= new_sources= 2024-09-14T11:17:40.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.826+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential sources added=[] removed=[] 2024-09-14T11:17:40.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.826+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_dests= new_dests= 2024-09-14T11:17:40.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.826+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential dests added=[] removed=[] 2024-09-14T11:17:40.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.827+0000 7f2295925800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.36.0 2024-09-14T11:17:40.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.827+0000 7f2295925800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:40.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.827+0000 7f2295925800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 2024-09-14T11:17:40.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:40.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:40.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:40.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36, ofs0, ns] 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2174ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464281 cookie 94584685878000 notifier 7722 bl.length()=891 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2174ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 info.flags=0x17 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2174ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 to cache LRU end 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2174ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_sources= new_sources= 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential sources added=[] removed=[] 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): orig_dests= new_dests= 2024-09-14T11:17:40.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.829+0000 7f2295925800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[17edae97-cd6b-4c90-863d-862429a20cf3.4538.36]): potential dests added=[] removed=[] 2024-09-14T11:17:40.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.831+0000 7f2295925800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 1 shards to 2 shards completed successfully 2024-09-14T11:17:40.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.833+0000 7f21477e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:40.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.835+0000 7f2295925800 20 remove_watcher() i=0 2024-09-14T11:17:40.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.835+0000 7f2295925800 2 removed watcher, disabling cache 2024-09-14T11:17:40.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.837+0000 7f2295925800 20 remove_watcher() i=1 2024-09-14T11:17:40.836 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.838+0000 7f2295925800 20 remove_watcher() i=2 2024-09-14T11:17:40.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.839+0000 7f2295925800 20 remove_watcher() i=3 2024-09-14T11:17:40.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.840+0000 7f2295925800 20 remove_watcher() i=4 2024-09-14T11:17:40.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.841+0000 7f2295925800 20 remove_watcher() i=5 2024-09-14T11:17:40.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.842+0000 7f2295925800 20 remove_watcher() i=6 2024-09-14T11:17:40.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.844+0000 7f2295925800 20 remove_watcher() i=7 2024-09-14T11:17:40.856 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-14T11:17:40.886 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:40.886 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:40.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.929+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.929 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 20 realm 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.930 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.931+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.932+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:40.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.932+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.933+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:40.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.933+0000 7fc7a030c800 20 searching for the correct realm 2024-09-14T11:17:40.934 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.936+0000 7fc79d5f5640 0 -- 172.21.15.2:0/3039579786 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x559d3af3f190 msgr2=0x559d3af41600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:40.937 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.939+0000 7fc79ddf6640 0 -- 172.21.15.2:0/3039579786 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fc790021060 msgr2=0x7fc79006a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:40.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:40.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:40.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:40.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:40.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:40.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:40.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.943 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.944+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:40.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:40.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 zone default found 2024-09-14T11:17:40.944 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 4 Realm: () 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 zonegroup default 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.945+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.946+0000 7fc7a030c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.946+0000 7fc7a030c800 20 started sync module instance, tier type = 2024-09-14T11:17:40.945 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.946+0000 7fc7a030c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:40.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.955+0000 7fc7a030c800 20 add_watcher() i=0 2024-09-14T11:17:40.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.955+0000 7fc7a030c800 20 add_watcher() i=1 2024-09-14T11:17:40.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.955+0000 7fc7a030c800 20 add_watcher() i=2 2024-09-14T11:17:40.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.955+0000 7fc7a030c800 20 add_watcher() i=3 2024-09-14T11:17:40.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.955+0000 7fc7a030c800 20 add_watcher() i=4 2024-09-14T11:17:40.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.955+0000 7fc7a030c800 20 add_watcher() i=5 2024-09-14T11:17:40.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.955+0000 7fc7a030c800 20 add_watcher() i=6 2024-09-14T11:17:40.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.956+0000 7fc7a030c800 20 add_watcher() i=7 2024-09-14T11:17:40.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.956+0000 7fc7a030c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:40.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.957+0000 7fc64f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:40.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.957+0000 7fc7a030c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:40.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.957+0000 7fc7a030c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:40.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.957+0000 7fc7a030c800 5 note: GC not initialized 2024-09-14T11:17:40.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.958+0000 7fc64e7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:40.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.958+0000 7fc7a030c800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:40.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.958+0000 7fc7a030c800 20 Filter name: none 2024-09-14T11:17:40.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.958+0000 7fc5bffff640 20 reqs_thread_entry: start 2024-09-14T11:17:40.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.958+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.958+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:40.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.958+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.959+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:40.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.959+0000 7fc7a030c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:40.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.959+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.959+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=193 2024-09-14T11:17:40.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.959+0000 7fc7a030c800 20 rados->read ofs=0 len=0 2024-09-14T11:17:40.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.960+0000 7fc7a030c800 20 rados_obj.operate() r=0 bl.length=415 2024-09-14T11:17:40.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.960+0000 7fc7a030c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:40.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.961+0000 7fc64f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:40.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.963+0000 7fc7a030c800 20 remove_watcher() i=0 2024-09-14T11:17:40.962 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.963+0000 7fc7a030c800 2 removed watcher, disabling cache 2024-09-14T11:17:40.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.965+0000 7fc7a030c800 20 remove_watcher() i=1 2024-09-14T11:17:40.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.966+0000 7fc7a030c800 20 remove_watcher() i=2 2024-09-14T11:17:40.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.967+0000 7fc7a030c800 20 remove_watcher() i=3 2024-09-14T11:17:40.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.968+0000 7fc7a030c800 20 remove_watcher() i=4 2024-09-14T11:17:40.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.969+0000 7fc7a030c800 20 remove_watcher() i=5 2024-09-14T11:17:40.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.970+0000 7fc7a030c800 20 remove_watcher() i=6 2024-09-14T11:17:40.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:40.971+0000 7fc7a030c800 20 remove_watcher() i=7 2024-09-14T11:17:40.980 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:40.980 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:40.980 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-logrecord-writes id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.36 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:17:40.980 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:40.982 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:40.982 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:40.985 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:40.986 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.029 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.029 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.042 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-14T11:17:41.042 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:41.043 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.044 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.054 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.054 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.096 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.097 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.104 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.104 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.111 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.111 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.118 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.118 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.125 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.125 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.132 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.132 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.140 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.140 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.147 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.147 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.154 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.154 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.161 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.161 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.168 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.168 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.177 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.177 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.184 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.184 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.191 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.191 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.198 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.198 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.205 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.205 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.212 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.212 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.218 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.219 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.226 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.226 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.232 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:41.233 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:41.240 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:17:41.269 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:41.269 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:41.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.309+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 20 realm 2024-09-14T11:17:41.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:41.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.311+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.312+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:41.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.312+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.312+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:41.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.313+0000 7f3140b2a800 20 searching for the correct realm 2024-09-14T11:17:41.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.316+0000 7f313d018640 0 -- 172.21.15.2:0/1893940466 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f313006fac0 msgr2=0x7f3130068bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:41.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.319+0000 7f313c817640 0 -- 172.21.15.2:0/1893940466 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f31300a1850 msgr2=0x7f31300682d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:41.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.525+0000 7f3140b2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:41.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.525+0000 7f3140b2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:41.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.525+0000 7f3140b2a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:41.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.525+0000 7f3140b2a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:41.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.525+0000 7f3140b2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:41.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.525+0000 7f3140b2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:41.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.525+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.525 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:41.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:41.526 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 zone default found 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 4 Realm: () 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 zonegroup default 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.526+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.527+0000 7f3140b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.527+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.527+0000 7f3140b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.527+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.527 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.527+0000 7f3140b2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.527+0000 7f3140b2a800 20 started sync module instance, tier type = 2024-09-14T11:17:41.528 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.527+0000 7f3140b2a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:41.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.536+0000 7f3140b2a800 20 add_watcher() i=0 2024-09-14T11:17:41.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.536+0000 7f3140b2a800 20 add_watcher() i=1 2024-09-14T11:17:41.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.536+0000 7f3140b2a800 20 add_watcher() i=2 2024-09-14T11:17:41.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.536+0000 7f3140b2a800 20 add_watcher() i=3 2024-09-14T11:17:41.534 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.536+0000 7f3140b2a800 20 add_watcher() i=4 2024-09-14T11:17:41.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.536+0000 7f3140b2a800 20 add_watcher() i=5 2024-09-14T11:17:41.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.536+0000 7f3140b2a800 20 add_watcher() i=6 2024-09-14T11:17:41.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.537+0000 7f3140b2a800 20 add_watcher() i=7 2024-09-14T11:17:41.535 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.537+0000 7f3140b2a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f2ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f3140b2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f3140b2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f3140b2a800 5 note: GC not initialized 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f2ff0fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f3140b2a800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f3140b2a800 20 Filter name: none 2024-09-14T11:17:41.538 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.539+0000 7f2f6a7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:41.539 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.540+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.540+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.540+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.541+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.541+0000 7f3140b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.541+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.541+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.541+0000 7f3140b2a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.541+0000 7f3140b2a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:41.540 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.541+0000 7f3140b2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:41.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.543+0000 7f2ff1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:41.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.545+0000 7f3140b2a800 20 remove_watcher() i=0 2024-09-14T11:17:41.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.545+0000 7f3140b2a800 2 removed watcher, disabling cache 2024-09-14T11:17:41.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.546+0000 7f3140b2a800 20 remove_watcher() i=1 2024-09-14T11:17:41.545 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.547+0000 7f3140b2a800 20 remove_watcher() i=2 2024-09-14T11:17:41.546 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.548+0000 7f3140b2a800 20 remove_watcher() i=3 2024-09-14T11:17:41.547 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.549+0000 7f3140b2a800 20 remove_watcher() i=4 2024-09-14T11:17:41.548 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.550+0000 7f3140b2a800 20 remove_watcher() i=5 2024-09-14T11:17:41.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.550+0000 7f3140b2a800 20 remove_watcher() i=6 2024-09-14T11:17:41.550 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.551+0000 7f3140b2a800 20 remove_watcher() i=7 2024-09-14T11:17:41.561 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:41.561 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:41.561 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:41.561 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:41.562 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-14T11:17:41.597 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:41.597 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:41.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.637+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 20 realm 2024-09-14T11:17:41.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:41.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.639+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.640+0000 7f8160526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:41.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.640+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.640+0000 7f8160526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:41.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.640+0000 7f8160526800 20 searching for the correct realm 2024-09-14T11:17:41.642 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.643+0000 7f815b9d8640 0 -- 172.21.15.2:0/86961924 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f814c0054d0 msgr2=0x7f814c067f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:41.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.647+0000 7f815c1d9640 0 -- 172.21.15.2:0/86961924 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f81500507a0 msgr2=0x7f8150061320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:41.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:41.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:41.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:41.854 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.854+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 zone default found 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 4 Realm: () 2024-09-14T11:17:41.855 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 zonegroup default 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.855+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.856 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.856+0000 7f8160526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.856+0000 7f8160526800 20 started sync module instance, tier type = 2024-09-14T11:17:41.857 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.856+0000 7f8160526800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:41.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.865+0000 7f8160526800 20 add_watcher() i=0 2024-09-14T11:17:41.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.865+0000 7f8160526800 20 add_watcher() i=1 2024-09-14T11:17:41.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.865+0000 7f8160526800 20 add_watcher() i=2 2024-09-14T11:17:41.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.865+0000 7f8160526800 20 add_watcher() i=3 2024-09-14T11:17:41.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.865+0000 7f8160526800 20 add_watcher() i=4 2024-09-14T11:17:41.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.865+0000 7f8160526800 20 add_watcher() i=5 2024-09-14T11:17:41.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.865+0000 7f8160526800 20 add_watcher() i=6 2024-09-14T11:17:41.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.866+0000 7f8160526800 20 add_watcher() i=7 2024-09-14T11:17:41.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.866+0000 7f8160526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f8012fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f8160526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f8160526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f8160526800 5 note: GC not initialized 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f8011fdb640 20 reqs_thread_entry: start 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f8160526800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f8160526800 20 Filter name: none 2024-09-14T11:17:41.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.868+0000 7f7f837fe640 20 reqs_thread_entry: start 2024-09-14T11:17:41.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.869+0000 7f8160526800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:17:41.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.869+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.869+0000 7f8160526800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.869+0000 7f8160526800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.869+0000 7f8160526800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.869+0000 7f8160526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 : miss 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.869+0000 7f8160526800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.870+0000 7f8160526800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.870+0000 7f8160526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.870+0000 7f8160526800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.870+0000 7f8160526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.870+0000 7f8160526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:41.869 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.870+0000 7f8160526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 2024-09-14T11:17:41.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.873+0000 7f8160526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:41.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.873+0000 7f8160526800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:41.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.873+0000 7f8160526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:41.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.873+0000 7f8160526800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37, ofs0, ns] 2024-09-14T11:17:41.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f80337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464314 cookie 94196477431312 notifier 7400 bl.length()=931 2024-09-14T11:17:41.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f80337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:41.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f80337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:41.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f80337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:41.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_sources= new_sources= 2024-09-14T11:17:41.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential sources added=[] removed=[] 2024-09-14T11:17:41.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_dests= new_dests= 2024-09-14T11:17:41.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.874+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential dests added=[] removed=[] 2024-09-14T11:17:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.876+0000 7f8160526800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.0 2024-09-14T11:17:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.876+0000 7f8160526800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.0 2024-09-14T11:17:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.876+0000 7f8160526800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.1 2024-09-14T11:17:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.876+0000 7f8160526800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.1 2024-09-14T11:17:41.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.876+0000 7f8160526800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.0 2024-09-14T11:17:41.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.879+0000 7f8160526800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-14T11:17:41.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.879+0000 7f8160526800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-14T11:17:41.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.884+0000 7f8160526800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:41.883 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.885+0000 7f8160526800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37, ofs0, ns] 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f80337fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464315 cookie 94196477431312 notifier 7400 bl.length()=899 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f80337fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f80337fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f80337fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:41.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_sources= new_sources= 2024-09-14T11:17:41.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential sources added=[] removed=[] 2024-09-14T11:17:41.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_dests= new_dests= 2024-09-14T11:17:41.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential dests added=[] removed=[] 2024-09-14T11:17:41.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.886+0000 7f8160526800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-14T11:17:41.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.888+0000 7f8012fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:41.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.890+0000 7f8160526800 20 remove_watcher() i=0 2024-09-14T11:17:41.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.890+0000 7f8160526800 2 removed watcher, disabling cache 2024-09-14T11:17:41.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.892+0000 7f8160526800 20 remove_watcher() i=1 2024-09-14T11:17:41.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.892+0000 7f8160526800 20 remove_watcher() i=2 2024-09-14T11:17:41.892 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.894+0000 7f8160526800 20 remove_watcher() i=3 2024-09-14T11:17:41.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.895+0000 7f8160526800 20 remove_watcher() i=4 2024-09-14T11:17:41.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.896+0000 7f8160526800 20 remove_watcher() i=5 2024-09-14T11:17:41.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.897+0000 7f8160526800 20 remove_watcher() i=6 2024-09-14T11:17:41.896 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.898+0000 7f8160526800 20 remove_watcher() i=7 2024-09-14T11:17:41.909 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:17:41.938 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:41.938 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:41.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.979+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.980+0000 7f174df3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.980+0000 7f174df3a800 20 realm 2024-09-14T11:17:41.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.980+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.981+0000 7f174df3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.981+0000 7f174df3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:41.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.981+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.981+0000 7f174df3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:41.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.981+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.982+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:41.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.982+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:41.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.982+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:41.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.982+0000 7f174df3a800 20 searching for the correct realm 2024-09-14T11:17:41.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.984+0000 7f17494ba640 0 -- 172.21.15.2:0/781199444 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f173c06a070 msgr2=0x7f173c0db2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:41.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:41.988+0000 7f1749cbb640 0 -- 172.21.15.2:0/781199444 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1740067cf0 msgr2=0x7f1740026700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:42.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.194+0000 7f174df3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:42.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.194+0000 7f174df3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:42.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.194+0000 7f174df3a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:42.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.194+0000 7f174df3a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:42.193 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.194+0000 7f174df3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:42.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.194+0000 7f174df3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:42.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.194+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.194 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 zone default found 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 4 Realm: () 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:42.195 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 zonegroup default 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.195+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.196+0000 7f174df3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.196+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.196+0000 7f174df3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.196+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.197+0000 7f174df3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.197+0000 7f174df3a800 20 started sync module instance, tier type = 2024-09-14T11:17:42.196 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.197+0000 7f174df3a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:42.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.206+0000 7f174df3a800 20 add_watcher() i=0 2024-09-14T11:17:42.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.206+0000 7f174df3a800 20 add_watcher() i=1 2024-09-14T11:17:42.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.206+0000 7f174df3a800 20 add_watcher() i=2 2024-09-14T11:17:42.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.206+0000 7f174df3a800 20 add_watcher() i=3 2024-09-14T11:17:42.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.206+0000 7f174df3a800 20 add_watcher() i=4 2024-09-14T11:17:42.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.206+0000 7f174df3a800 20 add_watcher() i=5 2024-09-14T11:17:42.205 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.206+0000 7f174df3a800 20 add_watcher() i=6 2024-09-14T11:17:42.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.207+0000 7f174df3a800 20 add_watcher() i=7 2024-09-14T11:17:42.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.207+0000 7f174df3a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:42.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.209+0000 7f15fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:42.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f174df3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:42.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f174df3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:42.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f174df3a800 5 note: GC not initialized 2024-09-14T11:17:42.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f15fa7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:42.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f174df3a800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:42.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f174df3a800 20 Filter name: none 2024-09-14T11:17:42.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f156bfff640 20 reqs_thread_entry: start 2024-09-14T11:17:42.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.210+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.211+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:42.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.211+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.212+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:42.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.212+0000 7f174df3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:42.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.212+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.212+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:42.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.212+0000 7f174df3a800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.212+0000 7f174df3a800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:42.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.212+0000 7f174df3a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:42.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.214+0000 7f15fb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:42.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.216+0000 7f174df3a800 20 remove_watcher() i=0 2024-09-14T11:17:42.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.216+0000 7f174df3a800 2 removed watcher, disabling cache 2024-09-14T11:17:42.215 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.217+0000 7f174df3a800 20 remove_watcher() i=1 2024-09-14T11:17:42.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.218+0000 7f174df3a800 20 remove_watcher() i=2 2024-09-14T11:17:42.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.219+0000 7f174df3a800 20 remove_watcher() i=3 2024-09-14T11:17:42.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.220+0000 7f174df3a800 20 remove_watcher() i=4 2024-09-14T11:17:42.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.221+0000 7f174df3a800 20 remove_watcher() i=5 2024-09-14T11:17:42.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.222+0000 7f174df3a800 20 remove_watcher() i=6 2024-09-14T11:17:42.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.223+0000 7f174df3a800 20 remove_watcher() i=7 2024-09-14T11:17:42.233 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:42.233 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:42.233 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:42.233 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:42.234 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.235 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.242 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.242 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.286 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:42.318 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:42.318 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:42.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.359+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 20 realm 2024-09-14T11:17:42.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:42.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.361+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.362+0000 7fa2d8e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:42.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.362+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.362+0000 7fa2d8e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:42.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.362+0000 7fa2d8e0e800 20 searching for the correct realm 2024-09-14T11:17:42.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.365+0000 7fa2d3dbb640 0 -- 172.21.15.2:0/4084809051 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fa2c4084400 msgr2=0x7fa2c4068e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:42.367 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.369+0000 7fa2d45bc640 0 -- 172.21.15.2:0/4084809051 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa2bc07a960 msgr2=0x7fa2bc0933c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:42.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:42.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:42.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:42.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:42.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:42.574 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:42.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:42.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.576+0000 7fa2d8e0e800 20 zone default found 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 4 Realm: () 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 20 zonegroup default 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.577+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.578+0000 7fa2d8e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.578+0000 7fa2d8e0e800 20 started sync module instance, tier type = 2024-09-14T11:17:42.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.578+0000 7fa2d8e0e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:42.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.587+0000 7fa2d8e0e800 20 add_watcher() i=0 2024-09-14T11:17:42.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.587+0000 7fa2d8e0e800 20 add_watcher() i=1 2024-09-14T11:17:42.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.587+0000 7fa2d8e0e800 20 add_watcher() i=2 2024-09-14T11:17:42.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.587+0000 7fa2d8e0e800 20 add_watcher() i=3 2024-09-14T11:17:42.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.587+0000 7fa2d8e0e800 20 add_watcher() i=4 2024-09-14T11:17:42.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.587+0000 7fa2d8e0e800 20 add_watcher() i=5 2024-09-14T11:17:42.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.587+0000 7fa2d8e0e800 20 add_watcher() i=6 2024-09-14T11:17:42.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.588+0000 7fa2d8e0e800 20 add_watcher() i=7 2024-09-14T11:17:42.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.588+0000 7fa2d8e0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:42.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.589+0000 7fa18a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:42.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa2d8e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa2d8e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa2d8e0e800 5 note: GC not initialized 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa1897e2640 20 reqs_thread_entry: start 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa2d8e0e800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa2d8e0e800 20 Filter name: none 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa0faffd640 20 reqs_thread_entry: start 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa2d8e0e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:17:42.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.590+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 : miss 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:42.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.591+0000 7fa2d8e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 2024-09-14T11:17:42.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa2d8e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:42.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa2d8e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:42.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa2d8e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:42.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa2d8e0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37, ofs0, ns] 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa1b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464316 cookie 94071062771328 notifier 7436 bl.length()=931 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa1b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa1b37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.595+0000 7fa1b37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.596+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_sources= new_sources= 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.596+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential sources added=[] removed=[] 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.596+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_dests= new_dests= 2024-09-14T11:17:42.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.596+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential dests added=[] removed=[] 2024-09-14T11:17:42.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.598+0000 7fa2d8e0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.0 2024-09-14T11:17:42.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.598+0000 7fa2d8e0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.0 2024-09-14T11:17:42.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.598+0000 7fa2d8e0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.1 2024-09-14T11:17:42.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.598+0000 7fa2d8e0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.1.1 2024-09-14T11:17:42.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.598+0000 7fa2d8e0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.0 2024-09-14T11:17:42.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.600+0000 7fa2d8e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:42.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.600+0000 7fa2d8e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa2d8e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa2d8e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa2d8e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa2d8e0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37, ofs0, ns] 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa1b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464317 cookie 94071062771328 notifier 7436 bl.length()=931 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa1b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa1b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.601+0000 7fa1b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:42.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.602+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_sources= new_sources= 2024-09-14T11:17:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.602+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential sources added=[] removed=[] 2024-09-14T11:17:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.602+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_dests= new_dests= 2024-09-14T11:17:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.602+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential dests added=[] removed=[] 2024-09-14T11:17:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.603+0000 7fa2d8e0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.37.0 2024-09-14T11:17:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.603+0000 7fa2d8e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:42.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.603+0000 7fa2d8e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.604+0000 7fa2d8e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.604+0000 7fa2d8e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.604+0000 7fa2d8e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.604+0000 7fa2d8e0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37, ofs0, ns] 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa1b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464318 cookie 94071062771328 notifier 7436 bl.length()=899 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa1b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 info.flags=0x17 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa1b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 to cache LRU end 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa1b2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:42.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_sources= new_sources= 2024-09-14T11:17:42.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential sources added=[] removed=[] 2024-09-14T11:17:42.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): orig_dests= new_dests= 2024-09-14T11:17:42.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.605+0000 7fa2d8e0e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.37]): potential dests added=[] removed=[] 2024-09-14T11:17:42.604 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.606+0000 7fa2d8e0e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-14T11:17:42.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.608+0000 7fa18a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:42.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.610+0000 7fa2d8e0e800 20 remove_watcher() i=0 2024-09-14T11:17:42.608 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.610+0000 7fa2d8e0e800 2 removed watcher, disabling cache 2024-09-14T11:17:42.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.611+0000 7fa2d8e0e800 20 remove_watcher() i=1 2024-09-14T11:17:42.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.612+0000 7fa2d8e0e800 20 remove_watcher() i=2 2024-09-14T11:17:42.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.613+0000 7fa2d8e0e800 20 remove_watcher() i=3 2024-09-14T11:17:42.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.614+0000 7fa2d8e0e800 20 remove_watcher() i=4 2024-09-14T11:17:42.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.615+0000 7fa2d8e0e800 20 remove_watcher() i=5 2024-09-14T11:17:42.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.616+0000 7fa2d8e0e800 20 remove_watcher() i=6 2024-09-14T11:17:42.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.617+0000 7fa2d8e0e800 20 remove_watcher() i=7 2024-09-14T11:17:42.628 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:17:42.657 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:42.657 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:42.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.697+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.699+0000 7f2c8f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.699+0000 7f2c8f728800 20 realm 2024-09-14T11:17:42.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.699+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.700+0000 7f2c8f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.698 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.700+0000 7f2c8f728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:42.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.700+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.700+0000 7f2c8f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.700+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.701+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:42.699 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.701+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.701+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:42.700 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.701+0000 7f2c8f728800 20 searching for the correct realm 2024-09-14T11:17:42.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.704+0000 7f2c8bc70640 0 -- 172.21.15.2:0/3302756835 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f2c80098c20 msgr2=0x7f2c8005ffa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:42.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.707+0000 7f2c8b46f640 0 -- 172.21.15.2:0/3302756835 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2c8004cb10 msgr2=0x7f2c80084800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:42.709 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.710 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.711+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 zone default found 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 4 Realm: () 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:42.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 zonegroup default 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.712+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.713+0000 7f2c8f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.713+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.713+0000 7f2c8f728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.713+0000 7f2c8f728800 20 started sync module instance, tier type = 2024-09-14T11:17:42.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.713+0000 7f2c8f728800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:42.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.722+0000 7f2c8f728800 20 add_watcher() i=0 2024-09-14T11:17:42.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.722+0000 7f2c8f728800 20 add_watcher() i=1 2024-09-14T11:17:42.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.722+0000 7f2c8f728800 20 add_watcher() i=2 2024-09-14T11:17:42.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.722+0000 7f2c8f728800 20 add_watcher() i=3 2024-09-14T11:17:42.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.722+0000 7f2c8f728800 20 add_watcher() i=4 2024-09-14T11:17:42.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.722+0000 7f2c8f728800 20 add_watcher() i=5 2024-09-14T11:17:42.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.722+0000 7f2c8f728800 20 add_watcher() i=6 2024-09-14T11:17:42.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.723+0000 7f2c8f728800 20 add_watcher() i=7 2024-09-14T11:17:42.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.723+0000 7f2c8f728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.724+0000 7f2b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.724+0000 7f2c8f728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.724+0000 7f2c8f728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.724+0000 7f2c8f728800 5 note: GC not initialized 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.725+0000 7f2b40fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.725+0000 7f2c8f728800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.725+0000 7f2c8f728800 20 Filter name: none 2024-09-14T11:17:42.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.725+0000 7f2aba7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:42.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.725+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.725+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.725+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.726+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.726+0000 7f2c8f728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.726+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.726+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.726+0000 7f2c8f728800 20 rados->read ofs=0 len=0 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.726+0000 7f2c8f728800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:42.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.726+0000 7f2c8f728800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:42.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.728+0000 7f2b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:42.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.730+0000 7f2c8f728800 20 remove_watcher() i=0 2024-09-14T11:17:42.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.730+0000 7f2c8f728800 2 removed watcher, disabling cache 2024-09-14T11:17:42.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.731+0000 7f2c8f728800 20 remove_watcher() i=1 2024-09-14T11:17:42.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.732+0000 7f2c8f728800 20 remove_watcher() i=2 2024-09-14T11:17:42.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.733+0000 7f2c8f728800 20 remove_watcher() i=3 2024-09-14T11:17:42.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.734+0000 7f2c8f728800 20 remove_watcher() i=4 2024-09-14T11:17:42.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.734+0000 7f2c8f728800 20 remove_watcher() i=5 2024-09-14T11:17:42.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.735+0000 7f2c8f728800 20 remove_watcher() i=6 2024-09-14T11:17:42.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:42.736+0000 7f2c8f728800 20 remove_watcher() i=7 2024-09-14T11:17:42.745 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:42.746 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:42.746 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.37 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:17:42.746 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:42.747 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.748 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.751 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.751 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.795 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.796 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.810 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-14T11:17:42.810 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:42.810 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.810 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.820 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.820 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.862 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.862 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.870 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.871 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.877 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.877 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.884 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.884 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.892 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.892 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.900 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.900 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.906 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.906 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.914 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.914 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.921 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.921 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.928 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.928 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.935 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.935 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.941 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.942 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.949 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.949 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.955 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.956 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.962 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.962 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.968 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.968 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.975 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.975 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.981 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.982 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.988 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.988 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:42.995 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:42.995 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:43.003 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:17:43.032 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:43.032 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:43.071 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.073+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.075+0000 7f04c2420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.075+0000 7f04c2420800 20 realm 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.075+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.075+0000 7f04c2420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.075+0000 7f04c2420800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.075+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.076+0000 7f04c2420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.074 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.076+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.076+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:43.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.076+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.077+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:43.075 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.077+0000 7f04c2420800 20 searching for the correct realm 2024-09-14T11:17:43.078 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.080+0000 7f04c070b640 0 -- 172.21.15.2:0/2916983908 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f04b4073020 msgr2=0x7f04b406c480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:43.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.083+0000 7f04bff0a640 0 -- 172.21.15.2:0/2916983908 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f04b40435e0 msgr2=0x7f04b40648e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:43.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:43.288 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:43.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:43.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 zone default found 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 4 Realm: () 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 zonegroup default 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.290+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.291+0000 7f04c2420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.291+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.291+0000 7f04c2420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.291+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.291+0000 7f04c2420800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.291+0000 7f04c2420800 20 started sync module instance, tier type = 2024-09-14T11:17:43.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.291+0000 7f04c2420800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:43.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.300+0000 7f04c2420800 20 add_watcher() i=0 2024-09-14T11:17:43.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.300+0000 7f04c2420800 20 add_watcher() i=1 2024-09-14T11:17:43.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.300+0000 7f04c2420800 20 add_watcher() i=2 2024-09-14T11:17:43.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.300+0000 7f04c2420800 20 add_watcher() i=3 2024-09-14T11:17:43.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.300+0000 7f04c2420800 20 add_watcher() i=4 2024-09-14T11:17:43.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.300+0000 7f04c2420800 20 add_watcher() i=5 2024-09-14T11:17:43.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.300+0000 7f04c2420800 20 add_watcher() i=6 2024-09-14T11:17:43.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.301+0000 7f04c2420800 20 add_watcher() i=7 2024-09-14T11:17:43.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.301+0000 7f04c2420800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:43.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.302+0000 7f0375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:43.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f04c2420800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:43.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f04c2420800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:43.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f04c2420800 5 note: GC not initialized 2024-09-14T11:17:43.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f0374fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:43.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f04c2420800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:43.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f04c2420800 20 Filter name: none 2024-09-14T11:17:43.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f02ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:43.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.303+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.304+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:43.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.304+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.304+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:43.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.305+0000 7f04c2420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:43.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.305+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.305+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:43.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.305+0000 7f04c2420800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.305+0000 7f04c2420800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:43.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.305+0000 7f04c2420800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:43.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.307+0000 7f0375fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:43.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.309+0000 7f04c2420800 20 remove_watcher() i=0 2024-09-14T11:17:43.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.309+0000 7f04c2420800 2 removed watcher, disabling cache 2024-09-14T11:17:43.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.310+0000 7f04c2420800 20 remove_watcher() i=1 2024-09-14T11:17:43.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.311+0000 7f04c2420800 20 remove_watcher() i=2 2024-09-14T11:17:43.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.312+0000 7f04c2420800 20 remove_watcher() i=3 2024-09-14T11:17:43.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.313+0000 7f04c2420800 20 remove_watcher() i=4 2024-09-14T11:17:43.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.314+0000 7f04c2420800 20 remove_watcher() i=5 2024-09-14T11:17:43.313 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.315+0000 7f04c2420800 20 remove_watcher() i=6 2024-09-14T11:17:43.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.316+0000 7f04c2420800 20 remove_watcher() i=7 2024-09-14T11:17:43.325 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:43.325 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:43.326 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:43.326 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:43.327 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-14T11:17:43.364 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:43.364 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:43.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.405+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.406+0000 7f69b9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.406+0000 7f69b9840800 20 realm 2024-09-14T11:17:43.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.406+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.406+0000 7f69b9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.406+0000 7f69b9840800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:43.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.406+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.407+0000 7f69b9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.407+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.407+0000 7f69b9840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:43.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.407+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.408+0000 7f69b9840800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:43.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.408+0000 7f69b9840800 20 searching for the correct realm 2024-09-14T11:17:43.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.411+0000 7f69b7b2b640 0 -- 172.21.15.2:0/2567507303 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f69a0064430 msgr2=0x7f69a0064850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:43.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.414+0000 7f69b732a640 0 -- 172.21.15.2:0/2567507303 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f69a00633d0 msgr2=0x7f69a0063850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:43.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:43.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:43.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:43.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:43.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:43.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:43.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.621+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 zone default found 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 4 Realm: () 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 zonegroup default 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 started sync module instance, tier type = 2024-09-14T11:17:43.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.622+0000 7f69b9840800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.631+0000 7f69b9840800 20 add_watcher() i=0 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 20 add_watcher() i=1 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 20 add_watcher() i=2 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 20 add_watcher() i=3 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 20 add_watcher() i=4 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 20 add_watcher() i=5 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 20 add_watcher() i=6 2024-09-14T11:17:43.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 20 add_watcher() i=7 2024-09-14T11:17:43.631 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.632+0000 7f69b9840800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:43.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.634+0000 7f686dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:43.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.634+0000 7f69b9840800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:43.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.634+0000 7f69b9840800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:43.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.635+0000 7f69b9840800 5 note: GC not initialized 2024-09-14T11:17:43.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.635+0000 7f686cfe1640 20 reqs_thread_entry: start 2024-09-14T11:17:43.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.635+0000 7f69b9840800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:43.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.635+0000 7f69b9840800 20 Filter name: none 2024-09-14T11:17:43.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.635+0000 7f67e67fc640 20 reqs_thread_entry: start 2024-09-14T11:17:43.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.635+0000 7f69b9840800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-14T11:17:43.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.635+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 : miss 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 info.flags=0x17 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 to cache LRU end 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:43.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.636+0000 7f69b9840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 2024-09-14T11:17:43.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f69b9840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 info.flags=0x17 2024-09-14T11:17:43.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f69b9840800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 to cache LRU end 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f69b9840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f69b9840800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38, ofs0, ns] 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f689a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464321 cookie 94419097876416 notifier 7490 bl.length()=931 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f689a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 info.flags=0x17 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f689a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 to cache LRU end 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.640+0000 7f689a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.641+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): orig_sources= new_sources= 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.641+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): potential sources added=[] removed=[] 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.641+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): orig_dests= new_dests= 2024-09-14T11:17:43.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.641+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): potential dests added=[] removed=[] 2024-09-14T11:17:43.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.643+0000 7f69b9840800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.38.1.0 2024-09-14T11:17:43.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.643+0000 7f69b9840800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.38.1.0 2024-09-14T11:17:43.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.643+0000 7f69b9840800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.38.1.1 2024-09-14T11:17:43.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.643+0000 7f69b9840800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.38.1.1 2024-09-14T11:17:43.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.643+0000 7f69b9840800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.38.0 2024-09-14T11:17:43.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.645+0000 7f69b9840800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-14T11:17:43.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.645+0000 7f69b9840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:43.643 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.645+0000 7f69b9840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 2024-09-14T11:17:43.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f69b9840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 info.flags=0x17 2024-09-14T11:17:43.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f69b9840800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 to cache LRU end 2024-09-14T11:17:43.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f69b9840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:43.644 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f69b9840800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38, ofs0, ns] 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f689a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464322 cookie 94419097876416 notifier 7490 bl.length()=931 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f689a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 info.flags=0x17 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f689a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 to cache LRU end 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.646+0000 7f689a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.647+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): orig_sources= new_sources= 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.647+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): potential sources added=[] removed=[] 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.647+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): orig_dests= new_dests= 2024-09-14T11:17:43.645 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.647+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): potential dests added=[] removed=[] 2024-09-14T11:17:43.646 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.648+0000 7f69b9840800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.38.0 2024-09-14T11:17:43.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.648+0000 7f69b9840800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 : hit (requested=0x17, cached=0x17) 2024-09-14T11:17:43.647 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.648+0000 7f69b9840800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 2024-09-14T11:17:43.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 info.flags=0x17 2024-09-14T11:17:43.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 to cache LRU end 2024-09-14T11:17:43.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:43.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38, ofs0, ns] 2024-09-14T11:17:43.648 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f689a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464323 cookie 94419097876416 notifier 7490 bl.length()=899 2024-09-14T11:17:43.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f689a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 info.flags=0x17 2024-09-14T11:17:43.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f689a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 to cache LRU end 2024-09-14T11:17:43.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f689a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:43.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): orig_sources= new_sources= 2024-09-14T11:17:43.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): potential sources added=[] removed=[] 2024-09-14T11:17:43.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): orig_dests= new_dests= 2024-09-14T11:17:43.649 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.650+0000 7f69b9840800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.38]): potential dests added=[] removed=[] 2024-09-14T11:17:43.650 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.652+0000 7f69b9840800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-14T11:17:43.651 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.653+0000 7f686dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:43.653 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.655+0000 7f69b9840800 20 remove_watcher() i=0 2024-09-14T11:17:43.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.655+0000 7f69b9840800 2 removed watcher, disabling cache 2024-09-14T11:17:43.654 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.656+0000 7f69b9840800 20 remove_watcher() i=1 2024-09-14T11:17:43.655 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.657+0000 7f69b9840800 20 remove_watcher() i=2 2024-09-14T11:17:43.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.658+0000 7f69b9840800 20 remove_watcher() i=3 2024-09-14T11:17:43.657 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.659+0000 7f69b9840800 20 remove_watcher() i=4 2024-09-14T11:17:43.658 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.660+0000 7f69b9840800 20 remove_watcher() i=5 2024-09-14T11:17:43.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.661+0000 7f69b9840800 20 remove_watcher() i=6 2024-09-14T11:17:43.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.662+0000 7f69b9840800 20 remove_watcher() i=7 2024-09-14T11:17:43.673 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-14T11:17:43.703 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:43.703 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:43.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.743+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 20 realm 2024-09-14T11:17:43.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:43.743 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.745+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.746+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:43.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.746+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.746+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:43.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.746+0000 7f9bcf546800 20 searching for the correct realm 2024-09-14T11:17:43.747 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.749+0000 7f9bcc836640 0 -- 172.21.15.2:0/3921273337 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f9bc0048af0 msgr2=0x7f9bc0075910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:43.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.752+0000 7f9bcd037640 0 -- 172.21.15.2:0/3921273337 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f9bc4045700 msgr2=0x7f9bc40707a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:17:43.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:43.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.958+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 zone default found 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 4 Realm: () 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 zonegroup default 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.959 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.959+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.960+0000 7f9bcf546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:43.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.960+0000 7f9bcf546800 20 started sync module instance, tier type = 2024-09-14T11:17:43.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.960+0000 7f9bcf546800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:43.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.969+0000 7f9bcf546800 20 add_watcher() i=0 2024-09-14T11:17:43.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.969+0000 7f9bcf546800 20 add_watcher() i=1 2024-09-14T11:17:43.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.969+0000 7f9bcf546800 20 add_watcher() i=2 2024-09-14T11:17:43.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.969+0000 7f9bcf546800 20 add_watcher() i=3 2024-09-14T11:17:43.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.969+0000 7f9bcf546800 20 add_watcher() i=4 2024-09-14T11:17:43.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.969+0000 7f9bcf546800 20 add_watcher() i=5 2024-09-14T11:17:43.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.969+0000 7f9bcf546800 20 add_watcher() i=6 2024-09-14T11:17:43.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.970+0000 7f9bcf546800 20 add_watcher() i=7 2024-09-14T11:17:43.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.970+0000 7f9bcf546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:43.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.972+0000 7f9a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:43.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.972+0000 7f9bcf546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:43.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.972+0000 7f9bcf546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:43.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.972+0000 7f9bcf546800 5 note: GC not initialized 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.972+0000 7f9a827e4640 20 reqs_thread_entry: start 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.972+0000 7f9bcf546800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.972+0000 7f9bcf546800 20 Filter name: none 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.973+0000 7f99f3fff640 20 reqs_thread_entry: start 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.973+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.973+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:43.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.973+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.974+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:43.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.974+0000 7f9bcf546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:43.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.974+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.974+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:43.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.974+0000 7f9bcf546800 20 rados->read ofs=0 len=0 2024-09-14T11:17:43.973 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.974+0000 7f9bcf546800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:43.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.974+0000 7f9bcf546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:43.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.976+0000 7f9a837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:43.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.978+0000 7f9bcf546800 20 remove_watcher() i=0 2024-09-14T11:17:43.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.978+0000 7f9bcf546800 2 removed watcher, disabling cache 2024-09-14T11:17:43.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.979+0000 7f9bcf546800 20 remove_watcher() i=1 2024-09-14T11:17:43.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.980+0000 7f9bcf546800 20 remove_watcher() i=2 2024-09-14T11:17:43.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.981+0000 7f9bcf546800 20 remove_watcher() i=3 2024-09-14T11:17:43.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.982+0000 7f9bcf546800 20 remove_watcher() i=4 2024-09-14T11:17:43.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.983+0000 7f9bcf546800 20 remove_watcher() i=5 2024-09-14T11:17:43.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.984+0000 7f9bcf546800 20 remove_watcher() i=6 2024-09-14T11:17:43.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:43.985+0000 7f9bcf546800 20 remove_watcher() i=7 2024-09-14T11:17:43.994 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:43.994 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:43.994 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: error-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.38 num_objects: 20 size_kb: 1 num_shards: 2 2024-09-14T11:17:43.995 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:43.997 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:43.997 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:43.999 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:43.999 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.042 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.042 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.056 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-14T11:17:44.056 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.057 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.057 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.067 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.067 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.110 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.111 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.118 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.118 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.125 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.125 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.132 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.132 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.140 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.140 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.147 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.147 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.154 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.154 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.162 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.162 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.169 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.169 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.176 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.176 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.183 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.183 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.189 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.189 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.197 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.197 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.205 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.205 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.212 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.212 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.219 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.219 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.226 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.226 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.233 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.233 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.240 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.240 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.248 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:44.248 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:44.256 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:17:44.286 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:44.286 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:44.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.326+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.326 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 20 realm 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.328+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.329+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:44.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.329+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.330+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:44.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.330+0000 7f703a93e800 20 searching for the correct realm 2024-09-14T11:17:44.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.332+0000 7f7035e85640 0 -- 172.21.15.2:0/1577948236 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f70280a0bf0 msgr2=0x7f7028003420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:44.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.336+0000 7f7036686640 0 -- 172.21.15.2:0/1577948236 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f702c02e450 msgr2=0x7f702c02e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:44.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:44.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:44.541 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:44.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:44.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:44.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:44.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.542 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.543+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 zone default found 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 4 Realm: () 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:44.543 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 zonegroup default 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.544+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.545+0000 7f703a93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.545+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.545+0000 7f703a93e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.545+0000 7f703a93e800 20 started sync module instance, tier type = 2024-09-14T11:17:44.544 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.545+0000 7f703a93e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.554+0000 7f703a93e800 20 add_watcher() i=0 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.554+0000 7f703a93e800 20 add_watcher() i=1 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.554+0000 7f703a93e800 20 add_watcher() i=2 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.554+0000 7f703a93e800 20 add_watcher() i=3 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.554+0000 7f703a93e800 20 add_watcher() i=4 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.554+0000 7f703a93e800 20 add_watcher() i=5 2024-09-14T11:17:44.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.554+0000 7f703a93e800 20 add_watcher() i=6 2024-09-14T11:17:44.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.555+0000 7f703a93e800 20 add_watcher() i=7 2024-09-14T11:17:44.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.555+0000 7f703a93e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:44.554 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.556+0000 7f6eecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:44.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f703a93e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:44.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f703a93e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:44.555 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f703a93e800 5 note: GC not initialized 2024-09-14T11:17:44.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f6e677fe640 20 reqs_thread_entry: start 2024-09-14T11:17:44.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f703a93e800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:44.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f703a93e800 20 Filter name: none 2024-09-14T11:17:44.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f6e657fa640 20 reqs_thread_entry: start 2024-09-14T11:17:44.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.557+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.558+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.558+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.558+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.558+0000 7f703a93e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.558+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.559+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:44.557 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.559+0000 7f703a93e800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.559+0000 7f703a93e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:44.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.559+0000 7f703a93e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:44.559 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.561+0000 7f6eecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:44.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.563+0000 7f703a93e800 20 remove_watcher() i=0 2024-09-14T11:17:44.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.563+0000 7f703a93e800 2 removed watcher, disabling cache 2024-09-14T11:17:44.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.564+0000 7f703a93e800 20 remove_watcher() i=1 2024-09-14T11:17:44.563 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.565+0000 7f703a93e800 20 remove_watcher() i=2 2024-09-14T11:17:44.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.566+0000 7f703a93e800 20 remove_watcher() i=3 2024-09-14T11:17:44.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.567+0000 7f703a93e800 20 remove_watcher() i=4 2024-09-14T11:17:44.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.568+0000 7f703a93e800 20 remove_watcher() i=5 2024-09-14T11:17:44.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.569+0000 7f703a93e800 20 remove_watcher() i=6 2024-09-14T11:17:44.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.570+0000 7f703a93e800 20 remove_watcher() i=7 2024-09-14T11:17:44.580 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.580 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:44.580 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:44.580 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.581 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:17:44.617 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:44.617 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:44.656 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.658+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.660+0000 7fec8c820800 20 realm 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.660+0000 7fec8c820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.659 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:44.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.662+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:44.660 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.662+0000 7fec8c820800 20 searching for the correct realm 2024-09-14T11:17:44.662 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.664+0000 7fec89b09640 0 -- 172.21.15.2:0/2744776305 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fec7c072030 msgr2=0x7fec7c0c0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:44.666 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.668+0000 7fec8a30a640 0 -- 172.21.15.2:0/2744776305 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fec80070050 msgr2=0x7fec800677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:44.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:44.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:44.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:44.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 zone default found 2024-09-14T11:17:44.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 4 Realm: () 2024-09-14T11:17:44.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:44.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:44.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 zonegroup default 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.877+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.877+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.878+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.878+0000 7fec8c820800 20 started sync module instance, tier type = 2024-09-14T11:17:44.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.878+0000 7fec8c820800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:44.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=0 2024-09-14T11:17:44.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=1 2024-09-14T11:17:44.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=2 2024-09-14T11:17:44.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=3 2024-09-14T11:17:44.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=4 2024-09-14T11:17:44.885 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=5 2024-09-14T11:17:44.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=6 2024-09-14T11:17:44.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.888+0000 7fec8c820800 20 add_watcher() i=7 2024-09-14T11:17:44.886 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.888+0000 7fec8c820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:44.887 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.889+0000 7feb40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7fec8c820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7fec8c820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7fec8c820800 5 note: GC not initialized 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7feabb7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7fec8c820800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7fec8c820800 20 Filter name: none 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7feab97fa640 20 reqs_thread_entry: start 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7fec8c820800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.890+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.889 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:44.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:17:44.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:17:44.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 : miss 2024-09-14T11:17:44.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:44.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:44.890 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:44.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:44.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:44.891 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.891+0000 7fec8c820800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 2024-09-14T11:17:44.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:44.893 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7fec8c820800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7fec8c820800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7fec8c820800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39, ofs0, ns] 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94209916285536 notifier 7923 bl.length()=931 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_sources= new_sources= 2024-09-14T11:17:44.894 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential sources added=[] removed=[] 2024-09-14T11:17:44.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_dests= new_dests= 2024-09-14T11:17:44.895 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential dests added=[] removed=[] 2024-09-14T11:17:44.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.898+0000 7fec8c820800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.0 2024-09-14T11:17:44.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.0 2024-09-14T11:17:44.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.898+0000 7fec8c820800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.1 2024-09-14T11:17:44.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.1 2024-09-14T11:17:44.897 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.0 2024-09-14T11:17:44.899 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec8c820800 time 2024-09-14T11:17:44.902237+0000 2024-09-14T11:17:44.899 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:44.900 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:44.900 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec8fd8c76a] 2024-09-14T11:17:44.900 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:44.900 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:44.900 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:44.901 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:44.901 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:44.901 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:44.901 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:44.902 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:44.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.902+0000 7fec8c820800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec8c820800 time 2024-09-14T11:17:44.902237+0000 2024-09-14T11:17:44.902 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:44.902 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.902 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec8fd8c76a] 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:44.903 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:44.904 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.904 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:17:44.904 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fec8c820800 thread_name:radosgw-admin 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec8ea3e6f0] 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec8ea8b99c] 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec8fd8c7c4] 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:44.918 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.903+0000 7fec8c820800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fec8c820800 thread_name:radosgw-admin 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec8ea3e6f0] 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec8ea8b99c] 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec8fd8c7c4] 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:44.919 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:17:44.641+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:44.920 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding auth protocol: cephx 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding auth protocol: cephx 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding auth protocol: cephx 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.921 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:17:44.641+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: starting msgr at 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: starting objecter 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 asok(0x55aef4668270) register_command objecter_requests hook 0x55aef48ba6c0 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: setting wanted keys 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: calling monclient init 2024-09-14T11:17:44.922 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:17:44.641+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding auth protocol: cephx 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding auth protocol: cephx 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding auth protocol: cephx 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.923 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:17:44.642+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:17:44.642+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:17:44.642+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key hook 0x55aef4888708 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef47137a0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef47cb700 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef47d19c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:44.924 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.194430s 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef47137a0 auth_method 0 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): get_auth_request con 0x55aef47cb700 auth_method 0 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef47d19c0 auth_method 0 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.925 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.926 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient: _finish_hunting 0 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:17:44.642+0000 7fec8a30a640 1 monclient: found mon.noname-c 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: dump: 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.927 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: _finish_auth 0 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: _check_auth_tickets 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: dump: 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.928 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:17:44.643+0000 7fec8c820800 5 monclient: authenticate success, global_id 7532 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:17:44.643+0000 7feb78608640 4 set_mon_vals no callback set 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:44.929 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:17:44.643+0000 7fec8c820800 1 librados: init done 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:17:44.645+0000 7feb76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:17:44.645+0000 7feb76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:17:44.645+0000 7feb76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:17:44.645+0000 7fec89b09640 10 monclient: get_auth_request con 0x7feb70077230 auth_method 0 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:17:44.645+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x55aef48ca7b0 auth_method 0 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:17:44.646+0000 7fec8a30a640 10 monclient: get_auth_request con 0x55aef48d3e50 auth_method 0 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:17:44.647+0000 7fec89b09640 10 monclient: get_auth_request con 0x55aef48d76b0 auth_method 0 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:17:44.648+0000 7fec8c820800 10 monclient: build_initial_monmap 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:17:44.648+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:17:44.648+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:44.930 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding auth protocol: cephx 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding auth protocol: cephx 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding auth protocol: cephx 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.931 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.932 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:17:44.648+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 asok(0x55aef4668270) register_command objecter_requests cmddesc objecter_requests hook 0x55aef48e0510 EEXIST 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding auth protocol: cephx 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding auth protocol: cephx 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding auth protocol: cephx 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.933 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:17:44.649+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:17:44.649+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key cmddesc rotate-key hook 0x55aef48dc0e0 EEXIST 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef4904830 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef4904c10 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef4903540 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.934 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.201611s 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef4903540 auth_method 0 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef4904830 auth_method 0 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.935 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_done global_id 7917 payload 824 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 1 monclient: found mon.noname-a 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:17:44.649+0000 7fec89b09640 10 monclient: get_auth_request con 0x55aef4904c10 auth_method 0 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: dump: 2024-09-14T11:17:44.936 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: _finish_auth 0 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:44.937 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: dump: 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.938 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:17:44.650+0000 7fec8c820800 5 monclient: authenticate success, global_id 7917 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:17:44.650+0000 7fec8b30c640 4 set_mon_vals no callback set 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:17:44.652+0000 7feb6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:17:44.652+0000 7feb6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:17:44.652+0000 7feb6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:17:44.652+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7feb64077140 auth_method 0 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:17:44.652+0000 7fec8c820800 10 monclient: get_monmap_and_config 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:17:44.652+0000 7fec8c820800 10 monclient: build_initial_monmap 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:17:44.652+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:17:44.652+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:44.939 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding auth protocol: cephx 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding auth protocol: cephx 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding auth protocol: cephx 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:44.940 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:44.941 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:17:44.653+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding auth protocol: cephx 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding auth protocol: cephx 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding auth protocol: cephx 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:44.942 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:17:44.653+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:17:44.653+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key cmddesc rotate-key hook 0x7ffcc7919458 EEXIST 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef4958bb0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef4949590 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef4953fe0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.943 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.205825s 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): get_auth_request con 0x55aef4949590 auth_method 0 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef4953fe0 auth_method 0 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.944 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef4958bb0 auth_method 0 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:17:44.654+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:17:44.654+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:17:44.654+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:17:44.654+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:17:44.654+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:17:44.654+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.945 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_done global_id 7920 payload 274 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 1 monclient: found mon.noname-a 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: dump: 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.946 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: dump: 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.947 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:17:44.654+0000 7fec8c820800 5 monclient: authenticate success, global_id 7920 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:17:44.654+0000 7fec8c820800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:17:44.654+0000 7fec8c820800 4 set_mon_vals no callback set 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:17:44.654+0000 7fec8c820800 10 monclient: shutdown 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:17:44.655+0000 7fec8c820800 10 monclient: build_initial_monmap 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:17:44.655+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:44.948 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding auth protocol: cephx 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding auth protocol: cephx 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding auth protocol: cephx 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:44.949 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:17:44.655+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: starting msgr at 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: starting objecter 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 asok(0x55aef4668270) register_command objecter_requests cmddesc objecter_requests hook 0x55aef49295a0 EEXIST 2024-09-14T11:17:44.950 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: setting wanted keys 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: calling monclient init 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:17:44.655+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding auth protocol: cephx 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding auth protocol: cephx 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding auth protocol: cephx 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:44.951 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:17:44.655+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:17:44.656+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:17:44.656+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key cmddesc rotate-key hook 0x55aef4919238 EEXIST 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef4949590 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:44.952 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef4953fe0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef4958bb0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.208114s 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): get_auth_request con 0x55aef4953fe0 auth_method 0 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef4949590 auth_method 0 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.953 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef4958bb0 auth_method 0 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.954 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_done global_id 7923 payload 824 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient: _finish_hunting 0 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:17:44.656+0000 7fec89b09640 1 monclient: found mon.noname-a 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: dump: 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.955 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: _finish_auth 0 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: dump: 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.956 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:17:44.656+0000 7fec8c820800 5 monclient: authenticate success, global_id 7923 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:17:44.656+0000 7feb6dffb640 4 set_mon_vals no callback set 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:17:44.656+0000 7fec8c820800 1 librados: init done 2024-09-14T11:17:44.957 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:17:44.656+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cr dump hook 0x55aef49462a8 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:17:44.658+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:17:44.659+0000 7feb5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:17:44.659+0000 7feb5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:17:44.659+0000 7feb5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:17:44.660+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7feb54077260 auth_method 0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:17:44.660+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x55aef4973850 auth_method 0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 realm 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:17:44.660+0000 7fec8c820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.958 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:17:44.661+0000 7fec8a30a640 10 monclient: get_auth_request con 0x55aef4977a90 auth_method 0 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:17:44.662+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:17:44.662+0000 7fec8c820800 20 searching for the correct realm 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:17:44.662+0000 7fec89b09640 10 monclient: get_auth_request con 0x55aef497cbf0 auth_method 0 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:17:44.662+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x7fec80069670 auth_method 0 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:17:44.663+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7fec84064140 auth_method 0 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:17:44.664+0000 7fec89b09640 10 monclient: get_auth_request con 0x7fec7c072030 auth_method 0 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:17:44.664+0000 7fec89b09640 0 -- 172.21.15.2:0/2744776305 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fec7c072030 msgr2=0x7fec7c0c0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:17:44.664+0000 7feb5bfff640 1 client.7923.objecter ms_handle_reset 0x7fec7c072030 session 0x7fec7c0a29e0 osd.4 2024-09-14T11:17:44.959 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:17:44.664+0000 7feb5bfff640 10 monclient: _renew_subs 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:17:44.664+0000 7feb5bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:17:44.664+0000 7fec89b09640 10 monclient: get_auth_request con 0x7feb54087160 auth_method 0 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:17:44.666+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x7fec80072860 auth_method 0 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:17:44.668+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7fec80070050 auth_method 0 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:17:44.668+0000 7fec8a30a640 0 -- 172.21.15.2:0/2744776305 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fec80070050 msgr2=0x7fec800677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:17:44.870+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7fec80070050 auth_method 0 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:44.960 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 zone default found 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:17:44.876+0000 7fec8c820800 4 Realm: () 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:17:44.876+0000 7fec8c820800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:17:44.876+0000 7fec8c820800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:17:44.876+0000 7fec8c820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:44.961 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 zonegroup default 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:17:44.877+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:17:44.877+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:17:44.878+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:17:44.878+0000 7fec8c820800 20 started sync module instance, tier type = 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:17:44.878+0000 7fec8c820800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=0 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=1 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=2 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=3 2024-09-14T11:17:44.962 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=4 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=5 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=6 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:17:44.888+0000 7fec8c820800 20 add_watcher() i=7 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:17:44.888+0000 7fec8c820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding auth protocol: cephx 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding auth protocol: cephx 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding auth protocol: cephx 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:44.963 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:17:44.889+0000 7feb40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:17:44.890+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache list hook 0x55aef494dc00 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache inspect hook 0x55aef494dc00 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache erase hook 0x55aef494dc00 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache zap hook 0x55aef494dc00 2024-09-14T11:17:44.964 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 note: GC not initialized 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:17:44.890+0000 7feabb7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace show hook 0x7fec84028020 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace history hook 0x7fec84028020 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace active hook 0x7fec84028020 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace active_short hook 0x7fec84028020 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 Filter name: none 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:17:44.890+0000 7feab97fa640 20 reqs_thread_entry: start 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:17:44.890+0000 7fec8c820800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:44.965 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 : miss 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:44.966 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39, ofs0, ns] 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94209916285536 notifier 7923 bl.length()=931 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_sources= new_sources= 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential sources added=[] removed=[] 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_dests= new_dests= 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential dests added=[] removed=[] 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:17:44.898+0000 7fec8c820800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.0 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.0 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:17:44.898+0000 7fec8c820800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.1 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.1 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.0 2024-09-14T11:17:44.967 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:17:44.902+0000 7fec8c820800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec8c820800 time 2024-09-14T11:17:44.902237+0000 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec8fd8c76a] 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:44.968 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:17:44.903+0000 7fec8c820800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fec8c820800 thread_name:radosgw-admin 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec8ea3e6f0] 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec8ea8b99c] 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec8fd8c7c4] 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:44.969 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:17:44.970 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:17:44.971 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:17:44.972 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:44.973 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:17:44.974 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:17:44.975 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:44.976 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:44.977 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feab97fa640 / http_manager 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feabb7fe640 / http_manager 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb40fe1640 / rgw_dt_lg_renew 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb5bfff640 / ms_dispatch 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb6dffb640 / io_context_pool 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb6ffff640 / ms_dispatch 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb76e05640 / ms_dispatch 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb78608640 / io_context_pool 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec89b09640 / msgr-worker-2 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8a30a640 / msgr-worker-1 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8ab0b640 / msgr-worker-0 2024-09-14T11:17:44.978 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8b30c640 / io_context_pool 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8c820800 / radosgw-admin 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.140899.log 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:17:44.641+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:44.979 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding auth protocol: cephx 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding auth protocol: cephx 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding auth protocol: cephx 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.980 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: crc 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef488e280) adding con mode: secure 2024-09-14T11:17:44.981 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:17:44.641+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: starting msgr at 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: starting objecter 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 asok(0x55aef4668270) register_command objecter_requests hook 0x55aef48ba6c0 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: setting wanted keys 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:17:44.641+0000 7fec8c820800 1 librados: calling monclient init 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:17:44.641+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding auth protocol: cephx 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding auth protocol: cephx 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding auth protocol: cephx 2024-09-14T11:17:44.982 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: crc 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:17:44.641+0000 7fec8c820800 5 AuthRegistry(0x55aef48885c0) adding con mode: secure 2024-09-14T11:17:44.983 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:17:44.642+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:17:44.642+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:17:44.642+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key hook 0x55aef4888708 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef47137a0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef47cb700 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef47d19c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.984 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:17:44.642+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.194430s 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef47137a0 auth_method 0 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): get_auth_request con 0x55aef47cb700 auth_method 0 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef47d19c0 auth_method 0 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.985 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:17:44.642+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:17:44.642+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient(hunting): handle_auth_done global_id 7532 payload 824 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient: _finish_hunting 0 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:17:44.642+0000 7fec8a30a640 1 monclient: found mon.noname-c 2024-09-14T11:17:44.986 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:17:44.642+0000 7fec8a30a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: dump: 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.987 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: _finish_auth 0 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: _check_auth_tickets 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:17:44.643+0000 7feb76e05640 10 monclient: dump: 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.988 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:17:44.643+0000 7fec8c820800 5 monclient: authenticate success, global_id 7532 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:17:44.643+0000 7feb78608640 4 set_mon_vals no callback set 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:17:44.643+0000 7fec8c820800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:17:44.643+0000 7fec8c820800 1 librados: init done 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:17:44.645+0000 7feb76e05640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:17:44.645+0000 7feb76e05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.989 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:17:44.645+0000 7feb76e05640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:17:44.645+0000 7fec89b09640 10 monclient: get_auth_request con 0x7feb70077230 auth_method 0 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:17:44.645+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x55aef48ca7b0 auth_method 0 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:17:44.646+0000 7fec8a30a640 10 monclient: get_auth_request con 0x55aef48d3e50 auth_method 0 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:17:44.647+0000 7fec89b09640 10 monclient: get_auth_request con 0x55aef48d76b0 auth_method 0 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:17:44.648+0000 7fec8c820800 10 monclient: build_initial_monmap 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:17:44.648+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:17:44.648+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:44.990 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding auth protocol: cephx 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding auth protocol: cephx 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding auth protocol: cephx 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.991 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: crc 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 AuthRegistry(0x55aef48dd050) adding con mode: secure 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:17:44.648+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:17:44.648+0000 7fec8c820800 5 asok(0x55aef4668270) register_command objecter_requests cmddesc objecter_requests hook 0x55aef48e0510 EEXIST 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:44.992 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding auth protocol: cephx 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding auth protocol: cephx 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding auth protocol: cephx 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.993 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: crc 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 AuthRegistry(0x55aef48dbf98) adding con mode: secure 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:17:44.649+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:17:44.649+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:17:44.649+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key cmddesc rotate-key hook 0x55aef48dc0e0 EEXIST 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef4904830 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef4904c10 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef4903540 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:44.994 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:17:44.649+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.201611s 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef4903540 auth_method 0 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef4904830 auth_method 0 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:44.995 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:17:44.649+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_done global_id 7917 payload 824 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 1 monclient: found mon.noname-a 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:17:44.649+0000 7fec8ab0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:17:44.649+0000 7fec89b09640 10 monclient: get_auth_request con 0x55aef4904c10 auth_method 0 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: dump: 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.996 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: _finish_auth 0 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:17:44.650+0000 7feb6ffff640 10 monclient: dump: 2024-09-14T11:17:44.997 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:17:44.650+0000 7fec8c820800 5 monclient: authenticate success, global_id 7917 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.998 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:17:44.650+0000 7fec8b30c640 4 set_mon_vals no callback set 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:17:44.650+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:17:44.652+0000 7feb6ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:17:44.652+0000 7feb6ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:17:44.652+0000 7feb6ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:17:44.652+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7feb64077140 auth_method 0 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:17:44.652+0000 7fec8c820800 10 monclient: get_monmap_and_config 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:17:44.652+0000 7fec8c820800 10 monclient: build_initial_monmap 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:17:44.652+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:17:44.652+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:44.999 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding auth protocol: cephx 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding auth protocol: cephx 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding auth protocol: cephx 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:45.000 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: crc 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:17:44.652+0000 7fec8c820800 5 AuthRegistry(0x55aef49245e0) adding con mode: secure 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:17:44.653+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:45.001 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding auth protocol: cephx 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding auth protocol: cephx 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding auth protocol: cephx 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:45.002 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: crc 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 AuthRegistry(0x7ffcc7919310) adding con mode: secure 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:17:44.653+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:17:44.653+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:17:44.653+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key cmddesc rotate-key hook 0x7ffcc7919458 EEXIST 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef4958bb0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef4949590 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef4953fe0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:45.003 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:17:44.653+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.205825s 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): get_auth_request con 0x55aef4949590 auth_method 0 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:17:44.653+0000 7fec89b09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef4953fe0 auth_method 0 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:17:44.653+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef4958bb0 auth_method 0 2024-09-14T11:17:45.004 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:17:44.653+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:17:44.654+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:17:44.654+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:17:44.654+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:17:44.654+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:17:44.654+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:17:44.654+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_done global_id 7920 payload 274 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient: _finish_hunting 0 2024-09-14T11:17:45.005 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 1 monclient: found mon.noname-a 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:17:44.654+0000 7fec8ab0b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: dump: 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:45.006 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: _finish_auth 0 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: _check_auth_tickets 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:17:44.654+0000 7feb6dffb640 10 monclient: dump: 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:45.007 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:17:44.654+0000 7fec8c820800 5 monclient: authenticate success, global_id 7920 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:17:44.654+0000 7fec8c820800 10 monclient: get_monmap_and_config success 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:17:44.654+0000 7fec8c820800 4 set_mon_vals no callback set 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:17:44.654+0000 7fec8c820800 10 monclient: shutdown 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:17:44.655+0000 7fec8c820800 10 monclient: build_initial_monmap 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 build_initial for_mkfs: 0 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:17:44.655+0000 7fec8c820800 10 monclient: monmap: 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:17:45.008 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding auth protocol: cephx 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding auth protocol: cephx 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding auth protocol: cephx 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:45.009 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: crc 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef4928130) adding con mode: secure 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:17:44.655+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: starting msgr at 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: starting objecter 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 asok(0x55aef4668270) register_command objecter_requests cmddesc objecter_requests hook 0x55aef49295a0 EEXIST 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: setting wanted keys 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:17:44.655+0000 7fec8c820800 1 librados: calling monclient init 2024-09-14T11:17:45.010 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:17:44.655+0000 7fec8c820800 10 monclient: init 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding auth protocol: cephx 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding auth protocol: cephx 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding auth protocol: cephx 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:45.011 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: crc 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:17:44.655+0000 7fec8c820800 5 AuthRegistry(0x55aef49190f0) adding con mode: secure 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:17:44.655+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:17:44.656+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:17:44.656+0000 7fec8c820800 5 asok(0x55aef4668270) register_command rotate-key cmddesc rotate-key hook 0x55aef4919238 EEXIST 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _reopen_session rank -1 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-c con 0x55aef4949590 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-a con 0x55aef4953fe0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): picked mon.noname-b con 0x55aef4958bb0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): start opening mon connection 2024-09-14T11:17:45.012 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): _renew_subs 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient(hunting): authenticate will time out at 2091.208114s 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): get_auth_request con 0x55aef4953fe0 auth_method 0 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): get_auth_request con 0x55aef4949590 auth_method 0 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:45.013 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request con 0x55aef4958bb0 auth_method 0 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:17:44.656+0000 7fec8a30a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:17:44.656+0000 7fec8ab0b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient(hunting): handle_auth_done global_id 7923 payload 824 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient: _finish_hunting 0 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:17:44.656+0000 7fec89b09640 1 monclient: found mon.noname-a 2024-09-14T11:17:45.014 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:17:44.656+0000 7fec89b09640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: dump: 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:45.015 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: _finish_auth 0 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: _check_auth_tickets 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: handle_config config(0 keys) 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:17:44.656+0000 7feb5bfff640 10 monclient: dump: 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:17:45.016 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:17:44.656+0000 7fec8c820800 5 monclient: authenticate success, global_id 7923 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:17:44.656+0000 7feb6dffb640 4 set_mon_vals no callback set 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _renew_subs 2024-09-14T11:17:45.017 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:17:44.656+0000 7fec8c820800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:17:44.656+0000 7fec8c820800 1 librados: init done 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:17:44.656+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cr dump hook 0x55aef49462a8 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:17:44.658+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:17:44.659+0000 7feb5bfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:17:44.659+0000 7feb5bfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:17:44.659+0000 7feb5bfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:17:44.660+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7feb54077260 auth_method 0 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:17:44.660+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x55aef4973850 auth_method 0 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 realm 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:17:44.660+0000 7fec8c820800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:45.018 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:17:44.660+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:17:44.661+0000 7fec8a30a640 10 monclient: get_auth_request con 0x55aef4977a90 auth_method 0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:17:44.661+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:17:44.662+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:17:44.662+0000 7fec8c820800 20 searching for the correct realm 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:17:44.662+0000 7fec89b09640 10 monclient: get_auth_request con 0x55aef497cbf0 auth_method 0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:17:44.662+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x7fec80069670 auth_method 0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:17:44.663+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7fec84064140 auth_method 0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:17:44.664+0000 7fec89b09640 10 monclient: get_auth_request con 0x7fec7c072030 auth_method 0 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:17:44.664+0000 7fec89b09640 0 -- 172.21.15.2:0/2744776305 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fec7c072030 msgr2=0x7fec7c0c0130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:17:44.664+0000 7feb5bfff640 1 client.7923.objecter ms_handle_reset 0x7fec7c072030 session 0x7fec7c0a29e0 osd.4 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:17:44.664+0000 7feb5bfff640 10 monclient: _renew_subs 2024-09-14T11:17:45.019 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:17:44.664+0000 7feb5bfff640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:17:44.664+0000 7fec89b09640 10 monclient: get_auth_request con 0x7feb54087160 auth_method 0 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:17:44.666+0000 7fec8ab0b640 10 monclient: get_auth_request con 0x7fec80072860 auth_method 0 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:17:44.668+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7fec80070050 auth_method 0 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:17:44.668+0000 7fec8a30a640 0 -- 172.21.15.2:0/2744776305 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fec80070050 msgr2=0x7fec800677e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:17:44.870+0000 7fec8a30a640 10 monclient: get_auth_request con 0x7fec80070050 auth_method 0 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:45.020 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:17:44.875+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 zone default found 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:17:44.876+0000 7fec8c820800 4 Realm: () 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:17:44.876+0000 7fec8c820800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:17:44.876+0000 7fec8c820800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:17:44.876+0000 7fec8c820800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:45.021 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 zonegroup default 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:17:44.876+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:17:44.877+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:17:44.877+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:17:44.878+0000 7fec8c820800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:17:44.878+0000 7fec8c820800 20 started sync module instance, tier type = 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:17:44.878+0000 7fec8c820800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=0 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=1 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=2 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=3 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=4 2024-09-14T11:17:45.022 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=5 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:17:44.887+0000 7fec8c820800 20 add_watcher() i=6 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:17:44.888+0000 7fec8c820800 20 add_watcher() i=7 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:17:44.888+0000 7fec8c820800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding auth protocol: cephx 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding auth protocol: cephx 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding auth protocol: cephx 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:45.023 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: crc 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:17:44.889+0000 7fec8c820800 5 AuthRegistry(0x7ffcc79197f0) adding con mode: secure 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:17:44.889+0000 7feb40fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:17:44.890+0000 7fec8c820800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache list hook 0x55aef494dc00 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache inspect hook 0x55aef494dc00 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache erase hook 0x55aef494dc00 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command cache zap hook 0x55aef494dc00 2024-09-14T11:17:45.024 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 note: GC not initialized 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:17:44.890+0000 7feabb7fe640 20 reqs_thread_entry: start 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace show hook 0x7fec84028020 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace history hook 0x7fec84028020 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace active hook 0x7fec84028020 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:17:44.890+0000 7fec8c820800 5 asok(0x55aef4668270) register_command sync trace active_short hook 0x7fec84028020 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 Filter name: none 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:17:44.890+0000 7feab97fa640 20 reqs_thread_entry: start 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:17:44.890+0000 7fec8c820800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:17:44.890+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:17:45.025 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 : miss 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:17:44.891+0000 7fec8c820800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:17:44.891+0000 7fec8c820800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:17:44.895+0000 7fec8c820800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39, ofs0, ns] 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464284 cookie 94209916285536 notifier 7923 bl.length()=931 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:45.026 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:17:44.895+0000 7feb6dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_sources= new_sources= 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential sources added=[] removed=[] 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_dests= new_dests= 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:17:44.896+0000 7fec8c820800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential dests added=[] removed=[] 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:17:44.898+0000 7fec8c820800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.0 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.0 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:17:44.898+0000 7fec8c820800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.1 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.1.1 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:17:44.898+0000 7fec8c820800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.0 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:17:44.902+0000 7fec8c820800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fec8c820800 time 2024-09-14T11:17:44.902237+0000 2024-09-14T11:17:45.027 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fec8fd8c76a] 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:17:45.028 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:17:44.903+0000 7fec8c820800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fec8c820800 thread_name:radosgw-admin 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fec8ea3e6f0] 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fec8ea8b99c] 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fec8fd8c7c4] 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fec8fd8c928] 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55aef235b0b1] 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55aef236a124] 2024-09-14T11:17:45.029 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55aef236afc4] 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fec8ea29590] 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:17:45.030 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:17:45.031 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:17:45.032 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:17:45.033 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:17:45.034 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:17:45.035 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:17:45.036 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feab97fa640 / http_manager 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feabb7fe640 / http_manager 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb40fe1640 / rgw_dt_lg_renew 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb5bfff640 / ms_dispatch 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb6dffb640 / io_context_pool 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb6ffff640 / ms_dispatch 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb76e05640 / ms_dispatch 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7feb78608640 / io_context_pool 2024-09-14T11:17:45.037 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec89b09640 / msgr-worker-2 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8a30a640 / msgr-worker-1 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8ab0b640 / msgr-worker-0 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8b30c640 / io_context_pool 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr: 7fec8c820800 / radosgw-admin 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:17:44.903908Z_8fe86543-c14b-4785-ac47-280d9a88801d/log 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:17:45.038 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:17:45.039 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:45.039 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.982+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.984+0000 7f3894536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.984+0000 7f3894536800 20 realm 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.984+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.984+0000 7f3894536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.984+0000 7f3894536800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.985+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.985+0000 7f3894536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.985+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.985+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.985+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.986+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.986+0000 7f3894536800 20 searching for the correct realm 2024-09-14T11:17:45.040 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.989+0000 7f3890ab8640 0 -- 172.21.15.2:0/923336540 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f3884074020 msgr2=0x7f3884058ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:45.041 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:44.992+0000 7f38902b7640 0 -- 172.21.15.2:0/923336540 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f38840af7f0 msgr2=0x7f38840bc8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:45.197 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.198+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:45.198 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 zone default found 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 4 Realm: () 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 zonegroup default 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.199 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.199+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.200+0000 7f3894536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.200+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.200+0000 7f3894536800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.200+0000 7f3894536800 20 started sync module instance, tier type = 2024-09-14T11:17:45.200 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.200+0000 7f3894536800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:45.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.209+0000 7f3894536800 20 add_watcher() i=0 2024-09-14T11:17:45.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.209+0000 7f3894536800 20 add_watcher() i=1 2024-09-14T11:17:45.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.209+0000 7f3894536800 20 add_watcher() i=2 2024-09-14T11:17:45.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.209+0000 7f3894536800 20 add_watcher() i=3 2024-09-14T11:17:45.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.209+0000 7f3894536800 20 add_watcher() i=4 2024-09-14T11:17:45.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.209+0000 7f3894536800 20 add_watcher() i=5 2024-09-14T11:17:45.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.209+0000 7f3894536800 20 add_watcher() i=6 2024-09-14T11:17:45.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.210+0000 7f3894536800 20 add_watcher() i=7 2024-09-14T11:17:45.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.210+0000 7f3894536800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:45.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.211+0000 7f37467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f3894536800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f3894536800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f3894536800 5 note: GC not initialized 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f37457e2640 20 reqs_thread_entry: start 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f3894536800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f3894536800 20 Filter name: none 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f36b6ffd640 20 reqs_thread_entry: start 2024-09-14T11:17:45.211 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.212+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.213+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:45.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.213+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.212 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.213+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:17:45.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.213+0000 7f3894536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:45.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.214+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.214+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:45.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.214+0000 7f3894536800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.214+0000 7f3894536800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:17:45.213 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.215+0000 7f3894536800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:17:45.214 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.216+0000 7f37467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:45.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.218+0000 7f3894536800 20 remove_watcher() i=0 2024-09-14T11:17:45.216 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.218+0000 7f3894536800 2 removed watcher, disabling cache 2024-09-14T11:17:45.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.219+0000 7f3894536800 20 remove_watcher() i=1 2024-09-14T11:17:45.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.221+0000 7f3894536800 20 remove_watcher() i=2 2024-09-14T11:17:45.220 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.222+0000 7f3894536800 20 remove_watcher() i=3 2024-09-14T11:17:45.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.223+0000 7f3894536800 20 remove_watcher() i=4 2024-09-14T11:17:45.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.224+0000 7f3894536800 20 remove_watcher() i=5 2024-09-14T11:17:45.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.225+0000 7f3894536800 20 remove_watcher() i=6 2024-09-14T11:17:45.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.226+0000 7f3894536800 20 remove_watcher() i=7 2024-09-14T11:17:45.235 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.235 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:17:45.235 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 num_objects: 20 size_kb: 1 num_shards: 1 2024-09-14T11:17:45.235 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:17:45.237 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:45.237 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:45.245 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:17:45.245 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:17:45.288 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:17:45.320 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:17:45.320 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:17:45.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.361+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.362+0000 7f63dde2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.362+0000 7f63dde2f800 20 realm 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.362+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.362+0000 7f63dde2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.362+0000 7f63dde2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.362+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.363+0000 7f63dde2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.363+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.363+0000 7f63dde2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:45.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.363+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.364+0000 7f63dde2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:17:45.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.364+0000 7f63dde2f800 20 searching for the correct realm 2024-09-14T11:17:45.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.367+0000 7f63dc121640 0 -- 172.21.15.2:0/3908504199 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x558d2f59c760 msgr2=0x558d2f59eb90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:45.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.371+0000 7f63db11f640 0 -- 172.21.15.2:0/3908504199 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f63cc018070 msgr2=0x7f63cc08b090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:17:45.372 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.374+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:17:45.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 zone default found 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 4 Realm: () 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 zonegroup default 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.375+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.376+0000 7f63dde2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.376+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.376+0000 7f63dde2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:17:45.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.376+0000 7f63dde2f800 20 started sync module instance, tier type = 2024-09-14T11:17:45.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.376+0000 7f63dde2f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.384+0000 7f63dde2f800 20 add_watcher() i=0 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.384+0000 7f63dde2f800 20 add_watcher() i=1 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.384+0000 7f63dde2f800 20 add_watcher() i=2 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.384+0000 7f63dde2f800 20 add_watcher() i=3 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.384+0000 7f63dde2f800 20 add_watcher() i=4 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.384+0000 7f63dde2f800 20 add_watcher() i=5 2024-09-14T11:17:45.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.385+0000 7f63dde2f800 20 add_watcher() i=6 2024-09-14T11:17:45.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.385+0000 7f63dde2f800 20 add_watcher() i=7 2024-09-14T11:17:45.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.385+0000 7f63dde2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:17:45.385 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.387+0000 7f6291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:45.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.387+0000 7f63dde2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.387+0000 7f63dde2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.387+0000 7f63dde2f800 5 note: GC not initialized 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.387+0000 7f6290fe1640 20 reqs_thread_entry: start 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 20 init_complete bucket index max shards: 1 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 20 Filter name: none 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f620a7fc640 20 reqs_thread_entry: start 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:17:45.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:17:45.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 : miss 2024-09-14T11:17:45.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.388+0000 7f63dde2f800 20 rados->read ofs=0 len=0 2024-09-14T11:17:45.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.389+0000 7f63dde2f800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:17:45.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.389+0000 7f63dde2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:17:45.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.389+0000 7f63dde2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:17:45.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.389+0000 7f63dde2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:17:45.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.389+0000 7f63dde2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:17:45.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.389+0000 7f63dde2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 2024-09-14T11:17:45.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.390+0000 7f63dde2f800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to be held by another RGW process; skipping for now 2024-09-14T11:17:45.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.391+0000 7f6291fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:17:45.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.393+0000 7f63dde2f800 20 remove_watcher() i=0 2024-09-14T11:17:45.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.393+0000 7f63dde2f800 2 removed watcher, disabling cache 2024-09-14T11:17:45.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.394+0000 7f63dde2f800 20 remove_watcher() i=1 2024-09-14T11:17:45.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.395+0000 7f63dde2f800 20 remove_watcher() i=2 2024-09-14T11:17:45.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.396+0000 7f63dde2f800 20 remove_watcher() i=3 2024-09-14T11:17:45.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.397+0000 7f63dde2f800 20 remove_watcher() i=4 2024-09-14T11:17:45.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.398+0000 7f63dde2f800 20 remove_watcher() i=5 2024-09-14T11:17:45.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.399+0000 7f63dde2f800 20 remove_watcher() i=6 2024-09-14T11:17:45.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:17:45.400+0000 7f63dde2f800 20 remove_watcher() i=7 2024-09-14T11:17:45.409 INFO:tasks.workunit.client.0.smithi002.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-14T11:18:15.430 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 2 --rgw-reshard-bucket-lock-duration 30 2024-09-14T11:18:15.467 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:15.467 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:15.513 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.515+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.516+0000 7f967fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.516+0000 7f967fc0e800 20 realm 2024-09-14T11:18:15.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.516+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.516+0000 7f967fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.516+0000 7f967fc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:15.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.516+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.515 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.517+0000 7f967fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.517+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.518+0000 7f967fc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:15.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.518+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.518+0000 7f967fc0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:15.516 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.518+0000 7f967fc0e800 20 searching for the correct realm 2024-09-14T11:18:15.520 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.522+0000 7f967bc1b640 0 -- 172.21.15.2:0/3648176142 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f9670076430 msgr2=0x7f9670067e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:15.524 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.526+0000 7f967b41a640 0 -- 172.21.15.2:0/3648176142 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f9670072020 msgr2=0x7f9670013180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.734+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 zone default found 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 4 Realm: () 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 zonegroup default 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.735+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.736+0000 7f967fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.736+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.736+0000 7f967fc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.736+0000 7f967fc0e800 20 started sync module instance, tier type = 2024-09-14T11:18:15.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.736+0000 7f967fc0e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:15.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.747+0000 7f967fc0e800 20 add_watcher() i=0 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.747+0000 7f967fc0e800 20 add_watcher() i=1 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.747+0000 7f967fc0e800 20 add_watcher() i=2 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.747+0000 7f967fc0e800 20 add_watcher() i=3 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.747+0000 7f967fc0e800 20 add_watcher() i=4 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.747+0000 7f967fc0e800 20 add_watcher() i=5 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.747+0000 7f967fc0e800 20 add_watcher() i=6 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.748+0000 7f967fc0e800 20 add_watcher() i=7 2024-09-14T11:18:15.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.748+0000 7f967fc0e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:15.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.750+0000 7f9531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:15.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f967fc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:15.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f967fc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:15.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f967fc0e800 5 note: GC not initialized 2024-09-14T11:18:15.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f9530fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:15.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f967fc0e800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:15.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f967fc0e800 20 Filter name: none 2024-09-14T11:18:15.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f94aa7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:15.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f967fc0e800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-14T11:18:15.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.751+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 : miss 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:18:15.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:18:15.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:15.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:18:15.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.752+0000 7f967fc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 2024-09-14T11:18:15.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.754+0000 7f967fc0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:18:15.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f967fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f967fc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f967fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f967fc0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39, ofs0, ns] 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f955e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464285 cookie 94664253152080 notifier 7592 bl.length()=931 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f955e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f955e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.758+0000 7f955e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:18:15.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.759+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_sources= new_sources= 2024-09-14T11:18:15.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.759+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential sources added=[] removed=[] 2024-09-14T11:18:15.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.759+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_dests= new_dests= 2024-09-14T11:18:15.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.759+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential dests added=[] removed=[] 2024-09-14T11:18:15.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.763+0000 7f967fc0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.2.0 2024-09-14T11:18:15.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.763+0000 7f967fc0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.2.0 2024-09-14T11:18:15.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.763+0000 7f967fc0e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.2.1 2024-09-14T11:18:15.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.763+0000 7f967fc0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.2.1 2024-09-14T11:18:15.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.763+0000 7f967fc0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.0 2024-09-14T11:18:15.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.765+0000 7f967fc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:15.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.765+0000 7f967fc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 2024-09-14T11:18:15.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.767+0000 7f967fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:18:15.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.767+0000 7f967fc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:18:15.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.767+0000 7f967fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:18:15.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.767+0000 7f967fc0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39, ofs0, ns] 2024-09-14T11:18:15.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.767+0000 7f955e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464286 cookie 94664253152080 notifier 7592 bl.length()=931 2024-09-14T11:18:15.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.768+0000 7f955e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:18:15.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.768+0000 7f955e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:18:15.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.768+0000 7f955e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:18:15.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.768+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_sources= new_sources= 2024-09-14T11:18:15.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.768+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential sources added=[] removed=[] 2024-09-14T11:18:15.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.768+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_dests= new_dests= 2024-09-14T11:18:15.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.768+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential dests added=[] removed=[] 2024-09-14T11:18:15.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.769+0000 7f967fc0e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.39.0 2024-09-14T11:18:15.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.770+0000 7f967fc0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 : hit (requested=0x17, cached=0x17) 2024-09-14T11:18:15.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.770+0000 7f967fc0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 2024-09-14T11:18:15.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.771+0000 7f967fc0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:18:15.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.771+0000 7f967fc0e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:18:15.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.771+0000 7f967fc0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:18:15.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.771+0000 7f967fc0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39, ofs0, ns] 2024-09-14T11:18:15.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f955e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464287 cookie 94664253152080 notifier 7592 bl.length()=899 2024-09-14T11:18:15.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f955e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 info.flags=0x17 2024-09-14T11:18:15.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f955e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 to cache LRU end 2024-09-14T11:18:15.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f955e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-14T11:18:15.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_sources= new_sources= 2024-09-14T11:18:15.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential sources added=[] removed=[] 2024-09-14T11:18:15.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): orig_dests= new_dests= 2024-09-14T11:18:15.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.772+0000 7f967fc0e800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[17edae97-cd6b-4c90-863d-862429a20cf3.4538.39]): potential dests added=[] removed=[] 2024-09-14T11:18:15.772 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.774+0000 7f967fc0e800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 1 shards to 2 shards completed successfully 2024-09-14T11:18:15.774 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.776+0000 7f9531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:15.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.778+0000 7f967fc0e800 20 remove_watcher() i=0 2024-09-14T11:18:15.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.778+0000 7f967fc0e800 2 removed watcher, disabling cache 2024-09-14T11:18:15.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.780+0000 7f967fc0e800 20 remove_watcher() i=1 2024-09-14T11:18:15.779 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.781+0000 7f967fc0e800 20 remove_watcher() i=2 2024-09-14T11:18:15.780 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.782+0000 7f967fc0e800 20 remove_watcher() i=3 2024-09-14T11:18:15.781 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.783+0000 7f967fc0e800 20 remove_watcher() i=4 2024-09-14T11:18:15.783 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.784+0000 7f967fc0e800 20 remove_watcher() i=5 2024-09-14T11:18:15.784 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.785+0000 7f967fc0e800 20 remove_watcher() i=6 2024-09-14T11:18:15.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.787+0000 7f967fc0e800 20 remove_watcher() i=7 2024-09-14T11:18:15.799 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-14T11:18:15.829 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:15.829 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:15.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.872+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 20 realm 2024-09-14T11:18:15.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:15.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:15.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.874+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.875+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:15.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.875+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:15.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.875+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:15.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.875+0000 7f2b97325800 20 searching for the correct realm 2024-09-14T11:18:15.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.878+0000 7f2b938a3640 0 -- 172.21.15.2:0/3566620075 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f2b88028040 msgr2=0x7f2b8806a2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:15.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:15.881+0000 7f2b930a2640 0 -- 172.21.15.2:0/3566620075 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2b88093a00 msgr2=0x7f2b88085130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.088 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.089+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.089 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 zone default found 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 4 Realm: () 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 zonegroup default 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.090+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.091+0000 7f2b97325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.090 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.091+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.091+0000 7f2b97325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.091+0000 7f2b97325800 20 started sync module instance, tier type = 2024-09-14T11:18:16.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.091+0000 7f2b97325800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:16.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.101+0000 7f2b97325800 20 add_watcher() i=0 2024-09-14T11:18:16.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.101+0000 7f2b97325800 20 add_watcher() i=1 2024-09-14T11:18:16.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.101+0000 7f2b97325800 20 add_watcher() i=2 2024-09-14T11:18:16.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.101+0000 7f2b97325800 20 add_watcher() i=3 2024-09-14T11:18:16.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.101+0000 7f2b97325800 20 add_watcher() i=4 2024-09-14T11:18:16.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.101+0000 7f2b97325800 20 add_watcher() i=5 2024-09-14T11:18:16.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.101+0000 7f2b97325800 20 add_watcher() i=6 2024-09-14T11:18:16.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.102+0000 7f2b97325800 20 add_watcher() i=7 2024-09-14T11:18:16.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.102+0000 7f2b97325800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:16.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2a49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2b97325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2b97325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2b97325800 5 note: GC not initialized 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2a48fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2b97325800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2b97325800 20 Filter name: none 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f29c27fc640 20 reqs_thread_entry: start 2024-09-14T11:18:16.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.104+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.105+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:18:16.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.105+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.105+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:18:16.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.105+0000 7f2b97325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:16.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.105+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.106+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=197 2024-09-14T11:18:16.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.106+0000 7f2b97325800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.106+0000 7f2b97325800 20 rados_obj.operate() r=0 bl.length=419 2024-09-14T11:18:16.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.106+0000 7f2b97325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:16.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.107+0000 7f2a49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:16.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.110+0000 7f2b97325800 20 remove_watcher() i=0 2024-09-14T11:18:16.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.110+0000 7f2b97325800 2 removed watcher, disabling cache 2024-09-14T11:18:16.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.111+0000 7f2b97325800 20 remove_watcher() i=1 2024-09-14T11:18:16.110 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.112+0000 7f2b97325800 20 remove_watcher() i=2 2024-09-14T11:18:16.111 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.113+0000 7f2b97325800 20 remove_watcher() i=3 2024-09-14T11:18:16.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.114+0000 7f2b97325800 20 remove_watcher() i=4 2024-09-14T11:18:16.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.115+0000 7f2b97325800 20 remove_watcher() i=5 2024-09-14T11:18:16.114 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.116+0000 7f2b97325800 20 remove_watcher() i=6 2024-09-14T11:18:16.115 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.117+0000 7f2b97325800 20 remove_watcher() i=7 2024-09-14T11:18:16.127 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:16.127 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:18:16.127 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: abort-at-change-reshard-state id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.39 num_objects: 19 size_kb: 1 num_shards: 2 2024-09-14T11:18:16.127 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:16.129 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:16.130 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:18:16.133 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:16.133 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:18:16.176 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:16.177 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:18:16.190 INFO:tasks.workunit.client.0.smithi002.stderr: test: logrecord could be stopped after reshard failed 2024-09-14T11:18:16.191 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:18:16.220 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:16.221 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:16.260 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.261+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.263+0000 7ff392e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.263+0000 7ff392e20800 20 realm 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.263+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.264+0000 7ff392e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.264+0000 7ff392e20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.264+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.264+0000 7ff392e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.264+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.265+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:16.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.265+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.265+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:16.263 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.265+0000 7ff392e20800 20 searching for the correct realm 2024-09-14T11:18:16.267 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.268+0000 7ff39110b640 0 -- 172.21.15.2:0/1094607068 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7ff384022020 msgr2=0x7ff3840733d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:16.270 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.272+0000 7ff39090a640 0 -- 172.21.15.2:0/1094607068 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7ff3840919e0 msgr2=0x7ff384076a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.478 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.479+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.479 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 20 zone default found 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 4 Realm: () 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 20 zonegroup default 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.480+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.481+0000 7ff392e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.481+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.481+0000 7ff392e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.481+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.481+0000 7ff392e20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.481+0000 7ff392e20800 20 started sync module instance, tier type = 2024-09-14T11:18:16.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.481+0000 7ff392e20800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:16.489 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.491+0000 7ff392e20800 20 add_watcher() i=0 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.491+0000 7ff392e20800 20 add_watcher() i=1 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.491+0000 7ff392e20800 20 add_watcher() i=2 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.491+0000 7ff392e20800 20 add_watcher() i=3 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.491+0000 7ff392e20800 20 add_watcher() i=4 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.491+0000 7ff392e20800 20 add_watcher() i=5 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.491+0000 7ff392e20800 20 add_watcher() i=6 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.492+0000 7ff392e20800 20 add_watcher() i=7 2024-09-14T11:18:16.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.492+0000 7ff392e20800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:16.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.494+0000 7ff246fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:16.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.494+0000 7ff392e20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:16.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.494+0000 7ff392e20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:16.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.494+0000 7ff392e20800 5 note: GC not initialized 2024-09-14T11:18:16.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.495+0000 7ff245fe3640 20 reqs_thread_entry: start 2024-09-14T11:18:16.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.495+0000 7ff392e20800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:16.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.495+0000 7ff392e20800 20 Filter name: none 2024-09-14T11:18:16.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.495+0000 7ff1b77fe640 20 reqs_thread_entry: start 2024-09-14T11:18:16.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.495+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.495+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:16.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.495+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.494 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.496+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:16.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.496+0000 7ff392e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:16.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.496+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.497+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:16.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.497+0000 7ff392e20800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.497+0000 7ff392e20800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:16.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.497+0000 7ff392e20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:16.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.498+0000 7ff246fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:16.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.501+0000 7ff392e20800 20 remove_watcher() i=0 2024-09-14T11:18:16.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.501+0000 7ff392e20800 2 removed watcher, disabling cache 2024-09-14T11:18:16.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.502+0000 7ff392e20800 20 remove_watcher() i=1 2024-09-14T11:18:16.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.503+0000 7ff392e20800 20 remove_watcher() i=2 2024-09-14T11:18:16.503 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.505+0000 7ff392e20800 20 remove_watcher() i=3 2024-09-14T11:18:16.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.506+0000 7ff392e20800 20 remove_watcher() i=4 2024-09-14T11:18:16.505 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.507+0000 7ff392e20800 20 remove_watcher() i=5 2024-09-14T11:18:16.506 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.508+0000 7ff392e20800 20 remove_watcher() i=6 2024-09-14T11:18:16.507 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.509+0000 7ff392e20800 20 remove_watcher() i=7 2024-09-14T11:18:16.518 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:16.518 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:18:16.518 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 8 size_kb: 1 num_shards: 3 2024-09-14T11:18:16.518 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:16.520 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:18:16.549 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:16.549 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:16.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.592+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.592 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 20 realm 2024-09-14T11:18:16.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:16.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.594+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.595+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:16.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.595+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.595+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:16.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.595+0000 7f587bd75800 20 searching for the correct realm 2024-09-14T11:18:16.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.599+0000 7f587a060640 0 -- 172.21.15.2:0/4293305317 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f587004c6e0 msgr2=0x7f587007a790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:16.601 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.602+0000 7f587985f640 0 -- 172.21.15.2:0/4293305317 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f58700951a0 msgr2=0x7f58700671e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:16.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.808+0000 7f587bd75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:16.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.808+0000 7f587bd75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:16.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.808+0000 7f587bd75800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:16.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.808+0000 7f587bd75800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:16.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.808+0000 7f587bd75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:16.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.808+0000 7f587bd75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:16.807 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.808+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.808 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 zone default found 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 4 Realm: () 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 zonegroup default 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.809+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.810+0000 7f587bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.810+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.810+0000 7f587bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.810+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.810+0000 7f587bd75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.810+0000 7f587bd75800 20 started sync module instance, tier type = 2024-09-14T11:18:16.810 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.810+0000 7f587bd75800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=0 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=1 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=2 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=3 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=4 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=5 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=6 2024-09-14T11:18:16.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 20 add_watcher() i=7 2024-09-14T11:18:16.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.821+0000 7f587bd75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:16.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.823+0000 7f572b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:16.821 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.823+0000 7f587bd75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:16.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.823+0000 7f587bd75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:16.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.823+0000 7f587bd75800 5 note: GC not initialized 2024-09-14T11:18:16.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.824+0000 7f572a7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:16.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.824+0000 7f587bd75800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:16.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.824+0000 7f587bd75800 20 Filter name: none 2024-09-14T11:18:16.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.824+0000 7f569ffff640 20 reqs_thread_entry: start 2024-09-14T11:18:16.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.824+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.824+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:16.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.824+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.825+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:16.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.825+0000 7f587bd75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:16.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.825+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.825+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:16.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.825+0000 7f587bd75800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.826+0000 7f587bd75800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:16.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.826+0000 7f587bd75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:16.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.827+0000 7f572b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:16.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.830+0000 7f587bd75800 20 remove_watcher() i=0 2024-09-14T11:18:16.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.830+0000 7f587bd75800 2 removed watcher, disabling cache 2024-09-14T11:18:16.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.831+0000 7f587bd75800 20 remove_watcher() i=1 2024-09-14T11:18:16.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.832+0000 7f587bd75800 20 remove_watcher() i=2 2024-09-14T11:18:16.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.833+0000 7f587bd75800 20 remove_watcher() i=3 2024-09-14T11:18:16.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.834+0000 7f587bd75800 20 remove_watcher() i=4 2024-09-14T11:18:16.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.835+0000 7f587bd75800 20 remove_watcher() i=5 2024-09-14T11:18:16.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.836+0000 7f587bd75800 20 remove_watcher() i=6 2024-09-14T11:18:16.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.837+0000 7f587bd75800 20 remove_watcher() i=7 2024-09-14T11:18:16.848 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-14T11:18:16.884 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:16.885 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:16.925 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.927+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.928+0000 7fbaf3323800 20 realm 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.928+0000 7fbaf3323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:16.927 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.930+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:16.928 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.930+0000 7fbaf3323800 20 searching for the correct realm 2024-09-14T11:18:16.931 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.933+0000 7fbaef80d640 0 -- 172.21.15.2:0/1949955505 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fbae4028940 msgr2=0x7fbae4008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:16.935 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:16.936+0000 7fbaef00c640 0 -- 172.21.15.2:0/1949955505 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fbae4037910 msgr2=0x7fbae40163d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:17.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:17.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:17.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:17.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:17.142 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:17.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.143 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:17.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 zone default found 2024-09-14T11:18:17.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 4 Realm: () 2024-09-14T11:18:17.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:17.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:17.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 zonegroup default 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.145+0000 7fbaf3323800 20 started sync module instance, tier type = 2024-09-14T11:18:17.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.145+0000 7fbaf3323800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:17.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=0 2024-09-14T11:18:17.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=1 2024-09-14T11:18:17.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=2 2024-09-14T11:18:17.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=3 2024-09-14T11:18:17.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=4 2024-09-14T11:18:17.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=5 2024-09-14T11:18:17.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=6 2024-09-14T11:18:17.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.157+0000 7fbaf3323800 20 add_watcher() i=7 2024-09-14T11:18:17.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.157+0000 7fbaf3323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:17.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.159+0000 7fb9a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:17.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.159+0000 7fbaf3323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:17.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.159+0000 7fbaf3323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:17.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.159+0000 7fbaf3323800 5 note: GC not initialized 2024-09-14T11:18:17.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fb9a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:17.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:17.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 20 Filter name: none 2024-09-14T11:18:17.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fb91e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:17.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:17.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:17.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.161+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.161+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.161+0000 7fbaf3323800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.161+0000 7fbaf3323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.161+0000 7fbaf3323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.161+0000 7fbaf3323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:17.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fbaf3323800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fbaf3323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fbaf3323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 94254280531584 notifier 7661 bl.length()=827 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:18:17.164 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.1 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.1 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.2 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.2 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.3 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.3 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.169+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.169+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.169+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.168 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.169+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.169 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbaf3323800 time 2024-09-14T11:18:17.172600+0000 2024-09-14T11:18:17.170 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:17.170 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbaf498c76a] 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:18:17.171 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fbaf3323800 thread_name:radosgw-admin 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.172+0000 7fbaf3323800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbaf3323800 time 2024-09-14T11:18:17.172600+0000 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbaf498c76a] 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:18:17.172 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.173 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:18:17.173 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:18:17.173 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.189 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.189 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbaf363e6f0] 2024-09-14T11:18:17.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbaf368b99c] 2024-09-14T11:18:17.189 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbaf498c7c4] 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.173+0000 7fbaf3323800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fbaf3323800 thread_name:radosgw-admin 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.190 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbaf363e6f0] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbaf368b99c] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbaf498c7c4] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:18:17.191 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:18:16.909+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: starting msgr at 2024-09-14T11:18:17.192 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: starting objecter 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command objecter_requests hook 0x55b948d98a90 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: setting wanted keys 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: calling monclient init 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:18:16.909+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding auth protocol: cephx 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding auth protocol: cephx 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding auth protocol: cephx 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.193 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:18:16.909+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:18:16.910+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:18:16.910+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key hook 0x55b948d946e8 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948c1f7a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948cd78d0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948cdd9c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.194 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.462506s 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948c1f7a0 auth_method 0 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948cd78d0 auth_method 0 2024-09-14T11:18:17.195 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948cdd9c0 auth_method 0 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:18:16.911+0000 7fbaef00c640 10 monclient(hunting): handle_auth_done global_id 8049 payload 824 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:18:16.911+0000 7fbaef00c640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:18:16.911+0000 7fbaef00c640 1 monclient: found mon.noname-a 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:18:16.911+0000 7fbaef00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.196 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: dump: 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.197 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: dump: 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.198 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:18:16.911+0000 7fbaf3323800 5 monclient: authenticate success, global_id 8049 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:18:16.911+0000 7fb9dd60a640 4 set_mon_vals no callback set 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:18:16.911+0000 7fbaf3323800 1 librados: init done 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:18:16.913+0000 7fb9dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:18:16.913+0000 7fb9dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:18:16.913+0000 7fb9dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:18:16.914+0000 7fbaee80b640 10 monclient: get_auth_request con 0x7fb9d4077260 auth_method 0 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:18:16.914+0000 7fbaef80d640 10 monclient: get_auth_request con 0x55b948dd31d0 auth_method 0 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:18:16.914+0000 7fbaef00c640 10 monclient: get_auth_request con 0x55b948ddfe70 auth_method 0 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:18:16.916+0000 7fbaee80b640 10 monclient: get_auth_request con 0x55b948de36d0 auth_method 0 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:18:16.916+0000 7fbaf3323800 10 monclient: build_initial_monmap 2024-09-14T11:18:17.199 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:18:16.916+0000 7fbaf3323800 1 build_initial for_mkfs: 0 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:18:16.916+0000 7fbaf3323800 10 monclient: monmap: 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding auth protocol: cephx 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding auth protocol: cephx 2024-09-14T11:18:17.200 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding auth protocol: cephx 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.201 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:18:16.917+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command objecter_requests cmddesc objecter_requests hook 0x55b948dec720 EEXIST 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:18:16.917+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding auth protocol: cephx 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding auth protocol: cephx 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding auth protocol: cephx 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.202 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:18:16.917+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:18:16.918+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:18:16.918+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key cmddesc rotate-key hook 0x55b948de82d0 EEXIST 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948e10a40 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948e10e20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948e0f750 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.203 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.470122s 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948e0f750 auth_method 0 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948e10e20 auth_method 0 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948e10a40 auth_method 0 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.204 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_done global_id 8052 payload 824 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:18:16.918+0000 7fbaef80d640 1 monclient: found mon.noname-a 2024-09-14T11:18:17.205 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: dump: 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.206 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: dump: 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.207 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:18:16.918+0000 7fbaf3323800 5 monclient: authenticate success, global_id 8052 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:18:16.918+0000 7fbaf000e640 4 set_mon_vals no callback set 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:18:16.920+0000 7fb9d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:18:16.920+0000 7fb9d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:18:16.920+0000 7fb9d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:18:16.921+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fb9c8077140 auth_method 0 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: get_monmap_and_config 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: build_initial_monmap 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:18:16.921+0000 7fbaf3323800 1 build_initial for_mkfs: 0 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: monmap: 2024-09-14T11:18:17.208 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding auth protocol: cephx 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding auth protocol: cephx 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding auth protocol: cephx 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.209 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:18:16.921+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.210 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding auth protocol: cephx 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding auth protocol: cephx 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding auth protocol: cephx 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.211 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:18:16.921+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:18:16.922+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:18:16.922+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key cmddesc rotate-key hook 0x7ffd7737bb48 EEXIST 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948e64c20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948e55570 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948e60050 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.212 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.474302s 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948e64c20 auth_method 0 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948e60050 auth_method 0 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.213 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948e55570 auth_method 0 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_done global_id 7658 payload 274 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:18:16.922+0000 7fbaef00c640 1 monclient: found mon.noname-c 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: dump: 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.214 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: dump: 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.215 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:18:16.922+0000 7fbaf3323800 5 monclient: authenticate success, global_id 7658 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:18:16.922+0000 7fbaf3323800 4 set_mon_vals no callback set 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:18:16.923+0000 7fbaf3323800 10 monclient: shutdown 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:18:16.923+0000 7fbaf3323800 10 monclient: build_initial_monmap 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:18:16.923+0000 7fbaf3323800 1 build_initial for_mkfs: 0 2024-09-14T11:18:17.216 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:18:16.923+0000 7fbaf3323800 10 monclient: monmap: 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding auth protocol: cephx 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding auth protocol: cephx 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding auth protocol: cephx 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.217 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:18:16.923+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:18:16.923+0000 7fbaf3323800 1 librados: starting msgr at 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:18:16.923+0000 7fbaf3323800 1 librados: starting objecter 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command objecter_requests cmddesc objecter_requests hook 0x55b948e61e20 EEXIST 2024-09-14T11:18:17.218 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:18:16.924+0000 7fbaf3323800 1 librados: setting wanted keys 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:18:16.924+0000 7fbaf3323800 1 librados: calling monclient init 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding auth protocol: cephx 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding auth protocol: cephx 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding auth protocol: cephx 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.219 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:18:16.924+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:18:16.924+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key cmddesc rotate-key hook 0x55b948e25448 EEXIST 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948e55570 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948e60050 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948e64c20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.220 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.476694s 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948e60050 auth_method 0 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948e64c20 auth_method 0 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.221 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948e55570 auth_method 0 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:18:16.925+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:18:16.925+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:18:16.925+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:18:16.925+0000 7fbaef80d640 10 monclient(hunting): handle_auth_done global_id 7661 payload 824 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:18:16.925+0000 7fbaef80d640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:18:16.925+0000 7fbaef80d640 1 monclient: found mon.noname-c 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:18:16.925+0000 7fbaef80d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.222 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: dump: 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.223 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: dump: 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:18:16.925+0000 7fbaf3323800 5 monclient: authenticate success, global_id 7661 2024-09-14T11:18:17.224 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:18:16.925+0000 7fb9d2ffd640 4 set_mon_vals no callback set 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:18:16.925+0000 7fbaf3323800 1 librados: init done 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:18:16.925+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cr dump hook 0x55b948e5cb38 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:18:16.927+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:18:16.927+0000 7fb9d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:18:16.927+0000 7fb9d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:18:16.927+0000 7fb9d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:18:16.927+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fb9b8077260 auth_method 0 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:18:16.928+0000 7fbaee80b640 10 monclient: get_auth_request con 0x55b948e7eec0 auth_method 0 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 realm 2024-09-14T11:18:17.225 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:18:16.928+0000 7fbaf3323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:18:16.929+0000 7fbaef00c640 10 monclient: get_auth_request con 0x55b948e83310 auth_method 0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:18:16.930+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:18:16.930+0000 7fbaf3323800 20 searching for the correct realm 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:18:16.930+0000 7fbaee80b640 10 monclient: get_auth_request con 0x55b948e88490 auth_method 0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:18:16.931+0000 7fbaef80d640 10 monclient: get_auth_request con 0x7fbae4028940 auth_method 0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:18:16.932+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fbae806a040 auth_method 0 2024-09-14T11:18:17.226 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:18:16.932+0000 7fbaee80b640 10 monclient: get_auth_request con 0x7fbae0074070 auth_method 0 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:18:16.933+0000 7fbaef80d640 0 -- 172.21.15.2:0/1949955505 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fbae4028940 msgr2=0x7fbae4008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:18:16.933+0000 7fb9d17fa640 1 client.7661.objecter ms_handle_reset 0x7fbae4028940 session 0x7fbae4005040 osd.7 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:18:16.933+0000 7fb9d17fa640 10 monclient: _renew_subs 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:18:16.933+0000 7fb9d17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:18:16.933+0000 7fbaef80d640 10 monclient: get_auth_request con 0x7fb9b8087080 auth_method 0 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:18:16.934+0000 7fbaef80d640 10 monclient: get_auth_request con 0x7fbae4045400 auth_method 0 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:18:16.936+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fbae4037910 auth_method 0 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:18:16.936+0000 7fbaef00c640 0 -- 172.21.15.2:0/1949955505 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fbae4037910 msgr2=0x7fbae40163d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:18:17.138+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fbae4037910 auth_method 0 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:17.227 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 zone default found 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:18:17.144+0000 7fbaf3323800 4 Realm: () 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:18:17.144+0000 7fbaf3323800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:18:17.144+0000 7fbaf3323800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:18:17.144+0000 7fbaf3323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 zonegroup default 2024-09-14T11:18:17.228 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 started sync module instance, tier type = 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=0 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=1 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=2 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=3 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=4 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=5 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=6 2024-09-14T11:18:17.229 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:18:17.157+0000 7fbaf3323800 20 add_watcher() i=7 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:18:17.157+0000 7fbaf3323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding auth protocol: cephx 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding auth protocol: cephx 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding auth protocol: cephx 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.230 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:18:17.159+0000 7fb9a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:18:17.159+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:18:17.159+0000 7fbaf3323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:18:17.159+0000 7fbaf3323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache list hook 0x55b948e59d90 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache inspect hook 0x55b948e59d90 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache erase hook 0x55b948e59d90 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache zap hook 0x55b948e59d90 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 note: GC not initialized 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:18:17.160+0000 7fb9a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:17.231 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace show hook 0x7fbae4004540 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace history hook 0x7fbae4004540 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace active hook 0x7fbae4004540 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace active_short hook 0x7fbae4004540 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 Filter name: none 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:18:17.160+0000 7fb91e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.232 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:18:17.161+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 94254280531584 notifier 7661 bl.length()=827 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.233 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.1 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.1 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.2 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.2 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.3 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.3 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.234 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:18:17.169+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:18:17.169+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:18:17.169+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:18:17.169+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:18:17.172+0000 7fbaf3323800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbaf3323800 time 2024-09-14T11:18:17.172600+0000 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbaf498c76a] 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:18:17.235 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:18:17.173+0000 7fbaf3323800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fbaf3323800 thread_name:radosgw-admin 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbaf363e6f0] 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbaf368b99c] 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbaf498c7c4] 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.236 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:18:17.237 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:18:17.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:18:17.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:18:17.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:18:17.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:17.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:17.243 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb91e7fc640 / http_manager 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9a4fe1640 / http_manager 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9a5fe3640 / rgw_dt_lg_renew 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9d17fa640 / ms_dispatch 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9d2ffd640 / io_context_pool 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9d9602640 / ms_dispatch 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9dbe07640 / ms_dispatch 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9dd60a640 / io_context_pool 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaee80b640 / msgr-worker-2 2024-09-14T11:18:17.244 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaef00c640 / msgr-worker-1 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaef80d640 / msgr-worker-0 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaf000e640 / io_context_pool 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaf3323800 / radosgw-admin 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.145024.log 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.245 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: crc 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:18:16.908+0000 7fbaf3323800 5 AuthRegistry(0x55b948d9a120) adding con mode: secure 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:18:16.909+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: starting msgr at 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: starting objecter 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command objecter_requests hook 0x55b948d98a90 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: setting wanted keys 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:18:16.909+0000 7fbaf3323800 1 librados: calling monclient init 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:18:16.909+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding auth protocol: cephx 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding auth protocol: cephx 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding auth protocol: cephx 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.246 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: crc 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:18:16.909+0000 7fbaf3323800 5 AuthRegistry(0x55b948d945a0) adding con mode: secure 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:18:16.909+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:18:16.910+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:18:16.910+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key hook 0x55b948d946e8 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:17.247 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948c1f7a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948cd78d0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948cdd9c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:18:16.910+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.462506s 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948c1f7a0 auth_method 0 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:18:16.910+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.248 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948cd78d0 auth_method 0 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:18:16.910+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948cdd9c0 auth_method 0 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:18:16.911+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:18:16.911+0000 7fbaef00c640 10 monclient(hunting): handle_auth_done global_id 8049 payload 824 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:18:16.911+0000 7fbaef00c640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:18:16.911+0000 7fbaef00c640 1 monclient: found mon.noname-a 2024-09-14T11:18:17.249 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:18:16.911+0000 7fbaef00c640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: dump: 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.250 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:18:16.911+0000 7fb9dbe07640 10 monclient: dump: 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.251 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:18:16.911+0000 7fbaf3323800 5 monclient: authenticate success, global_id 8049 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:18:16.911+0000 7fb9dd60a640 4 set_mon_vals no callback set 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:18:16.911+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.252 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:18:16.911+0000 7fbaf3323800 1 librados: init done 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:18:16.913+0000 7fb9dbe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:18:16.913+0000 7fb9dbe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:18:16.913+0000 7fb9dbe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:18:16.914+0000 7fbaee80b640 10 monclient: get_auth_request con 0x7fb9d4077260 auth_method 0 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:18:16.914+0000 7fbaef80d640 10 monclient: get_auth_request con 0x55b948dd31d0 auth_method 0 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:18:16.914+0000 7fbaef00c640 10 monclient: get_auth_request con 0x55b948ddfe70 auth_method 0 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:18:16.916+0000 7fbaee80b640 10 monclient: get_auth_request con 0x55b948de36d0 auth_method 0 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:18:16.916+0000 7fbaf3323800 10 monclient: build_initial_monmap 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:18:16.916+0000 7fbaf3323800 1 build_initial for_mkfs: 0 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:18:16.916+0000 7fbaf3323800 10 monclient: monmap: 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:17.253 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding auth protocol: cephx 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding auth protocol: cephx 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding auth protocol: cephx 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.254 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: crc 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:18:16.916+0000 7fbaf3323800 5 AuthRegistry(0x55b948de91f0) adding con mode: secure 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:18:16.917+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command objecter_requests cmddesc objecter_requests hook 0x55b948dec720 EEXIST 2024-09-14T11:18:17.255 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:18:16.917+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding auth protocol: cephx 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding auth protocol: cephx 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding auth protocol: cephx 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.256 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: crc 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:18:16.917+0000 7fbaf3323800 5 AuthRegistry(0x55b948de8188) adding con mode: secure 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:18:16.917+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:18:16.918+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:18:16.918+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key cmddesc rotate-key hook 0x55b948de82d0 EEXIST 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948e10a40 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948e10e20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948e0f750 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.257 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.470122s 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948e0f750 auth_method 0 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948e10e20 auth_method 0 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948e10a40 auth_method 0 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.258 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:18:16.918+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:18:16.918+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient(hunting): handle_auth_done global_id 8052 payload 824 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:18:16.918+0000 7fbaef80d640 1 monclient: found mon.noname-a 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:18:16.918+0000 7fbaef80d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:17.259 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: dump: 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.260 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:18:16.918+0000 7fb9d9602640 10 monclient: dump: 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:18:16.918+0000 7fbaf3323800 5 monclient: authenticate success, global_id 8052 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.261 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:18:16.918+0000 7fbaf000e640 4 set_mon_vals no callback set 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:18:16.918+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:18:16.920+0000 7fb9d9602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:18:16.920+0000 7fb9d9602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:18:16.920+0000 7fb9d9602640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:18:16.921+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fb9c8077140 auth_method 0 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: get_monmap_and_config 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: build_initial_monmap 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:18:16.921+0000 7fbaf3323800 1 build_initial for_mkfs: 0 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: monmap: 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:17.262 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding auth protocol: cephx 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding auth protocol: cephx 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding auth protocol: cephx 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.263 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: crc 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x55b948e30670) adding con mode: secure 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:18:16.921+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:18:16.921+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding auth protocol: cephx 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding auth protocol: cephx 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding auth protocol: cephx 2024-09-14T11:18:17.264 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: crc 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:18:16.921+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737ba00) adding con mode: secure 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:18:16.921+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:18:16.922+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:18:16.922+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key cmddesc rotate-key hook 0x7ffd7737bb48 EEXIST 2024-09-14T11:18:17.265 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948e64c20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948e55570 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948e60050 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.474302s 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948e64c20 auth_method 0 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948e60050 auth_method 0 2024-09-14T11:18:17.266 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:18:16.922+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948e55570 auth_method 0 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:18:16.922+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient(hunting): handle_auth_done global_id 7658 payload 274 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:18:16.922+0000 7fbaef00c640 1 monclient: found mon.noname-c 2024-09-14T11:18:17.267 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:18:16.922+0000 7fbaef00c640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: dump: 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.268 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:18:16.922+0000 7fb9d2ffd640 10 monclient: dump: 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.269 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:18:16.922+0000 7fbaf3323800 5 monclient: authenticate success, global_id 7658 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:18:16.922+0000 7fbaf3323800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:18:16.922+0000 7fbaf3323800 4 set_mon_vals no callback set 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:18:16.923+0000 7fbaf3323800 10 monclient: shutdown 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:18:16.923+0000 7fbaf3323800 10 monclient: build_initial_monmap 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:18:16.923+0000 7fbaf3323800 1 build_initial for_mkfs: 0 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:18:16.923+0000 7fbaf3323800 10 monclient: monmap: 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:17.270 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding auth protocol: cephx 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding auth protocol: cephx 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding auth protocol: cephx 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.271 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: crc 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 AuthRegistry(0x55b948e55a60) adding con mode: secure 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:18:16.923+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:18:16.923+0000 7fbaf3323800 1 librados: starting msgr at 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:18:16.923+0000 7fbaf3323800 1 librados: starting objecter 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:18:16.923+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command objecter_requests cmddesc objecter_requests hook 0x55b948e61e20 EEXIST 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:18:16.924+0000 7fbaf3323800 1 librados: setting wanted keys 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:18:16.924+0000 7fbaf3323800 1 librados: calling monclient init 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient: init 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding auth protocol: cephx 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding auth protocol: cephx 2024-09-14T11:18:17.272 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding auth protocol: cephx 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: crc 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 AuthRegistry(0x55b948e25300) adding con mode: secure 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:18:16.924+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:18:16.924+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.273 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:18:16.924+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command rotate-key cmddesc rotate-key hook 0x55b948e25448 EEXIST 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-b con 0x55b948e55570 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-a con 0x55b948e60050 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): picked mon.noname-c con 0x55b948e64c20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:18:16.924+0000 7fbaf3323800 10 monclient(hunting): authenticate will time out at 2123.476694s 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): get_auth_request con 0x55b948e60050 auth_method 0 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.274 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): get_auth_request con 0x55b948e64c20 auth_method 0 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:18:16.924+0000 7fbaef80d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:18:16.924+0000 7fbaee80b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): get_auth_request con 0x55b948e55570 auth_method 0 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:18:16.924+0000 7fbaef00c640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:18:16.925+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:18:16.925+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:17.275 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:18:16.925+0000 7fbaef00c640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:18:16.925+0000 7fbaef80d640 10 monclient(hunting): handle_auth_done global_id 7661 payload 824 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:18:16.925+0000 7fbaef80d640 10 monclient: _finish_hunting 0 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:18:16.925+0000 7fbaef80d640 1 monclient: found mon.noname-c 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:18:16.925+0000 7fbaef80d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: dump: 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.276 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: _finish_auth 0 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: _check_auth_tickets 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:18:16.925+0000 7fb9d17fa640 10 monclient: dump: 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:17.277 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:18:16.925+0000 7fbaf3323800 5 monclient: authenticate success, global_id 7661 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:18:16.925+0000 7fb9d2ffd640 4 set_mon_vals no callback set 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _renew_subs 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:18:16.925+0000 7fbaf3323800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:18:16.925+0000 7fbaf3323800 1 librados: init done 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:18:16.925+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cr dump hook 0x55b948e5cb38 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:18:16.927+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:18:16.927+0000 7fb9d17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:18:16.927+0000 7fb9d17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.278 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:18:16.927+0000 7fb9d17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:18:16.927+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fb9b8077260 auth_method 0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:18:16.928+0000 7fbaee80b640 10 monclient: get_auth_request con 0x55b948e7eec0 auth_method 0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 realm 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:18:16.928+0000 7fbaf3323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:18:16.928+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:18:16.929+0000 7fbaef00c640 10 monclient: get_auth_request con 0x55b948e83310 auth_method 0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:18:16.929+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:18:16.930+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:17.279 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:18:16.930+0000 7fbaf3323800 20 searching for the correct realm 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:18:16.930+0000 7fbaee80b640 10 monclient: get_auth_request con 0x55b948e88490 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:18:16.931+0000 7fbaef80d640 10 monclient: get_auth_request con 0x7fbae4028940 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:18:16.932+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fbae806a040 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:18:16.932+0000 7fbaee80b640 10 monclient: get_auth_request con 0x7fbae0074070 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:18:16.933+0000 7fbaef80d640 0 -- 172.21.15.2:0/1949955505 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fbae4028940 msgr2=0x7fbae4008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:18:16.933+0000 7fb9d17fa640 1 client.7661.objecter ms_handle_reset 0x7fbae4028940 session 0x7fbae4005040 osd.7 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:18:16.933+0000 7fb9d17fa640 10 monclient: _renew_subs 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:18:16.933+0000 7fb9d17fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:18:16.933+0000 7fbaef80d640 10 monclient: get_auth_request con 0x7fb9b8087080 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:18:16.934+0000 7fbaef80d640 10 monclient: get_auth_request con 0x7fbae4045400 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:18:16.936+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fbae4037910 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:18:16.936+0000 7fbaef00c640 0 -- 172.21.15.2:0/1949955505 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fbae4037910 msgr2=0x7fbae40163d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:18:17.138+0000 7fbaef00c640 10 monclient: get_auth_request con 0x7fbae4037910 auth_method 0 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:17.280 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:18:17.143+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 zone default found 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:18:17.144+0000 7fbaf3323800 4 Realm: () 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:18:17.144+0000 7fbaf3323800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:18:17.144+0000 7fbaf3323800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:17.281 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:18:17.144+0000 7fbaf3323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 zonegroup default 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:18:17.144+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 started sync module instance, tier type = 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:18:17.145+0000 7fbaf3323800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=0 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=1 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=2 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=3 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=4 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=5 2024-09-14T11:18:17.282 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:18:17.156+0000 7fbaf3323800 20 add_watcher() i=6 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:18:17.157+0000 7fbaf3323800 20 add_watcher() i=7 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:18:17.157+0000 7fbaf3323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding auth protocol: cephx 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding auth protocol: cephx 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding auth protocol: cephx 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.283 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: crc 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 AuthRegistry(0x7ffd7737bee0) adding con mode: secure 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:18:17.159+0000 7fb9a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:18:17.159+0000 7fbaf3323800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:18:17.159+0000 7fbaf3323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:18:17.159+0000 7fbaf3323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache list hook 0x55b948e59d90 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache inspect hook 0x55b948e59d90 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache erase hook 0x55b948e59d90 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command cache zap hook 0x55b948e59d90 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:18:17.159+0000 7fbaf3323800 5 note: GC not initialized 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:18:17.160+0000 7fb9a4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace show hook 0x7fbae4004540 2024-09-14T11:18:17.284 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace history hook 0x7fbae4004540 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace active hook 0x7fbae4004540 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:18:17.160+0000 7fbaf3323800 5 asok(0x55b948b74270) register_command sync trace active_short hook 0x7fbae4004540 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 Filter name: none 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:18:17.160+0000 7fb91e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:18:17.160+0000 7fbaf3323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:18:17.160+0000 7fbaf3323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:18:17.161+0000 7fbaf3323800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.285 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:18:17.161+0000 7fbaf3323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:18:17.165+0000 7fbaf3323800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464325 cookie 94254280531584 notifier 7661 bl.length()=827 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:18:17.165+0000 7fb9d2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:18:17.286 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:18:17.166+0000 7fbaf3323800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.1 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.1 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.2 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.2 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.3 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.3 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:18:17.168+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:18:17.168+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:18:17.169+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:18:17.169+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:18:17.169+0000 7fbaf3323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:18:17.169+0000 7fbaf3323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:18:17.172+0000 7fbaf3323800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fbaf3323800 time 2024-09-14T11:18:17.172600+0000 2024-09-14T11:18:17.287 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fbaf498c76a] 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:18:17.173+0000 7fbaf3323800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:17.288 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7fbaf3323800 thread_name:radosgw-admin 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fbaf363e6f0] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fbaf368b99c] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fbaf498c7c4] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7fbaf498c928] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b94643d0b1] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1834) [0x55b94644c124] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55b94644cfc4] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fbaf3629590] 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:18:17.289 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:18:17.290 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:18:17.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:18:17.292 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:18:17.293 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:17.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:18:17.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb91e7fc640 / http_manager 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9a4fe1640 / http_manager 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9a5fe3640 / rgw_dt_lg_renew 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9d17fa640 / ms_dispatch 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9d2ffd640 / io_context_pool 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9d9602640 / ms_dispatch 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9dbe07640 / ms_dispatch 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fb9dd60a640 / io_context_pool 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaee80b640 / msgr-worker-2 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaef00c640 / msgr-worker-1 2024-09-14T11:18:17.296 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaef80d640 / msgr-worker-0 2024-09-14T11:18:17.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaf000e640 / io_context_pool 2024-09-14T11:18:17.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7fbaf3323800 / radosgw-admin 2024-09-14T11:18:17.297 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:18:17.297 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:18:17.297 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:18:17.174240Z_fb8ead0c-6c58-48d9-b4e1-5d1fef735da6/log 2024-09-14T11:18:17.297 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:18:17.297 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:18:17.298 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:17.298 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:17.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.252+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 20 realm 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.254+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.255+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.255+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.255+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.255+0000 7f63afb19800 20 searching for the correct realm 2024-09-14T11:18:17.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.257+0000 7f63ad60a640 0 -- 172.21.15.2:0/2872169813 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f63a801f040 msgr2=0x7f63a802d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:17.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.464+0000 7f63ade0b640 0 -- 172.21.15.2:0/2872169813 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f63a405d040 msgr2=0x7f63a40ac9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:17.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:17.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:17.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:17.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:17.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:17.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.470+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:17.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 zone default found 2024-09-14T11:18:17.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 4 Realm: () 2024-09-14T11:18:17.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 zonegroup default 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.471+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.472+0000 7f63afb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.472+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.472+0000 7f63afb19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.472+0000 7f63afb19800 20 started sync module instance, tier type = 2024-09-14T11:18:17.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.472+0000 7f63afb19800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:17.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.481+0000 7f63afb19800 20 add_watcher() i=0 2024-09-14T11:18:17.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.481+0000 7f63afb19800 20 add_watcher() i=1 2024-09-14T11:18:17.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.481+0000 7f63afb19800 20 add_watcher() i=2 2024-09-14T11:18:17.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.481+0000 7f63afb19800 20 add_watcher() i=3 2024-09-14T11:18:17.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.481+0000 7f63afb19800 20 add_watcher() i=4 2024-09-14T11:18:17.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.481+0000 7f63afb19800 20 add_watcher() i=5 2024-09-14T11:18:17.480 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.481+0000 7f63afb19800 20 add_watcher() i=6 2024-09-14T11:18:17.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.482+0000 7f63afb19800 20 add_watcher() i=7 2024-09-14T11:18:17.481 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.482+0000 7f63afb19800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:17.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.484+0000 7f62637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:17.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f63afb19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:17.483 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f63afb19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:17.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f63afb19800 5 note: GC not initialized 2024-09-14T11:18:17.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f62627e4640 20 reqs_thread_entry: start 2024-09-14T11:18:17.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f63afb19800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:17.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f63afb19800 20 Filter name: none 2024-09-14T11:18:17.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f61d3fff640 20 reqs_thread_entry: start 2024-09-14T11:18:17.484 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.485+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.486+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:17.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.486+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.486+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:17.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.487+0000 7f63afb19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:17.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.487+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.487+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:17.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.487+0000 7f63afb19800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.487+0000 7f63afb19800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:17.486 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.487+0000 7f63afb19800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:17.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.489+0000 7f62637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:17.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.492+0000 7f63afb19800 20 remove_watcher() i=0 2024-09-14T11:18:17.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.492+0000 7f63afb19800 2 removed watcher, disabling cache 2024-09-14T11:18:17.492 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.494+0000 7f63afb19800 20 remove_watcher() i=1 2024-09-14T11:18:17.493 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.495+0000 7f63afb19800 20 remove_watcher() i=2 2024-09-14T11:18:17.495 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.496+0000 7f63afb19800 20 remove_watcher() i=3 2024-09-14T11:18:17.496 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.498+0000 7f63afb19800 20 remove_watcher() i=4 2024-09-14T11:18:17.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.499+0000 7f63afb19800 20 remove_watcher() i=5 2024-09-14T11:18:17.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.500+0000 7f63afb19800 20 remove_watcher() i=6 2024-09-14T11:18:17.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.501+0000 7f63afb19800 20 remove_watcher() i=7 2024-09-14T11:18:17.514 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:17.514 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:18:17.523 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:18:17.552 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:17.553 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:17.593 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.595+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 20 realm 2024-09-14T11:18:17.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:17.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.597+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.598+0000 7f1f7b42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.598+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.598+0000 7f1f7b42f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:17.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.598+0000 7f1f7b42f800 20 searching for the correct realm 2024-09-14T11:18:17.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.601+0000 7f1f73fff640 0 -- 172.21.15.2:0/1843973685 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f1f6c084030 msgr2=0x7f1f6c007720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.605+0000 7f1f78f19640 0 -- 172.21.15.2:0/1843973685 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1f640880d0 msgr2=0x7f1f640847e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.812+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 zone default found 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 4 Realm: () 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 zonegroup default 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.813 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.813+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.814+0000 7f1f7b42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.814+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.814+0000 7f1f7b42f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:17.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.814+0000 7f1f7b42f800 20 started sync module instance, tier type = 2024-09-14T11:18:17.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.814+0000 7f1f7b42f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:17.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.826+0000 7f1f7b42f800 20 add_watcher() i=0 2024-09-14T11:18:17.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.826+0000 7f1f7b42f800 20 add_watcher() i=1 2024-09-14T11:18:17.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.826+0000 7f1f7b42f800 20 add_watcher() i=2 2024-09-14T11:18:17.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.826+0000 7f1f7b42f800 20 add_watcher() i=3 2024-09-14T11:18:17.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.826+0000 7f1f7b42f800 20 add_watcher() i=4 2024-09-14T11:18:17.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.826+0000 7f1f7b42f800 20 add_watcher() i=5 2024-09-14T11:18:17.825 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.826+0000 7f1f7b42f800 20 add_watcher() i=6 2024-09-14T11:18:17.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.828+0000 7f1f7b42f800 20 add_watcher() i=7 2024-09-14T11:18:17.826 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.828+0000 7f1f7b42f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:17.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.829+0000 7f1e2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1f7b42f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1f7b42f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1f7b42f800 5 note: GC not initialized 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1e2dfe3640 20 reqs_thread_entry: start 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1f7b42f800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1f7b42f800 20 Filter name: none 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1d9f7fe640 20 reqs_thread_entry: start 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1f7b42f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:17.829 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.830+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.831+0000 7f1f7b42f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:17.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.831+0000 7f1f7b42f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:17.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.831+0000 7f1f7b42f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.831+0000 7f1f7b42f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.831+0000 7f1f7b42f800 20 rados->read ofs=0 len=0 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.832+0000 7f1f7b42f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:17.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.833+0000 7f1f7b42f800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.833+0000 7f1f7b42f800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:17.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.834+0000 7f1e2efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:17.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.836+0000 7f1f7b42f800 20 remove_watcher() i=0 2024-09-14T11:18:17.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.836+0000 7f1f7b42f800 2 removed watcher, disabling cache 2024-09-14T11:18:17.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.837+0000 7f1f7b42f800 20 remove_watcher() i=1 2024-09-14T11:18:17.837 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.839+0000 7f1f7b42f800 20 remove_watcher() i=2 2024-09-14T11:18:17.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.840+0000 7f1f7b42f800 20 remove_watcher() i=3 2024-09-14T11:18:17.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.841+0000 7f1f7b42f800 20 remove_watcher() i=4 2024-09-14T11:18:17.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.842+0000 7f1f7b42f800 20 remove_watcher() i=5 2024-09-14T11:18:17.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.843+0000 7f1f7b42f800 20 remove_watcher() i=6 2024-09-14T11:18:17.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:17.844+0000 7f1f7b42f800 20 remove_watcher() i=7 2024-09-14T11:18:47.872 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:18:47.905 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:47.905 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:47.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.952+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:47.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 20 realm 2024-09-14T11:18:47.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:47.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:47.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:47.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.954+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.955+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:47.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.955+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.955+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:47.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.955+0000 7f96af540800 20 searching for the correct realm 2024-09-14T11:18:47.958 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.959+0000 7f96abac1640 0 -- 172.21.15.2:0/673428856 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f96a00d7030 msgr2=0x7f96a0058740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:47.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.964+0000 7f96ab2c0640 0 -- 172.21.15.2:0/673428856 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f96a00e0110 msgr2=0x7f96a005a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:47.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:47.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:47.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:47.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:47.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:47.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:47.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:47.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.969+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:47.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 zone default found 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 4 Realm: () 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 zonegroup default 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:47.971 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.970+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.971+0000 7f96af540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:47.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.971+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.971+0000 7f96af540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:47.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.971+0000 7f96af540800 20 started sync module instance, tier type = 2024-09-14T11:18:47.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.971+0000 7f96af540800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:47.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.982+0000 7f96af540800 20 add_watcher() i=0 2024-09-14T11:18:47.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.982+0000 7f96af540800 20 add_watcher() i=1 2024-09-14T11:18:47.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.982+0000 7f96af540800 20 add_watcher() i=2 2024-09-14T11:18:47.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.982+0000 7f96af540800 20 add_watcher() i=3 2024-09-14T11:18:47.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.982+0000 7f96af540800 20 add_watcher() i=4 2024-09-14T11:18:47.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.982+0000 7f96af540800 20 add_watcher() i=5 2024-09-14T11:18:47.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.982+0000 7f96af540800 20 add_watcher() i=6 2024-09-14T11:18:47.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.983+0000 7f96af540800 20 add_watcher() i=7 2024-09-14T11:18:47.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.983+0000 7f96af540800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f9561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f96af540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f96af540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f96af540800 5 note: GC not initialized 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f9560fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f96af540800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f96af540800 20 Filter name: none 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.985+0000 7f94da7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:47.985 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.986+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.986+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:47.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.986+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.986+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:47.986 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.987+0000 7f96af540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:47.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.987+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.987+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:47.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.987+0000 7f96af540800 20 rados->read ofs=0 len=0 2024-09-14T11:18:47.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.987+0000 7f96af540800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:47.987 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.988+0000 7f96af540800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:47.988 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.989+0000 7f9561fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:47.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.991+0000 7f96af540800 20 remove_watcher() i=0 2024-09-14T11:18:47.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.992+0000 7f96af540800 2 removed watcher, disabling cache 2024-09-14T11:18:47.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.993+0000 7f96af540800 20 remove_watcher() i=1 2024-09-14T11:18:47.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.994+0000 7f96af540800 20 remove_watcher() i=2 2024-09-14T11:18:47.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.995+0000 7f96af540800 20 remove_watcher() i=3 2024-09-14T11:18:47.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.996+0000 7f96af540800 20 remove_watcher() i=4 2024-09-14T11:18:47.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.997+0000 7f96af540800 20 remove_watcher() i=5 2024-09-14T11:18:47.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.998+0000 7f96af540800 20 remove_watcher() i=6 2024-09-14T11:18:47.998 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:47.999+0000 7f96af540800 20 remove_watcher() i=7 2024-09-14T11:18:48.012 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:48.013 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:18:48.031 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:18:48.060 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:48.060 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:48.099 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.100+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.101+0000 7f2d23323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.101+0000 7f2d23323800 20 realm 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.101+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.102+0000 7f2d23323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.102+0000 7f2d23323800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.102+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.102+0000 7f2d23323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.102+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.103+0000 7f2d23323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.103+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.103+0000 7f2d23323800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:48.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.103+0000 7f2d23323800 20 searching for the correct realm 2024-09-14T11:18:48.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.106+0000 7f2d1e7ad640 0 -- 172.21.15.2:0/902401048 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55b52d456720 msgr2=0x55b52d458be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:48.109 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.110+0000 7f2d1efae640 0 -- 172.21.15.2:0/902401048 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2d1406c910 msgr2=0x7f2d1407b3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.317+0000 7f2d23323800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:48.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.317+0000 7f2d23323800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:48.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.317+0000 7f2d23323800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:48.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.317+0000 7f2d23323800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:48.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.317+0000 7f2d23323800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:48.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.317+0000 7f2d23323800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:48.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.317+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 zone default found 2024-09-14T11:18:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 4 Realm: () 2024-09-14T11:18:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:48.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 zonegroup default 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.318+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.319+0000 7f2d23323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.319+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.319+0000 7f2d23323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.319+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.319+0000 7f2d23323800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.319+0000 7f2d23323800 20 started sync module instance, tier type = 2024-09-14T11:18:48.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.319+0000 7f2d23323800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:48.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.329+0000 7f2d23323800 20 add_watcher() i=0 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.329+0000 7f2d23323800 20 add_watcher() i=1 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.329+0000 7f2d23323800 20 add_watcher() i=2 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.329+0000 7f2d23323800 20 add_watcher() i=3 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.329+0000 7f2d23323800 20 add_watcher() i=4 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.329+0000 7f2d23323800 20 add_watcher() i=5 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.329+0000 7f2d23323800 20 add_watcher() i=6 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.330+0000 7f2d23323800 20 add_watcher() i=7 2024-09-14T11:18:48.329 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.330+0000 7f2d23323800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:48.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.332+0000 7f2bd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.332+0000 7f2d23323800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:48.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.332+0000 7f2d23323800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:48.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.332+0000 7f2d23323800 5 note: GC not initialized 2024-09-14T11:18:48.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.332+0000 7f2b4ffff640 20 reqs_thread_entry: start 2024-09-14T11:18:48.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.332+0000 7f2d23323800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:48.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 20 Filter name: none 2024-09-14T11:18:48.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2b4dffb640 20 reqs_thread_entry: start 2024-09-14T11:18:48.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:48.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.333+0000 7f2d23323800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.334+0000 7f2d23323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.335+0000 7f2d23323800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.335+0000 7f2d23323800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:48.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.336+0000 7f2bd57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.339+0000 7f2d23323800 20 remove_watcher() i=0 2024-09-14T11:18:48.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.339+0000 7f2d23323800 2 removed watcher, disabling cache 2024-09-14T11:18:48.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.340+0000 7f2d23323800 20 remove_watcher() i=1 2024-09-14T11:18:48.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.341+0000 7f2d23323800 20 remove_watcher() i=2 2024-09-14T11:18:48.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.342+0000 7f2d23323800 20 remove_watcher() i=3 2024-09-14T11:18:48.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.343+0000 7f2d23323800 20 remove_watcher() i=4 2024-09-14T11:18:48.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.344+0000 7f2d23323800 20 remove_watcher() i=5 2024-09-14T11:18:48.344 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.345+0000 7f2d23323800 20 remove_watcher() i=6 2024-09-14T11:18:48.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.346+0000 7f2d23323800 20 remove_watcher() i=7 2024-09-14T11:18:48.358 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:18:48.388 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:48.388 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:48.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.428+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 20 realm 2024-09-14T11:18:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.430+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.431+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.431+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.431+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:48.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.431+0000 7f1d6f698800 20 searching for the correct realm 2024-09-14T11:18:48.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.435+0000 7f1d6c981640 0 -- 172.21.15.2:0/2157252342 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55d3a302aca0 msgr2=0x55d3a302d160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:48.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.438+0000 7f1d6d182640 0 -- 172.21.15.2:0/2157252342 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1d64045240 msgr2=0x7f1d6409a050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.443+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.443 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.444 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 zone default found 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 4 Realm: () 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 zonegroup default 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.444+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.445+0000 7f1d6f698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.445+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.445+0000 7f1d6f698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.445+0000 7f1d6f698800 20 started sync module instance, tier type = 2024-09-14T11:18:48.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.445+0000 7f1d6f698800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:48.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.454+0000 7f1d6f698800 20 add_watcher() i=0 2024-09-14T11:18:48.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.454+0000 7f1d6f698800 20 add_watcher() i=1 2024-09-14T11:18:48.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.454+0000 7f1d6f698800 20 add_watcher() i=2 2024-09-14T11:18:48.453 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.454+0000 7f1d6f698800 20 add_watcher() i=3 2024-09-14T11:18:48.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.454+0000 7f1d6f698800 20 add_watcher() i=4 2024-09-14T11:18:48.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.454+0000 7f1d6f698800 20 add_watcher() i=5 2024-09-14T11:18:48.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.454+0000 7f1d6f698800 20 add_watcher() i=6 2024-09-14T11:18:48.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.455+0000 7f1d6f698800 20 add_watcher() i=7 2024-09-14T11:18:48.454 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.455+0000 7f1d6f698800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:48.456 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.456+0000 7f1c237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1d6f698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1d6f698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1d6f698800 5 note: GC not initialized 2024-09-14T11:18:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1c227e4640 20 reqs_thread_entry: start 2024-09-14T11:18:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1d6f698800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1d6f698800 20 Filter name: none 2024-09-14T11:18:48.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1b93fff640 20 reqs_thread_entry: start 2024-09-14T11:18:48.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.457+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.458+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.458+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.458+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.458+0000 7f1d6f698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:48.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.458+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.459+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.459+0000 7f1d6f698800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.459+0000 7f1d6f698800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.459+0000 7f1d6f698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:48.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.461+0000 7f1c237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.463+0000 7f1d6f698800 20 remove_watcher() i=0 2024-09-14T11:18:48.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.463+0000 7f1d6f698800 2 removed watcher, disabling cache 2024-09-14T11:18:48.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.464+0000 7f1d6f698800 20 remove_watcher() i=1 2024-09-14T11:18:48.464 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.465+0000 7f1d6f698800 20 remove_watcher() i=2 2024-09-14T11:18:48.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.466+0000 7f1d6f698800 20 remove_watcher() i=3 2024-09-14T11:18:48.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.467+0000 7f1d6f698800 20 remove_watcher() i=4 2024-09-14T11:18:48.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.468+0000 7f1d6f698800 20 remove_watcher() i=5 2024-09-14T11:18:48.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.469+0000 7f1d6f698800 20 remove_watcher() i=6 2024-09-14T11:18:48.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.470+0000 7f1d6f698800 20 remove_watcher() i=7 2024-09-14T11:18:48.480 INFO:tasks.workunit.client.0.smithi002.stderr: test: duplicated entries should be purged before reshard 2024-09-14T11:18:48.481 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:18:48.510 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:48.511 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:48.549 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.550+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.551 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 20 realm 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.552+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.553+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.552 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.553+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.554+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:48.553 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.554+0000 7f84f281d800 20 searching for the correct realm 2024-09-14T11:18:48.556 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.557+0000 7f84ed7ea640 0 -- 172.21.15.2:0/1472247558 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55b545a15210 msgr2=0x55b545a176a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:48.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.561+0000 7f84edfeb640 0 -- 172.21.15.2:0/1472247558 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f84e4020440 msgr2=0x7f84e40208c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.565 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.565+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.566 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 20 zone default found 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 4 Realm: () 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 20 zonegroup default 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.566+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.567+0000 7f84f281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.567 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.567+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.567+0000 7f84f281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.567+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.567+0000 7f84f281d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.567+0000 7f84f281d800 20 started sync module instance, tier type = 2024-09-14T11:18:48.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.567+0000 7f84f281d800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:48.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.576+0000 7f84f281d800 20 add_watcher() i=0 2024-09-14T11:18:48.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.576+0000 7f84f281d800 20 add_watcher() i=1 2024-09-14T11:18:48.575 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.576+0000 7f84f281d800 20 add_watcher() i=2 2024-09-14T11:18:48.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.576+0000 7f84f281d800 20 add_watcher() i=3 2024-09-14T11:18:48.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.576+0000 7f84f281d800 20 add_watcher() i=4 2024-09-14T11:18:48.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.576+0000 7f84f281d800 20 add_watcher() i=5 2024-09-14T11:18:48.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.576+0000 7f84f281d800 20 add_watcher() i=6 2024-09-14T11:18:48.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.577+0000 7f84f281d800 20 add_watcher() i=7 2024-09-14T11:18:48.576 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.577+0000 7f84f281d800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:48.577 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.578+0000 7f839f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f84f281d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:48.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f84f281d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:48.578 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f84f281d800 5 note: GC not initialized 2024-09-14T11:18:48.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f839e7fc640 20 reqs_thread_entry: start 2024-09-14T11:18:48.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f84f281d800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:48.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f84f281d800 20 Filter name: none 2024-09-14T11:18:48.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f8313fff640 20 reqs_thread_entry: start 2024-09-14T11:18:48.579 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.579+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.580+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.580+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.580+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.580+0000 7f84f281d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.580+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.580+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.580+0000 7f84f281d800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.580 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.581+0000 7f84f281d800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.581+0000 7f84f281d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:48.581 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.582+0000 7f839f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.584+0000 7f84f281d800 20 remove_watcher() i=0 2024-09-14T11:18:48.583 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.584+0000 7f84f281d800 2 removed watcher, disabling cache 2024-09-14T11:18:48.585 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.586+0000 7f84f281d800 20 remove_watcher() i=1 2024-09-14T11:18:48.586 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.587+0000 7f84f281d800 20 remove_watcher() i=2 2024-09-14T11:18:48.587 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.588+0000 7f84f281d800 20 remove_watcher() i=3 2024-09-14T11:18:48.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.589+0000 7f84f281d800 20 remove_watcher() i=4 2024-09-14T11:18:48.589 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.590+0000 7f84f281d800 20 remove_watcher() i=5 2024-09-14T11:18:48.590 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.591+0000 7f84f281d800 20 remove_watcher() i=6 2024-09-14T11:18:48.591 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.592+0000 7f84f281d800 20 remove_watcher() i=7 2024-09-14T11:18:48.603 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.604 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:18:48.604 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 10 size_kb: 1 num_shards: 3 2024-09-14T11:18:48.604 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.605 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:18:48.640 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:48.640 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:48.679 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.680+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.681 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 20 realm 2024-09-14T11:18:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.682 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.683+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.683+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.683+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:48.683 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.683+0000 7f0315528800 20 searching for the correct realm 2024-09-14T11:18:48.686 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.687+0000 7f0308ad5640 0 -- 172.21.15.2:0/3137919345 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x563a1a05fee0 msgr2=0x563a1a0623a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.689 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.690+0000 7f03112d6640 0 -- 172.21.15.2:0/3137919345 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f02fc055960 msgr2=0x7f02fc020400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:48.693 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.694 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:48.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 zone default found 2024-09-14T11:18:48.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 4 Realm: () 2024-09-14T11:18:48.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 zonegroup default 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.695+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.695+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.695+0000 7f0315528800 20 started sync module instance, tier type = 2024-09-14T11:18:48.696 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.695+0000 7f0315528800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:48.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=0 2024-09-14T11:18:48.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=1 2024-09-14T11:18:48.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=2 2024-09-14T11:18:48.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=3 2024-09-14T11:18:48.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=4 2024-09-14T11:18:48.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=5 2024-09-14T11:18:48.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=6 2024-09-14T11:18:48.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=7 2024-09-14T11:18:48.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.704+0000 7f0315528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:48.705 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.706+0000 7f01c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f0315528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:48.706 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f0315528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:48.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f0315528800 5 note: GC not initialized 2024-09-14T11:18:48.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f01c6fe5640 20 reqs_thread_entry: start 2024-09-14T11:18:48.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f0315528800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:48.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f0315528800 20 Filter name: none 2024-09-14T11:18:48.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f01c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:48.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f0315528800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:48.707 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.707+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.708 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.708+0000 7f0315528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:48.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:18:48.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94807544708592 notifier 7778 bl.length()=827 2024-09-14T11:18:48.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.711 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:18:48.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:18:48.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:18:48.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:18:48.714 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0315528800 time 2024-09-14T11:18:48.716990+0000 2024-09-14T11:18:48.714 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0316d8c76a] 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.715+0000 7f0315528800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0315528800 time 2024-09-14T11:18:48.716990+0000 2024-09-14T11:18:48.715 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0316d8c76a] 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:18:48.716 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f0315528800 thread_name:radosgw-admin 2024-09-14T11:18:48.733 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.733 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0315a3e6f0] 2024-09-14T11:18:48.733 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0315a8b99c] 2024-09-14T11:18:48.733 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:48.733 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0316d8c7c4] 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.716+0000 7f0315528800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f0315528800 thread_name:radosgw-admin 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.734 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0315a3e6f0] 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0315a8b99c] 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0316d8c7c4] 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:48.735 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: dump: 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.736 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:18:48.662+0000 7f0315528800 5 monclient: authenticate success, global_id 8175 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:18:48.662+0000 7f0315528800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:18:48.662+0000 7f0315528800 4 set_mon_vals no callback set 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: dump: 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.737 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:18:48.663+0000 7f0315528800 10 monclient: shutdown 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:18:48.663+0000 7f0315528800 5 asok(0x563a19d4c270) unregister_commands rotate-key 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:18:48.663+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:18:48.663+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:18:48.663+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.738 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding auth protocol: cephx 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding auth protocol: cephx 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding auth protocol: cephx 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.739 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:18:48.663+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:18:48.663+0000 7f0315528800 1 librados: starting msgr at 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:18:48.663+0000 7f0315528800 1 librados: starting objecter 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:18:48.664+0000 7f0315528800 5 asok(0x563a19d4c270) register_command objecter_requests hook 0x563a19f70e30 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:18:48.664+0000 7f0315528800 1 librados: setting wanted keys 2024-09-14T11:18:48.740 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:18:48.664+0000 7f0315528800 1 librados: calling monclient init 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding auth protocol: cephx 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding auth protocol: cephx 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding auth protocol: cephx 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.741 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:18:48.664+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:18:48.664+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:18:48.664+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key hook 0x563a19f6c3d8 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a19df6920 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a19df7740 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a19df7e20 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.742 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.217682s 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a19df7e20 auth_method 0 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a19df6920 auth_method 0 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.743 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_done global_id 8178 payload 824 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:18:48.665+0000 7f0311ad7640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:18:48.665+0000 7f0311ad7640 1 monclient: found mon.noname-a 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:18:48.665+0000 7f0311ad7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: dump: 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.744 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: dump: 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.745 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:18:48.665+0000 7f0315528800 5 monclient: authenticate success, global_id 8178 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:18:48.665+0000 7f01ff606640 4 set_mon_vals no callback set 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.746 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:18:48.665+0000 7f0315528800 1 librados: init done 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:18:48.667+0000 7f01fde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:18:48.667+0000 7f01fde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:18:48.667+0000 7f01fde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:18:48.667+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f01f8077230 auth_method 0 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:18:48.668+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a19f94c50 auth_method 0 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:18:48.668+0000 7f03112d6640 10 monclient: get_auth_request con 0x563a19fb7b80 auth_method 0 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:18:48.670+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a19fbb3e0 auth_method 0 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:18:48.670+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:18:48.670+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:18:48.670+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.747 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding auth protocol: cephx 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding auth protocol: cephx 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding auth protocol: cephx 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.748 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:18:48.671+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:18:48.671+0000 7f0315528800 5 asok(0x563a19d4c270) register_command objecter_requests cmddesc objecter_requests hook 0x563a19fc4360 EEXIST 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.749 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding auth protocol: cephx 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding auth protocol: cephx 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding auth protocol: cephx 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.750 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:18:48.671+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:18:48.671+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:18:48.671+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key cmddesc rotate-key hook 0x563a19fbfe70 EEXIST 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a19fe8680 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a19fe8a60 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a19fe7390 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.224944s 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a19fe8680 auth_method 0 2024-09-14T11:18:48.751 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): get_auth_request con 0x563a19fe8a60 auth_method 0 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a19fe7390 auth_method 0 2024-09-14T11:18:48.752 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_done global_id 8181 payload 824 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:18:48.672+0000 7f03112d6640 1 monclient: found mon.noname-a 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: dump: 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.753 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:18:48.672+0000 7f0315528800 5 monclient: authenticate success, global_id 8181 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:48.754 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: dump: 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:18:48.672+0000 7f03122d8640 4 set_mon_vals no callback set 2024-09-14T11:18:48.755 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:18:48.674+0000 7f01f6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:18:48.674+0000 7f01f6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:18:48.674+0000 7f01f6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:18:48.674+0000 7f0308ad5640 10 monclient: get_auth_request con 0x7f01ec077140 auth_method 0 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: get_monmap_and_config 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:18:48.675+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.756 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding auth protocol: cephx 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding auth protocol: cephx 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding auth protocol: cephx 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.757 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:18:48.675+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding auth protocol: cephx 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding auth protocol: cephx 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding auth protocol: cephx 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.758 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:18:48.675+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:18:48.675+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:18:48.675+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key cmddesc rotate-key hook 0x7ffccab26208 EEXIST 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:48.759 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a1a03cc50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a1a00ca60 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a1a038010 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.229062s 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): get_auth_request con 0x563a1a00ca60 auth_method 0 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a1a038010 auth_method 0 2024-09-14T11:18:48.760 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a1a03cc50 auth_method 0 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.761 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:18:48.676+0000 7f0311ad7640 1 monclient: found mon.noname-c 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: dump: 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.762 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:18:48.676+0000 7f0315528800 5 monclient: authenticate success, global_id 7775 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:18:48.676+0000 7f0315528800 4 set_mon_vals no callback set 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: dump: 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.763 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: shutdown 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:18:48.677+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.764 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding auth protocol: cephx 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding auth protocol: cephx 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding auth protocol: cephx 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.765 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:18:48.677+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: starting msgr at 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: starting objecter 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:18:48.677+0000 7f0315528800 5 asok(0x563a19d4c270) register_command objecter_requests cmddesc objecter_requests hook 0x563a19fe8e60 EEXIST 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: setting wanted keys 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: calling monclient init 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding auth protocol: cephx 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding auth protocol: cephx 2024-09-14T11:18:48.766 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding auth protocol: cephx 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:18:48.678+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:18:48.678+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.767 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:18:48.678+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key cmddesc rotate-key hook 0x563a19ffd088 EEXIST 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a1a00ca60 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a1a038010 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a1a03cc50 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.231432s 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): get_auth_request con 0x563a1a038010 auth_method 0 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.768 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a1a03cc50 auth_method 0 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a1a00ca60 auth_method 0 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.769 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:18:48.678+0000 7f0311ad7640 1 monclient: found mon.noname-c 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:18:48.678+0000 7f01e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: dump: 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.770 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: dump: 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.771 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:18:48.679+0000 7f0315528800 5 monclient: authenticate success, global_id 7778 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:18:48.679+0000 7f01f4ff9640 4 set_mon_vals no callback set 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:18:48.679+0000 7f0315528800 1 librados: init done 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:18:48.679+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cr dump hook 0x563a1a03d108 2024-09-14T11:18:48.772 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:18:48.680+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:18:48.681+0000 7f01e2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:18:48.681+0000 7f01e2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:18:48.681+0000 7f01e2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:18:48.681+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f01dc077230 auth_method 0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:18:48.681+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a1a056d20 auth_method 0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:18:48.682+0000 7f0315528800 20 realm 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:18:48.682+0000 7f0315528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.773 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:18:48.682+0000 7f03112d6640 10 monclient: get_auth_request con 0x563a1a05afb0 auth_method 0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:18:48.683+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:18:48.683+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:18:48.683+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:18:48.683+0000 7f0315528800 20 searching for the correct realm 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:18:48.683+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a1a05fee0 auth_method 0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:18:48.684+0000 7f0311ad7640 10 monclient: get_auth_request con 0x7f02fc00f3d0 auth_method 0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:18:48.685+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f030c069040 auth_method 0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:18:48.686+0000 7f0308ad5640 10 monclient: get_auth_request con 0x7f03040c6070 auth_method 0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:18:48.687+0000 7f0308ad5640 0 -- 172.21.15.2:0/3137919345 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x563a1a05fee0 msgr2=0x563a1a0623a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:18:48.687+0000 7f01e2ffd640 1 client.7778.objecter ms_handle_reset 0x563a1a05fee0 session 0x563a1a05f860 osd.3 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:18:48.687+0000 7f01e2ffd640 10 monclient: _renew_subs 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:18:48.687+0000 7f01e2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:18:48.687+0000 7f0308ad5640 10 monclient: get_auth_request con 0x7f01dc0870d0 auth_method 0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:18:48.687+0000 7f0311ad7640 10 monclient: get_auth_request con 0x7f02fc0513c0 auth_method 0 2024-09-14T11:18:48.774 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:18:48.689+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f02fc055960 auth_method 0 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:18:48.690+0000 7f03112d6640 0 -- 172.21.15.2:0/3137919345 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f02fc055960 msgr2=0x7f02fc020400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:18:48.690+0000 7f01e2ffd640 1 client.7778.objecter ms_handle_reset 0x7f02fc055960 session 0x7f02fc040de0 osd.0 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:18:48.690+0000 7f03112d6640 10 monclient: get_auth_request con 0x563a1a05fee0 auth_method 0 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.775 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:18:48.694+0000 7f0315528800 20 zone default found 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:18:48.694+0000 7f0315528800 4 Realm: () 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:18:48.694+0000 7f0315528800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:18:48.694+0000 7f0315528800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:18:48.694+0000 7f0315528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:18:48.694+0000 7f0315528800 20 zonegroup default 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.776 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:18:48.695+0000 7f0315528800 20 started sync module instance, tier type = 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:18:48.695+0000 7f0315528800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=0 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=1 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=2 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=3 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=4 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=5 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=6 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=7 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:18:48.704+0000 7f0315528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding auth protocol: cephx 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding auth protocol: cephx 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding auth protocol: cephx 2024-09-14T11:18:48.777 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:18:48.706+0000 7f01c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:18:48.707+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:18:48.707+0000 7f0315528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:48.778 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:18:48.707+0000 7f0315528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache list hook 0x563a1a02df40 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache inspect hook 0x563a1a02df40 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache erase hook 0x563a1a02df40 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache zap hook 0x563a1a02df40 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:18:48.707+0000 7f0315528800 5 note: GC not initialized 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:18:48.707+0000 7f01c6fe5640 20 reqs_thread_entry: start 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace show hook 0x7f0300001d30 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace history hook 0x7f0300001d30 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace active hook 0x7f0300001d30 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace active_short hook 0x7f0300001d30 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:18:48.707+0000 7f0315528800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:18:48.707+0000 7f0315528800 20 Filter name: none 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:18:48.707+0000 7f01c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:18:48.707+0000 7f0315528800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:48.779 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:18:48.707+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:18:48.708+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:18:48.708+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:18:48.708+0000 7f0315528800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:18:48.708+0000 7f0315528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:18:48.708+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:18:48.708+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:18:48.708+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:18:48.708+0000 7f0315528800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:18:48.708+0000 7f0315528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:18:48.708+0000 7f0315528800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:18:48.708+0000 7f0315528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:18:48.712+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:18:48.712+0000 7f0315528800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:18:48.712+0000 7f0315528800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.780 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:18:48.712+0000 7f0315528800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94807544708592 notifier 7778 bl.length()=827 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:18:48.715+0000 7f0315528800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0315528800 time 2024-09-14T11:18:48.716990+0000 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0316d8c76a] 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.781 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:18:48.716+0000 7f0315528800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f0315528800 thread_name:radosgw-admin 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0315a3e6f0] 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0315a8b99c] 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:48.782 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0316d8c7c4] 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:18:48.783 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:48.784 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:18:48.785 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:18:48.786 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:18:48.787 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:48.788 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01c4fe1640 / http_manager 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01c6fe5640 / http_manager 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01c7fe7640 / rgw_dt_lg_renew 2024-09-14T11:18:48.789 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01e2ffd640 / ms_dispatch 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01f4ff9640 / io_context_pool 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01f6ffd640 / ms_dispatch 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01fde03640 / ms_dispatch 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01ff606640 / io_context_pool 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f0308ad5640 / msgr-worker-2 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f03112d6640 / msgr-worker-1 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f0311ad7640 / msgr-worker-0 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f03122d8640 / io_context_pool 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: 7f0315528800 / radosgw-admin 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.149147.log 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:18:48.790 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: dump: 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:18:48.662+0000 7f0315528800 5 monclient: authenticate success, global_id 8175 2024-09-14T11:18:48.791 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:18:48.662+0000 7f0315528800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:18:48.662+0000 7f0315528800 4 set_mon_vals no callback set 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:18:48.662+0000 7f01ff606640 10 monclient: dump: 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.792 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:18:48.663+0000 7f0315528800 10 monclient: shutdown 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:18:48.663+0000 7f0315528800 5 asok(0x563a19d4c270) unregister_commands rotate-key 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:18:48.663+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:18:48.663+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:18:48.663+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.793 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding auth protocol: cephx 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding auth protocol: cephx 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding auth protocol: cephx 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: crc 2024-09-14T11:18:48.794 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:18:48.663+0000 7f0315528800 5 AuthRegistry(0x563a19f71ed0) adding con mode: secure 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:18:48.663+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:18:48.663+0000 7f0315528800 1 librados: starting msgr at 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:18:48.663+0000 7f0315528800 1 librados: starting objecter 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:18:48.664+0000 7f0315528800 5 asok(0x563a19d4c270) register_command objecter_requests hook 0x563a19f70e30 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:18:48.664+0000 7f0315528800 1 librados: setting wanted keys 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:18:48.664+0000 7f0315528800 1 librados: calling monclient init 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding auth protocol: cephx 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding auth protocol: cephx 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding auth protocol: cephx 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.795 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: crc 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:18:48.664+0000 7f0315528800 5 AuthRegistry(0x563a19f6c290) adding con mode: secure 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:18:48.664+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:18:48.664+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:18:48.664+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key hook 0x563a19f6c3d8 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a19df6920 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a19df7740 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.796 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a19df7e20 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:18:48.664+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.217682s 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a19df7e20 auth_method 0 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a19df6920 auth_method 0 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.797 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:18:48.664+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:18:48.664+0000 7f0311ad7640 10 monclient(hunting): handle_auth_done global_id 8178 payload 824 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:18:48.665+0000 7f0311ad7640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:18:48.665+0000 7f0311ad7640 1 monclient: found mon.noname-a 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:18:48.665+0000 7f0311ad7640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: dump: 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.798 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:18:48.665+0000 7f01fde03640 10 monclient: dump: 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.799 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:18:48.665+0000 7f0315528800 5 monclient: authenticate success, global_id 8178 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:18:48.665+0000 7f01ff606640 4 set_mon_vals no callback set 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:18:48.665+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.800 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:18:48.665+0000 7f0315528800 1 librados: init done 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:18:48.667+0000 7f01fde03640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:18:48.667+0000 7f01fde03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:18:48.667+0000 7f01fde03640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:18:48.667+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f01f8077230 auth_method 0 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:18:48.668+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a19f94c50 auth_method 0 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:18:48.668+0000 7f03112d6640 10 monclient: get_auth_request con 0x563a19fb7b80 auth_method 0 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:18:48.670+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a19fbb3e0 auth_method 0 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:18:48.670+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:18:48.670+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:18:48.670+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.801 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding auth protocol: cephx 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding auth protocol: cephx 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding auth protocol: cephx 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.802 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: crc 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:18:48.670+0000 7f0315528800 5 AuthRegistry(0x563a19fc0f40) adding con mode: secure 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:18:48.671+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:18:48.671+0000 7f0315528800 5 asok(0x563a19d4c270) register_command objecter_requests cmddesc objecter_requests hook 0x563a19fc4360 EEXIST 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding auth protocol: cephx 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding auth protocol: cephx 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding auth protocol: cephx 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.803 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: crc 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:18:48.671+0000 7f0315528800 5 AuthRegistry(0x563a19fbfd28) adding con mode: secure 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:18:48.671+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:18:48.671+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:18:48.671+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key cmddesc rotate-key hook 0x563a19fbfe70 EEXIST 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a19fe8680 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.804 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a19fe8a60 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a19fe7390 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:18:48.671+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.224944s 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a19fe8680 auth_method 0 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): get_auth_request con 0x563a19fe8a60 auth_method 0 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.805 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:18:48.672+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a19fe7390 auth_method 0 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:18:48.672+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient(hunting): handle_auth_done global_id 8181 payload 824 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:18:48.672+0000 7f03112d6640 1 monclient: found mon.noname-a 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:18:48.672+0000 7f03112d6640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.806 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: dump: 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:18:48.672+0000 7f0315528800 5 monclient: authenticate success, global_id 8181 2024-09-14T11:18:48.807 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:18:48.672+0000 7f01f6ffd640 10 monclient: dump: 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.808 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:18:48.672+0000 7f0315528800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:18:48.672+0000 7f03122d8640 4 set_mon_vals no callback set 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:18:48.674+0000 7f01f6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:18:48.674+0000 7f01f6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:18:48.674+0000 7f01f6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:18:48.674+0000 7f0308ad5640 10 monclient: get_auth_request con 0x7f01ec077140 auth_method 0 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: get_monmap_and_config 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:18:48.675+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.809 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding auth protocol: cephx 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding auth protocol: cephx 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding auth protocol: cephx 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.810 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: crc 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x563a1a0085e0) adding con mode: secure 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:18:48.675+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding auth protocol: cephx 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding auth protocol: cephx 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding auth protocol: cephx 2024-09-14T11:18:48.811 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: crc 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:18:48.675+0000 7f0315528800 5 AuthRegistry(0x7ffccab260c0) adding con mode: secure 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:18:48.675+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.812 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:18:48.675+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:18:48.675+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key cmddesc rotate-key hook 0x7ffccab26208 EEXIST 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:18:48.675+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a1a03cc50 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a1a00ca60 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a1a038010 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.229062s 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): get_auth_request con 0x563a1a00ca60 auth_method 0 2024-09-14T11:18:48.813 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a1a038010 auth_method 0 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:18:48.676+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a1a03cc50 auth_method 0 2024-09-14T11:18:48.814 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:18:48.676+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient(hunting): handle_auth_done global_id 7775 payload 274 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:18:48.676+0000 7f0311ad7640 1 monclient: found mon.noname-c 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:18:48.676+0000 7f0311ad7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: dump: 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.815 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:18:48.676+0000 7f0315528800 5 monclient: authenticate success, global_id 7775 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:18:48.676+0000 7f0315528800 10 monclient: get_monmap_and_config success 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:18:48.676+0000 7f0315528800 4 set_mon_vals no callback set 2024-09-14T11:18:48.816 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:18:48.676+0000 7f01f4ff9640 10 monclient: dump: 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.817 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: shutdown 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: build_initial_monmap 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:18:48.677+0000 7f0315528800 1 build_initial for_mkfs: 0 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: monmap: 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.818 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding auth protocol: cephx 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding auth protocol: cephx 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding auth protocol: cephx 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.819 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: crc 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a1a0384c0) adding con mode: secure 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:18:48.677+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: starting msgr at 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: starting objecter 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:18:48.677+0000 7f0315528800 5 asok(0x563a19d4c270) register_command objecter_requests cmddesc objecter_requests hook 0x563a19fe8e60 EEXIST 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: setting wanted keys 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:18:48.677+0000 7f0315528800 1 librados: calling monclient init 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:18:48.677+0000 7f0315528800 10 monclient: init 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding auth protocol: cephx 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding auth protocol: cephx 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding auth protocol: cephx 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.820 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: crc 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:18:48.677+0000 7f0315528800 5 AuthRegistry(0x563a19ffcf40) adding con mode: secure 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:18:48.678+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:18:48.678+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:18:48.678+0000 7f0315528800 5 asok(0x563a19d4c270) register_command rotate-key cmddesc rotate-key hook 0x563a19ffd088 EEXIST 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient: _reopen_session rank -1 2024-09-14T11:18:48.821 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): picked mon.noname-b con 0x563a1a00ca60 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): picked mon.noname-a con 0x563a1a038010 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): picked mon.noname-c con 0x563a1a03cc50 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): start opening mon connection 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): _renew_subs 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:18:48.678+0000 7f0315528800 10 monclient(hunting): authenticate will time out at 2155.231432s 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): get_auth_request con 0x563a1a038010 auth_method 0 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.822 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): get_auth_request con 0x563a1a03cc50 auth_method 0 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:18:48.678+0000 7f0308ad5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): get_auth_request con 0x563a1a00ca60 auth_method 0 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:18:48.823 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:18:48.678+0000 7f03112d6640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient(hunting): handle_auth_done global_id 7778 payload 824 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient: _finish_hunting 0 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:18:48.678+0000 7f0311ad7640 1 monclient: found mon.noname-c 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:18:48.678+0000 7f0311ad7640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:18:48.678+0000 7f01e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: dump: 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.824 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: _finish_auth 0 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:18:48.679+0000 7f01e2ffd640 10 monclient: dump: 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.825 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:18:48.679+0000 7f0315528800 5 monclient: authenticate success, global_id 7778 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:18:48.679+0000 7f01f4ff9640 4 set_mon_vals no callback set 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _renew_subs 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:18:48.679+0000 7f0315528800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.826 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:18:48.679+0000 7f0315528800 1 librados: init done 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:18:48.679+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cr dump hook 0x563a1a03d108 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:18:48.680+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:18:48.681+0000 7f01e2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:18:48.681+0000 7f01e2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:18:48.681+0000 7f01e2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:18:48.681+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f01dc077230 auth_method 0 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:18:48.681+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a1a056d20 auth_method 0 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:18:48.682+0000 7f0315528800 20 realm 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:18:48.682+0000 7f0315528800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.827 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:18:48.682+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:18:48.682+0000 7f03112d6640 10 monclient: get_auth_request con 0x563a1a05afb0 auth_method 0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:18:48.683+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:18:48.683+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:18:48.683+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:18:48.683+0000 7f0315528800 20 searching for the correct realm 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:18:48.683+0000 7f0308ad5640 10 monclient: get_auth_request con 0x563a1a05fee0 auth_method 0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:18:48.684+0000 7f0311ad7640 10 monclient: get_auth_request con 0x7f02fc00f3d0 auth_method 0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:18:48.685+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f030c069040 auth_method 0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:18:48.686+0000 7f0308ad5640 10 monclient: get_auth_request con 0x7f03040c6070 auth_method 0 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:18:48.687+0000 7f0308ad5640 0 -- 172.21.15.2:0/3137919345 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x563a1a05fee0 msgr2=0x563a1a0623a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.828 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:18:48.687+0000 7f01e2ffd640 1 client.7778.objecter ms_handle_reset 0x563a1a05fee0 session 0x563a1a05f860 osd.3 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:18:48.687+0000 7f01e2ffd640 10 monclient: _renew_subs 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:18:48.687+0000 7f01e2ffd640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:18:48.687+0000 7f0308ad5640 10 monclient: get_auth_request con 0x7f01dc0870d0 auth_method 0 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:18:48.687+0000 7f0311ad7640 10 monclient: get_auth_request con 0x7f02fc0513c0 auth_method 0 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:18:48.689+0000 7f03112d6640 10 monclient: get_auth_request con 0x7f02fc055960 auth_method 0 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:18:48.690+0000 7f03112d6640 0 -- 172.21.15.2:0/3137919345 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f02fc055960 msgr2=0x7f02fc020400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:18:48.690+0000 7f01e2ffd640 1 client.7778.objecter ms_handle_reset 0x7f02fc055960 session 0x7f02fc040de0 osd.0 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:18:48.690+0000 7f03112d6640 10 monclient: get_auth_request con 0x563a1a05fee0 auth_method 0 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:48.829 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:18:48.694+0000 7f0315528800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:18:48.694+0000 7f0315528800 20 zone default found 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:18:48.694+0000 7f0315528800 4 Realm: () 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:18:48.694+0000 7f0315528800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:18:48.694+0000 7f0315528800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:18:48.694+0000 7f0315528800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:18:48.694+0000 7f0315528800 20 zonegroup default 2024-09-14T11:18:48.830 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:18:48.694+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:18:48.695+0000 7f0315528800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:18:48.695+0000 7f0315528800 20 started sync module instance, tier type = 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:18:48.695+0000 7f0315528800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=0 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=1 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=2 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=3 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=4 2024-09-14T11:18:48.831 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=5 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=6 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:18:48.704+0000 7f0315528800 20 add_watcher() i=7 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:18:48.704+0000 7f0315528800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding auth protocol: cephx 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding auth protocol: cephx 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding auth protocol: cephx 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.832 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: crc 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:18:48.706+0000 7f0315528800 5 AuthRegistry(0x7ffccab265a0) adding con mode: secure 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:18:48.706+0000 7f01c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:18:48.707+0000 7f0315528800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:18:48.707+0000 7f0315528800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:18:48.707+0000 7f0315528800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache list hook 0x563a1a02df40 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache inspect hook 0x563a1a02df40 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache erase hook 0x563a1a02df40 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command cache zap hook 0x563a1a02df40 2024-09-14T11:18:48.833 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:18:48.707+0000 7f0315528800 5 note: GC not initialized 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:18:48.707+0000 7f01c6fe5640 20 reqs_thread_entry: start 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace show hook 0x7f0300001d30 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace history hook 0x7f0300001d30 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace active hook 0x7f0300001d30 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:18:48.707+0000 7f0315528800 5 asok(0x563a19d4c270) register_command sync trace active_short hook 0x7f0300001d30 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:18:48.707+0000 7f0315528800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:18:48.707+0000 7f0315528800 20 Filter name: none 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:18:48.707+0000 7f01c4fe1640 20 reqs_thread_entry: start 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:18:48.707+0000 7f0315528800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:18:48.707+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:18:48.708+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:18:48.708+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:48.834 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:18:48.708+0000 7f0315528800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:18:48.708+0000 7f0315528800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:18:48.708+0000 7f0315528800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:18:48.708+0000 7f0315528800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:18:48.708+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:18:48.708+0000 7f0315528800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:18:48.708+0000 7f0315528800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:18:48.708+0000 7f0315528800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:18:48.708+0000 7f0315528800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:18:48.712+0000 7f0315528800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:18:48.712+0000 7f0315528800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:18:48.712+0000 7f0315528800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:18:48.712+0000 7f0315528800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:18:48.835 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464327 cookie 94807544708592 notifier 7778 bl.length()=827 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:18:48.712+0000 7f01f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:18:48.712+0000 7f0315528800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:18:48.715+0000 7f0315528800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0315528800 time 2024-09-14T11:18:48.716990+0000 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0316d8c76a] 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.836 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:18:48.716+0000 7f0315528800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f0315528800 thread_name:radosgw-admin 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0315a3e6f0] 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0315a8b99c] 2024-09-14T11:18:48.837 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0316d8c7c4] 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f0316d8c928] 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563a175910b1] 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563a175a0f6a] 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0315a29590] 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:18:48.838 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:18:48.839 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:18:48.840 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:18:48.841 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:18:48.842 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:18:48.843 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:18:48.844 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01c4fe1640 / http_manager 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01c6fe5640 / http_manager 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01c7fe7640 / rgw_dt_lg_renew 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01e2ffd640 / ms_dispatch 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01f4ff9640 / io_context_pool 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01f6ffd640 / ms_dispatch 2024-09-14T11:18:48.845 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01fde03640 / ms_dispatch 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: 7f01ff606640 / io_context_pool 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: 7f0308ad5640 / msgr-worker-2 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: 7f03112d6640 / msgr-worker-1 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: 7f0311ad7640 / msgr-worker-0 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: 7f03122d8640 / io_context_pool 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: 7f0315528800 / radosgw-admin 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:18:48.718430Z_eb5acd7c-2519-4f8b-859e-89a9608bdef4/log 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:18:48.846 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.796+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.798+0000 7f40ba731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.798+0000 7f40ba731800 20 realm 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.798+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.798+0000 7f40ba731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.798+0000 7f40ba731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.798+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.799+0000 7f40ba731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.799+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.799+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:48.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.799+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:48.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.800+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:48.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.800+0000 7f40ba731800 20 searching for the correct realm 2024-09-14T11:18:48.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:48.802+0000 7f40b6399640 0 -- 172.21.15.2:0/2990920877 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f40b0014980 msgr2=0x7f40b0024410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.006+0000 7f40b6b9a640 0 -- 172.21.15.2:0/2990920877 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f40ac06a8e0 msgr2=0x7f40ac09a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:49.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:49.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:49.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:49.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.012+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 20 zone default found 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 4 Realm: () 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:49.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 20 zonegroup default 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.013+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.014+0000 7f40ba731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.014+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.014+0000 7f40ba731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.014+0000 7f40ba731800 20 started sync module instance, tier type = 2024-09-14T11:18:49.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.014+0000 7f40ba731800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:49.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.022+0000 7f40ba731800 20 add_watcher() i=0 2024-09-14T11:18:49.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.022+0000 7f40ba731800 20 add_watcher() i=1 2024-09-14T11:18:49.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.022+0000 7f40ba731800 20 add_watcher() i=2 2024-09-14T11:18:49.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.022+0000 7f40ba731800 20 add_watcher() i=3 2024-09-14T11:18:49.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.022+0000 7f40ba731800 20 add_watcher() i=4 2024-09-14T11:18:49.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.022+0000 7f40ba731800 20 add_watcher() i=5 2024-09-14T11:18:49.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.022+0000 7f40ba731800 20 add_watcher() i=6 2024-09-14T11:18:49.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.023+0000 7f40ba731800 20 add_watcher() i=7 2024-09-14T11:18:49.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.023+0000 7f40ba731800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:49.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.025+0000 7f3f6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.025+0000 7f40ba731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:49.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.025+0000 7f40ba731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.025+0000 7f40ba731800 5 note: GC not initialized 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.025+0000 7f3ee77fe640 20 reqs_thread_entry: start 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.026+0000 7f40ba731800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.026+0000 7f40ba731800 20 Filter name: none 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.026+0000 7f3ee57fa640 20 reqs_thread_entry: start 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.026+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.026+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:49.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.026+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.027+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:49.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.027+0000 7f40ba731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:49.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.027+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.027+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:49.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.027+0000 7f40ba731800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.028+0000 7f40ba731800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:49.027 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.028+0000 7f40ba731800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:18:49.028 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.029+0000 7f3f6cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.031+0000 7f40ba731800 20 remove_watcher() i=0 2024-09-14T11:18:49.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.031+0000 7f40ba731800 2 removed watcher, disabling cache 2024-09-14T11:18:49.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.032+0000 7f40ba731800 20 remove_watcher() i=1 2024-09-14T11:18:49.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.033+0000 7f40ba731800 20 remove_watcher() i=2 2024-09-14T11:18:49.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.034+0000 7f40ba731800 20 remove_watcher() i=3 2024-09-14T11:18:49.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.035+0000 7f40ba731800 20 remove_watcher() i=4 2024-09-14T11:18:49.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.036+0000 7f40ba731800 20 remove_watcher() i=5 2024-09-14T11:18:49.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.037+0000 7f40ba731800 20 remove_watcher() i=6 2024-09-14T11:18:49.037 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.038+0000 7f40ba731800 20 remove_watcher() i=7 2024-09-14T11:18:49.051 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:18:49.051 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:18:49.060 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:18:49.089 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:18:49.089 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:18:49.129 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.129+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.131+0000 7f81ed328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.131+0000 7f81ed328800 20 realm 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.131+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.131+0000 7f81ed328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.131+0000 7f81ed328800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.132+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.132+0000 7f81ed328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.132+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.132+0000 7f81ed328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.132+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.133+0000 7f81ed328800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:18:49.132 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.133+0000 7f81ed328800 20 searching for the correct realm 2024-09-14T11:18:49.134 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.134+0000 7f81e904b640 0 -- 172.21.15.2:0/4037554103 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x55e38485eaf0 msgr2=0x7f81e4023970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:18:49.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.339+0000 7f81e984c640 0 -- 172.21.15.2:0/4037554103 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f81e0090990 msgr2=0x7f81e008e430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:18:49.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:18:49.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:18:49.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:18:49.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.345+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 20 zone default found 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 4 Realm: () 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 20 zonegroup default 2024-09-14T11:18:49.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.346+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.347+0000 7f81ed328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.347+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.347+0000 7f81ed328800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:18:49.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.347+0000 7f81ed328800 20 started sync module instance, tier type = 2024-09-14T11:18:49.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.347+0000 7f81ed328800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:18:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.355+0000 7f81ed328800 20 add_watcher() i=0 2024-09-14T11:18:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.355+0000 7f81ed328800 20 add_watcher() i=1 2024-09-14T11:18:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.355+0000 7f81ed328800 20 add_watcher() i=2 2024-09-14T11:18:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.355+0000 7f81ed328800 20 add_watcher() i=3 2024-09-14T11:18:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.355+0000 7f81ed328800 20 add_watcher() i=4 2024-09-14T11:18:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.355+0000 7f81ed328800 20 add_watcher() i=5 2024-09-14T11:18:49.355 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.355+0000 7f81ed328800 20 add_watcher() i=6 2024-09-14T11:18:49.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.356+0000 7f81ed328800 20 add_watcher() i=7 2024-09-14T11:18:49.356 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.356+0000 7f81ed328800 2 all 8 watchers are set, enabling cache 2024-09-14T11:18:49.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.358+0000 7f809f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.358+0000 7f81ed328800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:18:49.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.358+0000 7f81ed328800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:18:49.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.359+0000 7f81ed328800 5 note: GC not initialized 2024-09-14T11:18:49.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.359+0000 7f809e7e4640 20 reqs_thread_entry: start 2024-09-14T11:18:49.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.359+0000 7f81ed328800 20 init_complete bucket index max shards: 1 2024-09-14T11:18:49.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.359+0000 7f81ed328800 20 Filter name: none 2024-09-14T11:18:49.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.359+0000 7f800ffff640 20 reqs_thread_entry: start 2024-09-14T11:18:49.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.359+0000 7f81ed328800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:18:49.359 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.359+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:18:49.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:18:49.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:18:49.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:18:49.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 20 rados->read ofs=0 len=0 2024-09-14T11:18:49.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.360+0000 7f81ed328800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:18:49.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.361+0000 7f81ed328800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:49.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.361+0000 7f81ed328800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:18:49.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.362+0000 7f809f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:18:49.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.364+0000 7f81ed328800 20 remove_watcher() i=0 2024-09-14T11:18:49.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.364+0000 7f81ed328800 2 removed watcher, disabling cache 2024-09-14T11:18:49.364 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.365+0000 7f81ed328800 20 remove_watcher() i=1 2024-09-14T11:18:49.365 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.366+0000 7f81ed328800 20 remove_watcher() i=2 2024-09-14T11:18:49.366 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.367+0000 7f81ed328800 20 remove_watcher() i=3 2024-09-14T11:18:49.368 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.368+0000 7f81ed328800 20 remove_watcher() i=4 2024-09-14T11:18:49.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.369+0000 7f81ed328800 20 remove_watcher() i=5 2024-09-14T11:18:49.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.370+0000 7f81ed328800 20 remove_watcher() i=6 2024-09-14T11:18:49.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:18:49.371+0000 7f81ed328800 20 remove_watcher() i=7 2024-09-14T11:19:19.413 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-14T11:19:19.451 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:19.451 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:19.497 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.499+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.498 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.500+0000 7f5493540800 20 realm 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.500+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.500+0000 7f5493540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:19.499 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.500+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.501+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.500 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.502+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.502+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.502+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:19.501 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.502+0000 7f5493540800 20 searching for the correct realm 2024-09-14T11:19:19.504 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.506+0000 7f548eabf640 0 -- 172.21.15.2:0/2905710929 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f548007c070 msgr2=0x7f5480088400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.508 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.510+0000 7f548f2c0640 0 -- 172.21.15.2:0/2905710929 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f5484063850 msgr2=0x7f548400ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:19.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:19.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:19.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:19.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:19.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:19.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.717+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:19.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 20 zone default found 2024-09-14T11:19:19.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 4 Realm: () 2024-09-14T11:19:19.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:19.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:19.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 20 zonegroup default 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.718+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.719+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.719+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.719+0000 7f5493540800 20 started sync module instance, tier type = 2024-09-14T11:19:19.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.720+0000 7f5493540800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:19.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=0 2024-09-14T11:19:19.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=1 2024-09-14T11:19:19.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=2 2024-09-14T11:19:19.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=3 2024-09-14T11:19:19.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=4 2024-09-14T11:19:19.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=5 2024-09-14T11:19:19.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=6 2024-09-14T11:19:19.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.731+0000 7f5493540800 20 add_watcher() i=7 2024-09-14T11:19:19.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.731+0000 7f5493540800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:19.731 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.733+0000 7f5345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5493540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5493540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5493540800 5 note: GC not initialized 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5344fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5493540800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5493540800 20 Filter name: none 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f52be7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5493540800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.734+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.735+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:19.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.735+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:19.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.735+0000 7f5493540800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:19.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.735+0000 7f5493540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:19.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.735+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.736+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:19.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.736+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.736+0000 7f5493540800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.736+0000 7f5493540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:19.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.736+0000 7f5493540800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.736+0000 7f5493540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:19.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.737+0000 7f5493540800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.741+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.741+0000 7f5493540800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.741+0000 7f5493540800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.741+0000 7f5493540800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94505760166688 notifier 7826 bl.length()=827 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:19:19.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:19:19.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:19:19.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:19:19.743 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5493540800 time 2024-09-14T11:19:19.745892+0000 2024-09-14T11:19:19.743 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:19.744 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.744 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5494d8c76a] 2024-09-14T11:19:19.744 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.744 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.744 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.744 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.745 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:19:19.745 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.745 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:19:19.745 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:19:19.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.746+0000 7f5493540800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5493540800 time 2024-09-14T11:19:19.745892+0000 2024-09-14T11:19:19.745 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:19.746 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.746 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.746 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5494d8c76a] 2024-09-14T11:19:19.746 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.746 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.746 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.746 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.747 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:19:19.747 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.747 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:19:19.747 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:19:19.747 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.747 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:19:19.747 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f5493540800 thread_name:radosgw-admin 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5493a3e6f0] 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5493a8b99c] 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5494d8c7c4] 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:19:19.760 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.746+0000 7f5493540800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f5493540800 thread_name:radosgw-admin 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5493a3e6f0] 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5493a8b99c] 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5494d8c7c4] 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.761 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: dump: 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.762 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:19:19.479+0000 7f5493540800 5 monclient: authenticate success, global_id 8229 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:19:19.479+0000 7f5493540800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:19:19.479+0000 7f5493540800 4 set_mon_vals no callback set 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:19:19.479+0000 7f5493540800 10 monclient: shutdown 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:19:19.479+0000 7f5493540800 5 asok(0x55f3d611f270) unregister_commands rotate-key 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:19:19.480+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:19:19.480+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.763 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:19:19.480+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding auth protocol: cephx 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding auth protocol: cephx 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding auth protocol: cephx 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.764 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:19:19.480+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: starting msgr at 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: starting objecter 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:19:19.480+0000 7f5493540800 5 asok(0x55f3d611f270) register_command objecter_requests hook 0x55f3d6340cf0 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: setting wanted keys 2024-09-14T11:19:19.765 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: calling monclient init 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:19:19.480+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding auth protocol: cephx 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding auth protocol: cephx 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding auth protocol: cephx 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.766 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:19:19.480+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:19:19.481+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:19:19.481+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key hook 0x55f3d633f3c8 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d61ecbf0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d61f3b40 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d6288590 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.767 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.033176s 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): get_auth_request con 0x55f3d6288590 auth_method 0 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d61f3b40 auth_method 0 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d61ecbf0 auth_method 0 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.768 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_done global_id 8232 payload 824 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:19:19.481+0000 7f548eabf640 1 monclient: found mon.noname-a 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.769 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: dump: 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.770 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: dump: 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.771 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:19:19.482+0000 7f5493540800 5 monclient: authenticate success, global_id 8232 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:19:19.482+0000 7f537d60a640 4 set_mon_vals no callback set 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:19:19.482+0000 7f5493540800 1 librados: init done 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:19:19.484+0000 7f537be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:19:19.484+0000 7f537be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:19:19.484+0000 7f537be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:19:19.484+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5374077230 auth_method 0 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:19:19.485+0000 7f548fac1640 10 monclient: get_auth_request con 0x55f3d63663a0 auth_method 0 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:19:19.485+0000 7f548f2c0640 10 monclient: get_auth_request con 0x55f3d638ac60 auth_method 0 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:19:19.487+0000 7f548eabf640 10 monclient: get_auth_request con 0x55f3d638e4c0 auth_method 0 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:19:19.488+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.772 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:19:19.488+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:19:19.488+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.773 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding auth protocol: cephx 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding auth protocol: cephx 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding auth protocol: cephx 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.774 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:19:19.488+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:19:19.488+0000 7f5493540800 5 asok(0x55f3d611f270) register_command objecter_requests cmddesc objecter_requests hook 0x55f3d63975a0 EEXIST 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:19:19.488+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding auth protocol: cephx 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding auth protocol: cephx 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding auth protocol: cephx 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.775 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:19:19.489+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:19:19.489+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:19:19.489+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key cmddesc rotate-key hook 0x55f3d6393060 EEXIST 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d63bb8c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d63bbca0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d63ba5d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.776 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.041395s 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d63bbca0 auth_method 0 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): get_auth_request con 0x55f3d63ba5d0 auth_method 0 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.777 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d63bb8c0 auth_method 0 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:19:19.489+0000 7f548eabf640 1 monclient: found mon.noname-c 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: dump: 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.778 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: dump: 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.779 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:19:19.490+0000 7f5493540800 5 monclient: authenticate success, global_id 7820 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:19:19.490+0000 7f54902c2640 4 set_mon_vals no callback set 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.780 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:19:19.492+0000 7f5379602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:19:19.492+0000 7f5379602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:19:19.492+0000 7f5379602640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:19:19.492+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5368077140 auth_method 0 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:19:19.492+0000 7f5493540800 10 monclient: get_monmap_and_config 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:19:19.492+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:19:19.492+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:19:19.492+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.781 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding auth protocol: cephx 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding auth protocol: cephx 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding auth protocol: cephx 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.782 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:19:19.493+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding auth protocol: cephx 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding auth protocol: cephx 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding auth protocol: cephx 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.783 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:19:19.493+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:19:19.493+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:19:19.493+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key cmddesc rotate-key hook 0x7ffecf341ab8 EEXIST 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d63df9d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d640a440 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d640b7f0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.784 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.045956s 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d63df9d0 auth_method 0 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): get_auth_request con 0x55f3d640b7f0 auth_method 0 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.785 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d640a440 auth_method 0 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_done global_id 8238 payload 274 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:19:19.494+0000 7f548f2c0640 1 monclient: found mon.noname-a 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.786 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: dump: 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.787 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: dump: 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:19:19.494+0000 7f5493540800 5 monclient: authenticate success, global_id 8238 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:19:19.494+0000 7f5493540800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:19:19.494+0000 7f5493540800 4 set_mon_vals no callback set 2024-09-14T11:19:19.788 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:19:19.495+0000 7f5493540800 10 monclient: shutdown 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:19:19.495+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:19:19.495+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:19:19.495+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding auth protocol: cephx 2024-09-14T11:19:19.789 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding auth protocol: cephx 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding auth protocol: cephx 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:19:19.495+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.790 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:19:19.495+0000 7f5493540800 1 librados: starting msgr at 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:19:19.495+0000 7f5493540800 1 librados: starting objecter 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:19:19.495+0000 7f5493540800 5 asok(0x55f3d611f270) register_command objecter_requests cmddesc objecter_requests hook 0x55f3d63ddff0 EEXIST 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:19:19.496+0000 7f5493540800 1 librados: setting wanted keys 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:19:19.496+0000 7f5493540800 1 librados: calling monclient init 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding auth protocol: cephx 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding auth protocol: cephx 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding auth protocol: cephx 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.791 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:19:19.496+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:19:19.496+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:19:19.496+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key cmddesc rotate-key hook 0x55f3d63d02c8 EEXIST 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d63df9d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d640b7f0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d63fdac0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.792 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.048596s 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d63df9d0 auth_method 0 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d640b7f0 auth_method 0 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.793 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:19:19.496+0000 7f548eabf640 1 monclient: found mon.noname-c 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:19:19.496+0000 7f548fac1640 10 monclient: get_auth_request con 0x55f3d63fdac0 auth_method 0 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: dump: 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.794 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: dump: 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.795 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:19:19.497+0000 7f5493540800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:19:19.497+0000 7f5372ffd640 4 set_mon_vals no callback set 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:19:19.497+0000 7f5493540800 1 librados: init done 2024-09-14T11:19:19.796 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:19:19.497+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cr dump hook 0x55f3d6401ff8 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:19:19.499+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:19:19.499+0000 7f53717fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:19:19.499+0000 7f53717fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:19:19.499+0000 7f53717fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:19:19.499+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5358077230 auth_method 0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:19:19.500+0000 7f548fac1640 10 monclient: get_auth_request con 0x55f3d642a4e0 auth_method 0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:19:19.500+0000 7f5493540800 20 realm 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:19:19.500+0000 7f5493540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:19:19.501+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:19:19.501+0000 7f548f2c0640 10 monclient: get_auth_request con 0x55f3d642e800 auth_method 0 2024-09-14T11:19:19.797 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:19:19.502+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:19:19.502+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:19:19.502+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:19:19.502+0000 7f5493540800 20 searching for the correct realm 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:19:19.502+0000 7f548eabf640 10 monclient: get_auth_request con 0x55f3d6433970 auth_method 0 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:19:19.503+0000 7f548fac1640 10 monclient: get_auth_request con 0x7f548401e020 auth_method 0 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:19:19.504+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5488025040 auth_method 0 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:19:19.505+0000 7f548eabf640 10 monclient: get_auth_request con 0x7f548007c070 auth_method 0 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:19:19.506+0000 7f548eabf640 0 -- 172.21.15.2:0/2905710929 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f548007c070 msgr2=0x7f5480088400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:19:19.506+0000 7f53717fa640 1 client.7826.objecter ms_handle_reset 0x7f548007c070 session 0x7f54800a7040 osd.4 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:19:19.506+0000 7f53717fa640 10 monclient: _renew_subs 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:19:19.506+0000 7f53717fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:19:19.506+0000 7f548eabf640 10 monclient: get_auth_request con 0x7f53580870d0 auth_method 0 2024-09-14T11:19:19.798 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:19:19.507+0000 7f548fac1640 10 monclient: get_auth_request con 0x7f5484084010 auth_method 0 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:19:19.510+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5484063850 auth_method 0 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:19:19.510+0000 7f548f2c0640 0 -- 172.21.15.2:0/2905710929 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f5484063850 msgr2=0x7f548400ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:19:19.711+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5484063850 auth_method 0 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:19:19.717+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:19:19.717+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:19:19.717+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.799 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:19:19.718+0000 7f5493540800 20 zone default found 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:19:19.718+0000 7f5493540800 4 Realm: () 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:19:19.718+0000 7f5493540800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:19:19.718+0000 7f5493540800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:19:19.718+0000 7f5493540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:19:19.718+0000 7f5493540800 20 zonegroup default 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.800 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:19:19.719+0000 7f5493540800 20 started sync module instance, tier type = 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:19:19.720+0000 7f5493540800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=0 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=1 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=2 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=3 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=4 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=5 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=6 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:19:19.731+0000 7f5493540800 20 add_watcher() i=7 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:19:19.731+0000 7f5493540800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding auth protocol: cephx 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding auth protocol: cephx 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding auth protocol: cephx 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.801 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:19:19.733+0000 7f5345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:19:19.734+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:19:19.734+0000 7f5493540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:19.802 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:19:19.734+0000 7f5493540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache list hook 0x55f3d6414640 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache inspect hook 0x55f3d6414640 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache erase hook 0x55f3d6414640 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache zap hook 0x55f3d6414640 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:19:19.734+0000 7f5493540800 5 note: GC not initialized 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:19:19.734+0000 7f5344fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace show hook 0x7f5480072040 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace history hook 0x7f5480072040 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace active hook 0x7f5480072040 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace active_short hook 0x7f5480072040 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:19:19.734+0000 7f5493540800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:19:19.734+0000 7f5493540800 20 Filter name: none 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:19:19.734+0000 7f52be7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:19:19.734+0000 7f5493540800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:19:19.734+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.803 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:19:19.735+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:19:19.735+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:19:19.735+0000 7f5493540800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:19:19.735+0000 7f5493540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:19:19.735+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:19:19.736+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:19:19.736+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:19:19.736+0000 7f5493540800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:19:19.736+0000 7f5493540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:19:19.736+0000 7f5493540800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:19:19.736+0000 7f5493540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:19:19.737+0000 7f5493540800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:19.804 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:19:19.741+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:19:19.741+0000 7f5493540800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:19:19.741+0000 7f5493540800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:19:19.741+0000 7f5493540800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94505760166688 notifier 7826 bl.length()=827 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:19:19.746+0000 7f5493540800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5493540800 time 2024-09-14T11:19:19.745892+0000 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:19.805 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5494d8c76a] 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:19:19.746+0000 7f5493540800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f5493540800 thread_name:radosgw-admin 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.806 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5493a3e6f0] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5493a8b99c] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5494d8c7c4] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:19:19.807 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:19:19.808 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:19:19.809 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:19.810 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:19:19.811 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:19.812 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:19.813 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f52be7fc640 / http_manager 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5344fe1640 / http_manager 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5345fe3640 / rgw_dt_lg_renew 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f53717fa640 / ms_dispatch 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f53727fc640 / io_context_pool 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5372ffd640 / io_context_pool 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5379602640 / ms_dispatch 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f537be07640 / ms_dispatch 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f537d60a640 / io_context_pool 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f548eabf640 / msgr-worker-2 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f548f2c0640 / msgr-worker-1 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f548fac1640 / msgr-worker-0 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f54902c2640 / io_context_pool 2024-09-14T11:19:19.814 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5493540800 / radosgw-admin 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.150914.log 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:19:19.479+0000 7f537d60a640 10 monclient: dump: 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.815 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:19:19.479+0000 7f5493540800 5 monclient: authenticate success, global_id 8229 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:19:19.479+0000 7f5493540800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:19:19.479+0000 7f5493540800 4 set_mon_vals no callback set 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:19:19.479+0000 7f5493540800 10 monclient: shutdown 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:19:19.479+0000 7f5493540800 5 asok(0x55f3d611f270) unregister_commands rotate-key 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:19:19.480+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:19:19.480+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:19:19.480+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.816 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding auth protocol: cephx 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding auth protocol: cephx 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding auth protocol: cephx 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.817 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: crc 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d6344f90) adding con mode: secure 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:19:19.480+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: starting msgr at 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: starting objecter 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:19:19.480+0000 7f5493540800 5 asok(0x55f3d611f270) register_command objecter_requests hook 0x55f3d6340cf0 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: setting wanted keys 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:19:19.480+0000 7f5493540800 1 librados: calling monclient init 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:19:19.480+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding auth protocol: cephx 2024-09-14T11:19:19.818 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding auth protocol: cephx 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding auth protocol: cephx 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: crc 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:19:19.480+0000 7f5493540800 5 AuthRegistry(0x55f3d633f280) adding con mode: secure 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:19:19.480+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.819 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:19:19.481+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:19:19.481+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key hook 0x55f3d633f3c8 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d61ecbf0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d61f3b40 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d6288590 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:19:19.481+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.033176s 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): get_auth_request con 0x55f3d6288590 auth_method 0 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.820 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d61f3b40 auth_method 0 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d61ecbf0 auth_method 0 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:19:19.481+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.821 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:19:19.481+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient(hunting): handle_auth_done global_id 8232 payload 824 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:19:19.481+0000 7f548eabf640 1 monclient: found mon.noname-a 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:19:19.481+0000 7f548eabf640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: dump: 2024-09-14T11:19:19.822 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:19:19.481+0000 7f537be07640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:19.823 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:19:19.482+0000 7f537be07640 10 monclient: dump: 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:19:19.482+0000 7f5493540800 5 monclient: authenticate success, global_id 8232 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:19:19.482+0000 7f537d60a640 4 set_mon_vals no callback set 2024-09-14T11:19:19.824 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:19:19.482+0000 7f5493540800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:19:19.482+0000 7f5493540800 1 librados: init done 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:19:19.484+0000 7f537be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:19:19.484+0000 7f537be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:19:19.484+0000 7f537be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:19:19.484+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5374077230 auth_method 0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:19:19.485+0000 7f548fac1640 10 monclient: get_auth_request con 0x55f3d63663a0 auth_method 0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:19:19.485+0000 7f548f2c0640 10 monclient: get_auth_request con 0x55f3d638ac60 auth_method 0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:19:19.487+0000 7f548eabf640 10 monclient: get_auth_request con 0x55f3d638e4c0 auth_method 0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:19:19.488+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:19:19.488+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:19:19.488+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.825 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding auth protocol: cephx 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding auth protocol: cephx 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding auth protocol: cephx 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.826 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: crc 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6394070) adding con mode: secure 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:19:19.488+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:19:19.488+0000 7f5493540800 5 asok(0x55f3d611f270) register_command objecter_requests cmddesc objecter_requests hook 0x55f3d63975a0 EEXIST 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:19:19.488+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.827 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding auth protocol: cephx 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding auth protocol: cephx 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding auth protocol: cephx 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.828 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: crc 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:19:19.488+0000 7f5493540800 5 AuthRegistry(0x55f3d6392f18) adding con mode: secure 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:19:19.489+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:19:19.489+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:19:19.489+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key cmddesc rotate-key hook 0x55f3d6393060 EEXIST 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d63bb8c0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d63bbca0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d63ba5d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.829 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:19:19.489+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.041395s 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d63bbca0 auth_method 0 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): get_auth_request con 0x55f3d63ba5d0 auth_method 0 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:19:19.489+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d63bb8c0 auth_method 0 2024-09-14T11:19:19.830 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:19:19.489+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient(hunting): handle_auth_done global_id 7820 payload 824 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:19:19.489+0000 7f548eabf640 1 monclient: found mon.noname-c 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:19:19.489+0000 7f548eabf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: dump: 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.831 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:19:19.490+0000 7f5379602640 10 monclient: dump: 2024-09-14T11:19:19.832 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:19:19.490+0000 7f5493540800 5 monclient: authenticate success, global_id 7820 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:19:19.490+0000 7f54902c2640 4 set_mon_vals no callback set 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.833 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:19:19.490+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:19:19.492+0000 7f5379602640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:19:19.492+0000 7f5379602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:19:19.492+0000 7f5379602640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:19:19.492+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5368077140 auth_method 0 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:19:19.492+0000 7f5493540800 10 monclient: get_monmap_and_config 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:19:19.492+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:19:19.492+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:19:19.492+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.834 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding auth protocol: cephx 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding auth protocol: cephx 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding auth protocol: cephx 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.835 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: crc 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:19:19.492+0000 7f5493540800 5 AuthRegistry(0x55f3d63db860) adding con mode: secure 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:19:19.493+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding auth protocol: cephx 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding auth protocol: cephx 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding auth protocol: cephx 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.836 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: crc 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:19:19.493+0000 7f5493540800 5 AuthRegistry(0x7ffecf341970) adding con mode: secure 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:19:19.493+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:19:19.493+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:19:19.493+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key cmddesc rotate-key hook 0x7ffecf341ab8 EEXIST 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d63df9d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d640a440 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.837 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d640b7f0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:19:19.493+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.045956s 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d63df9d0 auth_method 0 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): get_auth_request con 0x55f3d640b7f0 auth_method 0 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.838 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:19:19.494+0000 7f548fac1640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d640a440 auth_method 0 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:19:19.494+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient(hunting): handle_auth_done global_id 8238 payload 274 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:19:19.494+0000 7f548f2c0640 1 monclient: found mon.noname-a 2024-09-14T11:19:19.839 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:19:19.494+0000 7f548f2c0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: dump: 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.840 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:19:19.494+0000 7f5372ffd640 10 monclient: dump: 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.841 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:19:19.494+0000 7f5493540800 5 monclient: authenticate success, global_id 8238 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:19:19.494+0000 7f5493540800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:19:19.494+0000 7f5493540800 4 set_mon_vals no callback set 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:19:19.495+0000 7f5493540800 10 monclient: shutdown 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:19:19.495+0000 7f5493540800 10 monclient: build_initial_monmap 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:19:19.495+0000 7f5493540800 1 build_initial for_mkfs: 0 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:19:19.495+0000 7f5493540800 10 monclient: monmap: 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:19.842 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding auth protocol: cephx 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding auth protocol: cephx 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding auth protocol: cephx 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.843 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: crc 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:19:19.495+0000 7f5493540800 5 AuthRegistry(0x55f3d6402440) adding con mode: secure 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:19:19.495+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:19:19.495+0000 7f5493540800 1 librados: starting msgr at 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:19:19.495+0000 7f5493540800 1 librados: starting objecter 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:19:19.495+0000 7f5493540800 5 asok(0x55f3d611f270) register_command objecter_requests cmddesc objecter_requests hook 0x55f3d63ddff0 EEXIST 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:19:19.496+0000 7f5493540800 1 librados: setting wanted keys 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:19:19.496+0000 7f5493540800 1 librados: calling monclient init 2024-09-14T11:19:19.844 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient: init 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding auth protocol: cephx 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding auth protocol: cephx 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding auth protocol: cephx 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.845 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: crc 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:19:19.496+0000 7f5493540800 5 AuthRegistry(0x55f3d63d0180) adding con mode: secure 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:19:19.496+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:19:19.496+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:19:19.496+0000 7f5493540800 5 asok(0x55f3d611f270) register_command rotate-key cmddesc rotate-key hook 0x55f3d63d02c8 EEXIST 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:19.846 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): picked mon.noname-a con 0x55f3d63df9d0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): picked mon.noname-c con 0x55f3d640b7f0 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): picked mon.noname-b con 0x55f3d63fdac0 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:19:19.496+0000 7f5493540800 10 monclient(hunting): authenticate will time out at 2186.048596s 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): get_auth_request con 0x55f3d63df9d0 auth_method 0 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.847 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): get_auth_request con 0x55f3d640b7f0 auth_method 0 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:19:19.496+0000 7f548f2c0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient(hunting): handle_auth_done global_id 7826 payload 824 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient: _finish_hunting 0 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:19:19.496+0000 7f548eabf640 1 monclient: found mon.noname-c 2024-09-14T11:19:19.848 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:19:19.496+0000 7f548eabf640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:19:19.496+0000 7f548fac1640 10 monclient: get_auth_request con 0x55f3d63fdac0 auth_method 0 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: dump: 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.849 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: _finish_auth 0 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: _check_auth_tickets 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:19:19.497+0000 7f53717fa640 10 monclient: dump: 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:19.850 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:19:19.497+0000 7f5493540800 5 monclient: authenticate success, global_id 7826 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:19:19.497+0000 7f5372ffd640 4 set_mon_vals no callback set 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _renew_subs 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:19:19.497+0000 7f5493540800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:19:19.497+0000 7f5493540800 1 librados: init done 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:19:19.497+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cr dump hook 0x55f3d6401ff8 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:19:19.499+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:19:19.499+0000 7f53717fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:19.851 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:19:19.499+0000 7f53717fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:19:19.499+0000 7f53717fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:19:19.499+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5358077230 auth_method 0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:19:19.500+0000 7f548fac1640 10 monclient: get_auth_request con 0x55f3d642a4e0 auth_method 0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:19:19.500+0000 7f5493540800 20 realm 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:19:19.500+0000 7f5493540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:19:19.500+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:19:19.501+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:19:19.501+0000 7f548f2c0640 10 monclient: get_auth_request con 0x55f3d642e800 auth_method 0 2024-09-14T11:19:19.852 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:19:19.502+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:19:19.502+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:19:19.502+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:19:19.502+0000 7f5493540800 20 searching for the correct realm 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:19:19.502+0000 7f548eabf640 10 monclient: get_auth_request con 0x55f3d6433970 auth_method 0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:19:19.503+0000 7f548fac1640 10 monclient: get_auth_request con 0x7f548401e020 auth_method 0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:19:19.504+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5488025040 auth_method 0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:19:19.505+0000 7f548eabf640 10 monclient: get_auth_request con 0x7f548007c070 auth_method 0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:19:19.506+0000 7f548eabf640 0 -- 172.21.15.2:0/2905710929 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f548007c070 msgr2=0x7f5480088400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:19:19.506+0000 7f53717fa640 1 client.7826.objecter ms_handle_reset 0x7f548007c070 session 0x7f54800a7040 osd.4 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:19:19.506+0000 7f53717fa640 10 monclient: _renew_subs 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:19:19.506+0000 7f53717fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:19:19.506+0000 7f548eabf640 10 monclient: get_auth_request con 0x7f53580870d0 auth_method 0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:19:19.507+0000 7f548fac1640 10 monclient: get_auth_request con 0x7f5484084010 auth_method 0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:19:19.510+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5484063850 auth_method 0 2024-09-14T11:19:19.853 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:19:19.510+0000 7f548f2c0640 0 -- 172.21.15.2:0/2905710929 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f5484063850 msgr2=0x7f548400ca70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:19:19.711+0000 7f548f2c0640 10 monclient: get_auth_request con 0x7f5484063850 auth_method 0 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:19:19.717+0000 7f5493540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:19:19.717+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:19:19.717+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:19:19.717+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.854 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:19:19.718+0000 7f5493540800 20 zone default found 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:19:19.718+0000 7f5493540800 4 Realm: () 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:19:19.718+0000 7f5493540800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:19:19.718+0000 7f5493540800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:19:19.718+0000 7f5493540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:19:19.718+0000 7f5493540800 20 zonegroup default 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:19:19.718+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:19:19.719+0000 7f5493540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.855 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:19:19.719+0000 7f5493540800 20 started sync module instance, tier type = 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:19:19.720+0000 7f5493540800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=0 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=1 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=2 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=3 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=4 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=5 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:19:19.730+0000 7f5493540800 20 add_watcher() i=6 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:19:19.731+0000 7f5493540800 20 add_watcher() i=7 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:19:19.731+0000 7f5493540800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding auth protocol: cephx 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding auth protocol: cephx 2024-09-14T11:19:19.856 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding auth protocol: cephx 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: crc 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:19:19.733+0000 7f5493540800 5 AuthRegistry(0x7ffecf341e50) adding con mode: secure 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:19:19.733+0000 7f5345fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.857 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:19:19.734+0000 7f5493540800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:19:19.734+0000 7f5493540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:19:19.734+0000 7f5493540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache list hook 0x55f3d6414640 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache inspect hook 0x55f3d6414640 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache erase hook 0x55f3d6414640 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command cache zap hook 0x55f3d6414640 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:19:19.734+0000 7f5493540800 5 note: GC not initialized 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:19:19.734+0000 7f5344fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace show hook 0x7f5480072040 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace history hook 0x7f5480072040 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace active hook 0x7f5480072040 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:19:19.734+0000 7f5493540800 5 asok(0x55f3d611f270) register_command sync trace active_short hook 0x7f5480072040 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:19:19.734+0000 7f5493540800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:19:19.734+0000 7f5493540800 20 Filter name: none 2024-09-14T11:19:19.858 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:19:19.734+0000 7f52be7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:19:19.734+0000 7f5493540800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:19:19.734+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:19:19.735+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:19:19.735+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:19:19.735+0000 7f5493540800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:19:19.735+0000 7f5493540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:19:19.735+0000 7f5493540800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:19:19.736+0000 7f5493540800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:19:19.736+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:19:19.736+0000 7f5493540800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:19:19.736+0000 7f5493540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:19:19.736+0000 7f5493540800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.859 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:19:19.736+0000 7f5493540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:19:19.737+0000 7f5493540800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:19:19.741+0000 7f5493540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:19:19.741+0000 7f5493540800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:19:19.741+0000 7f5493540800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:19:19.741+0000 7f5493540800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464328 cookie 94505760166688 notifier 7826 bl.length()=827 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:19:19.742+0000 7f53727fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:19:19.860 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:19:19.742+0000 7f5493540800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:19:19.746+0000 7f5493540800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5493540800 time 2024-09-14T11:19:19.745892+0000 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5494d8c76a] 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 4: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 6: main() 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 8: __libc_start_main() 2024-09-14T11:19:19.861 INFO:tasks.workunit.client.0.smithi002.stderr: 9: _start() 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:19:19.746+0000 7f5493540800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f5493540800 thread_name:radosgw-admin 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5493a3e6f0] 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5493a8b99c] 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5494d8c7c4] 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f5494d8c928] 2024-09-14T11:19:19.862 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55f3d510a0b1] 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 8: radosgw-admin(+0xd8907c) [0x55f3d561e07c] 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55f3d5119efd] 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 10: main() 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f5493a29590] 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 12: __libc_start_main() 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 13: _start() 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:19:19.863 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:19.864 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:19:19.865 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:19.866 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:19:19.867 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:19.868 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:19:19.869 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f52be7fc640 / http_manager 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5344fe1640 / http_manager 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5345fe3640 / rgw_dt_lg_renew 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f53717fa640 / ms_dispatch 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f53727fc640 / io_context_pool 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5372ffd640 / io_context_pool 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5379602640 / ms_dispatch 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f537be07640 / ms_dispatch 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f537d60a640 / io_context_pool 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f548eabf640 / msgr-worker-2 2024-09-14T11:19:19.870 INFO:tasks.workunit.client.0.smithi002.stderr: 7f548f2c0640 / msgr-worker-1 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr: 7f548fac1640 / msgr-worker-0 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr: 7f54902c2640 / io_context_pool 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr: 7f5493540800 / radosgw-admin 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:19:19.747656Z_c6e75da6-10ff-4c72-a9bc-bf7616b67baa/log 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:19:19.871 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.832+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.833+0000 7fa98ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.833+0000 7fa98ec11800 20 realm 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.833+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.833+0000 7fa98ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.833+0000 7fa98ec11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:19.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.833+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.834+0000 7fa98ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.834+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.835+0000 7fa98ec11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.835+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.835+0000 7fa98ec11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.835+0000 7fa98ec11800 20 searching for the correct realm 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.837+0000 7fa98a348640 0 -- 172.21.15.2:0/2398866313 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7fa984021070 msgr2=0x7fa9840632f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.841+0000 7fa98ab49640 0 -- 172.21.15.2:0/2398866313 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fa980088f70 msgr2=0x7fa9800b3740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:19.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.847+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 zone default found 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 4 Realm: () 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 zonegroup default 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.848+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.849+0000 7fa98ec11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.849+0000 7fa98ec11800 20 started sync module instance, tier type = 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.849+0000 7fa98ec11800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.858+0000 7fa98ec11800 20 add_watcher() i=0 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.858+0000 7fa98ec11800 20 add_watcher() i=1 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.858+0000 7fa98ec11800 20 add_watcher() i=2 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.858+0000 7fa98ec11800 20 add_watcher() i=3 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.858+0000 7fa98ec11800 20 add_watcher() i=4 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.858+0000 7fa98ec11800 20 add_watcher() i=5 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.858+0000 7fa98ec11800 20 add_watcher() i=6 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.859+0000 7fa98ec11800 20 add_watcher() i=7 2024-09-14T11:19:19.879 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.859+0000 7fa98ec11800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.861+0000 7fa83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa98ec11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa98ec11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa98ec11800 5 note: GC not initialized 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa7b77fe640 20 reqs_thread_entry: start 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa98ec11800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa98ec11800 20 Filter name: none 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa7b57fa640 20 reqs_thread_entry: start 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa98ec11800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.862+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.863+0000 7fa98ec11800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.863+0000 7fa98ec11800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.863+0000 7fa98ec11800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.863+0000 7fa98ec11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:19.880 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.863+0000 7fa98ec11800 20 rados->read ofs=0 len=0 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.864+0000 7fa98ec11800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.865+0000 7fa98ec11800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.865+0000 7fa98ec11800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.866+0000 7fa83cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.869+0000 7fa98ec11800 20 remove_watcher() i=0 2024-09-14T11:19:19.881 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.869+0000 7fa98ec11800 2 removed watcher, disabling cache 2024-09-14T11:19:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.870+0000 7fa98ec11800 20 remove_watcher() i=1 2024-09-14T11:19:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.871+0000 7fa98ec11800 20 remove_watcher() i=2 2024-09-14T11:19:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.872+0000 7fa98ec11800 20 remove_watcher() i=3 2024-09-14T11:19:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.873+0000 7fa98ec11800 20 remove_watcher() i=4 2024-09-14T11:19:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.874+0000 7fa98ec11800 20 remove_watcher() i=5 2024-09-14T11:19:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.875+0000 7fa98ec11800 20 remove_watcher() i=6 2024-09-14T11:19:19.882 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:19.876+0000 7fa98ec11800 20 remove_watcher() i=7 2024-09-14T11:19:19.885 INFO:tasks.workunit.client.0.smithi002.stderr: test: duplicated entries can be purged manually 2024-09-14T11:19:49.912 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:19:49.946 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:49.946 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:49.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.993+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 20 realm 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:49.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.995+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.996+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:49.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.996+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:49.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.997+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:49.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:49.997+0000 7fbda0135800 20 searching for the correct realm 2024-09-14T11:19:49.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.001+0000 7fbd9c622640 0 -- 172.21.15.2:0/2817085416 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55ca958b47a0 msgr2=0x55ca958b6c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.005+0000 7fbd93fff640 0 -- 172.21.15.2:0/2817085416 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fbd8c07c070 msgr2=0x7fbd8c088410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.009+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 zone default found 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 4 Realm: () 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 zonegroup default 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.010+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.011+0000 7fbda0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.011+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.011+0000 7fbda0135800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.011+0000 7fbda0135800 20 started sync module instance, tier type = 2024-09-14T11:19:50.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.011+0000 7fbda0135800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:50.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.021+0000 7fbda0135800 20 add_watcher() i=0 2024-09-14T11:19:50.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.021+0000 7fbda0135800 20 add_watcher() i=1 2024-09-14T11:19:50.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.021+0000 7fbda0135800 20 add_watcher() i=2 2024-09-14T11:19:50.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.021+0000 7fbda0135800 20 add_watcher() i=3 2024-09-14T11:19:50.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.021+0000 7fbda0135800 20 add_watcher() i=4 2024-09-14T11:19:50.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.021+0000 7fbda0135800 20 add_watcher() i=5 2024-09-14T11:19:50.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.021+0000 7fbda0135800 20 add_watcher() i=6 2024-09-14T11:19:50.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.022+0000 7fbda0135800 20 add_watcher() i=7 2024-09-14T11:19:50.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.022+0000 7fbda0135800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.024+0000 7fbc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.024+0000 7fbda0135800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.024+0000 7fbda0135800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.024+0000 7fbda0135800 5 note: GC not initialized 2024-09-14T11:19:50.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.024+0000 7fbc50fe1640 20 reqs_thread_entry: start 2024-09-14T11:19:50.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.024+0000 7fbda0135800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:50.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.024+0000 7fbda0135800 20 Filter name: none 2024-09-14T11:19:50.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.025+0000 7fbbca7fc640 20 reqs_thread_entry: start 2024-09-14T11:19:50.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.025+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.025+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.025+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.026+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.026+0000 7fbda0135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:50.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.026+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.026+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.024 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.026+0000 7fbda0135800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.026+0000 7fbda0135800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.025 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.026+0000 7fbda0135800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:50.026 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.028+0000 7fbc51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.030+0000 7fbda0135800 20 remove_watcher() i=0 2024-09-14T11:19:50.029 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.030+0000 7fbda0135800 2 removed watcher, disabling cache 2024-09-14T11:19:50.030 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.032+0000 7fbda0135800 20 remove_watcher() i=1 2024-09-14T11:19:50.031 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.033+0000 7fbda0135800 20 remove_watcher() i=2 2024-09-14T11:19:50.032 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.034+0000 7fbda0135800 20 remove_watcher() i=3 2024-09-14T11:19:50.033 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.035+0000 7fbda0135800 20 remove_watcher() i=4 2024-09-14T11:19:50.034 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.036+0000 7fbda0135800 20 remove_watcher() i=5 2024-09-14T11:19:50.035 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.037+0000 7fbda0135800 20 remove_watcher() i=6 2024-09-14T11:19:50.036 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.038+0000 7fbda0135800 20 remove_watcher() i=7 2024-09-14T11:19:50.048 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.048 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:19:50.048 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 11 size_kb: 1 num_shards: 3 2024-09-14T11:19:50.048 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.050 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 4 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-14T11:19:50.085 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:50.085 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:50.124 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.125+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.125 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 20 realm 2024-09-14T11:19:50.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:50.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.126 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.128+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.128+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.129+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:50.127 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.129+0000 7f877902f800 20 searching for the correct realm 2024-09-14T11:19:50.131 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.133+0000 7f8776318640 0 -- 172.21.15.2:0/732291571 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8768062010 msgr2=0x7f876807d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.135 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.136+0000 7f877731a640 0 -- 172.21.15.2:0/732291571 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f876c07cd20 msgr2=0x7f876c0681e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.138 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:50.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:50.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.139 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.140+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.140 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 zone default found 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 4 Realm: () 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 zonegroup default 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.142+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.142+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.142+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.142+0000 7f877902f800 20 started sync module instance, tier type = 2024-09-14T11:19:50.141 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.142+0000 7f877902f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:50.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=0 2024-09-14T11:19:50.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=1 2024-09-14T11:19:50.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=2 2024-09-14T11:19:50.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=3 2024-09-14T11:19:50.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=4 2024-09-14T11:19:50.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=5 2024-09-14T11:19:50.149 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=6 2024-09-14T11:19:50.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.152+0000 7f877902f800 20 add_watcher() i=7 2024-09-14T11:19:50.150 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.152+0000 7f877902f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f862dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.152 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f877902f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f877902f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f877902f800 5 note: GC not initialized 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f862cfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f877902f800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f877902f800 20 Filter name: none 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f8625ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f877902f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:50.153 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.154+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.154 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.155+0000 7f877902f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:50.155 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.156+0000 7f877902f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:50.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.159 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 93958571112432 notifier 7877 bl.length()=827 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:19:50.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:19:50.164 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f877902f800 time 2024-09-14T11:19:50.166773+0000 2024-09-14T11:19:50.164 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:50.164 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.164 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f877c58c76a] 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr:*** Caught signal (Aborted) ** 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f877902f800 thread_name:radosgw-admin 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.166+0000 7f877902f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f877902f800 time 2024-09-14T11:19:50.166773+0000 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.165 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f877c58c76a] 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:19:50.166 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f877b23e6f0] 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f877b28b99c] 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f877c58c7c4] 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.185 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.167+0000 7f877902f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f877902f800 thread_name:radosgw-admin 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f877b23e6f0] 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f877b28b99c] 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f877c58c7c4] 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.186 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: dump: 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.187 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:19:50.108+0000 7f877902f800 5 monclient: authenticate success, global_id 8283 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: dump: 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.188 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:19:50.108+0000 7f877902f800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:19:50.108+0000 7f877902f800 4 set_mon_vals no callback set 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: shutdown 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:19:50.109+0000 7f877902f800 5 asok(0x55746f0f8270) unregister_commands rotate-key 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:19:50.109+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.189 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding auth protocol: cephx 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding auth protocol: cephx 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding auth protocol: cephx 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.190 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:19:50.109+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: starting msgr at 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: starting objecter 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:19:50.109+0000 7f877902f800 5 asok(0x55746f0f8270) register_command objecter_requests hook 0x55746f31bbe0 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: setting wanted keys 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: calling monclient init 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.191 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding auth protocol: cephx 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding auth protocol: cephx 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding auth protocol: cephx 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.192 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:19:50.110+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:19:50.110+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:19:50.110+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key hook 0x55746f318698 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f1a37a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f25b700 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f261b90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.193 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.662386s 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): get_auth_request con 0x55746f1a37a0 auth_method 0 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f25b700 auth_method 0 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.194 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f261b90 auth_method 0 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_done global_id 8286 payload 824 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:19:50.110+0000 7f8776b19640 1 monclient: found mon.noname-a 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: dump: 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.195 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: dump: 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.196 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:19:50.111+0000 7f877902f800 5 monclient: authenticate success, global_id 8286 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:19:50.111+0000 7f8664e09640 4 set_mon_vals no callback set 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.197 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:19:50.111+0000 7f877902f800 1 librados: init done 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:19:50.113+0000 7f8663606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:19:50.113+0000 7f8663606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:19:50.113+0000 7f8663606640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:19:50.113+0000 7f8776318640 10 monclient: get_auth_request con 0x7f865c077230 auth_method 0 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:19:50.113+0000 7f877731a640 10 monclient: get_auth_request con 0x55746f341200 auth_method 0 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:19:50.114+0000 7f8776b19640 10 monclient: get_auth_request con 0x55746f3641d0 auth_method 0 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:19:50.115+0000 7f8776318640 10 monclient: get_auth_request con 0x55746f369390 auth_method 0 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:19:50.116+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:19:50.116+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:19:50.116+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.198 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding auth protocol: cephx 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding auth protocol: cephx 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding auth protocol: cephx 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.199 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:19:50.116+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:19:50.116+0000 7f877902f800 5 asok(0x55746f0f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55746f370e50 EEXIST 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:19:50.116+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding auth protocol: cephx 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding auth protocol: cephx 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding auth protocol: cephx 2024-09-14T11:19:50.200 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:19:50.117+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:19:50.117+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.201 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:19:50.117+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key cmddesc rotate-key hook 0x55746f36c500 EEXIST 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f394b40 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f396e10 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f393310 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.669594s 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f396e10 auth_method 0 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.202 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f393310 auth_method 0 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): get_auth_request con 0x55746f394b40 auth_method 0 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.203 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:19:50.117+0000 7f8776318640 1 monclient: found mon.noname-a 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: dump: 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.204 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: dump: 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.205 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:19:50.118+0000 7f877902f800 5 monclient: authenticate success, global_id 8289 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:19:50.118+0000 7f8777b1b640 4 set_mon_vals no callback set 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:19:50.120+0000 7f8660e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:19:50.120+0000 7f8660e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:19:50.120+0000 7f8660e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: get_monmap_and_config 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.206 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:19:50.120+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding auth protocol: cephx 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding auth protocol: cephx 2024-09-14T11:19:50.207 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding auth protocol: cephx 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:19:50.120+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f8650077140 auth_method 0 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:19:50.120+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.208 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding auth protocol: cephx 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding auth protocol: cephx 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding auth protocol: cephx 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.209 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:19:50.121+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:19:50.121+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:19:50.121+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key cmddesc rotate-key hook 0x7ffd32019228 EEXIST 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f3e9070 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f3b9f40 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f3e4a20 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.210 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.673524s 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): get_auth_request con 0x55746f3e9070 auth_method 0 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f3b9f40 auth_method 0 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.211 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f3e4a20 auth_method 0 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_done global_id 8292 payload 274 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:19:50.121+0000 7f8776b19640 1 monclient: found mon.noname-a 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: dump: 2024-09-14T11:19:50.212 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.213 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: dump: 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:19:50.122+0000 7f877902f800 5 monclient: authenticate success, global_id 8292 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:50.214 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:19:50.122+0000 7f877902f800 4 set_mon_vals no callback set 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: shutdown 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:19:50.122+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.215 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding auth protocol: cephx 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding auth protocol: cephx 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding auth protocol: cephx 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.216 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:19:50.123+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: starting msgr at 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: starting objecter 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:19:50.123+0000 7f877902f800 5 asok(0x55746f0f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55746f3b70d0 EEXIST 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: setting wanted keys 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: calling monclient init 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding auth protocol: cephx 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding auth protocol: cephx 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding auth protocol: cephx 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.217 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:19:50.123+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:19:50.123+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:19:50.123+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key cmddesc rotate-key hook 0x55746f3aca38 EEXIST 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:19:50.218 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f3b9f40 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f3e4a20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f3e9070 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.675803s 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f3e4a20 auth_method 0 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f3e9070 auth_method 0 2024-09-14T11:19:50.219 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:19:50.124+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:19:50.124+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:19:50.124+0000 7f8776318640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:19:50.124+0000 7f8776318640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:19:50.124+0000 7f8776318640 1 monclient: found mon.noname-c 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:19:50.124+0000 7f8776318640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.220 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: dump: 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.221 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:19:50.124+0000 7f877902f800 5 monclient: authenticate success, global_id 7877 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: dump: 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.222 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.223 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.223 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:19:50.124+0000 7f865a7fc640 4 set_mon_vals no callback set 2024-09-14T11:19:50.223 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:19:50.124+0000 7f877902f800 1 librados: init done 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:19:50.124+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cr dump hook 0x55746f3dfa98 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:19:50.125+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:19:50.126+0000 7f8658ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:19:50.126+0000 7f8658ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:19:50.126+0000 7f8658ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:19:50.126+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f8640077230 auth_method 0 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:19:50.126+0000 7f877731a640 10 monclient: get_auth_request con 0x55746f403920 auth_method 0 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:19:50.127+0000 7f877902f800 20 realm 2024-09-14T11:19:50.224 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:19:50.127+0000 7f877902f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:19:50.128+0000 7f8776b19640 10 monclient: get_auth_request con 0x55746f407bc0 auth_method 0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:19:50.128+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:19:50.128+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:19:50.129+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:19:50.129+0000 7f877902f800 20 searching for the correct realm 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:19:50.129+0000 7f8776318640 10 monclient: get_auth_request con 0x55746f40ce60 auth_method 0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:19:50.130+0000 7f877731a640 10 monclient: get_auth_request con 0x7f876c073b30 auth_method 0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:19:50.130+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f8770070040 auth_method 0 2024-09-14T11:19:50.225 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:19:50.131+0000 7f8776318640 10 monclient: get_auth_request con 0x7f8768062010 auth_method 0 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:19:50.133+0000 7f8776318640 0 -- 172.21.15.2:0/732291571 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8768062010 msgr2=0x7f876807d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:19:50.133+0000 7f8658ff9640 1 client.7877.objecter ms_handle_reset 0x7f8768062010 session 0x7f876808d070 osd.4 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:19:50.133+0000 7f8658ff9640 10 monclient: _renew_subs 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:19:50.133+0000 7f8658ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:19:50.133+0000 7f877731a640 10 monclient: get_auth_request con 0x7f876c07cd20 auth_method 0 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:19:50.133+0000 7f8776318640 10 monclient: get_auth_request con 0x7f8640087050 auth_method 0 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:19:50.135+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f876c074b50 auth_method 0 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:19:50.136+0000 7f877731a640 0 -- 172.21.15.2:0/732291571 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f876c07cd20 msgr2=0x7f876c0681e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:19:50.137+0000 7f8658ff9640 1 client.7877.objecter ms_handle_reset 0x7f876c07cd20 session 0x7f876c078380 osd.6 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:19:50.137+0000 7f877731a640 10 monclient: get_auth_request con 0x7f8768062010 auth_method 0 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.226 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:19:50.140+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:19:50.140+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:19:50.140+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:19:50.141+0000 7f877902f800 20 zone default found 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:19:50.141+0000 7f877902f800 4 Realm: () 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:19:50.141+0000 7f877902f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:19:50.141+0000 7f877902f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:50.227 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:19:50.141+0000 7f877902f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:19:50.141+0000 7f877902f800 20 zonegroup default 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:19:50.142+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:19:50.142+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:19:50.142+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:19:50.142+0000 7f877902f800 20 started sync module instance, tier type = 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:19:50.142+0000 7f877902f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=0 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=1 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=2 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=3 2024-09-14T11:19:50.228 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=4 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=5 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=6 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:19:50.152+0000 7f877902f800 20 add_watcher() i=7 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:19:50.152+0000 7f877902f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding auth protocol: cephx 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding auth protocol: cephx 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding auth protocol: cephx 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.229 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:19:50.154+0000 7f862dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:19:50.154+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:19:50.154+0000 7f877902f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:19:50.154+0000 7f877902f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache list hook 0x55746f3df430 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache inspect hook 0x55746f3df430 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache erase hook 0x55746f3df430 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache zap hook 0x55746f3df430 2024-09-14T11:19:50.230 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:19:50.154+0000 7f877902f800 5 note: GC not initialized 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:19:50.154+0000 7f862cfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace show hook 0x7f8768067070 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace history hook 0x7f8768067070 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace active hook 0x7f8768067070 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace active_short hook 0x7f8768067070 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:19:50.154+0000 7f877902f800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:19:50.154+0000 7f877902f800 20 Filter name: none 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:19:50.154+0000 7f8625ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:19:50.154+0000 7f877902f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:19:50.154+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:19:50.155+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:19:50.155+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:19:50.155+0000 7f877902f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:50.231 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:19:50.155+0000 7f877902f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:19:50.155+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:19:50.155+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:19:50.155+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:19:50.155+0000 7f877902f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:19:50.155+0000 7f877902f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:19:50.155+0000 7f877902f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:19:50.155+0000 7f877902f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:19:50.156+0000 7f877902f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:50.232 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:19:50.161+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:19:50.161+0000 7f877902f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:19:50.161+0000 7f877902f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:19:50.161+0000 7f877902f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 93958571112432 notifier 7877 bl.length()=827 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:19:50.166+0000 7f877902f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f877902f800 time 2024-09-14T11:19:50.166773+0000 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:50.233 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f877c58c76a] 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:19:50.167+0000 7f877902f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f877902f800 thread_name:radosgw-admin 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.234 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f877b23e6f0] 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f877b28b99c] 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f877c58c7c4] 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.235 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:19:50.236 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:19:50.237 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:50.238 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:19:50.239 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:50.240 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:50.241 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8625ffb640 / http_manager 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f862cfe1640 / http_manager 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f862dfe3640 / rgw_dt_lg_renew 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8658ff9640 / ms_dispatch 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8659ffb640 / io_context_pool 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f865a7fc640 / io_context_pool 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8660e01640 / ms_dispatch 2024-09-14T11:19:50.242 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8663606640 / ms_dispatch 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8664e09640 / io_context_pool 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8776318640 / msgr-worker-2 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8776b19640 / msgr-worker-1 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: 7f877731a640 / msgr-worker-0 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8777b1b640 / io_context_pool 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: 7f877902f800 / radosgw-admin 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/log/ceph/ceph-client.admin.152681.log 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr:--- begin dump of recent events --- 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr: -499> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: dump: 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.243 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: -498> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: -497> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: -496> 2024-09-14T11:19:50.108+0000 7f877902f800 5 monclient: authenticate success, global_id 8283 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: -495> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: -494> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: -493> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.244 INFO:tasks.workunit.client.0.smithi002.stderr: -492> 2024-09-14T11:19:50.108+0000 7f8664e09640 10 monclient: dump: 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr: -491> 2024-09-14T11:19:50.108+0000 7f877902f800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr: -490> 2024-09-14T11:19:50.108+0000 7f877902f800 4 set_mon_vals no callback set 2024-09-14T11:19:50.245 INFO:tasks.workunit.client.0.smithi002.stderr: -489> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: shutdown 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr: -488> 2024-09-14T11:19:50.109+0000 7f877902f800 5 asok(0x55746f0f8270) unregister_commands rotate-key 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr: -487> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr: -486> 2024-09-14T11:19:50.109+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr: -485> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.246 INFO:tasks.workunit.client.0.smithi002.stderr: -484> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding auth protocol: cephx 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -483> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding auth protocol: cephx 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -482> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding auth protocol: cephx 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -481> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -480> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -479> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -478> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -477> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -476> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -475> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -474> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -473> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -472> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -471> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: crc 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -470> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f31e1e0) adding con mode: secure 2024-09-14T11:19:50.247 INFO:tasks.workunit.client.0.smithi002.stderr: -469> 2024-09-14T11:19:50.109+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -468> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: starting msgr at 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -467> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: starting objecter 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -466> 2024-09-14T11:19:50.109+0000 7f877902f800 5 asok(0x55746f0f8270) register_command objecter_requests hook 0x55746f31bbe0 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -465> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: setting wanted keys 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -464> 2024-09-14T11:19:50.109+0000 7f877902f800 1 librados: calling monclient init 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -463> 2024-09-14T11:19:50.109+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -462> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding auth protocol: cephx 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -461> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding auth protocol: cephx 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -460> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding auth protocol: cephx 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -459> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -458> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -457> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -456> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.248 INFO:tasks.workunit.client.0.smithi002.stderr: -455> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -454> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -453> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -452> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -451> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -450> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -449> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: crc 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -448> 2024-09-14T11:19:50.109+0000 7f877902f800 5 AuthRegistry(0x55746f318550) adding con mode: secure 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -447> 2024-09-14T11:19:50.110+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -446> 2024-09-14T11:19:50.110+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -445> 2024-09-14T11:19:50.110+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key hook 0x55746f318698 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -444> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -443> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -442> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f1a37a0 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.249 INFO:tasks.workunit.client.0.smithi002.stderr: -441> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f25b700 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -440> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f261b90 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -439> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -438> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -437> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -436> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -435> 2024-09-14T11:19:50.110+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.662386s 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -434> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): get_auth_request con 0x55746f1a37a0 auth_method 0 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -433> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -432> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -431> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -430> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f25b700 auth_method 0 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -429> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -428> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -427> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.250 INFO:tasks.workunit.client.0.smithi002.stderr: -426> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -425> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -424> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -423> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -422> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -421> 2024-09-14T11:19:50.110+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -420> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f261b90 auth_method 0 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -419> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -418> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -417> 2024-09-14T11:19:50.110+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -416> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient(hunting): handle_auth_done global_id 8286 payload 824 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -415> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -414> 2024-09-14T11:19:50.110+0000 7f8776b19640 1 monclient: found mon.noname-a 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -413> 2024-09-14T11:19:50.110+0000 7f8776b19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -412> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.251 INFO:tasks.workunit.client.0.smithi002.stderr: -411> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr: -410> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: dump: 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr: -409> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr: -408> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.252 INFO:tasks.workunit.client.0.smithi002.stderr: -407> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr: -406> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr: -405> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr: -404> 2024-09-14T11:19:50.111+0000 7f8663606640 10 monclient: dump: 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.253 INFO:tasks.workunit.client.0.smithi002.stderr: -403> 2024-09-14T11:19:50.111+0000 7f877902f800 5 monclient: authenticate success, global_id 8286 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -402> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -401> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -400> 2024-09-14T11:19:50.111+0000 7f8664e09640 4 set_mon_vals no callback set 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -399> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -398> 2024-09-14T11:19:50.111+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -397> 2024-09-14T11:19:50.111+0000 7f877902f800 1 librados: init done 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -396> 2024-09-14T11:19:50.113+0000 7f8663606640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -395> 2024-09-14T11:19:50.113+0000 7f8663606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -394> 2024-09-14T11:19:50.113+0000 7f8663606640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -393> 2024-09-14T11:19:50.113+0000 7f8776318640 10 monclient: get_auth_request con 0x7f865c077230 auth_method 0 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -392> 2024-09-14T11:19:50.113+0000 7f877731a640 10 monclient: get_auth_request con 0x55746f341200 auth_method 0 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -391> 2024-09-14T11:19:50.114+0000 7f8776b19640 10 monclient: get_auth_request con 0x55746f3641d0 auth_method 0 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -390> 2024-09-14T11:19:50.115+0000 7f8776318640 10 monclient: get_auth_request con 0x55746f369390 auth_method 0 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -389> 2024-09-14T11:19:50.116+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.254 INFO:tasks.workunit.client.0.smithi002.stderr: -388> 2024-09-14T11:19:50.116+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr: -387> 2024-09-14T11:19:50.116+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr: -386> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding auth protocol: cephx 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr: -385> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding auth protocol: cephx 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr: -384> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding auth protocol: cephx 2024-09-14T11:19:50.255 INFO:tasks.workunit.client.0.smithi002.stderr: -383> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -382> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -381> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -380> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -379> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -378> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -377> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -376> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -375> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -374> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -373> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: crc 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -372> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36d400) adding con mode: secure 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -371> 2024-09-14T11:19:50.116+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.256 INFO:tasks.workunit.client.0.smithi002.stderr: -370> 2024-09-14T11:19:50.116+0000 7f877902f800 5 asok(0x55746f0f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55746f370e50 EEXIST 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -369> 2024-09-14T11:19:50.116+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -368> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding auth protocol: cephx 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -367> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding auth protocol: cephx 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -366> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding auth protocol: cephx 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -365> 2024-09-14T11:19:50.116+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -364> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -363> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -362> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -361> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -360> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -359> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -358> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -357> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.257 INFO:tasks.workunit.client.0.smithi002.stderr: -356> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -355> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: crc 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -354> 2024-09-14T11:19:50.117+0000 7f877902f800 5 AuthRegistry(0x55746f36c3b8) adding con mode: secure 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -353> 2024-09-14T11:19:50.117+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -352> 2024-09-14T11:19:50.117+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -351> 2024-09-14T11:19:50.117+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key cmddesc rotate-key hook 0x55746f36c500 EEXIST 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -350> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -349> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -348> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f394b40 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -347> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f396e10 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -346> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f393310 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -345> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.258 INFO:tasks.workunit.client.0.smithi002.stderr: -344> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -343> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -342> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -341> 2024-09-14T11:19:50.117+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.669594s 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -340> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f396e10 auth_method 0 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -339> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -338> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -337> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -336> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f393310 auth_method 0 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -335> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -334> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -333> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -332> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -331> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.259 INFO:tasks.workunit.client.0.smithi002.stderr: -330> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -329> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -328> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -327> 2024-09-14T11:19:50.117+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -326> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): get_auth_request con 0x55746f394b40 auth_method 0 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -325> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -324> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -323> 2024-09-14T11:19:50.117+0000 7f8776b19640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -322> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient(hunting): handle_auth_done global_id 8289 payload 824 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -321> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -320> 2024-09-14T11:19:50.117+0000 7f8776318640 1 monclient: found mon.noname-a 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -319> 2024-09-14T11:19:50.117+0000 7f8776318640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -318> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -317> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:50.260 INFO:tasks.workunit.client.0.smithi002.stderr: -316> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: dump: 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr: -315> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr: -314> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr: -313> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.261 INFO:tasks.workunit.client.0.smithi002.stderr: -312> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr: -311> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr: -310> 2024-09-14T11:19:50.118+0000 7f8660e01640 10 monclient: dump: 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.262 INFO:tasks.workunit.client.0.smithi002.stderr: -309> 2024-09-14T11:19:50.118+0000 7f877902f800 5 monclient: authenticate success, global_id 8289 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -308> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -307> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -306> 2024-09-14T11:19:50.118+0000 7f8777b1b640 4 set_mon_vals no callback set 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -305> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -304> 2024-09-14T11:19:50.118+0000 7f877902f800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -303> 2024-09-14T11:19:50.120+0000 7f8660e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -302> 2024-09-14T11:19:50.120+0000 7f8660e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -301> 2024-09-14T11:19:50.120+0000 7f8660e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -300> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: get_monmap_and_config 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -299> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.263 INFO:tasks.workunit.client.0.smithi002.stderr: -298> 2024-09-14T11:19:50.120+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr: -297> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr: -296> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding auth protocol: cephx 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr: -295> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding auth protocol: cephx 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr: -294> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding auth protocol: cephx 2024-09-14T11:19:50.264 INFO:tasks.workunit.client.0.smithi002.stderr: -293> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -292> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -291> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -290> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -289> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -288> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -287> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -286> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -285> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -284> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -283> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: crc 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -282> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x55746f3b4a20) adding con mode: secure 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -281> 2024-09-14T11:19:50.120+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f8650077140 auth_method 0 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -280> 2024-09-14T11:19:50.120+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.265 INFO:tasks.workunit.client.0.smithi002.stderr: -279> 2024-09-14T11:19:50.120+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -278> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding auth protocol: cephx 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -277> 2024-09-14T11:19:50.120+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding auth protocol: cephx 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -276> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding auth protocol: cephx 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -275> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -274> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -273> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -272> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -271> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -270> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -269> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -268> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -267> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -266> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.266 INFO:tasks.workunit.client.0.smithi002.stderr: -265> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: crc 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -264> 2024-09-14T11:19:50.121+0000 7f877902f800 5 AuthRegistry(0x7ffd320190e0) adding con mode: secure 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -263> 2024-09-14T11:19:50.121+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -262> 2024-09-14T11:19:50.121+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -261> 2024-09-14T11:19:50.121+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key cmddesc rotate-key hook 0x7ffd32019228 EEXIST 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -260> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -259> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -258> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f3e9070 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -257> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f3b9f40 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -256> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f3e4a20 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -255> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -254> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -253> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -252> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -251> 2024-09-14T11:19:50.121+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.673524s 2024-09-14T11:19:50.267 INFO:tasks.workunit.client.0.smithi002.stderr: -250> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): get_auth_request con 0x55746f3e9070 auth_method 0 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -249> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -248> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -247> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -246> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f3b9f40 auth_method 0 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -245> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -244> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -243> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -242> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -241> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -240> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -239> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -238> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.268 INFO:tasks.workunit.client.0.smithi002.stderr: -237> 2024-09-14T11:19:50.121+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -236> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f3e4a20 auth_method 0 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -235> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -234> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -233> 2024-09-14T11:19:50.121+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -232> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient(hunting): handle_auth_done global_id 8292 payload 274 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -231> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -230> 2024-09-14T11:19:50.121+0000 7f8776b19640 1 monclient: found mon.noname-a 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -229> 2024-09-14T11:19:50.121+0000 7f8776b19640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.2:3300/0 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -228> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -227> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr: -226> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: dump: 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.269 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr: -225> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr: -224> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr: -223> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr: -222> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr: -221> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr: -220> 2024-09-14T11:19:50.122+0000 7f865a7fc640 10 monclient: dump: 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.270 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr: -219> 2024-09-14T11:19:50.122+0000 7f877902f800 5 monclient: authenticate success, global_id 8292 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr: -218> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: get_monmap_and_config success 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr: -217> 2024-09-14T11:19:50.122+0000 7f877902f800 4 set_mon_vals no callback set 2024-09-14T11:19:50.271 INFO:tasks.workunit.client.0.smithi002.stderr: -216> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: shutdown 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr: -215> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: build_initial_monmap 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr: -214> 2024-09-14T11:19:50.122+0000 7f877902f800 1 build_initial for_mkfs: 0 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr: -213> 2024-09-14T11:19:50.122+0000 7f877902f800 10 monclient: monmap: 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 0 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 0.000000 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:created 0.000000 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 0 (unknown) 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.noname-a 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.noname-b 2024-09-14T11:19:50.272 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.noname-c 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -212> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding auth protocol: cephx 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -211> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding auth protocol: cephx 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -210> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding auth protocol: cephx 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -209> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -208> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -207> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -206> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -205> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -204> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -203> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -202> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.273 INFO:tasks.workunit.client.0.smithi002.stderr: -201> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -200> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -199> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: crc 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -198> 2024-09-14T11:19:50.122+0000 7f877902f800 5 AuthRegistry(0x55746f3db5f0) adding con mode: secure 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -197> 2024-09-14T11:19:50.123+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -196> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: starting msgr at 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -195> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: starting objecter 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -194> 2024-09-14T11:19:50.123+0000 7f877902f800 5 asok(0x55746f0f8270) register_command objecter_requests cmddesc objecter_requests hook 0x55746f3b70d0 EEXIST 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -193> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: setting wanted keys 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -192> 2024-09-14T11:19:50.123+0000 7f877902f800 1 librados: calling monclient init 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -191> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient: init 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -190> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding auth protocol: cephx 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -189> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding auth protocol: cephx 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -188> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding auth protocol: cephx 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -187> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.274 INFO:tasks.workunit.client.0.smithi002.stderr: -186> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -185> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -184> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -183> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -182> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -181> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -180> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -179> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -178> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -177> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: crc 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -176> 2024-09-14T11:19:50.123+0000 7f877902f800 5 AuthRegistry(0x55746f3ac8f0) adding con mode: secure 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -175> 2024-09-14T11:19:50.123+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -174> 2024-09-14T11:19:50.123+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -173> 2024-09-14T11:19:50.123+0000 7f877902f800 5 asok(0x55746f0f8270) register_command rotate-key cmddesc rotate-key hook 0x55746f3aca38 EEXIST 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -172> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient: _reopen_session rank -1 2024-09-14T11:19:50.275 INFO:tasks.workunit.client.0.smithi002.stderr: -171> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -170> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): picked mon.noname-b con 0x55746f3b9f40 addr [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -169> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): picked mon.noname-c con 0x55746f3e4a20 addr [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -168> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): picked mon.noname-a con 0x55746f3e9070 addr [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -167> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -166> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -165> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): start opening mon connection 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -164> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): _renew_subs 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -163> 2024-09-14T11:19:50.123+0000 7f877902f800 10 monclient(hunting): authenticate will time out at 2216.675803s 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -162> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): get_auth_request con 0x55746f3e4a20 auth_method 0 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -161> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -160> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -159> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -158> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): get_auth_request con 0x55746f3e9070 auth_method 0 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -157> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-14T11:19:50.276 INFO:tasks.workunit.client.0.smithi002.stderr: -156> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): _init_auth method 2 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -155> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): _init_auth creating new auth 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -154> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -153> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -152> 2024-09-14T11:19:50.123+0000 7f8776318640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -151> 2024-09-14T11:19:50.123+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -150> 2024-09-14T11:19:50.124+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -149> 2024-09-14T11:19:50.124+0000 7f877731a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -148> 2024-09-14T11:19:50.124+0000 7f8776318640 10 monclient(hunting): handle_auth_done global_id 7877 payload 824 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -147> 2024-09-14T11:19:50.124+0000 7f8776318640 10 monclient: _finish_hunting 0 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -146> 2024-09-14T11:19:50.124+0000 7f8776318640 1 monclient: found mon.noname-c 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -145> 2024-09-14T11:19:50.124+0000 7f8776318640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -144> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -143> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr: -142> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: dump: 2024-09-14T11:19:50.277 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr: -141> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: _finish_auth 0 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr: -140> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: _check_auth_tickets 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr: -139> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: handle_config config(0 keys) 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr: -138> 2024-09-14T11:19:50.124+0000 7f877902f800 5 monclient: authenticate success, global_id 7877 2024-09-14T11:19:50.278 INFO:tasks.workunit.client.0.smithi002.stderr: -137> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr: -136> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr: -135> 2024-09-14T11:19:50.124+0000 7f8658ff9640 10 monclient: dump: 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:epoch 1 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:fsid 28256c28-b166-4632-9431-ec178da9e31e 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:last_changed 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:created 2024-09-14T10:54:56.444181+0000 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:min_mon_release 19 (squid) 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:election_strategy: 1 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:0: [v2:172.21.15.2:3300/0,v1:172.21.15.2:6789/0] mon.a 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:1: [v2:172.21.15.86:3300/0,v1:172.21.15.86:6789/0] mon.b 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr:2: [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] mon.c 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr: -134> 2024-09-14T11:19:50.124+0000 7f865a7fc640 4 set_mon_vals no callback set 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr: -133> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.279 INFO:tasks.workunit.client.0.smithi002.stderr: -132> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -131> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _renew_subs 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -130> 2024-09-14T11:19:50.124+0000 7f877902f800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -129> 2024-09-14T11:19:50.124+0000 7f877902f800 1 librados: init done 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -128> 2024-09-14T11:19:50.124+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cr dump hook 0x55746f3dfa98 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -127> 2024-09-14T11:19:50.125+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -126> 2024-09-14T11:19:50.126+0000 7f8658ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -125> 2024-09-14T11:19:50.126+0000 7f8658ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -124> 2024-09-14T11:19:50.126+0000 7f8658ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.86:6800/3641925805,v1:172.21.15.86:6801/3641925805] 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -123> 2024-09-14T11:19:50.126+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f8640077230 auth_method 0 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -122> 2024-09-14T11:19:50.126+0000 7f877731a640 10 monclient: get_auth_request con 0x55746f403920 auth_method 0 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -121> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -120> 2024-09-14T11:19:50.127+0000 7f877902f800 20 realm 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -119> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.280 INFO:tasks.workunit.client.0.smithi002.stderr: -118> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -117> 2024-09-14T11:19:50.127+0000 7f877902f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -116> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -115> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -114> 2024-09-14T11:19:50.127+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -113> 2024-09-14T11:19:50.128+0000 7f8776b19640 10 monclient: get_auth_request con 0x55746f407bc0 auth_method 0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -112> 2024-09-14T11:19:50.128+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -111> 2024-09-14T11:19:50.128+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -110> 2024-09-14T11:19:50.129+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -109> 2024-09-14T11:19:50.129+0000 7f877902f800 20 searching for the correct realm 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -108> 2024-09-14T11:19:50.129+0000 7f8776318640 10 monclient: get_auth_request con 0x55746f40ce60 auth_method 0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -107> 2024-09-14T11:19:50.130+0000 7f877731a640 10 monclient: get_auth_request con 0x7f876c073b30 auth_method 0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -106> 2024-09-14T11:19:50.130+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f8770070040 auth_method 0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -105> 2024-09-14T11:19:50.131+0000 7f8776318640 10 monclient: get_auth_request con 0x7f8768062010 auth_method 0 2024-09-14T11:19:50.281 INFO:tasks.workunit.client.0.smithi002.stderr: -104> 2024-09-14T11:19:50.133+0000 7f8776318640 0 -- 172.21.15.2:0/732291571 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f8768062010 msgr2=0x7f876807d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -103> 2024-09-14T11:19:50.133+0000 7f8658ff9640 1 client.7877.objecter ms_handle_reset 0x7f8768062010 session 0x7f876808d070 osd.4 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -102> 2024-09-14T11:19:50.133+0000 7f8658ff9640 10 monclient: _renew_subs 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -101> 2024-09-14T11:19:50.133+0000 7f8658ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.2:3301/0 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -100> 2024-09-14T11:19:50.133+0000 7f877731a640 10 monclient: get_auth_request con 0x7f876c07cd20 auth_method 0 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -99> 2024-09-14T11:19:50.133+0000 7f8776318640 10 monclient: get_auth_request con 0x7f8640087050 auth_method 0 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -98> 2024-09-14T11:19:50.135+0000 7f8776b19640 10 monclient: get_auth_request con 0x7f876c074b50 auth_method 0 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -97> 2024-09-14T11:19:50.136+0000 7f877731a640 0 -- 172.21.15.2:0/732291571 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f876c07cd20 msgr2=0x7f876c0681e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -96> 2024-09-14T11:19:50.137+0000 7f8658ff9640 1 client.7877.objecter ms_handle_reset 0x7f876c07cd20 session 0x7f876c078380 osd.6 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -95> 2024-09-14T11:19:50.137+0000 7f877731a640 10 monclient: get_auth_request con 0x7f8768062010 auth_method 0 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -94> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -93> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -92> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:50.282 INFO:tasks.workunit.client.0.smithi002.stderr: -91> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -90> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -89> 2024-09-14T11:19:50.140+0000 7f877902f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -88> 2024-09-14T11:19:50.140+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -87> 2024-09-14T11:19:50.140+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -86> 2024-09-14T11:19:50.140+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -85> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -84> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -83> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -82> 2024-09-14T11:19:50.141+0000 7f877902f800 20 zone default found 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -81> 2024-09-14T11:19:50.141+0000 7f877902f800 4 Realm: () 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -80> 2024-09-14T11:19:50.141+0000 7f877902f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -79> 2024-09-14T11:19:50.141+0000 7f877902f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -78> 2024-09-14T11:19:50.141+0000 7f877902f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -77> 2024-09-14T11:19:50.141+0000 7f877902f800 20 zonegroup default 2024-09-14T11:19:50.283 INFO:tasks.workunit.client.0.smithi002.stderr: -76> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -75> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -74> 2024-09-14T11:19:50.141+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -73> 2024-09-14T11:19:50.142+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -72> 2024-09-14T11:19:50.142+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -71> 2024-09-14T11:19:50.142+0000 7f877902f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -70> 2024-09-14T11:19:50.142+0000 7f877902f800 20 started sync module instance, tier type = 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -69> 2024-09-14T11:19:50.142+0000 7f877902f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -68> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=0 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -67> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=1 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -66> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=2 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -65> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=3 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -64> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=4 2024-09-14T11:19:50.284 INFO:tasks.workunit.client.0.smithi002.stderr: -63> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=5 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -62> 2024-09-14T11:19:50.151+0000 7f877902f800 20 add_watcher() i=6 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -61> 2024-09-14T11:19:50.152+0000 7f877902f800 20 add_watcher() i=7 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -60> 2024-09-14T11:19:50.152+0000 7f877902f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -59> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding auth protocol: cephx 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -58> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding auth protocol: cephx 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -57> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding auth protocol: cephx 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -56> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -55> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -54> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -53> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -52> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -51> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -50> 2024-09-14T11:19:50.154+0000 7f862dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -49> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.285 INFO:tasks.workunit.client.0.smithi002.stderr: -48> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -47> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -46> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -45> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: crc 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -44> 2024-09-14T11:19:50.154+0000 7f877902f800 5 AuthRegistry(0x7ffd320195c0) adding con mode: secure 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -43> 2024-09-14T11:19:50.154+0000 7f877902f800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -42> 2024-09-14T11:19:50.154+0000 7f877902f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -41> 2024-09-14T11:19:50.154+0000 7f877902f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -40> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache list hook 0x55746f3df430 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -39> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache inspect hook 0x55746f3df430 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -38> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache erase hook 0x55746f3df430 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -37> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command cache zap hook 0x55746f3df430 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -36> 2024-09-14T11:19:50.154+0000 7f877902f800 5 note: GC not initialized 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -35> 2024-09-14T11:19:50.154+0000 7f862cfe1640 20 reqs_thread_entry: start 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -34> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace show hook 0x7f8768067070 2024-09-14T11:19:50.286 INFO:tasks.workunit.client.0.smithi002.stderr: -33> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace history hook 0x7f8768067070 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -32> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace active hook 0x7f8768067070 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -31> 2024-09-14T11:19:50.154+0000 7f877902f800 5 asok(0x55746f0f8270) register_command sync trace active_short hook 0x7f8768067070 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -30> 2024-09-14T11:19:50.154+0000 7f877902f800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -29> 2024-09-14T11:19:50.154+0000 7f877902f800 20 Filter name: none 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -28> 2024-09-14T11:19:50.154+0000 7f8625ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -27> 2024-09-14T11:19:50.154+0000 7f877902f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -26> 2024-09-14T11:19:50.154+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -25> 2024-09-14T11:19:50.155+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -24> 2024-09-14T11:19:50.155+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -23> 2024-09-14T11:19:50.155+0000 7f877902f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -22> 2024-09-14T11:19:50.155+0000 7f877902f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -21> 2024-09-14T11:19:50.155+0000 7f877902f800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -20> 2024-09-14T11:19:50.155+0000 7f877902f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -19> 2024-09-14T11:19:50.155+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.287 INFO:tasks.workunit.client.0.smithi002.stderr: -18> 2024-09-14T11:19:50.155+0000 7f877902f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -17> 2024-09-14T11:19:50.155+0000 7f877902f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -16> 2024-09-14T11:19:50.155+0000 7f877902f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -15> 2024-09-14T11:19:50.155+0000 7f877902f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -14> 2024-09-14T11:19:50.156+0000 7f877902f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -13> 2024-09-14T11:19:50.161+0000 7f877902f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -12> 2024-09-14T11:19:50.161+0000 7f877902f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -11> 2024-09-14T11:19:50.161+0000 7f877902f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -10> 2024-09-14T11:19:50.161+0000 7f877902f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -9> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464329 cookie 93958571112432 notifier 7877 bl.length()=827 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -8> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -7> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -6> 2024-09-14T11:19:50.161+0000 7f8659ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -5> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:19:50.288 INFO:tasks.workunit.client.0.smithi002.stderr: -4> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: -3> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: -2> 2024-09-14T11:19:50.161+0000 7f877902f800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: -1> 2024-09-14T11:19:50.166+0000 7f877902f800 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f877902f800 time 2024-09-14T11:19:50.166773+0000 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4907-ga2782315/rpm/el9/BUILD/ceph-19.3.0-4907-ga2782315/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f877c58c76a] 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 5: main() 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 7: __libc_start_main() 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 8: _start() 2024-09-14T11:19:50.289 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 0> 2024-09-14T11:19:50.167+0000 7f877902f800 -1 *** Caught signal (Aborted) ** 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: in thread 7f877902f800 thread_name:radosgw-admin 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: ceph version 19.3.0-4907-ga2782315 (a2782315255a3e7d5f6cdc9eb35785187ff6ddf8) squid (dev) 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f877b23e6f0] 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f877b28b99c] 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 3: raise() 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 4: abort() 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f877c58c7c4] 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c928) [0x7f877c58c928] 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55746dd570b1] 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x55746dd66f6a] 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 9: main() 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f877b229590] 2024-09-14T11:19:50.290 INFO:tasks.workunit.client.0.smithi002.stderr: 11: __libc_start_main() 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 12: _start() 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr:--- logging levels --- 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 none 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 lockdep 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 context 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 crush 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_balancer 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_locker 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_log_expire 2024-09-14T11:19:50.291 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mds_migrator 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 3/ 5 mds_quiesce 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 buffer 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 timer 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 filer 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 striper 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 1 objecter 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rados 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_mirror 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_replay 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 rbd_pwl 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 journaler 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objectcacher 2024-09-14T11:19:50.292 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 immutable_obj_cache 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 client 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 osd 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 optracker 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 objclass 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 filestore 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 journal 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 ms 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mon 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 0/10 monc 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 paxos 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 tp 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 auth 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 crypto 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 finisher 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 reserver 2024-09-14T11:19:50.293 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 heartbeatmap 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 perfcounter 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_sync 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_datacache 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_access 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_dbstore 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_flight 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 rgw_lifecycle 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 20/20 rgw_notification 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 javaclient 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 asok 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 1 throttle 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 0 refs 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 compressor 2024-09-14T11:19:50.294 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluestore 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 bluefs 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 3 bdev 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 kstore 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 4/ 5 rocksdb 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 fuse 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 2/ 5 mgr 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mgrc 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 dpdk 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 eventtrace 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 prioritycache 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 test 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephfs_mirror 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cephsqlite 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 crimson_interrupt 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore 2024-09-14T11:19:50.295 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_onode 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_odata 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_omap 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_tm 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_t 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cleaner 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_epm 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_lba 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_cache 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_journal 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_device 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 seastore_backref 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 alienstore 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 mclock 2024-09-14T11:19:50.296 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 cyanstore 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 ceph_exporter 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 memstore 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 1/ 5 trace 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 0/ 5 ceph_dedup 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: -2/-2 (syslog threshold) 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 99/99 (stderr threshold) 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8625ffb640 / http_manager 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f862cfe1640 / http_manager 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f862dfe3640 / rgw_dt_lg_renew 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8658ff9640 / ms_dispatch 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8659ffb640 / io_context_pool 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f865a7fc640 / io_context_pool 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8660e01640 / ms_dispatch 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8663606640 / ms_dispatch 2024-09-14T11:19:50.297 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8664e09640 / io_context_pool 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8776318640 / msgr-worker-2 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8776b19640 / msgr-worker-1 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: 7f877731a640 / msgr-worker-0 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: 7f8777b1b640 / io_context_pool 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: 7f877902f800 / radosgw-admin 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: max_recent 500 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: max_new 1000 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr: log_file /var/lib/ceph/crash/2024-09-14T11:19:50.168180Z_e9a7d6d3-b9ca-4b52-9f41-e61373a107d2/log 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr:--- end dump of recent events --- 2024-09-14T11:19:50.298 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.244+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 20 realm 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.246+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.247+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.247+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.247+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.248+0000 7f53e2698800 20 searching for the correct realm 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.251+0000 7f53e0983640 0 -- 172.21.15.2:0/2158883370 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f53d4083060 msgr2=0x7f53d40aaaa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.254+0000 7f53e0182640 0 -- 172.21.15.2:0/2158883370 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f53d40b0100 msgr2=0x7f53d40b8920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:50.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.259+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 zone default found 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 4 Realm: () 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 zonegroup default 2024-09-14T11:19:50.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.260+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.261+0000 7f53e2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.261+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.261+0000 7f53e2698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.261+0000 7f53e2698800 20 started sync module instance, tier type = 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.261+0000 7f53e2698800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.270+0000 7f53e2698800 20 add_watcher() i=0 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.270+0000 7f53e2698800 20 add_watcher() i=1 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.270+0000 7f53e2698800 20 add_watcher() i=2 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.270+0000 7f53e2698800 20 add_watcher() i=3 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.270+0000 7f53e2698800 20 add_watcher() i=4 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.270+0000 7f53e2698800 20 add_watcher() i=5 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.270+0000 7f53e2698800 20 add_watcher() i=6 2024-09-14T11:19:50.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.271+0000 7f53e2698800 20 add_watcher() i=7 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.271+0000 7f53e2698800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.273+0000 7f5296fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.273+0000 7f53e2698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.273+0000 7f53e2698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.273+0000 7f53e2698800 5 note: GC not initialized 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.273+0000 7f5295fdb640 20 reqs_thread_entry: start 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.274+0000 7f53e2698800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.274+0000 7f53e2698800 20 Filter name: none 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.274+0000 7f52077fe640 20 reqs_thread_entry: start 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.274+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.274+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.274+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.275+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.275+0000 7f53e2698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:50.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.275+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.275+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.275+0000 7f53e2698800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.276+0000 7f53e2698800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.276+0000 7f53e2698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.277+0000 7f5296fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.279+0000 7f53e2698800 20 remove_watcher() i=0 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.279+0000 7f53e2698800 2 removed watcher, disabling cache 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.280+0000 7f53e2698800 20 remove_watcher() i=1 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.281+0000 7f53e2698800 20 remove_watcher() i=2 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.283+0000 7f53e2698800 20 remove_watcher() i=3 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.284+0000 7f53e2698800 20 remove_watcher() i=4 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.285+0000 7f53e2698800 20 remove_watcher() i=5 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.286+0000 7f53e2698800 20 remove_watcher() i=6 2024-09-14T11:19:50.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.287+0000 7f53e2698800 20 remove_watcher() i=7 2024-09-14T11:19:50.309 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:19:50.309 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:19:50.309 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:19:50.337 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:19:50.337 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:19:50.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.379+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.381+0000 7f092f32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.381+0000 7f092f32a800 20 realm 2024-09-14T11:19:50.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.381+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.381+0000 7f092f32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.381+0000 7f092f32a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:19:50.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.381+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.382+0000 7f092f32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.382+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.382+0000 7f092f32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.382+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.383+0000 7f092f32a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:19:50.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.383+0000 7f092f32a800 20 searching for the correct realm 2024-09-14T11:19:50.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.384+0000 7f092af61640 0 -- 172.21.15.2:0/1068138317 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f092401f040 msgr2=0x7f092401f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.588 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.590+0000 7f092b762640 0 -- 172.21.15.2:0/1068138317 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f0914092040 msgr2=0x7f091408a4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:19:50.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:19:50.594 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:19:50.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:19:50.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:19:50.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:19:50.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:19:50.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.595 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.596+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:19:50.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:19:50.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 zone default found 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 4 Realm: () 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 zonegroup default 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.597+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.598+0000 7f092f32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.598+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.598+0000 7f092f32a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.598+0000 7f092f32a800 20 started sync module instance, tier type = 2024-09-14T11:19:50.597 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.598+0000 7f092f32a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:19:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.608+0000 7f092f32a800 20 add_watcher() i=0 2024-09-14T11:19:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.608+0000 7f092f32a800 20 add_watcher() i=1 2024-09-14T11:19:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.608+0000 7f092f32a800 20 add_watcher() i=2 2024-09-14T11:19:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.608+0000 7f092f32a800 20 add_watcher() i=3 2024-09-14T11:19:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.608+0000 7f092f32a800 20 add_watcher() i=4 2024-09-14T11:19:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.608+0000 7f092f32a800 20 add_watcher() i=5 2024-09-14T11:19:50.606 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.608+0000 7f092f32a800 20 add_watcher() i=6 2024-09-14T11:19:50.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.609+0000 7f092f32a800 20 add_watcher() i=7 2024-09-14T11:19:50.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.609+0000 7f092f32a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:19:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.610+0000 7f07e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f092f32a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:19:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f092f32a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:19:50.609 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f092f32a800 5 note: GC not initialized 2024-09-14T11:19:50.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f075bfff640 20 reqs_thread_entry: start 2024-09-14T11:19:50.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f092f32a800 20 init_complete bucket index max shards: 1 2024-09-14T11:19:50.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f092f32a800 20 Filter name: none 2024-09-14T11:19:50.610 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f0759ffb640 20 reqs_thread_entry: start 2024-09-14T11:19:50.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f092f32a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:19:50.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.611+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.612+0000 7f092f32a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:19:50.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.612+0000 7f092f32a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:19:50.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.612+0000 7f092f32a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:19:50.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.612+0000 7f092f32a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:19:50.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.612+0000 7f092f32a800 20 rados->read ofs=0 len=0 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:19:50.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:19:50.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:19:50.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:19:50.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:19:50.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.613+0000 7f092f32a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:19:50.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.615+0000 7f07e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:19:50.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.617+0000 7f092f32a800 20 remove_watcher() i=0 2024-09-14T11:19:50.615 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.617+0000 7f092f32a800 2 removed watcher, disabling cache 2024-09-14T11:19:50.616 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.618+0000 7f092f32a800 20 remove_watcher() i=1 2024-09-14T11:19:50.618 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.619+0000 7f092f32a800 20 remove_watcher() i=2 2024-09-14T11:19:50.619 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.621+0000 7f092f32a800 20 remove_watcher() i=3 2024-09-14T11:19:50.620 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.622+0000 7f092f32a800 20 remove_watcher() i=4 2024-09-14T11:19:50.621 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.623+0000 7f092f32a800 20 remove_watcher() i=5 2024-09-14T11:19:50.622 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.624+0000 7f092f32a800 20 remove_watcher() i=6 2024-09-14T11:19:50.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:19:50.625+0000 7f092f32a800 20 remove_watcher() i=7 2024-09-14T11:20:20.654 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-14T11:20:20.688 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:20.688 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:20.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.734+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:20.735 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 20 realm 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.736+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.737+0000 7fc3b4728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:20.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.737+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.737+0000 7fc3b4728800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:20.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.738+0000 7fc3b4728800 20 searching for the correct realm 2024-09-14T11:20:20.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.741+0000 7fc3b0b5e640 0 -- 172.21.15.2:0/4117688223 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fc3a4008920 msgr2=0x7fc3a402b3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:20.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.745+0000 7fc3b035d640 0 -- 172.21.15.2:0/4117688223 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fc3a40213f0 msgr2=0x7fc3a4021850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:20.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:20.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:20.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:20.951 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:20.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:20.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:20.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:20.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:20.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.952+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:20.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 zone default found 2024-09-14T11:20:20.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 4 Realm: () 2024-09-14T11:20:20.953 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 zonegroup default 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.953+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.954+0000 7fc3b4728800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.954+0000 7fc3b4728800 20 started sync module instance, tier type = 2024-09-14T11:20:20.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.954+0000 7fc3b4728800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:20.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.964+0000 7fc3b4728800 20 add_watcher() i=0 2024-09-14T11:20:20.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.964+0000 7fc3b4728800 20 add_watcher() i=1 2024-09-14T11:20:20.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.964+0000 7fc3b4728800 20 add_watcher() i=2 2024-09-14T11:20:20.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.964+0000 7fc3b4728800 20 add_watcher() i=3 2024-09-14T11:20:20.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.964+0000 7fc3b4728800 20 add_watcher() i=4 2024-09-14T11:20:20.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.964+0000 7fc3b4728800 20 add_watcher() i=5 2024-09-14T11:20:20.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.964+0000 7fc3b4728800 20 add_watcher() i=6 2024-09-14T11:20:20.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.965+0000 7fc3b4728800 20 add_watcher() i=7 2024-09-14T11:20:20.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.965+0000 7fc3b4728800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:20.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.967+0000 7fc266fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:20.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc3b4728800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:20.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc3b4728800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:20.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc3b4728800 5 note: GC not initialized 2024-09-14T11:20:20.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc265fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:20.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc3b4728800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:20.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc3b4728800 20 Filter name: none 2024-09-14T11:20:20.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc1d77fe640 20 reqs_thread_entry: start 2024-09-14T11:20:20.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc3b4728800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:20:20.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.968+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:20.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 20 rados->read ofs=0 len=0 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:20.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.969+0000 7fc3b4728800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:20:20.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.973+0000 7fc266fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:20.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.975+0000 7fc3b4728800 20 remove_watcher() i=0 2024-09-14T11:20:20.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.975+0000 7fc3b4728800 2 removed watcher, disabling cache 2024-09-14T11:20:20.975 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.976+0000 7fc3b4728800 20 remove_watcher() i=1 2024-09-14T11:20:20.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.977+0000 7fc3b4728800 20 remove_watcher() i=2 2024-09-14T11:20:20.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.979+0000 7fc3b4728800 20 remove_watcher() i=3 2024-09-14T11:20:20.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.980+0000 7fc3b4728800 20 remove_watcher() i=4 2024-09-14T11:20:20.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.981+0000 7fc3b4728800 20 remove_watcher() i=5 2024-09-14T11:20:20.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.982+0000 7fc3b4728800 20 remove_watcher() i=6 2024-09-14T11:20:20.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:20.983+0000 7fc3b4728800 20 remove_watcher() i=7 2024-09-14T11:20:20.996 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-14T11:20:21.026 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:21.026 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:21.066 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.067+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 20 realm 2024-09-14T11:20:21.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:21.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.069+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.069 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.070+0000 7f896232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:21.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.070+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.071+0000 7f896232a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:21.070 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.071+0000 7f896232a800 20 searching for the correct realm 2024-09-14T11:20:21.073 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.074+0000 7f895e8db640 0 -- 172.21.15.2:0/194733505 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f8954015440 msgr2=0x7f89540158a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:21.077 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.078+0000 7f895e0da640 0 -- 172.21.15.2:0/194733505 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f8954037420 msgr2=0x7f89540378a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:21.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:21.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.284+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:21.285 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 zone default found 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 4 Realm: () 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 zonegroup default 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.285+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.286+0000 7f896232a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.286+0000 7f896232a800 20 started sync module instance, tier type = 2024-09-14T11:20:21.286 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.286+0000 7f896232a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:21.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.295+0000 7f896232a800 20 add_watcher() i=0 2024-09-14T11:20:21.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.295+0000 7f896232a800 20 add_watcher() i=1 2024-09-14T11:20:21.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.295+0000 7f896232a800 20 add_watcher() i=2 2024-09-14T11:20:21.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.295+0000 7f896232a800 20 add_watcher() i=3 2024-09-14T11:20:21.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.295+0000 7f896232a800 20 add_watcher() i=4 2024-09-14T11:20:21.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.295+0000 7f896232a800 20 add_watcher() i=5 2024-09-14T11:20:21.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.295+0000 7f896232a800 20 add_watcher() i=6 2024-09-14T11:20:21.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.296+0000 7f896232a800 20 add_watcher() i=7 2024-09-14T11:20:21.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.296+0000 7f896232a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:21.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.298+0000 7f8814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.298+0000 7f896232a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.298+0000 7f896232a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.298+0000 7f896232a800 5 note: GC not initialized 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.298+0000 7f878f7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 20 Filter name: none 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f878d7fa640 20 reqs_thread_entry: start 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:20:21.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.299+0000 7f896232a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:20:21.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:21.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:21.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:21.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.300+0000 7f896232a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:21.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.301+0000 7f896232a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:21.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.301+0000 7f896232a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:21.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.302+0000 7f8814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:21.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.305+0000 7f896232a800 20 remove_watcher() i=0 2024-09-14T11:20:21.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.305+0000 7f896232a800 2 removed watcher, disabling cache 2024-09-14T11:20:21.305 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.306+0000 7f896232a800 20 remove_watcher() i=1 2024-09-14T11:20:21.306 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.307+0000 7f896232a800 20 remove_watcher() i=2 2024-09-14T11:20:21.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.308+0000 7f896232a800 20 remove_watcher() i=3 2024-09-14T11:20:21.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.309+0000 7f896232a800 20 remove_watcher() i=4 2024-09-14T11:20:21.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.310+0000 7f896232a800 20 remove_watcher() i=5 2024-09-14T11:20:21.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.311+0000 7f896232a800 20 remove_watcher() i=6 2024-09-14T11:20:21.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.312+0000 7f896232a800 20 remove_watcher() i=7 2024-09-14T11:20:21.322 INFO:tasks.workunit.client.0.smithi002.stderr:check reshard logrecord successfully 2024-09-14T11:20:21.322 INFO:tasks.workunit.client.0.smithi002.stderr: test: reshard versioned bucket 2024-09-14T11:20:21.323 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:20:21.352 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:21.352 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:21.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.394+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.396+0000 7f2409d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.396+0000 7f2409d75800 20 realm 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.396+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.396+0000 7f2409d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.396+0000 7f2409d75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.396+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.397+0000 7f2409d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.396 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.397+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.398+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:21.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.398+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.398+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:21.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.398+0000 7f2409d75800 20 searching for the correct realm 2024-09-14T11:20:21.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.401+0000 7f2408060640 0 -- 172.21.15.2:0/2476805707 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f23fc027040 msgr2=0x7f23fc034400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:21.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.405+0000 7f240785f640 0 -- 172.21.15.2:0/2476805707 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f23fc01b040 msgr2=0x7f23fc034400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:21.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:21.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:21.611 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:21.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:21.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:21.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:21.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.612 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.612+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:21.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:21.613 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 zone default found 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 4 Realm: () 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 zonegroup default 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.613+0000 7f2409d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.614+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.614+0000 7f2409d75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.614+0000 7f2409d75800 20 started sync module instance, tier type = 2024-09-14T11:20:21.614 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.614+0000 7f2409d75800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:21.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.624+0000 7f2409d75800 20 add_watcher() i=0 2024-09-14T11:20:21.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.624+0000 7f2409d75800 20 add_watcher() i=1 2024-09-14T11:20:21.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.624+0000 7f2409d75800 20 add_watcher() i=2 2024-09-14T11:20:21.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.624+0000 7f2409d75800 20 add_watcher() i=3 2024-09-14T11:20:21.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.624+0000 7f2409d75800 20 add_watcher() i=4 2024-09-14T11:20:21.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.624+0000 7f2409d75800 20 add_watcher() i=5 2024-09-14T11:20:21.623 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.624+0000 7f2409d75800 20 add_watcher() i=6 2024-09-14T11:20:21.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.625+0000 7f2409d75800 20 add_watcher() i=7 2024-09-14T11:20:21.624 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.625+0000 7f2409d75800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:21.626 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.627+0000 7f22bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.627+0000 7f2409d75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.627+0000 7f2409d75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.627+0000 7f2409d75800 5 note: GC not initialized 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.627+0000 7f22bcfe1640 20 reqs_thread_entry: start 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.627+0000 7f2409d75800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.627+0000 7f2409d75800 20 Filter name: none 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.628+0000 7f22367fc640 20 reqs_thread_entry: start 2024-09-14T11:20:21.627 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.628+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.628+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:21.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.628+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.629+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:21.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.629+0000 7f2409d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:21.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.629+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.628 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.629+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:21.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.629+0000 7f2409d75800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.629+0000 7f2409d75800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:21.629 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.629+0000 7f2409d75800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:21.630 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.631+0000 7f22bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:21.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.633+0000 7f2409d75800 20 remove_watcher() i=0 2024-09-14T11:20:21.632 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.633+0000 7f2409d75800 2 removed watcher, disabling cache 2024-09-14T11:20:21.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.634+0000 7f2409d75800 20 remove_watcher() i=1 2024-09-14T11:20:21.634 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.635+0000 7f2409d75800 20 remove_watcher() i=2 2024-09-14T11:20:21.635 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.636+0000 7f2409d75800 20 remove_watcher() i=3 2024-09-14T11:20:21.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.637+0000 7f2409d75800 20 remove_watcher() i=4 2024-09-14T11:20:21.637 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.638+0000 7f2409d75800 20 remove_watcher() i=5 2024-09-14T11:20:21.638 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.639+0000 7f2409d75800 20 remove_watcher() i=6 2024-09-14T11:20:21.639 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.640+0000 7f2409d75800 20 remove_watcher() i=7 2024-09-14T11:20:21.650 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:21.650 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:20:21.650 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: myver id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 num_objects: 0 size_kb: 0 num_shards: 1 2024-09-14T11:20:21.650 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:21.652 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 2 2024-09-14T11:20:21.683 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:21.684 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:21.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.724+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.725+0000 7f8a5992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.725+0000 7f8a5992c800 20 realm 2024-09-14T11:20:21.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.725+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.726+0000 7f8a5992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.726+0000 7f8a5992c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:21.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.726+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.726+0000 7f8a5992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.726+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.727+0000 7f8a5992c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:21.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.727+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.727+0000 7f8a5992c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:21.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.727+0000 7f8a5992c800 20 searching for the correct realm 2024-09-14T11:20:21.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.729+0000 7f8a5553e640 0 -- 172.21.15.2:0/3551084012 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f8a50079060 msgr2=0x7f8a500a7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:21.933 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.934+0000 7f8a55d3f640 0 -- 172.21.15.2:0/3551084012 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f8a4001c040 msgr2=0x7f8a40067b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:21.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:21.939 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:21.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:21.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:21.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:21.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:21.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.940 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.940+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:21.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:21.941 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 zone default found 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 4 Realm: () 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 zonegroup default 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.941+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.942+0000 7f8a5992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.942+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.942+0000 7f8a5992c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.942+0000 7f8a5992c800 20 started sync module instance, tier type = 2024-09-14T11:20:21.942 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.942+0000 7f8a5992c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:21.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.951+0000 7f8a5992c800 20 add_watcher() i=0 2024-09-14T11:20:21.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.951+0000 7f8a5992c800 20 add_watcher() i=1 2024-09-14T11:20:21.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.951+0000 7f8a5992c800 20 add_watcher() i=2 2024-09-14T11:20:21.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.951+0000 7f8a5992c800 20 add_watcher() i=3 2024-09-14T11:20:21.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.951+0000 7f8a5992c800 20 add_watcher() i=4 2024-09-14T11:20:21.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.951+0000 7f8a5992c800 20 add_watcher() i=5 2024-09-14T11:20:21.950 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.951+0000 7f8a5992c800 20 add_watcher() i=6 2024-09-14T11:20:21.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.953+0000 7f8a5992c800 20 add_watcher() i=7 2024-09-14T11:20:21.952 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.953+0000 7f8a5992c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:21.954 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.955+0000 7f890bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:21.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:21.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:21.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 5 note: GC not initialized 2024-09-14T11:20:21.955 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f890afe5640 20 reqs_thread_entry: start 2024-09-14T11:20:21.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:21.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 20 Filter name: none 2024-09-14T11:20:21.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8908fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:21.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:20:21.956 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : miss 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.956+0000 7f8a5992c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.957+0000 7f8a5992c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.957+0000 7f8a5992c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.957+0000 7f8a5992c800 10 adding default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.957+0000 7f8a5992c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.957+0000 7f8a5992c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.957 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.957+0000 7f8a5992c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:21.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8a5992c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:21.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8a5992c800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:21.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8a5992c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8a5992c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:21.960 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8938ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464387 cookie 94506562402832 notifier 8403 bl.length()=821 2024-09-14T11:20:21.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8938ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:21.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8938ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:21.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.961+0000 7f8938ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.962+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:21.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.962+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:21.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.962+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:21.961 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.962+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:21.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.964+0000 7f8a5992c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.0 2024-09-14T11:20:21.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.964+0000 7f8a5992c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.0 2024-09-14T11:20:21.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.964+0000 7f8a5992c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.1 2024-09-14T11:20:21.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.964+0000 7f8a5992c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.1 2024-09-14T11:20:21.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.964+0000 7f8a5992c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.0 2024-09-14T11:20:21.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.965+0000 7f8a5992c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:21.964 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.965+0000 7f8a5992c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.966+0000 7f8a5992c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.966+0000 7f8a5992c800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.966+0000 7f8a5992c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.966+0000 7f8a5992c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.966+0000 7f8938ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464388 cookie 94506562402832 notifier 8403 bl.length()=821 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.967+0000 7f8938ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.967+0000 7f8938ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.967+0000 7f8938ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.967+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:21.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.967+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:21.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.967+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:21.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.967+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:21.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.968+0000 7f8a5992c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.0 2024-09-14T11:20:21.967 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.968+0000 7f8a5992c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:21.968 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.968+0000 7f8a5992c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:21.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8a5992c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:21.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8a5992c800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:21.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8a5992c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8a5992c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8927fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464389 cookie 94506562402832 notifier 8403 bl.length()=789 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8927fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8927fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.970+0000 7f8927fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.971+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.971+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.971+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:21.970 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.971+0000 7f8a5992c800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:21.972 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.973+0000 7f8a5992c800 1 execute INFO: reshard of bucket "myver" from 1 shards to 2 shards completed successfully 2024-09-14T11:20:21.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.975+0000 7f890bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:21.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.977+0000 7f8a5992c800 20 remove_watcher() i=0 2024-09-14T11:20:21.976 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.977+0000 7f8a5992c800 2 removed watcher, disabling cache 2024-09-14T11:20:21.977 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.978+0000 7f8a5992c800 20 remove_watcher() i=1 2024-09-14T11:20:21.978 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.979+0000 7f8a5992c800 20 remove_watcher() i=2 2024-09-14T11:20:21.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.980+0000 7f8a5992c800 20 remove_watcher() i=3 2024-09-14T11:20:21.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.982+0000 7f8a5992c800 20 remove_watcher() i=4 2024-09-14T11:20:21.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.983+0000 7f8a5992c800 20 remove_watcher() i=5 2024-09-14T11:20:21.983 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.984+0000 7f8a5992c800 20 remove_watcher() i=6 2024-09-14T11:20:21.984 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:21.984+0000 7f8a5992c800 20 remove_watcher() i=7 2024-09-14T11:20:21.997 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:20:22.026 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:22.026 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:22.065 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.065+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.067+0000 7f906f546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.067+0000 7f906f546800 20 realm 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.067+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.068+0000 7f906f546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.068+0000 7f906f546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.068+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.068+0000 7f906f546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.067 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.068+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.069+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:22.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.069+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.069+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:22.068 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.069+0000 7f906f546800 20 searching for the correct realm 2024-09-14T11:20:22.072 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.073+0000 7f906c836640 0 -- 172.21.15.2:0/3360709913 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55b525abc1d0 msgr2=0x55b525abe5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:22.076 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.077+0000 7f906d037640 0 -- 172.21.15.2:0/3360709913 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f90640a3770 msgr2=0x7f90640cc340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:22.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:22.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:22.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:22.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:22.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:22.080 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:22.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.081 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.081+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 zone default found 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 4 Realm: () 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 zonegroup default 2024-09-14T11:20:22.082 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.082+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.083+0000 7f906f546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.083+0000 7f906f546800 20 started sync module instance, tier type = 2024-09-14T11:20:22.083 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.083+0000 7f906f546800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:22.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=0 2024-09-14T11:20:22.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=1 2024-09-14T11:20:22.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=2 2024-09-14T11:20:22.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=3 2024-09-14T11:20:22.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=4 2024-09-14T11:20:22.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=5 2024-09-14T11:20:22.091 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=6 2024-09-14T11:20:22.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 20 add_watcher() i=7 2024-09-14T11:20:22.092 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.092+0000 7f906f546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:22.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.094+0000 7f8f237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:22.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f906f546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:22.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f906f546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:22.094 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f906f546800 5 note: GC not initialized 2024-09-14T11:20:22.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f8f227e4640 20 reqs_thread_entry: start 2024-09-14T11:20:22.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f906f546800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:22.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f906f546800 20 Filter name: none 2024-09-14T11:20:22.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f8e93fff640 20 reqs_thread_entry: start 2024-09-14T11:20:22.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.095+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:22.095 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.096+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.096+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:22.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.096+0000 7f906f546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:22.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.096+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.096+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:22.096 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.096+0000 7f906f546800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.097+0000 7f906f546800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:22.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.097+0000 7f906f546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:22.097 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.098+0000 7f8f237e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:22.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.101+0000 7f906f546800 20 remove_watcher() i=0 2024-09-14T11:20:22.100 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.101+0000 7f906f546800 2 removed watcher, disabling cache 2024-09-14T11:20:22.101 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.102+0000 7f906f546800 20 remove_watcher() i=1 2024-09-14T11:20:22.102 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.103+0000 7f906f546800 20 remove_watcher() i=2 2024-09-14T11:20:22.103 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.104+0000 7f906f546800 20 remove_watcher() i=3 2024-09-14T11:20:22.104 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.105+0000 7f906f546800 20 remove_watcher() i=4 2024-09-14T11:20:22.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.106+0000 7f906f546800 20 remove_watcher() i=5 2024-09-14T11:20:22.106 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.107+0000 7f906f546800 20 remove_watcher() i=6 2024-09-14T11:20:22.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.108+0000 7f906f546800 20 remove_watcher() i=7 2024-09-14T11:20:22.118 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:22.118 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:20:22.118 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: myver id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-14T11:20:22.118 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:22.121 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:22.121 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:22.124 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:22.124 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:22.165 INFO:tasks.workunit.client.0.smithi002.stderr: test: reshard removes olh entries with empty name 2024-09-14T11:20:22.167 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:22.167 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:22.214 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:22.214 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:22.257 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-14T11:20:22.286 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:22.287 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:22.325 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.326+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.327+0000 7fd561687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.327+0000 7fd561687800 20 realm 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.327+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.327+0000 7fd561687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.327+0000 7fd561687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.327+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.328+0000 7fd561687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:22.327 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.328+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.328+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:22.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.328+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:22.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.329+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:22.328 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.329+0000 7fd561687800 20 searching for the correct realm 2024-09-14T11:20:22.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.331+0000 7fd55e977640 0 -- 172.21.15.2:0/4023312520 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fd550076b30 msgr2=0x7fd55000f3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:22.737 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:22.738+0000 7fd55f178640 0 -- 172.21.15.2:0/4023312520 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd554061910 msgr2=0x7fd554086450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:23.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.144+0000 7fd561687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:23.144 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:23.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:23.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:23.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:23.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:23.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.145 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:23.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.145+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:23.146 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 20 zone default found 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 4 Realm: () 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 20 zonegroup default 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.146+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.147+0000 7fd561687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.147+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.147+0000 7fd561687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.147+0000 7fd561687800 20 started sync module instance, tier type = 2024-09-14T11:20:23.147 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.147+0000 7fd561687800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:23.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.158+0000 7fd561687800 20 add_watcher() i=0 2024-09-14T11:20:23.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.158+0000 7fd561687800 20 add_watcher() i=1 2024-09-14T11:20:23.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.158+0000 7fd561687800 20 add_watcher() i=2 2024-09-14T11:20:23.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.158+0000 7fd561687800 20 add_watcher() i=3 2024-09-14T11:20:23.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.158+0000 7fd561687800 20 add_watcher() i=4 2024-09-14T11:20:23.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.158+0000 7fd561687800 20 add_watcher() i=5 2024-09-14T11:20:23.157 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.158+0000 7fd561687800 20 add_watcher() i=6 2024-09-14T11:20:23.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.159+0000 7fd561687800 20 add_watcher() i=7 2024-09-14T11:20:23.158 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.159+0000 7fd561687800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:23.160 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.161+0000 7fd415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.161+0000 7fd561687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.161+0000 7fd561687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.161+0000 7fd561687800 5 note: GC not initialized 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.161+0000 7fd414fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.161+0000 7fd561687800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.161+0000 7fd561687800 20 Filter name: none 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.162+0000 7fd38e7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:23.161 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.162+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.162+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:23.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.162+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.163+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:20:23.162 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.163+0000 7fd561687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:23.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.163+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.164+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:23.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.164+0000 7fd561687800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.164+0000 7fd561687800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:20:23.163 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.164+0000 7fd561687800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:23.165 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.166+0000 7fd415fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:23.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.168+0000 7fd561687800 20 remove_watcher() i=0 2024-09-14T11:20:23.167 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.168+0000 7fd561687800 2 removed watcher, disabling cache 2024-09-14T11:20:23.169 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.170+0000 7fd561687800 20 remove_watcher() i=1 2024-09-14T11:20:23.170 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.171+0000 7fd561687800 20 remove_watcher() i=2 2024-09-14T11:20:23.171 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.172+0000 7fd561687800 20 remove_watcher() i=3 2024-09-14T11:20:23.172 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.173+0000 7fd561687800 20 remove_watcher() i=4 2024-09-14T11:20:23.174 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.174+0000 7fd561687800 20 remove_watcher() i=5 2024-09-14T11:20:23.175 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.175+0000 7fd561687800 20 remove_watcher() i=6 2024-09-14T11:20:23.176 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.177+0000 7fd561687800 20 remove_watcher() i=7 2024-09-14T11:20:23.189 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:23.189 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:20:23.190 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: a-bucket id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 num_objects: 0 size_kb: 0 num_shards: 3 2024-09-14T11:20:23.190 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:23.191 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-14T11:20:23.222 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:23.222 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:23.262 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.263+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.264 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 20 realm 2024-09-14T11:20:23.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:23.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.265 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.265+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.266+0000 7f380dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:23.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.266+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.266+0000 7f380dfaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:23.266 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.266+0000 7f380dfaf800 20 searching for the correct realm 2024-09-14T11:20:23.269 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.270+0000 7f380c29a640 0 -- 172.21.15.2:0/655649390 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f3800036070 msgr2=0x7f3800046450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:23.273 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.274+0000 7f380ba99640 0 -- 172.21.15.2:0/655649390 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f3800037400 msgr2=0x7f3800037860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:23.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:23.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:23.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:23.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:23.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:23.278 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:23.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.279 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:23.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.279+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:23.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 zone default found 2024-09-14T11:20:23.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 4 Realm: () 2024-09-14T11:20:23.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 zonegroup default 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.280+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.281+0000 7f380dfaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.281+0000 7f380dfaf800 20 started sync module instance, tier type = 2024-09-14T11:20:23.281 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.281+0000 7f380dfaf800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:23.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.290+0000 7f380dfaf800 20 add_watcher() i=0 2024-09-14T11:20:23.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.290+0000 7f380dfaf800 20 add_watcher() i=1 2024-09-14T11:20:23.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.290+0000 7f380dfaf800 20 add_watcher() i=2 2024-09-14T11:20:23.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.290+0000 7f380dfaf800 20 add_watcher() i=3 2024-09-14T11:20:23.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.290+0000 7f380dfaf800 20 add_watcher() i=4 2024-09-14T11:20:23.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.290+0000 7f380dfaf800 20 add_watcher() i=5 2024-09-14T11:20:23.289 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.290+0000 7f380dfaf800 20 add_watcher() i=6 2024-09-14T11:20:23.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.291+0000 7f380dfaf800 20 add_watcher() i=7 2024-09-14T11:20:23.290 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.291+0000 7f380dfaf800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:23.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.292+0000 7f36c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:23.292 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f380dfaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:23.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f380dfaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:23.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f380dfaf800 5 note: GC not initialized 2024-09-14T11:20:23.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f36c0fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:23.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f380dfaf800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:23.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f380dfaf800 20 Filter name: none 2024-09-14T11:20:23.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f363a7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:23.293 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.293+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.294+0000 7f380dfaf800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:23.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.294+0000 7f380dfaf800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.294+0000 7f380dfaf800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:20:23.294 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.294+0000 7f380dfaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:23.295 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.296+0000 7f36c1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:23.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.298+0000 7f380dfaf800 20 remove_watcher() i=0 2024-09-14T11:20:23.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.298+0000 7f380dfaf800 2 removed watcher, disabling cache 2024-09-14T11:20:23.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.299+0000 7f380dfaf800 20 remove_watcher() i=1 2024-09-14T11:20:23.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.300+0000 7f380dfaf800 20 remove_watcher() i=2 2024-09-14T11:20:23.300 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.301+0000 7f380dfaf800 20 remove_watcher() i=3 2024-09-14T11:20:23.301 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.302+0000 7f380dfaf800 20 remove_watcher() i=4 2024-09-14T11:20:23.302 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.303+0000 7f380dfaf800 20 remove_watcher() i=5 2024-09-14T11:20:23.303 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.304+0000 7f380dfaf800 20 remove_watcher() i=6 2024-09-14T11:20:23.304 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.305+0000 7f380dfaf800 20 remove_watcher() i=7 2024-09-14T11:20:23.316 INFO:tasks.workunit.client.0.smithi002.stderr:rados -p default.rgw.buckets.index setomapval .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-14T11:20:23.343 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:23.344 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:23.361 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:20:23.389 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:23.389 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:23.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.429+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 20 realm 2024-09-14T11:20:23.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:23.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.431 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.431+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.634+0000 7f287f287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:23.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.634+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.634+0000 7f287f287800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:23.633 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.634+0000 7f287f287800 20 searching for the correct realm 2024-09-14T11:20:23.636 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.637+0000 7f287c570640 0 -- 172.21.15.2:0/543708421 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f286c0d0060 msgr2=0x7f286c0b6960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:23.641 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.642+0000 7f287cd71640 0 -- 172.21.15.2:0/543708421 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f287002c420 msgr2=0x7f287002c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:23.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.848+0000 7f287f287800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:23.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.848+0000 7f287f287800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:23.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.848+0000 7f287f287800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:23.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.848+0000 7f287f287800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:23.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.848+0000 7f287f287800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:23.848 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.848+0000 7f287f287800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:23.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.848+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.849 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:23.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:23.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 20 zone default found 2024-09-14T11:20:23.850 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 4 Realm: () 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.849+0000 7f287f287800 20 zonegroup default 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.850+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.850+0000 7f287f287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.850+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.850+0000 7f287f287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.850+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.850+0000 7f287f287800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.851+0000 7f287f287800 20 started sync module instance, tier type = 2024-09-14T11:20:23.851 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.851+0000 7f287f287800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:23.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.861+0000 7f287f287800 20 add_watcher() i=0 2024-09-14T11:20:23.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.861+0000 7f287f287800 20 add_watcher() i=1 2024-09-14T11:20:23.860 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.861+0000 7f287f287800 20 add_watcher() i=2 2024-09-14T11:20:23.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.861+0000 7f287f287800 20 add_watcher() i=3 2024-09-14T11:20:23.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.861+0000 7f287f287800 20 add_watcher() i=4 2024-09-14T11:20:23.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.861+0000 7f287f287800 20 add_watcher() i=5 2024-09-14T11:20:23.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.861+0000 7f287f287800 20 add_watcher() i=6 2024-09-14T11:20:23.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.862+0000 7f287f287800 20 add_watcher() i=7 2024-09-14T11:20:23.861 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.862+0000 7f287f287800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:23.863 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.864+0000 7f27337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.864+0000 7f287f287800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.864+0000 7f287f287800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.864+0000 7f287f287800 5 note: GC not initialized 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.864+0000 7f27327e4640 20 reqs_thread_entry: start 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.864+0000 7f287f287800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.865+0000 7f287f287800 20 Filter name: none 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.865+0000 7f272bfff640 20 reqs_thread_entry: start 2024-09-14T11:20:23.864 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.865+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.865+0000 7f287f287800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:23.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.865+0000 7f287f287800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:20:23.865 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:23.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:20:23.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 INFO: main: starting shard=0 2024-09-14T11:20:23.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:23.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:23.866 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:20:23.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 INFO: main: starting shard=1 2024-09-14T11:20:23.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:23.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.866+0000 7f287f287800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:23.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.867+0000 7f287f287800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:23.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.867+0000 7f287f287800 20 INFO: main: starting shard=2 2024-09-14T11:20:23.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.867+0000 7f287f287800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:23.867 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.867+0000 7f287f287800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:23.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.868+0000 7f287f287800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:23.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.868+0000 7f287f287800 20 INFO: main: done 2024-09-14T11:20:23.868 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.869+0000 7f27337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:23.870 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.871+0000 7f287f287800 20 remove_watcher() i=0 2024-09-14T11:20:23.871 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.871+0000 7f287f287800 2 removed watcher, disabling cache 2024-09-14T11:20:23.872 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.872+0000 7f287f287800 20 remove_watcher() i=1 2024-09-14T11:20:23.873 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.874+0000 7f287f287800 20 remove_watcher() i=2 2024-09-14T11:20:23.874 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.875+0000 7f287f287800 20 remove_watcher() i=3 2024-09-14T11:20:23.875 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.876+0000 7f287f287800 20 remove_watcher() i=4 2024-09-14T11:20:23.876 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.877+0000 7f287f287800 20 remove_watcher() i=5 2024-09-14T11:20:23.877 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.878+0000 7f287f287800 20 remove_watcher() i=6 2024-09-14T11:20:23.878 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.879+0000 7f287f287800 20 remove_watcher() i=7 2024-09-14T11:20:23.890 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-14T11:20:23.924 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:23.924 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:23.963 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.964+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.965+0000 7f54cc72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.965+0000 7f54cc72a800 20 realm 2024-09-14T11:20:23.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.965+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.966+0000 7f54cc72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.966+0000 7f54cc72a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:23.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.966+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.965 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.966+0000 7f54cc72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.966+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.967+0000 7f54cc72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:23.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.967+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.967+0000 7f54cc72a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:23.966 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.967+0000 7f54cc72a800 20 searching for the correct realm 2024-09-14T11:20:23.969 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.970+0000 7f54c7c16640 0 -- 172.21.15.2:0/2831105923 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55ed251da370 msgr2=0x55ed251dc830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:23.974 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.974+0000 7f54c8417640 0 -- 172.21.15.2:0/2831105923 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f54bc02e930 msgr2=0x7f54bc01f3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:23.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:23.979 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.979+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 zone default found 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 4 Realm: () 2024-09-14T11:20:23.980 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:23.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:23.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:23.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 zonegroup default 2024-09-14T11:20:23.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.981 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.980+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.981+0000 7f54cc72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.981+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.981+0000 7f54cc72a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:23.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.981+0000 7f54cc72a800 20 started sync module instance, tier type = 2024-09-14T11:20:23.982 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.981+0000 7f54cc72a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.990+0000 7f54cc72a800 20 add_watcher() i=0 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.990+0000 7f54cc72a800 20 add_watcher() i=1 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.990+0000 7f54cc72a800 20 add_watcher() i=2 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.990+0000 7f54cc72a800 20 add_watcher() i=3 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.990+0000 7f54cc72a800 20 add_watcher() i=4 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.990+0000 7f54cc72a800 20 add_watcher() i=5 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.990+0000 7f54cc72a800 20 add_watcher() i=6 2024-09-14T11:20:23.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.991+0000 7f54cc72a800 20 add_watcher() i=7 2024-09-14T11:20:23.991 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.991+0000 7f54cc72a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:23.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.993+0000 7f537efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.994+0000 7f54cc72a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.994+0000 7f54cc72a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.994+0000 7f54cc72a800 5 note: GC not initialized 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.994+0000 7f537dfdb640 20 reqs_thread_entry: start 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.994+0000 7f54cc72a800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.994+0000 7f54cc72a800 20 Filter name: none 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.994+0000 7f52ef7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.995+0000 7f54cc72a800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-14T11:20:23.994 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.995+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.995+0000 7f54cc72a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:23.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.995+0000 7f54cc72a800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-14T11:20:23.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.995+0000 7f54cc72a800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-14T11:20:23.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.995+0000 7f54cc72a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : miss 2024-09-14T11:20:23.995 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.996+0000 7f54cc72a800 20 rados->read ofs=0 len=0 2024-09-14T11:20:23.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.996+0000 7f54cc72a800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:20:23.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.996+0000 7f54cc72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:23.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.996+0000 7f54cc72a800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:23.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.996+0000 7f54cc72a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:23.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.996+0000 7f54cc72a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:23.996 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:23.996+0000 7f54cc72a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:20:23.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:23.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:23.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:23.999 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f539effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464331 cookie 94477018322576 notifier 8069 bl.length()=827 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f539effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f539effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f539effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:20:24.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.000+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:20:24.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.003+0000 7f54cc72a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:20:24.002 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.003+0000 7f54cc72a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:20:24.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.003+0000 7f54cc72a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:24.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.003+0000 7f54cc72a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:24.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.004+0000 7f54cc72a800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-14T11:20:24.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.004+0000 7f54cc72a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:24.003 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.004+0000 7f54cc72a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:24.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.004+0000 7f54cc72a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:24.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.004+0000 7f54cc72a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:24.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.005+0000 7f54cc72a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:24.004 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.005+0000 7f54cc72a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:20:24.005 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f54cc72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f54cc72a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f54cc72a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f54cc72a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f539effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464332 cookie 94477018322576 notifier 8069 bl.length()=827 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f539effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f539effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.006+0000 7f539effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.007+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:20:24.006 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.007+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:20:24.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.007+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:20:24.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.007+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:20:24.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.008+0000 7f54cc72a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:24.007 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.008+0000 7f54cc72a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.0 2024-09-14T11:20:24.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.008+0000 7f54cc72a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:24.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.008+0000 7f54cc72a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.1 2024-09-14T11:20:24.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.009+0000 7f54cc72a800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:24.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.009+0000 7f54cc72a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.2.2 2024-09-14T11:20:24.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.009+0000 7f54cc72a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:24.008 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.009+0000 7f54cc72a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 2024-09-14T11:20:24.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.010+0000 7f54cc72a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:24.009 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.010+0000 7f54cc72a800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:24.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.010+0000 7f54cc72a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.010+0000 7f54cc72a800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17, ofs0, ns] 2024-09-14T11:20:24.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f539f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464333 cookie 94477018322576 notifier 8069 bl.length()=795 2024-09-14T11:20:24.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f539f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 info.flags=0x17 2024-09-14T11:20:24.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f539f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17 to cache LRU end 2024-09-14T11:20:24.010 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f539f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_sources= new_sources= 2024-09-14T11:20:24.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential sources added=[] removed=[] 2024-09-14T11:20:24.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): orig_dests= new_dests= 2024-09-14T11:20:24.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.011+0000 7f54cc72a800 20 handle_bi_update(): bucket=:a-bucket[17edae97-cd6b-4c90-863d-862429a20cf3.4538.17]): potential dests added=[] removed=[] 2024-09-14T11:20:24.011 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.012+0000 7f54cc72a800 1 execute INFO: reshard of bucket "a-bucket" from 3 shards to 1 shards completed successfully 2024-09-14T11:20:24.013 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.014+0000 7f537efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:24.015 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.016+0000 7f54cc72a800 20 remove_watcher() i=0 2024-09-14T11:20:24.016 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.016+0000 7f54cc72a800 2 removed watcher, disabling cache 2024-09-14T11:20:24.017 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.018+0000 7f54cc72a800 20 remove_watcher() i=1 2024-09-14T11:20:24.018 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.019+0000 7f54cc72a800 20 remove_watcher() i=2 2024-09-14T11:20:24.019 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.020+0000 7f54cc72a800 20 remove_watcher() i=3 2024-09-14T11:20:24.020 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.021+0000 7f54cc72a800 20 remove_watcher() i=4 2024-09-14T11:20:24.021 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.022+0000 7f54cc72a800 20 remove_watcher() i=5 2024-09-14T11:20:24.022 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.023+0000 7f54cc72a800 20 remove_watcher() i=6 2024-09-14T11:20:24.023 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.024+0000 7f54cc72a800 20 remove_watcher() i=7 2024-09-14T11:20:24.035 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-14T11:20:24.065 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:24.065 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:24.105 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.105+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.107+0000 7fd60352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.107+0000 7fd60352c800 20 realm 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.107+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.108+0000 7fd60352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.108+0000 7fd60352c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.108+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.108+0000 7fd60352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.107 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.108+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.109+0000 7fd60352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:24.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.109+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.109+0000 7fd60352c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:24.108 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.109+0000 7fd60352c800 20 searching for the correct realm 2024-09-14T11:20:24.112 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.113+0000 7fd5fe93d640 0 -- 172.21.15.2:0/2703799405 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x5640271e5520 msgr2=0x5640271e7980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:24.116 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.117+0000 7fd5ff13e640 0 -- 172.21.15.2:0/2703799405 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd5f4009040 msgr2=0x7fd5f40128f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:24.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:24.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:24.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:24.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:24.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:24.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:24.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.322+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 zone default found 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 4 Realm: () 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:24.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 zonegroup default 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.323+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.324+0000 7fd60352c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.324+0000 7fd60352c800 20 started sync module instance, tier type = 2024-09-14T11:20:24.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.324+0000 7fd60352c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:24.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.334+0000 7fd60352c800 20 add_watcher() i=0 2024-09-14T11:20:24.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.334+0000 7fd60352c800 20 add_watcher() i=1 2024-09-14T11:20:24.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.334+0000 7fd60352c800 20 add_watcher() i=2 2024-09-14T11:20:24.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.334+0000 7fd60352c800 20 add_watcher() i=3 2024-09-14T11:20:24.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.334+0000 7fd60352c800 20 add_watcher() i=4 2024-09-14T11:20:24.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.334+0000 7fd60352c800 20 add_watcher() i=5 2024-09-14T11:20:24.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.334+0000 7fd60352c800 20 add_watcher() i=6 2024-09-14T11:20:24.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.335+0000 7fd60352c800 20 add_watcher() i=7 2024-09-14T11:20:24.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.335+0000 7fd60352c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:24.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.336+0000 7fd4b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:24.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd60352c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:24.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd60352c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd60352c800 5 note: GC not initialized 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd4b4fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd60352c800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd60352c800 20 Filter name: none 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd42e7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.337+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.338+0000 7fd60352c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-14T11:20:24.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.338+0000 7fd60352c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-14T11:20:24.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:24.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-14T11:20:24.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 20 INFO: main: starting shard=0 2024-09-14T11:20:24.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:20:24.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.17.3.0 2024-09-14T11:20:24.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:24.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd60352c800 20 INFO: main: done 2024-09-14T11:20:24.339 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.340+0000 7fd4b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:24.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.344+0000 7fd60352c800 20 remove_watcher() i=0 2024-09-14T11:20:24.342 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.344+0000 7fd60352c800 2 removed watcher, disabling cache 2024-09-14T11:20:24.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.344+0000 7fd60352c800 20 remove_watcher() i=1 2024-09-14T11:20:24.344 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.345+0000 7fd60352c800 20 remove_watcher() i=2 2024-09-14T11:20:24.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.346+0000 7fd60352c800 20 remove_watcher() i=3 2024-09-14T11:20:24.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.347+0000 7fd60352c800 20 remove_watcher() i=4 2024-09-14T11:20:24.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.348+0000 7fd60352c800 20 remove_watcher() i=5 2024-09-14T11:20:24.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.349+0000 7fd60352c800 20 remove_watcher() i=6 2024-09-14T11:20:24.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.350+0000 7fd60352c800 20 remove_watcher() i=7 2024-09-14T11:20:24.360 INFO:tasks.workunit.client.0.smithi002.stderr: test: PUT succeeds during reshard 2024-09-14T11:20:24.361 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:20:24.391 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:24.391 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:24.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.431+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 20 realm 2024-09-14T11:20:24.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:24.432 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.433+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.434+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:24.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.434+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.434+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:24.434 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.434+0000 7f75f8c15800 20 searching for the correct realm 2024-09-14T11:20:24.437 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.438+0000 7f75f3b91640 0 -- 172.21.15.2:0/2776068156 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x555c7a2093d0 msgr2=0x555c7a20b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:24.440 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.441+0000 7f75f4392640 0 -- 172.21.15.2:0/2776068156 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f75e801f910 msgr2=0x7f75e802b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:24.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:24.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:24.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:24.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:24.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:24.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:24.445 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.446 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.446+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 zone default found 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 4 Realm: () 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 zonegroup default 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.447 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.447+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.448+0000 7f75f8c15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.448+0000 7f75f8c15800 20 started sync module instance, tier type = 2024-09-14T11:20:24.448 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.448+0000 7f75f8c15800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.457+0000 7f75f8c15800 20 add_watcher() i=0 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.457+0000 7f75f8c15800 20 add_watcher() i=1 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.457+0000 7f75f8c15800 20 add_watcher() i=2 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.457+0000 7f75f8c15800 20 add_watcher() i=3 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.457+0000 7f75f8c15800 20 add_watcher() i=4 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.457+0000 7f75f8c15800 20 add_watcher() i=5 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.457+0000 7f75f8c15800 20 add_watcher() i=6 2024-09-14T11:20:24.457 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.458+0000 7f75f8c15800 20 add_watcher() i=7 2024-09-14T11:20:24.458 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.458+0000 7f75f8c15800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:24.459 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.460+0000 7f74aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.460+0000 7f75f8c15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.460+0000 7f75f8c15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.460+0000 7f75f8c15800 5 note: GC not initialized 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.460+0000 7f74a9fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.460+0000 7f75f8c15800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f75f8c15800 20 Filter name: none 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f741b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:24.460 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:24.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:24.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f75f8c15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:24.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.461+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.462+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:24.461 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.462+0000 7f75f8c15800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.462+0000 7f75f8c15800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:24.462 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.462+0000 7f75f8c15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:24.463 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.464+0000 7f74aafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:24.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.466+0000 7f75f8c15800 20 remove_watcher() i=0 2024-09-14T11:20:24.465 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.466+0000 7f75f8c15800 2 removed watcher, disabling cache 2024-09-14T11:20:24.466 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.468+0000 7f75f8c15800 20 remove_watcher() i=1 2024-09-14T11:20:24.467 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.468+0000 7f75f8c15800 20 remove_watcher() i=2 2024-09-14T11:20:24.468 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.469+0000 7f75f8c15800 20 remove_watcher() i=3 2024-09-14T11:20:24.469 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.470+0000 7f75f8c15800 20 remove_watcher() i=4 2024-09-14T11:20:24.470 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.471+0000 7f75f8c15800 20 remove_watcher() i=5 2024-09-14T11:20:24.471 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.472+0000 7f75f8c15800 20 remove_watcher() i=6 2024-09-14T11:20:24.472 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.473+0000 7f75f8c15800 20 remove_watcher() i=7 2024-09-14T11:20:24.483 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:24.483 INFO:tasks.workunit.client.0.smithi002.stderr:BUCKET_STATS: 2024-09-14T11:20:24.483 INFO:tasks.workunit.client.0.smithi002.stderr:bucket: myver id: 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 num_objects: 0 size_kb: 0 num_shards: 2 2024-09-14T11:20:24.483 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:24.485 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 3 2024-09-14T11:20:24.518 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:24.518 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:24.558 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.559+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 20 realm 2024-09-14T11:20:24.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.560 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:24.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.561+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.562+0000 7f16c1620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:24.561 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.562+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.562+0000 7f16c1620800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:24.562 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.562+0000 7f16c1620800 20 searching for the correct realm 2024-09-14T11:20:24.564 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.565+0000 7f16be909640 0 -- 172.21.15.2:0/2109954173 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f16b00bbef0 msgr2=0x7f16b00bb8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:24.568 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.569+0000 7f16bf10a640 0 -- 172.21.15.2:0/2109954173 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f16b406a930 msgr2=0x7f16b40738e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.775+0000 7f16c1620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.775+0000 7f16c1620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.775+0000 7f16c1620800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.775+0000 7f16c1620800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.775+0000 7f16c1620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.775+0000 7f16c1620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.775+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.775 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.776 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 zone default found 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 4 Realm: () 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 zonegroup default 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.776+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.777+0000 7f16c1620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.777+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.777 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.777+0000 7f16c1620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.777+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.777+0000 7f16c1620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:24.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.777+0000 7f16c1620800 20 started sync module instance, tier type = 2024-09-14T11:20:24.778 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.777+0000 7f16c1620800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:24.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.787+0000 7f16c1620800 20 add_watcher() i=0 2024-09-14T11:20:24.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.787+0000 7f16c1620800 20 add_watcher() i=1 2024-09-14T11:20:24.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.787+0000 7f16c1620800 20 add_watcher() i=2 2024-09-14T11:20:24.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.787+0000 7f16c1620800 20 add_watcher() i=3 2024-09-14T11:20:24.786 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.787+0000 7f16c1620800 20 add_watcher() i=4 2024-09-14T11:20:24.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.787+0000 7f16c1620800 20 add_watcher() i=5 2024-09-14T11:20:24.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.787+0000 7f16c1620800 20 add_watcher() i=6 2024-09-14T11:20:24.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.788+0000 7f16c1620800 20 add_watcher() i=7 2024-09-14T11:20:24.787 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.788+0000 7f16c1620800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:24.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.790+0000 7f1575fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.790+0000 7f16c1620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.790+0000 7f16c1620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.790+0000 7f16c1620800 5 note: GC not initialized 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.790+0000 7f1574fe1640 20 reqs_thread_entry: start 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.790+0000 7f16c1620800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.790+0000 7f16c1620800 20 Filter name: none 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f14ee7fc640 20 reqs_thread_entry: start 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:20:24.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : miss 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 20 rados->read ofs=0 len=0 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:24.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 adding default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:24.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:24.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.792 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.791+0000 7f16c1620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:24.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.795+0000 7f16c1620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:24.794 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.795+0000 7f16c1620800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:24.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.795+0000 7f16c1620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.795+0000 7f16c1620800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:24.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f15a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464390 cookie 94492123035984 notifier 8559 bl.length()=821 2024-09-14T11:20:24.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f15a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:24.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f15a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:24.795 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f15a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:24.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:24.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:24.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:24.796 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.796+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:24.797 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:24.798+0000 7f16c1620800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-14T11:20:25.490 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:25.490 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:25.508 INFO:tasks.workunit.client.0.smithi002.stderr:put object successful 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.0 2024-09-14T11:20:29.798 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.800+0000 7f16c1620800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.0 2024-09-14T11:20:29.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.801+0000 7f16c1620800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.1 2024-09-14T11:20:29.799 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.801+0000 7f16c1620800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.1 2024-09-14T11:20:29.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.803+0000 7f16c1620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:29.801 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.803+0000 7f16c1620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:29.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.805+0000 7f16c1620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:29.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.805+0000 7f16c1620800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:29.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.805+0000 7f16c1620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:29.803 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.805+0000 7f16c1620800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.805+0000 7f15a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464391 cookie 94492123035984 notifier 8559 bl.length()=821 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.806+0000 7f15a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.806+0000 7f15a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.806+0000 7f15a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.806+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.806+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.806+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:29.804 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.806+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:29.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.808+0000 7f16c1620800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.0 2024-09-14T11:20:29.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.808+0000 7f16c1620800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.0 2024-09-14T11:20:29.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.808+0000 7f16c1620800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.1 2024-09-14T11:20:29.806 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.808+0000 7f16c1620800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.1.1 2024-09-14T11:20:29.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.811+0000 7f16c1620800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:29.809 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.811+0000 7f16c1620800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.812+0000 7f16c1620800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.812+0000 7f16c1620800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.812+0000 7f16c1620800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.812+0000 7f16c1620800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.813+0000 7f15a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464392 cookie 94492123035984 notifier 8559 bl.length()=789 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.813+0000 7f15a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.813+0000 7f15a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:29.811 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.813+0000 7f15a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:29.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.814+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:29.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.814+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:29.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.814+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:29.812 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.814+0000 7f16c1620800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:29.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.815+0000 7f16c1620800 1 execute INFO: reshard of bucket "myver" from 2 shards to 3 shards completed successfully 2024-09-14T11:20:29.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.818+0000 7f1575fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:29.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.821+0000 7f16c1620800 20 remove_watcher() i=0 2024-09-14T11:20:29.819 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.821+0000 7f16c1620800 2 removed watcher, disabling cache 2024-09-14T11:20:29.820 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.822+0000 7f16c1620800 20 remove_watcher() i=1 2024-09-14T11:20:29.822 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.823+0000 7f16c1620800 20 remove_watcher() i=2 2024-09-14T11:20:29.823 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.825+0000 7f16c1620800 20 remove_watcher() i=3 2024-09-14T11:20:29.824 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.826+0000 7f16c1620800 20 remove_watcher() i=4 2024-09-14T11:20:29.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.827+0000 7f16c1620800 20 remove_watcher() i=5 2024-09-14T11:20:29.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.828+0000 7f16c1620800 20 remove_watcher() i=6 2024-09-14T11:20:29.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:29.830+0000 7f16c1620800 20 remove_watcher() i=7 2024-09-14T11:20:30.513 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-14T11:20:30.513 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:20:30.516 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.516 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.521 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.521 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.565 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.565 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.583 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.583 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.588 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.588 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.601 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.602 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.605 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.606 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.619 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:30.619 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:30.623 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:20:31.041 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-14T11:20:32.459 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:32.459 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:32.512 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:20:32.514 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-14T11:20:32.550 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:32.550 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:32.596 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.598+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.598 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.600+0000 7f2d0cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.600+0000 7f2d0cb46800 20 realm 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.600+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.600+0000 7f2d0cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.600+0000 7f2d0cb46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.600+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.601+0000 7f2d0cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.601+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.599 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.601+0000 7f2d0cb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:32.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.601+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.602+0000 7f2d0cb46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:32.600 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.602+0000 7f2d0cb46800 20 searching for the correct realm 2024-09-14T11:20:32.603 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.605+0000 7f2d09e36640 0 -- 172.21.15.2:0/3865327543 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f2cfc06e0d0 msgr2=0x7f2cfc084b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:32.607 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.609+0000 7f2d0a637640 0 -- 172.21.15.2:0/3865327543 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2d00026040 msgr2=0x7f2d00026930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:32.814 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.815 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.816+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:32.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:32.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 zone default found 2024-09-14T11:20:32.816 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 4 Realm: () 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 zonegroup default 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.817+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.818+0000 7f2d0cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.818+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.818+0000 7f2d0cb46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.818+0000 7f2d0cb46800 20 started sync module instance, tier type = 2024-09-14T11:20:32.817 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.818+0000 7f2d0cb46800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:32.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.829+0000 7f2d0cb46800 20 add_watcher() i=0 2024-09-14T11:20:32.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.829+0000 7f2d0cb46800 20 add_watcher() i=1 2024-09-14T11:20:32.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.829+0000 7f2d0cb46800 20 add_watcher() i=2 2024-09-14T11:20:32.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.829+0000 7f2d0cb46800 20 add_watcher() i=3 2024-09-14T11:20:32.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.829+0000 7f2d0cb46800 20 add_watcher() i=4 2024-09-14T11:20:32.827 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.829+0000 7f2d0cb46800 20 add_watcher() i=5 2024-09-14T11:20:32.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.829+0000 7f2d0cb46800 20 add_watcher() i=6 2024-09-14T11:20:32.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.830+0000 7f2d0cb46800 20 add_watcher() i=7 2024-09-14T11:20:32.828 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.830+0000 7f2d0cb46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:32.830 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.832+0000 7f2bc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.832+0000 7f2d0cb46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.832+0000 7f2d0cb46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.832+0000 7f2d0cb46800 5 note: GC not initialized 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.832+0000 7f2b3b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.832+0000 7f2d0cb46800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.833+0000 7f2d0cb46800 20 Filter name: none 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.833+0000 7f2b397fa640 20 reqs_thread_entry: start 2024-09-14T11:20:32.831 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.833+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.833+0000 7f2d0cb46800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:32.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.833+0000 7f2d0cb46800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.834+0000 7f2d0cb46800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:32.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.834+0000 7f2d0cb46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:32.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.834+0000 7f2d0cb46800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:20:32.832 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.834+0000 7f2d0cb46800 20 INFO: main: starting shard=0 2024-09-14T11:20:32.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.834+0000 7f2d0cb46800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:32.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.834+0000 7f2d0cb46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:32.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:20:32.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 20 INFO: main: starting shard=1 2024-09-14T11:20:32.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:32.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:32.833 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:32.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 20 INFO: main: starting shard=2 2024-09-14T11:20:32.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:32.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.835+0000 7f2d0cb46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:32.834 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.836+0000 7f2d0cb46800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:32.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.836+0000 7f2d0cb46800 20 INFO: main: done 2024-09-14T11:20:32.835 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.837+0000 7f2bc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:32.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.839+0000 7f2d0cb46800 20 remove_watcher() i=0 2024-09-14T11:20:32.838 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.839+0000 7f2d0cb46800 2 removed watcher, disabling cache 2024-09-14T11:20:32.839 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.841+0000 7f2d0cb46800 20 remove_watcher() i=1 2024-09-14T11:20:32.840 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.842+0000 7f2d0cb46800 20 remove_watcher() i=2 2024-09-14T11:20:32.841 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.843+0000 7f2d0cb46800 20 remove_watcher() i=3 2024-09-14T11:20:32.842 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.844+0000 7f2d0cb46800 20 remove_watcher() i=4 2024-09-14T11:20:32.844 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.846+0000 7f2d0cb46800 20 remove_watcher() i=5 2024-09-14T11:20:32.845 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.847+0000 7f2d0cb46800 20 remove_watcher() i=6 2024-09-14T11:20:32.846 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.848+0000 7f2d0cb46800 20 remove_watcher() i=7 2024-09-14T11:20:32.861 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:32.861 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:32.865 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:32.866 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:32.915 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:20:32.917 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-14T11:20:32.949 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:32.949 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:32.990 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.992+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.993+0000 7f4028942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.993+0000 7f4028942800 20 realm 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.993+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.993+0000 7f4028942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.993+0000 7f4028942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.993+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.994+0000 7f4028942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:32.992 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.994+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.995+0000 7f4028942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:32.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.995+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:32.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.995+0000 7f4028942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:32.993 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.995+0000 7f4028942800 20 searching for the correct realm 2024-09-14T11:20:32.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:32.998+0000 7f4024e87640 0 -- 172.21.15.2:0/1336834812 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f4018036060 msgr2=0x7f4018067fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.000 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.002+0000 7f4024686640 0 -- 172.21.15.2:0/1336834812 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f401808b2f0 msgr2=0x7f401806b570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.209+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:33.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 zone default found 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 4 Realm: () 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 zonegroup default 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.210+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.211+0000 7f4028942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.211+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.211+0000 7f4028942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.211+0000 7f4028942800 20 started sync module instance, tier type = 2024-09-14T11:20:33.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.211+0000 7f4028942800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.220+0000 7f4028942800 20 add_watcher() i=0 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.220+0000 7f4028942800 20 add_watcher() i=1 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.220+0000 7f4028942800 20 add_watcher() i=2 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.220+0000 7f4028942800 20 add_watcher() i=3 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.220+0000 7f4028942800 20 add_watcher() i=4 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.220+0000 7f4028942800 20 add_watcher() i=5 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.220+0000 7f4028942800 20 add_watcher() i=6 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.221+0000 7f4028942800 20 add_watcher() i=7 2024-09-14T11:20:33.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.221+0000 7f4028942800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:33.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.223+0000 7f3edafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:33.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.223+0000 7f4028942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:33.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.223+0000 7f4028942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:33.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.223+0000 7f4028942800 5 note: GC not initialized 2024-09-14T11:20:33.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.224+0000 7f3ed9fdb640 20 reqs_thread_entry: start 2024-09-14T11:20:33.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.224+0000 7f4028942800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:33.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.224+0000 7f4028942800 20 Filter name: none 2024-09-14T11:20:33.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.224+0000 7f3e4b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:33.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.224+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.224+0000 7f4028942800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:33.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.224+0000 7f4028942800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:33.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:33.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:20:33.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 INFO: main: starting shard=0 2024-09-14T11:20:33.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:33.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:33.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:33.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 INFO: main: starting shard=1 2024-09-14T11:20:33.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.225+0000 7f4028942800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.226+0000 7f4028942800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.226+0000 7f4028942800 20 INFO: main: starting shard=2 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.226+0000 7f4028942800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.226+0000 7f4028942800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.227+0000 7f4028942800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:20:33.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.227+0000 7f4028942800 20 INFO: main: done 2024-09-14T11:20:33.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.228+0000 7f3edafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:33.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.230+0000 7f4028942800 20 remove_watcher() i=0 2024-09-14T11:20:33.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.230+0000 7f4028942800 2 removed watcher, disabling cache 2024-09-14T11:20:33.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.231+0000 7f4028942800 20 remove_watcher() i=1 2024-09-14T11:20:33.231 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.233+0000 7f4028942800 20 remove_watcher() i=2 2024-09-14T11:20:33.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.234+0000 7f4028942800 20 remove_watcher() i=3 2024-09-14T11:20:33.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.235+0000 7f4028942800 20 remove_watcher() i=4 2024-09-14T11:20:33.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.236+0000 7f4028942800 20 remove_watcher() i=5 2024-09-14T11:20:33.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.237+0000 7f4028942800 20 remove_watcher() i=6 2024-09-14T11:20:33.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.238+0000 7f4028942800 20 remove_watcher() i=7 2024-09-14T11:20:33.249 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:33.249 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:33.254 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:33.254 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:33.302 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:20:33.304 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-14T11:20:33.337 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:33.337 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:33.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.378+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.380+0000 7f51f4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.380+0000 7f51f4f2e800 20 realm 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.380+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.380+0000 7f51f4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.380+0000 7f51f4f2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.380+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.381+0000 7f51f4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.381+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.382+0000 7f51f4f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:33.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.382+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.382+0000 7f51f4f2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:33.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.382+0000 7f51f4f2e800 20 searching for the correct realm 2024-09-14T11:20:33.384 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.386+0000 7f51f0363640 0 -- 172.21.15.2:0/3023452584 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f51e0048190 msgr2=0x7f51e00431d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.390+0000 7f51f1365640 0 -- 172.21.15.2:0/3023452584 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f51e4027040 msgr2=0x7f51e4075530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 zone default found 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 4 Realm: () 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 zonegroup default 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.394+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.395+0000 7f51f4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.395+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.395+0000 7f51f4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.395+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.395+0000 7f51f4f2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:33.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.395+0000 7f51f4f2e800 20 started sync module instance, tier type = 2024-09-14T11:20:33.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.395+0000 7f51f4f2e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:33.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.405+0000 7f51f4f2e800 20 add_watcher() i=0 2024-09-14T11:20:33.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.405+0000 7f51f4f2e800 20 add_watcher() i=1 2024-09-14T11:20:33.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.405+0000 7f51f4f2e800 20 add_watcher() i=2 2024-09-14T11:20:33.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.405+0000 7f51f4f2e800 20 add_watcher() i=3 2024-09-14T11:20:33.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.405+0000 7f51f4f2e800 20 add_watcher() i=4 2024-09-14T11:20:33.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.405+0000 7f51f4f2e800 20 add_watcher() i=5 2024-09-14T11:20:33.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.405+0000 7f51f4f2e800 20 add_watcher() i=6 2024-09-14T11:20:33.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.406+0000 7f51f4f2e800 20 add_watcher() i=7 2024-09-14T11:20:33.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.406+0000 7f51f4f2e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:33.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.407+0000 7f50a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:33.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:33.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:33.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 5 note: GC not initialized 2024-09-14T11:20:33.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f50a67e4640 20 reqs_thread_entry: start 2024-09-14T11:20:33.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:33.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 20 Filter name: none 2024-09-14T11:20:33.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f509ffff640 20 reqs_thread_entry: start 2024-09-14T11:20:33.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:33.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.408+0000 7f51f4f2e800 20 rados->read ofs=0 len=0 2024-09-14T11:20:33.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.409+0000 7f51f4f2e800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:33.407 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.409+0000 7f51f4f2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:33.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.409+0000 7f51f4f2e800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=3 2024-09-14T11:20:33.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.409+0000 7f51f4f2e800 20 INFO: main: starting shard=0 2024-09-14T11:20:33.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.409+0000 7f51f4f2e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:33.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.409+0000 7f51f4f2e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:33.408 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 20 INFO: main: starting shard=1 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 20 INFO: main: starting shard=2 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.410+0000 7f51f4f2e800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.411+0000 7f51f4f2e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:20:33.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.411+0000 7f51f4f2e800 20 INFO: main: done 2024-09-14T11:20:33.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.412+0000 7f50a77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:33.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.414+0000 7f51f4f2e800 20 remove_watcher() i=0 2024-09-14T11:20:33.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.414+0000 7f51f4f2e800 2 removed watcher, disabling cache 2024-09-14T11:20:33.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.416+0000 7f51f4f2e800 20 remove_watcher() i=1 2024-09-14T11:20:33.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.417+0000 7f51f4f2e800 20 remove_watcher() i=2 2024-09-14T11:20:33.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.418+0000 7f51f4f2e800 20 remove_watcher() i=3 2024-09-14T11:20:33.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.419+0000 7f51f4f2e800 20 remove_watcher() i=4 2024-09-14T11:20:33.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.420+0000 7f51f4f2e800 20 remove_watcher() i=5 2024-09-14T11:20:33.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.421+0000 7f51f4f2e800 20 remove_watcher() i=6 2024-09-14T11:20:33.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:33.422+0000 7f51f4f2e800 20 remove_watcher() i=7 2024-09-14T11:20:33.434 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:33.434 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:33.438 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:20:33.844 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-14T11:20:34.259 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-14T11:20:34.291 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:34.291 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:34.330 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.332+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 20 realm 2024-09-14T11:20:34.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:34.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.332 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.334+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.335+0000 7fc639d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.335+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.335+0000 7fc639d25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:34.333 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.335+0000 7fc639d25800 20 searching for the correct realm 2024-09-14T11:20:34.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.339+0000 7fc6352a1640 0 -- 172.21.15.2:0/265345881 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fc62808f060 msgr2=0x7fc628086460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.343+0000 7fc6362a3640 0 -- 172.21.15.2:0/265345881 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7fc62c001c20 msgr2=0x7fc62c05fc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:34.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.347+0000 7fc639d25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:34.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.347+0000 7fc639d25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:34.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.347+0000 7fc639d25800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:34.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.347+0000 7fc639d25800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:34.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.347+0000 7fc639d25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:34.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.347+0000 7fc639d25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:34.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.347+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:34.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 zone default found 2024-09-14T11:20:34.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 4 Realm: () 2024-09-14T11:20:34.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:34.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:34.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 zonegroup default 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.348+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.349+0000 7fc639d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.349+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.349+0000 7fc639d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.349+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.349+0000 7fc639d25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.349+0000 7fc639d25800 20 started sync module instance, tier type = 2024-09-14T11:20:34.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.349+0000 7fc639d25800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:34.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.359+0000 7fc639d25800 20 add_watcher() i=0 2024-09-14T11:20:34.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.359+0000 7fc639d25800 20 add_watcher() i=1 2024-09-14T11:20:34.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.359+0000 7fc639d25800 20 add_watcher() i=2 2024-09-14T11:20:34.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.359+0000 7fc639d25800 20 add_watcher() i=3 2024-09-14T11:20:34.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.359+0000 7fc639d25800 20 add_watcher() i=4 2024-09-14T11:20:34.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.359+0000 7fc639d25800 20 add_watcher() i=5 2024-09-14T11:20:34.357 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.359+0000 7fc639d25800 20 add_watcher() i=6 2024-09-14T11:20:34.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.360+0000 7fc639d25800 20 add_watcher() i=7 2024-09-14T11:20:34.358 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.360+0000 7fc639d25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:34.360 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.361+0000 7fc4e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc639d25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc639d25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc639d25800 5 note: GC not initialized 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc4e67fc640 20 reqs_thread_entry: start 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc639d25800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc639d25800 20 Filter name: none 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc457fff640 20 reqs_thread_entry: start 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc639d25800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:20:34.361 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.362+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:34.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:20:34.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:20:34.362 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : miss 2024-09-14T11:20:34.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:34.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 adding default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:34.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.363 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.363+0000 7fc639d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:34.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:34.369 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc5197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464393 cookie 94402826694592 notifier 8661 bl.length()=821 2024-09-14T11:20:34.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc5197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc5197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc5197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:34.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:34.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:34.370 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.371+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.0 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.0 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.1 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.1 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.2 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.2 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.3 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.3 2024-09-14T11:20:34.373 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.4 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.4 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.5 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.5 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.6 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.6 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.7 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.7 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.8 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.8 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.374 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.10 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.10 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.11 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.11 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.12 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.12 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.13 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.13 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.14 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.14 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.15 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.15 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.16 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.16 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:34.375 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.374+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:34.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.375+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:34.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.375+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:34.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.375+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:34.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.375+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:34.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.377+0000 7fc639d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:34.376 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.377+0000 7fc639d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:34.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:34.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc5197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464394 cookie 94402826694592 notifier 8661 bl.length()=821 2024-09-14T11:20:34.377 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc5197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc5197fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc5197fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:34.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:34.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:34.378 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.379+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:34.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.381+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:34.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.381+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.0 2024-09-14T11:20:34.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.381+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:34.379 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.381+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.1 2024-09-14T11:20:34.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.381+0000 7fc639d25800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:34.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.381+0000 7fc639d25800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.2.2 2024-09-14T11:20:34.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.382+0000 7fc639d25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : hit (requested=0x17, cached=0x17) 2024-09-14T11:20:34.380 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.382+0000 7fc639d25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:34.381 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.383+0000 7fc639d25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.383+0000 7fc639d25800 10 moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.383+0000 7fc639d25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.383+0000 7fc639d25800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18, ofs0, ns] 2024-09-14T11:20:34.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc518ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464395 cookie 94402826694592 notifier 8661 bl.length()=789 2024-09-14T11:20:34.382 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc518ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc518ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc518ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_sources= new_sources= 2024-09-14T11:20:34.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential sources added=[] removed=[] 2024-09-14T11:20:34.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): orig_dests= new_dests= 2024-09-14T11:20:34.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.384+0000 7fc639d25800 20 handle_bi_update(): bucket=:myver[17edae97-cd6b-4c90-863d-862429a20cf3.4538.18]): potential dests added=[] removed=[] 2024-09-14T11:20:34.383 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.385+0000 7fc639d25800 1 execute INFO: reshard of bucket "myver" from 3 shards to 17 shards completed successfully 2024-09-14T11:20:34.386 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.387+0000 7fc4e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.390+0000 7fc639d25800 20 remove_watcher() i=0 2024-09-14T11:20:34.388 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.390+0000 7fc639d25800 2 removed watcher, disabling cache 2024-09-14T11:20:34.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.391+0000 7fc639d25800 20 remove_watcher() i=1 2024-09-14T11:20:34.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.392+0000 7fc639d25800 20 remove_watcher() i=2 2024-09-14T11:20:34.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.393+0000 7fc639d25800 20 remove_watcher() i=3 2024-09-14T11:20:34.392 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.394+0000 7fc639d25800 20 remove_watcher() i=4 2024-09-14T11:20:34.393 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.395+0000 7fc639d25800 20 remove_watcher() i=5 2024-09-14T11:20:34.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.396+0000 7fc639d25800 20 remove_watcher() i=6 2024-09-14T11:20:34.395 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.397+0000 7fc639d25800 20 remove_watcher() i=7 2024-09-14T11:20:34.408 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-14T11:20:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:34.444 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:34.485 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.487+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.488+0000 7f475890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.488+0000 7f475890c800 20 realm 2024-09-14T11:20:34.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.488+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.489+0000 7f475890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.489+0000 7f475890c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:34.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.489+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.487 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.489+0000 7f475890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.489+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.490+0000 7f475890c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.490+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.490+0000 7f475890c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:34.488 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.490+0000 7f475890c800 20 searching for the correct realm 2024-09-14T11:20:34.490 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.492+0000 7f47563f6640 0 -- 172.21.15.2:0/1566810676 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f4740003ab0 msgr2=0x7f4750069ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.695 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.697+0000 7f4756bf7640 0 -- 172.21.15.2:0/1566810676 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f474c086060 msgr2=0x7f474c0ae5f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.702 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.703+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:34.703 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 zone default found 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 4 Realm: () 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 zonegroup default 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.704+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.705+0000 7f475890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.705+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.705+0000 7f475890c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.705+0000 7f475890c800 20 started sync module instance, tier type = 2024-09-14T11:20:34.704 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.705+0000 7f475890c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:34.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.714+0000 7f475890c800 20 add_watcher() i=0 2024-09-14T11:20:34.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.714+0000 7f475890c800 20 add_watcher() i=1 2024-09-14T11:20:34.712 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.714+0000 7f475890c800 20 add_watcher() i=2 2024-09-14T11:20:34.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.714+0000 7f475890c800 20 add_watcher() i=3 2024-09-14T11:20:34.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.714+0000 7f475890c800 20 add_watcher() i=4 2024-09-14T11:20:34.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.714+0000 7f475890c800 20 add_watcher() i=5 2024-09-14T11:20:34.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.714+0000 7f475890c800 20 add_watcher() i=6 2024-09-14T11:20:34.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.715+0000 7f475890c800 20 add_watcher() i=7 2024-09-14T11:20:34.713 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.715+0000 7f475890c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:34.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.716+0000 7f460cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.717+0000 7f475890c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:34.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.717+0000 7f475890c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:34.715 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.717+0000 7f475890c800 5 note: GC not initialized 2024-09-14T11:20:34.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.717+0000 7f45877fe640 20 reqs_thread_entry: start 2024-09-14T11:20:34.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.717+0000 7f475890c800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:34.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.717+0000 7f475890c800 20 Filter name: none 2024-09-14T11:20:34.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.717+0000 7f45857fa640 20 reqs_thread_entry: start 2024-09-14T11:20:34.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.718+0000 7f475890c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-14T11:20:34.716 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.718+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.718+0000 7f475890c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:34.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.718+0000 7f475890c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-14T11:20:34.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.718+0000 7f475890c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-14T11:20:34.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.718+0000 7f475890c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 : miss 2024-09-14T11:20:34.717 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.718+0000 7f475890c800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 info.flags=0x17 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 10 adding default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 to cache LRU end 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.0 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.0 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.1 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.719+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.1 2024-09-14T11:20:34.718 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.720+0000 7f475890c800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-14T11:20:34.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.720+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.2 2024-09-14T11:20:34.719 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.720+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.2 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.720+0000 7f475890c800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.720+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.3 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.720+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.3 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.721+0000 7f475890c800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.721+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.4 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.721+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.4 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.721+0000 7f475890c800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.721+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.5 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.721+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.5 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.722+0000 7f475890c800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.722+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.6 2024-09-14T11:20:34.720 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.722+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.6 2024-09-14T11:20:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.722+0000 7f475890c800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-14T11:20:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.722+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.7 2024-09-14T11:20:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.722+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.7 2024-09-14T11:20:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.723+0000 7f475890c800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-14T11:20:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.723+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.8 2024-09-14T11:20:34.721 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.723+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.8 2024-09-14T11:20:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.723+0000 7f475890c800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-14T11:20:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.723+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.723+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.724+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.10 2024-09-14T11:20:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.724+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.10 2024-09-14T11:20:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.724+0000 7f475890c800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-14T11:20:34.722 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.724+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.11 2024-09-14T11:20:34.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.724+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.11 2024-09-14T11:20:34.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.725+0000 7f475890c800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-14T11:20:34.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.725+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.12 2024-09-14T11:20:34.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.725+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.12 2024-09-14T11:20:34.723 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.725+0000 7f475890c800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-14T11:20:34.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.725+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.13 2024-09-14T11:20:34.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.725+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.13 2024-09-14T11:20:34.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.726+0000 7f475890c800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-14T11:20:34.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.726+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.14 2024-09-14T11:20:34.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.726+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.14 2024-09-14T11:20:34.724 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.726+0000 7f475890c800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-14T11:20:34.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.726+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.15 2024-09-14T11:20:34.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.726+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.15 2024-09-14T11:20:34.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.727+0000 7f475890c800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-14T11:20:34.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.727+0000 7f475890c800 10 bucket_obj is .dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.16 2024-09-14T11:20:34.725 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.727+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.16 2024-09-14T11:20:34.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.727+0000 7f475890c800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-14T11:20:34.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.727+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.728+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:x state=0x55a99594be28 s->prefetch_data=0 2024-09-14T11:20:34.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.728+0000 7f475890c800 20 get_obj_state: setting s->obj_tag to 4f1mtfgkdx23c458p1suxzjfkyykrxh9 2024-09-14T11:20:34.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.728+0000 7f475890c800 20 get_obj_state_impl: setting s->olh_tag to 2iz3m0sauq33j6h5tt4ept1yk16i1i95 2024-09-14T11:20:34.726 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.728+0000 7f475890c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2iz3m0sauq33j6h5tt4ept1yk16i1i95 2024-09-14T11:20:34.727 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.729+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.728 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.730+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-14T11:20:34.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 20 olh_log_entry: epoch=2 op=3 key=x[Q85qcbu3fVtZJg00pB4RDEu8.5U6luY] 2024-09-14T11:20:34.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:_:Q85qcbu3fVtZJg00pB4RDEu8.5U6luY_x state=0x55a995989908 s->prefetch_data=0 2024-09-14T11:20:34.729 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 10 manifest: total_size = 22 2024-09-14T11:20:34.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.1311645033175072841 2024-09-14T11:20:34.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:_:Q85qcbu3fVtZJg00pB4RDEu8.5U6luY_x state=0x55a995989908 s->prefetch_data=0 2024-09-14T11:20:34.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 20 prepare_atomic_modification: state is not atomic. state=0x55a995989908 2024-09-14T11:20:34.730 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.731+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.734+0000 7f475890c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:20:34.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.734+0000 7f475890c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:20:34.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.734+0000 7f475890c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:20:34.732 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.734+0000 7f475890c800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18__shadow:Q85qcbu3fVtZJg00pB4RDEu8.5U6luY_.81seY_aAZGXpHYhaJ3bHebX9fQZR4FG_0 2024-09-14T11:20:34.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.735+0000 7f475890c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:20:34.733 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.735+0000 7f46397fa640 20 handle_completion(): completion ok for obj=x[Q85qcbu3fVtZJg00pB4RDEu8.5U6luY] 2024-09-14T11:20:34.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.736+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:x state=0x55a99594be28 s->prefetch_data=0 2024-09-14T11:20:34.734 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.736+0000 7f475890c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2iz3m0sauq33j6h5tt4ept1yk16i1i95 2024-09-14T11:20:34.736 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.738+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.739+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.739+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.740+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:y state=0x55a9959868d8 s->prefetch_data=0 2024-09-14T11:20:34.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.740+0000 7f475890c800 20 get_obj_state: setting s->obj_tag to svif2apss2wd3visdry840dzxyufy3ui 2024-09-14T11:20:34.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.740+0000 7f475890c800 20 get_obj_state_impl: setting s->olh_tag to 9t97x38n8cgwfz79c88zbhr74rl4erxo 2024-09-14T11:20:34.738 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.740+0000 7f475890c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9t97x38n8cgwfz79c88zbhr74rl4erxo 2024-09-14T11:20:34.740 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.742+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-14T11:20:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 olh_log_entry: epoch=2 op=3 key=y[ymDVmuPZiNsB6QelFLfhA-SO3tx2K.-] 2024-09-14T11:20:34.741 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:_:ymDVmuPZiNsB6QelFLfhA-SO3tx2K.-_y state=0x55a995987438 s->prefetch_data=0 2024-09-14T11:20:34.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 10 manifest: total_size = 22 2024-09-14T11:20:34.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.3676616412546374302 2024-09-14T11:20:34.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:_:ymDVmuPZiNsB6QelFLfhA-SO3tx2K.-_y state=0x55a995987438 s->prefetch_data=0 2024-09-14T11:20:34.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 prepare_atomic_modification: state is not atomic. state=0x55a995987438 2024-09-14T11:20:34.742 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.743+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.746+0000 7f475890c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:20:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.746+0000 7f475890c800 20 RGWObjManifest::operator++(): result: ofs=22 stripe_ofs=22 part_ofs=0 rule->part_size=0 2024-09-14T11:20:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.746+0000 7f475890c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:20:34.744 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.746+0000 7f475890c800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18__shadow:ymDVmuPZiNsB6QelFLfhA-SO3tx2K.-_.qixs2vdXFc7ylbxnCD-E3LXVBw3cOFh_0 2024-09-14T11:20:34.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.747+0000 7f4639ffb640 20 handle_completion(): completion ok for obj=y[ymDVmuPZiNsB6QelFLfhA-SO3tx2K.-] 2024-09-14T11:20:34.745 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.747+0000 7f475890c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:20:34.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.748+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:y state=0x55a9959868d8 s->prefetch_data=0 2024-09-14T11:20:34.746 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.748+0000 7f475890c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=9t97x38n8cgwfz79c88zbhr74rl4erxo 2024-09-14T11:20:34.748 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.750+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.751+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.749 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.751+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.752+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:z state=0x55a99594be28 s->prefetch_data=0 2024-09-14T11:20:34.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.752+0000 7f475890c800 20 get_obj_state: setting s->obj_tag to i8rn43k7khrz0mr4in2qrbrb0b74078a 2024-09-14T11:20:34.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.752+0000 7f475890c800 20 get_obj_state_impl: setting s->olh_tag to 73igj1c2i5nk2ga0s5bfi51z8o4vtj13 2024-09-14T11:20:34.750 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.752+0000 7f475890c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=73igj1c2i5nk2ga0s5bfi51z8o4vtj13 2024-09-14T11:20:34.751 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.753+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.752 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.754+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-14T11:20:34.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 20 olh_log_entry: epoch=2 op=3 key=z[sQ5pH1FnLtXw1T3GGayczs78AoiOWK5] 2024-09-14T11:20:34.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:_:sQ5pH1FnLtXw1T3GGayczs78AoiOWK5_z state=0x55a9959927b8 s->prefetch_data=0 2024-09-14T11:20:34.753 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 10 manifest: total_size = 9 2024-09-14T11:20:34.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 20 get_obj_state: setting s->obj_tag to 17edae97-cd6b-4c90-863d-862429a20cf3.4538.18359504111939324588 2024-09-14T11:20:34.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:_:sQ5pH1FnLtXw1T3GGayczs78AoiOWK5_z state=0x55a9959927b8 s->prefetch_data=0 2024-09-14T11:20:34.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 20 prepare_atomic_modification: state is not atomic. state=0x55a9959927b8 2024-09-14T11:20:34.754 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.755+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.757+0000 7f475890c800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-14T11:20:34.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.757+0000 7f475890c800 20 RGWObjManifest::operator++(): result: ofs=9 stripe_ofs=9 part_ofs=0 rule->part_size=0 2024-09-14T11:20:34.755 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.757+0000 7f475890c800 0 deleting objects inline since gc isn't initialized 2024-09-14T11:20:34.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.757+0000 7f475890c800 5 delete_objs_inline: removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18__shadow:sQ5pH1FnLtXw1T3GGayczs78AoiOWK5_.8RMUvSGqKUJMxV8Uq20vyzOvY6RQKaR_0 2024-09-14T11:20:34.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.758+0000 7f475890c800 5 delete_objs_inline: refcount put returned error -2 2024-09-14T11:20:34.756 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.758+0000 7f46397fa640 20 handle_completion(): completion ok for obj=z[sQ5pH1FnLtXw1T3GGayczs78AoiOWK5] 2024-09-14T11:20:34.757 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.759+0000 7f475890c800 20 get_obj_state: octx=0x55a99569c8a0 obj=myver:z state=0x55a99594be28 s->prefetch_data=0 2024-09-14T11:20:34.758 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.759+0000 7f475890c800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=73igj1c2i5nk2ga0s5bfi51z8o4vtj13 2024-09-14T11:20:34.760 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.761+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.763+0000 7f475890c800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.18.3.9 2024-09-14T11:20:34.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.763+0000 7f475890c800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-14T11:20:34.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.763+0000 7f475890c800 1 NOTICE: finished all shards (3 entries removed) 2024-09-14T11:20:34.761 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.763+0000 7f460cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:34.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.766+0000 7f475890c800 20 remove_watcher() i=0 2024-09-14T11:20:34.764 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.766+0000 7f475890c800 2 removed watcher, disabling cache 2024-09-14T11:20:34.765 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.767+0000 7f475890c800 20 remove_watcher() i=1 2024-09-14T11:20:34.766 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.768+0000 7f475890c800 20 remove_watcher() i=2 2024-09-14T11:20:34.767 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.769+0000 7f475890c800 20 remove_watcher() i=3 2024-09-14T11:20:34.768 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.770+0000 7f475890c800 20 remove_watcher() i=4 2024-09-14T11:20:34.769 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.771+0000 7f475890c800 20 remove_watcher() i=5 2024-09-14T11:20:34.770 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.772+0000 7f475890c800 20 remove_watcher() i=6 2024-09-14T11:20:34.771 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.773+0000 7f475890c800 20 remove_watcher() i=7 2024-09-14T11:20:34.784 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:34.784 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:34.789 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:34.790 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:34.833 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket stats --bucket myver 2024-09-14T11:20:34.862 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:34.862 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:34.902 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.904+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 20 realm 2024-09-14T11:20:34.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:34.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.904 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:34.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.906+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.907+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:34.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.907+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:34.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.907+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:34.905 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.907+0000 7f1e91c13800 20 searching for the correct realm 2024-09-14T11:20:34.908 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:34.909+0000 7f1e8cb47640 0 -- 172.21.15.2:0/4232914052 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f1e8006ac20 msgr2=0x7f1e80094a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:35.113 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.115+0000 7f1e8d348640 0 -- 172.21.15.2:0/4232914052 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1e84078410 msgr2=0x7f1e84078870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.323+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:35.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.323 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 zone default found 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 4 Realm: () 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 zonegroup default 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.324+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.325+0000 7f1e91c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.325+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.325+0000 7f1e91c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.325+0000 7f1e91c13800 20 started sync module instance, tier type = 2024-09-14T11:20:35.324 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.325+0000 7f1e91c13800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:35.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.335+0000 7f1e91c13800 20 add_watcher() i=0 2024-09-14T11:20:35.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.335+0000 7f1e91c13800 20 add_watcher() i=1 2024-09-14T11:20:35.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.335+0000 7f1e91c13800 20 add_watcher() i=2 2024-09-14T11:20:35.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.335+0000 7f1e91c13800 20 add_watcher() i=3 2024-09-14T11:20:35.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.335+0000 7f1e91c13800 20 add_watcher() i=4 2024-09-14T11:20:35.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.335+0000 7f1e91c13800 20 add_watcher() i=5 2024-09-14T11:20:35.334 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.336+0000 7f1e91c13800 20 add_watcher() i=6 2024-09-14T11:20:35.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.336+0000 7f1e91c13800 20 add_watcher() i=7 2024-09-14T11:20:35.335 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.336+0000 7f1e91c13800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:35.336 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.338+0000 7f1d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:35.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.338+0000 7f1e91c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:35.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.338+0000 7f1e91c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:35.337 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.338+0000 7f1e91c13800 5 note: GC not initialized 2024-09-14T11:20:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.339+0000 7f1d427e4640 20 reqs_thread_entry: start 2024-09-14T11:20:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.339+0000 7f1e91c13800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.339+0000 7f1e91c13800 20 Filter name: none 2024-09-14T11:20:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.339+0000 7f1cb3fff640 20 reqs_thread_entry: start 2024-09-14T11:20:35.338 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.339+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.340+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:35.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.340+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.340+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:35.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.340+0000 7f1e91c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:35.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.340+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.340 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.341+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=173 2024-09-14T11:20:35.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.341+0000 7f1e91c13800 20 rados->read ofs=0 len=0 2024-09-14T11:20:35.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.341+0000 7f1e91c13800 20 rados_obj.operate() r=0 bl.length=395 2024-09-14T11:20:35.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.341+0000 7f1e91c13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:20:35.341 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.343+0000 7f1d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:35.343 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.345+0000 7f1e91c13800 20 remove_watcher() i=0 2024-09-14T11:20:35.344 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.345+0000 7f1e91c13800 2 removed watcher, disabling cache 2024-09-14T11:20:35.345 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.346+0000 7f1e91c13800 20 remove_watcher() i=1 2024-09-14T11:20:35.346 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.347+0000 7f1e91c13800 20 remove_watcher() i=2 2024-09-14T11:20:35.347 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.349+0000 7f1e91c13800 20 remove_watcher() i=3 2024-09-14T11:20:35.348 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.350+0000 7f1e91c13800 20 remove_watcher() i=4 2024-09-14T11:20:35.349 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.351+0000 7f1e91c13800 20 remove_watcher() i=5 2024-09-14T11:20:35.350 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.352+0000 7f1e91c13800 20 remove_watcher() i=6 2024-09-14T11:20:35.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:20:35.353+0000 7f1e91c13800 20 remove_watcher() i=7 2024-09-14T11:20:35.363 INFO:tasks.workunit.client.0.smithi002.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-14T11:20:35.363 INFO:tasks.workunit.client.0.smithi002.stderr:Deleting bucket a-bucket 2024-09-14T11:20:35.366 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:35.366 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:35.369 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:35.369 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:35.383 INFO:tasks.workunit.client.0.smithi002.stderr:Deleting bucket myver 2024-09-14T11:20:35.385 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:35.385 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:35.429 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:20:35.429 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:20:35.466 INFO:tasks.workunit.client.0.smithi002.stderr:Completed resharding tests 2024-09-14T11:20:35.466 INFO:tasks.workunit.client.0.smithi002.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:20:35.467 INFO:tasks.workunit.client.0.smithi002.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:20:35.467 INFO:tasks.workunit.client.0.smithi002.stdout:connected to https://localhost:443 2024-09-14T11:20:35.547 INFO:tasks.workunit.client.0.smithi002.stderr:+ deactivate 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n '' ']' 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ hash -r 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n '' ']' 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset -f deactivate 2024-09-14T11:20:35.548 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo OK. 2024-09-14T11:20:35.549 INFO:tasks.workunit.client.0.smithi002.stdout:OK. 2024-09-14T11:20:35.550 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:20:35.550 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:20:35.629 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-14T11:20:35.629 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:20:36.077 DEBUG:teuthology.parallel:result is None 2024-09-14T11:20:36.077 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:20:36.116 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:20:36.116 DEBUG:teuthology.orchestra.run.smithi002:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:20:36.186 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:20:36.187 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-14T11:20:36.200 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-14T11:20:36.200 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-14T11:20:36.200 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-14T11:20:36.200 DEBUG:teuthology.orchestra.run.smithi002:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:20:36.257 INFO:teuthology.orchestra.run.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-14T11:20:40.574 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-14T11:20:40.575 DEBUG:teuthology.orchestra.run.smithi002:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-14T11:20:42.711 INFO:teuthology.orchestra.run.smithi002.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-14T11:20:43.300 INFO:teuthology.orchestra.run.smithi002.stdout:Last metadata expiration check: 0:28:17 ago on Sat 14 Sep 2024 10:52:26 AM UTC. 2024-09-14T11:20:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:Dependencies resolved. 2024-09-14T11:20:43.448 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-14T11:20:43.448 INFO:teuthology.orchestra.run.smithi002.stdout: Package Arch Version Repository Size 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:Installing: 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:Installing dependencies: 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:Installing weak dependencies: 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction Summary 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:================================================================================ 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout:Install 5 Packages 2024-09-14T11:20:43.449 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:Total download size: 46 M 2024-09-14T11:20:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:Installed size: 166 M 2024-09-14T11:20:43.450 INFO:teuthology.orchestra.run.smithi002.stdout:Downloading Packages: 2024-09-14T11:20:43.967 INFO:teuthology.orchestra.run.smithi002.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.1 MB/s | 426 kB 00:00 2024-09-14T11:20:44.068 INFO:teuthology.orchestra.run.smithi002.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 7.5 MB/s | 3.5 MB 00:00 2024-09-14T11:20:44.110 INFO:teuthology.orchestra.run.smithi002.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 624 kB/s | 26 kB 00:00 2024-09-14T11:20:44.235 INFO:teuthology.orchestra.run.smithi002.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 15 MB/s | 9.3 MB 00:00 2024-09-14T11:20:44.910 INFO:teuthology.orchestra.run.smithi002.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 34 MB/s | 32 MB 00:00 2024-09-14T11:20:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------------------- 2024-09-14T11:20:44.911 INFO:teuthology.orchestra.run.smithi002.stdout:Total 31 MB/s | 46 MB 00:01 2024-09-14T11:20:45.349 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction check 2024-09-14T11:20:45.373 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction check succeeded. 2024-09-14T11:20:45.373 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction test 2024-09-14T11:20:45.876 INFO:teuthology.orchestra.run.smithi002.stdout:Transaction test succeeded. 2024-09-14T11:20:45.877 INFO:teuthology.orchestra.run.smithi002.stdout:Running transaction 2024-09-14T11:20:46.416 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-14T11:20:46.571 INFO:teuthology.orchestra.run.smithi002.stdout: Preparing : 1/1 2024-09-14T11:20:46.768 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-14T11:20:47.405 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-14T11:20:47.445 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:20:47.694 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-14T11:20:47.722 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:20:47.961 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-14T11:20:48.000 INFO:teuthology.orchestra.run.smithi002.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:20:48.009 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:20:48.018 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-14T11:20:48.053 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-14T11:20:51.281 INFO:teuthology.orchestra.run.smithi002.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-14T11:20:51.282 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-14T11:20:51.282 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-14T11:20:51.282 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-14T11:20:51.282 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-14T11:20:51.701 INFO:teuthology.orchestra.run.smithi002.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-14T11:20:51.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout:Installed: 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:51.702 INFO:teuthology.orchestra.run.smithi002.stdout:Complete! 2024-09-14T11:20:52.156 INFO:teuthology.orchestra.run.smithi002.stdout: Gradle will be installed under /opt/gradle 2024-09-14T11:20:52.228 INFO:teuthology.orchestra.run.smithi002.stderr:--2024-09-14 11:20:52-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-14T11:20:52.368 INFO:teuthology.orchestra.run.smithi002.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-14T11:20:52.377 INFO:teuthology.orchestra.run.smithi002.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-14T11:20:52.447 INFO:teuthology.orchestra.run.smithi002.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-14T11:20:52.447 INFO:teuthology.orchestra.run.smithi002.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-14T11:20:52.447 INFO:teuthology.orchestra.run.smithi002.stderr:--2024-09-14 11:20:52-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-14T11:20:52.447 INFO:teuthology.orchestra.run.smithi002.stderr:Resolving github.com (github.com)... 140.82.112.3 2024-09-14T11:20:52.457 INFO:teuthology.orchestra.run.smithi002.stderr:Connecting to github.com (github.com)|140.82.112.3|:443... connected. 2024-09-14T11:20:52.676 INFO:teuthology.orchestra.run.smithi002.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-14T11:20:52.676 INFO:teuthology.orchestra.run.smithi002.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T112052Z&X-Amz-Expires=300&X-Amz-Signature=203b901fa13dbceb43ca6ad668fe418f834e1ab4a7e55e54a4c93a872f7cb7c2&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-14T11:20:52.676 INFO:teuthology.orchestra.run.smithi002.stderr:--2024-09-14 11:20:52-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240914%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240914T112052Z&X-Amz-Expires=300&X-Amz-Signature=203b901fa13dbceb43ca6ad668fe418f834e1ab4a7e55e54a4c93a872f7cb7c2&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-14T11:20:52.677 INFO:teuthology.orchestra.run.smithi002.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.111.133, 185.199.108.133, 185.199.110.133, ... 2024-09-14T11:20:52.688 INFO:teuthology.orchestra.run.smithi002.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.111.133|:443... connected. 2024-09-14T11:20:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-14T11:20:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-14T11:20:52.763 INFO:teuthology.orchestra.run.smithi002.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-14T11:20:52.763 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:20:52.786 INFO:teuthology.orchestra.run.smithi002.stderr: 0K .......... .......... .......... .......... .......... 0% 2.11M 43s 2024-09-14T11:20:52.791 INFO:teuthology.orchestra.run.smithi002.stderr: 50K .......... .......... .......... .......... .......... 0% 8.31M 27s 2024-09-14T11:20:52.797 INFO:teuthology.orchestra.run.smithi002.stderr: 100K .......... .......... .......... .......... .......... 0% 8.03M 22s 2024-09-14T11:20:52.801 INFO:teuthology.orchestra.run.smithi002.stderr: 150K .......... .......... .......... .......... .......... 0% 13.9M 18s 2024-09-14T11:20:52.804 INFO:teuthology.orchestra.run.smithi002.stderr: 200K .......... .......... .......... .......... .......... 0% 19.7M 15s 2024-09-14T11:20:52.811 INFO:teuthology.orchestra.run.smithi002.stderr: 250K .......... .......... .......... .......... .......... 0% 8.73M 14s 2024-09-14T11:20:52.812 INFO:teuthology.orchestra.run.smithi002.stderr: 300K .......... .......... .......... .......... .......... 0% 41.1M 13s 2024-09-14T11:20:52.812 INFO:teuthology.orchestra.run.smithi002.stderr: 350K .......... .......... .......... .......... .......... 0% 27.7M 11s 2024-09-14T11:20:52.815 INFO:teuthology.orchestra.run.smithi002.stderr: 400K .......... .......... .......... .......... .......... 0% 19.4M 11s 2024-09-14T11:20:52.815 INFO:teuthology.orchestra.run.smithi002.stderr: 450K .......... .......... .......... .......... .......... 0% 109M 10s 2024-09-14T11:20:52.828 INFO:teuthology.orchestra.run.smithi002.stderr: 500K .......... .......... .......... .......... .......... 0% 9.09M 10s 2024-09-14T11:20:52.828 INFO:teuthology.orchestra.run.smithi002.stderr: 550K .......... .......... .......... .......... .......... 0% 88.9M 9s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 600K .......... .......... .......... .......... .......... 0% 47.3M 8s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 650K .......... .......... .......... .......... .......... 0% 324M 8s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 700K .......... .......... .......... .......... .......... 0% 49.3M 7s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 750K .......... .......... .......... .......... .......... 0% 47.5M 7s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 800K .......... .......... .......... .......... .......... 0% 76.4M 7s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 850K .......... .......... .......... .......... .......... 0% 39.3M 7s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 900K .......... .......... .......... .......... .......... 1% 236M 6s 2024-09-14T11:20:52.829 INFO:teuthology.orchestra.run.smithi002.stderr: 950K .......... .......... .......... .......... .......... 1% 135M 6s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1000K .......... .......... .......... .......... .......... 1% 9.16M 6s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1050K .......... .......... .......... .......... .......... 1% 230M 6s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1100K .......... .......... .......... .......... .......... 1% 83.0M 6s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1150K .......... .......... .......... .......... .......... 1% 92.2M 5s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1200K .......... .......... .......... .......... .......... 1% 271M 5s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1250K .......... .......... .......... .......... .......... 1% 89.3M 5s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1300K .......... .......... .......... .......... .......... 1% 118M 5s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1350K .......... .......... .......... .......... .......... 1% 103M 5s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1400K .......... .......... .......... .......... .......... 1% 271M 5s 2024-09-14T11:20:54.208 INFO:teuthology.orchestra.run.smithi002.stderr: 1450K .......... .......... .......... .......... .......... 1% 106M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1500K .......... .......... .......... .......... .......... 1% 117M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1550K .......... .......... .......... .......... .......... 1% 137M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1600K .......... .......... .......... .......... .......... 1% 130M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1650K .......... .......... .......... .......... .......... 1% 210M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1700K .......... .......... .......... .......... .......... 1% 124M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1750K .......... .......... .......... .......... .......... 1% 174M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1800K .......... .......... .......... .......... .......... 1% 152M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1850K .......... .......... .......... .......... .......... 2% 120M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1900K .......... .......... .......... .......... .......... 2% 284M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 1950K .......... .......... .......... .......... .......... 2% 193M 3s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 2000K .......... .......... .......... .......... .......... 2% 10.3M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 2050K .......... .......... .......... .......... .......... 2% 263M 4s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 2100K .......... .......... .......... .......... .......... 2% 320M 3s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 2150K .......... .......... .......... .......... .......... 2% 286M 3s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 2200K .......... .......... .......... .......... .......... 2% 194M 3s 2024-09-14T11:20:54.209 INFO:teuthology.orchestra.run.smithi002.stderr: 2250K .......... .......... .......... .......... .......... 2% 161M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2300K .......... .......... .......... .......... .......... 2% 191M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2350K .......... .......... .......... .......... .......... 2% 301M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2400K .......... .......... .......... .......... .......... 2% 240M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2450K .......... .......... .......... .......... .......... 2% 181M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2500K .......... .......... .......... .......... .......... 2% 213M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2550K .......... .......... .......... .......... .......... 2% 261M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2600K .......... .......... .......... .......... .......... 2% 180M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2650K .......... .......... .......... .......... .......... 2% 206M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2700K .......... .......... .......... .......... .......... 2% 321M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2750K .......... .......... .......... .......... .......... 3% 193M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2800K .......... .......... .......... .......... .......... 3% 305M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2850K .......... .......... .......... .......... .......... 3% 250M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2900K .......... .......... .......... .......... .......... 3% 187M 3s 2024-09-14T11:20:54.210 INFO:teuthology.orchestra.run.smithi002.stderr: 2950K .......... .......... .......... .......... .......... 3% 288M 3s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3000K .......... .......... .......... .......... .......... 3% 327M 3s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3050K .......... .......... .......... .......... .......... 3% 275M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3100K .......... .......... .......... .......... .......... 3% 291M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3150K .......... .......... .......... .......... .......... 3% 267M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3200K .......... .......... .......... .......... .......... 3% 230M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3250K .......... .......... .......... .......... .......... 3% 296M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3300K .......... .......... .......... .......... .......... 3% 199M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3350K .......... .......... .......... .......... .......... 3% 313M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3400K .......... .......... .......... .......... .......... 3% 320M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3450K .......... .......... .......... .......... .......... 3% 266M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3500K .......... .......... .......... .......... .......... 3% 327M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3550K .......... .......... .......... .......... .......... 3% 322M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3600K .......... .......... .......... .......... .......... 3% 330M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3650K .......... .......... .......... .......... .......... 3% 265M 2s 2024-09-14T11:20:54.211 INFO:teuthology.orchestra.run.smithi002.stderr: 3700K .......... .......... .......... .......... .......... 4% 312M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 3750K .......... .......... .......... .......... .......... 4% 334M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 3800K .......... .......... .......... .......... .......... 4% 332M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 3850K .......... .......... .......... .......... .......... 4% 249M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 3900K .......... .......... .......... .......... .......... 4% 328M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 3950K .......... .......... .......... .......... .......... 4% 321M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4000K .......... .......... .......... .......... .......... 4% 353M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4050K .......... .......... .......... .......... .......... 4% 12.1M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4100K .......... .......... .......... .......... .......... 4% 240M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4150K .......... .......... .......... .......... .......... 4% 261M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4200K .......... .......... .......... .......... .......... 4% 258M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4250K .......... .......... .......... .......... .......... 4% 198M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4300K .......... .......... .......... .......... .......... 4% 262M 2s 2024-09-14T11:20:54.212 INFO:teuthology.orchestra.run.smithi002.stderr: 4350K .......... .......... .......... .......... .......... 4% 254M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4400K .......... .......... .......... .......... .......... 4% 223M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4450K .......... .......... .......... .......... .......... 4% 229M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4500K .......... .......... .......... .......... .......... 4% 266M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4550K .......... .......... .......... .......... .......... 4% 243M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4600K .......... .......... .......... .......... .......... 5% 241M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4650K .......... .......... .......... .......... .......... 5% 208M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4700K .......... .......... .......... .......... .......... 5% 259M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4750K .......... .......... .......... .......... .......... 5% 263M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4800K .......... .......... .......... .......... .......... 5% 272M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4850K .......... .......... .......... .......... .......... 5% 243M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4900K .......... .......... .......... .......... .......... 5% 249M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 4950K .......... .......... .......... .......... .......... 5% 238M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 5000K .......... .......... .......... .......... .......... 5% 241M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 5050K .......... .......... .......... .......... .......... 5% 208M 2s 2024-09-14T11:20:54.213 INFO:teuthology.orchestra.run.smithi002.stderr: 5100K .......... .......... .......... .......... .......... 5% 259M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5150K .......... .......... .......... .......... .......... 5% 290M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5200K .......... .......... .......... .......... .......... 5% 273M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5250K .......... .......... .......... .......... .......... 5% 249M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5300K .......... .......... .......... .......... .......... 5% 239M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5350K .......... .......... .......... .......... .......... 5% 331M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5400K .......... .......... .......... .......... .......... 5% 300M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5450K .......... .......... .......... .......... .......... 5% 260M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5500K .......... .......... .......... .......... .......... 5% 345M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5550K .......... .......... .......... .......... .......... 6% 270M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5600K .......... .......... .......... .......... .......... 6% 290M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5650K .......... .......... .......... .......... .......... 6% 282M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5700K .......... .......... .......... .......... .......... 6% 320M 2s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5750K .......... .......... .......... .......... .......... 6% 319M 1s 2024-09-14T11:20:54.214 INFO:teuthology.orchestra.run.smithi002.stderr: 5800K .......... .......... .......... .......... .......... 6% 306M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 5850K .......... .......... .......... .......... .......... 6% 261M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 5900K .......... .......... .......... .......... .......... 6% 281M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 5950K .......... .......... .......... .......... .......... 6% 307M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6000K .......... .......... .......... .......... .......... 6% 322M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6050K .......... .......... .......... .......... .......... 6% 282M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6100K .......... .......... .......... .......... .......... 6% 351M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6150K .......... .......... .......... .......... .......... 6% 354M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6200K .......... .......... .......... .......... .......... 6% 343M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6250K .......... .......... .......... .......... .......... 6% 305M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6300K .......... .......... .......... .......... .......... 6% 363M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6350K .......... .......... .......... .......... .......... 6% 333M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6400K .......... .......... .......... .......... .......... 6% 313M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6450K .......... .......... .......... .......... .......... 6% 322M 1s 2024-09-14T11:20:54.215 INFO:teuthology.orchestra.run.smithi002.stderr: 6500K .......... .......... .......... .......... .......... 7% 350M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6550K .......... .......... .......... .......... .......... 7% 347M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6600K .......... .......... .......... .......... .......... 7% 357M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6650K .......... .......... .......... .......... .......... 7% 294M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6700K .......... .......... .......... .......... .......... 7% 358M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6750K .......... .......... .......... .......... .......... 7% 360M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6800K .......... .......... .......... .......... .......... 7% 360M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6850K .......... .......... .......... .......... .......... 7% 323M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6900K .......... .......... .......... .......... .......... 7% 330M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 6950K .......... .......... .......... .......... .......... 7% 356M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 7000K .......... .......... .......... .......... .......... 7% 367M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 7050K .......... .......... .......... .......... .......... 7% 37.2M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 7100K .......... .......... .......... .......... .......... 7% 290M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 7150K .......... .......... .......... .......... .......... 7% 258M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 7200K .......... .......... .......... .......... .......... 7% 281M 1s 2024-09-14T11:20:54.216 INFO:teuthology.orchestra.run.smithi002.stderr: 7250K .......... .......... .......... .......... .......... 7% 310M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7300K .......... .......... .......... .......... .......... 7% 273M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7350K .......... .......... .......... .......... .......... 7% 246M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7400K .......... .......... .......... .......... .......... 8% 103M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7450K .......... .......... .......... .......... .......... 8% 236M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7500K .......... .......... .......... .......... .......... 8% 280M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7550K .......... .......... .......... .......... .......... 8% 291M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7600K .......... .......... .......... .......... .......... 8% 300M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7650K .......... .......... .......... .......... .......... 8% 307M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7700K .......... .......... .......... .......... .......... 8% 305M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7750K .......... .......... .......... .......... .......... 8% 240M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7800K .......... .......... .......... .......... .......... 8% 350M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7850K .......... .......... .......... .......... .......... 8% 283M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7900K .......... .......... .......... .......... .......... 8% 367M 1s 2024-09-14T11:20:54.217 INFO:teuthology.orchestra.run.smithi002.stderr: 7950K .......... .......... .......... .......... .......... 8% 305M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8000K .......... .......... .......... .......... .......... 8% 279M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8050K .......... .......... .......... .......... .......... 8% 306M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8100K .......... .......... .......... .......... .......... 8% 339M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8150K .......... .......... .......... .......... .......... 8% 205M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8200K .......... .......... .......... .......... .......... 8% 207M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8250K .......... .......... .......... .......... .......... 8% 318M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8300K .......... .......... .......... .......... .......... 8% 286M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8350K .......... .......... .......... .......... .......... 9% 281M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8400K .......... .......... .......... .......... .......... 9% 311M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8450K .......... .......... .......... .......... .......... 9% 328M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8500K .......... .......... .......... .......... .......... 9% 304M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8550K .......... .......... .......... .......... .......... 9% 263M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8600K .......... .......... .......... .......... .......... 9% 376M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8650K .......... .......... .......... .......... .......... 9% 264M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8700K .......... .......... .......... .......... .......... 9% 291M 1s 2024-09-14T11:20:54.218 INFO:teuthology.orchestra.run.smithi002.stderr: 8750K .......... .......... .......... .......... .......... 9% 268M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 8800K .......... .......... .......... .......... .......... 9% 312M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 8850K .......... .......... .......... .......... .......... 9% 229M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 8900K .......... .......... .......... .......... .......... 9% 349M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 8950K .......... .......... .......... .......... .......... 9% 242M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9000K .......... .......... .......... .......... .......... 9% 301M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9050K .......... .......... .......... .......... .......... 9% 308M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9100K .......... .......... .......... .......... .......... 9% 337M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9150K .......... .......... .......... .......... .......... 9% 277M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9200K .......... .......... .......... .......... .......... 9% 375M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9250K .......... .......... .......... .......... .......... 10% 370M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9300K .......... .......... .......... .......... .......... 10% 67.6M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9350K .......... .......... .......... .......... .......... 10% 253M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9400K .......... .......... .......... .......... .......... 10% 287M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9450K .......... .......... .......... .......... .......... 10% 313M 1s 2024-09-14T11:20:54.219 INFO:teuthology.orchestra.run.smithi002.stderr: 9500K .......... .......... .......... .......... .......... 10% 376M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9550K .......... .......... .......... .......... .......... 10% 317M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9600K .......... .......... .......... .......... .......... 10% 364M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9650K .......... .......... .......... .......... .......... 10% 22.2M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9700K .......... .......... .......... .......... .......... 10% 245M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9750K .......... .......... .......... .......... .......... 10% 235M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9800K .......... .......... .......... .......... .......... 10% 291M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9850K .......... .......... .......... .......... .......... 10% 247M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9900K .......... .......... .......... .......... .......... 10% 317M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 9950K .......... .......... .......... .......... .......... 10% 212M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 10000K .......... .......... .......... .......... .......... 10% 362M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 10050K .......... .......... .......... .......... .......... 10% 380M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 10100K .......... .......... .......... .......... .......... 10% 278M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 10150K .......... .......... .......... .......... .......... 10% 271M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 10200K .......... .......... .......... .......... .......... 11% 266M 1s 2024-09-14T11:20:54.220 INFO:teuthology.orchestra.run.smithi002.stderr: 10250K .......... .......... .......... .......... .......... 11% 271M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10300K .......... .......... .......... .......... .......... 11% 243M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10350K .......... .......... .......... .......... .......... 11% 304M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10400K .......... .......... .......... .......... .......... 11% 364M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10450K .......... .......... .......... .......... .......... 11% 268M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10500K .......... .......... .......... .......... .......... 11% 229M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10550K .......... .......... .......... .......... .......... 11% 329M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10600K .......... .......... .......... .......... .......... 11% 296M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10650K .......... .......... .......... .......... .......... 11% 265M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10700K .......... .......... .......... .......... .......... 11% 231M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10750K .......... .......... .......... .......... .......... 11% 342M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10800K .......... .......... .......... .......... .......... 11% 376M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10850K .......... .......... .......... .......... .......... 11% 213M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10900K .......... .......... .......... .......... .......... 11% 257M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 10950K .......... .......... .......... .......... .......... 11% 284M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 11000K .......... .......... .......... .......... .......... 11% 279M 1s 2024-09-14T11:20:54.221 INFO:teuthology.orchestra.run.smithi002.stderr: 11050K .......... .......... .......... .......... .......... 11% 310M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11100K .......... .......... .......... .......... .......... 12% 215M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11150K .......... .......... .......... .......... .......... 12% 263M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11200K .......... .......... .......... .......... .......... 12% 363M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11250K .......... .......... .......... .......... .......... 12% 302M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11300K .......... .......... .......... .......... .......... 12% 273M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11350K .......... .......... .......... .......... .......... 12% 291M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11400K .......... .......... .......... .......... .......... 12% 300M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11450K .......... .......... .......... .......... .......... 12% 296M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11500K .......... .......... .......... .......... .......... 12% 260M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11550K .......... .......... .......... .......... .......... 12% 333M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11600K .......... .......... .......... .......... .......... 12% 306M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11650K .......... .......... .......... .......... .......... 12% 323M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11700K .......... .......... .......... .......... .......... 12% 283M 1s 2024-09-14T11:20:54.222 INFO:teuthology.orchestra.run.smithi002.stderr: 11750K .......... .......... .......... .......... .......... 12% 278M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 11800K .......... .......... .......... .......... .......... 12% 324M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 11850K .......... .......... .......... .......... .......... 12% 372M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 11900K .......... .......... .......... .......... .......... 12% 298M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 11950K .......... .......... .......... .......... .......... 12% 367M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12000K .......... .......... .......... .......... .......... 12% 374M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12050K .......... .......... .......... .......... .......... 13% 326M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12100K .......... .......... .......... .......... .......... 13% 328M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12150K .......... .......... .......... .......... .......... 13% 375M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12200K .......... .......... .......... .......... .......... 13% 310M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12250K .......... .......... .......... .......... .......... 13% 280M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12300K .......... .......... .......... .......... .......... 13% 269M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12350K .......... .......... .......... .......... .......... 13% 281M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12400K .......... .......... .......... .......... .......... 13% 320M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12450K .......... .......... .......... .......... .......... 13% 353M 1s 2024-09-14T11:20:54.223 INFO:teuthology.orchestra.run.smithi002.stderr: 12500K .......... .......... .......... .......... .......... 13% 332M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12550K .......... .......... .......... .......... .......... 13% 25.9M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12600K .......... .......... .......... .......... .......... 13% 225M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12650K .......... .......... .......... .......... .......... 13% 302M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12700K .......... .......... .......... .......... .......... 13% 294M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12750K .......... .......... .......... .......... .......... 13% 274M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12800K .......... .......... .......... .......... .......... 13% 236M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12850K .......... .......... .......... .......... .......... 13% 231M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12900K .......... .......... .......... .......... .......... 13% 150M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 12950K .......... .......... .......... .......... .......... 13% 313M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 13000K .......... .......... .......... .......... .......... 14% 290M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 13050K .......... .......... .......... .......... .......... 14% 271M 1s 2024-09-14T11:20:54.224 INFO:teuthology.orchestra.run.smithi002.stderr: 13100K .......... .......... .......... .......... .......... 14% 275M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13150K .......... .......... .......... .......... .......... 14% 315M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13200K .......... .......... .......... .......... .......... 14% 374M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13250K .......... .......... .......... .......... .......... 14% 325M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13300K .......... .......... .......... .......... .......... 14% 229M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13350K .......... .......... .......... .......... .......... 14% 247M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13400K .......... .......... .......... .......... .......... 14% 367M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13450K .......... .......... .......... .......... .......... 14% 263M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13500K .......... .......... .......... .......... .......... 14% 207M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13550K .......... .......... .......... .......... .......... 14% 300M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13600K .......... .......... .......... .......... .......... 14% 299M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13650K .......... .......... .......... .......... .......... 14% 368M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13700K .......... .......... .......... .......... .......... 14% 276M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13750K .......... .......... .......... .......... .......... 14% 248M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13800K .......... .......... .......... .......... .......... 14% 176M 1s 2024-09-14T11:20:54.225 INFO:teuthology.orchestra.run.smithi002.stderr: 13850K .......... .......... .......... .......... .......... 14% 174M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 13900K .......... .......... .......... .......... .......... 15% 125M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 13950K .......... .......... .......... .......... .......... 15% 137M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14000K .......... .......... .......... .......... .......... 15% 177M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14050K .......... .......... .......... .......... .......... 15% 144M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14100K .......... .......... .......... .......... .......... 15% 164M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14150K .......... .......... .......... .......... .......... 15% 169M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14200K .......... .......... .......... .......... .......... 15% 174M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14250K .......... .......... .......... .......... .......... 15% 149M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14300K .......... .......... .......... .......... .......... 15% 150M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14350K .......... .......... .......... .......... .......... 15% 216M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14400K .......... .......... .......... .......... .......... 15% 219M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14450K .......... .......... .......... .......... .......... 15% 222M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14500K .......... .......... .......... .......... .......... 15% 141M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14550K .......... .......... .......... .......... .......... 15% 138M 1s 2024-09-14T11:20:54.226 INFO:teuthology.orchestra.run.smithi002.stderr: 14600K .......... .......... .......... .......... .......... 15% 139M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 14650K .......... .......... .......... .......... .......... 15% 218M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 14700K .......... .......... .......... .......... .......... 15% 181M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 14750K .......... .......... .......... .......... .......... 15% 215M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 14800K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 14850K .......... .......... .......... .......... .......... 16% 219M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 14900K .......... .......... .......... .......... .......... 16% 139M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 14950K .......... .......... .......... .......... .......... 16% 213M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 15000K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 15050K .......... .......... .......... .......... .......... 16% 145M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 15100K .......... .......... .......... .......... .......... 16% 117M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 15150K .......... .......... .......... .......... .......... 16% 206M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 15200K .......... .......... .......... .......... .......... 16% 163M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 15250K .......... .......... .......... .......... .......... 16% 149M 1s 2024-09-14T11:20:54.227 INFO:teuthology.orchestra.run.smithi002.stderr: 15300K .......... .......... .......... .......... .......... 16% 132M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15350K .......... .......... .......... .......... .......... 16% 167M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15400K .......... .......... .......... .......... .......... 16% 215M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15450K .......... .......... .......... .......... .......... 16% 147M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15500K .......... .......... .......... .......... .......... 16% 137M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15550K .......... .......... .......... .......... .......... 16% 172M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15600K .......... .......... .......... .......... .......... 16% 168M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15650K .......... .......... .......... .......... .......... 16% 183M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15700K .......... .......... .......... .......... .......... 16% 148M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15750K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15800K .......... .......... .......... .......... .......... 17% 172M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15850K .......... .......... .......... .......... .......... 17% 178M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15900K .......... .......... .......... .......... .......... 17% 163M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 15950K .......... .......... .......... .......... .......... 17% 175M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 16000K .......... .......... .......... .......... .......... 17% 184M 1s 2024-09-14T11:20:54.228 INFO:teuthology.orchestra.run.smithi002.stderr: 16050K .......... .......... .......... .......... .......... 17% 181M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16100K .......... .......... .......... .......... .......... 17% 142M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16150K .......... .......... .......... .......... .......... 17% 214M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16200K .......... .......... .......... .......... .......... 17% 177M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16250K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16300K .......... .......... .......... .......... .......... 17% 194M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16350K .......... .......... .......... .......... .......... 17% 168M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16400K .......... .......... .......... .......... .......... 17% 215M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16450K .......... .......... .......... .......... .......... 17% 210M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16500K .......... .......... .......... .......... .......... 17% 174M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16550K .......... .......... .......... .......... .......... 17% 139M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16600K .......... .......... .......... .......... .......... 17% 176M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16650K .......... .......... .......... .......... .......... 17% 158M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16700K .......... .......... .......... .......... .......... 18% 186M 1s 2024-09-14T11:20:54.229 INFO:teuthology.orchestra.run.smithi002.stderr: 16750K .......... .......... .......... .......... .......... 18% 217M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 16800K .......... .......... .......... .......... .......... 18% 216M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 16850K .......... .......... .......... .......... .......... 18% 216M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 16900K .......... .......... .......... .......... .......... 18% 174M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 16950K .......... .......... .......... .......... .......... 18% 217M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17000K .......... .......... .......... .......... .......... 18% 217M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17050K .......... .......... .......... .......... .......... 18% 219M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17100K .......... .......... .......... .......... .......... 18% 126M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17150K .......... .......... .......... .......... .......... 18% 140M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17200K .......... .......... .......... .......... .......... 18% 144M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17250K .......... .......... .......... .......... .......... 18% 166M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17300K .......... .......... .......... .......... .......... 18% 166M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17350K .......... .......... .......... .......... .......... 18% 145M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17400K .......... .......... .......... .......... .......... 18% 200M 1s 2024-09-14T11:20:54.230 INFO:teuthology.orchestra.run.smithi002.stderr: 17450K .......... .......... .......... .......... .......... 18% 217M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17500K .......... .......... .......... .......... .......... 18% 155M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17550K .......... .......... .......... .......... .......... 18% 169M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17600K .......... .......... .......... .......... .......... 18% 167M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17650K .......... .......... .......... .......... .......... 19% 168M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17700K .......... .......... .......... .......... .......... 19% 156M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17750K .......... .......... .......... .......... .......... 19% 179M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17800K .......... .......... .......... .......... .......... 19% 187M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17850K .......... .......... .......... .......... .......... 19% 198M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17900K .......... .......... .......... .......... .......... 19% 165M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 17950K .......... .......... .......... .......... .......... 19% 173M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 18000K .......... .......... .......... .......... .......... 19% 219M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 18050K .......... .......... .......... .......... .......... 19% 178M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 18100K .......... .......... .......... .......... .......... 19% 163M 1s 2024-09-14T11:20:54.231 INFO:teuthology.orchestra.run.smithi002.stderr: 18150K .......... .......... .......... .......... .......... 19% 167M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18200K .......... .......... .......... .......... .......... 19% 207M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18250K .......... .......... .......... .......... .......... 19% 180M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18300K .......... .......... .......... .......... .......... 19% 154M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18350K .......... .......... .......... .......... .......... 19% 190M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18400K .......... .......... .......... .......... .......... 19% 213M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18450K .......... .......... .......... .......... .......... 19% 188M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18500K .......... .......... .......... .......... .......... 19% 178M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18550K .......... .......... .......... .......... .......... 20% 218M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18600K .......... .......... .......... .......... .......... 20% 220M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18650K .......... .......... .......... .......... .......... 20% 170M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18700K .......... .......... .......... .......... .......... 20% 154M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18750K .......... .......... .......... .......... .......... 20% 178M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18800K .......... .......... .......... .......... .......... 20% 214M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18850K .......... .......... .......... .......... .......... 20% 224M 1s 2024-09-14T11:20:54.232 INFO:teuthology.orchestra.run.smithi002.stderr: 18900K .......... .......... .......... .......... .......... 20% 193M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 18950K .......... .......... .......... .......... .......... 20% 337M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19000K .......... .......... .......... .......... .......... 20% 345M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19050K .......... .......... .......... .......... .......... 20% 369M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19100K .......... .......... .......... .......... .......... 20% 330M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19150K .......... .......... .......... .......... .......... 20% 375M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19200K .......... .......... .......... .......... .......... 20% 332M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19250K .......... .......... .......... .......... .......... 20% 341M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19300K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19350K .......... .......... .......... .......... .......... 20% 375M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19400K .......... .......... .......... .......... .......... 20% 332M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19450K .......... .......... .......... .......... .......... 20% 246M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19500K .......... .......... .......... .......... .......... 21% 239M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19550K .......... .......... .......... .......... .......... 21% 261M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19600K .......... .......... .......... .......... .......... 21% 260M 1s 2024-09-14T11:20:54.233 INFO:teuthology.orchestra.run.smithi002.stderr: 19650K .......... .......... .......... .......... .......... 21% 305M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 19700K .......... .......... .......... .......... .......... 21% 260M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 19750K .......... .......... .......... .......... .......... 21% 365M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 19800K .......... .......... .......... .......... .......... 21% 381M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 19850K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 19900K .......... .......... .......... .......... .......... 21% 289M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 19950K .......... .......... .......... .......... .......... 21% 281M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20000K .......... .......... .......... .......... .......... 21% 304M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20050K .......... .......... .......... .......... .......... 21% 369M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20100K .......... .......... .......... .......... .......... 21% 311M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20150K .......... .......... .......... .......... .......... 21% 361M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20200K .......... .......... .......... .......... .......... 21% 283M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20250K .......... .......... .......... .......... .......... 21% 339M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20300K .......... .......... .......... .......... .......... 21% 299M 1s 2024-09-14T11:20:54.234 INFO:teuthology.orchestra.run.smithi002.stderr: 20350K .......... .......... .......... .......... .......... 21% 256M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20400K .......... .......... .......... .......... .......... 22% 273M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20450K .......... .......... .......... .......... .......... 22% 351M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20500K .......... .......... .......... .......... .......... 22% 310M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20550K .......... .......... .......... .......... .......... 22% 265M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20600K .......... .......... .......... .......... .......... 22% 349M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20650K .......... .......... .......... .......... .......... 22% 274M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20700K .......... .......... .......... .......... .......... 22% 316M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20750K .......... .......... .......... .......... .......... 22% 293M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20800K .......... .......... .......... .......... .......... 22% 343M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20850K .......... .......... .......... .......... .......... 22% 357M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20900K .......... .......... .......... .......... .......... 22% 260M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 20950K .......... .......... .......... .......... .......... 22% 344M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 21000K .......... .......... .......... .......... .......... 22% 308M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 21050K .......... .......... .......... .......... .......... 22% 377M 1s 2024-09-14T11:20:54.235 INFO:teuthology.orchestra.run.smithi002.stderr: 21100K .......... .......... .......... .......... .......... 22% 250M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21150K .......... .......... .......... .......... .......... 22% 341M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21200K .......... .......... .......... .......... .......... 22% 383M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21250K .......... .......... .......... .......... .......... 22% 326M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21300K .......... .......... .......... .......... .......... 22% 265M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21350K .......... .......... .......... .......... .......... 23% 378M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21400K .......... .......... .......... .......... .......... 23% 380M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21450K .......... .......... .......... .......... .......... 23% 319M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21500K .......... .......... .......... .......... .......... 23% 273M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21550K .......... .......... .......... .......... .......... 23% 287M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21600K .......... .......... .......... .......... .......... 23% 367M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21650K .......... .......... .......... .......... .......... 23% 327M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21700K .......... .......... .......... .......... .......... 23% 295M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21750K .......... .......... .......... .......... .......... 23% 165M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21800K .......... .......... .......... .......... .......... 23% 41.4M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21850K .......... .......... .......... .......... .......... 23% 288M 1s 2024-09-14T11:20:54.236 INFO:teuthology.orchestra.run.smithi002.stderr: 21900K .......... .......... .......... .......... .......... 23% 251M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 21950K .......... .......... .......... .......... .......... 23% 305M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22000K .......... .......... .......... .......... .......... 23% 327M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22050K .......... .......... .......... .......... .......... 23% 344M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22100K .......... .......... .......... .......... .......... 23% 340M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22150K .......... .......... .......... .......... .......... 23% 387M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22200K .......... .......... .......... .......... .......... 23% 25.3M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22250K .......... .......... .......... .......... .......... 24% 266M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22300K .......... .......... .......... .......... .......... 24% 261M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22350K .......... .......... .......... .......... .......... 24% 272M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22400K .......... .......... .......... .......... .......... 24% 253M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22450K .......... .......... .......... .......... .......... 24% 284M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22500K .......... .......... .......... .......... .......... 24% 249M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22550K .......... .......... .......... .......... .......... 24% 298M 1s 2024-09-14T11:20:54.237 INFO:teuthology.orchestra.run.smithi002.stderr: 22600K .......... .......... .......... .......... .......... 24% 301M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 22650K .......... .......... .......... .......... .......... 24% 310M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 22700K .......... .......... .......... .......... .......... 24% 263M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 22750K .......... .......... .......... .......... .......... 24% 325M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 22800K .......... .......... .......... .......... .......... 24% 374M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 22850K .......... .......... .......... .......... .......... 24% 317M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 22900K .......... .......... .......... .......... .......... 24% 223M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 22950K .......... .......... .......... .......... .......... 24% 294M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23000K .......... .......... .......... .......... .......... 24% 296M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23050K .......... .......... .......... .......... .......... 24% 309M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23100K .......... .......... .......... .......... .......... 24% 284M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23150K .......... .......... .......... .......... .......... 24% 388M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23200K .......... .......... .......... .......... .......... 25% 335M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23250K .......... .......... .......... .......... .......... 25% 312M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23300K .......... .......... .......... .......... .......... 25% 243M 1s 2024-09-14T11:20:54.238 INFO:teuthology.orchestra.run.smithi002.stderr: 23350K .......... .......... .......... .......... .......... 25% 324M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23400K .......... .......... .......... .......... .......... 25% 368M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23450K .......... .......... .......... .......... .......... 25% 290M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23500K .......... .......... .......... .......... .......... 25% 253M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23550K .......... .......... .......... .......... .......... 25% 308M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23600K .......... .......... .......... .......... .......... 25% 294M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23650K .......... .......... .......... .......... .......... 25% 286M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23700K .......... .......... .......... .......... .......... 25% 288M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23750K .......... .......... .......... .......... .......... 25% 301M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23800K .......... .......... .......... .......... .......... 25% 305M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23850K .......... .......... .......... .......... .......... 25% 370M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23900K .......... .......... .......... .......... .......... 25% 252M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 23950K .......... .......... .......... .......... .......... 25% 286M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 24000K .......... .......... .......... .......... .......... 25% 319M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 24050K .......... .......... .......... .......... .......... 25% 373M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 24100K .......... .......... .......... .......... .......... 25% 279M 1s 2024-09-14T11:20:54.239 INFO:teuthology.orchestra.run.smithi002.stderr: 24150K .......... .......... .......... .......... .......... 26% 268M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24200K .......... .......... .......... .......... .......... 26% 299M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24250K .......... .......... .......... .......... .......... 26% 301M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24300K .......... .......... .......... .......... .......... 26% 299M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24350K .......... .......... .......... .......... .......... 26% 314M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24400K .......... .......... .......... .......... .......... 26% 325M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24450K .......... .......... .......... .......... .......... 26% 308M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24500K .......... .......... .......... .......... .......... 26% 331M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24550K .......... .......... .......... .......... .......... 26% 361M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24600K .......... .......... .......... .......... .......... 26% 386M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24650K .......... .......... .......... .......... .......... 26% 355M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24700K .......... .......... .......... .......... .......... 26% 277M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24750K .......... .......... .......... .......... .......... 26% 380M 1s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24800K .......... .......... .......... .......... .......... 26% 384M 0s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24850K .......... .......... .......... .......... .......... 26% 314M 0s 2024-09-14T11:20:54.240 INFO:teuthology.orchestra.run.smithi002.stderr: 24900K .......... .......... .......... .......... .......... 26% 96.1M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 24950K .......... .......... .......... .......... .......... 26% 248M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25000K .......... .......... .......... .......... .......... 26% 319M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25050K .......... .......... .......... .......... .......... 27% 370M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25100K .......... .......... .......... .......... .......... 27% 25.1M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25150K .......... .......... .......... .......... .......... 27% 252M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25200K .......... .......... .......... .......... .......... 27% 370M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25250K .......... .......... .......... .......... .......... 27% 379M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25300K .......... .......... .......... .......... .......... 27% 162M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25350K .......... .......... .......... .......... .......... 27% 298M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25400K .......... .......... .......... .......... .......... 27% 284M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25450K .......... .......... .......... .......... .......... 27% 314M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25500K .......... .......... .......... .......... .......... 27% 260M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25550K .......... .......... .......... .......... .......... 27% 297M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25600K .......... .......... .......... .......... .......... 27% 310M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25650K .......... .......... .......... .......... .......... 27% 315M 0s 2024-09-14T11:20:54.241 INFO:teuthology.orchestra.run.smithi002.stderr: 25700K .......... .......... .......... .......... .......... 27% 265M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 25750K .......... .......... .......... .......... .......... 27% 372M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 25800K .......... .......... .......... .......... .......... 27% 293M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 25850K .......... .......... .......... .......... .......... 27% 281M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 25900K .......... .......... .......... .......... .......... 27% 293M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 25950K .......... .......... .......... .......... .......... 27% 280M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26000K .......... .......... .......... .......... .......... 28% 256M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26050K .......... .......... .......... .......... .......... 28% 327M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26100K .......... .......... .......... .......... .......... 28% 291M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26150K .......... .......... .......... .......... .......... 28% 293M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26200K .......... .......... .......... .......... .......... 28% 340M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26250K .......... .......... .......... .......... .......... 28% 319M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26300K .......... .......... .......... .......... .......... 28% 242M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26350K .......... .......... .......... .......... .......... 28% 372M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26400K .......... .......... .......... .......... .......... 28% 322M 0s 2024-09-14T11:20:54.242 INFO:teuthology.orchestra.run.smithi002.stderr: 26450K .......... .......... .......... .......... .......... 28% 278M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26500K .......... .......... .......... .......... .......... 28% 285M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26550K .......... .......... .......... .......... .......... 28% 276M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26600K .......... .......... .......... .......... .......... 28% 350M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26650K .......... .......... .......... .......... .......... 28% 282M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26700K .......... .......... .......... .......... .......... 28% 295M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26750K .......... .......... .......... .......... .......... 28% 238M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26800K .......... .......... .......... .......... .......... 28% 302M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26850K .......... .......... .......... .......... .......... 28% 314M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26900K .......... .......... .......... .......... .......... 29% 326M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 26950K .......... .......... .......... .......... .......... 29% 320M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 27000K .......... .......... .......... .......... .......... 29% 310M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 27050K .......... .......... .......... .......... .......... 29% 326M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 27100K .......... .......... .......... .......... .......... 29% 286M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 27150K .......... .......... .......... .......... .......... 29% 336M 0s 2024-09-14T11:20:54.243 INFO:teuthology.orchestra.run.smithi002.stderr: 27200K .......... .......... .......... .......... .......... 29% 307M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27250K .......... .......... .......... .......... .......... 29% 306M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27300K .......... .......... .......... .......... .......... 29% 339M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27350K .......... .......... .......... .......... .......... 29% 330M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27400K .......... .......... .......... .......... .......... 29% 294M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27450K .......... .......... .......... .......... .......... 29% 374M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27500K .......... .......... .......... .......... .......... 29% 321M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27550K .......... .......... .......... .......... .......... 29% 382M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27600K .......... .......... .......... .......... .......... 29% 376M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27650K .......... .......... .......... .......... .......... 29% 97.5M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27700K .......... .......... .......... .......... .......... 29% 283M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27750K .......... .......... .......... .......... .......... 29% 327M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27800K .......... .......... .......... .......... .......... 29% 333M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27850K .......... .......... .......... .......... .......... 30% 314M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27900K .......... .......... .......... .......... .......... 30% 306M 0s 2024-09-14T11:20:54.244 INFO:teuthology.orchestra.run.smithi002.stderr: 27950K .......... .......... .......... .......... .......... 30% 338M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28000K .......... .......... .......... .......... .......... 30% 379M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28050K .......... .......... .......... .......... .......... 30% 389M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28100K .......... .......... .......... .......... .......... 30% 26.9M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28150K .......... .......... .......... .......... .......... 30% 354M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28200K .......... .......... .......... .......... .......... 30% 287M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28250K .......... .......... .......... .......... .......... 30% 367M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28300K .......... .......... .......... .......... .......... 30% 193M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28350K .......... .......... .......... .......... .......... 30% 321M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28400K .......... .......... .......... .......... .......... 30% 283M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28450K .......... .......... .......... .......... .......... 30% 260M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28500K .......... .......... .......... .......... .......... 30% 284M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28550K .......... .......... .......... .......... .......... 30% 368M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28600K .......... .......... .......... .......... .......... 30% 253M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28650K .......... .......... .......... .......... .......... 30% 328M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28700K .......... .......... .......... .......... .......... 30% 247M 0s 2024-09-14T11:20:54.245 INFO:teuthology.orchestra.run.smithi002.stderr: 28750K .......... .......... .......... .......... .......... 31% 360M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 28800K .......... .......... .......... .......... .......... 31% 386M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 28850K .......... .......... .......... .......... .......... 31% 150M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 28900K .......... .......... .......... .......... .......... 31% 275M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 28950K .......... .......... .......... .......... .......... 31% 351M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29000K .......... .......... .......... .......... .......... 31% 315M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29050K .......... .......... .......... .......... .......... 31% 300M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29100K .......... .......... .......... .......... .......... 31% 256M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29150K .......... .......... .......... .......... .......... 31% 366M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29200K .......... .......... .......... .......... .......... 31% 359M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29250K .......... .......... .......... .......... .......... 31% 321M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29300K .......... .......... .......... .......... .......... 31% 255M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29350K .......... .......... .......... .......... .......... 31% 341M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29400K .......... .......... .......... .......... .......... 31% 258M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29450K .......... .......... .......... .......... .......... 31% 255M 0s 2024-09-14T11:20:54.246 INFO:teuthology.orchestra.run.smithi002.stderr: 29500K .......... .......... .......... .......... .......... 31% 264M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29550K .......... .......... .......... .......... .......... 31% 318M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29600K .......... .......... .......... .......... .......... 31% 317M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29650K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29700K .......... .......... .......... .......... .......... 32% 313M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29750K .......... .......... .......... .......... .......... 32% 307M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29800K .......... .......... .......... .......... .......... 32% 381M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29850K .......... .......... .......... .......... .......... 32% 382M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29900K .......... .......... .......... .......... .......... 32% 28.5M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 29950K .......... .......... .......... .......... .......... 32% 293M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 30000K .......... .......... .......... .......... .......... 32% 235M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 30050K .......... .......... .......... .......... .......... 32% 271M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 30100K .......... .......... .......... .......... .......... 32% 230M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 30150K .......... .......... .......... .......... .......... 32% 233M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 30200K .......... .......... .......... .......... .......... 32% 268M 0s 2024-09-14T11:20:54.247 INFO:teuthology.orchestra.run.smithi002.stderr: 30250K .......... .......... .......... .......... .......... 32% 289M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30300K .......... .......... .......... .......... .......... 32% 252M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30350K .......... .......... .......... .......... .......... 32% 310M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30400K .......... .......... .......... .......... .......... 32% 286M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30450K .......... .......... .......... .......... .......... 32% 340M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30500K .......... .......... .......... .......... .......... 32% 337M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30550K .......... .......... .......... .......... .......... 32% 383M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30600K .......... .......... .......... .......... .......... 32% 392M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30650K .......... .......... .......... .......... .......... 33% 384M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30700K .......... .......... .......... .......... .......... 33% 321M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30750K .......... .......... .......... .......... .......... 33% 230M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30800K .......... .......... .......... .......... .......... 33% 367M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30850K .......... .......... .......... .......... .......... 33% 380M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30900K .......... .......... .......... .......... .......... 33% 342M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 30950K .......... .......... .......... .......... .......... 33% 387M 0s 2024-09-14T11:20:54.248 INFO:teuthology.orchestra.run.smithi002.stderr: 31000K .......... .......... .......... .......... .......... 33% 110M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31050K .......... .......... .......... .......... .......... 33% 239M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31100K .......... .......... .......... .......... .......... 33% 255M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31150K .......... .......... .......... .......... .......... 33% 327M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31200K .......... .......... .......... .......... .......... 33% 333M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31250K .......... .......... .......... .......... .......... 33% 294M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31300K .......... .......... .......... .......... .......... 33% 384M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31350K .......... .......... .......... .......... .......... 33% 315M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31400K .......... .......... .......... .......... .......... 33% 314M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31450K .......... .......... .......... .......... .......... 33% 270M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31500K .......... .......... .......... .......... .......... 33% 313M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31550K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31600K .......... .......... .......... .......... .......... 34% 299M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31650K .......... .......... .......... .......... .......... 34% 328M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31700K .......... .......... .......... .......... .......... 34% 301M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31750K .......... .......... .......... .......... .......... 34% 312M 0s 2024-09-14T11:20:54.249 INFO:teuthology.orchestra.run.smithi002.stderr: 31800K .......... .......... .......... .......... .......... 34% 394M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 31850K .......... .......... .......... .......... .......... 34% 193M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 31900K .......... .......... .......... .......... .......... 34% 337M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 31950K .......... .......... .......... .......... .......... 34% 215M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32000K .......... .......... .......... .......... .......... 34% 334M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32050K .......... .......... .......... .......... .......... 34% 183M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32100K .......... .......... .......... .......... .......... 34% 292M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32150K .......... .......... .......... .......... .......... 34% 237M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32200K .......... .......... .......... .......... .......... 34% 318M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32250K .......... .......... .......... .......... .......... 34% 298M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32300K .......... .......... .......... .......... .......... 34% 318M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32350K .......... .......... .......... .......... .......... 34% 285M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32400K .......... .......... .......... .......... .......... 34% 324M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32450K .......... .......... .......... .......... .......... 34% 303M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32500K .......... .......... .......... .......... .......... 35% 296M 0s 2024-09-14T11:20:54.250 INFO:teuthology.orchestra.run.smithi002.stderr: 32550K .......... .......... .......... .......... .......... 35% 298M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32600K .......... .......... .......... .......... .......... 35% 311M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32650K .......... .......... .......... .......... .......... 35% 315M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32700K .......... .......... .......... .......... .......... 35% 373M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32750K .......... .......... .......... .......... .......... 35% 260M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32800K .......... .......... .......... .......... .......... 35% 389M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32850K .......... .......... .......... .......... .......... 35% 31.0M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32900K .......... .......... .......... .......... .......... 35% 243M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 32950K .......... .......... .......... .......... .......... 35% 349M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 33000K .......... .......... .......... .......... .......... 35% 249M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 33050K .......... .......... .......... .......... .......... 35% 236M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 33100K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 33150K .......... .......... .......... .......... .......... 35% 220M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 33200K .......... .......... .......... .......... .......... 35% 374M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 33250K .......... .......... .......... .......... .......... 35% 391M 0s 2024-09-14T11:20:54.251 INFO:teuthology.orchestra.run.smithi002.stderr: 33300K .......... .......... .......... .......... .......... 35% 162M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33350K .......... .......... .......... .......... .......... 35% 235M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33400K .......... .......... .......... .......... .......... 36% 289M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33450K .......... .......... .......... .......... .......... 36% 382M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33500K .......... .......... .......... .......... .......... 36% 385M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33550K .......... .......... .......... .......... .......... 36% 323M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33600K .......... .......... .......... .......... .......... 36% 108M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33650K .......... .......... .......... .......... .......... 36% 290M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33700K .......... .......... .......... .......... .......... 36% 38.7M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33750K .......... .......... .......... .......... .......... 36% 250M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33800K .......... .......... .......... .......... .......... 36% 269M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33850K .......... .......... .......... .......... .......... 36% 305M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33900K .......... .......... .......... .......... .......... 36% 324M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 33950K .......... .......... .......... .......... .......... 36% 254M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 34000K .......... .......... .......... .......... .......... 36% 285M 0s 2024-09-14T11:20:54.252 INFO:teuthology.orchestra.run.smithi002.stderr: 34050K .......... .......... .......... .......... .......... 36% 301M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34100K .......... .......... .......... .......... .......... 36% 382M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34150K .......... .......... .......... .......... .......... 36% 267M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34200K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34250K .......... .......... .......... .......... .......... 36% 286M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34300K .......... .......... .......... .......... .......... 36% 309M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34350K .......... .......... .......... .......... .......... 37% 300M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34400K .......... .......... .......... .......... .......... 37% 361M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34450K .......... .......... .......... .......... .......... 37% 326M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34500K .......... .......... .......... .......... .......... 37% 259M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34550K .......... .......... .......... .......... .......... 37% 286M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34600K .......... .......... .......... .......... .......... 37% 312M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34650K .......... .......... .......... .......... .......... 37% 386M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34700K .......... .......... .......... .......... .......... 37% 329M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34750K .......... .......... .......... .......... .......... 37% 263M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34800K .......... .......... .......... .......... .......... 37% 380M 0s 2024-09-14T11:20:54.253 INFO:teuthology.orchestra.run.smithi002.stderr: 34850K .......... .......... .......... .......... .......... 37% 339M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 34900K .......... .......... .......... .......... .......... 37% 295M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 34950K .......... .......... .......... .......... .......... 37% 272M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35000K .......... .......... .......... .......... .......... 37% 352M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35050K .......... .......... .......... .......... .......... 37% 271M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35100K .......... .......... .......... .......... .......... 37% 342M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35150K .......... .......... .......... .......... .......... 37% 263M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35200K .......... .......... .......... .......... .......... 37% 324M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35250K .......... .......... .......... .......... .......... 37% 308M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35300K .......... .......... .......... .......... .......... 38% 360M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35350K .......... .......... .......... .......... .......... 38% 314M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35400K .......... .......... .......... .......... .......... 38% 302M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35450K .......... .......... .......... .......... .......... 38% 364M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35500K .......... .......... .......... .......... .......... 38% 390M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35550K .......... .......... .......... .......... .......... 38% 299M 0s 2024-09-14T11:20:54.254 INFO:teuthology.orchestra.run.smithi002.stderr: 35600K .......... .......... .......... .......... .......... 38% 393M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 35650K .......... .......... .......... .......... .......... 38% 372M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 35700K .......... .......... .......... .......... .......... 38% 398M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 35750K .......... .......... .......... .......... .......... 38% 350M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 35800K .......... .......... .......... .......... .......... 38% 387M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 35850K .......... .......... .......... .......... .......... 38% 54.9M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 35900K .......... .......... .......... .......... .......... 38% 257M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 35950K .......... .......... .......... .......... .......... 38% 245M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36000K .......... .......... .......... .......... .......... 38% 375M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36050K .......... .......... .......... .......... .......... 38% 310M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36100K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36150K .......... .......... .......... .......... .......... 38% 341M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36200K .......... .......... .......... .......... .......... 39% 391M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36250K .......... .......... .......... .......... .......... 39% 97.4M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36300K .......... .......... .......... .......... .......... 39% 285M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36350K .......... .......... .......... .......... .......... 39% 265M 0s 2024-09-14T11:20:54.255 INFO:teuthology.orchestra.run.smithi002.stderr: 36400K .......... .......... .......... .......... .......... 39% 327M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36450K .......... .......... .......... .......... .......... 39% 375M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36500K .......... .......... .......... .......... .......... 39% 393M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36550K .......... .......... .......... .......... .......... 39% 127M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36600K .......... .......... .......... .......... .......... 39% 290M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36650K .......... .......... .......... .......... .......... 39% 391M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36700K .......... .......... .......... .......... .......... 39% 388M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36750K .......... .......... .......... .......... .......... 39% 52.5M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36800K .......... .......... .......... .......... .......... 39% 118M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36850K .......... .......... .......... .......... .......... 39% 251M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36900K .......... .......... .......... .......... .......... 39% 373M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 36950K .......... .......... .......... .......... .......... 39% 153M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 37000K .......... .......... .......... .......... .......... 39% 333M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 37050K .......... .......... .......... .......... .......... 39% 287M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 37100K .......... .......... .......... .......... .......... 39% 323M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 37150K .......... .......... .......... .......... .......... 40% 298M 0s 2024-09-14T11:20:54.256 INFO:teuthology.orchestra.run.smithi002.stderr: 37200K .......... .......... .......... .......... .......... 40% 330M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37250K .......... .......... .......... .......... .......... 40% 314M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37300K .......... .......... .......... .......... .......... 40% 326M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37350K .......... .......... .......... .......... .......... 40% 316M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37400K .......... .......... .......... .......... .......... 40% 350M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37450K .......... .......... .......... .......... .......... 40% 303M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37500K .......... .......... .......... .......... .......... 40% 339M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37550K .......... .......... .......... .......... .......... 40% 253M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37600K .......... .......... .......... .......... .......... 40% 378M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37650K .......... .......... .......... .......... .......... 40% 389M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37700K .......... .......... .......... .......... .......... 40% 268M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37750K .......... .......... .......... .......... .......... 40% 266M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37800K .......... .......... .......... .......... .......... 40% 292M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37850K .......... .......... .......... .......... .......... 40% 305M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37900K .......... .......... .......... .......... .......... 40% 311M 0s 2024-09-14T11:20:54.257 INFO:teuthology.orchestra.run.smithi002.stderr: 37950K .......... .......... .......... .......... .......... 40% 278M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38000K .......... .......... .......... .......... .......... 40% 345M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38050K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38100K .......... .......... .......... .......... .......... 41% 323M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38150K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38200K .......... .......... .......... .......... .......... 41% 372M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38250K .......... .......... .......... .......... .......... 41% 364M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38300K .......... .......... .......... .......... .......... 41% 292M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38350K .......... .......... .......... .......... .......... 41% 273M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38400K .......... .......... .......... .......... .......... 41% 323M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38450K .......... .......... .......... .......... .......... 41% 363M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38500K .......... .......... .......... .......... .......... 41% 387M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38550K .......... .......... .......... .......... .......... 41% 350M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38600K .......... .......... .......... .......... .......... 41% 31.6M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38650K .......... .......... .......... .......... .......... 41% 258M 0s 2024-09-14T11:20:54.258 INFO:teuthology.orchestra.run.smithi002.stderr: 38700K .......... .......... .......... .......... .......... 41% 264M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 38750K .......... .......... .......... .......... .......... 41% 261M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 38800K .......... .......... .......... .......... .......... 41% 295M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 38850K .......... .......... .......... .......... .......... 41% 241M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 38900K .......... .......... .......... .......... .......... 41% 381M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 38950K .......... .......... .......... .......... .......... 41% 330M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39000K .......... .......... .......... .......... .......... 42% 301M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39050K .......... .......... .......... .......... .......... 42% 290M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39100K .......... .......... .......... .......... .......... 42% 259M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39150K .......... .......... .......... .......... .......... 42% 309M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39200K .......... .......... .......... .......... .......... 42% 319M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39250K .......... .......... .......... .......... .......... 42% 295M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39300K .......... .......... .......... .......... .......... 42% 384M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39350K .......... .......... .......... .......... .......... 42% 354M 0s 2024-09-14T11:20:54.259 INFO:teuthology.orchestra.run.smithi002.stderr: 39400K .......... .......... .......... .......... .......... 42% 311M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39450K .......... .......... .......... .......... .......... 42% 370M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39500K .......... .......... .......... .......... .......... 42% 309M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39550K .......... .......... .......... .......... .......... 42% 258M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39600K .......... .......... .......... .......... .......... 42% 388M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39650K .......... .......... .......... .......... .......... 42% 362M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39700K .......... .......... .......... .......... .......... 42% 389M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39750K .......... .......... .......... .......... .......... 42% 94.4M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39800K .......... .......... .......... .......... .......... 42% 328M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39850K .......... .......... .......... .......... .......... 42% 214M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39900K .......... .......... .......... .......... .......... 43% 310M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 39950K .......... .......... .......... .......... .......... 43% 82.8M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 40000K .......... .......... .......... .......... .......... 43% 365M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 40050K .......... .......... .......... .......... .......... 43% 322M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 40100K .......... .......... .......... .......... .......... 43% 288M 0s 2024-09-14T11:20:54.260 INFO:teuthology.orchestra.run.smithi002.stderr: 40150K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40200K .......... .......... .......... .......... .......... 43% 348M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40250K .......... .......... .......... .......... .......... 43% 391M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40300K .......... .......... .......... .......... .......... 43% 205M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40350K .......... .......... .......... .......... .......... 43% 241M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40400K .......... .......... .......... .......... .......... 43% 306M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40450K .......... .......... .......... .......... .......... 43% 340M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40500K .......... .......... .......... .......... .......... 43% 347M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40550K .......... .......... .......... .......... .......... 43% 309M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40600K .......... .......... .......... .......... .......... 43% 309M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40650K .......... .......... .......... .......... .......... 43% 300M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40700K .......... .......... .......... .......... .......... 43% 387M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40750K .......... .......... .......... .......... .......... 43% 235M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40800K .......... .......... .......... .......... .......... 43% 296M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40850K .......... .......... .......... .......... .......... 44% 327M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40900K .......... .......... .......... .......... .......... 44% 303M 0s 2024-09-14T11:20:54.261 INFO:teuthology.orchestra.run.smithi002.stderr: 40950K .......... .......... .......... .......... .......... 44% 368M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41000K .......... .......... .......... .......... .......... 44% 326M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41050K .......... .......... .......... .......... .......... 44% 291M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41100K .......... .......... .......... .......... .......... 44% 347M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41150K .......... .......... .......... .......... .......... 44% 269M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41200K .......... .......... .......... .......... .......... 44% 317M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41250K .......... .......... .......... .......... .......... 44% 315M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41300K .......... .......... .......... .......... .......... 44% 290M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41350K .......... .......... .......... .......... .......... 44% 334M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41400K .......... .......... .......... .......... .......... 44% 308M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41450K .......... .......... .......... .......... .......... 44% 338M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41500K .......... .......... .......... .......... .......... 44% 28.2M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41550K .......... .......... .......... .......... .......... 44% 306M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41600K .......... .......... .......... .......... .......... 44% 376M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41650K .......... .......... .......... .......... .......... 44% 235M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41700K .......... .......... .......... .......... .......... 44% 306M 0s 2024-09-14T11:20:54.262 INFO:teuthology.orchestra.run.smithi002.stderr: 41750K .......... .......... .......... .......... .......... 44% 289M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 41800K .......... .......... .......... .......... .......... 45% 377M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 41850K .......... .......... .......... .......... .......... 45% 345M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 41900K .......... .......... .......... .......... .......... 45% 355M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 41950K .......... .......... .......... .......... .......... 45% 309M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42000K .......... .......... .......... .......... .......... 45% 257M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42050K .......... .......... .......... .......... .......... 45% 238M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42100K .......... .......... .......... .......... .......... 45% 285M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42150K .......... .......... .......... .......... .......... 45% 363M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42200K .......... .......... .......... .......... .......... 45% 338M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42250K .......... .......... .......... .......... .......... 45% 266M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42300K .......... .......... .......... .......... .......... 45% 300M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42350K .......... .......... .......... .......... .......... 45% 230M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42400K .......... .......... .......... .......... .......... 45% 344M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42450K .......... .......... .......... .......... .......... 45% 323M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42500K .......... .......... .......... .......... .......... 45% 340M 0s 2024-09-14T11:20:54.263 INFO:teuthology.orchestra.run.smithi002.stderr: 42550K .......... .......... .......... .......... .......... 45% 343M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42600K .......... .......... .......... .......... .......... 45% 375M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42650K .......... .......... .......... .......... .......... 45% 144M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42700K .......... .......... .......... .......... .......... 46% 287M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42750K .......... .......... .......... .......... .......... 46% 282M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42800K .......... .......... .......... .......... .......... 46% 324M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42850K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42900K .......... .......... .......... .......... .......... 46% 375M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 42950K .......... .......... .......... .......... .......... 46% 327M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 43000K .......... .......... .......... .......... .......... 46% 264M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 43050K .......... .......... .......... .......... .......... 46% 116M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 43100K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 43150K .......... .......... .......... .......... .......... 46% 284M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 43200K .......... .......... .......... .......... .......... 46% 384M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 43250K .......... .......... .......... .......... .......... 46% 120M 0s 2024-09-14T11:20:54.264 INFO:teuthology.orchestra.run.smithi002.stderr: 43300K .......... .......... .......... .......... .......... 46% 284M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43350K .......... .......... .......... .......... .......... 46% 216M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43400K .......... .......... .......... .......... .......... 46% 287M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43450K .......... .......... .......... .......... .......... 46% 272M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43500K .......... .......... .......... .......... .......... 46% 382M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43550K .......... .......... .......... .......... .......... 46% 274M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43600K .......... .......... .......... .......... .......... 46% 280M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43650K .......... .......... .......... .......... .......... 47% 358M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43700K .......... .......... .......... .......... .......... 47% 310M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43750K .......... .......... .......... .......... .......... 47% 264M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43800K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43850K .......... .......... .......... .......... .......... 47% 379M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43900K .......... .......... .......... .......... .......... 47% 386M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 43950K .......... .......... .......... .......... .......... 47% 310M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 44000K .......... .......... .......... .......... .......... 47% 213M 0s 2024-09-14T11:20:54.265 INFO:teuthology.orchestra.run.smithi002.stderr: 44050K .......... .......... .......... .......... .......... 47% 255M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44100K .......... .......... .......... .......... .......... 47% 320M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44150K .......... .......... .......... .......... .......... 47% 267M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44200K .......... .......... .......... .......... .......... 47% 293M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44250K .......... .......... .......... .......... .......... 47% 330M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44300K .......... .......... .......... .......... .......... 47% 308M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44350K .......... .......... .......... .......... .......... 47% 292M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44400K .......... .......... .......... .......... .......... 47% 385M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44450K .......... .......... .......... .......... .......... 47% 386M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44500K .......... .......... .......... .......... .......... 47% 36.2M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44550K .......... .......... .......... .......... .......... 48% 233M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44600K .......... .......... .......... .......... .......... 48% 371M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44650K .......... .......... .......... .......... .......... 48% 144M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44700K .......... .......... .......... .......... .......... 48% 291M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44750K .......... .......... .......... .......... .......... 48% 264M 0s 2024-09-14T11:20:54.266 INFO:teuthology.orchestra.run.smithi002.stderr: 44800K .......... .......... .......... .......... .......... 48% 371M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 44850K .......... .......... .......... .......... .......... 48% 382M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 44900K .......... .......... .......... .......... .......... 48% 203M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 44950K .......... .......... .......... .......... .......... 48% 289M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45000K .......... .......... .......... .......... .......... 48% 304M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45050K .......... .......... .......... .......... .......... 48% 358M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45100K .......... .......... .......... .......... .......... 48% 303M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45150K .......... .......... .......... .......... .......... 48% 240M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45200K .......... .......... .......... .......... .......... 48% 320M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45250K .......... .......... .......... .......... .......... 48% 355M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45300K .......... .......... .......... .......... .......... 48% 322M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45350K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45400K .......... .......... .......... .......... .......... 48% 285M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45450K .......... .......... .......... .......... .......... 48% 367M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45500K .......... .......... .......... .......... .......... 49% 377M 0s 2024-09-14T11:20:54.267 INFO:teuthology.orchestra.run.smithi002.stderr: 45550K .......... .......... .......... .......... .......... 49% 317M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45600K .......... .......... .......... .......... .......... 49% 122M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45650K .......... .......... .......... .......... .......... 49% 266M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45700K .......... .......... .......... .......... .......... 49% 314M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45750K .......... .......... .......... .......... .......... 49% 348M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45800K .......... .......... .......... .......... .......... 49% 306M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45850K .......... .......... .......... .......... .......... 49% 281M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45900K .......... .......... .......... .......... .......... 49% 281M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 45950K .......... .......... .......... .......... .......... 49% 276M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 46000K .......... .......... .......... .......... .......... 49% 383M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 46050K .......... .......... .......... .......... .......... 49% 313M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 46100K .......... .......... .......... .......... .......... 49% 279M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 46150K .......... .......... .......... .......... .......... 49% 308M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 46200K .......... .......... .......... .......... .......... 49% 389M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 46250K .......... .......... .......... .......... .......... 49% 91.4M 0s 2024-09-14T11:20:54.268 INFO:teuthology.orchestra.run.smithi002.stderr: 46300K .......... .......... .......... .......... .......... 49% 283M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46350K .......... .......... .......... .......... .......... 49% 244M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46400K .......... .......... .......... .......... .......... 49% 255M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46450K .......... .......... .......... .......... .......... 50% 303M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46500K .......... .......... .......... .......... .......... 50% 261M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46550K .......... .......... .......... .......... .......... 50% 265M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46600K .......... .......... .......... .......... .......... 50% 373M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46650K .......... .......... .......... .......... .......... 50% 320M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46700K .......... .......... .......... .......... .......... 50% 284M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46750K .......... .......... .......... .......... .......... 50% 283M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46800K .......... .......... .......... .......... .......... 50% 340M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46850K .......... .......... .......... .......... .......... 50% 351M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46900K .......... .......... .......... .......... .......... 50% 202M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 46950K .......... .......... .......... .......... .......... 50% 239M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 47000K .......... .......... .......... .......... .......... 50% 302M 0s 2024-09-14T11:20:54.269 INFO:teuthology.orchestra.run.smithi002.stderr: 47050K .......... .......... .......... .......... .......... 50% 300M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47100K .......... .......... .......... .......... .......... 50% 306M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47150K .......... .......... .......... .......... .......... 50% 272M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47200K .......... .......... .......... .......... .......... 50% 331M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47250K .......... .......... .......... .......... .......... 50% 309M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47300K .......... .......... .......... .......... .......... 50% 333M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47350K .......... .......... .......... .......... .......... 51% 332M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47400K .......... .......... .......... .......... .......... 51% 391M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47450K .......... .......... .......... .......... .......... 51% 35.0M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47500K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47550K .......... .......... .......... .......... .......... 51% 296M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47600K .......... .......... .......... .......... .......... 51% 223M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47650K .......... .......... .......... .......... .......... 51% 290M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47700K .......... .......... .......... .......... .......... 51% 377M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47750K .......... .......... .......... .......... .......... 51% 222M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47800K .......... .......... .......... .......... .......... 51% 340M 0s 2024-09-14T11:20:54.270 INFO:teuthology.orchestra.run.smithi002.stderr: 47850K .......... .......... .......... .......... .......... 51% 277M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 47900K .......... .......... .......... .......... .......... 51% 286M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 47950K .......... .......... .......... .......... .......... 51% 291M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48000K .......... .......... .......... .......... .......... 51% 336M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48050K .......... .......... .......... .......... .......... 51% 273M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48100K .......... .......... .......... .......... .......... 51% 371M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48150K .......... .......... .......... .......... .......... 51% 362M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48200K .......... .......... .......... .......... .......... 51% 195M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48250K .......... .......... .......... .......... .......... 51% 299M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48300K .......... .......... .......... .......... .......... 52% 319M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48350K .......... .......... .......... .......... .......... 52% 323M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48400K .......... .......... .......... .......... .......... 52% 328M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48450K .......... .......... .......... .......... .......... 52% 291M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48500K .......... .......... .......... .......... .......... 52% 85.1M 0s 2024-09-14T11:20:54.271 INFO:teuthology.orchestra.run.smithi002.stderr: 48550K .......... .......... .......... .......... .......... 52% 194M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48600K .......... .......... .......... .......... .......... 52% 284M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48650K .......... .......... .......... .......... .......... 52% 295M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48700K .......... .......... .......... .......... .......... 52% 279M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48750K .......... .......... .......... .......... .......... 52% 325M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48800K .......... .......... .......... .......... .......... 52% 322M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48850K .......... .......... .......... .......... .......... 52% 214M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48900K .......... .......... .......... .......... .......... 52% 289M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 48950K .......... .......... .......... .......... .......... 52% 336M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 49000K .......... .......... .......... .......... .......... 52% 339M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 49050K .......... .......... .......... .......... .......... 52% 304M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 49100K .......... .......... .......... .......... .......... 52% 367M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 49150K .......... .......... .......... .......... .......... 52% 382M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 49200K .......... .......... .......... .......... .......... 53% 111M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 49250K .......... .......... .......... .......... .......... 53% 197M 0s 2024-09-14T11:20:54.272 INFO:teuthology.orchestra.run.smithi002.stderr: 49300K .......... .......... .......... .......... .......... 53% 329M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49350K .......... .......... .......... .......... .......... 53% 332M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49400K .......... .......... .......... .......... .......... 53% 372M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49450K .......... .......... .......... .......... .......... 53% 337M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49500K .......... .......... .......... .......... .......... 53% 319M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49550K .......... .......... .......... .......... .......... 53% 308M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49600K .......... .......... .......... .......... .......... 53% 380M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49650K .......... .......... .......... .......... .......... 53% 112M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49700K .......... .......... .......... .......... .......... 53% 232M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49750K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49800K .......... .......... .......... .......... .......... 53% 276M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49850K .......... .......... .......... .......... .......... 53% 266M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49900K .......... .......... .......... .......... .......... 53% 259M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 49950K .......... .......... .......... .......... .......... 53% 290M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 50000K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-14T11:20:54.273 INFO:teuthology.orchestra.run.smithi002.stderr: 50050K .......... .......... .......... .......... .......... 53% 280M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50100K .......... .......... .......... .......... .......... 53% 355M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50150K .......... .......... .......... .......... .......... 54% 313M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50200K .......... .......... .......... .......... .......... 54% 373M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50250K .......... .......... .......... .......... .......... 54% 318M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50300K .......... .......... .......... .......... .......... 54% 364M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50350K .......... .......... .......... .......... .......... 54% 379M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50400K .......... .......... .......... .......... .......... 54% 53.2M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50450K .......... .......... .......... .......... .......... 54% 233M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50500K .......... .......... .......... .......... .......... 54% 288M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50550K .......... .......... .......... .......... .......... 54% 217M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50600K .......... .......... .......... .......... .......... 54% 160M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50650K .......... .......... .......... .......... .......... 54% 196M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50700K .......... .......... .......... .......... .......... 54% 280M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50750K .......... .......... .......... .......... .......... 54% 375M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50800K .......... .......... .......... .......... .......... 54% 305M 0s 2024-09-14T11:20:54.274 INFO:teuthology.orchestra.run.smithi002.stderr: 50850K .......... .......... .......... .......... .......... 54% 263M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 50900K .......... .......... .......... .......... .......... 54% 290M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 50950K .......... .......... .......... .......... .......... 54% 307M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51000K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51050K .......... .......... .......... .......... .......... 55% 312M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51100K .......... .......... .......... .......... .......... 55% 328M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51150K .......... .......... .......... .......... .......... 55% 336M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51200K .......... .......... .......... .......... .......... 55% 256M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51250K .......... .......... .......... .......... .......... 55% 327M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51300K .......... .......... .......... .......... .......... 55% 339M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51350K .......... .......... .......... .......... .......... 55% 340M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51400K .......... .......... .......... .......... .......... 55% 342M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51450K .......... .......... .......... .......... .......... 55% 422M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51500K .......... .......... .......... .......... .......... 55% 77.7M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51550K .......... .......... .......... .......... .......... 55% 297M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51600K .......... .......... .......... .......... .......... 55% 275M 0s 2024-09-14T11:20:54.275 INFO:teuthology.orchestra.run.smithi002.stderr: 51650K .......... .......... .......... .......... .......... 55% 380M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 51700K .......... .......... .......... .......... .......... 55% 380M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 51750K .......... .......... .......... .......... .......... 55% 335M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 51800K .......... .......... .......... .......... .......... 55% 313M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 51850K .......... .......... .......... .......... .......... 55% 340M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 51900K .......... .......... .......... .......... .......... 55% 215M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 51950K .......... .......... .......... .......... .......... 55% 294M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52000K .......... .......... .......... .......... .......... 56% 298M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52050K .......... .......... .......... .......... .......... 56% 319M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52100K .......... .......... .......... .......... .......... 56% 344M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52150K .......... .......... .......... .......... .......... 56% 65.9M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52200K .......... .......... .......... .......... .......... 56% 339M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52250K .......... .......... .......... .......... .......... 56% 299M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52300K .......... .......... .......... .......... .......... 56% 281M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52350K .......... .......... .......... .......... .......... 56% 376M 0s 2024-09-14T11:20:54.276 INFO:teuthology.orchestra.run.smithi002.stderr: 52400K .......... .......... .......... .......... .......... 56% 286M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52450K .......... .......... .......... .......... .......... 56% 275M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52500K .......... .......... .......... .......... .......... 56% 277M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52550K .......... .......... .......... .......... .......... 56% 392M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52600K .......... .......... .......... .......... .......... 56% 335M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52650K .......... .......... .......... .......... .......... 56% 306M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52700K .......... .......... .......... .......... .......... 56% 270M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52750K .......... .......... .......... .......... .......... 56% 347M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52800K .......... .......... .......... .......... .......... 56% 325M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52850K .......... .......... .......... .......... .......... 56% 381M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52900K .......... .......... .......... .......... .......... 56% 285M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 52950K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 53000K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 53050K .......... .......... .......... .......... .......... 57% 328M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 53100K .......... .......... .......... .......... .......... 57% 296M 0s 2024-09-14T11:20:54.277 INFO:teuthology.orchestra.run.smithi002.stderr: 53150K .......... .......... .......... .......... .......... 57% 291M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53200K .......... .......... .......... .......... .......... 57% 348M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53250K .......... .......... .......... .......... .......... 57% 381M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53300K .......... .......... .......... .......... .......... 57% 33.0M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53350K .......... .......... .......... .......... .......... 57% 268M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53400K .......... .......... .......... .......... .......... 57% 341M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53450K .......... .......... .......... .......... .......... 57% 307M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53500K .......... .......... .......... .......... .......... 57% 301M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53550K .......... .......... .......... .......... .......... 57% 351M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53600K .......... .......... .......... .......... .......... 57% 299M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53650K .......... .......... .......... .......... .......... 57% 303M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53700K .......... .......... .......... .......... .......... 57% 311M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53750K .......... .......... .......... .......... .......... 57% 318M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53800K .......... .......... .......... .......... .......... 57% 376M 0s 2024-09-14T11:20:54.278 INFO:teuthology.orchestra.run.smithi002.stderr: 53850K .......... .......... .......... .......... .......... 58% 386M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 53900K .......... .......... .......... .......... .......... 58% 271M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 53950K .......... .......... .......... .......... .......... 58% 315M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54000K .......... .......... .......... .......... .......... 58% 358M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54050K .......... .......... .......... .......... .......... 58% 137M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54100K .......... .......... .......... .......... .......... 58% 269M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54150K .......... .......... .......... .......... .......... 58% 310M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54200K .......... .......... .......... .......... .......... 58% 344M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54250K .......... .......... .......... .......... .......... 58% 330M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54300K .......... .......... .......... .......... .......... 58% 247M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54350K .......... .......... .......... .......... .......... 58% 384M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54400K .......... .......... .......... .......... .......... 58% 377M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54450K .......... .......... .......... .......... .......... 58% 388M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54500K .......... .......... .......... .......... .......... 58% 136M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54550K .......... .......... .......... .......... .......... 58% 262M 0s 2024-09-14T11:20:54.279 INFO:teuthology.orchestra.run.smithi002.stderr: 54600K .......... .......... .......... .......... .......... 58% 317M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 54650K .......... .......... .......... .......... .......... 58% 264M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 54700K .......... .......... .......... .......... .......... 58% 301M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 54750K .......... .......... .......... .......... .......... 58% 301M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 54800K .......... .......... .......... .......... .......... 59% 310M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 54850K .......... .......... .......... .......... .......... 59% 269M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 54900K .......... .......... .......... .......... .......... 59% 327M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 54950K .......... .......... .......... .......... .......... 59% 231M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55000K .......... .......... .......... .......... .......... 59% 308M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55050K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55100K .......... .......... .......... .......... .......... 59% 87.7M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55150K .......... .......... .......... .......... .......... 59% 253M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55200K .......... .......... .......... .......... .......... 59% 313M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55250K .......... .......... .......... .......... .......... 59% 348M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55300K .......... .......... .......... .......... .......... 59% 288M 0s 2024-09-14T11:20:54.280 INFO:teuthology.orchestra.run.smithi002.stderr: 55350K .......... .......... .......... .......... .......... 59% 384M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55400K .......... .......... .......... .......... .......... 59% 135M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55450K .......... .......... .......... .......... .......... 59% 288M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55500K .......... .......... .......... .......... .......... 59% 314M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55550K .......... .......... .......... .......... .......... 59% 321M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55600K .......... .......... .......... .......... .......... 59% 276M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55650K .......... .......... .......... .......... .......... 59% 339M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55700K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55750K .......... .......... .......... .......... .......... 60% 301M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55800K .......... .......... .......... .......... .......... 60% 352M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55850K .......... .......... .......... .......... .......... 60% 323M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55900K .......... .......... .......... .......... .......... 60% 247M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 55950K .......... .......... .......... .......... .......... 60% 295M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 56000K .......... .......... .......... .......... .......... 60% 339M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 56050K .......... .......... .......... .......... .......... 60% 362M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 56100K .......... .......... .......... .......... .......... 60% 288M 0s 2024-09-14T11:20:54.281 INFO:teuthology.orchestra.run.smithi002.stderr: 56150K .......... .......... .......... .......... .......... 60% 334M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56200K .......... .......... .......... .......... .......... 60% 366M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56250K .......... .......... .......... .......... .......... 60% 384M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56300K .......... .......... .......... .......... .......... 60% 35.5M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56350K .......... .......... .......... .......... .......... 60% 373M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56400K .......... .......... .......... .......... .......... 60% 262M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56450K .......... .......... .......... .......... .......... 60% 284M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56500K .......... .......... .......... .......... .......... 60% 297M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56550K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56600K .......... .......... .......... .......... .......... 60% 335M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56650K .......... .......... .......... .......... .......... 61% 357M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56700K .......... .......... .......... .......... .......... 61% 250M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56750K .......... .......... .......... .......... .......... 61% 375M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56800K .......... .......... .......... .......... .......... 61% 343M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56850K .......... .......... .......... .......... .......... 61% 327M 0s 2024-09-14T11:20:54.282 INFO:teuthology.orchestra.run.smithi002.stderr: 56900K .......... .......... .......... .......... .......... 61% 262M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 56950K .......... .......... .......... .......... .......... 61% 356M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57000K .......... .......... .......... .......... .......... 61% 388M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57050K .......... .......... .......... .......... .......... 61% 264M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57100K .......... .......... .......... .......... .......... 61% 278M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57150K .......... .......... .......... .......... .......... 61% 325M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57200K .......... .......... .......... .......... .......... 61% 285M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57250K .......... .......... .......... .......... .......... 61% 371M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57300K .......... .......... .......... .......... .......... 61% 215M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57350K .......... .......... .......... .......... .......... 61% 286M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57400K .......... .......... .......... .......... .......... 61% 337M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57450K .......... .......... .......... .......... .......... 61% 86.1M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57500K .......... .......... .......... .......... .......... 61% 259M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57550K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57600K .......... .......... .......... .......... .......... 62% 325M 0s 2024-09-14T11:20:54.283 INFO:teuthology.orchestra.run.smithi002.stderr: 57650K .......... .......... .......... .......... .......... 62% 292M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 57700K .......... .......... .......... .......... .......... 62% 311M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 57750K .......... .......... .......... .......... .......... 62% 341M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 57800K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 57850K .......... .......... .......... .......... .......... 62% 323M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 57900K .......... .......... .......... .......... .......... 62% 286M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 57950K .......... .......... .......... .......... .......... 62% 342M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58000K .......... .......... .......... .......... .......... 62% 347M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58050K .......... .......... .......... .......... .......... 62% 279M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58100K .......... .......... .......... .......... .......... 62% 118M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58150K .......... .......... .......... .......... .......... 62% 231M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58200K .......... .......... .......... .......... .......... 62% 349M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58250K .......... .......... .......... .......... .......... 62% 316M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58300K .......... .......... .......... .......... .......... 62% 290M 0s 2024-09-14T11:20:54.284 INFO:teuthology.orchestra.run.smithi002.stderr: 58350K .......... .......... .......... .......... .......... 62% 140M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58400K .......... .......... .......... .......... .......... 62% 247M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58450K .......... .......... .......... .......... .......... 62% 285M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58500K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58550K .......... .......... .......... .......... .......... 63% 348M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58600K .......... .......... .......... .......... .......... 63% 293M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58650K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58700K .......... .......... .......... .......... .......... 63% 266M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58750K .......... .......... .......... .......... .......... 63% 324M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58800K .......... .......... .......... .......... .......... 63% 311M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58850K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58900K .......... .......... .......... .......... .......... 63% 285M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 58950K .......... .......... .......... .......... .......... 63% 284M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 59000K .......... .......... .......... .......... .......... 63% 363M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 59050K .......... .......... .......... .......... .......... 63% 305M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 59100K .......... .......... .......... .......... .......... 63% 246M 0s 2024-09-14T11:20:54.285 INFO:teuthology.orchestra.run.smithi002.stderr: 59150K .......... .......... .......... .......... .......... 63% 385M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59200K .......... .......... .......... .......... .......... 63% 32.8M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59250K .......... .......... .......... .......... .......... 63% 251M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59300K .......... .......... .......... .......... .......... 63% 280M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59350K .......... .......... .......... .......... .......... 63% 379M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59400K .......... .......... .......... .......... .......... 63% 313M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59450K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59500K .......... .......... .......... .......... .......... 64% 261M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59550K .......... .......... .......... .......... .......... 64% 340M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59600K .......... .......... .......... .......... .......... 64% 267M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59650K .......... .......... .......... .......... .......... 64% 296M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59700K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59750K .......... .......... .......... .......... .......... 64% 278M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59800K .......... .......... .......... .......... .......... 64% 309M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59850K .......... .......... .......... .......... .......... 64% 354M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59900K .......... .......... .......... .......... .......... 64% 281M 0s 2024-09-14T11:20:54.286 INFO:teuthology.orchestra.run.smithi002.stderr: 59950K .......... .......... .......... .......... .......... 64% 299M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60000K .......... .......... .......... .......... .......... 64% 271M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60050K .......... .......... .......... .......... .......... 64% 304M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60100K .......... .......... .......... .......... .......... 64% 294M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60150K .......... .......... .......... .......... .......... 64% 296M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60200K .......... .......... .......... .......... .......... 64% 329M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60250K .......... .......... .......... .......... .......... 64% 385M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60300K .......... .......... .......... .......... .......... 64% 319M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60350K .......... .......... .......... .......... .......... 65% 388M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60400K .......... .......... .......... .......... .......... 65% 78.9M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60450K .......... .......... .......... .......... .......... 65% 232M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60500K .......... .......... .......... .......... .......... 65% 188M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60550K .......... .......... .......... .......... .......... 65% 231M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60600K .......... .......... .......... .......... .......... 65% 265M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60650K .......... .......... .......... .......... .......... 65% 305M 0s 2024-09-14T11:20:54.287 INFO:teuthology.orchestra.run.smithi002.stderr: 60700K .......... .......... .......... .......... .......... 65% 249M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 60750K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 60800K .......... .......... .......... .......... .......... 65% 357M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 60850K .......... .......... .......... .......... .......... 65% 283M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 60900K .......... .......... .......... .......... .......... 65% 306M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 60950K .......... .......... .......... .......... .......... 65% 375M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61000K .......... .......... .......... .......... .......... 65% 382M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61050K .......... .......... .......... .......... .......... 65% 357M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61100K .......... .......... .......... .......... .......... 65% 267M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61150K .......... .......... .......... .......... .......... 65% 301M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61200K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61250K .......... .......... .......... .......... .......... 65% 367M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61300K .......... .......... .......... .......... .......... 66% 340M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61350K .......... .......... .......... .......... .......... 66% 228M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61400K .......... .......... .......... .......... .......... 66% 283M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61450K .......... .......... .......... .......... .......... 66% 318M 0s 2024-09-14T11:20:54.288 INFO:teuthology.orchestra.run.smithi002.stderr: 61500K .......... .......... .......... .......... .......... 66% 232M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61550K .......... .......... .......... .......... .......... 66% 312M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61600K .......... .......... .......... .......... .......... 66% 376M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61650K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61700K .......... .......... .......... .......... .......... 66% 287M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61750K .......... .......... .......... .......... .......... 66% 369M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61800K .......... .......... .......... .......... .......... 66% 286M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61850K .......... .......... .......... .......... .......... 66% 342M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61900K .......... .......... .......... .......... .......... 66% 273M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 61950K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 62000K .......... .......... .......... .......... .......... 66% 349M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 62050K .......... .......... .......... .......... .......... 66% 368M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 62100K .......... .......... .......... .......... .......... 66% 310M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 62150K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-14T11:20:54.289 INFO:teuthology.orchestra.run.smithi002.stderr: 62200K .......... .......... .......... .......... .......... 67% 27.7M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62250K .......... .......... .......... .......... .......... 67% 179M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62300K .......... .......... .......... .......... .......... 67% 301M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62350K .......... .......... .......... .......... .......... 67% 292M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62400K .......... .......... .......... .......... .......... 67% 283M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62450K .......... .......... .......... .......... .......... 67% 340M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62500K .......... .......... .......... .......... .......... 67% 302M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62550K .......... .......... .......... .......... .......... 67% 288M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62600K .......... .......... .......... .......... .......... 67% 293M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62650K .......... .......... .......... .......... .......... 67% 298M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62700K .......... .......... .......... .......... .......... 67% 260M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62750K .......... .......... .......... .......... .......... 67% 342M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62800K .......... .......... .......... .......... .......... 67% 319M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62850K .......... .......... .......... .......... .......... 67% 274M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62900K .......... .......... .......... .......... .......... 67% 338M 0s 2024-09-14T11:20:54.290 INFO:teuthology.orchestra.run.smithi002.stderr: 62950K .......... .......... .......... .......... .......... 67% 264M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63000K .......... .......... .......... .......... .......... 67% 310M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63050K .......... .......... .......... .......... .......... 67% 184M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63100K .......... .......... .......... .......... .......... 67% 368M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63150K .......... .......... .......... .......... .......... 68% 384M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63200K .......... .......... .......... .......... .......... 68% 389M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63250K .......... .......... .......... .......... .......... 68% 346M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63300K .......... .......... .......... .......... .......... 68% 70.7M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63350K .......... .......... .......... .......... .......... 68% 300M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63400K .......... .......... .......... .......... .......... 68% 278M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63450K .......... .......... .......... .......... .......... 68% 268M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63500K .......... .......... .......... .......... .......... 68% 334M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63550K .......... .......... .......... .......... .......... 68% 333M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63600K .......... .......... .......... .......... .......... 68% 302M 0s 2024-09-14T11:20:54.291 INFO:teuthology.orchestra.run.smithi002.stderr: 63650K .......... .......... .......... .......... .......... 68% 296M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 63700K .......... .......... .......... .......... .......... 68% 337M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 63750K .......... .......... .......... .......... .......... 68% 348M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 63800K .......... .......... .......... .......... .......... 68% 322M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 63850K .......... .......... .......... .......... .......... 68% 286M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 63900K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 63950K .......... .......... .......... .......... .......... 68% 345M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64000K .......... .......... .......... .......... .......... 68% 309M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64050K .......... .......... .......... .......... .......... 68% 334M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64100K .......... .......... .......... .......... .......... 69% 361M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64150K .......... .......... .......... .......... .......... 69% 312M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64200K .......... .......... .......... .......... .......... 69% 334M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64250K .......... .......... .......... .......... .......... 69% 311M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64300K .......... .......... .......... .......... .......... 69% 185M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64350K .......... .......... .......... .......... .......... 69% 262M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64400K .......... .......... .......... .......... .......... 69% 295M 0s 2024-09-14T11:20:54.292 INFO:teuthology.orchestra.run.smithi002.stderr: 64450K .......... .......... .......... .......... .......... 69% 299M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64500K .......... .......... .......... .......... .......... 69% 388M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64550K .......... .......... .......... .......... .......... 69% 296M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64600K .......... .......... .......... .......... .......... 69% 295M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64650K .......... .......... .......... .......... .......... 69% 265M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64700K .......... .......... .......... .......... .......... 69% 296M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64750K .......... .......... .......... .......... .......... 69% 323M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64800K .......... .......... .......... .......... .......... 69% 370M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64850K .......... .......... .......... .......... .......... 69% 273M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64900K .......... .......... .......... .......... .......... 69% 317M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 64950K .......... .......... .......... .......... .......... 69% 327M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 65000K .......... .......... .......... .......... .......... 70% 363M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 65050K .......... .......... .......... .......... .......... 70% 325M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 65100K .......... .......... .......... .......... .......... 70% 395M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 65150K .......... .......... .......... .......... .......... 70% 384M 0s 2024-09-14T11:20:54.293 INFO:teuthology.orchestra.run.smithi002.stderr: 65200K .......... .......... .......... .......... .......... 70% 36.0M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65250K .......... .......... .......... .......... .......... 70% 286M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65300K .......... .......... .......... .......... .......... 70% 79.9M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65350K .......... .......... .......... .......... .......... 70% 267M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65400K .......... .......... .......... .......... .......... 70% 298M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65450K .......... .......... .......... .......... .......... 70% 259M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65500K .......... .......... .......... .......... .......... 70% 349M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65550K .......... .......... .......... .......... .......... 70% 285M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65600K .......... .......... .......... .......... .......... 70% 310M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65650K .......... .......... .......... .......... .......... 70% 343M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65700K .......... .......... .......... .......... .......... 70% 332M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65750K .......... .......... .......... .......... .......... 70% 323M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65800K .......... .......... .......... .......... .......... 70% 314M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65850K .......... .......... .......... .......... .......... 70% 285M 0s 2024-09-14T11:20:54.294 INFO:teuthology.orchestra.run.smithi002.stderr: 65900K .......... .......... .......... .......... .......... 70% 327M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 65950K .......... .......... .......... .......... .......... 71% 322M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66000K .......... .......... .......... .......... .......... 71% 325M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66050K .......... .......... .......... .......... .......... 71% 339M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66100K .......... .......... .......... .......... .......... 71% 318M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66150K .......... .......... .......... .......... .......... 71% 376M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66200K .......... .......... .......... .......... .......... 71% 49.6M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66250K .......... .......... .......... .......... .......... 71% 198M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66300K .......... .......... .......... .......... .......... 71% 309M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66350K .......... .......... .......... .......... .......... 71% 348M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66400K .......... .......... .......... .......... .......... 71% 298M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66450K .......... .......... .......... .......... .......... 71% 299M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66500K .......... .......... .......... .......... .......... 71% 327M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66550K .......... .......... .......... .......... .......... 71% 331M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66600K .......... .......... .......... .......... .......... 71% 335M 0s 2024-09-14T11:20:54.295 INFO:teuthology.orchestra.run.smithi002.stderr: 66650K .......... .......... .......... .......... .......... 71% 274M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 66700K .......... .......... .......... .......... .......... 71% 307M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 66750K .......... .......... .......... .......... .......... 71% 341M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 66800K .......... .......... .......... .......... .......... 71% 344M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 66850K .......... .......... .......... .......... .......... 72% 299M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 66900K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 66950K .......... .......... .......... .......... .......... 72% 318M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67000K .......... .......... .......... .......... .......... 72% 317M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67050K .......... .......... .......... .......... .......... 72% 236M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67100K .......... .......... .......... .......... .......... 72% 390M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67150K .......... .......... .......... .......... .......... 72% 394M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67200K .......... .......... .......... .......... .......... 72% 278M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67250K .......... .......... .......... .......... .......... 72% 248M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67300K .......... .......... .......... .......... .......... 72% 354M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67350K .......... .......... .......... .......... .......... 72% 298M 0s 2024-09-14T11:20:54.296 INFO:teuthology.orchestra.run.smithi002.stderr: 67400K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67450K .......... .......... .......... .......... .......... 72% 261M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67500K .......... .......... .......... .......... .......... 72% 392M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67550K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67600K .......... .......... .......... .......... .......... 72% 288M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67650K .......... .......... .......... .......... .......... 72% 278M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67700K .......... .......... .......... .......... .......... 72% 307M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67750K .......... .......... .......... .......... .......... 72% 329M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67800K .......... .......... .......... .......... .......... 73% 309M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67850K .......... .......... .......... .......... .......... 73% 260M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67900K .......... .......... .......... .......... .......... 73% 330M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 67950K .......... .......... .......... .......... .......... 73% 383M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 68000K .......... .......... .......... .......... .......... 73% 385M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 68050K .......... .......... .......... .......... .......... 73% 349M 0s 2024-09-14T11:20:54.297 INFO:teuthology.orchestra.run.smithi002.stderr: 68100K .......... .......... .......... .......... .......... 73% 38.7M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68150K .......... .......... .......... .......... .......... 73% 293M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68200K .......... .......... .......... .......... .......... 73% 305M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68250K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68300K .......... .......... .......... .......... .......... 73% 111M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68350K .......... .......... .......... .......... .......... 73% 296M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68400K .......... .......... .......... .......... .......... 73% 336M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68450K .......... .......... .......... .......... .......... 73% 282M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68500K .......... .......... .......... .......... .......... 73% 339M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68550K .......... .......... .......... .......... .......... 73% 319M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68600K .......... .......... .......... .......... .......... 73% 341M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68650K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68700K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68750K .......... .......... .......... .......... .......... 74% 277M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68800K .......... .......... .......... .......... .......... 74% 320M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68850K .......... .......... .......... .......... .......... 74% 342M 0s 2024-09-14T11:20:54.298 INFO:teuthology.orchestra.run.smithi002.stderr: 68900K .......... .......... .......... .......... .......... 74% 320M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 68950K .......... .......... .......... .......... .......... 74% 329M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69000K .......... .......... .......... .......... .......... 74% 299M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69050K .......... .......... .......... .......... .......... 74% 338M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69100K .......... .......... .......... .......... .......... 74% 379M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69150K .......... .......... .......... .......... .......... 74% 235M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69200K .......... .......... .......... .......... .......... 74% 51.2M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69250K .......... .......... .......... .......... .......... 74% 292M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69300K .......... .......... .......... .......... .......... 74% 345M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69350K .......... .......... .......... .......... .......... 74% 317M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69400K .......... .......... .......... .......... .......... 74% 280M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69450K .......... .......... .......... .......... .......... 74% 162M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69500K .......... .......... .......... .......... .......... 74% 333M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69550K .......... .......... .......... .......... .......... 74% 242M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69600K .......... .......... .......... .......... .......... 74% 337M 0s 2024-09-14T11:20:54.299 INFO:teuthology.orchestra.run.smithi002.stderr: 69650K .......... .......... .......... .......... .......... 75% 305M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 69700K .......... .......... .......... .......... .......... 75% 277M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 69750K .......... .......... .......... .......... .......... 75% 339M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 69800K .......... .......... .......... .......... .......... 75% 379M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 69850K .......... .......... .......... .......... .......... 75% 318M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 69900K .......... .......... .......... .......... .......... 75% 301M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 69950K .......... .......... .......... .......... .......... 75% 302M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70000K .......... .......... .......... .......... .......... 75% 338M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70050K .......... .......... .......... .......... .......... 75% 338M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70100K .......... .......... .......... .......... .......... 75% 381M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70150K .......... .......... .......... .......... .......... 75% 251M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70200K .......... .......... .......... .......... .......... 75% 263M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70250K .......... .......... .......... .......... .......... 75% 294M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70300K .......... .......... .......... .......... .......... 75% 299M 0s 2024-09-14T11:20:54.300 INFO:teuthology.orchestra.run.smithi002.stderr: 70350K .......... .......... .......... .......... .......... 75% 269M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70400K .......... .......... .......... .......... .......... 75% 294M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70450K .......... .......... .......... .......... .......... 75% 373M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70500K .......... .......... .......... .......... .......... 75% 367M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70550K .......... .......... .......... .......... .......... 75% 288M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70600K .......... .......... .......... .......... .......... 76% 315M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70650K .......... .......... .......... .......... .......... 76% 334M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70700K .......... .......... .......... .......... .......... 76% 330M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70750K .......... .......... .......... .......... .......... 76% 256M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70800K .......... .......... .......... .......... .......... 76% 363M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70850K .......... .......... .......... .......... .......... 76% 321M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70900K .......... .......... .......... .......... .......... 76% 379M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 70950K .......... .......... .......... .......... .......... 76% 30.7M 0s 2024-09-14T11:20:54.301 INFO:teuthology.orchestra.run.smithi002.stderr: 71000K .......... .......... .......... .......... .......... 76% 251M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71050K .......... .......... .......... .......... .......... 76% 278M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71100K .......... .......... .......... .......... .......... 76% 207M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71150K .......... .......... .......... .......... .......... 76% 307M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71200K .......... .......... .......... .......... .......... 76% 342M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71250K .......... .......... .......... .......... .......... 76% 302M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71300K .......... .......... .......... .......... .......... 76% 334M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71350K .......... .......... .......... .......... .......... 76% 303M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71400K .......... .......... .......... .......... .......... 76% 307M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71450K .......... .......... .......... .......... .......... 76% 344M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71500K .......... .......... .......... .......... .......... 77% 312M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71550K .......... .......... .......... .......... .......... 77% 285M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71600K .......... .......... .......... .......... .......... 77% 324M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71650K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71700K .......... .......... .......... .......... .......... 77% 367M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71750K .......... .......... .......... .......... .......... 77% 294M 0s 2024-09-14T11:20:54.302 INFO:teuthology.orchestra.run.smithi002.stderr: 71800K .......... .......... .......... .......... .......... 77% 291M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 71850K .......... .......... .......... .......... .......... 77% 345M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 71900K .......... .......... .......... .......... .......... 77% 329M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 71950K .......... .......... .......... .......... .......... 77% 286M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72000K .......... .......... .......... .......... .......... 77% 358M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72050K .......... .......... .......... .......... .......... 77% 314M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72100K .......... .......... .......... .......... .......... 77% 340M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72150K .......... .......... .......... .......... .......... 77% 337M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72200K .......... .......... .......... .......... .......... 77% 386M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72250K .......... .......... .......... .......... .......... 77% 85.4M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72300K .......... .......... .......... .......... .......... 77% 133M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72350K .......... .......... .......... .......... .......... 77% 134M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72400K .......... .......... .......... .......... .......... 77% 256M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72450K .......... .......... .......... .......... .......... 78% 331M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72500K .......... .......... .......... .......... .......... 78% 350M 0s 2024-09-14T11:20:54.303 INFO:teuthology.orchestra.run.smithi002.stderr: 72550K .......... .......... .......... .......... .......... 78% 270M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72600K .......... .......... .......... .......... .......... 78% 362M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72650K .......... .......... .......... .......... .......... 78% 336M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72700K .......... .......... .......... .......... .......... 78% 345M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72750K .......... .......... .......... .......... .......... 78% 241M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72800K .......... .......... .......... .......... .......... 78% 313M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72850K .......... .......... .......... .......... .......... 78% 340M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72900K .......... .......... .......... .......... .......... 78% 343M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 72950K .......... .......... .......... .......... .......... 78% 310M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73000K .......... .......... .......... .......... .......... 78% 341M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73050K .......... .......... .......... .......... .......... 78% 353M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73100K .......... .......... .......... .......... .......... 78% 374M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73150K .......... .......... .......... .......... .......... 78% 180M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73200K .......... .......... .......... .......... .......... 78% 325M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73250K .......... .......... .......... .......... .......... 78% 176M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73300K .......... .......... .......... .......... .......... 78% 307M 0s 2024-09-14T11:20:54.304 INFO:teuthology.orchestra.run.smithi002.stderr: 73350K .......... .......... .......... .......... .......... 79% 299M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73400K .......... .......... .......... .......... .......... 79% 269M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73450K .......... .......... .......... .......... .......... 79% 293M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73500K .......... .......... .......... .......... .......... 79% 303M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73550K .......... .......... .......... .......... .......... 79% 264M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73600K .......... .......... .......... .......... .......... 79% 276M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73650K .......... .......... .......... .......... .......... 79% 321M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73700K .......... .......... .......... .......... .......... 79% 320M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73750K .......... .......... .......... .......... .......... 79% 242M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73800K .......... .......... .......... .......... .......... 79% 389M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73850K .......... .......... .......... .......... .......... 79% 388M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73900K .......... .......... .......... .......... .......... 79% 384M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 73950K .......... .......... .......... .......... .......... 79% 37.3M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 74000K .......... .......... .......... .......... .......... 79% 258M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 74050K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-14T11:20:54.305 INFO:teuthology.orchestra.run.smithi002.stderr: 74100K .......... .......... .......... .......... .......... 79% 257M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74150K .......... .......... .......... .......... .......... 79% 280M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74200K .......... .......... .......... .......... .......... 79% 212M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74250K .......... .......... .......... .......... .......... 79% 265M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74300K .......... .......... .......... .......... .......... 80% 316M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74350K .......... .......... .......... .......... .......... 80% 285M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74400K .......... .......... .......... .......... .......... 80% 314M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74450K .......... .......... .......... .......... .......... 80% 324M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74500K .......... .......... .......... .......... .......... 80% 345M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74550K .......... .......... .......... .......... .......... 80% 260M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74600K .......... .......... .......... .......... .......... 80% 362M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74650K .......... .......... .......... .......... .......... 80% 318M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74700K .......... .......... .......... .......... .......... 80% 326M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74750K .......... .......... .......... .......... .......... 80% 273M 0s 2024-09-14T11:20:54.306 INFO:teuthology.orchestra.run.smithi002.stderr: 74800K .......... .......... .......... .......... .......... 80% 286M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 74850K .......... .......... .......... .......... .......... 80% 324M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 74900K .......... .......... .......... .......... .......... 80% 336M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 74950K .......... .......... .......... .......... .......... 80% 275M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75000K .......... .......... .......... .......... .......... 80% 311M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75050K .......... .......... .......... .......... .......... 80% 381M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75100K .......... .......... .......... .......... .......... 80% 361M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75150K .......... .......... .......... .......... .......... 80% 89.6M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75200K .......... .......... .......... .......... .......... 81% 266M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75250K .......... .......... .......... .......... .......... 81% 278M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75300K .......... .......... .......... .......... .......... 81% 347M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75350K .......... .......... .......... .......... .......... 81% 345M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75400K .......... .......... .......... .......... .......... 81% 364M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75450K .......... .......... .......... .......... .......... 81% 156M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75500K .......... .......... .......... .......... .......... 81% 303M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75550K .......... .......... .......... .......... .......... 81% 251M 0s 2024-09-14T11:20:54.307 INFO:teuthology.orchestra.run.smithi002.stderr: 75600K .......... .......... .......... .......... .......... 81% 314M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 75650K .......... .......... .......... .......... .......... 81% 339M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 75700K .......... .......... .......... .......... .......... 81% 257M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 75750K .......... .......... .......... .......... .......... 81% 296M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 75800K .......... .......... .......... .......... .......... 81% 189M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 75850K .......... .......... .......... .......... .......... 81% 287M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 75900K .......... .......... .......... .......... .......... 81% 286M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 75950K .......... .......... .......... .......... .......... 81% 240M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76000K .......... .......... .......... .......... .......... 81% 325M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76050K .......... .......... .......... .......... .......... 81% 327M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76100K .......... .......... .......... .......... .......... 81% 317M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76150K .......... .......... .......... .......... .......... 82% 283M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76200K .......... .......... .......... .......... .......... 82% 389M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76250K .......... .......... .......... .......... .......... 82% 267M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76300K .......... .......... .......... .......... .......... 82% 214M 0s 2024-09-14T11:20:54.308 INFO:teuthology.orchestra.run.smithi002.stderr: 76350K .......... .......... .......... .......... .......... 82% 278M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76400K .......... .......... .......... .......... .......... 82% 340M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76450K .......... .......... .......... .......... .......... 82% 345M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76500K .......... .......... .......... .......... .......... 82% 205M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76550K .......... .......... .......... .......... .......... 82% 277M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76600K .......... .......... .......... .......... .......... 82% 301M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76650K .......... .......... .......... .......... .......... 82% 333M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76700K .......... .......... .......... .......... .......... 82% 289M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76750K .......... .......... .......... .......... .......... 82% 284M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76800K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76850K .......... .......... .......... .......... .......... 82% 379M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76900K .......... .......... .......... .......... .......... 82% 33.0M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 76950K .......... .......... .......... .......... .......... 82% 240M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 77000K .......... .......... .......... .......... .......... 82% 277M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 77050K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-14T11:20:54.309 INFO:teuthology.orchestra.run.smithi002.stderr: 77100K .......... .......... .......... .......... .......... 83% 266M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77150K .......... .......... .......... .......... .......... 83% 277M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77200K .......... .......... .......... .......... .......... 83% 296M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77250K .......... .......... .......... .......... .......... 83% 344M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77300K .......... .......... .......... .......... .......... 83% 301M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77350K .......... .......... .......... .......... .......... 83% 242M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77400K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77450K .......... .......... .......... .......... .......... 83% 314M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77500K .......... .......... .......... .......... .......... 83% 324M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77550K .......... .......... .......... .......... .......... 83% 266M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77600K .......... .......... .......... .......... .......... 83% 293M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77650K .......... .......... .......... .......... .......... 83% 337M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77700K .......... .......... .......... .......... .......... 83% 333M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77750K .......... .......... .......... .......... .......... 83% 251M 0s 2024-09-14T11:20:54.310 INFO:teuthology.orchestra.run.smithi002.stderr: 77800K .......... .......... .......... .......... .......... 83% 341M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 77850K .......... .......... .......... .......... .......... 83% 303M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 77900K .......... .......... .......... .......... .......... 83% 309M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 77950K .......... .......... .......... .......... .......... 83% 244M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78000K .......... .......... .......... .......... .......... 84% 393M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78050K .......... .......... .......... .......... .......... 84% 381M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78100K .......... .......... .......... .......... .......... 84% 89.1M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78150K .......... .......... .......... .......... .......... 84% 235M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78200K .......... .......... .......... .......... .......... 84% 318M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78250K .......... .......... .......... .......... .......... 84% 375M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78300K .......... .......... .......... .......... .......... 84% 383M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78350K .......... .......... .......... .......... .......... 84% 184M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78400K .......... .......... .......... .......... .......... 84% 287M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78450K .......... .......... .......... .......... .......... 84% 320M 0s 2024-09-14T11:20:54.311 INFO:teuthology.orchestra.run.smithi002.stderr: 78500K .......... .......... .......... .......... .......... 84% 347M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78550K .......... .......... .......... .......... .......... 84% 321M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78600K .......... .......... .......... .......... .......... 84% 289M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78650K .......... .......... .......... .......... .......... 84% 327M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78700K .......... .......... .......... .......... .......... 84% 365M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78750K .......... .......... .......... .......... .......... 84% 254M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78800K .......... .......... .......... .......... .......... 84% 299M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78850K .......... .......... .......... .......... .......... 84% 374M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78900K .......... .......... .......... .......... .......... 84% 376M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 78950K .......... .......... .......... .......... .......... 85% 192M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 79000K .......... .......... .......... .......... .......... 85% 371M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 79050K .......... .......... .......... .......... .......... 85% 291M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 79100K .......... .......... .......... .......... .......... 85% 313M 0s 2024-09-14T11:20:54.312 INFO:teuthology.orchestra.run.smithi002.stderr: 79150K .......... .......... .......... .......... .......... 85% 190M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79200K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79250K .......... .......... .......... .......... .......... 85% 308M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79300K .......... .......... .......... .......... .......... 85% 343M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79350K .......... .......... .......... .......... .......... 85% 298M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79400K .......... .......... .......... .......... .......... 85% 362M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79450K .......... .......... .......... .......... .......... 85% 223M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79500K .......... .......... .......... .......... .......... 85% 365M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79550K .......... .......... .......... .......... .......... 85% 208M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79600K .......... .......... .......... .......... .......... 85% 233M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79650K .......... .......... .......... .......... .......... 85% 327M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79700K .......... .......... .......... .......... .......... 85% 359M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79750K .......... .......... .......... .......... .......... 85% 283M 0s 2024-09-14T11:20:54.313 INFO:teuthology.orchestra.run.smithi002.stderr: 79800K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 79850K .......... .......... .......... .......... .......... 86% 388M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 79900K .......... .......... .......... .......... .......... 86% 33.5M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 79950K .......... .......... .......... .......... .......... 86% 132M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80000K .......... .......... .......... .......... .......... 86% 318M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80050K .......... .......... .......... .......... .......... 86% 341M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80100K .......... .......... .......... .......... .......... 86% 304M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80150K .......... .......... .......... .......... .......... 86% 273M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80200K .......... .......... .......... .......... .......... 86% 328M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80250K .......... .......... .......... .......... .......... 86% 372M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80300K .......... .......... .......... .......... .......... 86% 319M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80350K .......... .......... .......... .......... .......... 86% 310M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80400K .......... .......... .......... .......... .......... 86% 181M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80450K .......... .......... .......... .......... .......... 86% 277M 0s 2024-09-14T11:20:54.314 INFO:teuthology.orchestra.run.smithi002.stderr: 80500K .......... .......... .......... .......... .......... 86% 336M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80550K .......... .......... .......... .......... .......... 86% 317M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80600K .......... .......... .......... .......... .......... 86% 325M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80650K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80700K .......... .......... .......... .......... .......... 86% 336M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80750K .......... .......... .......... .......... .......... 86% 264M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80800K .......... .......... .......... .......... .......... 87% 338M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80850K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80900K .......... .......... .......... .......... .......... 87% 379M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 80950K .......... .......... .......... .......... .......... 87% 283M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 81000K .......... .......... .......... .......... .......... 87% 310M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 81050K .......... .......... .......... .......... .......... 87% 362M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 81100K .......... .......... .......... .......... .......... 87% 102M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 81150K .......... .......... .......... .......... .......... 87% 275M 0s 2024-09-14T11:20:54.315 INFO:teuthology.orchestra.run.smithi002.stderr: 81200K .......... .......... .......... .......... .......... 87% 295M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81250K .......... .......... .......... .......... .......... 87% 323M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81300K .......... .......... .......... .......... .......... 87% 113M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81350K .......... .......... .......... .......... .......... 87% 266M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81400K .......... .......... .......... .......... .......... 87% 307M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81450K .......... .......... .......... .......... .......... 87% 382M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81500K .......... .......... .......... .......... .......... 87% 364M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81550K .......... .......... .......... .......... .......... 87% 163M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81600K .......... .......... .......... .......... .......... 87% 308M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81650K .......... .......... .......... .......... .......... 87% 309M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81700K .......... .......... .......... .......... .......... 87% 357M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81750K .......... .......... .......... .......... .......... 88% 277M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81800K .......... .......... .......... .......... .......... 88% 255M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81850K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-14T11:20:54.316 INFO:teuthology.orchestra.run.smithi002.stderr: 81900K .......... .......... .......... .......... .......... 88% 370M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 81950K .......... .......... .......... .......... .......... 88% 278M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82000K .......... .......... .......... .......... .......... 88% 293M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82050K .......... .......... .......... .......... .......... 88% 385M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82100K .......... .......... .......... .......... .......... 88% 332M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82150K .......... .......... .......... .......... .......... 88% 260M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82200K .......... .......... .......... .......... .......... 88% 276M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82250K .......... .......... .......... .......... .......... 88% 356M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82300K .......... .......... .......... .......... .......... 88% 381M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82350K .......... .......... .......... .......... .......... 88% 277M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82400K .......... .......... .......... .......... .......... 88% 294M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82450K .......... .......... .......... .......... .......... 88% 345M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82500K .......... .......... .......... .......... .......... 88% 392M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82550K .......... .......... .......... .......... .......... 88% 240M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82600K .......... .......... .......... .......... .......... 88% 201M 0s 2024-09-14T11:20:54.317 INFO:teuthology.orchestra.run.smithi002.stderr: 82650K .......... .......... .......... .......... .......... 89% 314M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 82700K .......... .......... .......... .......... .......... 89% 292M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 82750K .......... .......... .......... .......... .......... 89% 321M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 82800K .......... .......... .......... .......... .......... 89% 401M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 82850K .......... .......... .......... .......... .......... 89% 39.9M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 82900K .......... .......... .......... .......... .......... 89% 245M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 82950K .......... .......... .......... .......... .......... 89% 333M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83000K .......... .......... .......... .......... .......... 89% 122M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83050K .......... .......... .......... .......... .......... 89% 170M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83100K .......... .......... .......... .......... .......... 89% 293M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83150K .......... .......... .......... .......... .......... 89% 249M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83200K .......... .......... .......... .......... .......... 89% 310M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83250K .......... .......... .......... .......... .......... 89% 373M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83300K .......... .......... .......... .......... .......... 89% 359M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83350K .......... .......... .......... .......... .......... 89% 276M 0s 2024-09-14T11:20:54.318 INFO:teuthology.orchestra.run.smithi002.stderr: 83400K .......... .......... .......... .......... .......... 89% 336M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83450K .......... .......... .......... .......... .......... 89% 357M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83500K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83550K .......... .......... .......... .......... .......... 89% 218M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83600K .......... .......... .......... .......... .......... 90% 306M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83650K .......... .......... .......... .......... .......... 90% 322M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83700K .......... .......... .......... .......... .......... 90% 349M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83750K .......... .......... .......... .......... .......... 90% 286M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83800K .......... .......... .......... .......... .......... 90% 358M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83850K .......... .......... .......... .......... .......... 90% 349M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83900K .......... .......... .......... .......... .......... 90% 96.1M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 83950K .......... .......... .......... .......... .......... 90% 277M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 84000K .......... .......... .......... .......... .......... 90% 379M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 84050K .......... .......... .......... .......... .......... 90% 318M 0s 2024-09-14T11:20:54.319 INFO:teuthology.orchestra.run.smithi002.stderr: 84100K .......... .......... .......... .......... .......... 90% 302M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84150K .......... .......... .......... .......... .......... 90% 351M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84200K .......... .......... .......... .......... .......... 90% 283M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84250K .......... .......... .......... .......... .......... 90% 309M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84300K .......... .......... .......... .......... .......... 90% 386M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84350K .......... .......... .......... .......... .......... 90% 172M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84400K .......... .......... .......... .......... .......... 90% 138M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84450K .......... .......... .......... .......... .......... 90% 296M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84500K .......... .......... .......... .......... .......... 91% 328M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84550K .......... .......... .......... .......... .......... 91% 281M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84600K .......... .......... .......... .......... .......... 91% 365M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84650K .......... .......... .......... .......... .......... 91% 221M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84700K .......... .......... .......... .......... .......... 91% 220M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84750K .......... .......... .......... .......... .......... 91% 261M 0s 2024-09-14T11:20:54.320 INFO:teuthology.orchestra.run.smithi002.stderr: 84800K .......... .......... .......... .......... .......... 91% 343M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 84850K .......... .......... .......... .......... .......... 91% 380M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 84900K .......... .......... .......... .......... .......... 91% 316M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 84950K .......... .......... .......... .......... .......... 91% 188M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85000K .......... .......... .......... .......... .......... 91% 333M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85050K .......... .......... .......... .......... .......... 91% 377M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85100K .......... .......... .......... .......... .......... 91% 326M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85150K .......... .......... .......... .......... .......... 91% 265M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85200K .......... .......... .......... .......... .......... 91% 295M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85250K .......... .......... .......... .......... .......... 91% 285M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85300K .......... .......... .......... .......... .......... 91% 272M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85350K .......... .......... .......... .......... .......... 91% 285M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85400K .......... .......... .......... .......... .......... 91% 350M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85450K .......... .......... .......... .......... .......... 92% 384M 0s 2024-09-14T11:20:54.321 INFO:teuthology.orchestra.run.smithi002.stderr: 85500K .......... .......... .......... .......... .......... 92% 265M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85550K .......... .......... .......... .......... .......... 92% 245M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85600K .......... .......... .......... .......... .......... 92% 371M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85650K .......... .......... .......... .......... .......... 92% 318M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85700K .......... .......... .......... .......... .......... 92% 334M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85750K .......... .......... .......... .......... .......... 92% 299M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85800K .......... .......... .......... .......... .......... 92% 37.8M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85850K .......... .......... .......... .......... .......... 92% 268M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85900K .......... .......... .......... .......... .......... 92% 384M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 85950K .......... .......... .......... .......... .......... 92% 295M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 86000K .......... .......... .......... .......... .......... 92% 317M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 86050K .......... .......... .......... .......... .......... 92% 300M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 86100K .......... .......... .......... .......... .......... 92% 115M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 86150K .......... .......... .......... .......... .......... 92% 237M 0s 2024-09-14T11:20:54.322 INFO:teuthology.orchestra.run.smithi002.stderr: 86200K .......... .......... .......... .......... .......... 92% 354M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86250K .......... .......... .......... .......... .......... 92% 381M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86300K .......... .......... .......... .......... .......... 92% 276M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86350K .......... .......... .......... .......... .......... 93% 245M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86400K .......... .......... .......... .......... .......... 93% 310M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86450K .......... .......... .......... .......... .......... 93% 377M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86500K .......... .......... .......... .......... .......... 93% 297M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86550K .......... .......... .......... .......... .......... 93% 233M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86600K .......... .......... .......... .......... .......... 93% 319M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86650K .......... .......... .......... .......... .......... 93% 296M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86700K .......... .......... .......... .......... .......... 93% 314M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86750K .......... .......... .......... .......... .......... 93% 302M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86800K .......... .......... .......... .......... .......... 93% 392M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86850K .......... .......... .......... .......... .......... 93% 389M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86900K .......... .......... .......... .......... .......... 93% 158M 0s 2024-09-14T11:20:54.323 INFO:teuthology.orchestra.run.smithi002.stderr: 86950K .......... .......... .......... .......... .......... 93% 277M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87000K .......... .......... .......... .......... .......... 93% 368M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87050K .......... .......... .......... .......... .......... 93% 161M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87100K .......... .......... .......... .......... .......... 93% 194M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87150K .......... .......... .......... .......... .......... 93% 306M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87200K .......... .......... .......... .......... .......... 93% 179M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87250K .......... .......... .......... .......... .......... 93% 351M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87300K .......... .......... .......... .......... .......... 94% 362M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87350K .......... .......... .......... .......... .......... 94% 236M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87400K .......... .......... .......... .......... .......... 94% 277M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87450K .......... .......... .......... .......... .......... 94% 379M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87500K .......... .......... .......... .......... .......... 94% 168M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87550K .......... .......... .......... .......... .......... 94% 211M 0s 2024-09-14T11:20:54.324 INFO:teuthology.orchestra.run.smithi002.stderr: 87600K .......... .......... .......... .......... .......... 94% 322M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 87650K .......... .......... .......... .......... .......... 94% 310M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 87700K .......... .......... .......... .......... .......... 94% 338M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 87750K .......... .......... .......... .......... .......... 94% 280M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 87800K .......... .......... .......... .......... .......... 94% 319M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 87850K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 87900K .......... .......... .......... .......... .......... 94% 330M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 87950K .......... .......... .......... .......... .......... 94% 270M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88000K .......... .......... .......... .......... .......... 94% 355M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88050K .......... .......... .......... .......... .......... 94% 321M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88100K .......... .......... .......... .......... .......... 94% 328M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88150K .......... .......... .......... .......... .......... 94% 298M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88200K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88250K .......... .......... .......... .......... .......... 95% 332M 0s 2024-09-14T11:20:54.325 INFO:teuthology.orchestra.run.smithi002.stderr: 88300K .......... .......... .......... .......... .......... 95% 355M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88350K .......... .......... .......... .......... .......... 95% 142M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88400K .......... .......... .......... .......... .......... 95% 342M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88450K .......... .......... .......... .......... .......... 95% 327M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88500K .......... .......... .......... .......... .......... 95% 281M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88550K .......... .......... .......... .......... .......... 95% 302M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88600K .......... .......... .......... .......... .......... 95% 341M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88650K .......... .......... .......... .......... .......... 95% 326M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88700K .......... .......... .......... .......... .......... 95% 347M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88750K .......... .......... .......... .......... .......... 95% 309M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88800K .......... .......... .......... .......... .......... 95% 40.4M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88850K .......... .......... .......... .......... .......... 95% 324M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88900K .......... .......... .......... .......... .......... 95% 305M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 88950K .......... .......... .......... .......... .......... 95% 320M 0s 2024-09-14T11:20:54.326 INFO:teuthology.orchestra.run.smithi002.stderr: 89000K .......... .......... .......... .......... .......... 95% 265M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89050K .......... .......... .......... .......... .......... 95% 315M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89100K .......... .......... .......... .......... .......... 95% 129M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89150K .......... .......... .......... .......... .......... 96% 244M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89200K .......... .......... .......... .......... .......... 96% 322M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89250K .......... .......... .......... .......... .......... 96% 310M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89300K .......... .......... .......... .......... .......... 96% 305M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89350K .......... .......... .......... .......... .......... 96% 144M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89400K .......... .......... .......... .......... .......... 96% 248M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89450K .......... .......... .......... .......... .......... 96% 282M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89500K .......... .......... .......... .......... .......... 96% 319M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89550K .......... .......... .......... .......... .......... 96% 262M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89600K .......... .......... .......... .......... .......... 96% 331M 0s 2024-09-14T11:20:54.327 INFO:teuthology.orchestra.run.smithi002.stderr: 89650K .......... .......... .......... .......... .......... 96% 362M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 89700K .......... .......... .......... .......... .......... 96% 332M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 89750K .......... .......... .......... .......... .......... 96% 299M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 89800K .......... .......... .......... .......... .......... 96% 344M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 89850K .......... .......... .......... .......... .......... 96% 323M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 89900K .......... .......... .......... .......... .......... 96% 314M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 89950K .......... .......... .......... .......... .......... 96% 300M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90000K .......... .......... .......... .......... .......... 96% 247M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90050K .......... .......... .......... .......... .......... 96% 153M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90100K .......... .......... .......... .......... .......... 97% 301M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90150K .......... .......... .......... .......... .......... 97% 322M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90200K .......... .......... .......... .......... .......... 97% 299M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90250K .......... .......... .......... .......... .......... 97% 278M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90300K .......... .......... .......... .......... .......... 97% 254M 0s 2024-09-14T11:20:54.328 INFO:teuthology.orchestra.run.smithi002.stderr: 90350K .......... .......... .......... .......... .......... 97% 243M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90400K .......... .......... .......... .......... .......... 97% 317M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90450K .......... .......... .......... .......... .......... 97% 345M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90500K .......... .......... .......... .......... .......... 97% 134M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90550K .......... .......... .......... .......... .......... 97% 189M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90600K .......... .......... .......... .......... .......... 97% 312M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90650K .......... .......... .......... .......... .......... 97% 309M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90700K .......... .......... .......... .......... .......... 97% 209M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90750K .......... .......... .......... .......... .......... 97% 154M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90800K .......... .......... .......... .......... .......... 97% 222M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90850K .......... .......... .......... .......... .......... 97% 298M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90900K .......... .......... .......... .......... .......... 97% 308M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 90950K .......... .......... .......... .......... .......... 97% 340M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 91000K .......... .......... .......... .......... .......... 98% 320M 0s 2024-09-14T11:20:54.329 INFO:teuthology.orchestra.run.smithi002.stderr: 91050K .......... .......... .......... .......... .......... 98% 316M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91100K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91150K .......... .......... .......... .......... .......... 98% 274M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91200K .......... .......... .......... .......... .......... 98% 383M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91250K .......... .......... .......... .......... .......... 98% 344M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91300K .......... .......... .......... .......... .......... 98% 288M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91350K .......... .......... .......... .......... .......... 98% 273M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91400K .......... .......... .......... .......... .......... 98% 320M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91450K .......... .......... .......... .......... .......... 98% 299M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91500K .......... .......... .......... .......... .......... 98% 266M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91550K .......... .......... .......... .......... .......... 98% 269M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91600K .......... .......... .......... .......... .......... 98% 317M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91650K .......... .......... .......... .......... .......... 98% 359M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91700K .......... .......... .......... .......... .......... 98% 385M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91750K .......... .......... .......... .......... .......... 98% 353M 0s 2024-09-14T11:20:54.330 INFO:teuthology.orchestra.run.smithi002.stderr: 91800K .......... .......... .......... .......... .......... 98% 49.1M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 91850K .......... .......... .......... .......... .......... 98% 303M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 91900K .......... .......... .......... .......... .......... 98% 330M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 91950K .......... .......... .......... .......... .......... 99% 251M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92000K .......... .......... .......... .......... .......... 99% 255M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92050K .......... .......... .......... .......... .......... 99% 330M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92100K .......... .......... .......... .......... .......... 99% 386M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92150K .......... .......... .......... .......... .......... 99% 317M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92200K .......... .......... .......... .......... .......... 99% 60.5M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92250K .......... .......... .......... .......... .......... 99% 325M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92300K .......... .......... .......... .......... .......... 99% 332M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92350K .......... .......... .......... .......... .......... 99% 342M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92400K .......... .......... .......... .......... .......... 99% 290M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92450K .......... .......... .......... .......... .......... 99% 323M 0s 2024-09-14T11:20:54.331 INFO:teuthology.orchestra.run.smithi002.stderr: 92500K .......... .......... .......... .......... .......... 99% 371M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92550K .......... .......... .......... .......... .......... 99% 382M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92600K .......... .......... .......... .......... .......... 99% 378M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92650K .......... .......... .......... .......... .......... 99% 388M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92700K .......... .......... .......... .......... .......... 99% 258M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92750K .......... .......... .......... .......... .......... 99% 326M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92800K .......... .......... .......... .......... .......... 99% 298M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92850K .......... .......... .......... .......... .......... 99% 392M 0s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 92900K 100% 134G=0.5s 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14 11:20:53 (201 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-14T11:20:54.332 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:20:54.370 INFO:teuthology.orchestra.run.smithi002.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-14T11:20:54.370 INFO:teuthology.orchestra.run.smithi002.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-14T11:20:54.370 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-14T11:20:54.370 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-14T11:20:54.370 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-14T11:20:54.371 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-14T11:20:54.372 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-14T11:20:54.373 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-14T11:20:54.374 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-14T11:20:54.375 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-14T11:20:54.376 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-14T11:20:54.377 INFO:teuthology.orchestra.run.smithi002.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-14T11:20:54.378 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-14T11:20:54.379 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-14T11:20:54.380 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-14T11:20:54.381 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-14T11:20:54.382 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-14T11:20:54.383 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-14T11:20:54.384 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-14T11:20:54.385 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout:Welcome to Gradle 6.0.1! 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout:Here are the highlights of this release: 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: - Substantial improvements in dependency management, including 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-14T11:20:54.386 INFO:teuthology.orchestra.run.smithi002.stdout: - Advanced control of transitive versions 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: - Support for optional features and dependencies 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: - Rules to tweak published metadata 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: - Support for Java 13 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: - Faster incremental Java and Groovy compilation 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: - New Zinc compiler for Scala 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: - VS2019 support 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout:------------------------------------------------------------ 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout:Gradle 6.0.1 2024-09-14T11:20:54.387 INFO:teuthology.orchestra.run.smithi002.stdout:------------------------------------------------------------ 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout:Kotlin: 1.3.50 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout:Groovy: 2.5.8 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-14T11:20:54.388 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.388 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-14T11:20:54.388 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-14T11:20:54.388 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T11:20:54.389 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-14T11:20:54.389 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T11:20:54.389 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-14T11:20:54.619 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-14T11:20:54.620 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-14T11:20:54.620 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'VEZPFXEBUYOGLTGUXZRK', 'access_secret': 'uOXda1rZc+JL+Ai1uPgz+AZdJjnxSZ1hJCrywj1CqYo+OSmR5R/Tqg==', 'region': 'mexico', 'endpoint': 'smithi002.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi002.front.sepia.ceph.com'} 2024-09-14T11:20:54.620 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-14T11:20:54.620 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'VEZPFXEBUYOGLTGUXZRK', '--secret', 'uOXda1rZc+JL+Ai1uPgz+AZdJjnxSZ1hJCrywj1CqYo+OSmR5R/Tqg==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-14T11:20:54.620 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key VEZPFXEBUYOGLTGUXZRK --secret uOXda1rZc+JL+Ai1uPgz+AZdJjnxSZ1hJCrywj1CqYo+OSmR5R/Tqg== --email tester.client.0_test@test.test --cluster ceph 2024-09-14T11:20:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:54.686 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:54.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.724+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 20 realm 2024-09-14T11:20:54.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.726+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.727+0000 7f76f6d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.727+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.728+0000 7f76f6d22800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:54.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.728+0000 7f76f6d22800 20 searching for the correct realm 2024-09-14T11:20:54.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.732+0000 7f76f2267640 0 -- 172.21.15.2:0/2096212164 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x5612480bb9a0 msgr2=0x5612480bde10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:54.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.735+0000 7f76f2267640 0 -- 172.21.15.2:0/2096212164 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f76e408d060 msgr2=0x7f76e406f820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.739+0000 7f76f6d22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.739+0000 7f76f6d22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.739+0000 7f76f6d22800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.739+0000 7f76f6d22800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.739+0000 7f76f6d22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.739+0000 7f76f6d22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.739+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:54.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 zone default found 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 4 Realm: () 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 zonegroup default 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.740+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.741+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.741+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.741+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.741+0000 7f76f6d22800 20 started sync module instance, tier type = 2024-09-14T11:20:54.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.741+0000 7f76f6d22800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.751+0000 7f76f6d22800 20 add_watcher() i=0 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.751+0000 7f76f6d22800 20 add_watcher() i=1 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.751+0000 7f76f6d22800 20 add_watcher() i=2 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.751+0000 7f76f6d22800 20 add_watcher() i=3 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.751+0000 7f76f6d22800 20 add_watcher() i=4 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.751+0000 7f76f6d22800 20 add_watcher() i=5 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.751+0000 7f76f6d22800 20 add_watcher() i=6 2024-09-14T11:20:54.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.752+0000 7f76f6d22800 20 add_watcher() i=7 2024-09-14T11:20:54.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.752+0000 7f76f6d22800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.753+0000 7f75a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.753+0000 7f76f6d22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.753+0000 7f76f6d22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.754+0000 7f76f6d22800 5 note: GC not initialized 2024-09-14T11:20:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.754+0000 7f7523fff640 20 reqs_thread_entry: start 2024-09-14T11:20:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.754+0000 7f76f6d22800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:54.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.754+0000 7f76f6d22800 20 Filter name: none 2024-09-14T11:20:54.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.754+0000 7f7521ffb640 20 reqs_thread_entry: start 2024-09-14T11:20:54.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.754+0000 7f76f6d22800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:20:54.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.754+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 cache get: name=default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK : miss 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 20 rados->read ofs=0 len=0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 cache put: name=default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK info.flags=0x0 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 adding default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK to cache LRU end 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 cache get: name=default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK : hit (negative entry) 2024-09-14T11:20:54.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.755+0000 7f76f6d22800 10 cache get: name=default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK : hit (negative entry) 2024-09-14T11:20:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.757+0000 7f76f6d22800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:20:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.757+0000 7f76f6d22800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:20:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.757+0000 7f76f6d22800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:20:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.757+0000 7f75d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464322 cookie 94636518194512 notifier 8258 bl.length()=670 2024-09-14T11:20:54.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.757+0000 7f75d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-14T11:20:54.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.757+0000 7f75d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:20:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.759+0000 7f76f6d22800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:20:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.759+0000 7f76f6d22800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:20:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.759+0000 7f76f6d22800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:20:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.759+0000 7f75d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464336 cookie 94636518185472 notifier 8258 bl.length()=200 2024-09-14T11:20:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.759+0000 7f75d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-14T11:20:54.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.759+0000 7f75d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-14T11:20:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.761+0000 7f76f6d22800 10 cache put: name=default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK info.flags=0x7 2024-09-14T11:20:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.761+0000 7f76f6d22800 10 moving default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK to cache LRU end 2024-09-14T11:20:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.761+0000 7f76f6d22800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:VEZPFXEBUYOGLTGUXZRK, ofs0, ns] 2024-09-14T11:20:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.761+0000 7f75d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464398 cookie 94636518178896 notifier 8258 bl.length()=189 2024-09-14T11:20:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.761+0000 7f75d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK info.flags=0x7 2024-09-14T11:20:54.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.761+0000 7f75d67fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VEZPFXEBUYOGLTGUXZRK to cache LRU end 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "tester.client.0", 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Ms. tester.client.0", 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "tester.client.0_test@test.test", 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "tester.client.0", 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "VEZPFXEBUYOGLTGUXZRK", 2024-09-14T11:20:54.760 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "uOXda1rZc+JL+Ai1uPgz+AZdJjnxSZ1hJCrywj1CqYo+OSmR5R/Tqg==", 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:20:54.756580Z" 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:20:54.761 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "rgw", 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "", 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:20:54.756566Z", 2024-09-14T11:20:54.762 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:20:54.763 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:20:54.763 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:20:54.763 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:20:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.762+0000 7f75a97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.764+0000 7f76f6d22800 20 remove_watcher() i=0 2024-09-14T11:20:54.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.764+0000 7f76f6d22800 2 removed watcher, disabling cache 2024-09-14T11:20:54.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.766+0000 7f76f6d22800 20 remove_watcher() i=1 2024-09-14T11:20:54.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.768+0000 7f76f6d22800 20 remove_watcher() i=2 2024-09-14T11:20:54.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.768+0000 7f76f6d22800 20 remove_watcher() i=3 2024-09-14T11:20:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.770+0000 7f76f6d22800 20 remove_watcher() i=4 2024-09-14T11:20:54.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.771+0000 7f76f6d22800 20 remove_watcher() i=5 2024-09-14T11:20:54.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.772+0000 7f76f6d22800 20 remove_watcher() i=6 2024-09-14T11:20:54.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:54.773+0000 7f76f6d22800 20 remove_watcher() i=7 2024-09-14T11:20:54.783 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:20:54.783 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-14T11:20:54.815 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-14T11:20:54.815 DEBUG:teuthology.orchestra.run.smithi002:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-14T11:20:54.883 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:20:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:54.977 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:55.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.019+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.020+0000 7f60e5f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.020+0000 7f60e5f39800 20 realm 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.020+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.021+0000 7f60e5f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.021+0000 7f60e5f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.021+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.021+0000 7f60e5f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.021+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.022+0000 7f60e5f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.022+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.022+0000 7f60e5f39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:55.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.022+0000 7f60e5f39800 20 searching for the correct realm 2024-09-14T11:20:55.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.026+0000 7f60e13c6640 0 -- 172.21.15.2:0/2483886429 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f60d407f290 msgr2=0x7f60d4067740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:20:55.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.031+0000 7f60e13c6640 0 -- 172.21.15.2:0/2483886429 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f5fac087130 msgr2=0x7f5fac089560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:55.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:55.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:55.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:55.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:55.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:55.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.035+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 zone default found 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 4 Realm: () 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 zonegroup default 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 started sync module instance, tier type = 2024-09-14T11:20:55.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.036+0000 7f60e5f39800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.048+0000 7f60e5f39800 20 add_watcher() i=0 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.048+0000 7f60e5f39800 20 add_watcher() i=1 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.048+0000 7f60e5f39800 20 add_watcher() i=2 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.048+0000 7f60e5f39800 20 add_watcher() i=3 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.048+0000 7f60e5f39800 20 add_watcher() i=4 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.048+0000 7f60e5f39800 20 add_watcher() i=5 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.048+0000 7f60e5f39800 20 add_watcher() i=6 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.049+0000 7f60e5f39800 20 add_watcher() i=7 2024-09-14T11:20:55.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.049+0000 7f60e5f39800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:55.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.051+0000 7f5f937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.051+0000 7f60e5f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:55.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.051+0000 7f60e5f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.087+0000 7f5f927fc640 20 reqs_thread_entry: start 2024-09-14T11:20:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.087+0000 7f60e5f39800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:55.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.087+0000 7f60e5f39800 20 Filter name: none 2024-09-14T11:20:55.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.087+0000 7f5f03fff640 20 reqs_thread_entry: start 2024-09-14T11:20:55.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.087+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:20:55.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:20:55.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12453491970733656796', time=2024-09-14T13:12:09.809192+0000, chain.objs.size()=1 2024-09-14T11:20:55.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.dG2P3XbqwRWbMOWa2N-5j7yiQUPgqU3_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18212379729927954137', time=2024-09-14T13:12:09.817631+0000, chain.objs.size()=1 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.ji7vh_a9kkDrqvJIO6q0CMr7jn0gLK3_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15958432582078233852', time=2024-09-14T13:12:09.839318+0000, chain.objs.size()=1 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.k7F4fbQ47L7BMxqvMB1EQ1yq4QXuACY_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4793071143775487310', time=2024-09-14T13:12:10.104737+0000, chain.objs.size()=1 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.KwZ0FuwsFMaXodcq7cZFTuevgw483b7_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5203235677196896724', time=2024-09-14T13:13:40.312909+0000, chain.objs.size()=1 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.089+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.QtsJOvLIUT7E746A2BPUR9JX49Ge59T_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12685656930451444242', time=2024-09-14T13:14:15.658738+0000, chain.objs.size()=1 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.YOfFzhR3YIUgnjNuoUyK1-dkCl28uy9_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12017304860051372576', time=2024-09-14T13:14:49.234999+0000, chain.objs.size()=1 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.DVzQ6TMhGUdqogORIqdGgZR1hac08n6_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10375197872234958156', time=2024-09-14T13:14:49.773365+0000, chain.objs.size()=1 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.6j49HGD4NfD4ppyOC5z4_nlh0BTb3um_0 2024-09-14T11:20:55.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6603354632345327871', time=2024-09-14T13:15:24.179246+0000, chain.objs.size()=1 2024-09-14T11:20:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.RKrEcjW5D5F_S6-A6JCNFUTkv-JjZil_0 2024-09-14T11:20:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.978129725881946489', time=2024-09-14T13:15:26.367154+0000, chain.objs.size()=1 2024-09-14T11:20:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.h9RIXil-yDA0ixDXjIFdkJgARmHsOB1_0 2024-09-14T11:20:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15949719504867234177', time=2024-09-14T13:16:00.692966+0000, chain.objs.size()=1 2024-09-14T11:20:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.dOxicFQIXdzmRZG_ltaHQwOeVyebQY4_0 2024-09-14T11:20:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2678299546744850081', time=2024-09-14T13:16:01.954039+0000, chain.objs.size()=1 2024-09-14T11:20:55.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.090+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.eVocrzMGWzrG5iohHFFllsZ3CTFTOA0_0 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.091+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5400639727837482409', time=2024-09-14T13:16:33.753769+0000, chain.objs.size()=1 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.091+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.Zl-8dx3ui_Nh__6SDSrZd39jGSgarZ-_0 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12750726675221428736', time=2024-09-14T13:17:07.088350+0000, chain.objs.size()=1 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.YlbIxt4ztKqsfqR0TzViuIblEvXlQ8D_0 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14668470835208441055', time=2024-09-14T13:17:42.763035+0000, chain.objs.size()=1 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.KhPVdKxGJTL1OSdiDklfhxafUsfM1Yv_0 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7618859183381014445', time=2024-09-14T13:18:16.143615+0000, chain.objs.size()=1 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.vm-GwIRqu6RrpwewIBqlCtltNp3DuVO_0 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13068099706943448106', time=2024-09-14T13:18:16.149557+0000, chain.objs.size()=1 2024-09-14T11:20:55.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.BcjzpXIfi36TjNxG9Q63WYzjHDq96Zv_0 2024-09-14T11:20:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15623353310335116254', time=2024-09-14T13:18:16.155453+0000, chain.objs.size()=1 2024-09-14T11:20:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.092+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.rKs9y_l1ZGeGs3dMZXK1DDjIcuHEtMN_0 2024-09-14T11:20:55.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.093+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.096+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:20:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.097+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.097+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=18, truncated=0, next_marker='' 2024-09-14T11:20:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17577506893089656642', time=2024-09-14T13:12:09.813147+0000, chain.objs.size()=1 2024-09-14T11:20:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.2V-iTigtsAgt1qRJ1MBoxTBlqpbAaun_0 2024-09-14T11:20:55.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12717773912133260198', time=2024-09-14T13:12:10.065140+0000, chain.objs.size()=1 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.039AcW6MSFocxnLvtjb9VnK1yhFnVo-_0 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11006959141979224566', time=2024-09-14T13:14:12.861360+0000, chain.objs.size()=1 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.2My5-QN8CEnzoisz_BQpVlvqQAvGJZb_0 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10658352779914322839', time=2024-09-14T13:14:14.817209+0000, chain.objs.size()=1 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.jKwNrQBEIJNM4WbZhhyy47WuqFj6QcX_0 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14998850411732405554', time=2024-09-14T13:14:17.088774+0000, chain.objs.size()=1 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.uKbOM8QHvJN63_tUN16kpxi0WEATGwc_0 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17802647557067764925', time=2024-09-14T13:14:47.977094+0000, chain.objs.size()=1 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.XIGtiVk3ytiGL_Y8xfcQrFeOMW3C5Bj_0 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9976469987769217827', time=2024-09-14T13:14:47.978078+0000, chain.objs.size()=1 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.wuVa2SvLxTXimu2sp3OZc_hWLn3yYsF_0 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9401251898145813351', time=2024-09-14T13:14:51.828974+0000, chain.objs.size()=1 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.loY-81NDR_Y_B1_TClqk3iIF65dLRjZ_0 2024-09-14T11:20:55.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9879501651376002018', time=2024-09-14T13:15:24.177116+0000, chain.objs.size()=1 2024-09-14T11:20:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.Im4LJIkPAlLWlypjotgO3WFJQe1Upxo_0 2024-09-14T11:20:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6213846398972462193', time=2024-09-14T13:15:24.187668+0000, chain.objs.size()=1 2024-09-14T11:20:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.6ulLBoTixngKlShRmqTKKw4J_y-P0GB_0 2024-09-14T11:20:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16051533134862832838', time=2024-09-14T13:16:00.689687+0000, chain.objs.size()=1 2024-09-14T11:20:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.zkY_c1PJOBje3SBLpa7Zdj5gFxWVnlR_0 2024-09-14T11:20:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10533088170090477684', time=2024-09-14T13:16:01.948789+0000, chain.objs.size()=1 2024-09-14T11:20:55.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.098+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.C1tNqr3wBPEBO40aSrAbdxD8kNhgQkC_0 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17314479620239800708', time=2024-09-14T13:16:33.744988+0000, chain.objs.size()=1 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.tgxxIXSWLk5gaJlCNPcMtA6i7qtaN6r_0 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15073975722146662173', time=2024-09-14T13:16:35.142041+0000, chain.objs.size()=1 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.jlJ7h3WUkC_NE8FHlkySmbfM_ye84Re_0 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1589542642847611651', time=2024-09-14T13:17:07.081388+0000, chain.objs.size()=1 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.RE45tBTGPMwkPAbz4XM_8TlvZ1DC1z9_0 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.838482957628396230', time=2024-09-14T13:17:07.084553+0000, chain.objs.size()=1 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.Nk5SU3FOKJu70R6MDmOYCfDfkaArGJL_0 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17139293521239812542', time=2024-09-14T13:17:09.076422+0000, chain.objs.size()=1 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.WwDkVbs1MtDEKkg90j-w5TxtY9p5m3x_0 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14419343362121506471', time=2024-09-14T13:17:42.767687+0000, chain.objs.size()=1 2024-09-14T11:20:55.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.100+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_._OY_0i8ZfQyJ9jdYEtzSfqSzvmeiMRx_0 2024-09-14T11:20:55.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.102+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.104+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:20:55.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.105+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3306364220879110563', time=2024-09-14T13:12:10.112389+0000, chain.objs.size()=1 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.oTI-aep3Yi1I4TRqIT96_YitR6-gao2_0 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9810485842310871139', time=2024-09-14T13:13:40.308395+0000, chain.objs.size()=1 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.mmCKSQEZk6UnZKERtGYduy23ZbIuuah_0 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3255940006141904352', time=2024-09-14T13:14:14.815688+0000, chain.objs.size()=1 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.coieNAHdji7qw4s65j2z-p1fqHNw1Kv_0 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4740504193888635052', time=2024-09-14T13:14:51.838101+0000, chain.objs.size()=1 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.U5xhn7j60r5wEMM3b3sEZ0KOjLQFSSA_0 2024-09-14T11:20:55.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5137747773286187717', time=2024-09-14T13:14:51.838896+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.MR2YUlkxFjwZQl69wgHJwRvUatxvqmy_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18175167889321111293', time=2024-09-14T13:15:24.179154+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.KZVs_Q1laW7T-hAM5-q2wzv1l6RzYEa_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9795259104165474318', time=2024-09-14T13:16:00.689762+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.NUNgdtvJn7ICFMBQk89tr8YwC0L4FbO_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1007432700279999493', time=2024-09-14T13:16:00.692421+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.KtfmAPuK_IJ_JE4iqfxhgdVfZNNF7mO_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2530389250435162967', time=2024-09-14T13:16:00.697341+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.XfVncsvNKlunUkBPF7OR5mk4Hv2TPl1_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15716683628488199422', time=2024-09-14T13:17:07.085224+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.1xY174yxOxBusi_UHKvt4OYE1n-R2B5_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2552490496163625395', time=2024-09-14T13:17:40.995672+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.73Q0Q8oyIi8t77ifTtW15vQO8POYQ5w_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11065769865681026389', time=2024-09-14T13:17:41.001853+0000, chain.objs.size()=1 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.106+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.KlRIwL2IeZL_evlwnjqp97lhN3qQOva_0 2024-09-14T11:20:55.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.108+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10731925784658530743', time=2024-09-14T13:17:42.769275+0000, chain.objs.size()=1 2024-09-14T11:20:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.108+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_._cAEukURqqI7QEjwtfrS6UmentaK2os_0 2024-09-14T11:20:55.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.109+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.111+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:20:55.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.112+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:20:55.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13687142439614039382', time=2024-09-14T13:14:47.964022+0000, chain.objs.size()=1 2024-09-14T11:20:55.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.Zdbnps9KU-99syoZxSzpZ40RdET9SCw_0 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10312643125375645900', time=2024-09-14T13:16:00.694484+0000, chain.objs.size()=1 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.NwNwVAnl5T8K9YGWGzJppJajNGwlebW_0 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5149980831374904082', time=2024-09-14T13:16:35.150596+0000, chain.objs.size()=1 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.3aqKKW5ZG8wXsbTic4Ni3RY-0lWwUV7_0 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11266007566792018617', time=2024-09-14T13:17:09.072611+0000, chain.objs.size()=1 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.MIxsghTgO6R2Dn76RyYorb6iWzzBDwC_0 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15727743122676793576', time=2024-09-14T13:17:40.999855+0000, chain.objs.size()=1 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.uuHPUhip4lApxldUHMrUbejT1Yk5tKp_0 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7235440376523056669', time=2024-09-14T13:17:42.767376+0000, chain.objs.size()=1 2024-09-14T11:20:55.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.113+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.q5MZLI_90j9OJ5QmYJOcyxVFwP9GYfi_0 2024-09-14T11:20:55.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.115+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.117+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:20:55.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.118+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12850942232017324346', time=2024-09-14T13:12:09.874413+0000, chain.objs.size()=4 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.1 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.2 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.3 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.12__multipart_foo.2~TOtRAFvLB1jQpem-DAEc6MpV270XHrI.4 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3884883169024026227', time=2024-09-14T13:12:09.907915+0000, chain.objs.size()=4 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.1 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.2 2024-09-14T11:20:55.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.3 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.9__multipart_foo.2~S1rG8MvK262Iw-FSPNocsaK9sVaYkaa.4 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_XB6qxRpfAXGHC2iH10omIAVE4prAZsq', time=2024-09-14T13:12:09.987794+0000, chain.objs.size()=2 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.rXnJYGHZXOcFLz8HrkdblJfXO2uP2Ua_0 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.rXnJYGHZXOcFLz8HrkdblJfXO2uP2Ua_1 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12610645877798789488', time=2024-09-14T13:13:40.309304+0000, chain.objs.size()=1 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.tHACArubs8vLDsW0OgG1qswD-vrzXF8_0 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15182010130522359675', time=2024-09-14T13:14:12.855754+0000, chain.objs.size()=1 2024-09-14T11:20:55.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.119+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.G4RI8NOUm2nkRBI1m6Az3GeWhPZE33x_0 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6140122558091436475', time=2024-09-14T13:14:15.666040+0000, chain.objs.size()=1 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.EYhhGkK3MvOPTkGDdbGeapdV8kc-6o8_0 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10267747599015013437', time=2024-09-14T13:14:15.666778+0000, chain.objs.size()=1 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.v2CcHDNXu8q8px8mnnGmrDbky4Ygy8M_0 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4102607837474829053', time=2024-09-14T13:14:15.670660+0000, chain.objs.size()=1 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.034-lZycPx8iOS9CG5JRL5YpMD127sZ_0 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12303293087486074040', time=2024-09-14T13:14:47.971850+0000, chain.objs.size()=1 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.gix1FYSUhLoYgSGnkHrG5txFS-pYDw5_0 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1777432139043081301', time=2024-09-14T13:14:51.838377+0000, chain.objs.size()=1 2024-09-14T11:20:55.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.121+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.lFrR8nZPsmD-nnYhdmVxWp-1wIAHt97_0 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6623328619959925829', time=2024-09-14T13:15:26.366271+0000, chain.objs.size()=1 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.G8jonMwkHRuIuX2dp_4GbBCfKznWRxC_0 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5527854643885348481', time=2024-09-14T13:15:58.721343+0000, chain.objs.size()=1 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.QH0pmfAH-s_84yhM-sXgflvuBkpj3XW_0 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5362912785624432114', time=2024-09-14T13:16:33.755506+0000, chain.objs.size()=1 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.3EANTO0znvNngTFxEUkGDvYbGfTWgDy_0 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17668106977951648388', time=2024-09-14T13:17:42.761263+0000, chain.objs.size()=1 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.122+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.S1BPPDWD7YT3cP49mjq2gs3VgQJxge1_0 2024-09-14T11:20:55.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.123+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4604128934267871217', time=2024-09-14T13:17:42.772020+0000, chain.objs.size()=1 2024-09-14T11:20:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.123+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.wFsL9DBuFB4WRFCnTMm4YdpIpCHQ9Wp_0 2024-09-14T11:20:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.123+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15102509066742316807', time=2024-09-14T13:18:16.154364+0000, chain.objs.size()=1 2024-09-14T11:20:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.123+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.jZf62BiBDlaFSfCIGTrqmJrUn_qaxXS_0 2024-09-14T11:20:55.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.124+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.126+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:20:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.127+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:20:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4019728867152022263', time=2024-09-14T13:12:09.939142+0000, chain.objs.size()=1 2024-09-14T11:20:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.M10HvagiBusDZ60MBoVKtPTpcHmbX2G_0 2024-09-14T11:20:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.857608590221489291', time=2024-09-14T13:13:40.306277+0000, chain.objs.size()=1 2024-09-14T11:20:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.YZ-VvJMhr_V7FlIaLMWvet7ZJFCxNaf_0 2024-09-14T11:20:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13284995399416850713', time=2024-09-14T13:14:12.853042+0000, chain.objs.size()=1 2024-09-14T11:20:55.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.iG3Wgd10JjCL7gZZf8plRxJ3yiKo1xb_0 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9023626063955178220', time=2024-09-14T13:14:14.820326+0000, chain.objs.size()=1 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.Gv0p4S2Gpz8u_KqcmwOexdH-BRLczH9_0 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13107601341383457984', time=2024-09-14T13:15:26.361394+0000, chain.objs.size()=1 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.wWUi58vpYgXE7ZTjpknO_3msbPTsjOS_0 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11110704283274879488', time=2024-09-14T13:17:08.334576+0000, chain.objs.size()=1 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.yufjcQdLnrGlsJoJwjrt5tuV_pPKMlu_0 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8821876943435261944', time=2024-09-14T13:17:09.070700+0000, chain.objs.size()=1 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.xE4FPKcxqSiVHcpg5b1Ofpc0VGhh2Yz_0 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.162990826181759142', time=2024-09-14T13:17:09.071305+0000, chain.objs.size()=1 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.9a2htEPNI43NVI7keexibqfgoHgOG2d_0 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15732069977457281821', time=2024-09-14T13:17:40.999074+0000, chain.objs.size()=1 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.xuQny1OniAshWLNBS84kEwZPIhNf40p_0 2024-09-14T11:20:55.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11828458362491479853', time=2024-09-14T13:17:42.761205+0000, chain.objs.size()=1 2024-09-14T11:20:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.0mFEkH9fQ1rU3WfBtL111YsUTyZqM4O_0 2024-09-14T11:20:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14090383365002076216', time=2024-09-14T13:17:42.763268+0000, chain.objs.size()=1 2024-09-14T11:20:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.KT8zVA3zQC6CTfnpGnQRK87TY-2UcWA_0 2024-09-14T11:20:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11799215799428670192', time=2024-09-14T13:18:16.151788+0000, chain.objs.size()=1 2024-09-14T11:20:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.128+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.OXgjk59mJCRWb-WSPEbDqt349_3PVM2_0 2024-09-14T11:20:55.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.131+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.133+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:20:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.134+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.134+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5238278203041020352', time=2024-09-14T13:12:09.946293+0000, chain.objs.size()=1 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.M10HvagiBusDZ60MBoVKtPTpcHmbX2G_0 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2212497560846202784', time=2024-09-14T13:12:09.980476+0000, chain.objs.size()=3 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.1 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.2 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.3 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3902453347711406475', time=2024-09-14T13:12:10.043492+0000, chain.objs.size()=3 2024-09-14T11:20:55.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-STANDARD.2~NdtmLmfPfFeM1AW0KSlX_hhleGlL5qT.1 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-STANDARD.2~NdtmLmfPfFeM1AW0KSlX_hhleGlL5qT.2 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-STANDARD.2~NdtmLmfPfFeM1AW0KSlX_hhleGlL5qT.3 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4110675571472164539', time=2024-09-14T13:13:40.306493+0000, chain.objs.size()=1 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.-o1w0UW0835TvfFMslYDw8HccRuT5aF_0 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10570673297816096412', time=2024-09-14T13:14:12.857685+0000, chain.objs.size()=1 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.Yu6Kx10AC5rP49vLTqK8tYCQlpdzl0R_0 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1634975931239231621', time=2024-09-14T13:14:12.864170+0000, chain.objs.size()=1 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.cAwv21eAZ1dWFBlbTRtrcj4m7mav5Tr_0 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.823042238242844777', time=2024-09-14T13:14:15.667447+0000, chain.objs.size()=1 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.CIBO_tIhzaFG98hwdsjvGZCRQ7Rcfk2_0 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12433027700175620320', time=2024-09-14T13:15:24.183861+0000, chain.objs.size()=1 2024-09-14T11:20:55.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.135+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.pXZIxAxiyUcnrOe3iB-MMU1oUi98QHF_0 2024-09-14T11:20:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3567549767275349713', time=2024-09-14T13:15:58.726978+0000, chain.objs.size()=1 2024-09-14T11:20:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.nHQWsLiwYSJ5YaAWI654ulRzIX3DM0S_0 2024-09-14T11:20:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13016379121345197620', time=2024-09-14T13:16:01.955522+0000, chain.objs.size()=1 2024-09-14T11:20:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.qc42bGqAwXr3u93sRAHzn-2O7H0i2of_0 2024-09-14T11:20:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16253187952195339719', time=2024-09-14T13:16:35.144663+0000, chain.objs.size()=1 2024-09-14T11:20:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.6W2cXTLLDCG3TXCx2JCNk2wKAYI0SKB_0 2024-09-14T11:20:55.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7511798389433244424', time=2024-09-14T13:17:09.066081+0000, chain.objs.size()=1 2024-09-14T11:20:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.TjvHbCOOJbUk2OyUfaXrWOzi4CCK19K_0 2024-09-14T11:20:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4937399929024461572', time=2024-09-14T13:17:42.242212+0000, chain.objs.size()=1 2024-09-14T11:20:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.138+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.RVPHbpTJv04Nck0aUHU52SWcYWI_J2w_0 2024-09-14T11:20:55.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.139+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.142+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:20:55.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.143+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.143+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_lccKa-0lWSysluseNWsHziYWzfpvcm1', time=2024-09-14T13:12:09.991611+0000, chain.objs.size()=2 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.k7X6Z-SV_-wCIyRM4LKcDGf6sPK5ozr_0 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.k7X6Z-SV_-wCIyRM4LKcDGf6sPK5ozr_1 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_HhYbNT60iMMKk1YWKkFW3Dx8WjG5sXY', time=2024-09-14T13:12:09.999211+0000, chain.objs.size()=2 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.Q2_uXbd-CptCQnVjEbU-Ktfjg15xHOd_0 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.Q2_uXbd-CptCQnVjEbU-Ktfjg15xHOd_1 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_FCur7RyL_x_Csc4LMq08OdCTu2LrePM', time=2024-09-14T13:12:10.013982+0000, chain.objs.size()=1 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.eA03TOnf3jix1O2v3DSTMuR6WWU8jqr_0 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2815512037334755466', time=2024-09-14T13:13:39.261955+0000, chain.objs.size()=1 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.yPY1D9IruTn7yYdLTj01Cmau4FKLQ7V_0 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6026077199309885050', time=2024-09-14T13:14:12.852518+0000, chain.objs.size()=1 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.bakj10gisE7EvExX15ONci1n-oJRoZk_0 2024-09-14T11:20:55.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12303845381652610192', time=2024-09-14T13:14:14.814884+0000, chain.objs.size()=1 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.6J7VKBXa7rxNBqhZi-Uep-HK_FlmXkf_0 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.397589638358068156', time=2024-09-14T13:14:47.969206+0000, chain.objs.size()=1 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.lz5SumTGBwtfjjJkV7rzyPCp24kgUvt_0 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11396914701843967403', time=2024-09-14T13:14:51.831248+0000, chain.objs.size()=1 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.3pnFn_WDRdnhFHKIZTTFOthAWvzyMeH_0 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3957178073841043980', time=2024-09-14T13:17:07.077290+0000, chain.objs.size()=1 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.obx_-e4BZ9rOpM8HMa8lNKekuitNL6y_0 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17947993134388791492', time=2024-09-14T13:17:42.772383+0000, chain.objs.size()=1 2024-09-14T11:20:55.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.144+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.rD8SsyTWDtOkIjfcm1X10w1ECq7GcbB_0 2024-09-14T11:20:55.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.148+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8268094286352320905', time=2024-09-14T13:17:44.015676+0000, chain.objs.size()=1 2024-09-14T11:20:55.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.148+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.W3raBnSHncMUz7Utm--XI89TdzsGQPB_0 2024-09-14T11:20:55.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.148+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.50373724854072534', time=2024-09-14T13:17:44.018368+0000, chain.objs.size()=1 2024-09-14T11:20:55.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.148+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.bj5MzI_uhc7uYTc1EU7x9dLjC2f3Vtl_0 2024-09-14T11:20:55.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.149+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.151+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:20:55.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.154+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.154+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1785872595366556726', time=2024-09-14T13:14:15.658995+0000, chain.objs.size()=1 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.5DaTEdmlgC7Zgg2peHhiHDKyWaBxjRG_0 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3195284886643422666', time=2024-09-14T13:15:24.187804+0000, chain.objs.size()=1 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.Ckt-bSbGaQV3hBK_EwEhQOhF5iar99__0 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4041754875202097030', time=2024-09-14T13:15:26.361717+0000, chain.objs.size()=1 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.bTMOtiI_07uyapwsfBSDYFmNtL9FGnt_0 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8606749846435049659', time=2024-09-14T13:15:58.719126+0000, chain.objs.size()=1 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.1Lhat78BUJDjiPte4ERrL68UhLU-xfR_0 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11322593767789438694', time=2024-09-14T13:16:00.696152+0000, chain.objs.size()=1 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.wsndeRw7WWfXEJ0mQQT2utzZylQFFWD_0 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14685624102452843177', time=2024-09-14T13:16:33.745123+0000, chain.objs.size()=1 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.Kt7ccpExH6ZUdxzl3JtDQVE6o_a0odx_0 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12775104739585304366', time=2024-09-14T13:16:35.141731+0000, chain.objs.size()=1 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.kkBVrqPAYbDXdgHNLmeq8qGVjbgDIiQ_0 2024-09-14T11:20:55.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1525279924452914069', time=2024-09-14T13:17:07.083170+0000, chain.objs.size()=1 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.CIIH1W8zzfpgQrtb5M1ES4SZPmXH1I8_0 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5803356167042315375', time=2024-09-14T13:17:45.244577+0000, chain.objs.size()=1 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.yU6PB_UljE4KlyMpFyx4yj3rOo7r_ju_0 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10491240556762948933', time=2024-09-14T13:18:16.146621+0000, chain.objs.size()=1 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.1bTZFJFNfCaej4_BUUa3TtPeLJjZoMW_0 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2256693311299188867', time=2024-09-14T13:20:22.243514+0000, chain.objs.size()=1 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.155+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.rucU1t8PIiVALAo4rPq3wa1pzUwhpMD_0 2024-09-14T11:20:55.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.157+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.159+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:20:55.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.160+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:20:55.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11797033889575777325', time=2024-09-14T13:12:09.830190+0000, chain.objs.size()=1 2024-09-14T11:20:55.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.lSEbqTw3O4ms7uw7x1s2XGw9jGypuQT_0 2024-09-14T11:20:55.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15898495071331177064', time=2024-09-14T13:12:10.138731+0000, chain.objs.size()=1 2024-09-14T11:20:55.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.2JyAl9hluhGhCrZXHh9txTeLA0D-rUf_0 2024-09-14T11:20:55.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9562016545900324678', time=2024-09-14T13:13:39.261485+0000, chain.objs.size()=1 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.tIGcOBUzuycIhas1RhFJZM8hTf06GG-_0 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12869299581290803068', time=2024-09-14T13:14:47.975236+0000, chain.objs.size()=1 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.0mNcWSUUnZpB9JwutyOc_kZhAGnL-as_0 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3518899042164849405', time=2024-09-14T13:14:49.763006+0000, chain.objs.size()=1 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.75X0hCGg4KeYiEJlF1cu9lrJqosWmu6_0 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9814335318478126137', time=2024-09-14T13:14:49.768491+0000, chain.objs.size()=1 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.bVEQgUEAct64O1BJhJMEEVBplDfslc9_0 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14581285351229436836', time=2024-09-14T13:14:49.772710+0000, chain.objs.size()=1 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.EZWyjp38urcR1kajg0rNQy3-_gY9kk4_0 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12998987144392907765', time=2024-09-14T13:14:51.831734+0000, chain.objs.size()=1 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.AwUDQDJuyI1bBcUUZ1EdTOKzC-hY7He_0 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10729035719351223890', time=2024-09-14T13:15:24.178620+0000, chain.objs.size()=1 2024-09-14T11:20:55.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.PK9H7WqEBL9VyWnLMxwrIl7seaHKrXf_0 2024-09-14T11:20:55.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16433606994399516285', time=2024-09-14T13:15:24.182586+0000, chain.objs.size()=1 2024-09-14T11:20:55.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.P_JV7QR11Tk8nYfaBMH-JVEeyWtAK4Q_0 2024-09-14T11:20:55.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1296803273140901230', time=2024-09-14T13:15:25.225624+0000, chain.objs.size()=1 2024-09-14T11:20:55.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.161+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.KjHxIoQU1X9FGmCZzNw7s6sfdAkArsr_0 2024-09-14T11:20:55.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.162+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3475125297025899158', time=2024-09-14T13:16:00.701273+0000, chain.objs.size()=1 2024-09-14T11:20:55.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.162+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.eVN_Obp4l7yQ0DYk1-Pn9x8_8w1rN2Q_0 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8991087364724370324', time=2024-09-14T13:16:01.941978+0000, chain.objs.size()=1 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.pQUGQvVPdAeH3AZR8tvl2VEPysNHohj_0 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1604680599029297352', time=2024-09-14T13:16:33.756286+0000, chain.objs.size()=1 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.O7a5uH3rr58557p54-RckBvKvAgLKpg_0 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5832935621386206670', time=2024-09-14T13:17:41.000959+0000, chain.objs.size()=1 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.ZWCTrIl4UlMTV83F3Xrg3IxS1wuaAo4_0 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13304721924111731316', time=2024-09-14T13:17:41.001831+0000, chain.objs.size()=1 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.163+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.Eeqrwf6Tpr4lTuQweyspEy8_8arhDCy_0 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.164+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12432873138125499745', time=2024-09-14T13:20:22.243438+0000, chain.objs.size()=1 2024-09-14T11:20:55.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.164+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.KJdSY0GmlYJyZNz5AEFRTUy9sTgIaxs_0 2024-09-14T11:20:55.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.165+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.167+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:20:55.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.168+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8015968559032740975', time=2024-09-14T13:12:10.021220+0000, chain.objs.size()=3 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.1 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.2 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.3 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4635045263478867627', time=2024-09-14T13:13:40.312418+0000, chain.objs.size()=1 2024-09-14T11:20:55.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.A4ktxuOCc965Nh7CFWAXjKpOY2gSdp9_0 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16297819851400361902', time=2024-09-14T13:14:12.851711+0000, chain.objs.size()=1 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.i-ouhp9KbMyIojhTGaBtlWAn59oPNSo_0 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14803222859366677231', time=2024-09-14T13:14:14.294376+0000, chain.objs.size()=1 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.LuQcA39ndtIZFVIv1lB2yeTwSwfSzbN_0 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1430865247421025857', time=2024-09-14T13:14:15.662848+0000, chain.objs.size()=1 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.YLVd5r2KBSL3LbvLeC_hYk1qX6MiFrE_0 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9074110898335188521', time=2024-09-14T13:14:15.663626+0000, chain.objs.size()=1 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.YeOsUGZ9Ixo7Akz-o3cB3i8Yei7X0x2_0 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18276716427565773922', time=2024-09-14T13:14:47.964881+0000, chain.objs.size()=1 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.ZZZkQyCtrvxllsbVw64y2peg7FqGKhC_0 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.848959968089085958', time=2024-09-14T13:14:49.767497+0000, chain.objs.size()=1 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.XhZlbWVGtEPskrVrtXD9KcQ0k1I3thO_0 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6148147855332303422', time=2024-09-14T13:14:51.828415+0000, chain.objs.size()=1 2024-09-14T11:20:55.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.36uMH22UMIoBO4k6NxwCBzjLIq9_g68_0 2024-09-14T11:20:55.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17185789171663080671', time=2024-09-14T13:14:51.829236+0000, chain.objs.size()=1 2024-09-14T11:20:55.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.169+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_._CxHcwhWp29XqQfs6rILHKqBrZI4dW1_0 2024-09-14T11:20:55.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8803739092330601611', time=2024-09-14T13:14:51.834447+0000, chain.objs.size()=1 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.k3GFXfCwkgWbwQrnu9I3D3vygrYpp4q_0 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4912834694963587015', time=2024-09-14T13:15:58.723728+0000, chain.objs.size()=1 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.ga3VfhFN7lYM9OyLfBpW79kRgfpJv4k_0 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16794857693102407478', time=2024-09-14T13:15:58.727111+0000, chain.objs.size()=1 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.I3U3_Coyll0EoS7thJISPfCCOlayxZa_0 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16820784547678090262', time=2024-09-14T13:16:01.950897+0000, chain.objs.size()=1 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.6bkWaHyLbvqTlEeB27cxpPexF9PCLjl_0 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.84469649678450162', time=2024-09-14T13:16:33.752095+0000, chain.objs.size()=1 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.CXkq8H-Oo1rwX2Bx9mS0_FV6b-xemDl_0 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.149873446733934230', time=2024-09-14T13:16:35.142799+0000, chain.objs.size()=1 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.ECSmJQZx0mZLmcsRZnhiAu627Nk6J6v_0 2024-09-14T11:20:55.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14459403181321795080', time=2024-09-14T13:17:07.081377+0000, chain.objs.size()=1 2024-09-14T11:20:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.I9I1qZfp1JxhO9OdtM4q6FMZppSNAST_0 2024-09-14T11:20:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15563763400453900211', time=2024-09-14T13:17:09.067085+0000, chain.objs.size()=1 2024-09-14T11:20:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.hAu_ESiN4qMP43KHKIkWmQCc35DvSz8_0 2024-09-14T11:20:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4088474984520246784', time=2024-09-14T13:20:34.802836+0000, chain.objs.size()=1 2024-09-14T11:20:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.171+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18__shadow:aNrD30mI8dLlMURIDmu0zM3ijo79Une_.TQOCYIiQmsqgiT9oRZLcazhcBmq88Ie_0 2024-09-14T11:20:55.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.173+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.175+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:20:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.177+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.177+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-14T11:20:55.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_suSBuc9_fvfS0iNZr140feDi4TpWEqu', time=2024-09-14T13:12:09.958173+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.NgR1LtOdKUQ2jTSJmLdGCc3XTJX5TiU_0 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2995043695844194313', time=2024-09-14T13:14:14.815197+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.ALkr-k8PF-8kzieYIzhWnRRveawPlfi_0 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11561053306887892779', time=2024-09-14T13:14:14.820981+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.U0-mxlkjKCIQrSBCMngLiWpr_QXYEra_0 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17316534337935863291', time=2024-09-14T13:14:49.762295+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.uj40ni9r0BJ1BMVJrhFKQ-p4EYKSzz__0 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8066223585094258034', time=2024-09-14T13:15:24.179398+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.UXu9TCnYBbSoLZzjfgb42x4KBkEXDdo_0 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3037893347915646453', time=2024-09-14T13:16:01.952282+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.dzh4NtezsGsqYsOnm5eu4BGDZ30Qnlm_0 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6933979945198645513', time=2024-09-14T13:16:33.746412+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.PjuNQMObRlCcXmIHtlhIoKLo39FMnwZ_0 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1160349885306156803', time=2024-09-14T13:17:44.012127+0000, chain.objs.size()=1 2024-09-14T11:20:55.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.-d-Xcq6FBP9O1OWwN0kMSR01GAWurdc_0 2024-09-14T11:20:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13388613855365765453', time=2024-09-14T13:17:44.018093+0000, chain.objs.size()=1 2024-09-14T11:20:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.PWFYNX8uPMBpeuOPH-mERJP5VoJSkSz_0 2024-09-14T11:20:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5798864562469574329', time=2024-09-14T13:20:22.243829+0000, chain.objs.size()=1 2024-09-14T11:20:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.178+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.DDErYUBsAVBD9UbetCn4UfihK2t_gAv_0 2024-09-14T11:20:55.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.180+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.182+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:20:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.184+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.184+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:20:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17241719805197179826', time=2024-09-14T13:12:10.010306+0000, chain.objs.size()=3 2024-09-14T11:20:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.1 2024-09-14T11:20:55.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.2 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-STANDARD.2~4ceW2XvHId3Sac3IO0q1c5-oO9e5_T-.3 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16146050752328952411', time=2024-09-14T13:13:39.251328+0000, chain.objs.size()=1 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.AjWzzCQ92OO5e0HUVASgpMhdrOW0hRq_0 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7374276972313156371', time=2024-09-14T13:13:40.314622+0000, chain.objs.size()=1 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.Zr_GroSvareSf8rO168eqC7nS_kMm49_0 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8339327563582845425', time=2024-09-14T13:14:14.829229+0000, chain.objs.size()=1 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_._dCmB5I2trTlhCsheovkegNbp2BnexG_0 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14401117074800674339', time=2024-09-14T13:14:15.666208+0000, chain.objs.size()=1 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.XkFTOJCKhrLfVBZxams0BAVYFFbuM9A_0 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14141687842322534804', time=2024-09-14T13:14:51.833282+0000, chain.objs.size()=1 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.0NOUm3gGOZlYZin6-VZZ03NV0I5snWD_0 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16840200019817339727', time=2024-09-14T13:15:26.363116+0000, chain.objs.size()=1 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.-aGwHwoan4is2uejrov046-TJm7bAK-_0 2024-09-14T11:20:55.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7702926709304605839', time=2024-09-14T13:16:01.941865+0000, chain.objs.size()=1 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.nFZZ5pntA6G_e0__4nwP-QOp6TiZfef_0 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14193837582263845969', time=2024-09-14T13:17:42.764245+0000, chain.objs.size()=1 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.fOMNZrdkbPmtBIK1TDIp8-9bVaLtviw_0 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10842748709487630893', time=2024-09-14T13:17:44.010408+0000, chain.objs.size()=1 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.185+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.GPCL90XxLz6Gv3mWcgNpG-BeFJvreQx_0 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.186+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8531070515263892676', time=2024-09-14T13:20:22.243842+0000, chain.objs.size()=1 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.186+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.9ni1n6euLqvrjxLhipWbpF1P88ArYU8_0 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.186+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11662791347015046293', time=2024-09-14T13:20:22.245554+0000, chain.objs.size()=1 2024-09-14T11:20:55.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.186+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.A4EBWwnj_obxz-A44NMtibNFPy9wWUN_0 2024-09-14T11:20:55.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.188+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.190+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:20:55.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.191+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12025277438303618826', time=2024-09-14T13:12:09.825679+0000, chain.objs.size()=1 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.iZQ4Smr4W_4mx6hSiROOSD0JQ_UJmY3_0 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1045062330657505740', time=2024-09-14T13:12:10.100668+0000, chain.objs.size()=1 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.Yp8hpinIyGOS_YbJIKad4hi3lBAuKmy_0 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15783850385975668334', time=2024-09-14T13:14:14.823223+0000, chain.objs.size()=1 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.RmuJ8Mx9EBNYP7nPH5BUZ4HG8dCn0ac_0 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4352468778604033940', time=2024-09-14T13:14:53.263202+0000, chain.objs.size()=1 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.jXbjfzQCn7zA4FYZg7Ki8nO4_MPTaHG_0 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12319180845598458756', time=2024-09-14T13:16:00.689729+0000, chain.objs.size()=1 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.ir48_5jEN7Z6-KHfXgDXWFYMkHnDADR_0 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17174423611414907245', time=2024-09-14T13:16:00.690455+0000, chain.objs.size()=1 2024-09-14T11:20:55.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.7sGuYwR3R-7IRdrAjLIa4Tjhm-LXBE9_0 2024-09-14T11:20:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.600855428925499259', time=2024-09-14T13:16:01.949433+0000, chain.objs.size()=1 2024-09-14T11:20:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.jrOmRnKBopo_ss_pwgOlnUdA3wkGTsH_0 2024-09-14T11:20:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12617944168826266015', time=2024-09-14T13:16:33.751269+0000, chain.objs.size()=1 2024-09-14T11:20:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.aUrMTgvOwoQWut-yA-LV3kQ-bWKjnn0_0 2024-09-14T11:20:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9029184192415462145', time=2024-09-14T13:17:42.760344+0000, chain.objs.size()=1 2024-09-14T11:20:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.192+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.vBj9rZi9VEZK6zlWMwOLpXcuseFwIgs_0 2024-09-14T11:20:55.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.194+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.196+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:20:55.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3004803539938552461', time=2024-09-14T13:13:39.266347+0000, chain.objs.size()=1 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.eVFPuBJBGSvJXj5yR7IlgfI6Wbjn3df_0 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8655325761219769259', time=2024-09-14T13:13:41.327656+0000, chain.objs.size()=1 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.cmOWU64nrdNCqNsSBW7ogJFHueg2Jie_0 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14851548680543624551', time=2024-09-14T13:14:12.858146+0000, chain.objs.size()=1 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.TH_d2d4-2Z9ZqVp3v8r0HARRdkPPwdc_0 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12707498904155181462', time=2024-09-14T13:14:14.823142+0000, chain.objs.size()=1 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.WpFOPfMLCWe81Ygurb2rW5OmDI3c7r1_0 2024-09-14T11:20:55.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.443875763604638434', time=2024-09-14T13:14:49.767478+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.GplxUG9_pK4o1xSDUJo6YA5-6OHtDWJ_0 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9728412238345501092', time=2024-09-14T13:15:24.182949+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.swdnK8uyp2s6Q3u8zi3XGJxiumZi9a8_0 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9110744107829939621', time=2024-09-14T13:15:26.367818+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.DNKg5hVeeJZo18AkgoWj9i5hrighu-2_0 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14125719346783119100', time=2024-09-14T13:15:26.368676+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.vGfszoq1q5kHv2SaDagULi6XwENEuK2_0 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12400994524698982689', time=2024-09-14T13:15:58.723708+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.198+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.no9o2MpVHyM6AAOyddf9YOGFU-MRnkx_0 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.199+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2060591485605882335', time=2024-09-14T13:16:00.700138+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.199+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.OKUlLs8uUvN6eggWcPsXRu_K1pK0e2y_0 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.199+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3931873079561588636', time=2024-09-14T13:16:01.946509+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.199+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.odcos-_4uMdSEDrHdebbn1bMx0OX9k5_0 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.199+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5485612092339493506', time=2024-09-14T13:16:01.947312+0000, chain.objs.size()=1 2024-09-14T11:20:55.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.199+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.snnTkR-gaFqKARVqZ-coo5IMsVLv02E_0 2024-09-14T11:20:55.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.200+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8681436583569258741', time=2024-09-14T13:17:07.077712+0000, chain.objs.size()=1 2024-09-14T11:20:55.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.200+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.ofDeEsurmQ5Kz_ua8KehpjkyrXfbjuz_0 2024-09-14T11:20:55.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.200+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14279087092436852593', time=2024-09-14T13:17:09.067828+0000, chain.objs.size()=1 2024-09-14T11:20:55.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.201+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.VAGa8a6usd1Df73v8vCuKnzdfkzLvjZ_0 2024-09-14T11:20:55.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.201+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1991963699807635826', time=2024-09-14T13:18:16.145662+0000, chain.objs.size()=1 2024-09-14T11:20:55.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.201+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.X7ajCEE2xOfG8UFQ03QFC9Z9PsPeRme_0 2024-09-14T11:20:55.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.201+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8244518560370243288', time=2024-09-14T13:18:16.154734+0000, chain.objs.size()=1 2024-09-14T11:20:55.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.201+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.DJ-ZUf_Q4Ov9phvL3Lz01DNhkgSvezx_0 2024-09-14T11:20:55.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.203+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.205+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:20:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.206+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.206+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:20:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10320611883224586263', time=2024-09-14T13:12:09.995219+0000, chain.objs.size()=3 2024-09-14T11:20:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.1 2024-09-14T11:20:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.2 2024-09-14T11:20:55.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.3 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8817427760586469460', time=2024-09-14T13:12:10.108583+0000, chain.objs.size()=1 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.7__shadow_.9DBr5TuL6OHgJpMhfQ-mi35NNTy37pN_0 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11542075173215930376', time=2024-09-14T13:13:39.258914+0000, chain.objs.size()=1 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.EmMcTHv7lJMy2HOh61AgevepFioqwIt_0 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10694852245228361552', time=2024-09-14T13:13:39.260701+0000, chain.objs.size()=1 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.62MzczLZwpbnU1EY_cAjDIpLQmZAUTo_0 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5310487338837445738', time=2024-09-14T13:14:47.966198+0000, chain.objs.size()=1 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.dgJ3KsSwEFgJ5rkxdMvx9u798Qg4KTP_0 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1089387240377753861', time=2024-09-14T13:14:49.763849+0000, chain.objs.size()=1 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.sahzZwdHAHxu5fnVaM6wTHobyFcEOP9_0 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8464635260855779572', time=2024-09-14T13:14:49.765779+0000, chain.objs.size()=1 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.bV5gIklDvY-LjvEKUAyWoL7ehz-F8v9_0 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14469585123072725349', time=2024-09-14T13:14:51.838289+0000, chain.objs.size()=1 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.1-07GsQHwrP7dMo7EEPbpx3GoG_-Rpw_0 2024-09-14T11:20:55.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15617299482935234539', time=2024-09-14T13:14:51.842766+0000, chain.objs.size()=1 2024-09-14T11:20:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.jmYciGxDzCZCRA0DKc99NZNznu0pB92_0 2024-09-14T11:20:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16769146894252333730', time=2024-09-14T13:15:24.183974+0000, chain.objs.size()=1 2024-09-14T11:20:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.207+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.dIg3xKTHCUUyuUN73CBBs9UgBd_qtgD_0 2024-09-14T11:20:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1038480233178655584', time=2024-09-14T13:15:26.362991+0000, chain.objs.size()=1 2024-09-14T11:20:55.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.TXGZV863kKPV4-AN5EnzrJH9vvR0jnI_0 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15964131391145710160', time=2024-09-14T13:15:26.366709+0000, chain.objs.size()=1 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.7Neu_zj4hI9kTz8QE3uhXiKUeno_sFR_0 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1486682651846240134', time=2024-09-14T13:15:58.721147+0000, chain.objs.size()=1 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.H4zieZMQ_eklvXftfLxC7J7Rtpkzmx__0 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16537047648048424890', time=2024-09-14T13:17:07.079978+0000, chain.objs.size()=1 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.puy3roHOEUt1Iz6dDYTLNX71MyaOnow_0 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18276570399682453569', time=2024-09-14T13:17:40.999807+0000, chain.objs.size()=1 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.8K945e3yJgLquxStmdkutQXu8qodx9k_0 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18389212871580491919', time=2024-09-14T13:17:41.000804+0000, chain.objs.size()=1 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.t83QL19fnEIoVsaEernkcGjIXFmsP8__0 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9950785482914690611', time=2024-09-14T13:17:44.014784+0000, chain.objs.size()=1 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.UNMMF5jAyxFBlVTYeqm0k_B6uIw3XSr_0 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10024363057539862499', time=2024-09-14T13:18:16.147945+0000, chain.objs.size()=1 2024-09-14T11:20:55.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.209+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.E2Ti0IG346D15gv_TP3ovX16lNnNpmp_0 2024-09-14T11:20:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.210+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9829739813826036386', time=2024-09-14T13:20:34.802904+0000, chain.objs.size()=1 2024-09-14T11:20:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.210+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18__shadow:ySU1HjB8bol4oQn-jB5krq5QvV.hVmW_.lqQHw2YV6ydfiMejKJfhm-lXWyMBpC2_0 2024-09-14T11:20:55.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.211+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.213+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:20:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.215+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.215+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T11:20:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_DUJ3KhpardbryEMjyKGaSVHqL2zFqgw', time=2024-09-14T13:12:09.935147+0000, chain.objs.size()=1 2024-09-14T11:20:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.m1CORFI5zmrBS9jCJo-Vc3OyCpCxE7x_0 2024-09-14T11:20:55.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_9gV6vDVbNZTBwL5L0skGkETsj-S3tMm', time=2024-09-14T13:12:09.950148+0000, chain.objs.size()=1 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.-wqEGdeuCiIc9L5p2oKkggPyT8Gwiup_0 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2871663515520457041', time=2024-09-14T13:12:10.134731+0000, chain.objs.size()=1 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.YHS6eWOS67vdvRFL5AKel1RrFOeP9e7_0 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15197569705467999672', time=2024-09-14T13:13:39.252827+0000, chain.objs.size()=1 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.v4jleuIMuTVjGSpO5astATyb90Fn21__0 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4270518153399605391', time=2024-09-14T13:13:39.256556+0000, chain.objs.size()=1 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.tDezSgl1ajzdOMIYkk7nlY7dBSkXlCu_0 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.721844610162220966', time=2024-09-14T13:13:39.264120+0000, chain.objs.size()=1 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.tgn56dxFUOSR4fwanFBDR28sDStjQNW_0 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17939086011184342384', time=2024-09-14T13:14:12.855461+0000, chain.objs.size()=1 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.t6Bk8ZwIPiWUdUHoHC2SroMoIX25MSP_0 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10253403371885809672', time=2024-09-14T13:14:12.860070+0000, chain.objs.size()=1 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.8asEYcLzyNl1mdxh0sC_lzPmdrBB5jt_0 2024-09-14T11:20:55.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7150795374842600439', time=2024-09-14T13:14:12.860818+0000, chain.objs.size()=1 2024-09-14T11:20:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.v-M00dSz_Anrkyq9RVxTu4zRvfLiMim_0 2024-09-14T11:20:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3753725890971794742', time=2024-09-14T13:14:12.863039+0000, chain.objs.size()=1 2024-09-14T11:20:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.NLLR5PDWU8pgJO3EiPujA8PcdQeYpTJ_0 2024-09-14T11:20:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14240035546174302432', time=2024-09-14T13:14:15.658954+0000, chain.objs.size()=1 2024-09-14T11:20:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.YyR4i_pUU6sRIclhMxCZJdnMMDOzT-k_0 2024-09-14T11:20:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14439202632409388816', time=2024-09-14T13:14:47.971801+0000, chain.objs.size()=1 2024-09-14T11:20:55.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.216+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.LqvXR8pqCoo1J8rUCoDZlGsdPJZ6eqJ_0 2024-09-14T11:20:55.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3308077909060718581', time=2024-09-14T13:14:49.762850+0000, chain.objs.size()=1 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.FpAX9whpvfymkkzM3PwKfu6E17WC09Y_0 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8241037099208135253', time=2024-09-14T13:14:51.833820+0000, chain.objs.size()=1 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.RGWF1qXUbwlna5RPMxv1W6h-Wh9BfdB_0 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2698936897249430157', time=2024-09-14T13:15:24.189732+0000, chain.objs.size()=1 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.YvZg5Mnjks_z9rjAjBRiFGcVQHEXTJi_0 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12059300790497687772', time=2024-09-14T13:15:26.366572+0000, chain.objs.size()=1 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.SLKpHp560A7ZKDQxbrCzMrz0FcDOiIK_0 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5631445195213393745', time=2024-09-14T13:15:26.372232+0000, chain.objs.size()=1 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.9XCzkvBWJXC4ODddL9rBqiTxyQaX76X_0 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16759388884123345638', time=2024-09-14T13:16:00.692580+0000, chain.objs.size()=1 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.rPHgsw7lQm8ObNgnkhCENafmwtF_AF8_0 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13858461390665578426', time=2024-09-14T13:16:32.993469+0000, chain.objs.size()=1 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.ueHWYdTKFdsCAuVaQ9ghr3TqSwzdMWK_0 2024-09-14T11:20:55.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9494646179599889124', time=2024-09-14T13:16:35.141367+0000, chain.objs.size()=1 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.LxLqYb9EZkaEDlb3VLog2JXr24CdKG2_0 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8816920310524392854', time=2024-09-14T13:16:35.143616+0000, chain.objs.size()=1 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.AibaE3AlOESLNLcmhjqKkac3ZO7qNK6_0 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12783401006285847206', time=2024-09-14T13:16:35.149400+0000, chain.objs.size()=1 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.NL4-UMfhC7o_ul1vsOn3qb9aT3rGbvM_0 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10381076931752973825', time=2024-09-14T13:17:07.078743+0000, chain.objs.size()=1 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.219+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.u4cwEyqAFPX0x8xbaIsJaLJxLulRSCI_0 2024-09-14T11:20:55.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.220+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8895412639654099879', time=2024-09-14T13:17:09.066518+0000, chain.objs.size()=1 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.220+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.aDYqJzd_Kia6ForC8iMWUOYivLU7-nt_0 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1350842665303438780', time=2024-09-14T13:17:09.068114+0000, chain.objs.size()=1 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.NbMyvb_hm6MChoUCSjUt4Jgtfnt_YnE_0 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.665448123649836621', time=2024-09-14T13:17:41.004830+0000, chain.objs.size()=1 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.FynjUPCKAIk1P3NwuDdbcDXcUrv_ZfC_0 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10407489574553646998', time=2024-09-14T13:17:41.007040+0000, chain.objs.size()=1 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.Sh7uanmcUQpeQjKRo0u-plkHk_DZAZc_0 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4045001427732135948', time=2024-09-14T13:20:22.243659+0000, chain.objs.size()=1 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.221+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.nrqTDrkU03d8rU1KW7miianrnTJtgLs_0 2024-09-14T11:20:55.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.222+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.225+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:20:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.226+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.226+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4049832726074066599', time=2024-09-14T13:12:09.984104+0000, chain.objs.size()=3 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.1 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.2 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-FROZEN.2~uIvSdpNHjJcW6aJjPJS_EQET8kIqHs9.3 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18256556092746850536', time=2024-09-14T13:12:10.126015+0000, chain.objs.size()=1 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.zGY8gC5hqqAvQq8OcSTSRxkej9-5tlr_0 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.348590994551660059', time=2024-09-14T13:12:10.129604+0000, chain.objs.size()=1 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.8__shadow_.59AzdRw-8PfGyq1PPXoJbu7JAeEwhOf_0 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5725206231089867376', time=2024-09-14T13:13:39.255431+0000, chain.objs.size()=1 2024-09-14T11:20:55.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.6NLJNtA6wtLQ-wVIoPQa4giQH0KORuF_0 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.883134877980141732', time=2024-09-14T13:14:14.817896+0000, chain.objs.size()=1 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.-g5N4ciO_OQEUOtwjC-vR_SXEjnEWj3_0 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1498362337723192941', time=2024-09-14T13:14:51.831522+0000, chain.objs.size()=1 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.iJHAj3JqKk1pbwNDiEKwhYLYWr_khLx_0 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16115491932550903695', time=2024-09-14T13:15:58.716236+0000, chain.objs.size()=1 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.MPEi-rjJWSQjXxN3lTVKDhg8n3kvwqx_0 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6653306628912906200', time=2024-09-14T13:17:07.088832+0000, chain.objs.size()=1 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.Qq2Rr62r9b9ObjDiMP0Xt76n66WsGA9_0 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9206101496758253450', time=2024-09-14T13:17:09.068791+0000, chain.objs.size()=1 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.tc2X58x6m2eUdZE-A9gXhoiKVka_qd2_0 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8106421366166165528', time=2024-09-14T13:17:09.071982+0000, chain.objs.size()=1 2024-09-14T11:20:55.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.227+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.G35G2RGoDX-yCeflh_XVNmJRqAoGpmS_0 2024-09-14T11:20:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.230+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6793041648697572494', time=2024-09-14T13:17:44.012848+0000, chain.objs.size()=1 2024-09-14T11:20:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.230+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.x6wR6gmor7qYEr0FhtIuCff4TqNGyj1_0 2024-09-14T11:20:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.230+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16754035360916238547', time=2024-09-14T13:17:44.017406+0000, chain.objs.size()=1 2024-09-14T11:20:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.230+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.vr-Jq28hsYjUK_8zYwoDCodlybiQNqz_0 2024-09-14T11:20:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.230+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3281439205329825845', time=2024-09-14T13:17:44.022513+0000, chain.objs.size()=1 2024-09-14T11:20:55.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.230+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.0jN79QTEC6F5gchhI0eLNIj2Aw7Ed64_0 2024-09-14T11:20:55.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.231+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.233+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:20:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.234+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5199774885726665620', time=2024-09-14T13:12:10.002895+0000, chain.objs.size()=3 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.1 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.2 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__multipart_foo-LUKEWARM.2~UQTS0xwp_F0uaCrdZvGBUOhAB1M-P0T.3 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15766593546931901669', time=2024-09-14T13:12:10.036024+0000, chain.objs.size()=3 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-FROZEN.2~nsulaTeQYt43vfqAsfpKenzEelvVNJe.1 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-FROZEN.2~nsulaTeQYt43vfqAsfpKenzEelvVNJe.2 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-FROZEN.2~nsulaTeQYt43vfqAsfpKenzEelvVNJe.3 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7216596884686996007', time=2024-09-14T13:14:49.771533+0000, chain.objs.size()=1 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.DodhlTJo_ZUAP98ZgJwf0r41xT7fNfn_0 2024-09-14T11:20:55.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14245106103984219978', time=2024-09-14T13:14:51.828251+0000, chain.objs.size()=1 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.ZPWpdZgtRcbrWRQWIrXrjGsxt7l3Wzy_0 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2860697381766556609', time=2024-09-14T13:15:24.176220+0000, chain.objs.size()=1 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.K_BGznYgqhCRPLkFJmDBdkCnkmAhNQG_0 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16137312920880231005', time=2024-09-14T13:15:58.717001+0000, chain.objs.size()=1 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.sqgvDApM_t1EPZyeKLw-XW0AvJvsmWx_0 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5139884566302046701', time=2024-09-14T13:16:01.944650+0000, chain.objs.size()=1 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.ocaJ-AINrcsBpKf_1qQaZ836FKKZRCh_0 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4449712598502877848', time=2024-09-14T13:16:01.945453+0000, chain.objs.size()=1 2024-09-14T11:20:55.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.235+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.1NvbtJuHa_VP5waaZUEhyXgJv7hxgjm_0 2024-09-14T11:20:55.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.238+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8369101508452763118', time=2024-09-14T13:16:35.138926+0000, chain.objs.size()=1 2024-09-14T11:20:55.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.238+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.vGU8ia5k1FFAASg9Ax04a9nfySBusDI_0 2024-09-14T11:20:55.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.239+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8959311077546938265', time=2024-09-14T13:17:09.074581+0000, chain.objs.size()=1 2024-09-14T11:20:55.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.239+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.iCSzdQcw9JYApgmRp31qT27wn6xfKYw_0 2024-09-14T11:20:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.242+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9744063921733070712', time=2024-09-14T13:18:16.145456+0000, chain.objs.size()=1 2024-09-14T11:20:55.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.242+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.IRmOStfzmsDt4pqMOAmDiLrM4P98yyD_0 2024-09-14T11:20:55.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.243+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.245+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:20:55.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.247+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.247+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:20:55.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6245378901898452886', time=2024-09-14T13:12:09.834700+0000, chain.objs.size()=1 2024-09-14T11:20:55.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.E-SLdz3BybgBu-dOThdWjPRW_D2BdCB_0 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.513442097295932193', time=2024-09-14T13:12:09.857310+0000, chain.objs.size()=4 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.1 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.2 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.3 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.11__multipart_foo.2~ZXonOs_yL3MxyrdxxJNM-SXSIJU1lbJ.4 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17673658255885487243', time=2024-09-14T13:13:40.312613+0000, chain.objs.size()=1 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.zpVrqOpfJif1BtHEeGCqk1w1jDep-LV_0 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7083819377672887870', time=2024-09-14T13:14:12.855451+0000, chain.objs.size()=1 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.hHeGT5aYZ-IpmwTlJkv1cofz0RlzWaE_0 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7084519875140703264', time=2024-09-14T13:14:14.816768+0000, chain.objs.size()=1 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.70zrb1wtDyzo_44-sFB_aV7weBB3KjT_0 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2254734408630854591', time=2024-09-14T13:14:47.968943+0000, chain.objs.size()=1 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.xWN8xYb6kAHKf9jibJQfEg5Wy71u-wZ_0 2024-09-14T11:20:55.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10829985049134454129', time=2024-09-14T13:14:49.760813+0000, chain.objs.size()=1 2024-09-14T11:20:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.51vjwUrnX2gKuxYCxd5mGE11JxwgVoH_0 2024-09-14T11:20:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5808639808437198199', time=2024-09-14T13:14:49.761679+0000, chain.objs.size()=1 2024-09-14T11:20:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.UAODGdK6qBIiCfAbUBnkfJSkC0xZFJR_0 2024-09-14T11:20:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11101410990096453755', time=2024-09-14T13:16:33.749814+0000, chain.objs.size()=1 2024-09-14T11:20:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.248+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.aN786LiQrayau380dfYF5KwNod0OTEe_0 2024-09-14T11:20:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.250+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7717303226250620912', time=2024-09-14T13:17:07.079244+0000, chain.objs.size()=1 2024-09-14T11:20:55.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.250+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.L6U7VJ7SzH0Qk-eDEUTsiziu4jz91OT_0 2024-09-14T11:20:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.250+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8578886678748314512', time=2024-09-14T13:18:16.144849+0000, chain.objs.size()=1 2024-09-14T11:20:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.250+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.IIn_8nqWshjihOwPMH4aHxbbrS4-aub_0 2024-09-14T11:20:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.250+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10962610369233942709', time=2024-09-14T13:18:16.148902+0000, chain.objs.size()=1 2024-09-14T11:20:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.250+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.LuEj5Sbrfc-DSvN9xYrpkwNJaTpwAKj_0 2024-09-14T11:20:55.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.251+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.253+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:20:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.255+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.255+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13398266633677555639', time=2024-09-14T13:12:09.966013+0000, chain.objs.size()=1 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.J2C3YWn8zhoORuSSjyQesD1EVZkZNGw_0 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15557648141656043172', time=2024-09-14T13:13:39.255747+0000, chain.objs.size()=1 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.eDa5pgqEPz2qcOkJywgyvA_O4Xa4I_1_0 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2341495950250397562', time=2024-09-14T13:13:39.256484+0000, chain.objs.size()=1 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.WHg56lkhci9KvNOvYFjFHpq8NgFTY6f_0 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10179598495075173193', time=2024-09-14T13:13:40.306228+0000, chain.objs.size()=1 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.QH0WYJCtD_Q108k7pUnM4hJ-wiauRBb_0 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11046771036547198425', time=2024-09-14T13:14:12.859658+0000, chain.objs.size()=1 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.8KbI04JM9d_Kbapp7H7tNXgIQxHdFgt_0 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.748708986125717660', time=2024-09-14T13:14:14.820913+0000, chain.objs.size()=1 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.hEHcap8Ei6CavqKiry1nQRZH1HUxq_9_0 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7370903665716362775', time=2024-09-14T13:14:14.822416+0000, chain.objs.size()=1 2024-09-14T11:20:55.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.JePzcKczbGne6CuhW-b6wSpS4F339XX_0 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6960188880401331206', time=2024-09-14T13:14:15.664048+0000, chain.objs.size()=1 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.6Uhp1msZtIRkS-9ZbNSOvKrPqGFb6gh_0 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6517510477149351482', time=2024-09-14T13:14:47.975125+0000, chain.objs.size()=1 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.8dvY95Vsg7dxqKdWMvoJWp0YbjF7Fle_0 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7968814201500472832', time=2024-09-14T13:15:58.728714+0000, chain.objs.size()=1 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.OI-neVrvEOIJYq7t0TL3AdZvJ5donIG_0 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10870145418600953104', time=2024-09-14T13:16:01.942034+0000, chain.objs.size()=1 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.ECgcYA0_iiTT71pfKDVZLC1YH3CdVJ3_0 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16177199114668877758', time=2024-09-14T13:16:01.946833+0000, chain.objs.size()=1 2024-09-14T11:20:55.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.256+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.t5aR9ZOOFE-__IIijrfgSwpNgQ8n6-P_0 2024-09-14T11:20:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.257+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.245282964088227375', time=2024-09-14T13:16:01.955611+0000, chain.objs.size()=1 2024-09-14T11:20:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.257+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.qXQ0KbJzWOUrQmVSyjFi-8GuSG0kDhi_0 2024-09-14T11:20:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.257+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4733217516543608349', time=2024-09-14T13:16:33.745258+0000, chain.objs.size()=1 2024-09-14T11:20:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.257+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.JsG0K1657MY07C9QnOTWXlPpOLlQhMr_0 2024-09-14T11:20:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.257+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7175124117563572018', time=2024-09-14T13:16:33.747756+0000, chain.objs.size()=1 2024-09-14T11:20:55.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.257+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.lZuG563mSgVOtQ1CErWH6At3ua01quR_0 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8591699914149448781', time=2024-09-14T13:16:35.142750+0000, chain.objs.size()=1 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.Hnvw1ZqXkDUuRcqZlLD7SMGy2gQ_gCq_0 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.968520288424315555', time=2024-09-14T13:16:35.149551+0000, chain.objs.size()=1 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.eESfY0ww5Y8Dwbw3KXZ5pMhsmTU6ocR_0 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3878313196332733709', time=2024-09-14T13:17:09.068492+0000, chain.objs.size()=1 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_._Hd2Rc4ypA6s3-yqxH-68XKEZrPJ5WT_0 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11497911862904787311', time=2024-09-14T13:17:40.995934+0000, chain.objs.size()=1 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.9GaesbOk6Cj0080uYPYJ7LjmYd9I9uP_0 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10477889363908302740', time=2024-09-14T13:18:16.152688+0000, chain.objs.size()=1 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.1L6yMRYccoRGGR-4x1aJSxRm-3wR-YJ_0 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18432840107796020341', time=2024-09-14T13:20:22.243539+0000, chain.objs.size()=1 2024-09-14T11:20:55.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.258+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.mSViM_hWMM_htWOGtby9iZ8UOihJAef_0 2024-09-14T11:20:55.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.260+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.260 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.262+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:20:55.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.263+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10397549254521201924', time=2024-09-14T13:12:09.927826+0000, chain.objs.size()=1 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.b2s6WY3aJUbt4h99swkE8lsqAVhOPro_0 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8677312472159054579', time=2024-09-14T13:12:10.061077+0000, chain.objs.size()=2 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.tD6g1bEONDjbnm6gJlluaK8w63n6gje_0 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.tD6g1bEONDjbnm6gJlluaK8w63n6gje_1 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8311456194591863465', time=2024-09-14T13:13:39.250075+0000, chain.objs.size()=1 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.RHqIc0XnylgD9juJbwL6wPOWpSG7IjE_0 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7442918147776727335', time=2024-09-14T13:13:40.306246+0000, chain.objs.size()=1 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.JjN8lL-GhQ-WiSpzdr8bPpCh1V-jSms_0 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16549674390215219733', time=2024-09-14T13:14:49.769731+0000, chain.objs.size()=1 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.L_HIc00ZJ3aE91-iR27J29eJ6tCNE7O_0 2024-09-14T11:20:55.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15338653982607366272', time=2024-09-14T13:15:24.178660+0000, chain.objs.size()=1 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.5XnClUIvJBITW6w9tAmMlezHVO3Odon_0 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11357100251750454474', time=2024-09-14T13:15:24.179559+0000, chain.objs.size()=1 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.-156b2B-Tm44rwNAOz_xLsvkTpISRSG_0 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10306463321304190299', time=2024-09-14T13:15:24.184947+0000, chain.objs.size()=1 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.8LeiXh4xIpixGF0VE08W0Ox0TukcNgc_0 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15027771152524795476', time=2024-09-14T13:15:26.369118+0000, chain.objs.size()=1 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.4kH9Wg35ikBk4zGiSxGL0uClpHzQ04__0 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7437539891806886237', time=2024-09-14T13:15:58.717337+0000, chain.objs.size()=1 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.IUHj9SSPgBqGAcouihTdb8LyOJKe73Y_0 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.264+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6424705693159659633', time=2024-09-14T13:16:01.941635+0000, chain.objs.size()=1 2024-09-14T11:20:55.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.265+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.Ok1x7EASrMhh2Gng73apwhiAs1ssVPJ_0 2024-09-14T11:20:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.952043314170106258', time=2024-09-14T13:16:33.750994+0000, chain.objs.size()=1 2024-09-14T11:20:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.FSEFkLKFMGRTNjXv_MvY1hwL6bFutEm_0 2024-09-14T11:20:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15928599911660911615', time=2024-09-14T13:16:35.148562+0000, chain.objs.size()=1 2024-09-14T11:20:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.AAkcDTvz3iVvA3MHW49DsbKi5gly8y__0 2024-09-14T11:20:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4211523455481478705', time=2024-09-14T13:17:07.076521+0000, chain.objs.size()=1 2024-09-14T11:20:55.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.oyBhyWLWhB6VEz3iW2GaaRFV-_S9Pw1_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4468355610434131889', time=2024-09-14T13:17:09.064524+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.1Z8GYGhT8Tlpl06xDGEqfJlintXWEcG_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11515846392961541704', time=2024-09-14T13:17:09.068036+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.6JaVBFDg8kLnBfTw7xKhUcZRWpD6Js4_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17674657114181256545', time=2024-09-14T13:17:10.091016+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.0RhARShHa5wSUHST2HrwBWpstv1KD_y_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15481948806518166494', time=2024-09-14T13:17:40.995794+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.SX8L2q5KmXC8Bfe83ysQZifSTc2MOIc_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7143126884802016248', time=2024-09-14T13:17:40.999680+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.267+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.d63xgpJN2dwqT28_WRFF6XOfXbqUnBj_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.268+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3872220271539604676', time=2024-09-14T13:17:42.766592+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.268+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.nbJ6uCHVFq05tW8gA_TSbnmHoJe3UW8_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.268+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10291425739293694624', time=2024-09-14T13:18:16.154074+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.268+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.3VBK4ZwebbAitrWIVYnr-mo43kdXDES_0 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.268+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3739431475115615118', time=2024-09-14T13:20:22.243357+0000, chain.objs.size()=1 2024-09-14T11:20:55.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.268+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.Uh5fMzMAwY5muX1g4UJ35UsrA9j3tyu_0 2024-09-14T11:20:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.269+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12105714606121193430', time=2024-09-14T13:20:22.244658+0000, chain.objs.size()=1 2024-09-14T11:20:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.269+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.snbXWJdj6Q08XUPoIs5zbwwb61MBaXp_0 2024-09-14T11:20:55.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.270+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.272+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:20:55.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=25, truncated=0, next_marker='' 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_f8acKmzqOXJllS2tkZnMAUOjPyBnfYz', time=2024-09-14T13:12:09.931538+0000, chain.objs.size()=1 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.4JxKWpKQdbv9lLSu892tVVJI9mDRKP6_0 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17202523787989154543', time=2024-09-14T13:13:39.255835+0000, chain.objs.size()=1 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.qQIAb247ihbBck8E-In1E4mgxc0EvAh_0 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17241850394699726756', time=2024-09-14T13:13:39.257993+0000, chain.objs.size()=1 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.HVHbsMe1gU8NwhlZzDd5lSY8fUQdXiA_0 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10963419227427116030', time=2024-09-14T13:13:40.306819+0000, chain.objs.size()=1 2024-09-14T11:20:55.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.O9AHWG9UqDuttQPeHIagp9el0m9CtIB_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16554123274561449250', time=2024-09-14T13:13:40.311102+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.CvgRS5Y8B0ZQGchtM6WzRz3jVz3MfKW_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4928359179751824992', time=2024-09-14T13:13:40.316717+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.Uo1D2LYLWyLWLrFPnxyfRmv8DqZgBSu_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1093619001690666007', time=2024-09-14T13:14:15.663388+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.FiRQ61klH_4qDsyzqiXRFVnoHhFV7GD_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1020905753047867977', time=2024-09-14T13:14:15.664631+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.qcH1oNWowNpyiPOf1AocZocojx6Xew9_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15611916581921913602', time=2024-09-14T13:14:47.968389+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.N2b-605JP6XhUpc92XjOFdmBmI9ahbA_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14450706173856685204', time=2024-09-14T13:14:47.975420+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.U2hAV1gM3NJkOWG5pOqVcxjnEKnRMCw_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8111376278929171765', time=2024-09-14T13:14:49.768788+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.FMLPMzRn33pFzz9FYSQlMvKrmOpFiVH_0 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8091043551363883351', time=2024-09-14T13:14:49.770603+0000, chain.objs.size()=1 2024-09-14T11:20:55.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.274+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.e7LP_Yrp5Eh9mMzi2jFLRftMUk_RZLV_0 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17101605944857566190', time=2024-09-14T13:15:26.367390+0000, chain.objs.size()=1 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.r9cEynDqBjJug54WgWF6tFKPw30W5iE_0 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15183058782911132688', time=2024-09-14T13:16:00.693391+0000, chain.objs.size()=1 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.KtmHbinENXbtTVZ_s_atyVN3LfTbZ_d_0 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3452143503096657716', time=2024-09-14T13:16:00.695618+0000, chain.objs.size()=1 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.YR0RdIyru-J3HCKO8P6O1ZrAaLJyoY-_0 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10635682599038330768', time=2024-09-14T13:16:33.746843+0000, chain.objs.size()=1 2024-09-14T11:20:55.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.xdiFAqJofAddh4V6Nr0kXArYfLbVuZc_0 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9925734181453749969', time=2024-09-14T13:16:35.145543+0000, chain.objs.size()=1 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.SEuIoZwHEdHqiG1-swNhypnliK69mYS_0 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8334279915307760483', time=2024-09-14T13:16:35.146733+0000, chain.objs.size()=1 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.IFKSlWxaP6KwBEcQ08WQPTvnIeLQYTs_0 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5707983073443205563', time=2024-09-14T13:17:07.087103+0000, chain.objs.size()=1 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.7dLONduHzJELr1mp6c7a65OzP-wusu0_0 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16110385066950844084', time=2024-09-14T13:17:09.069897+0000, chain.objs.size()=1 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.277+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.g1517V33U5cGh6cg8hYk-LenrW9qh6p_0 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.278+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5291505745542253552', time=2024-09-14T13:17:09.072844+0000, chain.objs.size()=1 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.278+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.gCs_4yorN3nxmYoE33Xebbi9nfiSROh_0 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.278+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7023079298761484598', time=2024-09-14T13:17:40.996964+0000, chain.objs.size()=1 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.278+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.bb_uIfo36zOVYKxXXqnymbIzQ-hWI1j_0 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.278+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6872680397321692616', time=2024-09-14T13:17:41.002452+0000, chain.objs.size()=1 2024-09-14T11:20:55.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.278+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_._Tl7QU0f8PuWfjjm-bKV76Ix3cPfp0__0 2024-09-14T11:20:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.279+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11812234851273236787', time=2024-09-14T13:17:42.772712+0000, chain.objs.size()=1 2024-09-14T11:20:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.279+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.937-c825ZCSkzDnEDchdeNeJACopn21_0 2024-09-14T11:20:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.279+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18050607681120888280', time=2024-09-14T13:17:44.010352+0000, chain.objs.size()=1 2024-09-14T11:20:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.279+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.l9dX0bmaYBgrjIVimuHfN0Kh_oS_Rgn_0 2024-09-14T11:20:55.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.281+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.281 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.283+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:20:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.284+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.284+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=13, truncated=0, next_marker='' 2024-09-14T11:20:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1558470325646227487', time=2024-09-14T13:12:09.891653+0000, chain.objs.size()=4 2024-09-14T11:20:55.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.1 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.2 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.3 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.10__multipart_foo.2~7-PufdEOkHGa-fn-_xfcLO4l_nbUwV0.4 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_t5jp52Ezh-7nFO1PzGF3SVe-LOAl3c-', time=2024-09-14T13:12:10.017571+0000, chain.objs.size()=1 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.RXG5AbCi0zCh8ZP7FQgcfJvXVTiqC1W_0 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1793743283312309938', time=2024-09-14T13:13:39.266356+0000, chain.objs.size()=1 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.xVqipK4fwGsDKklHSSeWw0IKMa-S49p_0 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15128989856174865029', time=2024-09-14T13:13:40.307551+0000, chain.objs.size()=1 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.rItQSyw-fMKNJmNMk2keC-LcDsC4RL3_0 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15743721715763356092', time=2024-09-14T13:13:40.309252+0000, chain.objs.size()=1 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.dwmjDbHQCyfR5td0eZTpsjU5SQscz03_0 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4979553833899100354', time=2024-09-14T13:13:40.316776+0000, chain.objs.size()=1 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.1BUNuppuuQ8XzTh4BlslYskYnm3hOmO_0 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12337282990213087058', time=2024-09-14T13:14:12.854918+0000, chain.objs.size()=1 2024-09-14T11:20:55.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.TdOxZtZRRrSfhbH6TGztUZF8myaMUaj_0 2024-09-14T11:20:55.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2996576547307622495', time=2024-09-14T13:14:51.842609+0000, chain.objs.size()=1 2024-09-14T11:20:55.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.43Bs1inJUENOtLn58TXXxh7WnN5c3Sc_0 2024-09-14T11:20:55.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6917010115295438198', time=2024-09-14T13:15:24.176415+0000, chain.objs.size()=1 2024-09-14T11:20:55.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.285+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.YupMaLYKMsQuhiCIUFCNmemzGMLy3Jb_0 2024-09-14T11:20:55.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.286+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7914313156870536160', time=2024-09-14T13:15:26.373397+0000, chain.objs.size()=1 2024-09-14T11:20:55.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.286+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.eJ97VYw26zFygWvGQ6aJFuA8EJ5Caf2_0 2024-09-14T11:20:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.287+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2317655562017474513', time=2024-09-14T13:16:33.756362+0000, chain.objs.size()=1 2024-09-14T11:20:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.287+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.iv4blJ9virJk5dbNy1o6K1e3DENouKF_0 2024-09-14T11:20:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.287+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5644331102029874340', time=2024-09-14T13:17:07.081740+0000, chain.objs.size()=1 2024-09-14T11:20:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.287+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.XiUrvj9sbeKOArxghquNA0CYx3KnR41_0 2024-09-14T11:20:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.287+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8525749543868652159', time=2024-09-14T13:18:16.151790+0000, chain.objs.size()=1 2024-09-14T11:20:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.287+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.f8xzOXRL-D_f2mC0BY5marjF7fByx9r_0 2024-09-14T11:20:55.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.288+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.290+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:20:55.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_abyzf0Gn9pUkd01X8l1FjMuG0kpiavn', time=2024-09-14T13:12:09.942778+0000, chain.objs.size()=1 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.rvU2epuvUrZDF5I7wz33jguzqRgKT49_0 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13561155395605251438', time=2024-09-14T13:14:47.975047+0000, chain.objs.size()=1 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.IznPrxELVgGRSsf67Ey61awMIkBo42M_0 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12291566669851746694', time=2024-09-14T13:16:00.698754+0000, chain.objs.size()=1 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.4v-Nq3DmOaPXTusA_8-QDiC4Q_0jfsB_0 2024-09-14T11:20:55.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12275207299164861842', time=2024-09-14T13:16:01.951069+0000, chain.objs.size()=1 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.ZPtwvU8DjOxiwVmHBvUz3axew59APve_0 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14889845657424453231', time=2024-09-14T13:16:33.749984+0000, chain.objs.size()=1 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.7sXCujC2fkWcWVEfxOjjb25TiEWooR0_0 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7895471591342381839', time=2024-09-14T13:16:35.146042+0000, chain.objs.size()=1 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.j2ag0lg4W49IxiCKpbRNmqkpyPXw-I9_0 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7672240516979688787', time=2024-09-14T13:17:40.996030+0000, chain.objs.size()=1 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.Mu2XlvS3-A1FsbsFksf2rQ9DUbzgPDY_0 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8945410036528755081', time=2024-09-14T13:17:42.763904+0000, chain.objs.size()=1 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.JRP49kawXRN6OCiVr_Z1r6PBETbd6rU_0 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17705679001629502910', time=2024-09-14T13:17:42.771158+0000, chain.objs.size()=1 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.dRIWvi1xBxucJLX4tEv4Lku-kSyI-aH_0 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2896620578219001878', time=2024-09-14T13:18:16.144596+0000, chain.objs.size()=1 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.ttsYftDAYowZDoUFfrQCoef-SlPf3Uq_0 2024-09-14T11:20:55.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12629374952958197957', time=2024-09-14T13:18:16.157008+0000, chain.objs.size()=1 2024-09-14T11:20:55.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.292+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.24Pj6h1dWLAAN_-Wm5nzNui7sSP90Td_0 2024-09-14T11:20:55.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.295+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.297+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:20:55.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.298+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17114030615821735545', time=2024-09-14T13:13:40.305822+0000, chain.objs.size()=1 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.-8j7JIBUTKoooRNtJZaoWFBnMg2jukw_0 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15167430638276028401', time=2024-09-14T13:14:14.826377+0000, chain.objs.size()=1 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.wlWfTkm2rVQDAQmYFAD1YA0myOCZrT7_0 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4632582771954271239', time=2024-09-14T13:14:14.827757+0000, chain.objs.size()=1 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.oUox0SaRv83nxK9NQETgO9o8C1zGGH7_0 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3398204605365318754', time=2024-09-14T13:14:15.658874+0000, chain.objs.size()=1 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.88Cdy_CH6EkdGKnkglVoGP7EYmUYJ7l_0 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12672232370391304951', time=2024-09-14T13:14:15.660390+0000, chain.objs.size()=1 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.QLKdeKK00I1SLwzmvlGB81vZ1wS_cit_0 2024-09-14T11:20:55.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7614748910463729415', time=2024-09-14T13:14:47.973467+0000, chain.objs.size()=1 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.2T9_t_2oMLv5NuM55_gcvL80U0qBxW9_0 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6168055085747819422', time=2024-09-14T13:14:51.838955+0000, chain.objs.size()=1 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.vWTljmbQmDCIXYb2aLBvCfhbp9B_shz_0 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4699755664850517566', time=2024-09-14T13:15:24.179294+0000, chain.objs.size()=1 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.nf1yhJwxcKNrInYDHqf2niz8qt4FFa8_0 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.722098687383333561', time=2024-09-14T13:15:24.181036+0000, chain.objs.size()=1 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.27__shadow_.nsT0lKrlt-LQRQdGsS36ONgoKOCLF31_0 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4303329903018028137', time=2024-09-14T13:15:26.368168+0000, chain.objs.size()=1 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.SUREjNHJDM2--yju23YBMTRsVuFxNC9_0 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.106508678023788274', time=2024-09-14T13:15:26.369454+0000, chain.objs.size()=1 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.KnuHJZmizPFdR5l_M453FP9dBIvLUfx_0 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3360084986251919244', time=2024-09-14T13:15:58.717084+0000, chain.objs.size()=1 2024-09-14T11:20:55.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.299+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.H9ZHQxNxVbr7GX9NOJDND9NDwSJ-u4s_0 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2082978101932058474', time=2024-09-14T13:16:00.692581+0000, chain.objs.size()=1 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.gFv04oKkEbahVdPGWdey8x0wOi3diEw_0 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7083608276230840711', time=2024-09-14T13:17:09.080863+0000, chain.objs.size()=1 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.WUekQWke7bdeflSZXDmsZRYvSiWoRDm_0 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1792462340094520015', time=2024-09-14T13:17:41.003151+0000, chain.objs.size()=1 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.ipQMy4r9AxK5fRn-50hSjSccIhy0EsI_0 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7624553274389995512', time=2024-09-14T13:17:44.010760+0000, chain.objs.size()=1 2024-09-14T11:20:55.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.MeWD4eM7XNDxjY99TebII2fxXjL8QaF_0 2024-09-14T11:20:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17355836153901206072', time=2024-09-14T13:17:44.019905+0000, chain.objs.size()=1 2024-09-14T11:20:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.301+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.dZX9k6VfCydBXlPhOZaBjaB3Nh4doUG_0 2024-09-14T11:20:55.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.303+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.305+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:20:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.306+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.306+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=16, truncated=0, next_marker='' 2024-09-14T11:20:55.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17195226712446934414', time=2024-09-14T13:12:10.057280+0000, chain.objs.size()=2 2024-09-14T11:20:55.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.vSUYp7VFi6p7izhIQq6ZVNLkqISysJN_0 2024-09-14T11:20:55.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.13__shadow_.vSUYp7VFi6p7izhIQq6ZVNLkqISysJN_1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4673723185465070783', time=2024-09-14T13:14:12.863848+0000, chain.objs.size()=1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.JK5foNduebgXPcsPnztt6TsyzoAX1GI_0 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6994205742849031186', time=2024-09-14T13:14:14.822288+0000, chain.objs.size()=1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.xe3zLY9oLXJqWoijTihvIawPzXKq5ak_0 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13623070356982071869', time=2024-09-14T13:14:15.668102+0000, chain.objs.size()=1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.OkeE06VLVjCNp7DJsgH3qpHs_FIN6SV_0 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12607878522815691', time=2024-09-14T13:14:49.766449+0000, chain.objs.size()=1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.wVbR_RflI_rew2vdVfMDfBcW9PVTlCS_0 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2674044626787052783', time=2024-09-14T13:14:49.773835+0000, chain.objs.size()=1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.3P2hth338ToTU4j-FYthXqiVKER8NoW_0 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.573444937154269694', time=2024-09-14T13:15:26.361466+0000, chain.objs.size()=1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.TyyzZh7s9o40_Stizpt0Mh1XJyxxifn_0 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10262245591184067761', time=2024-09-14T13:16:01.952205+0000, chain.objs.size()=1 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.oRiuyX6V374HXG-cmX6U984zYk5QGS9_0 2024-09-14T11:20:55.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8240856591057558338', time=2024-09-14T13:16:35.141860+0000, chain.objs.size()=1 2024-09-14T11:20:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.e1RfqsvQGCYJXWcxzNnCU76scvulqEX_0 2024-09-14T11:20:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7062507802221051208', time=2024-09-14T13:17:07.084672+0000, chain.objs.size()=1 2024-09-14T11:20:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.vDW6CEw2_LebWD8A3_MN8BPfKrD0opt_0 2024-09-14T11:20:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6406409040838984503', time=2024-09-14T13:17:09.069579+0000, chain.objs.size()=1 2024-09-14T11:20:55.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.307+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.35__shadow_.afuxoPgIVtb78OEWX62qYVwYVStofW4_0 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5245181564440155661', time=2024-09-14T13:17:42.769284+0000, chain.objs.size()=1 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.psPubT9PdE6a8Fabj0918VGWUJcynQg_0 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4605334004147139391', time=2024-09-14T13:17:44.020375+0000, chain.objs.size()=1 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.ezZVjPe74X_M6WHCXrhU0u3DCC1XzJs_0 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12056853533341304966', time=2024-09-14T13:18:16.143919+0000, chain.objs.size()=1 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.9ePdirBeTrLriCFcrbELF0o1nd4SGTe_0 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14596086847777615150', time=2024-09-14T13:18:16.145647+0000, chain.objs.size()=1 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.39__shadow_.MuL0ANomcEUajZzCd43kSUNVLbP5wdn_0 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6840793114435829993', time=2024-09-14T13:20:22.245746+0000, chain.objs.size()=1 2024-09-14T11:20:55.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.309+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.8ohumgzRdFVXzU2-xynUAeAb4MZb70d_0 2024-09-14T11:20:55.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.311+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.313+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:20:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.314+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.314+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=11, truncated=0, next_marker='' 2024-09-14T11:20:55.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3935199821906043027', time=2024-09-14T13:12:10.039764+0000, chain.objs.size()=3 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-LUKEWARM.2~eBj0BjRJD-K99v3_6L8GOgRODXgMMja.1 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-LUKEWARM.2~eBj0BjRJD-K99v3_6L8GOgRODXgMMja.2 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.14__multipart_foo-LUKEWARM.2~eBj0BjRJD-K99v3_6L8GOgRODXgMMja.3 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1397585329818829587', time=2024-09-14T13:13:40.314633+0000, chain.objs.size()=1 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.bufTafx3oZphpm4hanrBJotpAbiY0nt_0 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12861579832561906220', time=2024-09-14T13:14:12.855676+0000, chain.objs.size()=1 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.3CijeN1we-FhQXnXyo9eLG4Jmdha_yR_0 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5604043299886477539', time=2024-09-14T13:14:15.663688+0000, chain.objs.size()=1 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.xtM4Wf21VeiLi_QBmVVhylu4zSvpbnF_0 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17298947030784853109', time=2024-09-14T13:15:58.723696+0000, chain.objs.size()=1 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.6MhHc5Q1lEtLwQSbSK3J2upEub7kGXt_0 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2592079314827026167', time=2024-09-14T13:16:00.689189+0000, chain.objs.size()=1 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.oIQwPsivtnDLk_ohPMZB8axlhd4VbQU_0 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8672435938867598742', time=2024-09-14T13:17:42.770327+0000, chain.objs.size()=1 2024-09-14T11:20:55.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.KnceKsEGBQBaB5B3yQmDnSPmEXh0WJ2_0 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8819425908825582311', time=2024-09-14T13:17:44.008818+0000, chain.objs.size()=1 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.CM_YjzQ92Us4bX6oyvzkXCFftCFRS3i_0 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.755941058976709126', time=2024-09-14T13:17:44.013274+0000, chain.objs.size()=1 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.bJi-sygxvH6bjVQwOn9WmckkBHZ5Zix_0 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1530721065678520366', time=2024-09-14T13:17:44.016669+0000, chain.objs.size()=1 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.315+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.36qyvfp4omyYVLafG21g_mWRSkvCAwD_0 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.317+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14135831664421862656', time=2024-09-14T13:20:30.534363+0000, chain.objs.size()=1 2024-09-14T11:20:55.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.317+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18__shadow:S5c6r1b6kziYpKWwT3rvK975qQG7S-H_.byZmoGz_DWK6ZljuJUtqlQdMysaJefp_0 2024-09-14T11:20:55.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.318+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.320+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:20:55.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.322+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12941658060711248239', time=2024-09-14T13:12:09.821760+0000, chain.objs.size()=1 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.DdLH2PJwH4nN_UrjytMzCGl-myMY-J9_0 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_r_bmYYXvEn5eDwS5KmyrOT6iMrbBpqG', time=2024-09-14T13:12:10.006679+0000, chain.objs.size()=2 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.WmcVSZSIc7su-xtdUEZaMXqZDFr1IS-_0 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.16__shadow_.WmcVSZSIc7su-xtdUEZaMXqZDFr1IS-_1 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16174816991201251248', time=2024-09-14T13:13:40.317977+0000, chain.objs.size()=1 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.nDQiTZqfVRgOc5PtigqFrFi1XQkq639_0 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9693704325284495271', time=2024-09-14T13:14:12.852335+0000, chain.objs.size()=1 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.p0_xFZ2IclZBgFUCuKjdi3QnN7dqChr_0 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9453716468096052481', time=2024-09-14T13:14:12.857304+0000, chain.objs.size()=1 2024-09-14T11:20:55.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.21__shadow_.yCIZ3ps2BaM0RD3PhJ5VBetsCjkQANJ_0 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5125374041032780328', time=2024-09-14T13:14:47.964663+0000, chain.objs.size()=1 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.yCSNvWVjM3jOawpNcoC9FSk9ZDUdpSF_0 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1475901677728897815', time=2024-09-14T13:14:47.966965+0000, chain.objs.size()=1 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.OU9hY6NciNP2ikMjNpXL0Fc0_j-Aro__0 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14224064812939414702', time=2024-09-14T13:15:26.371516+0000, chain.objs.size()=1 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.E6ZaSTogyZC_6u_K0xZBkjA9l72G8LR_0 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12284439135175306815', time=2024-09-14T13:16:33.753248+0000, chain.objs.size()=1 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.OXgTdvkNyCL22sgkaWtKisLKl2gW8hQ_0 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7899968581846259009', time=2024-09-14T13:16:34.823244+0000, chain.objs.size()=1 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.exH8sSgdLEy9_2xHH_XeAtcz_82QW4f_0 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.371210228126905158', time=2024-09-14T13:16:35.144726+0000, chain.objs.size()=1 2024-09-14T11:20:55.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.323+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.l4PSrfLYDHjD9NFojCY2rf5wpHV_cJP_0 2024-09-14T11:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.325+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5832857656382260505', time=2024-09-14T13:16:35.148539+0000, chain.objs.size()=1 2024-09-14T11:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.325+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.6aj9MRjzojkGrftnUcgE-rNzZUMHczK_0 2024-09-14T11:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8865566330461400639', time=2024-09-14T13:17:07.082097+0000, chain.objs.size()=1 2024-09-14T11:20:55.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_._VlNGZHVpIDgthnKa7cKH3qEq3EYhnF_0 2024-09-14T11:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17263009222739325628', time=2024-09-14T13:17:42.768132+0000, chain.objs.size()=1 2024-09-14T11:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.SD-9whin-JmHFgZcQiyE4niTUpkQoea_0 2024-09-14T11:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4572727624292071553', time=2024-09-14T13:17:44.008609+0000, chain.objs.size()=1 2024-09-14T11:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.gOcA0j4_taXybnh6T2YKbF-gnAo3RZy_0 2024-09-14T11:20:55.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16607841054908628261', time=2024-09-14T13:17:44.017492+0000, chain.objs.size()=1 2024-09-14T11:20:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.cDEd4C7kb4ReHcfjr8bZzHGdv829QE3_0 2024-09-14T11:20:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5726188205737058386', time=2024-09-14T13:20:34.802321+0000, chain.objs.size()=1 2024-09-14T11:20:55.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.326+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.18__shadow:UDCp3uYhi0Tvn0yLoW2RqjTBLAMHxzl_.aP-J2DG6KCR_VoGkDgGYxbM3vxTplS7_0 2024-09-14T11:20:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.328+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.330+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:20:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.332+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.332+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:20:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5210233232260918325', time=2024-09-14T13:12:09.843194+0000, chain.objs.size()=1 2024-09-14T11:20:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.4__shadow_.rhxGAKITHgINxd8iBZPhlCGy7MKK4ro_0 2024-09-14T11:20:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='_lpjGmOThm35_M2JLNv766-OPHa6kuo1', time=2024-09-14T13:12:09.962282+0000, chain.objs.size()=1 2024-09-14T11:20:55.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.ARV_XqshisJs_tgyBD4Y3ppJAG70ID0_0 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6515135079653143768', time=2024-09-14T13:13:38.317631+0000, chain.objs.size()=1 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.EPKsvV1t14ccbd7Llk_5GDoDkTOtkg6_0 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8134483025172287818', time=2024-09-14T13:13:39.251354+0000, chain.objs.size()=1 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.0Esaj5rC2xkGrpvj5Zp7lXB903qHh83_0 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3959677437948418378', time=2024-09-14T13:13:39.256388+0000, chain.objs.size()=1 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.G687nkIdDGfOPJNcgAdTHue2Ehl-Gl5_0 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12877623694629719959', time=2024-09-14T13:14:14.823592+0000, chain.objs.size()=1 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.XtP-0aftM_Yr8xKjvCSzUSci7_5pN_A_0 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13222792000811669687', time=2024-09-14T13:14:15.663248+0000, chain.objs.size()=1 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.TL4Ga1AAWDQxlzJTJIuydsF3hLRrBJo_0 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4438928287169848373', time=2024-09-14T13:14:49.765500+0000, chain.objs.size()=1 2024-09-14T11:20:55.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.25__shadow_.O-Ay3XD8nsXkUELL26WnN0g7gN2ZlfY_0 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13102455043380080387', time=2024-09-14T13:14:51.829498+0000, chain.objs.size()=1 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.iDcB6_saU4fpqH9MXUKvU4HCyqHlv4n_0 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18064146518270133513', time=2024-09-14T13:14:51.833591+0000, chain.objs.size()=1 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.zs3csP5rLFX7mLIOc9GdgDa7jvwiDmq_0 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14754850907732499018', time=2024-09-14T13:14:51.840894+0000, chain.objs.size()=1 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.26__shadow_.QOqzLcP_7DAP4Zow8cW0WaZWvEim5NA_0 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3651695118615374633', time=2024-09-14T13:15:26.367318+0000, chain.objs.size()=1 2024-09-14T11:20:55.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.333+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.28__shadow_.YoMBns5aQKsqhGWMRxDPc8ZM-SVyR4X_0 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7772430587240224999', time=2024-09-14T13:15:58.721697+0000, chain.objs.size()=1 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.nk3NC6TiE5EKN_3pK4S8dQ8HR_-Q7QU_0 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10279341915306458135', time=2024-09-14T13:15:58.731266+0000, chain.objs.size()=1 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.DZslaAY-42BfutbYxVlBNxvG8Snf4dk_0 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16099401847683339584', time=2024-09-14T13:16:35.138836+0000, chain.objs.size()=1 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.33__shadow_.SlJ3Oc5tkXdedrLDoyrbpUrjbCReL6h_0 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5390554981957054920', time=2024-09-14T13:17:41.004327+0000, chain.objs.size()=1 2024-09-14T11:20:55.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.4JpfQeWDJ1LRkA3-UNdcYBsxuajjVgp_0 2024-09-14T11:20:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8145644027412311182', time=2024-09-14T13:17:44.018518+0000, chain.objs.size()=1 2024-09-14T11:20:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.IAXRWf1ihpo-Tki00i5JZpIaD7TDase_0 2024-09-14T11:20:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.569828978038790269', time=2024-09-14T13:20:22.245646+0000, chain.objs.size()=1 2024-09-14T11:20:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.5ipGpjBYQjMhBynl3E1ktxGN3SYd5Ky_0 2024-09-14T11:20:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1733124250411440464', time=2024-09-14T13:20:22.246420+0000, chain.objs.size()=1 2024-09-14T11:20:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.335+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.17__shadow_.vyXIu5bWt-yu2sWpu2W1tqDCuCaIuAL_0 2024-09-14T11:20:55.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.337+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.338+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:20:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.340+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.340+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:20:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15111954336380300897', time=2024-09-14T13:12:09.923672+0000, chain.objs.size()=1 2024-09-14T11:20:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.b2s6WY3aJUbt4h99swkE8lsqAVhOPro_0 2024-09-14T11:20:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11966027224339076035', time=2024-09-14T13:12:09.954372+0000, chain.objs.size()=1 2024-09-14T11:20:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.15__shadow_.J2C3YWn8zhoORuSSjyQesD1EVZkZNGw_0 2024-09-14T11:20:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11109793874080267897', time=2024-09-14T13:14:47.964720+0000, chain.objs.size()=1 2024-09-14T11:20:55.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.NTdTRM00J_0wm056XQG93zqFxuaxHht_0 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4623383077583089511', time=2024-09-14T13:14:47.971207+0000, chain.objs.size()=1 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.24__shadow_.BqguB5q3eyZ-kVVFpE_wqDyI0dPmRwT_0 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9451827034919872302', time=2024-09-14T13:15:27.394365+0000, chain.objs.size()=1 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.kftXSASXtPpEvv4yQNza7NV-Y02dhll_0 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4236315036090099462', time=2024-09-14T13:15:58.723288+0000, chain.objs.size()=1 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.HR0qUL-gvgl_v3YNiP3hg1WXG4IOHOk_0 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3770863131420316125', time=2024-09-14T13:15:58.725296+0000, chain.objs.size()=1 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.dm4B3migk_S7abPtKLzy5xCej10QtKS_0 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.912980328172659772', time=2024-09-14T13:15:58.728627+0000, chain.objs.size()=1 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.fj6dwv2hFIpDPkENs1AtC9vbwwD-SJF_0 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.979921091302439970', time=2024-09-14T13:15:59.962555+0000, chain.objs.size()=1 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.YZxvzg1LFavlhT15IBsovQFb9zrOfsk_0 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11749038974596149128', time=2024-09-14T13:16:00.695838+0000, chain.objs.size()=1 2024-09-14T11:20:55.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.lpGSBPa_k7M3ncOd7vGJV4P6N47JGm-_0 2024-09-14T11:20:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16595939042604743658', time=2024-09-14T13:16:01.944642+0000, chain.objs.size()=1 2024-09-14T11:20:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.dxkZzohhXolv9nw59elFqjUqI7_GelJ_0 2024-09-14T11:20:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4086907792377057873', time=2024-09-14T13:16:01.951105+0000, chain.objs.size()=1 2024-09-14T11:20:55.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.341+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.31__shadow_.W3xQOpipMSNdtRA-K2Sy3STh9L5aCjY_0 2024-09-14T11:20:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1831997462656593975', time=2024-09-14T13:16:33.748716+0000, chain.objs.size()=1 2024-09-14T11:20:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.ZIzFhGvN7NQ6VO4l4xKnriQSIC14vIy_0 2024-09-14T11:20:55.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14700838333555618532', time=2024-09-14T13:16:33.751237+0000, chain.objs.size()=1 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.zLiI0e3zlnOcpw9WDPWVSQ000EVv-_X_0 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12818338940267891116', time=2024-09-14T13:17:41.007872+0000, chain.objs.size()=1 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.36__shadow_.iKqJpQpNxdQ_4CUzH2KXoIxrCcHAJjx_0 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12191943097325759582', time=2024-09-14T13:17:42.766100+0000, chain.objs.size()=1 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.37__shadow_.kfYpmknB9sIUdmor1a2RAKVd3Y7xaoD_0 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15483847330063764222', time=2024-09-14T13:17:44.011515+0000, chain.objs.size()=1 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.344+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.38__shadow_.S0zs-Nc4PgTfifXsgKtLvIbiRv4ZKTx_0 2024-09-14T11:20:55.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.345+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.348+0000 7f60e5f39800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:20:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.349+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.349+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=12, truncated=0, next_marker='' 2024-09-14T11:20:55.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6157637694194705880', time=2024-09-14T13:13:39.256746+0000, chain.objs.size()=1 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.19__shadow_.-rtFtSoWoyb93Q-utLLwEBBVsZOKtTj_0 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3603724758155926038', time=2024-09-14T13:13:40.317938+0000, chain.objs.size()=1 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.20__shadow_.mOJOt9oPiZYdqB9k3crLZ_tZ9DhZe_r_0 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13033494201736544496', time=2024-09-14T13:14:14.819030+0000, chain.objs.size()=1 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.DWjQAENNLGnCPqOVij_nN0NLKqV45LL_0 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15249470685399319870', time=2024-09-14T13:14:14.820112+0000, chain.objs.size()=1 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.22__shadow_.3vURGbzW5nDjQDt1GHP_4K-oJAChNiX_0 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5851786893616408551', time=2024-09-14T13:14:15.666197+0000, chain.objs.size()=1 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.kHgcSMRZzF_FoGuM8HRjYEqUhq1SlT9_0 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7135709798344480667', time=2024-09-14T13:14:15.670239+0000, chain.objs.size()=1 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.23__shadow_.vL5UiLz_ynMVt0XCC0Ocv9egC73kLao_0 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10791237275400999436', time=2024-09-14T13:15:58.721954+0000, chain.objs.size()=1 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.29__shadow_.Nqo4hQIfkXij3Qlcd1-OZTHuHwb0NhA_0 2024-09-14T11:20:55.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18118469303182467561', time=2024-09-14T13:16:00.695780+0000, chain.objs.size()=1 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.30__shadow_.a7Em-6yaGqAGxnheIYOfPDm-DVTJaEp_0 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15630489497290881270', time=2024-09-14T13:16:33.749359+0000, chain.objs.size()=1 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.32__shadow_.MoiADaNOKN2ehIFuNWH0IbDAOSZ2fxX_0 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6031358087609170322', time=2024-09-14T13:16:36.174410+0000, chain.objs.size()=1 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.5SXJffrp2t4yhSeWu4F7C7KnwmIbU9o_0 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16921666218312031477', time=2024-09-14T13:17:07.082371+0000, chain.objs.size()=1 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.ozYVKeiCi0ga5m9sAc94VgsJblyKw4D_0 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3020213401890094757', time=2024-09-14T13:17:07.083258+0000, chain.objs.size()=1 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.350+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.34__shadow_.ndbc6oGDvLcDdb-CCjo6cPk6-XbUh-k_0 2024-09-14T11:20:55.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.352+0000 7f60e5f39800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:20:55.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.355+0000 7f5f937fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:55.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.357+0000 7f60e5f39800 20 remove_watcher() i=0 2024-09-14T11:20:55.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.357+0000 7f60e5f39800 2 removed watcher, disabling cache 2024-09-14T11:20:55.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.358+0000 7f60e5f39800 20 remove_watcher() i=1 2024-09-14T11:20:55.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.359+0000 7f60e5f39800 20 remove_watcher() i=2 2024-09-14T11:20:55.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.360+0000 7f60e5f39800 20 remove_watcher() i=3 2024-09-14T11:20:55.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.361+0000 7f60e5f39800 20 remove_watcher() i=4 2024-09-14T11:20:55.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.362+0000 7f60e5f39800 20 remove_watcher() i=5 2024-09-14T11:20:55.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.363+0000 7f60e5f39800 20 remove_watcher() i=6 2024-09-14T11:20:55.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.364+0000 7f60e5f39800 20 remove_watcher() i=7 2024-09-14T11:20:55.374 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:20:55.467 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:20:55.467 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:20:55.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.509+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.510+0000 7f3fdc80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.510+0000 7f3fdc80f800 20 realm 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.510+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.510+0000 7f3fdc80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.510+0000 7f3fdc80f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.510+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.511+0000 7f3fdc80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.511+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.511+0000 7f3fdc80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.511+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.512+0000 7f3fdc80f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:20:55.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.512+0000 7f3fdc80f800 20 searching for the correct realm 2024-09-14T11:20:55.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.516+0000 7f3fdab01640 0 -- 172.21.15.2:0/2458355178 >> [v2:172.21.15.86:6826/3650976683,v1:172.21.15.86:6827/3650976683] conn(0x7f3fc406c330 msgr2=0x7f3fc406bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:55.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.722+0000 7f3fda300640 0 -- 172.21.15.2:0/2458355178 >> [v2:172.21.15.86:6810/3386010674,v1:172.21.15.86:6811/3386010674] conn(0x562586961a70 msgr2=0x562586963e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:20:55.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:20:55.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:20:55.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:20:55.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.725+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:20:55.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 20 zone default found 2024-09-14T11:20:55.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 4 Realm: () 2024-09-14T11:20:55.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:20:55.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:20:55.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 20 zonegroup default 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.726+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.727+0000 7f3fdc80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.727+0000 7f3fdc80f800 20 rados->read ofs=0 len=0 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.727+0000 7f3fdc80f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.727+0000 7f3fdc80f800 20 started sync module instance, tier type = 2024-09-14T11:20:55.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.727+0000 7f3fdc80f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.735+0000 7f3fdc80f800 20 add_watcher() i=0 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.735+0000 7f3fdc80f800 20 add_watcher() i=1 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.735+0000 7f3fdc80f800 20 add_watcher() i=2 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.735+0000 7f3fdc80f800 20 add_watcher() i=3 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.735+0000 7f3fdc80f800 20 add_watcher() i=4 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.735+0000 7f3fdc80f800 20 add_watcher() i=5 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.735+0000 7f3fdc80f800 20 add_watcher() i=6 2024-09-14T11:20:55.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.736+0000 7f3fdc80f800 20 add_watcher() i=7 2024-09-14T11:20:55.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.736+0000 7f3fdc80f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:20:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.738+0000 7f3e90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.738+0000 7f3fdc80f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:20:55.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.738+0000 7f3fdc80f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:20:55.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.772+0000 7f3e0b7fe640 20 reqs_thread_entry: start 2024-09-14T11:20:55.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.772+0000 7f3fdc80f800 20 init_complete bucket index max shards: 1 2024-09-14T11:20:55.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.772+0000 7f3fdc80f800 20 Filter name: none 2024-09-14T11:20:55.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.772+0000 7f3e097fa640 20 reqs_thread_entry: start 2024-09-14T11:20:55.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.772+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:20:55.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.774+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.775+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.775+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.776+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:20:55.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.778+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.778+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.778+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.779+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:20:55.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.781+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.781+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.779 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.781+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.782+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:20:55.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.783+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.784+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.784+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.785+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:20:55.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.786+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.787+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.787+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.788+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:20:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.789+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.789+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.790+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.791+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:20:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.792+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.792+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.793+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.793+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:20:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.795+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.796+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.796+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.797+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:20:55.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.798+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.799+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.799+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.800+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:20:55.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.801+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.802+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.802+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.803+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:20:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.805+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.805+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.805+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.806+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:20:55.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.808+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.808+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.808+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.809+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:20:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.811+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.811+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.811+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.812+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:20:55.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.814+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.814+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.815+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.816+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:20:55.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.817+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.818+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.818+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.819+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:20:55.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.820+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.821+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.821+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.822+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:20:55.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.823+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.824+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.824+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.825+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:20:55.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.826+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.827+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.827+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.828+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:20:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.829+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.830+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.830+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.831+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:20:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.833+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.833+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.833+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.834+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:20:55.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.836+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.836+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.836+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.838+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:20:55.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.839+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.839+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.839+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.841+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:20:55.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.842+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.842+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.843+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.844+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:20:55.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.845+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.846+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.847+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.848+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:20:55.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.849+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.850+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.850+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.851+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:20:55.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.852+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.853+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.853+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.854+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:20:55.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.855+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.856+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.856+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.857+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:20:55.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.858+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.858+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.859+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.860+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:20:55.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.861+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.862+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.862+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.863+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:20:55.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.864+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.864+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.865+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.866+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:20:55.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.867+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.867+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.868+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.869+0000 7f3fdc80f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:20:55.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.870+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.871+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:20:55.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.871+0000 7f3fdc80f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:20:55.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.873+0000 7f3e90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:20:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.875+0000 7f3fdc80f800 20 remove_watcher() i=0 2024-09-14T11:20:55.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.875+0000 7f3fdc80f800 2 removed watcher, disabling cache 2024-09-14T11:20:55.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.877+0000 7f3fdc80f800 20 remove_watcher() i=1 2024-09-14T11:20:55.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.878+0000 7f3fdc80f800 20 remove_watcher() i=2 2024-09-14T11:20:55.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.879+0000 7f3fdc80f800 20 remove_watcher() i=3 2024-09-14T11:20:55.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.880+0000 7f3fdc80f800 20 remove_watcher() i=4 2024-09-14T11:20:55.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.881+0000 7f3fdc80f800 20 remove_watcher() i=5 2024-09-14T11:20:55.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.882+0000 7f3fdc80f800 20 remove_watcher() i=6 2024-09-14T11:20:55.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:20:55.882+0000 7f3fdc80f800 20 remove_watcher() i=7 2024-09-14T11:20:55.892 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-14T11:20:56.419 INFO:teuthology.orchestra.run.smithi002.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-14T11:21:00.120 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :clean UP-TO-DATE 2024-09-14T11:21:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :compileJava 2024-09-14T11:21:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :processResources 2024-09-14T11:21:18.119 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :classes 2024-09-14T11:21:18.820 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:18.820 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :compileTestJava 2024-09-14T11:21:18.820 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:18.821 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:21:18.821 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :testClasses 2024-09-14T11:21:18.821 INFO:teuthology.orchestra.run.smithi002.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:21:18.821 INFO:teuthology.orchestra.run.smithi002.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:21:24.819 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :test 2024-09-14T11:21:24.819 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:24.819 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-14T11:21:25.518 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:25.519 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-14T11:21:25.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:25.718 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-14T11:21:25.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:25.818 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-14T11:21:26.018 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:26.018 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-14T11:21:26.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:26.719 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-14T11:21:26.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:26.918 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:21:26.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:26.919 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:21:27.018 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:27.018 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-14T11:21:27.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:27.019 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-14T11:21:27.218 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:27.218 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-14T11:21:27.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:27.618 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-14T11:21:27.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:27.918 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:21:28.018 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:28.019 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-14T11:21:28.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14 11:21:28,007 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:21:31.619 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:31.619 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:21:31.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:31.919 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-14T11:21:31.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:31.919 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-14T11:21:32.119 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:32.119 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-14T11:21:32.119 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:32.119 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-14T11:21:32.418 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:32.418 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-14T11:21:32.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:32.919 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-14T11:21:33.119 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:33.119 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-14T11:21:33.119 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:33.119 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-14T11:21:33.218 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:33.218 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-14T11:21:35.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:35.619 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-14T11:21:35.818 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:35.818 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:21:36.218 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:36.219 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:21:36.418 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:36.418 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-14T11:21:36.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:36.719 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-14T11:21:36.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:36.918 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-14T11:21:43.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:43.719 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-14T11:21:43.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:43.918 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-14T11:21:44.819 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:44.819 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-14T11:21:45.018 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:45.018 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-14T11:21:45.518 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:45.519 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-14T11:21:45.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:45.718 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-14T11:21:46.019 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.019 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-14T11:21:46.219 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.219 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-14T11:21:46.219 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.219 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-14T11:21:46.418 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.418 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-14T11:21:46.518 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.519 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-14T11:21:46.618 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.618 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-14T11:21:46.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.719 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-14T11:21:46.918 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.919 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-14T11:21:46.919 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:46.919 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-14T11:21:47.118 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:47.118 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-14T11:21:47.118 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:47.118 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-14T11:21:47.318 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:47.318 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-14T11:21:47.318 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:47.318 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-14T11:21:47.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:47.519 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-14T11:21:47.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:47.519 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-14T11:21:47.718 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:47.718 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-14T11:21:48.318 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:48.319 INFO:teuthology.orchestra.run.smithi002.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-14T11:21:48.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:48.519 INFO:teuthology.orchestra.run.smithi002.stdout:---------------------------------------------------------------------- 2024-09-14T11:21:48.519 INFO:teuthology.orchestra.run.smithi002.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-14T11:21:48.519 INFO:teuthology.orchestra.run.smithi002.stdout:---------------------------------------------------------------------- 2024-09-14T11:21:48.519 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:48.519 INFO:teuthology.orchestra.run.smithi002.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:21:48.520 INFO:teuthology.orchestra.run.smithi002.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:21:48.520 INFO:teuthology.orchestra.run.smithi002.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:21:48.520 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:48.520 INFO:teuthology.orchestra.run.smithi002.stdout:BUILD SUCCESSFUL in 52s 2024-09-14T11:21:48.520 INFO:teuthology.orchestra.run.smithi002.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-14T11:21:48.859 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:48.914 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:48.914 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:48.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.954+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.955+0000 7f5d7f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.955+0000 7f5d7f498800 20 realm 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.955+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.955+0000 7f5d7f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.955+0000 7f5d7f498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.955+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.956+0000 7f5d7f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:48.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.956+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.957+0000 7f5d7f498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.957+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.957+0000 7f5d7f498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:48.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.957+0000 7f5d7f498800 20 searching for the correct realm 2024-09-14T11:21:48.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.960+0000 7f5d7d783640 0 -- 172.21.15.2:0/2233886146 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f5d680b5420 msgr2=0x7f5d680b5b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:48.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.964+0000 7f5d7cf82640 0 -- 172.21.15.2:0/2233886146 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f5d680b4df0 msgr2=0x7f5d680b03a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.968+0000 7f5d7f498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.968+0000 7f5d7f498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.968+0000 7f5d7f498800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.968+0000 7f5d7f498800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.968+0000 7f5d7f498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.968+0000 7f5d7f498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:48.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 zone default found 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 4 Realm: () 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 zonegroup default 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.969+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.970+0000 7f5d7f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:48.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.970+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.970+0000 7f5d7f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.970+0000 7f5d7f498800 20 rados->read ofs=0 len=0 2024-09-14T11:21:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.970+0000 7f5d7f498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.970+0000 7f5d7f498800 20 started sync module instance, tier type = 2024-09-14T11:21:48.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.970+0000 7f5d7f498800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.979+0000 7f5d7f498800 20 add_watcher() i=0 2024-09-14T11:21:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.979+0000 7f5d7f498800 20 add_watcher() i=1 2024-09-14T11:21:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.979+0000 7f5d7f498800 20 add_watcher() i=2 2024-09-14T11:21:48.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.979+0000 7f5d7f498800 20 add_watcher() i=3 2024-09-14T11:21:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.979+0000 7f5d7f498800 20 add_watcher() i=4 2024-09-14T11:21:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.979+0000 7f5d7f498800 20 add_watcher() i=5 2024-09-14T11:21:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.979+0000 7f5d7f498800 20 add_watcher() i=6 2024-09-14T11:21:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.980+0000 7f5d7f498800 20 add_watcher() i=7 2024-09-14T11:21:48.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.980+0000 7f5d7f498800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.981+0000 7f5c32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.982+0000 7f5d7f498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:48.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:48.982+0000 7f5d7f498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.016+0000 7f5c31fe3640 20 reqs_thread_entry: start 2024-09-14T11:21:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.016+0000 7f5d7f498800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.016+0000 7f5d7f498800 20 Filter name: none 2024-09-14T11:21:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.016+0000 7f5ba37fe640 20 reqs_thread_entry: start 2024-09-14T11:21:49.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.016+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.018+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.018+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.019+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.019+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11764608872576466696', time=2024-09-14T13:21:44.325529+0000, chain.objs.size()=1 2024-09-14T11:21:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.019+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.56__shadow_.U_nvmsBM5PqkwpENEI-VsDgTrtW-Izg_0 2024-09-14T11:21:49.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.019+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.021+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.688881274929322309', time=2024-09-14T13:21:45.533702+0000, chain.objs.size()=5 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.57__multipart_key1.2~eF6ckvgQLRdYM9-CAetK6GsbmevYkW0.1 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.57__multipart_key1.2~eF6ckvgQLRdYM9-CAetK6GsbmevYkW0.2 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.57__multipart_key1.2~eF6ckvgQLRdYM9-CAetK6GsbmevYkW0.3 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.023+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.57__multipart_key1.2~eF6ckvgQLRdYM9-CAetK6GsbmevYkW0.4 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.024+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.57__multipart_key1.2~eF6ckvgQLRdYM9-CAetK6GsbmevYkW0.5 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.024+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7640080778563853601', time=2024-09-14T13:21:47.140110+0000, chain.objs.size()=1 2024-09-14T11:21:49.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.024+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.63__shadow_.2F_gtJFu9t9M-eagp3JI6ILzRQEQmKv_0 2024-09-14T11:21:49.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.026+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.028+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:49.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.029+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.030+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.030+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.030+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13393999193792100545', time=2024-09-14T13:21:47.348437+0000, chain.objs.size()=1 2024-09-14T11:21:49.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.030+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.64__shadow_.xCfxGreD_R2JxtXhEaS3WpCZf6bFCkm_0 2024-09-14T11:21:49.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.031+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.033+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:49.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.034+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='2~0PV857tHAeIHOMd5k9rl2vi1ITHgoAJ', time=2024-09-14T13:21:25.482456+0000, chain.objs.size()=5 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.40__multipart_key1.2~0PV857tHAeIHOMd5k9rl2vi1ITHgoAJ.1 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.40__multipart_key1.2~0PV857tHAeIHOMd5k9rl2vi1ITHgoAJ.2 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.40__multipart_key1.2~0PV857tHAeIHOMd5k9rl2vi1ITHgoAJ.3 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.40__multipart_key1.2~0PV857tHAeIHOMd5k9rl2vi1ITHgoAJ.4 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.40__multipart_key1.2~0PV857tHAeIHOMd5k9rl2vi1ITHgoAJ.5 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17906229164056423444', time=2024-09-14T13:21:31.469297+0000, chain.objs.size()=5 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~CGsBQbmbThWnrULU3iza8D3rBsbpSAu.1 2024-09-14T11:21:49.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__shadow_key1.2~CGsBQbmbThWnrULU3iza8D3rBsbpSAu.1_1 2024-09-14T11:21:49.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~CGsBQbmbThWnrULU3iza8D3rBsbpSAu.2 2024-09-14T11:21:49.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__shadow_key1.2~CGsBQbmbThWnrULU3iza8D3rBsbpSAu.2_1 2024-09-14T11:21:49.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~CGsBQbmbThWnrULU3iza8D3rBsbpSAu.3 2024-09-14T11:21:49.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5674137641661684473', time=2024-09-14T13:21:35.632979+0000, chain.objs.size()=5 2024-09-14T11:21:49.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.52__multipart_key1.2~UdtlXUNDyQ-hpJC83MQHsT9CBfGhIf4.1 2024-09-14T11:21:49.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.035+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.52__multipart_key1.2~UdtlXUNDyQ-hpJC83MQHsT9CBfGhIf4.2 2024-09-14T11:21:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.039+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.52__multipart_key1.2~UdtlXUNDyQ-hpJC83MQHsT9CBfGhIf4.3 2024-09-14T11:21:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.039+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.52__multipart_key1.2~UdtlXUNDyQ-hpJC83MQHsT9CBfGhIf4.4 2024-09-14T11:21:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.039+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.52__multipart_key1.2~UdtlXUNDyQ-hpJC83MQHsT9CBfGhIf4.5 2024-09-14T11:21:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.039+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10899425477021672145', time=2024-09-14T13:21:36.293125+0000, chain.objs.size()=1 2024-09-14T11:21:49.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.039+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__shadow_.97Rwy0ExQi4z4i4ByZ5EV2mr2IwSc1d_0 2024-09-14T11:21:49.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.042+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.045+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:49.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.046+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.047+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.047+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.048+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:49.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.049+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.050+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.050+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.050+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17570678043513739074', time=2024-09-14T13:21:46.722517+0000, chain.objs.size()=1 2024-09-14T11:21:49.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.050+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.61__shadow_.-dD8MQZWbfinQMiL2WiMZCWCvNra9LS_0 2024-09-14T11:21:49.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.051+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.053+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:49.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.054+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.055+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.055+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.056+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.057+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.057+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.058+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.058+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13304930459290720334', time=2024-09-14T13:21:31.720672+0000, chain.objs.size()=4 2024-09-14T11:21:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.058+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.46__shadow_.66Jsar6hLwejoGz5UNi3_pJg8dRpJMN_0 2024-09-14T11:21:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.058+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.46__shadow_.66Jsar6hLwejoGz5UNi3_pJg8dRpJMN_1 2024-09-14T11:21:49.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.058+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.46__shadow_.66Jsar6hLwejoGz5UNi3_pJg8dRpJMN_2 2024-09-14T11:21:49.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.058+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.46__shadow_.66Jsar6hLwejoGz5UNi3_pJg8dRpJMN_3 2024-09-14T11:21:49.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.061+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.063+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6946442257550738246', time=2024-09-14T13:21:48.317943+0000, chain.objs.size()=11 2024-09-14T11:21:49.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.1 2024-09-14T11:21:49.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.2 2024-09-14T11:21:49.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.3 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.4 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.5 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.6 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.7 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.8 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.9 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.065+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.10 2024-09-14T11:21:49.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.066+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.66__multipart_key1.2~f4h1FA-vQEegV2agyNPniXxP4tvwcqb.11 2024-09-14T11:21:49.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.070+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.072+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:49.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.073+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.073+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.074+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.075+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:49.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.076+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10258477464481472856', time=2024-09-14T13:21:29.150599+0000, chain.objs.size()=5 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~ZPBj_vInhl-kw4__beOH-OLdldWws-b.1 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~ZPBj_vInhl-kw4__beOH-OLdldWws-b.2 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~ZPBj_vInhl-kw4__beOH-OLdldWws-b.3 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~ZPBj_vInhl-kw4__beOH-OLdldWws-b.4 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~ZPBj_vInhl-kw4__beOH-OLdldWws-b.5 2024-09-14T11:21:49.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='2~qveM06uZIBxno9DkwSmI292OdmJwnlq', time=2024-09-14T13:21:36.788448+0000, chain.objs.size()=3 2024-09-14T11:21:49.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.54__multipart_key1.2~qveM06uZIBxno9DkwSmI292OdmJwnlq.7 2024-09-14T11:21:49.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.54__multipart_key1.2~qveM06uZIBxno9DkwSmI292OdmJwnlq.10 2024-09-14T11:21:49.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.077+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.54__multipart_key1.2~qveM06uZIBxno9DkwSmI292OdmJwnlq.13 2024-09-14T11:21:49.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.081+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.082+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:49.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.084+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.084+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.084+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.084+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6127784339053020347', time=2024-09-14T13:21:30.646222+0000, chain.objs.size()=5 2024-09-14T11:21:49.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.084+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~AdEZ3vjCvkgUoV0GvYuHuwS1k30vf3G.1 2024-09-14T11:21:49.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.084+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~AdEZ3vjCvkgUoV0GvYuHuwS1k30vf3G.2 2024-09-14T11:21:49.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.084+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~AdEZ3vjCvkgUoV0GvYuHuwS1k30vf3G.3 2024-09-14T11:21:49.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.085+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~AdEZ3vjCvkgUoV0GvYuHuwS1k30vf3G.4 2024-09-14T11:21:49.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.085+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~AdEZ3vjCvkgUoV0GvYuHuwS1k30vf3G.5 2024-09-14T11:21:49.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.087+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.089+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:49.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7237246244014092453', time=2024-09-14T13:21:27.721004+0000, chain.objs.size()=5 2024-09-14T11:21:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.1 2024-09-14T11:21:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.2 2024-09-14T11:21:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.3 2024-09-14T11:21:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.4 2024-09-14T11:21:49.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.091+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.5 2024-09-14T11:21:49.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.093+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.095+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.096+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.096+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.097+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.098+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.099+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.099+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:21:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3709146055767755091', time=2024-09-14T13:21:36.270742+0000, chain.objs.size()=5 2024-09-14T11:21:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file.mpg.2~Ja5ru0vAxo9I7nv2FI2I-F2sE3o-ObJ.1 2024-09-14T11:21:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file.mpg.2~Ja5ru0vAxo9I7nv2FI2I-F2sE3o-ObJ.2 2024-09-14T11:21:49.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file.mpg.2~Ja5ru0vAxo9I7nv2FI2I-F2sE3o-ObJ.3 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file.mpg.2~Ja5ru0vAxo9I7nv2FI2I-F2sE3o-ObJ.4 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file.mpg.2~Ja5ru0vAxo9I7nv2FI2I-F2sE3o-ObJ.5 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8213544864979662696', time=2024-09-14T13:21:36.276862+0000, chain.objs.size()=1 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__shadow_.5Sx607xZLX0LgtXMFblJLC9M0ZdSb0C_0 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13258515028746874020', time=2024-09-14T13:21:43.775626+0000, chain.objs.size()=11 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.1 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.1_1 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.2 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.2_1 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.3 2024-09-14T11:21:49.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.100+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.3_1 2024-09-14T11:21:49.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.104+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.4 2024-09-14T11:21:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.106+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.4_1 2024-09-14T11:21:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.106+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.5 2024-09-14T11:21:49.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.106+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.5_1 2024-09-14T11:21:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.106+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~m-yxBhuZd-Yk6I4FMfQXe7QHFdna4ou.6 2024-09-14T11:21:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.106+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11978336082751298747', time=2024-09-14T13:21:46.300934+0000, chain.objs.size()=1 2024-09-14T11:21:49.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.106+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.59__shadow_.tCbMZwTEj4KWtpp1Wjke4ejObqLyr02_0 2024-09-14T11:21:49.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.109+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.111+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:49.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.112+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.113+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.113+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.113+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7532972484053563673', time=2024-09-14T13:21:36.287969+0000, chain.objs.size()=1 2024-09-14T11:21:49.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.113+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__shadow_.6iP2GalgsSgP6moQIMqz4c313Q6vDXR_0 2024-09-14T11:21:49.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.114+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.116+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:49.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.117+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.118+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.118+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.119+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.121+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.121+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.121+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.121+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8338293185629583503', time=2024-09-14T13:21:31.610093+0000, chain.objs.size()=5 2024-09-14T11:21:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.121+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~m1nhjG-7WuEmx_lBI74UjJCj6juzwmA.1 2024-09-14T11:21:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__shadow_key1.2~m1nhjG-7WuEmx_lBI74UjJCj6juzwmA.1_1 2024-09-14T11:21:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~m1nhjG-7WuEmx_lBI74UjJCj6juzwmA.2 2024-09-14T11:21:49.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__shadow_key1.2~m1nhjG-7WuEmx_lBI74UjJCj6juzwmA.2_1 2024-09-14T11:21:49.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~m1nhjG-7WuEmx_lBI74UjJCj6juzwmA.3 2024-09-14T11:21:49.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13532076850037056911', time=2024-09-14T13:21:36.282518+0000, chain.objs.size()=5 2024-09-14T11:21:49.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file2.mpg.2~4UqhVSaq_LZ4DhA000b-awBAahNXXOh.1 2024-09-14T11:21:49.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file2.mpg.2~4UqhVSaq_LZ4DhA000b-awBAahNXXOh.2 2024-09-14T11:21:49.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file2.mpg.2~4UqhVSaq_LZ4DhA000b-awBAahNXXOh.3 2024-09-14T11:21:49.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file2.mpg.2~4UqhVSaq_LZ4DhA000b-awBAahNXXOh.4 2024-09-14T11:21:49.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.122+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.53__multipart_file2.mpg.2~4UqhVSaq_LZ4DhA000b-awBAahNXXOh.5 2024-09-14T11:21:49.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.127+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.129+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.130+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.130+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:49.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14419446186590696564', time=2024-09-14T13:21:32.963360+0000, chain.objs.size()=5 2024-09-14T11:21:49.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.51__multipart_key1.2~xlpemAspNiqdjOloxZUR_UozMKVMAwA.1 2024-09-14T11:21:49.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.51__multipart_key1.2~xlpemAspNiqdjOloxZUR_UozMKVMAwA.2 2024-09-14T11:21:49.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.51__multipart_key1.2~xlpemAspNiqdjOloxZUR_UozMKVMAwA.3 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.51__multipart_key1.2~xlpemAspNiqdjOloxZUR_UozMKVMAwA.4 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.51__multipart_key1.2~xlpemAspNiqdjOloxZUR_UozMKVMAwA.5 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.566748732238849383', time=2024-09-14T13:21:44.885754+0000, chain.objs.size()=5 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.56__multipart_key1.2~44yHHDzEyVh1ji9OA0PdwlNUmhgfzng.1 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.56__multipart_key1.2~44yHHDzEyVh1ji9OA0PdwlNUmhgfzng.2 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.56__multipart_key1.2~44yHHDzEyVh1ji9OA0PdwlNUmhgfzng.3 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.56__multipart_key1.2~44yHHDzEyVh1ji9OA0PdwlNUmhgfzng.4 2024-09-14T11:21:49.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.131+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.56__multipart_key1.2~44yHHDzEyVh1ji9OA0PdwlNUmhgfzng.5 2024-09-14T11:21:49.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.135+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.137+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:49.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.139+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.139+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4106353031020086371', time=2024-09-14T13:21:41.130555+0000, chain.objs.size()=10 2024-09-14T11:21:49.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.1 2024-09-14T11:21:49.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.2 2024-09-14T11:21:49.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.3 2024-09-14T11:21:49.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.4 2024-09-14T11:21:49.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.5 2024-09-14T11:21:49.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.6 2024-09-14T11:21:49.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.7 2024-09-14T11:21:49.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.8 2024-09-14T11:21:49.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.9 2024-09-14T11:21:49.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.140+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~_phWf1C__VVaoFVrCP-5s-slvLlXW4S.10 2024-09-14T11:21:49.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.144+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.146+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:49.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.147+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.97826874861885638', time=2024-09-14T13:21:43.031654+0000, chain.objs.size()=11 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.1 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.1_1 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.2 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.2_1 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.3 2024-09-14T11:21:49.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.3_1 2024-09-14T11:21:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.4 2024-09-14T11:21:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.4_1 2024-09-14T11:21:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.5 2024-09-14T11:21:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.5_1 2024-09-14T11:21:49.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.148+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~jEXyQri5yIvNkpKJyZXnIQd2j_hxHiV.6 2024-09-14T11:21:49.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.153+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.155+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:49.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.156+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16008859356635996845', time=2024-09-14T13:21:27.606575+0000, chain.objs.size()=5 2024-09-14T11:21:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.1 2024-09-14T11:21:49.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.2 2024-09-14T11:21:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.3 2024-09-14T11:21:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.4 2024-09-14T11:21:49.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.157+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.44__multipart_key1.2~sH1J_Ec6nTZE9gJI-_LATyy8WKSmrRV.5 2024-09-14T11:21:49.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.160+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.162+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:49.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.163+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.514247470095870295', time=2024-09-14T13:21:43.637437+0000, chain.objs.size()=11 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.1 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.1_1 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.2 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.2_1 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.3 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.3_1 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.4 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.4_1 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.5 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__shadow_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.5_1 2024-09-14T11:21:49.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.164+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~o1Y_xyjEq0f-YP9eZpbmtA_rLZ_0Ati.6 2024-09-14T11:21:49.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.168+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.170+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:49.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.171+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.172+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.172+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.173+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:49.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.174+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.174+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.175+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.175+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15436671239826911719', time=2024-09-14T13:21:30.233656+0000, chain.objs.size()=5 2024-09-14T11:21:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.175+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~OwDVK1eEDsT-GG4mFuJeIqfm6F7ngjO.1 2024-09-14T11:21:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.175+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~OwDVK1eEDsT-GG4mFuJeIqfm6F7ngjO.2 2024-09-14T11:21:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.175+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~OwDVK1eEDsT-GG4mFuJeIqfm6F7ngjO.3 2024-09-14T11:21:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.175+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~OwDVK1eEDsT-GG4mFuJeIqfm6F7ngjO.4 2024-09-14T11:21:49.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.175+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~OwDVK1eEDsT-GG4mFuJeIqfm6F7ngjO.5 2024-09-14T11:21:49.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.177+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.180+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:49.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.181+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.182+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.182+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.182+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11608061655864344646', time=2024-09-14T13:21:46.929862+0000, chain.objs.size()=1 2024-09-14T11:21:49.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.182+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.62__shadow_.UFjHUCFCWzi8p4v5DR5twoMkHK510j7_0 2024-09-14T11:21:49.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.183+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.185+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:49.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.187+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.187+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.188+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.188+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16590675177541549317', time=2024-09-14T13:21:46.511363+0000, chain.objs.size()=1 2024-09-14T11:21:49.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.188+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.60__shadow_.BiiCAHIG7be2v9LfM9Ju7_CDHwMELRl_0 2024-09-14T11:21:49.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.189+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.191+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:49.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.192+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.193+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.193+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.194+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:49.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.195+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:21:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14642985794490989385', time=2024-09-14T13:21:38.414644+0000, chain.objs.size()=11 2024-09-14T11:21:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.1 2024-09-14T11:21:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.2 2024-09-14T11:21:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.3 2024-09-14T11:21:49.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.4 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.5 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.6 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.7 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.8 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.9 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.10 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~-_OXARYthD8dCtjV4Xw-35y07tgduXt.11 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3', time=2024-09-14T13:21:46.133798+0000, chain.objs.size()=92 2024-09-14T11:21:49.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.196+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.1 2024-09-14T11:21:49.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.200+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.2 2024-09-14T11:21:49.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.200+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.3 2024-09-14T11:21:49.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.200+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.4 2024-09-14T11:21:49.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.200+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.5 2024-09-14T11:21:49.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.200+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.6 2024-09-14T11:21:49.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.200+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.7 2024-09-14T11:21:49.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.201+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.8 2024-09-14T11:21:49.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.201+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.9 2024-09-14T11:21:49.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.201+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.10 2024-09-14T11:21:49.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.201+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.11 2024-09-14T11:21:49.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.201+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.12 2024-09-14T11:21:49.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.202+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.13 2024-09-14T11:21:49.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.202+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.14 2024-09-14T11:21:49.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.15 2024-09-14T11:21:49.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.16 2024-09-14T11:21:49.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.17 2024-09-14T11:21:49.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.18 2024-09-14T11:21:49.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.19 2024-09-14T11:21:49.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.20 2024-09-14T11:21:49.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.21 2024-09-14T11:21:49.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.22 2024-09-14T11:21:49.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.203+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.23 2024-09-14T11:21:49.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.204+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.24 2024-09-14T11:21:49.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.204+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.25 2024-09-14T11:21:49.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.26 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.27 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.28 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.29 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.30 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.31 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.32 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.33 2024-09-14T11:21:49.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.205+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.34 2024-09-14T11:21:49.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.206+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.35 2024-09-14T11:21:49.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.206+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.36 2024-09-14T11:21:49.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.206+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.37 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.38 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.39 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.40 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.41 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.42 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.43 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.44 2024-09-14T11:21:49.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.207+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.45 2024-09-14T11:21:49.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.46 2024-09-14T11:21:49.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.47 2024-09-14T11:21:49.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.48 2024-09-14T11:21:49.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.49 2024-09-14T11:21:49.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.50 2024-09-14T11:21:49.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.51 2024-09-14T11:21:49.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.52 2024-09-14T11:21:49.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.53 2024-09-14T11:21:49.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.209+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.54 2024-09-14T11:21:49.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.210+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.55 2024-09-14T11:21:49.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.210+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.56 2024-09-14T11:21:49.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.211+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.57 2024-09-14T11:21:49.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.211+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.58 2024-09-14T11:21:49.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.211+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.59 2024-09-14T11:21:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.211+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.60 2024-09-14T11:21:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.61 2024-09-14T11:21:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.62 2024-09-14T11:21:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.63 2024-09-14T11:21:49.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.64 2024-09-14T11:21:49.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.65 2024-09-14T11:21:49.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.66 2024-09-14T11:21:49.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.67 2024-09-14T11:21:49.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.68 2024-09-14T11:21:49.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.69 2024-09-14T11:21:49.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.212+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.70 2024-09-14T11:21:49.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.71 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.72 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.73 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.74 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.75 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.76 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.77 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.78 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.79 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.80 2024-09-14T11:21:49.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.214+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.81 2024-09-14T11:21:49.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.215+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.82 2024-09-14T11:21:49.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.216+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.83 2024-09-14T11:21:49.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.216+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.84 2024-09-14T11:21:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.216+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.85 2024-09-14T11:21:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.217+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.86 2024-09-14T11:21:49.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.217+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.87 2024-09-14T11:21:49.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.217+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.88 2024-09-14T11:21:49.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.217+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.89 2024-09-14T11:21:49.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.217+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.90 2024-09-14T11:21:49.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.217+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.91 2024-09-14T11:21:49.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.217+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.58__multipart_key1.2~IJuEm1NIF_EeX3aRHNihudE_iBqs-s3.92 2024-09-14T11:21:49.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.220+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.221 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.222+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:49.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.223+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2600051643969219869', time=2024-09-14T13:21:26.723788+0000, chain.objs.size()=5 2024-09-14T11:21:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.42__multipart_key1.2~wdqCMimgQ78RnQJYjRolXT7f17a2ZW2.1 2024-09-14T11:21:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.42__multipart_key1.2~wdqCMimgQ78RnQJYjRolXT7f17a2ZW2.2 2024-09-14T11:21:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.42__multipart_key1.2~wdqCMimgQ78RnQJYjRolXT7f17a2ZW2.3 2024-09-14T11:21:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.42__multipart_key1.2~wdqCMimgQ78RnQJYjRolXT7f17a2ZW2.4 2024-09-14T11:21:49.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.224+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.42__multipart_key1.2~wdqCMimgQ78RnQJYjRolXT7f17a2ZW2.5 2024-09-14T11:21:49.226 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.227+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.229+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:49.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.231+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.231+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.232+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.232+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12887807936353635391', time=2024-09-14T13:21:31.056992+0000, chain.objs.size()=5 2024-09-14T11:21:49.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.232+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~dNubOs0ybBbqszaHC4A-LdQjzJKy9PR.1 2024-09-14T11:21:49.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.232+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__shadow_key1.2~dNubOs0ybBbqszaHC4A-LdQjzJKy9PR.1_1 2024-09-14T11:21:49.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.232+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~dNubOs0ybBbqszaHC4A-LdQjzJKy9PR.2 2024-09-14T11:21:49.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.232+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__shadow_key1.2~dNubOs0ybBbqszaHC4A-LdQjzJKy9PR.2_1 2024-09-14T11:21:49.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.232+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.47__multipart_key1.2~dNubOs0ybBbqszaHC4A-LdQjzJKy9PR.3 2024-09-14T11:21:49.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.234+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.236+0000 7f5d7f498800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3436431069068756373', time=2024-09-14T13:21:39.131865+0000, chain.objs.size()=11 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.1 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.2 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.3 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.4 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.5 2024-09-14T11:21:49.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.6 2024-09-14T11:21:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.238+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.7 2024-09-14T11:21:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.239+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.8 2024-09-14T11:21:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.239+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.9 2024-09-14T11:21:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.239+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.10 2024-09-14T11:21:49.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.239+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.55__multipart_key1.2~FxShTFQHzv9_bifVtxAkOI9kY_meybw.11 2024-09-14T11:21:49.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.244+0000 7f5d7f498800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:49.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.247+0000 7f5c32fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:49.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.249+0000 7f5d7f498800 20 remove_watcher() i=0 2024-09-14T11:21:49.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.249+0000 7f5d7f498800 2 removed watcher, disabling cache 2024-09-14T11:21:49.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.250+0000 7f5d7f498800 20 remove_watcher() i=1 2024-09-14T11:21:49.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.251+0000 7f5d7f498800 20 remove_watcher() i=2 2024-09-14T11:21:49.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.252+0000 7f5d7f498800 20 remove_watcher() i=3 2024-09-14T11:21:49.252 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.253+0000 7f5d7f498800 20 remove_watcher() i=4 2024-09-14T11:21:49.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.254+0000 7f5d7f498800 20 remove_watcher() i=5 2024-09-14T11:21:49.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.255+0000 7f5d7f498800 20 remove_watcher() i=6 2024-09-14T11:21:49.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.256+0000 7f5d7f498800 20 remove_watcher() i=7 2024-09-14T11:21:49.266 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:49.319 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:49.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.359+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.361+0000 7f7f3462f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.361+0000 7f7f3462f800 20 realm 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.361+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.361+0000 7f7f3462f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.361+0000 7f7f3462f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.361+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.362+0000 7f7f3462f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.362+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.362+0000 7f7f3462f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.362+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.363+0000 7f7f3462f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:49.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.363+0000 7f7f3462f800 20 searching for the correct realm 2024-09-14T11:21:49.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.366+0000 7f7f3191f640 0 -- 172.21.15.2:0/2104274200 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f7f24095040 msgr2=0x7f7f2406b960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:49.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.370+0000 7f7f32120640 0 -- 172.21.15.2:0/2104274200 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f7f280b7970 msgr2=0x7f7f280b5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:49.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.576+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 zone default found 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 4 Realm: () 2024-09-14T11:21:49.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 zonegroup default 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.577+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.578+0000 7f7f3462f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.578+0000 7f7f3462f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.578+0000 7f7f3462f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.578+0000 7f7f3462f800 20 started sync module instance, tier type = 2024-09-14T11:21:49.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.578+0000 7f7f3462f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.587+0000 7f7f3462f800 20 add_watcher() i=0 2024-09-14T11:21:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.587+0000 7f7f3462f800 20 add_watcher() i=1 2024-09-14T11:21:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.587+0000 7f7f3462f800 20 add_watcher() i=2 2024-09-14T11:21:49.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.587+0000 7f7f3462f800 20 add_watcher() i=3 2024-09-14T11:21:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.587+0000 7f7f3462f800 20 add_watcher() i=4 2024-09-14T11:21:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.587+0000 7f7f3462f800 20 add_watcher() i=5 2024-09-14T11:21:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.587+0000 7f7f3462f800 20 add_watcher() i=6 2024-09-14T11:21:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.588+0000 7f7f3462f800 20 add_watcher() i=7 2024-09-14T11:21:49.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.588+0000 7f7f3462f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:49.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.589+0000 7f7de8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.590+0000 7f7f3462f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:49.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.590+0000 7f7f3462f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.625+0000 7f7d637fe640 20 reqs_thread_entry: start 2024-09-14T11:21:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.625+0000 7f7f3462f800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.625+0000 7f7f3462f800 20 Filter name: none 2024-09-14T11:21:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.626+0000 7f7d617fa640 20 reqs_thread_entry: start 2024-09-14T11:21:49.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.626+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.627+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.627+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.628+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.629+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:49.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.630+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.630+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.630+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.631+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:49.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.633+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.633+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.633+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.634+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:49.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.636+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.636+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.636+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.637+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:49.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.639+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.640+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.640+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.642+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:49.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.643+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.643+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.643+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.644+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:49.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.646+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.646+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.646+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.647+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:49.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.648+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.649+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.649+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.650+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:49.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.651+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.652+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.652+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.653+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:49.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.655+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.655+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.656+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.657+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:49.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.658+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.658+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.659+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.660+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.661+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.661+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.661+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.662+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:49.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.664+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.665+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.665+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.666+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:49.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.667+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.668+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.668+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.669+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:49.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.670+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.671+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.671+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.672+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.673+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.674+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.674+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.675+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:49.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.676+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.677+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.677+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.678+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:49.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.679+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.680+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.680+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.681+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:49.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.682+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.683+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.683+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.684+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:49.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.685+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.685+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.686+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.687+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.688+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.688+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.689+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.690+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.691+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.691+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.691+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.692+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.694+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.694+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.694+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.695+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.697+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.697+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.697+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.698+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:49.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.700+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.701+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.701+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.702+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.704+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.704+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.704+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.705+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.707+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.707+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.707+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.708+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:49.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.709+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.710+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.710+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.711+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:49.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.712+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.713+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.713+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.714+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.715+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.716+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.716+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.717+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.718+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.719+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.719+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.720+0000 7f7f3462f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.722+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.722+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:49.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.722+0000 7f7f3462f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:49.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.724+0000 7f7de8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:49.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.726+0000 7f7f3462f800 20 remove_watcher() i=0 2024-09-14T11:21:49.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.726+0000 7f7f3462f800 2 removed watcher, disabling cache 2024-09-14T11:21:49.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.727+0000 7f7f3462f800 20 remove_watcher() i=1 2024-09-14T11:21:49.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.728+0000 7f7f3462f800 20 remove_watcher() i=2 2024-09-14T11:21:49.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.729+0000 7f7f3462f800 20 remove_watcher() i=3 2024-09-14T11:21:49.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.730+0000 7f7f3462f800 20 remove_watcher() i=4 2024-09-14T11:21:49.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.731+0000 7f7f3462f800 20 remove_watcher() i=5 2024-09-14T11:21:49.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.732+0000 7f7f3462f800 20 remove_watcher() i=6 2024-09-14T11:21:49.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.733+0000 7f7f3462f800 20 remove_watcher() i=7 2024-09-14T11:21:49.744 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:49.797 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:49.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.838+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 20 realm 2024-09-14T11:21:49.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.840+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.841+0000 7fbc8a546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:49.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.841+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.841+0000 7fbc8a546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:49.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.841+0000 7fbc8a546800 20 searching for the correct realm 2024-09-14T11:21:49.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.844+0000 7fbc8782f640 0 -- 172.21.15.2:0/1445936245 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fbc7806ec20 msgr2=0x7fbc7806c670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:49.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:49.847+0000 7fbc88030640 0 -- 172.21.15.2:0/1445936245 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fbc7c069a60 msgr2=0x7fbc7c068bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.053+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:50.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 zone default found 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 4 Realm: () 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 zonegroup default 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.054+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.055+0000 7fbc8a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.055+0000 7fbc8a546800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.055+0000 7fbc8a546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.055+0000 7fbc8a546800 20 started sync module instance, tier type = 2024-09-14T11:21:50.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.055+0000 7fbc8a546800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:50.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.064+0000 7fbc8a546800 20 add_watcher() i=0 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.064+0000 7fbc8a546800 20 add_watcher() i=1 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.064+0000 7fbc8a546800 20 add_watcher() i=2 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.064+0000 7fbc8a546800 20 add_watcher() i=3 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.064+0000 7fbc8a546800 20 add_watcher() i=4 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.064+0000 7fbc8a546800 20 add_watcher() i=5 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.064+0000 7fbc8a546800 20 add_watcher() i=6 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.065+0000 7fbc8a546800 20 add_watcher() i=7 2024-09-14T11:21:50.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.065+0000 7fbc8a546800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:50.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.067+0000 7fbb3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.067+0000 7fbc8a546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:50.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.067+0000 7fbc8a546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:50.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.102+0000 7fbb3dfdb640 20 reqs_thread_entry: start 2024-09-14T11:21:50.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.102+0000 7fbc8a546800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:50.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.102+0000 7fbc8a546800 20 Filter name: none 2024-09-14T11:21:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.102+0000 7fbaaf7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:50.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.102+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.104+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.104+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.104+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.105+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.107+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.107+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.106 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.107+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.107 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.108+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.110+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.111+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.111+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.112+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:50.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.113+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.114+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.114+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.115+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:50.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.116+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.117+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.117+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.118+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.119+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.119+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.120+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.121+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.122+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.122+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.123+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.124+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.125+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.125+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.125+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.126+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.128+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.128+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.128+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.129+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:50.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.131+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.131+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.131+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.132+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:50.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.134+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.134+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.135+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.136+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:50.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.137+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.137+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.138+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.139+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:50.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.140+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.141+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.141+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.142+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:50.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.143+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.144+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.144+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.145+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:50.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.146+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.147+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.147+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.148+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:50.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.149+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.150+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.150+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.151+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.152+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.153+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.153+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.154+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:50.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.155+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.156+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.156+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.157+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:50.157 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.158+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.159+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.159+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.159 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.160+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:50.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.161+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.162+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.161 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.162+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.163+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:50.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.165+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.165+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.165 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.166+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.167+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:50.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.168+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.168+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.168+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.169+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.171+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.171+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.171+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.172+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:50.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.174+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.174+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.174+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.175+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.177+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.177+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.178+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.179+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.180+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.180+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.181+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.181+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:50.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.183+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.184+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.184+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.185+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:50.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.186+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.187+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.187+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.188+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:50.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.189+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.190+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.190+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.191+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:50.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.192+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.193+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.193+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.194+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:50.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.196+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.196+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.196+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.197+0000 7fbc8a546800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.199+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.199+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.199+0000 7fbc8a546800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.202+0000 7fbb3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.204+0000 7fbc8a546800 20 remove_watcher() i=0 2024-09-14T11:21:50.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.204+0000 7fbc8a546800 2 removed watcher, disabling cache 2024-09-14T11:21:50.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.205+0000 7fbc8a546800 20 remove_watcher() i=1 2024-09-14T11:21:50.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.206+0000 7fbc8a546800 20 remove_watcher() i=2 2024-09-14T11:21:50.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.207+0000 7fbc8a546800 20 remove_watcher() i=3 2024-09-14T11:21:50.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.208+0000 7fbc8a546800 20 remove_watcher() i=4 2024-09-14T11:21:50.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.209+0000 7fbc8a546800 20 remove_watcher() i=5 2024-09-14T11:21:50.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.210+0000 7fbc8a546800 20 remove_watcher() i=6 2024-09-14T11:21:50.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.211+0000 7fbc8a546800 20 remove_watcher() i=7 2024-09-14T11:21:50.222 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:50.274 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:50.275 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:50.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.315+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 20 realm 2024-09-14T11:21:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:50.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.317+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.318+0000 7fbdbf82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:50.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.318+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.318+0000 7fbdbf82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:50.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.318+0000 7fbdbf82f800 20 searching for the correct realm 2024-09-14T11:21:50.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.321+0000 7fbdbdb21640 0 -- 172.21.15.2:0/2670107598 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fbda8030060 msgr2=0x7fbda807a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:50.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.325+0000 7fbdbd320640 0 -- 172.21.15.2:0/2670107598 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fbda808d390 msgr2=0x7fbda80599d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.530+0000 7fbdbf82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.530+0000 7fbdbf82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.530+0000 7fbdbf82f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.530+0000 7fbdbf82f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:50.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.530+0000 7fbdbf82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.530+0000 7fbdbf82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.530+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:50.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 zone default found 2024-09-14T11:21:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 4 Realm: () 2024-09-14T11:21:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:50.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 zonegroup default 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.531+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.532+0000 7fbdbf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.532+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.532+0000 7fbdbf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.532+0000 7fbdbf82f800 20 rados->read ofs=0 len=0 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.532+0000 7fbdbf82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.532+0000 7fbdbf82f800 20 started sync module instance, tier type = 2024-09-14T11:21:50.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.532+0000 7fbdbf82f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.541+0000 7fbdbf82f800 20 add_watcher() i=0 2024-09-14T11:21:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.541+0000 7fbdbf82f800 20 add_watcher() i=1 2024-09-14T11:21:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.541+0000 7fbdbf82f800 20 add_watcher() i=2 2024-09-14T11:21:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.541+0000 7fbdbf82f800 20 add_watcher() i=3 2024-09-14T11:21:50.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.541+0000 7fbdbf82f800 20 add_watcher() i=4 2024-09-14T11:21:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.541+0000 7fbdbf82f800 20 add_watcher() i=5 2024-09-14T11:21:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.541+0000 7fbdbf82f800 20 add_watcher() i=6 2024-09-14T11:21:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.542+0000 7fbdbf82f800 20 add_watcher() i=7 2024-09-14T11:21:50.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.542+0000 7fbdbf82f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:50.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.543+0000 7fbc737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.544+0000 7fbdbf82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:50.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.544+0000 7fbdbf82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.577+0000 7fbc727e4640 20 reqs_thread_entry: start 2024-09-14T11:21:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.577+0000 7fbdbf82f800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.577+0000 7fbdbf82f800 20 Filter name: none 2024-09-14T11:21:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.577+0000 7fbbe3fff640 20 reqs_thread_entry: start 2024-09-14T11:21:50.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.577+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:50.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.578+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.579+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.579+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.580+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:50.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.581+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.581+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.581 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.582+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.583+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:50.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.584+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.584+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.585+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.586+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.587+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.587+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.587+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.588+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:50.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.590+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.590+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.590+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.592+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.593+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.592 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.593+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.594+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.595+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:50.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.597+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.597+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.597+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.598+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:50.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.599+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.600+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.600+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.601+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:50.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.602+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.602+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.602 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.603+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.604+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.605+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.605+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.605 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.606+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.607+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.608+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.607 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.609+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.609+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.610+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:50.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.611+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.611+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.612+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.612+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.614+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.614+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.614+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.615+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.617+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.617+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.617+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.618+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.620+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.620+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.620+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.621+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.623+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.623+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.623+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.624+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:50.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.625+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.626+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.626+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.627+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.628+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.629+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.629+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.630+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.631+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.631+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.631+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.632+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.634+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.634+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.635+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.636+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:50.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.637+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.637+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.638+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.638+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.640+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.640+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.640+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.641+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:50.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.642+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.643+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.643+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.644+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.645+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.646+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.646+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.647+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:50.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.648+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.649+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.649+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.650+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.652+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.652+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.652+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.653+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:50.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.654+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.655+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.655+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.656+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:50.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.657+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.658+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.658+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.659+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:50.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.660+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.661+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.661+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.662+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:50.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.664+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.664+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.665+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.666+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:50.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.667+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.667+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.667+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.668+0000 7fbdbf82f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:50.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.670+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.670+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:50.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.670+0000 7fbdbf82f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:50.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.672+0000 7fbc737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:50.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.674+0000 7fbdbf82f800 20 remove_watcher() i=0 2024-09-14T11:21:50.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.674+0000 7fbdbf82f800 2 removed watcher, disabling cache 2024-09-14T11:21:50.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.675+0000 7fbdbf82f800 20 remove_watcher() i=1 2024-09-14T11:21:50.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.676+0000 7fbdbf82f800 20 remove_watcher() i=2 2024-09-14T11:21:50.676 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.677+0000 7fbdbf82f800 20 remove_watcher() i=3 2024-09-14T11:21:50.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.678+0000 7fbdbf82f800 20 remove_watcher() i=4 2024-09-14T11:21:50.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.679+0000 7fbdbf82f800 20 remove_watcher() i=5 2024-09-14T11:21:50.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.680+0000 7fbdbf82f800 20 remove_watcher() i=6 2024-09-14T11:21:50.680 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:50.681+0000 7fbdbf82f800 20 remove_watcher() i=7 2024-09-14T11:21:50.692 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-14T11:21:51.303 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :clean 2024-09-14T11:21:52.102 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :compileJava 2024-09-14T11:21:52.102 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :processResources 2024-09-14T11:21:52.102 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :classes 2024-09-14T11:21:52.701 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:52.701 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :compileTestJava 2024-09-14T11:21:52.702 INFO:teuthology.orchestra.run.smithi002.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:21:52.702 INFO:teuthology.orchestra.run.smithi002.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:21:52.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:52.703 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:21:52.703 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :testClasses 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :test 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests STANDARD_OUT 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14 11:21:54,002 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.703 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.704 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-14T11:21:54.901 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:54.901 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-14T11:21:55.001 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.001 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-14T11:21:55.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.101 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-14T11:21:55.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.102 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-14T11:21:55.301 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.301 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-14T11:21:55.401 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.401 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-14T11:21:55.501 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.501 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-14T11:21:55.501 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.501 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-14T11:21:55.801 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.801 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-14T11:21:55.901 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:55.901 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-14T11:21:56.101 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:56.102 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-14T11:21:56.102 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:56.102 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------- 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout:-------------------------------------------------------------------- 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:56.202 INFO:teuthology.orchestra.run.smithi002.stdout:BUILD SUCCESSFUL in 5s 2024-09-14T11:21:56.203 INFO:teuthology.orchestra.run.smithi002.stdout:5 actionable tasks: 5 executed 2024-09-14T11:21:56.209 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:56.261 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:56.262 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:56.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.302+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 20 realm 2024-09-14T11:21:56.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.304+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.305+0000 7f2854526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.305+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.305+0000 7f2854526800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:56.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.305+0000 7f2854526800 20 searching for the correct realm 2024-09-14T11:21:56.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.309+0000 7f28509da640 0 -- 172.21.15.2:0/4105068147 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55b2eee493b0 msgr2=0x55b2eee4b870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:56.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.313+0000 7f284f9d8640 0 -- 172.21.15.2:0/4105068147 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f2840049500 msgr2=0x7f2840070130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:56.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.317 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 zone default found 2024-09-14T11:21:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 4 Realm: () 2024-09-14T11:21:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:56.318 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 zonegroup default 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.318+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.319+0000 7f2854526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.319+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.319+0000 7f2854526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.319+0000 7f2854526800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.319+0000 7f2854526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.319+0000 7f2854526800 20 started sync module instance, tier type = 2024-09-14T11:21:56.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.319+0000 7f2854526800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:56.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.328+0000 7f2854526800 20 add_watcher() i=0 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.328+0000 7f2854526800 20 add_watcher() i=1 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.328+0000 7f2854526800 20 add_watcher() i=2 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.328+0000 7f2854526800 20 add_watcher() i=3 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.328+0000 7f2854526800 20 add_watcher() i=4 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.328+0000 7f2854526800 20 add_watcher() i=5 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.328+0000 7f2854526800 20 add_watcher() i=6 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.329+0000 7f2854526800 20 add_watcher() i=7 2024-09-14T11:21:56.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.329+0000 7f2854526800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:56.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.331+0000 7f2706fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:56.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.331+0000 7f2854526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:56.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.331+0000 7f2854526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:56.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.412+0000 7f2705fdb640 20 reqs_thread_entry: start 2024-09-14T11:21:56.410 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.412+0000 7f2854526800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:56.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.412+0000 7f2854526800 20 Filter name: none 2024-09-14T11:21:56.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.412+0000 7f26777fe640 20 reqs_thread_entry: start 2024-09-14T11:21:56.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.412+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:56.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.414+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.414+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.415+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:56.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.415+0000 7f2854526800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1904066882073547181', time=2024-09-14T13:21:55.169631+0000, chain.objs.size()=1 2024-09-14T11:21:56.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.415+0000 7f2854526800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.71__shadow_.IHnUeR0oelpDULNYNFeQSxxjdp3g7Hi_0 2024-09-14T11:21:56.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.416+0000 7f2854526800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:56.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.419+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:56.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.420+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.420+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.421+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.422+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:56.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.423+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.424+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.424+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.425+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.426+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.427+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.427+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.428+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:56.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.430+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.431+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.431+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.432+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:56.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.434+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.434+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.435+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.436+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.437+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.438+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.438+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.439+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:56.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.440+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.441+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.441+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.442+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.444+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.444+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.442 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.444+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.445+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.447+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.447+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.448+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.449+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:56.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.450+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.450+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.451+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.452+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:56.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.453+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.454+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.454+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.455+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:56.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.456+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.457+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.458+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.459+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:56.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.460+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.461+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.461+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.462+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.464+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.464+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.464+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.465+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:56.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.467+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.467+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.468+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.469+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:56.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.470+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.471+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.471+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.472+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:56.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.473+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.474+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.474+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.476+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:56.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.477+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.478+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.478+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.479+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:56.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.480+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.481+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.481+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.482+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:56.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.483+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.484+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.484+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.487+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:56.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.488+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.488+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.489+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.490+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:56.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.491+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.492+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.492+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.493+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:56.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.494+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.495+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.495+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.496+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:56.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.498+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.498+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.499+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.500+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.501+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.501+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.502+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.503+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:56.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.504+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.505+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.505+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.506+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:56.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.507+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.508+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.508+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.509+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:56.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.510+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.511+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.512+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.513+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:56.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.514+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.515+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.515+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.516+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:56.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.517+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.518+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.518+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.519+0000 7f2854526800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.520+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.521+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.521+0000 7f2854526800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:21:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.521+0000 7f2854526800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1875508894910194372', time=2024-09-14T13:21:55.680556+0000, chain.objs.size()=1 2024-09-14T11:21:56.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.521+0000 7f2854526800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.72__shadow_.xIs7r3_YQJkx-2RTzTUZnZD9q3UmNAc_0 2024-09-14T11:21:56.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.522+0000 7f2854526800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:21:56.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.525+0000 7f2706fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.528+0000 7f2854526800 20 remove_watcher() i=0 2024-09-14T11:21:56.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.528+0000 7f2854526800 2 removed watcher, disabling cache 2024-09-14T11:21:56.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.529+0000 7f2854526800 20 remove_watcher() i=1 2024-09-14T11:21:56.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.530+0000 7f2854526800 20 remove_watcher() i=2 2024-09-14T11:21:56.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.531+0000 7f2854526800 20 remove_watcher() i=3 2024-09-14T11:21:56.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.532+0000 7f2854526800 20 remove_watcher() i=4 2024-09-14T11:21:56.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.533+0000 7f2854526800 20 remove_watcher() i=5 2024-09-14T11:21:56.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.534+0000 7f2854526800 20 remove_watcher() i=6 2024-09-14T11:21:56.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.535+0000 7f2854526800 20 remove_watcher() i=7 2024-09-14T11:21:56.545 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:56.598 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:56.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.639+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.641+0000 7fd18e521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.641+0000 7fd18e521800 20 realm 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.641+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.641+0000 7fd18e521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.641+0000 7fd18e521800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.641+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.642+0000 7fd18e521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.642+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.642+0000 7fd18e521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.642+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.643+0000 7fd18e521800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:56.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.643+0000 7fd18e521800 20 searching for the correct realm 2024-09-14T11:21:56.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.646+0000 7fd189a43640 0 -- 172.21.15.2:0/1350082429 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x5561460db930 msgr2=0x5561460dddf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:56.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.650+0000 7fd18a244640 0 -- 172.21.15.2:0/1350082429 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fd1800567c0 msgr2=0x7fd1800b5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.654+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 zone default found 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 4 Realm: () 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 zonegroup default 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.655+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.656+0000 7fd18e521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.656+0000 7fd18e521800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.656+0000 7fd18e521800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.656+0000 7fd18e521800 20 started sync module instance, tier type = 2024-09-14T11:21:56.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.656+0000 7fd18e521800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.665+0000 7fd18e521800 20 add_watcher() i=0 2024-09-14T11:21:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.665+0000 7fd18e521800 20 add_watcher() i=1 2024-09-14T11:21:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.665+0000 7fd18e521800 20 add_watcher() i=2 2024-09-14T11:21:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.665+0000 7fd18e521800 20 add_watcher() i=3 2024-09-14T11:21:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.665+0000 7fd18e521800 20 add_watcher() i=4 2024-09-14T11:21:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.665+0000 7fd18e521800 20 add_watcher() i=5 2024-09-14T11:21:56.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.665+0000 7fd18e521800 20 add_watcher() i=6 2024-09-14T11:21:56.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.666+0000 7fd18e521800 20 add_watcher() i=7 2024-09-14T11:21:56.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.666+0000 7fd18e521800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:56.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.667+0000 7fd040fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:56.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.668+0000 7fd18e521800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:56.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.668+0000 7fd18e521800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:56.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.702+0000 7fcfbb7fe640 20 reqs_thread_entry: start 2024-09-14T11:21:56.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.702+0000 7fd18e521800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:56.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.702+0000 7fd18e521800 20 Filter name: none 2024-09-14T11:21:56.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.702+0000 7fcfb97fa640 20 reqs_thread_entry: start 2024-09-14T11:21:56.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.702+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:56.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.704+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.704+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.705+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.706+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:56.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.707+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.708+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.708+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.709+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:56.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.710+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.711+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.711+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.712+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.714+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.714+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.714+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.713 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.715+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.717+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.717+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.717+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.718+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.720+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.720+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.721+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.722+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:56.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.723+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.724+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.724+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.725+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:56.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.726+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.727+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.727+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.728+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:56.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.729+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.730+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.730+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.731+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:56.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.732+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.733+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.733+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.734+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.736+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.737+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.737+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.738+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:56.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.739+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.740+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.740+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.741+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:56.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.742+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.743+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.743+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.744+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:56.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.745+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.746+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.746+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.747+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:56.746 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.748+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.749+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.749+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.748 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.750+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:56.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.751+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.752+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.752+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.753+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.754+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.754+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.755+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.756+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:56.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.757+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.757+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.758+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.758+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.761+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.761+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.761+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.762+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.764+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.764+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.764+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.765+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:56.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.767+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.767+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.767+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.768+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.770+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.770+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.771+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.772+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:56.771 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.773+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.774+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.774+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.775+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:56.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.776+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.777+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.777+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.778+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:56.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.780+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.780+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.780+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.782+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.783+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.783+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.784+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.785+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:56.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.786+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.787+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.788+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.789+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:56.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.790+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.791+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.791+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.792+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.793+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.794+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.794+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.795+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:56.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.797+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.797+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.797+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.798+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.800+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.800+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.800+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.801+0000 7fd18e521800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:56.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.803+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.804+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.804+0000 7fd18e521800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.806+0000 7fd040fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:56.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.808+0000 7fd18e521800 20 remove_watcher() i=0 2024-09-14T11:21:56.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.808+0000 7fd18e521800 2 removed watcher, disabling cache 2024-09-14T11:21:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.809+0000 7fd18e521800 20 remove_watcher() i=1 2024-09-14T11:21:56.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.810+0000 7fd18e521800 20 remove_watcher() i=2 2024-09-14T11:21:56.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.811+0000 7fd18e521800 20 remove_watcher() i=3 2024-09-14T11:21:56.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.812+0000 7fd18e521800 20 remove_watcher() i=4 2024-09-14T11:21:56.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.813+0000 7fd18e521800 20 remove_watcher() i=5 2024-09-14T11:21:56.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.814+0000 7fd18e521800 20 remove_watcher() i=6 2024-09-14T11:21:56.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.815+0000 7fd18e521800 20 remove_watcher() i=7 2024-09-14T11:21:56.825 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:56.878 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:56.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.920+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.922+0000 7f53eb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.922+0000 7f53eb010800 20 realm 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.922+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.923+0000 7f53eb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.923+0000 7f53eb010800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.923+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.923+0000 7f53eb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.923+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.924+0000 7f53eb010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.924+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.924+0000 7f53eb010800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:56.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.924+0000 7f53eb010800 20 searching for the correct realm 2024-09-14T11:21:56.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.927+0000 7f53e5eca640 0 -- 172.21.15.2:0/1709135849 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x5614c61a5350 msgr2=0x5614c61a7810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:56.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.931+0000 7f53e66cb640 0 -- 172.21.15.2:0/1709135849 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f53dc01a040 msgr2=0x7f53dc09f830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:56.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.935+0000 7f53eb010800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.935+0000 7f53eb010800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.935+0000 7f53eb010800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.935+0000 7f53eb010800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.935+0000 7f53eb010800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.935+0000 7f53eb010800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.935+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:56.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:56.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 zone default found 2024-09-14T11:21:56.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 4 Realm: () 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 zonegroup default 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.936+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.937+0000 7f53eb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.937+0000 7f53eb010800 20 rados->read ofs=0 len=0 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.937+0000 7f53eb010800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.937+0000 7f53eb010800 20 started sync module instance, tier type = 2024-09-14T11:21:56.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.937+0000 7f53eb010800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.946+0000 7f53eb010800 20 add_watcher() i=0 2024-09-14T11:21:56.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.946+0000 7f53eb010800 20 add_watcher() i=1 2024-09-14T11:21:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.946+0000 7f53eb010800 20 add_watcher() i=2 2024-09-14T11:21:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.946+0000 7f53eb010800 20 add_watcher() i=3 2024-09-14T11:21:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.946+0000 7f53eb010800 20 add_watcher() i=4 2024-09-14T11:21:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.946+0000 7f53eb010800 20 add_watcher() i=5 2024-09-14T11:21:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.946+0000 7f53eb010800 20 add_watcher() i=6 2024-09-14T11:21:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.947+0000 7f53eb010800 20 add_watcher() i=7 2024-09-14T11:21:56.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.947+0000 7f53eb010800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.949+0000 7f529cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.949+0000 7f53eb010800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:56.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.949+0000 7f53eb010800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.982+0000 7f52177fe640 20 reqs_thread_entry: start 2024-09-14T11:21:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.982+0000 7f53eb010800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.982+0000 7f53eb010800 20 Filter name: none 2024-09-14T11:21:56.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.982+0000 7f52157fa640 20 reqs_thread_entry: start 2024-09-14T11:21:56.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.982+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.983+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.984+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.984+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.985+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:56.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.986+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.987+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.987+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.988+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:56.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.989+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.990+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.990+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.991+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:56.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.992+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.992+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.993+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.994+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.995+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.995+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.996+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.997+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:56.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.998+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.999+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:56.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:56.999+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.000+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:56.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.001+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:56.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.001+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.002+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.003+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:57.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.004+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.005+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.005+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.006+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:57.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.007+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.008+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.008+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.009+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.010+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.010+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.011+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.012+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.013+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.013+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.014+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.015+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:57.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.016+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.017+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.017+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.018+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.019+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.020+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.020+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.021+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.023+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.023+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.023+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.024+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.026+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.026+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.027+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.028+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:57.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.029+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.029+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.030+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.031+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:57.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.032+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.032+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.033+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.033+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:57.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.035+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.035+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.035+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.036+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:57.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.038+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.038+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.038+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.039+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:57.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.040+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.041+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.041+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.042+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:57.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.044+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.044+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.044+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.045+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.046+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.047+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.047+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.048+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:57.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.049+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.050+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.050+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.051+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:57.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.052+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.052+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.053+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.054+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.055+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.055+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.056+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.057+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.058+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.058+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.059+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.060+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:57.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.061+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.062+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.062+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.063+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:57.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.065+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.065+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.065+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.066+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:57.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.068+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.068+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.069+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.070+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:57.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.071+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.072+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.070 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.072+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.074+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:57.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.075+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.075+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.076+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.077+0000 7f53eb010800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:57.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.078+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.078+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.079+0000 7f53eb010800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.080+0000 7f529cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.082+0000 7f53eb010800 20 remove_watcher() i=0 2024-09-14T11:21:57.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.082+0000 7f53eb010800 2 removed watcher, disabling cache 2024-09-14T11:21:57.081 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.083+0000 7f53eb010800 20 remove_watcher() i=1 2024-09-14T11:21:57.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.084+0000 7f53eb010800 20 remove_watcher() i=2 2024-09-14T11:21:57.083 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.085+0000 7f53eb010800 20 remove_watcher() i=3 2024-09-14T11:21:57.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.086+0000 7f53eb010800 20 remove_watcher() i=4 2024-09-14T11:21:57.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.087+0000 7f53eb010800 20 remove_watcher() i=5 2024-09-14T11:21:57.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.088+0000 7f53eb010800 20 remove_watcher() i=6 2024-09-14T11:21:57.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.089+0000 7f53eb010800 20 remove_watcher() i=7 2024-09-14T11:21:57.098 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:21:57.151 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:21:57.151 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:21:57.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.192+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 20 realm 2024-09-14T11:21:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:21:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.194+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.195+0000 7f75d86b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.195+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.195+0000 7f75d86b9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:21:57.193 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.195+0000 7f75d86b9800 20 searching for the correct realm 2024-09-14T11:21:57.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.198+0000 7f75d69a4640 0 -- 172.21.15.2:0/3658684757 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f75c0085070 msgr2=0x7f75c00b72b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:21:57.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.201+0000 7f75d61a3640 0 -- 172.21.15.2:0/3658684757 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f75c00b50c0 msgr2=0x7f75c00d01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:21:57.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:21:57.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:21:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:21:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:21:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:21:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:21:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.407+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:21:57.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:21:57.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 zone default found 2024-09-14T11:21:57.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 4 Realm: () 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 zonegroup default 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.408+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.409+0000 7f75d86b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.409+0000 7f75d86b9800 20 rados->read ofs=0 len=0 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.409+0000 7f75d86b9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.409+0000 7f75d86b9800 20 started sync module instance, tier type = 2024-09-14T11:21:57.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.409+0000 7f75d86b9800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:21:57.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.418+0000 7f75d86b9800 20 add_watcher() i=0 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.418+0000 7f75d86b9800 20 add_watcher() i=1 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.418+0000 7f75d86b9800 20 add_watcher() i=2 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.418+0000 7f75d86b9800 20 add_watcher() i=3 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.418+0000 7f75d86b9800 20 add_watcher() i=4 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.418+0000 7f75d86b9800 20 add_watcher() i=5 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.418+0000 7f75d86b9800 20 add_watcher() i=6 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.419+0000 7f75d86b9800 20 add_watcher() i=7 2024-09-14T11:21:57.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.419+0000 7f75d86b9800 2 all 8 watchers are set, enabling cache 2024-09-14T11:21:57.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.421+0000 7f748cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.421+0000 7f75d86b9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:21:57.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.421+0000 7f75d86b9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:21:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.454+0000 7f74077fe640 20 reqs_thread_entry: start 2024-09-14T11:21:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.454+0000 7f75d86b9800 20 init_complete bucket index max shards: 1 2024-09-14T11:21:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.455+0000 7f75d86b9800 20 Filter name: none 2024-09-14T11:21:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.455+0000 7f74057fa640 20 reqs_thread_entry: start 2024-09-14T11:21:57.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.455+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:21:57.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.456+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.456+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.457+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.458+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:21:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.459+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.459+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.459+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.460+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:21:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.462+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.462+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.462+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.463+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:21:57.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.464+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.465+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.465+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.466+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:21:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.467+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.468+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.468+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.469+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:21:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.471+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.471+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.471+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.470 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.472+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:21:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.474+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.474+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.474+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.475+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:21:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.478+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.478+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.478+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.479+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:21:57.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.481+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.481+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.482+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.482+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:21:57.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.484+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.485+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.485+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.486+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:21:57.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.487+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.488+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.488+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.489+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:21:57.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.490+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.491+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.491+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.492+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:21:57.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.493+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.494+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.494+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.495+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:21:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.497+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.497+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.498+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.499+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:21:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.500+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.500+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.501+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.502+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:21:57.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.503+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.503+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.504+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.504+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:21:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.506+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.506+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.507+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.508+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:21:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.509+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.509+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.510+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.511+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:21:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.513+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.513+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.513+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.514+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:21:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.516+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.516+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.516+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.517+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:21:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.519+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.519+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.519+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.520+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:21:57.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.523+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.523+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.523+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.524+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:21:57.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.526+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.526+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.526+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.527+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:21:57.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.529+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.529+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.529+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.530+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:21:57.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.532+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.532+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.532+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.533+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:21:57.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.535+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.536+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.536+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.537+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:21:57.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.539+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.539+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.539+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.541+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:21:57.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.542+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.542+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.543+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.543+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:21:57.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.545+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.545+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.545+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.546+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:21:57.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.548+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.548+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.548+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.550+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:21:57.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.551+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.552+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.552+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.553+0000 7f75d86b9800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:21:57.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.555+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.555+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:21:57.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.555+0000 7f75d86b9800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:21:57.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.557+0000 7f748cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:21:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.559+0000 7f75d86b9800 20 remove_watcher() i=0 2024-09-14T11:21:57.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.559+0000 7f75d86b9800 2 removed watcher, disabling cache 2024-09-14T11:21:57.559 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.561+0000 7f75d86b9800 20 remove_watcher() i=1 2024-09-14T11:21:57.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.562+0000 7f75d86b9800 20 remove_watcher() i=2 2024-09-14T11:21:57.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.563+0000 7f75d86b9800 20 remove_watcher() i=3 2024-09-14T11:21:57.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.564+0000 7f75d86b9800 20 remove_watcher() i=4 2024-09-14T11:21:57.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.565+0000 7f75d86b9800 20 remove_watcher() i=5 2024-09-14T11:21:57.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.566+0000 7f75d86b9800 20 remove_watcher() i=6 2024-09-14T11:21:57.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:21:57.567+0000 7f75d86b9800 20 remove_watcher() i=7 2024-09-14T11:21:57.577 DEBUG:teuthology.orchestra.run.smithi002:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-14T11:21:58.176 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :clean 2024-09-14T11:21:58.973 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :compileJava 2024-09-14T11:21:58.973 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :processResources 2024-09-14T11:21:58.973 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :classes 2024-09-14T11:21:59.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:59.473 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :compileTestJava 2024-09-14T11:21:59.474 INFO:teuthology.orchestra.run.smithi002.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-14T11:21:59.474 INFO:teuthology.orchestra.run.smithi002.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-14T11:21:59.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:21:59.475 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :processTestResources NO-SOURCE 2024-09-14T11:21:59.475 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :testClasses 2024-09-14T11:22:01.474 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:> Task :test 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests STANDARD_OUT 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14 11:22:00,651 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-14T11:22:01.475 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.476 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-14T11:22:01.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-14T11:22:01.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-14T11:22:01.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:01.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-14T11:22:02.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:02.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-14T11:22:03.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-14T11:22:03.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-14T11:22:03.372 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.372 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-14T11:22:03.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-14T11:22:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-14T11:22:03.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.674 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-14T11:22:03.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-14T11:22:03.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-14T11:22:03.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:03.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-14T11:22:04.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:04.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-14T11:22:04.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:04.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-14T11:22:04.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:04.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-14T11:22:04.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:04.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-14T11:22:04.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:04.674 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-14T11:22:04.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:04.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-14T11:22:04.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:04.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-14T11:22:05.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-14T11:22:05.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-14T11:22:05.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-14T11:22:05.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-14T11:22:05.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-14T11:22:05.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-14T11:22:05.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-14T11:22:05.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:05.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-14T11:22:06.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:06.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-14T11:22:06.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:06.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-14T11:22:06.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:06.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-14T11:22:12.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:12.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-14T11:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-14T11:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:13.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-14T11:22:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:13.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-14T11:22:13.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:13.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-14T11:22:13.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:13.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-14T11:22:13.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:13.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-14T11:22:14.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:14.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-14T11:22:14.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:14.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-14T11:22:14.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:14.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-14T11:22:15.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:15.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-14T11:22:15.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:15.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-14T11:22:15.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:15.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-14T11:22:16.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:16.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-14T11:22:16.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:16.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-14T11:22:16.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:16.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-14T11:22:20.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:20.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-14T11:22:20.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:20.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-14T11:22:21.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:21.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-14T11:22:21.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:21.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-14T11:22:22.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:22.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-14T11:22:22.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:22.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-14T11:22:22.974 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:22.974 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-14T11:22:23.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-14T11:22:23.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:23.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-14T11:22:23.772 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:23.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-14T11:22:23.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:23.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-14T11:22:23.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:23.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-14T11:22:24.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.073 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-14T11:22:24.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-14T11:22:24.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-14T11:22:24.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-14T11:22:24.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-14T11:22:24.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-14T11:22:24.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-14T11:22:24.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-14T11:22:24.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:24.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-14T11:22:25.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:25.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-14T11:22:25.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:25.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-14T11:22:25.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:25.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-14T11:22:25.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:25.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-14T11:22:25.674 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:25.674 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-14T11:22:25.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:25.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-14T11:22:25.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:25.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-14T11:22:26.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:26.073 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-14T11:22:26.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:26.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-14T11:22:26.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:26.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-14T11:22:26.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:26.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-14T11:22:26.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:26.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-14T11:22:26.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:26.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-14T11:22:26.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:26.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-14T11:22:27.072 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.073 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-14T11:22:27.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-14T11:22:27.372 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-14T11:22:27.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-14T11:22:27.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-14T11:22:27.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-14T11:22:27.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-14T11:22:27.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:27.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-14T11:22:28.172 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:28.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-14T11:22:28.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:28.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-14T11:22:28.472 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:28.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-14T11:22:28.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:28.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-14T11:22:28.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:28.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-14T11:22:28.872 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:28.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-14T11:22:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.073 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-14T11:22:29.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.073 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-14T11:22:29.273 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-14T11:22:29.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-14T11:22:29.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-14T11:22:29.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-14T11:22:29.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-14T11:22:29.972 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:29.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-14T11:22:30.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-14T11:22:30.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-14T11:22:30.372 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-14T11:22:30.472 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-14T11:22:30.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-14T11:22:30.773 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.773 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-14T11:22:30.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-14T11:22:30.973 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:30.973 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-14T11:22:31.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-14T11:22:31.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.273 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-14T11:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-14T11:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-14T11:22:31.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-14T11:22:31.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-14T11:22:31.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-14T11:22:31.972 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:31.972 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-14T11:22:32.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-14T11:22:32.272 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.272 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-14T11:22:32.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-14T11:22:32.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-14T11:22:32.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-14T11:22:32.673 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.673 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-14T11:22:32.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-14T11:22:32.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:32.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-14T11:22:33.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:33.073 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-14T11:22:33.173 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:33.173 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-14T11:22:33.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:33.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-14T11:22:33.373 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:33.373 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-14T11:22:33.573 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:33.573 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-14T11:22:33.873 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:33.873 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-14T11:22:34.073 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:34.073 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-14T11:22:34.473 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:34.473 INFO:teuthology.orchestra.run.smithi002.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout:---------------------------------------------------------------------- 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout:---------------------------------------------------------------------- 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:34.612 INFO:teuthology.orchestra.run.smithi002.stdout:BUILD SUCCESSFUL in 36s 2024-09-14T11:22:34.613 INFO:teuthology.orchestra.run.smithi002.stdout:5 actionable tasks: 5 executed 2024-09-14T11:22:34.628 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:22:34.680 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:34.681 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:34.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.721+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.722+0000 7f1184923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.722+0000 7f1184923800 20 realm 2024-09-14T11:22:34.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.722+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.722+0000 7f1184923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.722+0000 7f1184923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.722+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.723+0000 7f1184923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.723+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.723+0000 7f1184923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.723+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.724+0000 7f1184923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:34.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.724+0000 7f1184923800 20 searching for the correct realm 2024-09-14T11:22:34.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.727+0000 7f117fe43640 0 -- 172.21.15.2:0/2911795319 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x559d3dc6adf0 msgr2=0x559d3dc6d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:34.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.731+0000 7f1180644640 0 -- 172.21.15.2:0/2911795319 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f1174085670 msgr2=0x7f1174065610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:34.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:34.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:34.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:34.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:34.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:34.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.735+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 zone default found 2024-09-14T11:22:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 4 Realm: () 2024-09-14T11:22:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:34.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 zonegroup default 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 rados->read ofs=0 len=0 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 started sync module instance, tier type = 2024-09-14T11:22:34.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.736+0000 7f1184923800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.745+0000 7f1184923800 20 add_watcher() i=0 2024-09-14T11:22:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.745+0000 7f1184923800 20 add_watcher() i=1 2024-09-14T11:22:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.745+0000 7f1184923800 20 add_watcher() i=2 2024-09-14T11:22:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.745+0000 7f1184923800 20 add_watcher() i=3 2024-09-14T11:22:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.745+0000 7f1184923800 20 add_watcher() i=4 2024-09-14T11:22:34.744 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.745+0000 7f1184923800 20 add_watcher() i=5 2024-09-14T11:22:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.745+0000 7f1184923800 20 add_watcher() i=6 2024-09-14T11:22:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.746+0000 7f1184923800 20 add_watcher() i=7 2024-09-14T11:22:34.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.746+0000 7f1184923800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.747+0000 7f1036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.748+0000 7f1184923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:34.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.748+0000 7f1184923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:34.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.782+0000 7f1035fdb640 20 reqs_thread_entry: start 2024-09-14T11:22:34.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.782+0000 7f1184923800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:34.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.782+0000 7f1184923800 20 Filter name: none 2024-09-14T11:22:34.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.783+0000 7f0fa77fe640 20 reqs_thread_entry: start 2024-09-14T11:22:34.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.783+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.784+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.784+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~AHQqlExIpgQMhkv61__q4cBjJM5w6YF', time=2024-09-14T13:22:02.880675+0000, chain.objs.size()=5 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.79__multipart_key1.2~AHQqlExIpgQMhkv61__q4cBjJM5w6YF.1 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.79__multipart_key1.2~AHQqlExIpgQMhkv61__q4cBjJM5w6YF.2 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.79__multipart_key1.2~AHQqlExIpgQMhkv61__q4cBjJM5w6YF.3 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.79__multipart_key1.2~AHQqlExIpgQMhkv61__q4cBjJM5w6YF.4 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.79__multipart_key1.2~AHQqlExIpgQMhkv61__q4cBjJM5w6YF.5 2024-09-14T11:22:34.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2872261040341534279', time=2024-09-14T13:22:26.116338+0000, chain.objs.size()=1 2024-09-14T11:22:34.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.115__shadow_.O9PeWI_ZqbWm4snV60Z00WNJVTBgsb4_0 2024-09-14T11:22:34.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.925236663018786204', time=2024-09-14T13:22:28.329152+0000, chain.objs.size()=1 2024-09-14T11:22:34.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.123__shadow_.bDiq-YSTj8JDtCjZcgZI-4JN6HZAV35_0 2024-09-14T11:22:34.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8766241228285907344', time=2024-09-14T13:22:28.334102+0000, chain.objs.size()=1 2024-09-14T11:22:34.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.123__shadow_.hvnvXeBqIV_y3ioInjcsqK3cTBGhwHV_0 2024-09-14T11:22:34.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4455240045624189762', time=2024-09-14T13:22:29.151726+0000, chain.objs.size()=1 2024-09-14T11:22:34.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.785+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.126__shadow_.c1iF6kmvhMxGr7XZgXcHYw5lP3AdltZ_0 2024-09-14T11:22:34.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.788+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.790+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:22:34.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.791+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:22:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8840924269571836813', time=2024-09-14T13:22:31.060164+0000, chain.objs.size()=1 2024-09-14T11:22:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.133__shadow_.zQ1tiBtSKfnyWqRY6H5fXCliKD5aDuZ_0 2024-09-14T11:22:34.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14486925978776714733', time=2024-09-14T13:22:33.937213+0000, chain.objs.size()=5 2024-09-14T11:22:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.143__multipart_key1.2~APGok-sz2vfh5BOT_Xc08HG1itM95jb.1 2024-09-14T11:22:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.143__multipart_key1.2~APGok-sz2vfh5BOT_Xc08HG1itM95jb.2 2024-09-14T11:22:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.143__multipart_key1.2~APGok-sz2vfh5BOT_Xc08HG1itM95jb.3 2024-09-14T11:22:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.143__multipart_key1.2~APGok-sz2vfh5BOT_Xc08HG1itM95jb.4 2024-09-14T11:22:34.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.792+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.143__multipart_key1.2~APGok-sz2vfh5BOT_Xc08HG1itM95jb.5 2024-09-14T11:22:34.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.795+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.798+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:22:34.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.798+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.799+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.799+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:22:34.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.799+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10930200088382740566', time=2024-09-14T13:22:29.711528+0000, chain.objs.size()=1 2024-09-14T11:22:34.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.799+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.128__shadow_.0mVCrghuEkjJR0xOlT7XrtegCQ7Fz9H_0 2024-09-14T11:22:34.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.799+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15744122813012981520', time=2024-09-14T13:22:32.135122+0000, chain.objs.size()=1 2024-09-14T11:22:34.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.799+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.138__shadow_.jYLMoy8lK8EnO-w1hzU45hXzegXMefG_0 2024-09-14T11:22:34.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.800+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.802+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:22:34.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:22:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15852509950485618337', time=2024-09-14T13:22:26.668435+0000, chain.objs.size()=1 2024-09-14T11:22:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.117__shadow_.kJ90qxHVWpJWu7gtSfE2Nete-hBjErg_0 2024-09-14T11:22:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6111736976559451412', time=2024-09-14T13:22:27.789823+0000, chain.objs.size()=1 2024-09-14T11:22:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.121__shadow_.u1GbUFtft3PNUKxRwtz83YI997FsAPC_0 2024-09-14T11:22:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5478308593623435260', time=2024-09-14T13:22:28.875621+0000, chain.objs.size()=1 2024-09-14T11:22:34.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.804+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.125__shadow_.q9fejTLmm433WIjxX-bAF40FLnTIQoC_0 2024-09-14T11:22:34.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.806+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.808+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:22:34.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.809+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.809+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:22:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11623783547484241001', time=2024-09-14T13:22:06.747877+0000, chain.objs.size()=5 2024-09-14T11:22:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.1 2024-09-14T11:22:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.2 2024-09-14T11:22:34.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.3 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.4 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.5 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7614441274581319000', time=2024-09-14T13:22:25.548265+0000, chain.objs.size()=1 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.113__shadow_.VkGomnLohhrXL0qqfPXzhzl40hG9G_9_0 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10108466807501095097', time=2024-09-14T13:22:26.393900+0000, chain.objs.size()=1 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.116__shadow_.xT-BrMoSUm3Czdn_j13UM9QV7yX2qrZ_0 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11327759064729340788', time=2024-09-14T13:22:28.880522+0000, chain.objs.size()=1 2024-09-14T11:22:34.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.810+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.125__shadow_.GxHOqFK3JeSavmu9CuLdzF2pZdQjzGG_0 2024-09-14T11:22:34.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.812+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.814+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:22:34.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.815+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.815+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.816+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:22:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.816+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15530019440216283824', time=2024-09-14T13:22:03.512910+0000, chain.objs.size()=1 2024-09-14T11:22:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.816+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.81__shadow_.zGBkLg_HC5OfRUxHZM63u9TpnxQRBp1_0 2024-09-14T11:22:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.816+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17645261146571087282', time=2024-09-14T13:22:28.067130+0000, chain.objs.size()=1 2024-09-14T11:22:34.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.816+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.122__shadow_.3ZSEFQsjPi2GywsA-_9_Uj0Fnmu6kjh_0 2024-09-14T11:22:34.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.817+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.819+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:22:34.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.820+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.821+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.821+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.822+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:22:34.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10585970001526251973', time=2024-09-14T13:22:15.962414+0000, chain.objs.size()=5 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file.mpg.2~ncji5hl3vSmoFjGDtGif2iU29jQbvWa.1 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file.mpg.2~ncji5hl3vSmoFjGDtGif2iU29jQbvWa.2 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file.mpg.2~ncji5hl3vSmoFjGDtGif2iU29jQbvWa.3 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.824+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file.mpg.2~ncji5hl3vSmoFjGDtGif2iU29jQbvWa.4 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.825+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file.mpg.2~ncji5hl3vSmoFjGDtGif2iU29jQbvWa.5 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.825+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.169329300471701907', time=2024-09-14T13:22:15.968272+0000, chain.objs.size()=1 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.825+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__shadow_.GNa7Dm8VuolDa11hQh-oyjxnclVvAwb_0 2024-09-14T11:22:34.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.825+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10896146684067332338', time=2024-09-14T13:22:26.673608+0000, chain.objs.size()=1 2024-09-14T11:22:34.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.825+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.117__shadow_.nup_artOiZyqDVZfCz5gJ-Dx6fACWdU_0 2024-09-14T11:22:34.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.825+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15619408455082724908', time=2024-09-14T13:22:27.780100+0000, chain.objs.size()=1 2024-09-14T11:22:34.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.825+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.121__shadow_.gA7633k2nDuHoaNq6tG0PgOwg_2yL6Y_0 2024-09-14T11:22:34.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.827+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.829+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:22:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.830+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.831+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.831+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:22:34.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.831+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18166169336284875710', time=2024-09-14T13:22:28.602195+0000, chain.objs.size()=1 2024-09-14T11:22:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.831+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.124__shadow_.5dhPZXdg_plH4PVWd9oTdlFlbC2E4Yt_0 2024-09-14T11:22:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.831+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7631374861119381034', time=2024-09-14T13:22:30.266960+0000, chain.objs.size()=1 2024-09-14T11:22:34.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.831+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.130__shadow_.ApWyR_Brm7-PfoNTRuOqHUF3hhv5qsM_0 2024-09-14T11:22:34.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.832+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.834+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:22:34.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16807383736825460698', time=2024-09-14T13:22:26.947977+0000, chain.objs.size()=1 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.118__shadow_.goMqB6VAmTbvrbsy3Uf_PZCvw9E0wuj_0 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12939618472155877041', time=2024-09-14T13:22:29.438615+0000, chain.objs.size()=1 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.127__shadow_.llPGq3XHYbNAx2rcAxf-04oX80sVEdm_0 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11220384471572843436', time=2024-09-14T13:22:30.535810+0000, chain.objs.size()=1 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.131__shadow_.lHgliO4mV9OdT8ApuMt2jLIS4zAXZc7_0 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3683565273037607322', time=2024-09-14T13:22:34.472703+0000, chain.objs.size()=1 2024-09-14T11:22:34.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.836+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.144__shadow_.Mw1kkKkXVAaXywWdfoqRRPtAnOt1boP_0 2024-09-14T11:22:34.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.838+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.840+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:22:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9863871449435463757', time=2024-09-14T13:22:25.281096+0000, chain.objs.size()=1 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.112__shadow_.Lrv8CSPVr6SJOj5_SUi4LI-8dBN8nqJ_0 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9523439934395492250', time=2024-09-14T13:22:25.832836+0000, chain.objs.size()=1 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.114__shadow_.hzPEvLFywuF149Vh5F6U2P1ZTSZVKBw_0 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15472218061054946496', time=2024-09-14T13:22:26.684086+0000, chain.objs.size()=1 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.117__shadow_.59rvo9sGj-0U6zSlGRQ_ogovn8LNlhz_0 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8620237124245918815', time=2024-09-14T13:22:27.506987+0000, chain.objs.size()=1 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.120__shadow_.R6yYZVpXwtFRdYpWqkik4oLvVfnopck_0 2024-09-14T11:22:34.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1572422071297606454', time=2024-09-14T13:22:27.511857+0000, chain.objs.size()=1 2024-09-14T11:22:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.120__shadow_.zc0CCjK2qLgPdDoOOaKfk9OrpY9K2G9_0 2024-09-14T11:22:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12340345469741780275', time=2024-09-14T13:22:28.056478+0000, chain.objs.size()=1 2024-09-14T11:22:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.122__shadow_.nNxzuRwbCd-87vzruXUSmBzzF1NDGN3_0 2024-09-14T11:22:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10559223216245077006', time=2024-09-14T13:22:31.065731+0000, chain.objs.size()=1 2024-09-14T11:22:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.842+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.133__shadow_.9kcxFtL6p5qii7FXI1cHmJn3Uc2Mtnp_0 2024-09-14T11:22:34.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.844+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.846+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:22:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.847+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:22:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1214992456658464340', time=2024-09-14T13:22:04.754198+0000, chain.objs.size()=1 2024-09-14T11:22:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.85__shadow_.1YAahO6IjNYWiJalv4ApSUZCeRJIKLD_0 2024-09-14T11:22:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8347292075823390207', time=2024-09-14T13:22:12.868574+0000, chain.objs.size()=4 2024-09-14T11:22:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.93__shadow_.uOchNMw_RsJMAU6ppaI9X6xr0YStAoY_0 2024-09-14T11:22:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.93__shadow_.uOchNMw_RsJMAU6ppaI9X6xr0YStAoY_1 2024-09-14T11:22:34.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.93__shadow_.uOchNMw_RsJMAU6ppaI9X6xr0YStAoY_2 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.93__shadow_.uOchNMw_RsJMAU6ppaI9X6xr0YStAoY_3 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3032895760023638200', time=2024-09-14T13:22:20.617859+0000, chain.objs.size()=5 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~v-tNvDi_R3m0Pfmc4hHi17hvywAPzhA.1 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__shadow_key1.2~v-tNvDi_R3m0Pfmc4hHi17hvywAPzhA.1_1 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~v-tNvDi_R3m0Pfmc4hHi17hvywAPzhA.2 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__shadow_key1.2~v-tNvDi_R3m0Pfmc4hHi17hvywAPzhA.2_1 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~v-tNvDi_R3m0Pfmc4hHi17hvywAPzhA.3 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18381326904169015612', time=2024-09-14T13:22:22.374251+0000, chain.objs.size()=5 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.104__multipart_key1.2~UvdJ0TcU_a66LvlgH6QIGu-A9hSAO7v.1 2024-09-14T11:22:34.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.848+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.104__multipart_key1.2~UvdJ0TcU_a66LvlgH6QIGu-A9hSAO7v.2 2024-09-14T11:22:34.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.851+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.104__multipart_key1.2~UvdJ0TcU_a66LvlgH6QIGu-A9hSAO7v.3 2024-09-14T11:22:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.852+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.104__multipart_key1.2~UvdJ0TcU_a66LvlgH6QIGu-A9hSAO7v.4 2024-09-14T11:22:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.104__multipart_key1.2~UvdJ0TcU_a66LvlgH6QIGu-A9hSAO7v.5 2024-09-14T11:22:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8003006059465103682', time=2024-09-14T13:22:25.553228+0000, chain.objs.size()=1 2024-09-14T11:22:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.113__shadow_.Ykmj_kE3zVvQlRrMGxeqGLieevul4b4_0 2024-09-14T11:22:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13619311331386396778', time=2024-09-14T13:22:26.399163+0000, chain.objs.size()=1 2024-09-14T11:22:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.116__shadow_.3FDCW-uRgJnYZuM4ZlAsa4LZCsx197E_0 2024-09-14T11:22:34.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16429884635226575716', time=2024-09-14T13:22:31.758877+0000, chain.objs.size()=1 2024-09-14T11:22:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.136__shadow_.XbCdvqGhdZ0k_7YsCnSr4n0H06i4wUj_0 2024-09-14T11:22:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.474583899089184240', time=2024-09-14T13:22:34.467434+0000, chain.objs.size()=5 2024-09-14T11:22:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.144__multipart_key1/data/file.mpg.2~DmGDVcx5Dk2RTqV4HdXF8FptcCFL5OU.1 2024-09-14T11:22:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.144__multipart_key1/data/file.mpg.2~DmGDVcx5Dk2RTqV4HdXF8FptcCFL5OU.2 2024-09-14T11:22:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.144__multipart_key1/data/file.mpg.2~DmGDVcx5Dk2RTqV4HdXF8FptcCFL5OU.3 2024-09-14T11:22:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.144__multipart_key1/data/file.mpg.2~DmGDVcx5Dk2RTqV4HdXF8FptcCFL5OU.4 2024-09-14T11:22:34.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.853+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.144__multipart_key1/data/file.mpg.2~DmGDVcx5Dk2RTqV4HdXF8FptcCFL5OU.5 2024-09-14T11:22:34.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.856+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.858+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:22:34.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.860+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.861+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.861+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.861+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12852126617172229224', time=2024-09-14T13:22:15.984865+0000, chain.objs.size()=1 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.861+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__shadow_.M0uCUVYI0jpPWnDeJZGq8H4xCsRc_Sl_0 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.861+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11890768146121602046', time=2024-09-14T13:22:26.383642+0000, chain.objs.size()=1 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.861+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.116__shadow_.ilf1eYQ-3udOdeWI7Ot4MTM_cJL0SQn_0 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.861+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6523444568513975729', time=2024-09-14T13:22:26.679049+0000, chain.objs.size()=1 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.862+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.117__shadow_.BE_QioptQORs16__9OTzv8b3gGn99X0_0 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.862+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6320161112607818248', time=2024-09-14T13:22:29.156921+0000, chain.objs.size()=1 2024-09-14T11:22:34.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.862+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.126__shadow_.lItuNfuFrzZdv3GSND8WTnA8vtNnLOC_0 2024-09-14T11:22:34.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.863+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.865+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:22:34.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.866+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.867+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.867+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:22:34.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.867+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3419052660024345378', time=2024-09-14T13:22:04.230574+0000, chain.objs.size()=2 2024-09-14T11:22:34.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.867+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.83__shadow_.Rmb1r3b8gPtA9Zas8AjTrlz7s9tKLUc_0 2024-09-14T11:22:34.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.867+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.83__shadow_.Rmb1r3b8gPtA9Zas8AjTrlz7s9tKLUc_1 2024-09-14T11:22:34.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.870+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.872+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:22:34.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.873+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:22:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.247182022361437900', time=2024-09-14T13:22:12.280033+0000, chain.objs.size()=5 2024-09-14T11:22:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~0i2gkH0xQBivn1EQWdvpOv7sSZl1hiK.1 2024-09-14T11:22:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__shadow_key1.2~0i2gkH0xQBivn1EQWdvpOv7sSZl1hiK.1_1 2024-09-14T11:22:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~0i2gkH0xQBivn1EQWdvpOv7sSZl1hiK.2 2024-09-14T11:22:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__shadow_key1.2~0i2gkH0xQBivn1EQWdvpOv7sSZl1hiK.2_1 2024-09-14T11:22:34.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~0i2gkH0xQBivn1EQWdvpOv7sSZl1hiK.3 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8456508711116054128', time=2024-09-14T13:22:12.729993+0000, chain.objs.size()=5 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~I9WrpFL-65YBy29pLssFWKxqHEq887Y.1 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__shadow_key1.2~I9WrpFL-65YBy29pLssFWKxqHEq887Y.1_1 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~I9WrpFL-65YBy29pLssFWKxqHEq887Y.2 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__shadow_key1.2~I9WrpFL-65YBy29pLssFWKxqHEq887Y.2_1 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~I9WrpFL-65YBy29pLssFWKxqHEq887Y.3 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2374305032673257682', time=2024-09-14T13:22:15.978450+0000, chain.objs.size()=1 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__shadow_.V1lXKWT9lH6CDSim_IZkPZ7QXM7Fr-K_0 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13609518317000041592', time=2024-09-14T13:22:17.995715+0000, chain.objs.size()=5 2024-09-14T11:22:34.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.874+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~xI8wYLWJYhnz93Alqc9Gi5HZIJzbxXQ.1 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~xI8wYLWJYhnz93Alqc9Gi5HZIJzbxXQ.2 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~xI8wYLWJYhnz93Alqc9Gi5HZIJzbxXQ.3 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~xI8wYLWJYhnz93Alqc9Gi5HZIJzbxXQ.4 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~xI8wYLWJYhnz93Alqc9Gi5HZIJzbxXQ.5 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14929930149257446357', time=2024-09-14T13:22:30.256642+0000, chain.objs.size()=1 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.130__shadow_.SPh9MLlPHCgRI7rUVnPqtczyKXQ-eK0_0 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.741346201364636637', time=2024-09-14T13:22:30.522329+0000, chain.objs.size()=1 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.131__shadow_.RWDnEAVRLmXxaYCc7ZK3rfnkkVj9lA3_0 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16217791423786524953', time=2024-09-14T13:22:30.798772+0000, chain.objs.size()=1 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.132__shadow_.5y4Gg1uqPcsevbykzE0-gQ-OrYSqGhg_0 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10371689998964778674', time=2024-09-14T13:22:30.803860+0000, chain.objs.size()=1 2024-09-14T11:22:34.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.879+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.132__shadow_.08F9-3K5s7rYWotbp1CD3KTwZ4nCJiL_0 2024-09-14T11:22:34.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.882+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.884+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:22:34.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.885+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:22:34.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7886238110346573062', time=2024-09-14T13:22:15.973370+0000, chain.objs.size()=5 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file2.mpg.2~ZZQ8SLKzvCbq7onbDvl6uQ9suuSlZr1.1 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file2.mpg.2~ZZQ8SLKzvCbq7onbDvl6uQ9suuSlZr1.2 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file2.mpg.2~ZZQ8SLKzvCbq7onbDvl6uQ9suuSlZr1.3 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file2.mpg.2~ZZQ8SLKzvCbq7onbDvl6uQ9suuSlZr1.4 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.100__multipart_file2.mpg.2~ZZQ8SLKzvCbq7onbDvl6uQ9suuSlZr1.5 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~zdD3bruVDvzJYxw9ubzhNk8kGjthiTD', time=2024-09-14T13:22:16.625937+0000, chain.objs.size()=5 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.101__multipart_key1.2~zdD3bruVDvzJYxw9ubzhNk8kGjthiTD.7 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.101__multipart_key1.2~zdD3bruVDvzJYxw9ubzhNk8kGjthiTD.8 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.101__multipart_key1.2~zdD3bruVDvzJYxw9ubzhNk8kGjthiTD.9 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.101__multipart_key1.2~zdD3bruVDvzJYxw9ubzhNk8kGjthiTD.10 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.101__multipart_key1.2~zdD3bruVDvzJYxw9ubzhNk8kGjthiTD.11 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9474151390912898259', time=2024-09-14T13:22:28.339029+0000, chain.objs.size()=1 2024-09-14T11:22:34.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.886+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.123__shadow_.HR08y7IgS3sHtW20dCU8hqji0afGlfa_0 2024-09-14T11:22:34.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.889+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.892+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:22:34.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.893+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11725593049983968996', time=2024-09-14T13:22:01.395977+0000, chain.objs.size()=1 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.77__shadow_.ofWD_T-45QGKzwlnmmeoYdaNhI08ANG_0 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1216104473195620377', time=2024-09-14T13:22:04.491228+0000, chain.objs.size()=1 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.84__shadow_.J9_l9cg7W2TeOEXxuotEN-Q0R9apAeo_0 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11906131136728257164', time=2024-09-14T13:22:06.639471+0000, chain.objs.size()=5 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.1 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.2 2024-09-14T11:22:34.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.3 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.4 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.91__multipart_key1.2~uQ2Lqqfjmzu0D1tDrtrEpnKKMMtzq4L.5 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17278240290245652503', time=2024-09-14T13:22:25.276488+0000, chain.objs.size()=1 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.112__shadow_.tXYwNXvv8DuSfB8pW7TT06tHB65Im5T_0 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12613927258491175160', time=2024-09-14T13:22:29.166970+0000, chain.objs.size()=1 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.126__shadow_.n0Ssf68TuP0In9NLtzfVGrzbPN29-91_0 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9900599065197645996', time=2024-09-14T13:22:32.945062+0000, chain.objs.size()=1 2024-09-14T11:22:34.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.894+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.140__shadow_.W_2TRE_Vm08H1b0Bqvu9KqaXowzGNfw_0 2024-09-14T11:22:34.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.899+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.901+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:22:34.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.902+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.903+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.903+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-14T11:22:34.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.903+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11415801044904067227', time=2024-09-14T13:22:27.239575+0000, chain.objs.size()=1 2024-09-14T11:22:34.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.903+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.119__shadow_.0W2UiLU3oMMPgWOw6n9tJ1gCElOIK5j_0 2024-09-14T11:22:34.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.903+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1989306999079555577', time=2024-09-14T13:22:29.433454+0000, chain.objs.size()=1 2024-09-14T11:22:34.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.903+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.127__shadow_.agV8-S-2AuE-4Khad6quthfUuyDNfQk_0 2024-09-14T11:22:34.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.904+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.906+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:22:34.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3115195693356767629', time=2024-09-14T13:22:25.271073+0000, chain.objs.size()=1 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.112__shadow_.OSFb_4nl-6VuXAk8j95p8cj5WocsWnI_0 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7765356950530154514', time=2024-09-14T13:22:26.111610+0000, chain.objs.size()=1 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.115__shadow_.vXoEs1bnKCSLiHuA88icltutB2_pnyq_0 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6334412110299839118', time=2024-09-14T13:22:27.235086+0000, chain.objs.size()=1 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.119__shadow_.IvOCsie4z0ViYclJ2VKpZldzkzb5Wyy_0 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9424365937300467792', time=2024-09-14T13:22:27.794765+0000, chain.objs.size()=1 2024-09-14T11:22:34.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.908+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.121__shadow_.JK-k9ysEqZQJTZiDvw_vVVaj3DYFS5n_0 2024-09-14T11:22:34.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.910+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.912+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:22:34.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.913+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:22:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9710404845745860056', time=2024-09-14T13:22:28.607431+0000, chain.objs.size()=1 2024-09-14T11:22:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.124__shadow_.-fYaZWEbPKrceZr_NrsDIBK6DDtqH-b_0 2024-09-14T11:22:34.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15172084484360509950', time=2024-09-14T13:22:28.885183+0000, chain.objs.size()=1 2024-09-14T11:22:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.125__shadow_.I7YpVVRbhYPjmzE9sRF5KWejFQxgez7_0 2024-09-14T11:22:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.779131010124893470', time=2024-09-14T13:22:29.428089+0000, chain.objs.size()=1 2024-09-14T11:22:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.127__shadow_.Ru9yQpO0H5i_Jmq0Kzfqm0JN4erzS_E_0 2024-09-14T11:22:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10644744606417951595', time=2024-09-14T13:22:29.705937+0000, chain.objs.size()=1 2024-09-14T11:22:34.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.914+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.128__shadow_.ywV-zGCEucywU-DRi4BWYdeLfS8cRO__0 2024-09-14T11:22:34.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.916+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.918+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:22:34.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.919+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15059707069853417190', time=2024-09-14T13:22:10.259640+0000, chain.objs.size()=5 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~dDaMwBH4WBUSSG_xvF6fAg7B_rU66j6.1 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~dDaMwBH4WBUSSG_xvF6fAg7B_rU66j6.2 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~dDaMwBH4WBUSSG_xvF6fAg7B_rU66j6.3 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~dDaMwBH4WBUSSG_xvF6fAg7B_rU66j6.4 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~dDaMwBH4WBUSSG_xvF6fAg7B_rU66j6.5 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7318697199550585615', time=2024-09-14T13:22:27.230388+0000, chain.objs.size()=1 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.119__shadow_.TXijH2Fs1zZk-6Dw0R_5-OilfNYL7O8_0 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11771245029084220221', time=2024-09-14T13:22:29.716125+0000, chain.objs.size()=1 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.128__shadow_.Bcjk664uawGug2i5yK6LD3dqY1Li2kq_0 2024-09-14T11:22:34.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3859971343422523835', time=2024-09-14T13:22:29.999449+0000, chain.objs.size()=1 2024-09-14T11:22:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.129__shadow_.p8zmr17WVd7fVbNLTOOpVfFdIlFzQT-_0 2024-09-14T11:22:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15265709939943367073', time=2024-09-14T13:22:30.528050+0000, chain.objs.size()=1 2024-09-14T11:22:34.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.920+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.131__shadow_.T35nyTUc81koa7nWgkn0vNdaBuni9UK_0 2024-09-14T11:22:34.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.923+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.925+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:22:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:22:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16817310398755024692', time=2024-09-14T13:22:25.558379+0000, chain.objs.size()=1 2024-09-14T11:22:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.113__shadow_.jlFOmJegZSu7Rv2A0qDR3lCCsPkCb4H_0 2024-09-14T11:22:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5891394406271252688', time=2024-09-14T13:22:26.953264+0000, chain.objs.size()=1 2024-09-14T11:22:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.118__shadow_.fVZ6HIMaapePjCo-t-4dPaXb1gA2jfV_0 2024-09-14T11:22:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2918457239006635182', time=2024-09-14T13:22:28.062114+0000, chain.objs.size()=1 2024-09-14T11:22:34.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.927+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.122__shadow_.ToVwDccYNCgf-Imhx52Ld1M4PNx6Rdw_0 2024-09-14T11:22:34.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.929+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.931+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:22:34.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.932+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:22:34.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15714564895951133362', time=2024-09-14T13:22:11.272403+0000, chain.objs.size()=5 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~s0BgVHMYDuaINNCEVEwLL_L2BFodydL.1 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~s0BgVHMYDuaINNCEVEwLL_L2BFodydL.2 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~s0BgVHMYDuaINNCEVEwLL_L2BFodydL.3 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~s0BgVHMYDuaINNCEVEwLL_L2BFodydL.4 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~s0BgVHMYDuaINNCEVEwLL_L2BFodydL.5 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10042906133390018926', time=2024-09-14T13:22:25.285954+0000, chain.objs.size()=1 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.112__shadow_.PS79Csp9PNn7ziSsz_WvDmlVsDKSx2a_0 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16295003705206147762', time=2024-09-14T13:22:28.870501+0000, chain.objs.size()=1 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.125__shadow_.-Pgw4R5NVqILgDEm39lREWov9TPbnl4_0 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13865540114804222068', time=2024-09-14T13:22:29.982404+0000, chain.objs.size()=1 2024-09-14T11:22:34.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.933+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.129__shadow_.tykjuBAvdAHFsYvvMp9leqApne5d0ge_0 2024-09-14T11:22:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.934+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3560747572475054781', time=2024-09-14T13:22:30.262162+0000, chain.objs.size()=1 2024-09-14T11:22:34.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.934+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.130__shadow_.g5Qtz9rKMDVszkU5GLiKpIIrmKe8tG5_0 2024-09-14T11:22:34.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.936+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.939+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:22:34.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.940+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.940+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-14T11:22:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7818971526300546445', time=2024-09-14T13:22:12.975356+0000, chain.objs.size()=5 2024-09-14T11:22:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~JJ6VrxHTKpmvoogeSwBu-7W4Fsxq4_V.1 2024-09-14T11:22:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__shadow_key1.2~JJ6VrxHTKpmvoogeSwBu-7W4Fsxq4_V.1_1 2024-09-14T11:22:34.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~JJ6VrxHTKpmvoogeSwBu-7W4Fsxq4_V.2 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__shadow_key1.2~JJ6VrxHTKpmvoogeSwBu-7W4Fsxq4_V.2_1 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~JJ6VrxHTKpmvoogeSwBu-7W4Fsxq4_V.3 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2657034241337790563', time=2024-09-14T13:22:21.145258+0000, chain.objs.size()=1 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.103__shadow_.gO3ngq3_vux8TFotDSSIZ174NZdGRR5_0 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4867758162232255735', time=2024-09-14T13:22:21.721689+0000, chain.objs.size()=5 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.103__multipart_key1.2~cHqYrHsdrS2Bv5QgdZoA6mzpKoO0zIw.1 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.103__multipart_key1.2~cHqYrHsdrS2Bv5QgdZoA6mzpKoO0zIw.2 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.103__multipart_key1.2~cHqYrHsdrS2Bv5QgdZoA6mzpKoO0zIw.3 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.103__multipart_key1.2~cHqYrHsdrS2Bv5QgdZoA6mzpKoO0zIw.4 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.103__multipart_key1.2~cHqYrHsdrS2Bv5QgdZoA6mzpKoO0zIw.5 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17256846660949007164', time=2024-09-14T13:22:29.162080+0000, chain.objs.size()=1 2024-09-14T11:22:34.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.941+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.126__shadow_.fNFEFEl5vZM-xKSlvf8T9G7JLXf8Whg_0 2024-09-14T11:22:34.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.946+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.948+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:22:34.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.949+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.950+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.950+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-14T11:22:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.950+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4579735691370793783', time=2024-09-14T13:22:26.958546+0000, chain.objs.size()=1 2024-09-14T11:22:34.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.950+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.118__shadow_.-2s8Q0Qd1da3NxWsKOFSq3LilkVVpJ3_0 2024-09-14T11:22:34.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.951+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.953+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:22:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.955+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.955+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-14T11:22:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1476035868589721232', time=2024-09-14T13:22:08.948628+0000, chain.objs.size()=5 2024-09-14T11:22:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~x2tGesbM5ILIk1dUGC8HXk1nPb09Q6T.1 2024-09-14T11:22:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~x2tGesbM5ILIk1dUGC8HXk1nPb09Q6T.2 2024-09-14T11:22:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~x2tGesbM5ILIk1dUGC8HXk1nPb09Q6T.3 2024-09-14T11:22:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~x2tGesbM5ILIk1dUGC8HXk1nPb09Q6T.4 2024-09-14T11:22:34.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.94__multipart_key1.2~x2tGesbM5ILIk1dUGC8HXk1nPb09Q6T.5 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3692690021790462997', time=2024-09-14T13:22:15.234437+0000, chain.objs.size()=5 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.99__multipart_key1.2~hhv0mx4u_gWhpO9uTySItVQ3a9B0tnM.1 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.99__multipart_key1.2~hhv0mx4u_gWhpO9uTySItVQ3a9B0tnM.2 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.99__multipart_key1.2~hhv0mx4u_gWhpO9uTySItVQ3a9B0tnM.3 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.99__multipart_key1.2~hhv0mx4u_gWhpO9uTySItVQ3a9B0tnM.4 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.99__multipart_key1.2~hhv0mx4u_gWhpO9uTySItVQ3a9B0tnM.5 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17737873860267746458', time=2024-09-14T13:22:19.575712+0000, chain.objs.size()=5 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~VeAXxHkISkpjDk7KR9bB-0e_pugPcX3.1 2024-09-14T11:22:34.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.956+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__shadow_key1.2~VeAXxHkISkpjDk7KR9bB-0e_pugPcX3.1_1 2024-09-14T11:22:34.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.960+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~VeAXxHkISkpjDk7KR9bB-0e_pugPcX3.2 2024-09-14T11:22:34.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.960+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__shadow_key1.2~VeAXxHkISkpjDk7KR9bB-0e_pugPcX3.2_1 2024-09-14T11:22:34.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.960+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~VeAXxHkISkpjDk7KR9bB-0e_pugPcX3.3 2024-09-14T11:22:34.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.960+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.221330014619060331', time=2024-09-14T13:22:27.785079+0000, chain.objs.size()=1 2024-09-14T11:22:34.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.960+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.121__shadow_.UC7Miv1m8c7C28jj2NDFxheruhP1bdv_0 2024-09-14T11:22:34.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.960+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12288788942440636724', time=2024-09-14T13:22:29.443485+0000, chain.objs.size()=1 2024-09-14T11:22:34.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.960+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.127__shadow_._OaaMG61MpVqBkVTSMqbUjf6cBUMSSI_0 2024-09-14T11:22:34.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.963+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.966+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:22:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.967+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.967+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12926192091015353606', time=2024-09-14T13:22:25.843308+0000, chain.objs.size()=1 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.114__shadow_.pMROfjd-j_vw7sdtiXvYY9zCC1XdoXR_0 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6182366731000133465', time=2024-09-14T13:22:26.963127+0000, chain.objs.size()=1 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.118__shadow_._-cXpip8WPB01ECU7aihD1kktXKC6aP_0 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11495974074460906931', time=2024-09-14T13:22:27.502069+0000, chain.objs.size()=1 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.120__shadow_.9io6PAzNCjV-gAyFOE4dd7E6y8U6TRq_0 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1572171135869656598', time=2024-09-14T13:22:27.516916+0000, chain.objs.size()=1 2024-09-14T11:22:34.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.120__shadow_.TFJSwjYbmWY-8yvvCQQT2BiIZOMi_st_0 2024-09-14T11:22:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17049649690412086225', time=2024-09-14T13:22:29.988472+0000, chain.objs.size()=1 2024-09-14T11:22:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.129__shadow_.710uUbztTqJhT0sKEOMx5YhtQM8exSO_0 2024-09-14T11:22:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8899429844196752795', time=2024-09-14T13:22:31.969304+0000, chain.objs.size()=1 2024-09-14T11:22:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.137__shadow_._QaAkVrZ3GWf0NskBVfCAwUpNXYxDGX_0 2024-09-14T11:22:34.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.969+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:34.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.971+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:22:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.973+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:34.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.973+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.107958+0000, chain.objs.size()=91 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.1 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.2 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.3 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.4 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.5 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.6 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.7 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.8 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.9 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.10 2024-09-14T11:22:34.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.11 2024-09-14T11:22:34.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.974+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.12 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.13 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.14 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.15 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.16 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.17 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.18 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.19 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.20 2024-09-14T11:22:34.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.21 2024-09-14T11:22:34.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.22 2024-09-14T11:22:34.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.976+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.23 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.24 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.25 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.26 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.27 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.28 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.29 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.30 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.31 2024-09-14T11:22:34.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.32 2024-09-14T11:22:34.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.33 2024-09-14T11:22:34.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.978+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.34 2024-09-14T11:22:34.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.980+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.35 2024-09-14T11:22:34.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.980+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.36 2024-09-14T11:22:34.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.980+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.37 2024-09-14T11:22:34.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.980+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.38 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.981+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.39 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.981+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.40 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.41 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.42 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.43 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.44 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.45 2024-09-14T11:22:34.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.46 2024-09-14T11:22:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.47 2024-09-14T11:22:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.982+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.48 2024-09-14T11:22:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.983+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.49 2024-09-14T11:22:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.983+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.50 2024-09-14T11:22:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.983+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.51 2024-09-14T11:22:34.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.983+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.52 2024-09-14T11:22:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.984+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.53 2024-09-14T11:22:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.984+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.54 2024-09-14T11:22:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.984+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.55 2024-09-14T11:22:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.984+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.56 2024-09-14T11:22:34.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.984+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.57 2024-09-14T11:22:34.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.985+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.58 2024-09-14T11:22:34.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.985+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.59 2024-09-14T11:22:34.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.985+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.60 2024-09-14T11:22:34.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.985+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.61 2024-09-14T11:22:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.985+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.62 2024-09-14T11:22:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.985+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.63 2024-09-14T11:22:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.985+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.64 2024-09-14T11:22:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.986+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.65 2024-09-14T11:22:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.986+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.66 2024-09-14T11:22:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.986+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.67 2024-09-14T11:22:34.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.986+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.68 2024-09-14T11:22:34.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.987+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.69 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.987+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.70 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.987+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.71 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.987+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.72 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.987+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.73 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.987+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.74 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.987+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.75 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.988+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.76 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.988+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.77 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.988+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.78 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.988+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.79 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.989+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.80 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.989+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.81 2024-09-14T11:22:34.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.989+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.82 2024-09-14T11:22:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.989+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.83 2024-09-14T11:22:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.989+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.84 2024-09-14T11:22:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.990+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.85 2024-09-14T11:22:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.990+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.86 2024-09-14T11:22:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.990+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.87 2024-09-14T11:22:34.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.990+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.88 2024-09-14T11:22:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.990+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.89 2024-09-14T11:22:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.991+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.91 2024-09-14T11:22:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.991+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.95 2024-09-14T11:22:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.991+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.123387+0000, chain.objs.size()=7 2024-09-14T11:22:34.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.991+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.90 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.991+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.92 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.991+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.93 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.992+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.94 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.992+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.96 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.992+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.97 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.992+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.98 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.993+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.136031+0000, chain.objs.size()=3 2024-09-14T11:22:34.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.993+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.99 2024-09-14T11:22:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.993+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.100 2024-09-14T11:22:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.993+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.101 2024-09-14T11:22:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.993+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.164408+0000, chain.objs.size()=9 2024-09-14T11:22:34.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.993+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.102 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.994+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.103 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.994+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.104 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.994+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.105 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.994+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.106 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.994+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.107 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.994+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.108 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.994+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.109 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.995+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.110 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.995+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.191003+0000, chain.objs.size()=10 2024-09-14T11:22:34.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.995+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.111 2024-09-14T11:22:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.995+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.112 2024-09-14T11:22:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.995+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.113 2024-09-14T11:22:34.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.996+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.114 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.115 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.116 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.117 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.118 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.119 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.120 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.206988+0000, chain.objs.size()=2 2024-09-14T11:22:34.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.121 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.997+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.122 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.998+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.233056+0000, chain.objs.size()=10 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.998+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.123 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.124 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.125 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.126 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.127 2024-09-14T11:22:34.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.128 2024-09-14T11:22:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.129 2024-09-14T11:22:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.130 2024-09-14T11:22:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:34.999+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.131 2024-09-14T11:22:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.000+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.132 2024-09-14T11:22:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.000+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.266581+0000, chain.objs.size()=10 2024-09-14T11:22:34.999 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.000+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.133 2024-09-14T11:22:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.000+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.134 2024-09-14T11:22:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.001+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.135 2024-09-14T11:22:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.001+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.136 2024-09-14T11:22:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.001+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.137 2024-09-14T11:22:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.001+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.138 2024-09-14T11:22:35.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.001+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.139 2024-09-14T11:22:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.002+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.140 2024-09-14T11:22:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.002+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.141 2024-09-14T11:22:35.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.002+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.142 2024-09-14T11:22:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.002+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.286606+0000, chain.objs.size()=6 2024-09-14T11:22:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.002+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.143 2024-09-14T11:22:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.144 2024-09-14T11:22:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.145 2024-09-14T11:22:35.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.146 2024-09-14T11:22:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.147 2024-09-14T11:22:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.148 2024-09-14T11:22:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.313588+0000, chain.objs.size()=10 2024-09-14T11:22:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.149 2024-09-14T11:22:35.003 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.003+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.150 2024-09-14T11:22:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.004+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.151 2024-09-14T11:22:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.004+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.152 2024-09-14T11:22:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.004+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.153 2024-09-14T11:22:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.004+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.154 2024-09-14T11:22:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.005+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.155 2024-09-14T11:22:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.005+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.156 2024-09-14T11:22:35.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.005+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.157 2024-09-14T11:22:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.005+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.158 2024-09-14T11:22:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.006+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.330514+0000, chain.objs.size()=6 2024-09-14T11:22:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.006+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.159 2024-09-14T11:22:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.006+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.160 2024-09-14T11:22:35.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.006+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.161 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.006+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.162 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.006+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.163 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.006+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.164 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.007+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.347922+0000, chain.objs.size()=5 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.007+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.165 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.007+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.166 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.007+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.167 2024-09-14T11:22:35.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.007+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.168 2024-09-14T11:22:35.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.007+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.169 2024-09-14T11:22:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.377385+0000, chain.objs.size()=10 2024-09-14T11:22:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.170 2024-09-14T11:22:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.171 2024-09-14T11:22:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.172 2024-09-14T11:22:35.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.173 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.174 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.175 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.176 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.177 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.178 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.179 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.393546+0000, chain.objs.size()=6 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.009+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.180 2024-09-14T11:22:35.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.010+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.181 2024-09-14T11:22:35.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.182 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.183 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.184 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.185 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.420163+0000, chain.objs.size()=10 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.186 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.187 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.188 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.189 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.190 2024-09-14T11:22:35.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.011+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.191 2024-09-14T11:22:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.012+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.192 2024-09-14T11:22:35.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.013+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.193 2024-09-14T11:22:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.194 2024-09-14T11:22:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.195 2024-09-14T11:22:35.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd', time=2024-09-14T13:22:23.579808+0000, chain.objs.size()=212 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.1 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.2 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.3 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.4 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.5 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.6 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.7 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.8 2024-09-14T11:22:35.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.014+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.9 2024-09-14T11:22:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.015+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.10 2024-09-14T11:22:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.015+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.11 2024-09-14T11:22:35.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.12 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.13 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.14 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.15 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.16 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.17 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.18 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.19 2024-09-14T11:22:35.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.016+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.20 2024-09-14T11:22:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.017+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.21 2024-09-14T11:22:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.017+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.22 2024-09-14T11:22:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.017+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.23 2024-09-14T11:22:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.018+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.24 2024-09-14T11:22:35.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.018+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.25 2024-09-14T11:22:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.26 2024-09-14T11:22:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.27 2024-09-14T11:22:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.28 2024-09-14T11:22:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.29 2024-09-14T11:22:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.30 2024-09-14T11:22:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.31 2024-09-14T11:22:35.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.32 2024-09-14T11:22:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.33 2024-09-14T11:22:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.019+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.34 2024-09-14T11:22:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.020+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.35 2024-09-14T11:22:35.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.020+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.36 2024-09-14T11:22:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.37 2024-09-14T11:22:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.38 2024-09-14T11:22:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.39 2024-09-14T11:22:35.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.40 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.41 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.42 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.43 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.44 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.45 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.46 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.021+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.47 2024-09-14T11:22:35.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.022+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.48 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.49 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.50 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.51 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.52 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.53 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.54 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.55 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.56 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.57 2024-09-14T11:22:35.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.023+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.58 2024-09-14T11:22:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.024+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.59 2024-09-14T11:22:35.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.024+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.60 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.61 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.62 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.63 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.64 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.65 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.66 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.67 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.68 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.69 2024-09-14T11:22:35.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.025+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.70 2024-09-14T11:22:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.026+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.71 2024-09-14T11:22:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.72 2024-09-14T11:22:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.73 2024-09-14T11:22:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.74 2024-09-14T11:22:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.75 2024-09-14T11:22:35.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.76 2024-09-14T11:22:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.77 2024-09-14T11:22:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.78 2024-09-14T11:22:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.79 2024-09-14T11:22:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.027+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.80 2024-09-14T11:22:35.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.028+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.81 2024-09-14T11:22:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.028+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.82 2024-09-14T11:22:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.028+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.83 2024-09-14T11:22:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.028+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.84 2024-09-14T11:22:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.028+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.85 2024-09-14T11:22:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.029+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.86 2024-09-14T11:22:35.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.029+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.87 2024-09-14T11:22:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.030+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.88 2024-09-14T11:22:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.030+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.89 2024-09-14T11:22:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.030+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.90 2024-09-14T11:22:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.030+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.91 2024-09-14T11:22:35.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.030+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.92 2024-09-14T11:22:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.030+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.93 2024-09-14T11:22:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.030+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.94 2024-09-14T11:22:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.031+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.95 2024-09-14T11:22:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.031+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.96 2024-09-14T11:22:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.031+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.97 2024-09-14T11:22:35.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.031+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.98 2024-09-14T11:22:35.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.99 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.100 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.101 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.102 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.103 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.104 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.105 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.106 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.107 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.108 2024-09-14T11:22:35.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.032+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.109 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.110 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.111 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.112 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.113 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.114 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.115 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.116 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.117 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.118 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.119 2024-09-14T11:22:35.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.034+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.120 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.035+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.121 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.122 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.123 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.124 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.125 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.126 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.127 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.128 2024-09-14T11:22:35.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.129 2024-09-14T11:22:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.130 2024-09-14T11:22:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.036+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.131 2024-09-14T11:22:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.037+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.132 2024-09-14T11:22:35.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.037+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.133 2024-09-14T11:22:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.037+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.134 2024-09-14T11:22:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.037+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.135 2024-09-14T11:22:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.037+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.136 2024-09-14T11:22:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.037+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.137 2024-09-14T11:22:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.038+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.138 2024-09-14T11:22:35.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.038+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.139 2024-09-14T11:22:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.038+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.140 2024-09-14T11:22:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.038+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.141 2024-09-14T11:22:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.038+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.142 2024-09-14T11:22:35.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.143 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.144 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.145 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.146 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.147 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.148 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.149 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.150 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.151 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.039+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.152 2024-09-14T11:22:35.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.040+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.153 2024-09-14T11:22:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.041+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.154 2024-09-14T11:22:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.041+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.155 2024-09-14T11:22:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.041+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.156 2024-09-14T11:22:35.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.041+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.157 2024-09-14T11:22:35.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.158 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.159 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.160 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.161 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.162 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.163 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.164 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.165 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.166 2024-09-14T11:22:35.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.042+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.167 2024-09-14T11:22:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.043+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.168 2024-09-14T11:22:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.169 2024-09-14T11:22:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.170 2024-09-14T11:22:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.171 2024-09-14T11:22:35.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.172 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.173 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.174 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.175 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.176 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.177 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.044+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.178 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.045+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.179 2024-09-14T11:22:35.044 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.045+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.180 2024-09-14T11:22:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.045+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.181 2024-09-14T11:22:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.046+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.182 2024-09-14T11:22:35.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.046+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.183 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.046+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.184 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.185 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.186 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.187 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.188 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.189 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.190 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.191 2024-09-14T11:22:35.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.047+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.192 2024-09-14T11:22:35.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.048+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.193 2024-09-14T11:22:35.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.048+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.194 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.195 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.196 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.197 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.198 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.199 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.200 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.201 2024-09-14T11:22:35.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.202 2024-09-14T11:22:35.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.049+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.203 2024-09-14T11:22:35.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.050+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.204 2024-09-14T11:22:35.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.050+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.205 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.050+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.206 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.050+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.207 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.051+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.208 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.051+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.209 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.051+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.210 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.051+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.211 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.051+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.105__multipart_key1.2~L7ywgBHWAF46lhObJ94SUX7wge0cgmd.212 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.051+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11903567991857411860', time=2024-09-14T13:22:32.184482+0000, chain.objs.size()=1 2024-09-14T11:22:35.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.051+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.138__shadow_.OIMaLoFIPbJZI4HBfO53gvIG7kIg7xz_0 2024-09-14T11:22:35.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.053+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:35.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.055+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:22:35.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.056+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:22:35.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.454494912825328132', time=2024-09-14T13:22:05.860351+0000, chain.objs.size()=1 2024-09-14T11:22:35.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.90__shadow_.M6VMe0jhf0yvyRNJDC52_bF8k707Xt0_0 2024-09-14T11:22:35.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17521094755593954027', time=2024-09-14T13:22:25.827345+0000, chain.objs.size()=1 2024-09-14T11:22:35.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.114__shadow_.uxjmKmd-cVIdON6m0HTZzRMlFpynYae_0 2024-09-14T11:22:35.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4034168799786414426', time=2024-09-14T13:22:28.071680+0000, chain.objs.size()=1 2024-09-14T11:22:35.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.057+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.122__shadow_.vEqjoL7f9k4Q6SkBHvxGQs8rp-ZVqke_0 2024-09-14T11:22:35.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.058+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:35.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.060+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:22:35.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.061+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:22:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3339845427993784235', time=2024-09-14T13:22:25.838168+0000, chain.objs.size()=1 2024-09-14T11:22:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.114__shadow_.QgtTwZBBgT6bN2UsvmdK-1Ld2zJ7qWr_0 2024-09-14T11:22:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6394177614850612418', time=2024-09-14T13:22:26.121150+0000, chain.objs.size()=1 2024-09-14T11:22:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.115__shadow_.eh4UWeDHU_DsGm4D8koIxFve5FqBrTb_0 2024-09-14T11:22:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11279984683013749326', time=2024-09-14T13:22:26.389041+0000, chain.objs.size()=1 2024-09-14T11:22:35.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.062+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.116__shadow_.LLtAD_Mls1CNEf3kE-HuvGsQ1sDqcQv_0 2024-09-14T11:22:35.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.064+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:35.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.066+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:22:35.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.067+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.067+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-14T11:22:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3299862068399641044', time=2024-09-14T13:22:23.838938+0000, chain.objs.size()=1 2024-09-14T11:22:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.106__shadow_.zJXFT1TIZLH8cVCm5NL3X4lbzN8G5au_0 2024-09-14T11:22:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12258932808433365009', time=2024-09-14T13:22:25.563488+0000, chain.objs.size()=1 2024-09-14T11:22:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.113__shadow_.Owe0VzH4dmpldz2wYtHNsO6rbZS0dFW_0 2024-09-14T11:22:35.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1788210145314797574', time=2024-09-14T13:22:27.225547+0000, chain.objs.size()=1 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.119__shadow_.50ToXReBQzRj4IpATCo0R74Hn36wTvE_0 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10407995714640447274', time=2024-09-14T13:22:28.597040+0000, chain.objs.size()=1 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.124__shadow_.Vr_ZctIY8ut4wl9QC48VKdCymWRKx6M_0 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8499193104437629300', time=2024-09-14T13:22:29.721038+0000, chain.objs.size()=1 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.128__shadow_.Xv2ykFGe9cBJgjNxRFQWTtqM4pvsyhg_0 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10365777255902174506', time=2024-09-14T13:22:29.993444+0000, chain.objs.size()=1 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.129__shadow_._8_03WV8IXbwlXluXRpnCEcSAqSdY5x_0 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16559063133346279957', time=2024-09-14T13:22:30.793726+0000, chain.objs.size()=1 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.132__shadow_.u3S3tFC_BJpWokdaYTtFgCbjcF_DPKB_0 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1450580937976121075', time=2024-09-14T13:22:32.694552+0000, chain.objs.size()=1 2024-09-14T11:22:35.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.068+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.139__shadow_.FNxK8-tVbIa0h17v6jUel1khVT3NXai_0 2024-09-14T11:22:35.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.069+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:35.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.071+0000 7f1184923800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:22:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.073+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.073+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:22:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16360419485314142764', time=2024-09-14T13:22:14.050341+0000, chain.objs.size()=5 2024-09-14T11:22:35.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.98__multipart_key1.2~mNk4UCFqMbRvJOCT_OMTgziIkOdR3iV.1 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.98__multipart_key1.2~mNk4UCFqMbRvJOCT_OMTgziIkOdR3iV.2 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.98__multipart_key1.2~mNk4UCFqMbRvJOCT_OMTgziIkOdR3iV.3 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.98__multipart_key1.2~mNk4UCFqMbRvJOCT_OMTgziIkOdR3iV.4 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.98__multipart_key1.2~mNk4UCFqMbRvJOCT_OMTgziIkOdR3iV.5 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12369899697397850179', time=2024-09-14T13:22:18.353158+0000, chain.objs.size()=5 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~nOPff0Z-gH5lnVqd6fap9lFlFD0kw8J.1 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~nOPff0Z-gH5lnVqd6fap9lFlFD0kw8J.2 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~nOPff0Z-gH5lnVqd6fap9lFlFD0kw8J.3 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~nOPff0Z-gH5lnVqd6fap9lFlFD0kw8J.4 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~nOPff0Z-gH5lnVqd6fap9lFlFD0kw8J.5 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13421009722193943866', time=2024-09-14T13:22:18.693066+0000, chain.objs.size()=5 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~o8VBRyXR95nwBqeaPLoWyeabQ9AZUvz.1 2024-09-14T11:22:35.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.074+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~o8VBRyXR95nwBqeaPLoWyeabQ9AZUvz.2 2024-09-14T11:22:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.078+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~o8VBRyXR95nwBqeaPLoWyeabQ9AZUvz.3 2024-09-14T11:22:35.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.078+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~o8VBRyXR95nwBqeaPLoWyeabQ9AZUvz.4 2024-09-14T11:22:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~o8VBRyXR95nwBqeaPLoWyeabQ9AZUvz.5 2024-09-14T11:22:35.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12811963730835199333', time=2024-09-14T13:22:20.479298+0000, chain.objs.size()=5 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~Ol0hLNcCn5Ybf5uXQVf4eBZaLECQutV.1 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__shadow_key1.2~Ol0hLNcCn5Ybf5uXQVf4eBZaLECQutV.1_1 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~Ol0hLNcCn5Ybf5uXQVf4eBZaLECQutV.2 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__shadow_key1.2~Ol0hLNcCn5Ybf5uXQVf4eBZaLECQutV.2_1 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.102__multipart_key1.2~Ol0hLNcCn5Ybf5uXQVf4eBZaLECQutV.3 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2903506042349361885', time=2024-09-14T13:22:26.106075+0000, chain.objs.size()=1 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.115__shadow_.3TRcmPGlbHgNy4t9lsXn-Nhjm357aCc_0 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18201162312851030463', time=2024-09-14T13:22:31.071366+0000, chain.objs.size()=1 2024-09-14T11:22:35.079 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.079+0000 7f1184923800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.133__shadow_.xPD5MwU0i1PsZj45b9b6kL0yyoHchO6_0 2024-09-14T11:22:35.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.083+0000 7f1184923800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:22:35.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.086+0000 7f1036fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:35.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.088+0000 7f1184923800 20 remove_watcher() i=0 2024-09-14T11:22:35.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.088+0000 7f1184923800 2 removed watcher, disabling cache 2024-09-14T11:22:35.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.089+0000 7f1184923800 20 remove_watcher() i=1 2024-09-14T11:22:35.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.090+0000 7f1184923800 20 remove_watcher() i=2 2024-09-14T11:22:35.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.091+0000 7f1184923800 20 remove_watcher() i=3 2024-09-14T11:22:35.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.092+0000 7f1184923800 20 remove_watcher() i=4 2024-09-14T11:22:35.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.093+0000 7f1184923800 20 remove_watcher() i=5 2024-09-14T11:22:35.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.094+0000 7f1184923800 20 remove_watcher() i=6 2024-09-14T11:22:35.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.095+0000 7f1184923800 20 remove_watcher() i=7 2024-09-14T11:22:35.106 DEBUG:teuthology.orchestra.run.smithi002:> radosgw-admin gc process --include-all 2024-09-14T11:22:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:35.159 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:35.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.199+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.200+0000 7f0d4b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.200+0000 7f0d4b52e800 20 realm 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.200+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.201+0000 7f0d4b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.201+0000 7f0d4b52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.201+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.201+0000 7f0d4b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:35.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.201+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.201+0000 7f0d4b52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:35.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.202+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.202+0000 7f0d4b52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:35.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.202+0000 7f0d4b52e800 20 searching for the correct realm 2024-09-14T11:22:35.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.205+0000 7f0d46adc640 0 -- 172.21.15.2:0/2016730089 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f0d38075020 msgr2=0x7f0d3806a710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:35.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.208+0000 7f0d472dd640 0 -- 172.21.15.2:0/2016730089 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f0d3c0d3890 msgr2=0x7f0d3c0b64f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:35.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:35.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.414+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 zone default found 2024-09-14T11:22:35.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 4 Realm: () 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 zonegroup default 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.415+0000 7f0d4b52e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.416+0000 7f0d4b52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.416+0000 7f0d4b52e800 20 started sync module instance, tier type = 2024-09-14T11:22:35.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.416+0000 7f0d4b52e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:35.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.424+0000 7f0d4b52e800 20 add_watcher() i=0 2024-09-14T11:22:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.424+0000 7f0d4b52e800 20 add_watcher() i=1 2024-09-14T11:22:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.424+0000 7f0d4b52e800 20 add_watcher() i=2 2024-09-14T11:22:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.424+0000 7f0d4b52e800 20 add_watcher() i=3 2024-09-14T11:22:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.424+0000 7f0d4b52e800 20 add_watcher() i=4 2024-09-14T11:22:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.424+0000 7f0d4b52e800 20 add_watcher() i=5 2024-09-14T11:22:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.424+0000 7f0d4b52e800 20 add_watcher() i=6 2024-09-14T11:22:35.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.425+0000 7f0d4b52e800 20 add_watcher() i=7 2024-09-14T11:22:35.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.425+0000 7f0d4b52e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.427+0000 7f0bfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.428+0000 7f0d4b52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:35.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.428+0000 7f0d4b52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.464+0000 7f0bfcfe1640 20 reqs_thread_entry: start 2024-09-14T11:22:35.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.464+0000 7f0d4b52e800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.464+0000 7f0d4b52e800 20 Filter name: none 2024-09-14T11:22:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.464+0000 7f0b767fc640 20 reqs_thread_entry: start 2024-09-14T11:22:35.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.464+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:22:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.466+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.466+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.466+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.467+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:22:35.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.469+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.469+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.469+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.470+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:22:35.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.473+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.473+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.473+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.473+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:22:35.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.475+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.475+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.475+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.476+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:22:35.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.478+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.478+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.480+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.480+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:22:35.480 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.481+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.482+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.482+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.482 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.483+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:22:35.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.484+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.484+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.484 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.485+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.486+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:22:35.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.487+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.488+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.488+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.489+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:22:35.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.490+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.491+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.491+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.492+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:22:35.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.493+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.493+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.494+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.495+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:22:35.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.496+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.496+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.497+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.498+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:22:35.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.499+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.499+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.499+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.500+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:22:35.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.502+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.502+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.502+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.503+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:22:35.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.504+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.505+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.505+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.506+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:22:35.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.507+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.508+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.507 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.508+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.508 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.509+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:22:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.510+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.511+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.511+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.513+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:22:35.512 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.514+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.514+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.514+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.516+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:22:35.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.516+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.516+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.516+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.517+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:22:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.519+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.519+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.519+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.520+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:22:35.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.522+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.522+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.522+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.523+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:22:35.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.524+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.525+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.525+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.526+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:22:35.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.527+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.528+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.528+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.529+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:22:35.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.531+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.531+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.531+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.532+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:22:35.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.534+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.534+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.534+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.535+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:22:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.537+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.537+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.537+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.538+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:22:35.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.540+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.540+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.540+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.542+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:22:35.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.543+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.544+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.544+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.545+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:22:35.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.545+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.545+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.547+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.547+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:22:35.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.548+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.547 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.548+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.549+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.550+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:22:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.552+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.550 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.552+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.551 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.553+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.554+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:22:35.553 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.554+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.555+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.555+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.555 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.557+0000 7f0d4b52e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:22:35.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.558+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.556 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.558+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:22:35.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.558+0000 7f0d4b52e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:22:35.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.559+0000 7f0bfdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:35.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.562+0000 7f0d4b52e800 20 remove_watcher() i=0 2024-09-14T11:22:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.562+0000 7f0d4b52e800 2 removed watcher, disabling cache 2024-09-14T11:22:35.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.563+0000 7f0d4b52e800 20 remove_watcher() i=1 2024-09-14T11:22:35.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.564+0000 7f0d4b52e800 20 remove_watcher() i=2 2024-09-14T11:22:35.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.565+0000 7f0d4b52e800 20 remove_watcher() i=3 2024-09-14T11:22:35.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.567+0000 7f0d4b52e800 20 remove_watcher() i=4 2024-09-14T11:22:35.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.567+0000 7f0d4b52e800 20 remove_watcher() i=5 2024-09-14T11:22:35.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.567+0000 7f0d4b52e800 20 remove_watcher() i=6 2024-09-14T11:22:35.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:35.569+0000 7f0d4b52e800 20 remove_watcher() i=7 2024-09-14T11:22:35.580 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-14T11:22:35.597 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888', 's3 tenant': 'RGW33333333333333333'}, 'force-branch': 'ceph-master', 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-14T11:22:35.598 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-14T11:22:35.598 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-14T11:22:35.598 DEBUG:teuthology.orchestra.run.smithi002:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:22:35.628 INFO:teuthology.orchestra.run.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-14T11:22:36.398 INFO:tasks.s3tests:Creating rgw users... 2024-09-14T11:22:36.398 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-14T11:22:36.398 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key IUCRDVOGTOYDGFWDJMHR --secret NA7fKHTMF8lc3psMA/ycynQLwG27JGO06ib7Swc3fhypzAOqau7uOA== --cluster ceph 2024-09-14T11:22:36.504 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:36.504 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:36.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.542+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.543+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.543+0000 7fa5e423e800 20 realm 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.543+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.544+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.544+0000 7fa5e423e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.544+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.544+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.544+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.545+0000 7fa5e423e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.545+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.545+0000 7fa5e423e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:36.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.545+0000 7fa5e423e800 20 searching for the correct realm 2024-09-14T11:22:36.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.548+0000 7fa5e1527640 0 -- 172.21.15.2:0/2047447477 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fa5d402c070 msgr2=0x7fa5d403a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:36.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.755+0000 7fa5e1d28640 0 -- 172.21.15.2:0/2047447477 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa5d8069ad0 msgr2=0x7fa5d80cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:36.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.962+0000 7fa5e423e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:36.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.962+0000 7fa5e423e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:36.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.962+0000 7fa5e423e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.962+0000 7fa5e423e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.962+0000 7fa5e423e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.962+0000 7fa5e423e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.962+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.963+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.963+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.963+0000 7fa5e423e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:36.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.963+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 zone default found 2024-09-14T11:22:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 4 Realm: () 2024-09-14T11:22:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:36.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 zonegroup default 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.964+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.965+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.965+0000 7fa5e423e800 20 started sync module instance, tier type = 2024-09-14T11:22:36.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.965+0000 7fa5e423e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.976+0000 7fa5e423e800 20 add_watcher() i=0 2024-09-14T11:22:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.976+0000 7fa5e423e800 20 add_watcher() i=1 2024-09-14T11:22:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.976+0000 7fa5e423e800 20 add_watcher() i=2 2024-09-14T11:22:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.976+0000 7fa5e423e800 20 add_watcher() i=3 2024-09-14T11:22:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.976+0000 7fa5e423e800 20 add_watcher() i=4 2024-09-14T11:22:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.976+0000 7fa5e423e800 20 add_watcher() i=5 2024-09-14T11:22:36.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.976+0000 7fa5e423e800 20 add_watcher() i=6 2024-09-14T11:22:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.977+0000 7fa5e423e800 20 add_watcher() i=7 2024-09-14T11:22:36.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.977+0000 7fa5e423e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:36.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa493fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa5e423e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa5e423e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa5e423e800 5 note: GC not initialized 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa492ffd640 20 reqs_thread_entry: start 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa5e423e800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa5e423e800 20 Filter name: none 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa490ff9640 20 reqs_thread_entry: start 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa5e423e800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:22:36.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.979+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-14T11:22:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:22:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-14T11:22:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 cache get: name=default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR : miss 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 cache put: name=default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR info.flags=0x0 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 adding default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR to cache LRU end 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 cache get: name=default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR : hit (negative entry) 2024-09-14T11:22:36.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.980+0000 7fa5e423e800 10 cache get: name=default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR : hit (negative entry) 2024-09-14T11:22:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.982+0000 7fa5e423e800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:22:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.982+0000 7fa5e423e800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:22:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.982+0000 7fa5e423e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:22:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.982+0000 7fa4c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464491 cookie 94924098916880 notifier 8474 bl.length()=645 2024-09-14T11:22:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.982+0000 7fa4c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:22:36.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.982+0000 7fa4c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:22:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.984+0000 7fa5e423e800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:22:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.984+0000 7fa5e423e800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:22:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.984+0000 7fa5e423e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-14T11:22:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.984+0000 7fa4c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464492 cookie 94924098931008 notifier 8474 bl.length()=185 2024-09-14T11:22:36.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.984+0000 7fa4c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-14T11:22:36.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.984+0000 7fa4c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-14T11:22:36.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.986+0000 7fa5e423e800 10 cache put: name=default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR info.flags=0x7 2024-09-14T11:22:36.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.986+0000 7fa5e423e800 10 moving default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR to cache LRU end 2024-09-14T11:22:36.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.986+0000 7fa5e423e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:IUCRDVOGTOYDGFWDJMHR, ofs0, ns] 2024-09-14T11:22:36.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.986+0000 7fa4c57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1120986464493 cookie 94924098931008 notifier 8474 bl.length()=186 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.986+0000 7fa4c57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR info.flags=0x7 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.986+0000 7fa4c57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+IUCRDVOGTOYDGFWDJMHR to cache LRU end 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "foo.client.0", 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr.foo.client.0", 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "foo+test@test.test", 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:22:36.985 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "foo.client.0", 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "IUCRDVOGTOYDGFWDJMHR", 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "NA7fKHTMF8lc3psMA/ycynQLwG27JGO06ib7Swc3fhypzAOqau7uOA==", 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:36.981556Z" 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:36.986 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "rgw", 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:22:36.987 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "", 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:36.981543Z", 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.988+0000 7fa493fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.990+0000 7fa5e423e800 20 remove_watcher() i=0 2024-09-14T11:22:36.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.990+0000 7fa5e423e800 2 removed watcher, disabling cache 2024-09-14T11:22:36.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.991+0000 7fa5e423e800 20 remove_watcher() i=1 2024-09-14T11:22:36.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.992+0000 7fa5e423e800 20 remove_watcher() i=2 2024-09-14T11:22:36.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.993+0000 7fa5e423e800 20 remove_watcher() i=3 2024-09-14T11:22:36.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.994+0000 7fa5e423e800 20 remove_watcher() i=4 2024-09-14T11:22:36.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.995+0000 7fa5e423e800 20 remove_watcher() i=5 2024-09-14T11:22:36.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.996+0000 7fa5e423e800 20 remove_watcher() i=6 2024-09-14T11:22:36.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:36.998+0000 7fa5e423e800 20 remove_watcher() i=7 2024-09-14T11:22:37.008 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 8553683279 --totp-seed SF4RRYO3DPP72SDXBYKIPJBVR7B7J57LXM4CHVMADUIG4V5HBEIMLXLVYPZDWE62 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:22:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:37.078 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:37.114 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.116+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.117+0000 7f1a2df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.117+0000 7f1a2df25800 20 realm 2024-09-14T11:22:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.117+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.117+0000 7f1a2df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.117+0000 7f1a2df25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.117+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.116 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.118+0000 7f1a2df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.118+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.119+0000 7f1a2df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:37.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.119+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.119+0000 7f1a2df25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:37.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.119+0000 7f1a2df25800 20 searching for the correct realm 2024-09-14T11:22:37.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.123+0000 7f1a29332640 0 -- 172.21.15.2:0/3524518618 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x56463c5b0000 msgr2=0x56463c5b24c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:37.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.126+0000 7f1a29332640 0 -- 172.21.15.2:0/3524518618 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f1a1c016070 msgr2=0x7f1a1c016960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:37.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.131+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 zone default found 2024-09-14T11:22:37.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 4 Realm: () 2024-09-14T11:22:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 zonegroup default 2024-09-14T11:22:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:37.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.132+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.133+0000 7f1a2df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.133+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.133+0000 7f1a2df25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.133+0000 7f1a2df25800 20 started sync module instance, tier type = 2024-09-14T11:22:37.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.133+0000 7f1a2df25800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=0 2024-09-14T11:22:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=1 2024-09-14T11:22:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=2 2024-09-14T11:22:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=3 2024-09-14T11:22:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=4 2024-09-14T11:22:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=5 2024-09-14T11:22:37.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=6 2024-09-14T11:22:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 20 add_watcher() i=7 2024-09-14T11:22:37.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.142+0000 7f1a2df25800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.144+0000 7f18db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.144+0000 7f1a2df25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.144+0000 7f1a2df25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.144+0000 7f1a2df25800 5 note: GC not initialized 2024-09-14T11:22:37.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f18da7fc640 20 reqs_thread_entry: start 2024-09-14T11:22:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 20 Filter name: none 2024-09-14T11:22:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f184bfff640 20 reqs_thread_entry: start 2024-09-14T11:22:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-14T11:22:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 20 rados->read ofs=0 len=0 2024-09-14T11:22:37.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:22:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-14T11:22:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:22:37.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:37.145+0000 7f1a2df25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.564+0000 7f1a2df25800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:22:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.564+0000 7f1a2df25800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:22:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.564+0000 7f1a2df25800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-14T11:22:38.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.565+0000 7f190cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399086 cookie 94859660279168 notifier 8492 bl.length()=659 2024-09-14T11:22:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.565+0000 7f190cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-14T11:22:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.565+0000 7f190cff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-14T11:22:38.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.566+0000 7f18db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.569+0000 7f1a2df25800 20 remove_watcher() i=0 2024-09-14T11:22:38.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.569+0000 7f1a2df25800 2 removed watcher, disabling cache 2024-09-14T11:22:38.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.570+0000 7f1a2df25800 20 remove_watcher() i=1 2024-09-14T11:22:38.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.571+0000 7f1a2df25800 20 remove_watcher() i=2 2024-09-14T11:22:38.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.572+0000 7f1a2df25800 20 remove_watcher() i=3 2024-09-14T11:22:38.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.573+0000 7f1a2df25800 20 remove_watcher() i=4 2024-09-14T11:22:38.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.575+0000 7f1a2df25800 20 remove_watcher() i=5 2024-09-14T11:22:38.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.576+0000 7f1a2df25800 20 remove_watcher() i=6 2024-09-14T11:22:38.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.577+0000 7f1a2df25800 20 remove_watcher() i=7 2024-09-14T11:22:38.588 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-14T11:22:38.589 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key UPADKMPXJEFJWBHWWPEL --secret e4wyk0HuYW2YRUyUTMPBA4qeCA5n2tDBe7dmkFH+kqkUIOoURg+Yxg== --cluster ceph 2024-09-14T11:22:38.658 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:38.658 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:38.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.697+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 20 realm 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.698+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.699+0000 7f7284813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.699+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.700+0000 7f7284813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:38.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.700+0000 7f7284813800 20 searching for the correct realm 2024-09-14T11:22:38.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.703+0000 7f7280793640 0 -- 172.21.15.2:0/1078841061 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x562bffbfc2c0 msgr2=0x562bffbfe780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:38.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.707+0000 7f727f791640 0 -- 172.21.15.2:0/1078841061 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f7270093070 msgr2=0x7f72700093c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:38.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.710 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.711+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:38.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 zone default found 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 4 Realm: () 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 zonegroup default 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.712+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.713+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.713+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.713+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.713+0000 7f7284813800 20 started sync module instance, tier type = 2024-09-14T11:22:38.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.713+0000 7f7284813800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.722+0000 7f7284813800 20 add_watcher() i=0 2024-09-14T11:22:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.722+0000 7f7284813800 20 add_watcher() i=1 2024-09-14T11:22:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.722+0000 7f7284813800 20 add_watcher() i=2 2024-09-14T11:22:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.722+0000 7f7284813800 20 add_watcher() i=3 2024-09-14T11:22:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.722+0000 7f7284813800 20 add_watcher() i=4 2024-09-14T11:22:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.722+0000 7f7284813800 20 add_watcher() i=5 2024-09-14T11:22:38.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.722+0000 7f7284813800 20 add_watcher() i=6 2024-09-14T11:22:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.723+0000 7f7284813800 20 add_watcher() i=7 2024-09-14T11:22:38.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.723+0000 7f7284813800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.724+0000 7f7135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.724+0000 7f7284813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.724+0000 7f7284813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.724+0000 7f7284813800 5 note: GC not initialized 2024-09-14T11:22:38.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7134fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 20 Filter name: none 2024-09-14T11:22:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f70ae7fc640 20 reqs_thread_entry: start 2024-09-14T11:22:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:22:38.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-14T11:22:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:22:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-14T11:22:38.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.725+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 10 cache get: name=default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL : miss 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 20 rados->read ofs=0 len=0 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 10 cache put: name=default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL info.flags=0x0 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 10 adding default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL to cache LRU end 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 10 cache get: name=default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL : hit (negative entry) 2024-09-14T11:22:38.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.726+0000 7f7284813800 10 cache get: name=default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL : hit (negative entry) 2024-09-14T11:22:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.727+0000 7f7284813800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:22:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.727+0000 7f7284813800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:22:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.727+0000 7f7284813800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:22:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.728+0000 7f715effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399003 cookie 94746974393392 notifier 8510 bl.length()=645 2024-09-14T11:22:38.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.728+0000 7f715effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.728+0000 7f715effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.729+0000 7f7284813800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.729+0000 7f7284813800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.729+0000 7f7284813800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.729+0000 7f715effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399018 cookie 94746974403600 notifier 8510 bl.length()=185 2024-09-14T11:22:38.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.729+0000 7f715effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.729+0000 7f715effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.731+0000 7f7284813800 10 cache put: name=default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL info.flags=0x7 2024-09-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.731+0000 7f7284813800 10 moving default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL to cache LRU end 2024-09-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.731+0000 7f7284813800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:UPADKMPXJEFJWBHWWPEL, ofs0, ns] 2024-09-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.731+0000 7f715e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399019 cookie 94746974403600 notifier 8510 bl.length()=186 2024-09-14T11:22:38.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.731+0000 7f715e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL info.flags=0x7 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.731+0000 7f715e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+UPADKMPXJEFJWBHWWPEL to cache LRU end 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "bar.client.0", 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr.bar.client.0", 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "bar+test@test.test", 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:38.730 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "bar.client.0", 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "UPADKMPXJEFJWBHWWPEL", 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "e4wyk0HuYW2YRUyUTMPBA4qeCA5n2tDBe7dmkFH+kqkUIOoURg+Yxg==", 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:38.727076Z" 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:22:38.731 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:22:38.732 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "rgw", 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "", 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:38.727060Z", 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:22:38.733 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:22:38.734 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:38.734 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.732+0000 7f7135fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.734+0000 7f7284813800 20 remove_watcher() i=0 2024-09-14T11:22:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.734+0000 7f7284813800 2 removed watcher, disabling cache 2024-09-14T11:22:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.735+0000 7f7284813800 20 remove_watcher() i=1 2024-09-14T11:22:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.736+0000 7f7284813800 20 remove_watcher() i=2 2024-09-14T11:22:38.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.737+0000 7f7284813800 20 remove_watcher() i=3 2024-09-14T11:22:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.738+0000 7f7284813800 20 remove_watcher() i=4 2024-09-14T11:22:38.737 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.739+0000 7f7284813800 20 remove_watcher() i=5 2024-09-14T11:22:38.738 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.740+0000 7f7284813800 20 remove_watcher() i=6 2024-09-14T11:22:38.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:38.741+0000 7f7284813800 20 remove_watcher() i=7 2024-09-14T11:22:38.751 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2743424499 --totp-seed MFCJBGSIC2H7LA5G55RV6SYPP45DU37C2UPFIVIG4XTW4XBEU5UBTWN3EBMI2WBQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:22:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:38.819 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:39.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.053+0000 7f35c7781640 0 --2- 172.21.15.2:0/3672481328 >> [v2:172.21.15.2:3301/0,v1:172.21.15.2:6790/0] conn(0x555c9b2c8170 0x555c9b2c85f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-14T11:22:39.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.060+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 20 realm 2024-09-14T11:22:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:39.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.062+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.063+0000 7f35ca498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:39.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.063+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.064+0000 7f35ca498800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.064+0000 7f35ca498800 20 searching for the correct realm 2024-09-14T11:22:39.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.064+0000 7f35c7781640 0 -- 172.21.15.2:0/1086605792 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x555c9b2f37d0 msgr2=0x555c9b2f5c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:39.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.270+0000 7f35c7781640 0 -- 172.21.15.2:0/1086605792 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x555c9b2f37d0 msgr2=0x555c9b2f5c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:39.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.279+0000 7f35ca498800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:39.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:39.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 zone default found 2024-09-14T11:22:39.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 4 Realm: () 2024-09-14T11:22:39.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 zonegroup default 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.280+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.281+0000 7f35ca498800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.281+0000 7f35ca498800 20 started sync module instance, tier type = 2024-09-14T11:22:39.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.281+0000 7f35ca498800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:39.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.290+0000 7f35ca498800 20 add_watcher() i=0 2024-09-14T11:22:39.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.290+0000 7f35ca498800 20 add_watcher() i=1 2024-09-14T11:22:39.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.290+0000 7f35ca498800 20 add_watcher() i=2 2024-09-14T11:22:39.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.290+0000 7f35ca498800 20 add_watcher() i=3 2024-09-14T11:22:39.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.290+0000 7f35ca498800 20 add_watcher() i=4 2024-09-14T11:22:39.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.290+0000 7f35ca498800 20 add_watcher() i=5 2024-09-14T11:22:39.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.290+0000 7f35ca498800 20 add_watcher() i=6 2024-09-14T11:22:39.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.291+0000 7f35ca498800 20 add_watcher() i=7 2024-09-14T11:22:39.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.291+0000 7f35ca498800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:39.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f347e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f35ca498800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f35ca498800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f35ca498800 5 note: GC not initialized 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f347d7e2640 20 reqs_thread_entry: start 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f35ca498800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f35ca498800 20 Filter name: none 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f34767fc640 20 reqs_thread_entry: start 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f35ca498800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-14T11:22:39.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.293+0000 7f35ca498800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.294+0000 7f35ca498800 20 rados_obj.operate() r=0 bl.length=460 2024-09-14T11:22:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.294+0000 7f35ca498800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-14T11:22:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.294+0000 7f35ca498800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:22:39.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.294+0000 7f35ca498800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:39.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.297+0000 7f35ca498800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:22:39.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.297+0000 7f35ca498800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:22:39.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.297+0000 7f35ca498800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-14T11:22:39.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.297+0000 7f34a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399004 cookie 93856228928240 notifier 8525 bl.length()=659 2024-09-14T11:22:39.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.297+0000 7f34a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-14T11:22:39.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.297+0000 7f34a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-14T11:22:39.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.299+0000 7f347e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:39.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.301+0000 7f35ca498800 20 remove_watcher() i=0 2024-09-14T11:22:39.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.301+0000 7f35ca498800 2 removed watcher, disabling cache 2024-09-14T11:22:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.302+0000 7f35ca498800 20 remove_watcher() i=1 2024-09-14T11:22:39.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.303+0000 7f35ca498800 20 remove_watcher() i=2 2024-09-14T11:22:39.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.305+0000 7f35ca498800 20 remove_watcher() i=3 2024-09-14T11:22:39.304 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.306+0000 7f35ca498800 20 remove_watcher() i=4 2024-09-14T11:22:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.306+0000 7f35ca498800 20 remove_watcher() i=5 2024-09-14T11:22:39.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.307+0000 7f35ca498800 20 remove_watcher() i=6 2024-09-14T11:22:39.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.309+0000 7f35ca498800 20 remove_watcher() i=7 2024-09-14T11:22:39.319 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW33333333333333333 --account-name Mr.RGW33333333333333333 --email RGW33333333333333333+test@test.test --tenant testx 2024-09-14T11:22:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:39.382 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:39.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.420+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 20 realm 2024-09-14T11:22:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.422+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.423+0000 7f7baa3a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.423+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.423+0000 7f7baa3a7800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:39.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.423+0000 7f7baa3a7800 20 searching for the correct realm 2024-09-14T11:22:39.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.427+0000 7f7b9f690640 0 -- 172.21.15.2:0/1985929917 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x5606447abf10 msgr2=0x5606447ae3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:39.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.430+0000 7f7ba7e91640 0 -- 172.21.15.2:0/1985929917 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f7b90035820 msgr2=0x7f7b9008f770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.435+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:39.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:39.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 zone default found 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 4 Realm: () 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 zonegroup default 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.436+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.437+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.437+0000 7f7baa3a7800 20 started sync module instance, tier type = 2024-09-14T11:22:39.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.437+0000 7f7baa3a7800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:39.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.446+0000 7f7baa3a7800 20 add_watcher() i=0 2024-09-14T11:22:39.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.446+0000 7f7baa3a7800 20 add_watcher() i=1 2024-09-14T11:22:39.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.446+0000 7f7baa3a7800 20 add_watcher() i=2 2024-09-14T11:22:39.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.446+0000 7f7baa3a7800 20 add_watcher() i=3 2024-09-14T11:22:39.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.446+0000 7f7baa3a7800 20 add_watcher() i=4 2024-09-14T11:22:39.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.446+0000 7f7baa3a7800 20 add_watcher() i=5 2024-09-14T11:22:39.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.446+0000 7f7baa3a7800 20 add_watcher() i=6 2024-09-14T11:22:39.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.447+0000 7f7baa3a7800 20 add_watcher() i=7 2024-09-14T11:22:39.445 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.447+0000 7f7baa3a7800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.448+0000 7f7a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.448+0000 7f7baa3a7800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.448+0000 7f7baa3a7800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.448+0000 7f7baa3a7800 5 note: GC not initialized 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7a5cfe1640 20 reqs_thread_entry: start 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 20 Filter name: none 2024-09-14T11:22:39.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f79d67fc640 20 reqs_thread_entry: start 2024-09-14T11:22:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 10 cache get: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 : miss 2024-09-14T11:22:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x0 2024-09-14T11:22:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 10 adding default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:22:39.448 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 20 failed to read name.testx$Mr.RGW33333333333333333 with: (2) No such file or directory 2024-09-14T11:22:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 10 cache get: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test : miss 2024-09-14T11:22:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.449+0000 7f7baa3a7800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.450+0000 7f7baa3a7800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.450+0000 7f7baa3a7800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x0 2024-09-14T11:22:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.450+0000 7f7baa3a7800 10 adding default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:22:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.450+0000 7f7baa3a7800 20 failed to read rgw33333333333333333+test@test.test with: (2) No such file or directory 2024-09-14T11:22:39.449 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.451+0000 7f7baa3a7800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:22:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.451+0000 7f7baa3a7800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:22:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.451+0000 7f7baa3a7800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW33333333333333333, ofs0, ns] 2024-09-14T11:22:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.451+0000 7f7a86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399005 cookie 94584918738368 notifier 8543 bl.length()=389 2024-09-14T11:22:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.451+0000 7f7a86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:22:39.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.451+0000 7f7a86ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:22:39.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.453+0000 7f7baa3a7800 10 cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:22:39.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.453+0000 7f7baa3a7800 10 moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:22:39.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.453+0000 7f7baa3a7800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.testx$Mr.RGW33333333333333333, ofs0, ns] 2024-09-14T11:22:39.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.453+0000 7f7a86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399087 cookie 94584918745616 notifier 8543 bl.length()=230 2024-09-14T11:22:39.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.453+0000 7f7a86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 info.flags=0x17 2024-09-14T11:22:39.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.453+0000 7f7a86ffd640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.testx$Mr.RGW33333333333333333 to cache LRU end 2024-09-14T11:22:39.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.455+0000 7f7baa3a7800 10 cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:22:39.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.455+0000 7f7baa3a7800 10 moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:22:39.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.455+0000 7f7baa3a7800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw33333333333333333+test@test.test, ofs0, ns] 2024-09-14T11:22:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.455+0000 7f7a86ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398984 cookie 94584918740576 notifier 8543 bl.length()=234 2024-09-14T11:22:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.455+0000 7f7a86ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw33333333333333333+test@test.test info.flags=0x17 2024-09-14T11:22:39.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.455+0000 7f7a86ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw33333333333333333+test@test.test to cache LRU end 2024-09-14T11:22:39.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.457+0000 7f7a5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.459+0000 7f7baa3a7800 20 remove_watcher() i=0 2024-09-14T11:22:39.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.459+0000 7f7baa3a7800 2 removed watcher, disabling cache 2024-09-14T11:22:39.458 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.460+0000 7f7baa3a7800 20 remove_watcher() i=1 2024-09-14T11:22:39.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.461+0000 7f7baa3a7800 20 remove_watcher() i=2 2024-09-14T11:22:39.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.462+0000 7f7baa3a7800 20 remove_watcher() i=3 2024-09-14T11:22:39.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.463+0000 7f7baa3a7800 20 remove_watcher() i=4 2024-09-14T11:22:39.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.464+0000 7f7baa3a7800 20 remove_watcher() i=5 2024-09-14T11:22:39.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.465+0000 7f7baa3a7800 20 remove_watcher() i=6 2024-09-14T11:22:39.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.466+0000 7f7baa3a7800 20 remove_watcher() i=7 2024-09-14T11:22:39.473 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "id": "RGW33333333333333333", 2024-09-14T11:22:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "tenant": "testx", 2024-09-14T11:22:39.473 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "Mr.RGW33333333333333333", 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "RGW33333333333333333+test@test.test", 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "quota": { 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:39.474 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max_users": 1000, 2024-09-14T11:22:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max_roles": 1000, 2024-09-14T11:22:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max_groups": 1000, 2024-09-14T11:22:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:39.475 INFO:teuthology.orchestra.run.smithi002.stdout: "max_access_keys": 4 2024-09-14T11:22:39.475 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:39.476 DEBUG:tasks.s3tests:Creating user RGW33333333333333333 on client.0 2024-09-14T11:22:39.476 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name Mr.RGW33333333333333333 --email 'testx$tenanteduser+test@test.test' --access-key XPRKCWQAZKNDMDQREZWZ --secret TBoIrWsqsbYiXQFjSWRdWRi6+KBSdUzHib/rbtNf0etxKMFhA3VHLA== --cluster ceph --account-id RGW33333333333333333 --account-root 2024-09-14T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:39.546 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:39.593 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.595+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 20 realm 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.597+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.598+0000 7f57b7740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.598+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.598+0000 7f57b7740800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:39.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.598+0000 7f57b7740800 20 searching for the correct realm 2024-09-14T11:22:39.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.606+0000 7f57b3cc8640 0 -- 172.21.15.2:0/1226761267 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f57a808f040 msgr2=0x7f57a8078410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:39.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.613+0000 7f57b34c7640 0 -- 172.21.15.2:0/1226761267 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f57a80ac410 msgr2=0x7f57a80ac870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:39.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.820+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 zone default found 2024-09-14T11:22:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 4 Realm: () 2024-09-14T11:22:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:39.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 zonegroup default 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.821+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.822+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.822+0000 7f57b7740800 20 started sync module instance, tier type = 2024-09-14T11:22:39.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.822+0000 7f57b7740800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.831+0000 7f57b7740800 20 add_watcher() i=0 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.831+0000 7f57b7740800 20 add_watcher() i=1 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.831+0000 7f57b7740800 20 add_watcher() i=2 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.831+0000 7f57b7740800 20 add_watcher() i=3 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.831+0000 7f57b7740800 20 add_watcher() i=4 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.831+0000 7f57b7740800 20 add_watcher() i=5 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.831+0000 7f57b7740800 20 add_watcher() i=6 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.832+0000 7f57b7740800 20 add_watcher() i=7 2024-09-14T11:22:39.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.832+0000 7f57b7740800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.834+0000 7f5669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.834+0000 7f57b7740800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.834+0000 7f57b7740800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.834+0000 7f57b7740800 5 note: GC not initialized 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.834+0000 7f5668fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.834+0000 7f57b7740800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.834+0000 7f57b7740800 20 Filter name: none 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f55e27fc640 20 reqs_thread_entry: start 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:22:39.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 10 cache get: name=default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ : miss 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.835+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 cache put: name=default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ info.flags=0x0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 adding default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ to cache LRU end 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 cache get: name=default.rgw.meta+accounts+account.RGW33333333333333333 : miss 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 20 rados_obj.operate() r=0 bl.length=189 2024-09-14T11:22:39.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 cache put: name=default.rgw.meta+accounts+account.RGW33333333333333333 info.flags=0x17 2024-09-14T11:22:39.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 adding default.rgw.meta+accounts+account.RGW33333333333333333 to cache LRU end 2024-09-14T11:22:39.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:39.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 cache get: name=default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ : hit (negative entry) 2024-09-14T11:22:39.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.836+0000 7f57b7740800 10 cache get: name=default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ : hit (negative entry) 2024-09-14T11:22:39.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.838+0000 7f57b7740800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:22:39.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.838+0000 7f57b7740800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:22:39.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.838+0000 7f57b7740800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:22:39.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.838+0000 7f5696ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366316 cookie 93930471311312 notifier 9057 bl.length()=732 2024-09-14T11:22:39.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.838+0000 7f5696ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:22:39.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.838+0000 7f5696ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:22:39.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.840+0000 7f57b7740800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:22:39.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.840+0000 7f57b7740800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:22:39.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.840+0000 7f57b7740800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-14T11:22:39.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.841+0000 7f56967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366210 cookie 93930471316176 notifier 9057 bl.length()=215 2024-09-14T11:22:39.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.841+0000 7f56967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-14T11:22:39.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.841+0000 7f56967fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-14T11:22:39.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.842+0000 7f57b7740800 10 cache put: name=default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ info.flags=0x7 2024-09-14T11:22:39.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.842+0000 7f57b7740800 10 moving default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ to cache LRU end 2024-09-14T11:22:39.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.842+0000 7f57b7740800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:XPRKCWQAZKNDMDQREZWZ, ofs0, ns] 2024-09-14T11:22:39.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.843+0000 7f5696ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366233 cookie 93930471301616 notifier 9057 bl.length()=201 2024-09-14T11:22:39.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.843+0000 7f5696ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ info.flags=0x7 2024-09-14T11:22:39.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.843+0000 7f5696ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XPRKCWQAZKNDMDQREZWZ to cache LRU end 2024-09-14T11:22:39.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.844+0000 7f57b7740800 20 linked user testx$tenanteduser.client.0 to account RGW33333333333333333 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr.RGW33333333333333333", 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "testx$tenanteduser.client.0", 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "XPRKCWQAZKNDMDQREZWZ", 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "TBoIrWsqsbYiXQFjSWRdWRi6+KBSdUzHib/rbtNf0etxKMFhA3VHLA==", 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:22:39.843 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:39.837623Z" 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:39.844 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "root", 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "RGW33333333333333333", 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:39.837611Z", 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:39.845 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:39.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.845+0000 7f5669fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:39.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.847+0000 7f57b7740800 20 remove_watcher() i=0 2024-09-14T11:22:39.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.847+0000 7f57b7740800 2 removed watcher, disabling cache 2024-09-14T11:22:39.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.849+0000 7f57b7740800 20 remove_watcher() i=1 2024-09-14T11:22:39.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.850+0000 7f57b7740800 20 remove_watcher() i=2 2024-09-14T11:22:39.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.851+0000 7f57b7740800 20 remove_watcher() i=3 2024-09-14T11:22:39.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.852+0000 7f57b7740800 20 remove_watcher() i=4 2024-09-14T11:22:39.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.853+0000 7f57b7740800 20 remove_watcher() i=5 2024-09-14T11:22:39.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.854+0000 7f57b7740800 20 remove_watcher() i=6 2024-09-14T11:22:39.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.855+0000 7f57b7740800 20 remove_watcher() i=7 2024-09-14T11:22:39.864 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 5650651911 --totp-seed TDB6AU4SUTMTMOHVZ3FVEMAJRRQSIAPNCKSFER43XR4DTXQE3VXDP5ZXC7FR3D5W --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:22:39.931 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:39.932 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:39.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.969+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 20 realm 2024-09-14T11:22:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.971+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.972+0000 7fe1c5887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:39.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.972+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.972+0000 7fe1c5887800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:39.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.972+0000 7fe1c5887800 20 searching for the correct realm 2024-09-14T11:22:39.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.975+0000 7fe1bab70640 0 -- 172.21.15.2:0/4280263629 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fe1b4003b80 msgr2=0x7fe1b40c2ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:39.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:39.979+0000 7fe1c3371640 0 -- 172.21.15.2:0/4280263629 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fe1ac07e140 msgr2=0x7fe1ac071050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.185+0000 7fe1c5887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.185+0000 7fe1c5887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.185+0000 7fe1c5887800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.185+0000 7fe1c5887800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.185+0000 7fe1c5887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.185+0000 7fe1c5887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.185+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 zone default found 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 4 Realm: () 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:40.186 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 zonegroup default 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.186+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.187+0000 7fe1c5887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.187+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.187+0000 7fe1c5887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.187+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.187+0000 7fe1c5887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.187+0000 7fe1c5887800 20 started sync module instance, tier type = 2024-09-14T11:22:40.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.187+0000 7fe1c5887800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:40.195 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.197+0000 7fe1c5887800 20 add_watcher() i=0 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.197+0000 7fe1c5887800 20 add_watcher() i=1 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.197+0000 7fe1c5887800 20 add_watcher() i=2 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.197+0000 7fe1c5887800 20 add_watcher() i=3 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.197+0000 7fe1c5887800 20 add_watcher() i=4 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.197+0000 7fe1c5887800 20 add_watcher() i=5 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.197+0000 7fe1c5887800 20 add_watcher() i=6 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.198+0000 7fe1c5887800 20 add_watcher() i=7 2024-09-14T11:22:40.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.198+0000 7fe1c5887800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.200+0000 7fe079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.200+0000 7fe1c5887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.200+0000 7fe1c5887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.200+0000 7fe1c5887800 5 note: GC not initialized 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.200+0000 7fe078fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 20 Filter name: none 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fdff27fc640 20 reqs_thread_entry: start 2024-09-14T11:22:40.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-14T11:22:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 20 rados_obj.operate() r=0 bl.length=532 2024-09-14T11:22:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-14T11:22:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:22:40.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.201+0000 7fe1c5887800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.204+0000 7fe1c5887800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:22:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.204+0000 7fe1c5887800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:22:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.204+0000 7fe1c5887800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-14T11:22:40.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.204+0000 7fe0a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366317 cookie 94354816317264 notifier 8579 bl.length()=746 2024-09-14T11:22:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.204+0000 7fe0a6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-14T11:22:40.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.204+0000 7fe0a6ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-14T11:22:40.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.206+0000 7fe079fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.208+0000 7fe1c5887800 20 remove_watcher() i=0 2024-09-14T11:22:40.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.208+0000 7fe1c5887800 2 removed watcher, disabling cache 2024-09-14T11:22:40.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.209+0000 7fe1c5887800 20 remove_watcher() i=1 2024-09-14T11:22:40.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.210+0000 7fe1c5887800 20 remove_watcher() i=2 2024-09-14T11:22:40.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.212+0000 7fe1c5887800 20 remove_watcher() i=3 2024-09-14T11:22:40.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.213+0000 7fe1c5887800 20 remove_watcher() i=4 2024-09-14T11:22:40.212 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.214+0000 7fe1c5887800 20 remove_watcher() i=5 2024-09-14T11:22:40.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.215+0000 7fe1c5887800 20 remove_watcher() i=6 2024-09-14T11:22:40.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.216+0000 7fe1c5887800 20 remove_watcher() i=7 2024-09-14T11:22:40.226 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-14T11:22:40.226 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key RDSTNQAUABUOMQGSZMMI --secret 0uS4uO5rapLqrM/+1NOucrmSwYkB7ALscnOad0De+uQNWu2z2OxJLQ== --cluster ceph 2024-09-14T11:22:40.292 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:40.292 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:40.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.330+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.331+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.331+0000 7f0ba6f23800 20 realm 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.331+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.331+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.331+0000 7f0ba6f23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.331+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.332+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.332+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.332+0000 7f0ba6f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.332+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.333+0000 7f0ba6f23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:40.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.333+0000 7f0ba6f23800 20 searching for the correct realm 2024-09-14T11:22:40.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.336+0000 7f0ba340d640 0 -- 172.21.15.2:0/1122684549 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f0b9801a040 msgr2=0x7f0b980393d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:40.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.340+0000 7f0ba2c0c640 0 -- 172.21.15.2:0/1122684549 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f0b980398e0 msgr2=0x7f0b98017400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.547+0000 7f0ba6f23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.547+0000 7f0ba6f23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.547+0000 7f0ba6f23800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.547+0000 7f0ba6f23800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.547+0000 7f0ba6f23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.547+0000 7f0ba6f23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.547+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 zone default found 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 4 Realm: () 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 zonegroup default 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.548+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.549+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.549+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.549+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.549+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.549+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.549+0000 7f0ba6f23800 20 started sync module instance, tier type = 2024-09-14T11:22:40.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.549+0000 7f0ba6f23800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:40.557 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.559+0000 7f0ba6f23800 20 add_watcher() i=0 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.559+0000 7f0ba6f23800 20 add_watcher() i=1 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.559+0000 7f0ba6f23800 20 add_watcher() i=2 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.559+0000 7f0ba6f23800 20 add_watcher() i=3 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.559+0000 7f0ba6f23800 20 add_watcher() i=4 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.559+0000 7f0ba6f23800 20 add_watcher() i=5 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.559+0000 7f0ba6f23800 20 add_watcher() i=6 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.560+0000 7f0ba6f23800 20 add_watcher() i=7 2024-09-14T11:22:40.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.560+0000 7f0ba6f23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:40.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f0a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:40.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f0ba6f23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:40.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f0ba6f23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:40.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f0ba6f23800 5 note: GC not initialized 2024-09-14T11:22:40.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f09d3fff640 20 reqs_thread_entry: start 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f0ba6f23800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f0ba6f23800 20 Filter name: none 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f09d1ffb640 20 reqs_thread_entry: start 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.562+0000 7f0ba6f23800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-14T11:22:40.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 10 cache get: name=default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI : miss 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.563+0000 7f0ba6f23800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.564+0000 7f0ba6f23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.564+0000 7f0ba6f23800 10 cache put: name=default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI info.flags=0x0 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.564+0000 7f0ba6f23800 10 adding default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI to cache LRU end 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.564+0000 7f0ba6f23800 10 cache get: name=default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI : hit (negative entry) 2024-09-14T11:22:40.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.564+0000 7f0ba6f23800 10 cache get: name=default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI : hit (negative entry) 2024-09-14T11:22:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.565+0000 7f0ba6f23800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:22:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.565+0000 7f0ba6f23800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.565+0000 7f0ba6f23800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:22:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.565+0000 7f0a867fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366211 cookie 94057431316672 notifier 9093 bl.length()=660 2024-09-14T11:22:40.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.566+0000 7f0a867fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:22:40.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.566+0000 7f0a867fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:40.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.567+0000 7f0ba6f23800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:22:40.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.567+0000 7f0ba6f23800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:22:40.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.567+0000 7f0ba6f23800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-14T11:22:40.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.568+0000 7f0a85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366302 cookie 94057431297280 notifier 9093 bl.length()=191 2024-09-14T11:22:40.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.568+0000 7f0a85ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-14T11:22:40.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.568+0000 7f0a85ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-14T11:22:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.570+0000 7f0ba6f23800 10 cache put: name=default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI info.flags=0x7 2024-09-14T11:22:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.570+0000 7f0ba6f23800 10 moving default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI to cache LRU end 2024-09-14T11:22:40.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.570+0000 7f0ba6f23800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:RDSTNQAUABUOMQGSZMMI, ofs0, ns] 2024-09-14T11:22:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.570+0000 7f0a85ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366384 cookie 94057431293504 notifier 9093 bl.length()=189 2024-09-14T11:22:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.570+0000 7f0a85ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI info.flags=0x7 2024-09-14T11:22:40.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.570+0000 7f0a85ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+RDSTNQAUABUOMQGSZMMI to cache LRU end 2024-09-14T11:22:40.569 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:40.569 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "foobar.client.0", 2024-09-14T11:22:40.569 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "foobar+test@test.test", 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "foobar.client.0", 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "RDSTNQAUABUOMQGSZMMI", 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "0uS4uO5rapLqrM/+1NOucrmSwYkB7ALscnOad0De+uQNWu2z2OxJLQ==", 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:40.565056Z" 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:22:40.570 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:40.571 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "rgw", 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "", 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:40.565044Z", 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:40.572 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.572+0000 7f0a597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.574+0000 7f0ba6f23800 20 remove_watcher() i=0 2024-09-14T11:22:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.574+0000 7f0ba6f23800 2 removed watcher, disabling cache 2024-09-14T11:22:40.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.575+0000 7f0ba6f23800 20 remove_watcher() i=1 2024-09-14T11:22:40.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.576+0000 7f0ba6f23800 20 remove_watcher() i=2 2024-09-14T11:22:40.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.577+0000 7f0ba6f23800 20 remove_watcher() i=3 2024-09-14T11:22:40.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.578+0000 7f0ba6f23800 20 remove_watcher() i=4 2024-09-14T11:22:40.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.579+0000 7f0ba6f23800 20 remove_watcher() i=5 2024-09-14T11:22:40.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.581+0000 7f0ba6f23800 20 remove_watcher() i=6 2024-09-14T11:22:40.580 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.581+0000 7f0ba6f23800 20 remove_watcher() i=7 2024-09-14T11:22:40.591 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 0393238256 --totp-seed XWL42HPJ4OWUCGH4NEVSZTGK6VAKQI5LWIEMPT2BTN4SNEQIEJHDY7ZBXB62UD2Y --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:22:40.658 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:40.659 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:40.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.697+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.698+0000 7f18ca80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.698+0000 7f18ca80e800 20 realm 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.698+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.698+0000 7f18ca80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.698+0000 7f18ca80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.698+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.699+0000 7f18ca80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.699+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.699+0000 7f18ca80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.700+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.700+0000 7f18ca80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:40.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.700+0000 7f18ca80e800 20 searching for the correct realm 2024-09-14T11:22:40.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.703+0000 7f18c676c640 0 -- 172.21.15.2:0/3211869221 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f18bc01a040 msgr2=0x7f18bc061aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:40.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.707+0000 7f18c5f6b640 0 -- 172.21.15.2:0/3211869221 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f18bc06bbf0 msgr2=0x7f18bc0670d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:40.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.914+0000 7f18ca80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 zone default found 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 4 Realm: () 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 zonegroup default 2024-09-14T11:22:40.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 started sync module instance, tier type = 2024-09-14T11:22:40.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.915+0000 7f18ca80e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.926+0000 7f18ca80e800 20 add_watcher() i=0 2024-09-14T11:22:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.926+0000 7f18ca80e800 20 add_watcher() i=1 2024-09-14T11:22:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.926+0000 7f18ca80e800 20 add_watcher() i=2 2024-09-14T11:22:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.926+0000 7f18ca80e800 20 add_watcher() i=3 2024-09-14T11:22:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.926+0000 7f18ca80e800 20 add_watcher() i=4 2024-09-14T11:22:40.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.926+0000 7f18ca80e800 20 add_watcher() i=5 2024-09-14T11:22:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.926+0000 7f18ca80e800 20 add_watcher() i=6 2024-09-14T11:22:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.927+0000 7f18ca80e800 20 add_watcher() i=7 2024-09-14T11:22:40.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.927+0000 7f18ca80e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:40.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.928+0000 7f1777fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:40.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f18ca80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f18ca80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f18ca80e800 5 note: GC not initialized 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f1776ffd640 20 reqs_thread_entry: start 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f18ca80e800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f18ca80e800 20 Filter name: none 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f1774ff9640 20 reqs_thread_entry: start 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f18ca80e800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.929+0000 7f18ca80e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:40.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.930+0000 7f18ca80e800 20 rados_obj.operate() r=0 bl.length=472 2024-09-14T11:22:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.930+0000 7f18ca80e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:22:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.930+0000 7f18ca80e800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:40.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.930+0000 7f18ca80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.933+0000 7f18ca80e800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:22:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.933+0000 7f18ca80e800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.933+0000 7f18ca80e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:22:40.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.933+0000 7f17a97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366212 cookie 93856628001632 notifier 9114 bl.length()=674 2024-09-14T11:22:40.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.933+0000 7f17a97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:22:40.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.933+0000 7f17a97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:40.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.934+0000 7f1777fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:40.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.937+0000 7f18ca80e800 20 remove_watcher() i=0 2024-09-14T11:22:40.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.937+0000 7f18ca80e800 2 removed watcher, disabling cache 2024-09-14T11:22:40.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.938+0000 7f18ca80e800 20 remove_watcher() i=1 2024-09-14T11:22:40.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.939+0000 7f18ca80e800 20 remove_watcher() i=2 2024-09-14T11:22:40.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.941+0000 7f18ca80e800 20 remove_watcher() i=3 2024-09-14T11:22:40.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.942+0000 7f18ca80e800 20 remove_watcher() i=4 2024-09-14T11:22:40.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.943+0000 7f18ca80e800 20 remove_watcher() i=5 2024-09-14T11:22:40.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.944+0000 7f18ca80e800 20 remove_watcher() i=6 2024-09-14T11:22:40.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:40.945+0000 7f18ca80e800 20 remove_watcher() i=7 2024-09-14T11:22:40.955 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-14T11:22:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:41.014 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:41.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.052+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.054+0000 7f2ff8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.054+0000 7f2ff8a2f800 20 realm 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.054+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.054+0000 7f2ff8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.054+0000 7f2ff8a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.054+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.055+0000 7f2ff8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.055+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.056+0000 7f2ff8a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.056+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.056+0000 7f2ff8a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:41.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.056+0000 7f2ff8a2f800 20 searching for the correct realm 2024-09-14T11:22:41.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.059+0000 7f2ff5d18640 0 -- 172.21.15.2:0/1900785238 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f2fe80431a0 msgr2=0x7f2fe803b240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:41.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.063+0000 7f2ff6519640 0 -- 172.21.15.2:0/1900785238 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f2fec0743d0 msgr2=0x7f2fec087120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.269+0000 7f2ff8a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.269+0000 7f2ff8a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.269+0000 7f2ff8a2f800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:41.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.269+0000 7f2ff8a2f800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:41.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.269+0000 7f2ff8a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:41.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.269+0000 7f2ff8a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:41.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 zone default found 2024-09-14T11:22:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 4 Realm: () 2024-09-14T11:22:41.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 zonegroup default 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.270+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.271+0000 7f2ff8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.271+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.271+0000 7f2ff8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.271+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.271+0000 7f2ff8a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.271+0000 7f2ff8a2f800 20 started sync module instance, tier type = 2024-09-14T11:22:41.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.271+0000 7f2ff8a2f800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:41.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.281+0000 7f2ff8a2f800 20 add_watcher() i=0 2024-09-14T11:22:41.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.281+0000 7f2ff8a2f800 20 add_watcher() i=1 2024-09-14T11:22:41.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.281+0000 7f2ff8a2f800 20 add_watcher() i=2 2024-09-14T11:22:41.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.281+0000 7f2ff8a2f800 20 add_watcher() i=3 2024-09-14T11:22:41.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.281+0000 7f2ff8a2f800 20 add_watcher() i=4 2024-09-14T11:22:41.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.281+0000 7f2ff8a2f800 20 add_watcher() i=5 2024-09-14T11:22:41.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.281+0000 7f2ff8a2f800 20 add_watcher() i=6 2024-09-14T11:22:41.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.282+0000 7f2ff8a2f800 20 add_watcher() i=7 2024-09-14T11:22:41.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.282+0000 7f2ff8a2f800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:41.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.283+0000 7f2eacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:41.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.283+0000 7f2ff8a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:41.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.283+0000 7f2ff8a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:41.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.283+0000 7f2ff8a2f800 5 note: GC not initialized 2024-09-14T11:22:41.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2e277fe640 20 reqs_thread_entry: start 2024-09-14T11:22:41.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:41.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 20 Filter name: none 2024-09-14T11:22:41.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2e257fa640 20 reqs_thread_entry: start 2024-09-14T11:22:41.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-14T11:22:41.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 20 rados_obj.operate() r=0 bl.length=486 2024-09-14T11:22:41.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-14T11:22:41.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:41.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.284+0000 7f2ff8a2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:41.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.286+0000 7f2ff8a2f800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:22:41.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.286+0000 7f2ff8a2f800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.286+0000 7f2ff8a2f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.286+0000 7f2ed9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366213 cookie 94301916992384 notifier 8630 bl.length()=727 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.286+0000 7f2ed9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.286+0000 7f2ed9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "foobar.client.0", 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr.foobar.client.0", 2024-09-14T11:22:41.285 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "foobar+test@test.test", 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "foobar.client.0", 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "RDSTNQAUABUOMQGSZMMI", 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "0uS4uO5rapLqrM/+1NOucrmSwYkB7ALscnOad0De+uQNWu2z2OxJLQ==", 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:40.565056Z" 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:41.286 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [ 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "oidc-provider", 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: "perm": "*" 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "roles", 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: "perm": "*" 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "user-policy", 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: "perm": "*" 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:41.287 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:22:41.288 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "rgw", 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [ 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "0393238256" 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "", 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:22:41.289 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:40.565044Z", 2024-09-14T11:22:41.290 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:22:41.290 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:22:41.290 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:41.290 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.287+0000 7f2eacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:41.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.290+0000 7f2ff8a2f800 20 remove_watcher() i=0 2024-09-14T11:22:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.290+0000 7f2ff8a2f800 2 removed watcher, disabling cache 2024-09-14T11:22:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.291+0000 7f2ff8a2f800 20 remove_watcher() i=1 2024-09-14T11:22:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.292+0000 7f2ff8a2f800 20 remove_watcher() i=2 2024-09-14T11:22:41.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.293+0000 7f2ff8a2f800 20 remove_watcher() i=3 2024-09-14T11:22:41.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.294+0000 7f2ff8a2f800 20 remove_watcher() i=4 2024-09-14T11:22:41.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.295+0000 7f2ff8a2f800 20 remove_watcher() i=5 2024-09-14T11:22:41.294 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.296+0000 7f2ff8a2f800 20 remove_watcher() i=6 2024-09-14T11:22:41.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.297+0000 7f2ff8a2f800 20 remove_watcher() i=7 2024-09-14T11:22:41.306 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-14T11:22:41.368 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:41.368 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:41.404 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.406+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 20 realm 2024-09-14T11:22:41.406 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.408+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.409+0000 7f09a3d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.407 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.409+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.409+0000 7f09a3d2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:41.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.409+0000 7f09a3d2c800 20 searching for the correct realm 2024-09-14T11:22:41.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.413+0000 7f09a013f640 0 -- 172.21.15.2:0/312251204 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f0994094610 msgr2=0x7f0994089f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:41.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.416+0000 7f099f93e640 0 -- 172.21.15.2:0/312251204 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f099406aa80 msgr2=0x7f099408b230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:41.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.624+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 zone default found 2024-09-14T11:22:41.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 4 Realm: () 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 zonegroup default 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.625+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.626+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.626+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.626+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.626+0000 7f09a3d2c800 20 started sync module instance, tier type = 2024-09-14T11:22:41.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.626+0000 7f09a3d2c800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.635+0000 7f09a3d2c800 20 add_watcher() i=0 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.635+0000 7f09a3d2c800 20 add_watcher() i=1 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.635+0000 7f09a3d2c800 20 add_watcher() i=2 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.635+0000 7f09a3d2c800 20 add_watcher() i=3 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.635+0000 7f09a3d2c800 20 add_watcher() i=4 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.635+0000 7f09a3d2c800 20 add_watcher() i=5 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.636+0000 7f09a3d2c800 20 add_watcher() i=6 2024-09-14T11:22:41.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.636+0000 7f09a3d2c800 20 add_watcher() i=7 2024-09-14T11:22:41.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.636+0000 7f09a3d2c800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.638+0000 7f0855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.638+0000 7f09a3d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.638+0000 7f09a3d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.638+0000 7f09a3d2c800 5 note: GC not initialized 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.638+0000 7f0854fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.638+0000 7f09a3d2c800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 20 Filter name: none 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f07ce7fc640 20 reqs_thread_entry: start 2024-09-14T11:22:41.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-14T11:22:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-14T11:22:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:22:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-14T11:22:41.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.639+0000 7f09a3d2c800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.641+0000 7f09a3d2c800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.641+0000 7f09a3d2c800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:22:41.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.641+0000 7f09a3d2c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-14T11:22:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.642+0000 7f087effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366303 cookie 94178081403648 notifier 8648 bl.length()=384 2024-09-14T11:22:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.642+0000 7f087effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:22:41.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.642+0000 7f087effd640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:22:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.644+0000 7f09a3d2c800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:22:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.644+0000 7f09a3d2c800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:22:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.644+0000 7f09a3d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-14T11:22:41.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.644+0000 7f087e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366385 cookie 94178081405984 notifier 8648 bl.length()=225 2024-09-14T11:22:41.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.644+0000 7f087e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-14T11:22:41.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.644+0000 7f087e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-14T11:22:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.646+0000 7f09a3d2c800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:22:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.646+0000 7f09a3d2c800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:22:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.646+0000 7f09a3d2c800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-14T11:22:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.646+0000 7f087effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366281 cookie 94178081396656 notifier 8648 bl.length()=234 2024-09-14T11:22:41.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.646+0000 7f087effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-14T11:22:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.646+0000 7f087effd640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-14T11:22:41.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.647+0000 7f0855fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.650+0000 7f09a3d2c800 20 remove_watcher() i=0 2024-09-14T11:22:41.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.650+0000 7f09a3d2c800 2 removed watcher, disabling cache 2024-09-14T11:22:41.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.651+0000 7f09a3d2c800 20 remove_watcher() i=1 2024-09-14T11:22:41.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.652+0000 7f09a3d2c800 20 remove_watcher() i=2 2024-09-14T11:22:41.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.653+0000 7f09a3d2c800 20 remove_watcher() i=3 2024-09-14T11:22:41.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.654+0000 7f09a3d2c800 20 remove_watcher() i=4 2024-09-14T11:22:41.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.655+0000 7f09a3d2c800 20 remove_watcher() i=5 2024-09-14T11:22:41.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.656+0000 7f09a3d2c800 20 remove_watcher() i=6 2024-09-14T11:22:41.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.657+0000 7f09a3d2c800 20 remove_watcher() i=7 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "id": "RGW88888888888888888", 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "tenant": "", 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "Mr.RGW88888888888888888", 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "quota": { 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:41.665 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_users": 1000, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_roles": 1000, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_groups": 1000, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout: "max_access_keys": 4 2024-09-14T11:22:41.666 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:41.667 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-14T11:22:41.668 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key JNSQRUJVALTYLRSTWYQE --secret 6XgxdKXKQOsOdwQZ/ilcegttduxARL34/sUIsoTUGRDDWs4pj8+LEw== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-14T11:22:41.736 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:41.737 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:41.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.774+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 20 realm 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.776+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.777+0000 7f031ac10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.777+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.778+0000 7f031ac10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:41.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.778+0000 7f031ac10800 20 searching for the correct realm 2024-09-14T11:22:41.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.781+0000 7f0315bbb640 0 -- 172.21.15.2:0/1363705630 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x561f7e51fee0 msgr2=0x561f7e5223a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:41.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.785+0000 7f03163bc640 0 -- 172.21.15.2:0/1363705630 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f030c03c8e0 msgr2=0x7f030c01d3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:41.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.790+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 zone default found 2024-09-14T11:22:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 4 Realm: () 2024-09-14T11:22:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:41.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 zonegroup default 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 started sync module instance, tier type = 2024-09-14T11:22:41.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.791+0000 7f031ac10800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.800+0000 7f031ac10800 20 add_watcher() i=0 2024-09-14T11:22:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.800+0000 7f031ac10800 20 add_watcher() i=1 2024-09-14T11:22:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.800+0000 7f031ac10800 20 add_watcher() i=2 2024-09-14T11:22:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.800+0000 7f031ac10800 20 add_watcher() i=3 2024-09-14T11:22:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.800+0000 7f031ac10800 20 add_watcher() i=4 2024-09-14T11:22:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.800+0000 7f031ac10800 20 add_watcher() i=5 2024-09-14T11:22:41.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.800+0000 7f031ac10800 20 add_watcher() i=6 2024-09-14T11:22:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.801+0000 7f031ac10800 20 add_watcher() i=7 2024-09-14T11:22:41.800 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.801+0000 7f031ac10800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.803+0000 7f01ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.803+0000 7f031ac10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.803+0000 7f031ac10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.803+0000 7f031ac10800 5 note: GC not initialized 2024-09-14T11:22:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.803+0000 7f01477fe640 20 reqs_thread_entry: start 2024-09-14T11:22:41.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 20 Filter name: none 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f01457fa640 20 reqs_thread_entry: start 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-14T11:22:41.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-14T11:22:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:22:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 10 cache get: name=default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE : miss 2024-09-14T11:22:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.804+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 cache put: name=default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE info.flags=0x0 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 adding default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE to cache LRU end 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 cache get: name=default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE : hit (negative entry) 2024-09-14T11:22:41.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.805+0000 7f031ac10800 10 cache get: name=default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE : hit (negative entry) 2024-09-14T11:22:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.807+0000 7f031ac10800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:22:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.807+0000 7f031ac10800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:22:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.807+0000 7f031ac10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:22:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.807+0000 7f01f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366304 cookie 94693263291728 notifier 8666 bl.length()=681 2024-09-14T11:22:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.807+0000 7f01f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:22:41.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.807+0000 7f01f9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:22:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.809+0000 7f031ac10800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:22:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.809+0000 7f031ac10800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:22:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.809+0000 7f031ac10800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-14T11:22:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.809+0000 7f01f9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366318 cookie 94693263301936 notifier 8666 bl.length()=189 2024-09-14T11:22:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.809+0000 7f01f9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-14T11:22:41.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.809+0000 7f01f9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-14T11:22:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.810+0000 7f031ac10800 10 cache put: name=default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE info.flags=0x7 2024-09-14T11:22:41.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.810+0000 7f031ac10800 10 moving default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE to cache LRU end 2024-09-14T11:22:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.810+0000 7f031ac10800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:JNSQRUJVALTYLRSTWYQE, ofs0, ns] 2024-09-14T11:22:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.811+0000 7f01f97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366386 cookie 94693263286144 notifier 8666 bl.length()=188 2024-09-14T11:22:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.811+0000 7f01f97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE info.flags=0x7 2024-09-14T11:22:41.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.811+0000 7f01f97fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+JNSQRUJVALTYLRSTWYQE to cache LRU end 2024-09-14T11:22:41.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.813+0000 7f031ac10800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-14T11:22:41.811 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:41.811 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "root1.client.0", 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "root1+test@test.test", 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "root1.client.0", 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "JNSQRUJVALTYLRSTWYQE", 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "6XgxdKXKQOsOdwQZ/ilcegttduxARL34/sUIsoTUGRDDWs4pj8+LEw==", 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:22:41.812 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:41.806459Z" 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:41.813 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "root", 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "RGW88888888888888888", 2024-09-14T11:22:41.814 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:22:41.815 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:41.806448Z", 2024-09-14T11:22:41.815 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:22:41.815 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:22:41.815 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:41.815 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.814+0000 7f01ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:41.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.816+0000 7f031ac10800 20 remove_watcher() i=0 2024-09-14T11:22:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.816+0000 7f031ac10800 2 removed watcher, disabling cache 2024-09-14T11:22:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.817+0000 7f031ac10800 20 remove_watcher() i=1 2024-09-14T11:22:41.816 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.818+0000 7f031ac10800 20 remove_watcher() i=2 2024-09-14T11:22:41.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.819+0000 7f031ac10800 20 remove_watcher() i=3 2024-09-14T11:22:41.818 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.820+0000 7f031ac10800 20 remove_watcher() i=4 2024-09-14T11:22:41.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.821+0000 7f031ac10800 20 remove_watcher() i=5 2024-09-14T11:22:41.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.822+0000 7f031ac10800 20 remove_watcher() i=6 2024-09-14T11:22:41.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.823+0000 7f031ac10800 20 remove_watcher() i=7 2024-09-14T11:22:41.833 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 5308483034 --totp-seed NQPLVXWN7JUCWVKEJFAI7Q2ZBGK7Q4OVK4BLAOMC4GHIHV2PNBZWOXLHEMHN5BUZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:22:41.900 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:41.901 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:41.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.938+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.939+0000 7fdcb9c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.939+0000 7fdcb9c12800 20 realm 2024-09-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.939+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.940+0000 7fdcb9c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.940+0000 7fdcb9c12800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.940+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.940+0000 7fdcb9c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.940+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.941+0000 7fdcb9c12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.941+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.941+0000 7fdcb9c12800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:41.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.941+0000 7fdcb9c12800 20 searching for the correct realm 2024-09-14T11:22:41.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.945+0000 7fdcb4aca640 0 -- 172.21.15.2:0/2285389645 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fdca809b670 msgr2=0x7fdca809e4a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:41.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.949+0000 7fdcb4aca640 0 -- 172.21.15.2:0/2285389645 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fdb80087e30 msgr2=0x7fdb8008a260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:41.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.953+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:41.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 zone default found 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 4 Realm: () 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 zonegroup default 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 started sync module instance, tier type = 2024-09-14T11:22:41.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.954+0000 7fdcb9c12800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=0 2024-09-14T11:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=1 2024-09-14T11:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=2 2024-09-14T11:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=3 2024-09-14T11:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=4 2024-09-14T11:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=5 2024-09-14T11:22:41.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=6 2024-09-14T11:22:41.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 20 add_watcher() i=7 2024-09-14T11:22:41.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.964+0000 7fdcb9c12800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.966+0000 7fdb6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.966+0000 7fdcb9c12800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.966+0000 7fdcb9c12800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.966+0000 7fdcb9c12800 5 note: GC not initialized 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.966+0000 7fdb6a7e4640 20 reqs_thread_entry: start 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.966+0000 7fdcb9c12800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.966+0000 7fdcb9c12800 20 Filter name: none 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.967+0000 7fdadbfff640 20 reqs_thread_entry: start 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.967+0000 7fdcb9c12800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-14T11:22:41.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.967+0000 7fdcb9c12800 20 rados->read ofs=0 len=0 2024-09-14T11:22:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.967+0000 7fdcb9c12800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:22:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.967+0000 7fdcb9c12800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-14T11:22:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.967+0000 7fdcb9c12800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:22:41.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.967+0000 7fdcb9c12800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.969+0000 7fdcb9c12800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:22:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.969+0000 7fdcb9c12800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:22:41.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.969+0000 7fdcb9c12800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-14T11:22:41.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.970+0000 7fdb98ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366305 cookie 94202127129536 notifier 9186 bl.length()=695 2024-09-14T11:22:41.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.970+0000 7fdb98ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-14T11:22:41.968 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.970+0000 7fdb98ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-14T11:22:41.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:41.971+0000 7fdb6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:42.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.175+0000 7fdcb9c12800 20 remove_watcher() i=0 2024-09-14T11:22:42.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.175+0000 7fdcb9c12800 2 removed watcher, disabling cache 2024-09-14T11:22:42.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.176+0000 7fdcb9c12800 20 remove_watcher() i=1 2024-09-14T11:22:42.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.177+0000 7fdcb9c12800 20 remove_watcher() i=2 2024-09-14T11:22:42.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.178+0000 7fdcb9c12800 20 remove_watcher() i=3 2024-09-14T11:22:42.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.180+0000 7fdcb9c12800 20 remove_watcher() i=4 2024-09-14T11:22:42.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.181+0000 7fdcb9c12800 20 remove_watcher() i=5 2024-09-14T11:22:42.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.181+0000 7fdcb9c12800 20 remove_watcher() i=6 2024-09-14T11:22:42.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.182+0000 7fdcb9c12800 20 remove_watcher() i=7 2024-09-14T11:22:42.192 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-14T11:22:42.254 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:42.254 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:42.290 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.291+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.293+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.293+0000 7f61f3f46800 20 realm 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.293+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.293+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.293+0000 7f61f3f46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.293+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.294+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.292 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.294+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.294+0000 7f61f3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:42.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.294+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.295+0000 7f61f3f46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:42.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.295+0000 7f61f3f46800 20 searching for the correct realm 2024-09-14T11:22:42.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.298+0000 7f61f2231640 0 -- 172.21.15.2:0/3154688710 >> [v2:172.21.15.2:6800/3069717018,v1:172.21.15.2:6801/3069717018] conn(0x55e39f40f260 msgr2=0x55e39f4116e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:42.300 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.302+0000 7f61f122f640 0 -- 172.21.15.2:0/3154688710 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f61e40761e0 msgr2=0x7f61e4075c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:42.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.306+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 zone default found 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 4 Realm: () 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:42.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 zonegroup default 2024-09-14T11:22:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.307+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.308+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.308+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.308+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.308+0000 7f61f3f46800 20 started sync module instance, tier type = 2024-09-14T11:22:42.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.308+0000 7f61f3f46800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.317+0000 7f61f3f46800 20 add_watcher() i=0 2024-09-14T11:22:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.317+0000 7f61f3f46800 20 add_watcher() i=1 2024-09-14T11:22:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.317+0000 7f61f3f46800 20 add_watcher() i=2 2024-09-14T11:22:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.317+0000 7f61f3f46800 20 add_watcher() i=3 2024-09-14T11:22:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.317+0000 7f61f3f46800 20 add_watcher() i=4 2024-09-14T11:22:42.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.317+0000 7f61f3f46800 20 add_watcher() i=5 2024-09-14T11:22:42.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.317+0000 7f61f3f46800 20 add_watcher() i=6 2024-09-14T11:22:42.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.318+0000 7f61f3f46800 20 add_watcher() i=7 2024-09-14T11:22:42.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.318+0000 7f61f3f46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f60a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f61f3f46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f61f3f46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f61f3f46800 5 note: GC not initialized 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f60a27fc640 20 reqs_thread_entry: start 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f61f3f46800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f61f3f46800 20 Filter name: none 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f6013fff640 20 reqs_thread_entry: start 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f61f3f46800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.320+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-14T11:22:42.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:22:42.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-14T11:22:42.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-14T11:22:42.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.321+0000 7f61f3f46800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.322+0000 7f61f3f46800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.322+0000 7f61f3f46800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.322+0000 7f61f3f46800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.323+0000 7f60d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366306 cookie 94436117822656 notifier 9207 bl.length()=384 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.323+0000 7f60d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:22:42.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.323+0000 7f60d57fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:22:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.324+0000 7f61f3f46800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:22:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.324+0000 7f61f3f46800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:22:42.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.324+0000 7f61f3f46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-14T11:22:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.325+0000 7f60d57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366387 cookie 94436117823712 notifier 9207 bl.length()=225 2024-09-14T11:22:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.325+0000 7f60d57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-14T11:22:42.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.325+0000 7f60d57fa640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-14T11:22:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.327+0000 7f61f3f46800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:22:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.327+0000 7f61f3f46800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:22:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.327+0000 7f61f3f46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-14T11:22:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.327+0000 7f60d4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366282 cookie 94436117830032 notifier 9207 bl.length()=234 2024-09-14T11:22:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.327+0000 7f60d4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-14T11:22:42.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.327+0000 7f60d4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-14T11:22:42.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.328+0000 7f60a37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.331+0000 7f61f3f46800 20 remove_watcher() i=0 2024-09-14T11:22:42.329 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.331+0000 7f61f3f46800 2 removed watcher, disabling cache 2024-09-14T11:22:42.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.332+0000 7f61f3f46800 20 remove_watcher() i=1 2024-09-14T11:22:42.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.333+0000 7f61f3f46800 20 remove_watcher() i=2 2024-09-14T11:22:42.332 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.334+0000 7f61f3f46800 20 remove_watcher() i=3 2024-09-14T11:22:42.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.335+0000 7f61f3f46800 20 remove_watcher() i=4 2024-09-14T11:22:42.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.336+0000 7f61f3f46800 20 remove_watcher() i=5 2024-09-14T11:22:42.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.337+0000 7f61f3f46800 20 remove_watcher() i=6 2024-09-14T11:22:42.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.338+0000 7f61f3f46800 20 remove_watcher() i=7 2024-09-14T11:22:42.345 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "id": "RGW99999999999999999", 2024-09-14T11:22:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "tenant": "", 2024-09-14T11:22:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "name": "Mr.RGW99999999999999999", 2024-09-14T11:22:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-14T11:22:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "quota": { 2024-09-14T11:22:42.345 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:42.346 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max_users": 1000, 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max_roles": 1000, 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max_groups": 1000, 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout: "max_access_keys": 4 2024-09-14T11:22:42.347 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:42.348 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-14T11:22:42.348 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key WBBXSUJYRWWHFBMNHIOE --secret 7BJRHhMW3NOyKPBYkqXPkglk4ePEnezDkIfiuIohNg0+wqHgf0aIaQ== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-14T11:22:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:42.418 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:42.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.456+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.457+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.457+0000 7f0b3800e800 20 realm 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.457+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.457+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.457+0000 7f0b3800e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.457+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.458+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.458+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.458+0000 7f0b3800e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.458+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.459+0000 7f0b3800e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:42.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.459+0000 7f0b3800e800 20 searching for the correct realm 2024-09-14T11:22:42.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.462+0000 7f0b32e58640 0 -- 172.21.15.2:0/3104414809 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f0b2406c220 msgr2=0x7f0b24089130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:42.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.466+0000 7f0b33659640 0 -- 172.21.15.2:0/3104414809 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f0b2807cbd0 msgr2=0x7f0b280727d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.673+0000 7f0b3800e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.673+0000 7f0b3800e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.673+0000 7f0b3800e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.673+0000 7f0b3800e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.673+0000 7f0b3800e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.673+0000 7f0b3800e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.673+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 zone default found 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 4 Realm: () 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 zonegroup default 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.674+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.675+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.675+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.675+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.675+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.675+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.675+0000 7f0b3800e800 20 started sync module instance, tier type = 2024-09-14T11:22:42.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.675+0000 7f0b3800e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.685+0000 7f0b3800e800 20 add_watcher() i=0 2024-09-14T11:22:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.685+0000 7f0b3800e800 20 add_watcher() i=1 2024-09-14T11:22:42.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.685+0000 7f0b3800e800 20 add_watcher() i=2 2024-09-14T11:22:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.685+0000 7f0b3800e800 20 add_watcher() i=3 2024-09-14T11:22:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.685+0000 7f0b3800e800 20 add_watcher() i=4 2024-09-14T11:22:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.685+0000 7f0b3800e800 20 add_watcher() i=5 2024-09-14T11:22:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.685+0000 7f0b3800e800 20 add_watcher() i=6 2024-09-14T11:22:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.686+0000 7f0b3800e800 20 add_watcher() i=7 2024-09-14T11:22:42.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.686+0000 7f0b3800e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f09ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f0b3800e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f0b3800e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f0b3800e800 5 note: GC not initialized 2024-09-14T11:22:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f09e97e2640 20 reqs_thread_entry: start 2024-09-14T11:22:42.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f0b3800e800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f0b3800e800 20 Filter name: none 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f09e27fc640 20 reqs_thread_entry: start 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f0b3800e800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.688+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 cache get: name=default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE : miss 2024-09-14T11:22:42.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 cache put: name=default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE info.flags=0x0 2024-09-14T11:22:42.689 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 adding default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE to cache LRU end 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.689+0000 7f0b3800e800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.690+0000 7f0b3800e800 20 rados_obj.operate() r=0 bl.length=184 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.690+0000 7f0b3800e800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.690+0000 7f0b3800e800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.690+0000 7f0b3800e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.690+0000 7f0b3800e800 10 cache get: name=default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE : hit (negative entry) 2024-09-14T11:22:42.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.690+0000 7f0b3800e800 10 cache get: name=default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE : hit (negative entry) 2024-09-14T11:22:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.692+0000 7f0b3800e800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:22:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.692+0000 7f0b3800e800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:22:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.692+0000 7f0b3800e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:22:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.692+0000 7f0a16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366307 cookie 94550514952000 notifier 9228 bl.length()=681 2024-09-14T11:22:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.692+0000 7f0a16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:22:42.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.692+0000 7f0a16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:22:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.694+0000 7f0b3800e800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:22:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.694+0000 7f0b3800e800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:22:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.694+0000 7f0b3800e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-14T11:22:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.694+0000 7f0a16ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366319 cookie 94550514962624 notifier 9228 bl.length()=189 2024-09-14T11:22:42.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.694+0000 7f0a16ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-14T11:22:42.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.694+0000 7f0a16ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-14T11:22:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.696+0000 7f0b3800e800 10 cache put: name=default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE info.flags=0x7 2024-09-14T11:22:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.696+0000 7f0b3800e800 10 moving default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE to cache LRU end 2024-09-14T11:22:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.696+0000 7f0b3800e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:WBBXSUJYRWWHFBMNHIOE, ofs0, ns] 2024-09-14T11:22:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.696+0000 7f0a167fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366320 cookie 94550514962624 notifier 9228 bl.length()=188 2024-09-14T11:22:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.696+0000 7f0a167fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE info.flags=0x7 2024-09-14T11:22:42.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.696+0000 7f0a167fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+WBBXSUJYRWWHFBMNHIOE to cache LRU end 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.698+0000 7f0b3800e800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "user_id": "root2.client.0", 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "email": "root2+test@test.test", 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "suspended": 0, 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "max_buckets": 1000, 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "subusers": [], 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: "keys": [ 2024-09-14T11:22:42.696 INFO:teuthology.orchestra.run.smithi002.stdout: { 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "user": "root2.client.0", 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "access_key": "WBBXSUJYRWWHFBMNHIOE", 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "secret_key": "7BJRHhMW3NOyKPBYkqXPkglk4ePEnezDkIfiuIohNg0+wqHgf0aIaQ==", 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "active": true, 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:42.691371Z" 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: } 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: ], 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "swift_keys": [], 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "caps": [], 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "op_mask": "read, write, delete", 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_placement": "", 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "default_storage_class": "", 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "placement_tags": [], 2024-09-14T11:22:42.697 INFO:teuthology.orchestra.run.smithi002.stdout: "bucket_quota": { 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "user_quota": { 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "enabled": false, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "check_on_raw": false, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size": -1, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max_size_kb": 0, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "max_objects": -1 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: }, 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "temp_url_keys": [], 2024-09-14T11:22:42.698 INFO:teuthology.orchestra.run.smithi002.stdout: "type": "root", 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "mfa_ids": [], 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "account_id": "RGW99999999999999999", 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "path": "/", 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "create_date": "2024-09-14T11:22:42.691358Z", 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "tags": [], 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: "group_ids": [] 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:22:42.699 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:22:42.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.698+0000 7f09ea7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:42.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.701+0000 7f0b3800e800 20 remove_watcher() i=0 2024-09-14T11:22:42.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.701+0000 7f0b3800e800 2 removed watcher, disabling cache 2024-09-14T11:22:42.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.702+0000 7f0b3800e800 20 remove_watcher() i=1 2024-09-14T11:22:42.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.703+0000 7f0b3800e800 20 remove_watcher() i=2 2024-09-14T11:22:42.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.704+0000 7f0b3800e800 20 remove_watcher() i=3 2024-09-14T11:22:42.703 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.705+0000 7f0b3800e800 20 remove_watcher() i=4 2024-09-14T11:22:42.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.706+0000 7f0b3800e800 20 remove_watcher() i=5 2024-09-14T11:22:42.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.707+0000 7f0b3800e800 20 remove_watcher() i=6 2024-09-14T11:22:42.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.708+0000 7f0b3800e800 20 remove_watcher() i=7 2024-09-14T11:22:42.718 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 1508089904 --totp-seed Z7HSXWNZ2HD7HQXSVSVAWZNGGFQ4FQDEBRGMOZ74X5ANLL3U2CVW25JQZAEE7RKN --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-14T11:22:42.785 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:22:42.786 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:22:42.821 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.823+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 20 realm 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:42.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.825+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.826+0000 7f559fa87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:42.824 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.826+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:42.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.826+0000 7f559fa87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:22:42.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.826+0000 7f559fa87800 20 searching for the correct realm 2024-09-14T11:22:42.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.830+0000 7f559dd72640 0 -- 172.21.15.2:0/1887815011 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f5594016040 msgr2=0x7f5594066d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:22:42.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:42.834+0000 7f559d571640 0 -- 172.21.15.2:0/1887815011 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f559409e9b0 msgr2=0x7f5594026870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:22:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:22:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:22:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:22:43.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:22:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:22:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:22:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.040 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.041+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 zone default found 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 4 Realm: () 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 zonegroup default 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.042+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.043+0000 7f559fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.043+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.043+0000 7f559fa87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:22:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.043+0000 7f559fa87800 20 started sync module instance, tier type = 2024-09-14T11:22:43.042 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.043+0000 7f559fa87800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:22:43.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.052+0000 7f559fa87800 20 add_watcher() i=0 2024-09-14T11:22:43.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.052+0000 7f559fa87800 20 add_watcher() i=1 2024-09-14T11:22:43.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.052+0000 7f559fa87800 20 add_watcher() i=2 2024-09-14T11:22:43.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.052+0000 7f559fa87800 20 add_watcher() i=3 2024-09-14T11:22:43.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.052+0000 7f559fa87800 20 add_watcher() i=4 2024-09-14T11:22:43.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.052+0000 7f559fa87800 20 add_watcher() i=5 2024-09-14T11:22:43.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.052+0000 7f559fa87800 20 add_watcher() i=6 2024-09-14T11:22:43.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.053+0000 7f559fa87800 20 add_watcher() i=7 2024-09-14T11:22:43.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.053+0000 7f559fa87800 2 all 8 watchers are set, enabling cache 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.055+0000 7f5453fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.055+0000 7f559fa87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.055+0000 7f559fa87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.055+0000 7f559fa87800 5 note: GC not initialized 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f5452fe5640 20 reqs_thread_entry: start 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 20 init_complete bucket index max shards: 1 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 20 Filter name: none 2024-09-14T11:22:43.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f5450fe1640 20 reqs_thread_entry: start 2024-09-14T11:22:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-14T11:22:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 20 rados->read ofs=0 len=0 2024-09-14T11:22:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 20 rados_obj.operate() r=0 bl.length=494 2024-09-14T11:22:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-14T11:22:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:22:43.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.056+0000 7f559fa87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:22:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.059+0000 7f559fa87800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:22:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.059+0000 7f559fa87800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:22:43.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.059+0000 7f559fa87800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-14T11:22:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.059+0000 7f5480ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366308 cookie 94701209602144 notifier 8729 bl.length()=695 2024-09-14T11:22:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.059+0000 7f5480ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-14T11:22:43.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.059+0000 7f5480ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-14T11:22:43.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.061+0000 7f5453fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:22:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.064+0000 7f559fa87800 20 remove_watcher() i=0 2024-09-14T11:22:43.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.064+0000 7f559fa87800 2 removed watcher, disabling cache 2024-09-14T11:22:43.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.065+0000 7f559fa87800 20 remove_watcher() i=1 2024-09-14T11:22:43.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.066+0000 7f559fa87800 20 remove_watcher() i=2 2024-09-14T11:22:43.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.067+0000 7f559fa87800 20 remove_watcher() i=3 2024-09-14T11:22:43.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.068+0000 7f559fa87800 20 remove_watcher() i=4 2024-09-14T11:22:43.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.069+0000 7f559fa87800 20 remove_watcher() i=5 2024-09-14T11:22:43.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.070+0000 7f559fa87800 20 remove_watcher() i=6 2024-09-14T11:22:43.069 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:22:43.071+0000 7f559fa87800 20 remove_watcher() i=7 2024-09-14T11:22:43.081 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-14T11:22:43.081 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:22:43.081 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-14T11:22:43.111 INFO:tasks.s3tests:Configuring boto... 2024-09-14T11:22:43.111 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:22:43.111 DEBUG:teuthology.orchestra.run.smithi002:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:22:43.180 DEBUG:teuthology.orchestra.run.smithi002:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:22:43.365 INFO:teuthology.orchestra.run.smithi002.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-14T11:22:43.550 INFO:teuthology.orchestra.run.smithi002.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-14T11:22:43.834 INFO:teuthology.orchestra.run.smithi002.stdout:py installdeps: -rrequirements.txt 2024-09-14T11:24:47.329 INFO:teuthology.orchestra.run.smithi002.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-14T11:24:48.807 INFO:teuthology.orchestra.run.smithi002.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.9,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.3,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=fd318cb4c6448d1fcc514ab8bf6ae96e06003f57e50c17fa7cd006c4bbe2dc39,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-14T11:24:48.807 INFO:teuthology.orchestra.run.smithi002.stdout:py run-test-pre: PYTHONHASHSEED='3093714953' 2024-09-14T11:24:48.807 INFO:teuthology.orchestra.run.smithi002.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-14T11:24:48.950 INFO:teuthology.orchestra.run.smithi002.stdout:============================= test session starts ============================== 2024-09-14T11:24:48.951 INFO:teuthology.orchestra.run.smithi002.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-14T11:24:48.951 INFO:teuthology.orchestra.run.smithi002.stdout:cachedir: .tox/py/.pytest_cache 2024-09-14T11:24:48.951 INFO:teuthology.orchestra.run.smithi002.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:24:48.951 INFO:teuthology.orchestra.run.smithi002.stdout:configfile: pytest.ini 2024-09-14T11:24:50.802 INFO:teuthology.orchestra.run.smithi002.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-14T11:24:50.802 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:24:51.119 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-14T11:24:51.278 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-14T11:24:51.436 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-14T11:24:51.597 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-14T11:24:51.759 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-14T11:24:51.871 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-14T11:24:52.033 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-14T11:24:52.143 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-14T11:24:52.232 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-14T11:24:52.319 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-14T11:24:52.485 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-14T11:24:52.647 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-14T11:24:52.811 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-14T11:24:52.975 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-14T11:24:53.062 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-14T11:24:53.150 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-14T11:24:53.196 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-14T11:24:53.243 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-14T11:24:53.289 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-14T11:24:53.338 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-14T11:24:53.385 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-14T11:24:53.432 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-14T11:24:53.479 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:24:53.527 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-14T11:24:53.574 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:24:53.621 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-14T11:24:53.668 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:24:53.716 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-14T11:24:53.765 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-14T11:24:53.812 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-14T11:24:53.860 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:24:53.907 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-14T11:24:53.955 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:24:54.003 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-14T11:24:54.050 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:24:54.097 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-14T11:24:54.146 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-14T11:24:54.193 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-14T11:24:54.241 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:24:54.289 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:24:54.337 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-14T11:24:54.386 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:24:54.436 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-14T11:24:54.481 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-14T11:24:54.529 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.578 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.625 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.673 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.720 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.767 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.815 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.862 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-14T11:24:54.911 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-14T11:24:55.337 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-14T11:24:55.906 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-14T11:24:56.929 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-14T11:24:57.970 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-14T11:24:59.700 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-14T11:25:00.241 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-14T11:25:01.009 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-14T11:25:01.238 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-14T11:25:01.360 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-14T11:25:01.562 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-14T11:25:01.765 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-14T11:25:02.091 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-14T11:25:02.275 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-14T11:25:02.508 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-14T11:25:02.509 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:25:02.510 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-14T11:25:02.510 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:25:02.511 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-14T11:25:02.512 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:25:02.513 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-14T11:25:02.514 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-14T11:25:02.515 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:25:02.515 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:25:02.516 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-14T11:25:02.517 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:25:02.518 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-14T11:25:02.519 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:25:02.520 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:25:02.520 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-14T11:25:02.521 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:25:02.522 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:25:02.523 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:25:02.523 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-14T11:25:02.524 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-14T11:25:02.525 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-14T11:25:02.526 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-14T11:25:02.527 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-14T11:25:02.528 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-14T11:25:02.528 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-14T11:25:02.529 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-14T11:25:02.530 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-14T11:25:02.622 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-14T11:25:02.634 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-14T11:25:03.196 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-14T11:25:09.926 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-14T11:25:10.307 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-14T11:25:10.780 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-14T11:25:11.184 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-14T11:25:11.659 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-14T11:25:12.097 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-14T11:25:12.469 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-14T11:25:12.938 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-14T11:25:13.388 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-14T11:25:13.764 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-14T11:25:14.138 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-14T11:25:14.491 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-14T11:25:14.855 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-14T11:25:15.149 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-14T11:25:15.480 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-14T11:25:15.942 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-14T11:25:16.399 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-14T11:25:16.815 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-14T11:25:17.195 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-14T11:25:17.614 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-14T11:25:18.004 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-14T11:25:18.389 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-14T11:25:18.759 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-14T11:25:19.080 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-14T11:25:19.374 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-14T11:25:19.712 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-14T11:25:20.006 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-14T11:25:20.301 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-14T11:25:20.596 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-14T11:25:21.089 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-14T11:25:21.393 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:25:21.705 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-14T11:25:22.107 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-14T11:25:22.493 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-14T11:25:22.801 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:25:23.235 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-14T11:25:23.625 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-14T11:25:24.109 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:25:24.453 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-14T11:25:24.849 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-14T11:25:25.249 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-14T11:25:25.828 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-14T11:25:26.317 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:25:26.746 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-14T11:25:27.187 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:25:27.777 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:25:28.257 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:25:28.792 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:25:29.327 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:25:29.840 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-14T11:25:30.259 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-14T11:25:30.796 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-14T11:25:31.285 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-14T11:25:32.269 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-14T11:25:33.004 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-14T11:25:33.861 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-14T11:25:35.567 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-14T11:25:37.845 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-14T11:25:39.116 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-14T11:25:40.291 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-14T11:25:41.213 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-14T11:25:41.805 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-14T11:25:42.839 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-14T11:25:43.617 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-14T11:25:44.621 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-14T11:25:45.331 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-14T11:25:46.599 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-14T11:25:47.544 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-14T11:25:48.991 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-14T11:25:50.357 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-14T11:25:51.289 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-14T11:25:52.157 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-14T11:25:52.895 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-14T11:25:54.580 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-14T11:25:55.779 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-14T11:25:57.201 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-14T11:25:58.569 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-14T11:25:59.777 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-14T11:26:00.980 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-14T11:26:01.955 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-14T11:26:02.687 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-14T11:26:03.530 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-14T11:26:05.046 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-14T11:26:07.017 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-14T11:26:07.938 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-14T11:26:09.235 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-14T11:26:10.528 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-14T11:26:11.706 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:26:12.989 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-14T11:26:14.278 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-14T11:26:15.579 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-14T11:26:16.774 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-14T11:26:17.600 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-14T11:26:18.314 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:26:19.024 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-14T11:26:19.753 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-14T11:26:20.818 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:26:21.948 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-14T11:26:23.028 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:26:24.120 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-14T11:26:25.275 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:26:26.377 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-14T11:26:27.474 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-14T11:26:28.673 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-14T11:26:29.784 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-14T11:26:30.945 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:26:32.027 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-14T11:26:33.179 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-14T11:26:33.927 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-14T11:26:34.684 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-14T11:26:35.364 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-14T11:26:36.069 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-14T11:26:36.641 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-14T11:26:37.250 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-14T11:26:37.769 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-14T11:26:38.254 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-14T11:26:38.691 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-14T11:26:39.135 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-14T11:26:39.585 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-14T11:26:40.031 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-14T11:26:40.550 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-14T11:26:41.353 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-14T11:26:42.145 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-14T11:26:42.601 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:26:43.070 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-14T11:26:43.546 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-14T11:26:44.023 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-14T11:26:44.864 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:26:45.696 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-14T11:26:46.177 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-14T11:26:46.658 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-14T11:26:47.138 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:26:47.613 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-14T11:26:48.093 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-14T11:26:48.536 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-14T11:26:49.012 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:26:49.467 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-14T11:26:49.942 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-14T11:26:50.597 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-14T11:26:51.130 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-14T11:26:51.591 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-14T11:26:52.041 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-14T11:26:52.520 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-14T11:26:52.973 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-14T11:26:53.451 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:26:53.931 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-14T11:27:03.174 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-14T11:27:03.690 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-14T11:27:04.157 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-14T11:27:04.637 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-14T11:27:05.082 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-14T11:27:05.515 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-14T11:27:05.953 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-14T11:27:06.420 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-14T11:27:06.942 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-14T11:27:07.418 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-14T11:27:07.854 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-14T11:27:08.333 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-14T11:27:08.772 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-14T11:27:09.251 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:27:09.711 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-14T11:27:10.230 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:27:10.688 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-14T11:27:11.148 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-14T11:27:11.634 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-14T11:27:12.082 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:27:12.528 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:27:13.006 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:27:13.499 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-14T11:27:14.014 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-14T11:27:14.533 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-14T11:27:14.975 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-14T11:27:15.449 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-14T11:27:15.904 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-14T11:27:16.389 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-14T11:27:16.682 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-14T11:27:17.104 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-14T11:27:17.915 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-14T11:27:18.732 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-14T11:27:19.212 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-14T11:27:19.731 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-14T11:27:20.177 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-14T11:27:20.668 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-14T11:27:21.160 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-14T11:27:21.866 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-14T11:27:22.330 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-14T11:27:22.808 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-14T11:27:23.292 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-14T11:27:23.737 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-14T11:27:24.228 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-14T11:27:24.678 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-14T11:27:25.308 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-14T11:27:26.056 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-14T11:27:26.505 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-14T11:27:26.921 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-14T11:27:27.295 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:27:27.711 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-14T11:27:28.005 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-14T11:27:28.312 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-14T11:27:28.607 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-14T11:27:29.065 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-14T11:27:29.504 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-14T11:27:29.848 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-14T11:27:30.265 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-14T11:27:30.625 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-14T11:27:31.039 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-14T11:27:31.456 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-14T11:27:32.119 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-14T11:27:32.702 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-14T11:27:33.348 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-14T11:27:42.926 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-14T11:27:52.562 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-14T11:27:53.006 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-14T11:27:53.395 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-14T11:27:53.811 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-14T11:27:54.264 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-14T11:27:54.779 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-14T11:27:55.191 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-14T11:27:55.581 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-14T11:27:56.015 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-14T11:27:56.445 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-14T11:27:56.913 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-14T11:27:57.350 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-14T11:27:57.814 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-14T11:27:58.281 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-14T11:27:58.689 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-14T11:27:59.114 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-14T11:27:59.532 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-14T11:28:00.034 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-14T11:28:00.499 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-14T11:28:00.933 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-14T11:28:01.361 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-14T11:28:01.832 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-14T11:28:02.331 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-14T11:28:02.724 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-14T11:28:03.143 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-14T11:28:03.553 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-14T11:28:04.002 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-14T11:28:04.424 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-14T11:28:04.845 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-14T11:28:05.306 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-14T11:28:05.728 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-14T11:28:06.139 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-14T11:28:06.551 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-14T11:28:06.933 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-14T11:28:07.416 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-14T11:28:07.867 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-14T11:28:08.255 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-14T11:28:08.664 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-14T11:28:09.056 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-14T11:28:09.465 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-14T11:28:09.861 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-14T11:28:10.289 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-14T11:28:10.761 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-14T11:28:11.175 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-14T11:28:11.698 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-14T11:28:12.171 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-14T11:28:12.572 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-14T11:28:13.037 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-14T11:28:13.541 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-14T11:28:15.025 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-14T11:28:15.508 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-14T11:28:15.975 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-14T11:28:16.575 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-14T11:28:17.100 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-14T11:28:17.671 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-14T11:28:18.158 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-14T11:28:18.721 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-14T11:28:19.310 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-14T11:28:19.748 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-14T11:28:20.366 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-14T11:28:20.852 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-14T11:28:21.248 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-14T11:28:21.625 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-14T11:28:22.017 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-14T11:28:22.378 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-14T11:28:22.633 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-14T11:28:23.136 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-14T11:28:23.554 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-14T11:28:24.013 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-14T11:28:26.941 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-14T11:28:27.365 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-14T11:28:27.806 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-14T11:28:28.239 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-14T11:28:28.636 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-14T11:28:29.017 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-14T11:28:29.405 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-14T11:28:29.898 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-14T11:28:30.414 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-14T11:28:30.889 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-14T11:28:31.350 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-14T11:28:31.807 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-14T11:28:32.266 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-14T11:28:32.670 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-14T11:28:33.098 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-14T11:28:33.565 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-14T11:28:34.075 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-14T11:28:34.519 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-14T11:28:34.830 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-14T11:28:35.127 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-14T11:28:35.425 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-14T11:28:35.762 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-14T11:28:36.133 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-14T11:28:36.470 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-14T11:28:36.835 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-14T11:28:37.206 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-14T11:28:37.499 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-14T11:28:37.796 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-14T11:28:38.201 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-14T11:28:38.511 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-14T11:28:38.823 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-14T11:28:39.121 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-14T11:28:39.415 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-14T11:28:39.800 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-14T11:28:40.201 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-14T11:28:40.621 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-14T11:28:41.027 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-14T11:28:41.429 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-14T11:28:41.884 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-14T11:28:42.249 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-14T11:28:42.666 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-14T11:28:43.069 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:28:43.471 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:28:43.901 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-14T11:28:44.327 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-14T11:28:44.875 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-14T11:28:45.348 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-14T11:28:45.851 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-14T11:28:46.381 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-14T11:28:46.864 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-14T11:28:47.337 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-14T11:28:47.849 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-14T11:28:48.219 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-14T11:28:48.725 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-14T11:28:49.211 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-14T11:28:49.736 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-14T11:28:50.284 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-14T11:28:50.842 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-14T11:28:51.508 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-14T11:28:52.126 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-14T11:28:52.827 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-14T11:28:53.536 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-14T11:28:54.143 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-14T11:28:54.642 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-14T11:28:55.105 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-14T11:28:55.531 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-14T11:28:56.037 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-14T11:28:56.468 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-14T11:28:56.992 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-14T11:28:57.740 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-14T11:28:58.509 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-14T11:28:59.186 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-14T11:28:59.914 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-14T11:29:00.629 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:29:01.356 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-14T11:29:02.116 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-14T11:29:02.831 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-14T11:29:03.562 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-14T11:29:04.177 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-14T11:29:04.740 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-14T11:29:05.318 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-14T11:29:06.042 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-14T11:29:06.761 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-14T11:29:07.055 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-14T11:29:07.362 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-14T11:29:07.658 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-14T11:29:08.078 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-14T11:29:08.512 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-14T11:29:08.836 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-14T11:29:09.162 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-14T11:29:09.734 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-14T11:29:10.841 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-14T11:29:11.380 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-14T11:29:11.899 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-14T11:29:12.469 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-14T11:29:12.980 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-14T11:29:13.531 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-14T11:29:14.076 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-14T11:29:14.550 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-14T11:29:15.256 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-14T11:29:15.750 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-14T11:29:16.423 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-14T11:29:17.010 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-14T11:29:17.764 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-14T11:29:18.431 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-14T11:29:18.813 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-14T11:29:19.218 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-14T11:29:20.452 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-14T11:29:21.014 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-14T11:29:22.767 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-14T11:29:23.251 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-14T11:29:23.788 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-14T11:29:24.610 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-14T11:29:25.131 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-14T11:29:25.944 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-14T11:29:27.910 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-14T11:29:30.716 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-14T11:29:33.129 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-14T11:29:43.886 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-14T11:29:45.216 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-14T11:29:47.799 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-14T11:29:48.317 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-14T11:29:49.112 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-14T11:29:49.828 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-14T11:29:50.366 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-14T11:29:50.801 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-14T11:29:51.562 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-14T11:29:52.050 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-14T11:29:52.521 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-14T11:29:53.046 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-14T11:30:07.426 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-14T11:30:09.522 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-14T11:30:10.031 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-14T11:30:10.375 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-14T11:30:10.840 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-14T11:30:15.915 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-14T11:30:19.447 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-14T11:30:22.955 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-14T11:30:23.486 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-14T11:30:23.982 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-14T11:30:24.462 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-14T11:30:24.944 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-14T11:30:25.429 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-14T11:30:25.911 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-14T11:30:26.377 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-14T11:30:26.964 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-14T11:30:27.530 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-14T11:30:28.163 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-14T11:30:28.672 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-14T11:30:29.417 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-14T11:30:30.182 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-14T11:30:30.751 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-14T11:30:31.283 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-14T11:30:31.959 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-14T11:30:32.582 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-14T11:30:33.101 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-14T11:30:33.766 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-14T11:30:34.227 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-14T11:30:38.841 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-14T11:30:39.301 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-14T11:30:39.724 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-14T11:30:40.232 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-14T11:30:40.725 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-14T11:30:41.503 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-14T11:30:47.991 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-14T11:30:48.554 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-14T11:30:49.165 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-14T11:30:49.903 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-14T11:30:50.674 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-14T11:30:53.481 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-14T11:30:54.095 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-14T11:30:57.604 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-14T11:31:10.782 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-14T11:31:13.222 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-14T11:31:14.291 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-14T11:31:15.598 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-14T11:31:16.256 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-14T11:31:16.877 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-14T11:31:17.498 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-14T11:31:18.192 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-14T11:31:18.865 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-14T11:31:19.574 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-14T11:31:19.993 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-14T11:31:20.447 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-14T11:31:20.898 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-14T11:31:21.315 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-14T11:31:21.774 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-14T11:31:22.231 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-14T11:31:22.639 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-14T11:31:23.045 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-14T11:31:23.450 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-14T11:31:23.857 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-14T11:31:24.226 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-14T11:31:24.631 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-14T11:31:25.017 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-14T11:31:25.428 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-14T11:31:25.921 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-14T11:31:26.345 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-14T11:31:26.771 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-14T11:31:27.238 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-14T11:31:27.629 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-14T11:31:28.108 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-14T11:31:28.564 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-14T11:31:28.984 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-14T11:31:29.369 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-14T11:31:29.920 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-14T11:31:30.298 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-14T11:31:33.740 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-14T11:31:36.919 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-14T11:31:37.925 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-14T11:31:38.385 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-14T11:32:39.192 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-14T11:33:39.780 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-14T11:33:40.223 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-14T11:33:40.657 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-14T11:33:41.082 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-14T11:33:41.504 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-14T11:33:43.871 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-14T11:33:44.675 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-14T11:33:45.538 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-14T11:33:45.972 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-14T11:33:46.393 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-14T11:33:46.814 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-14T11:33:47.255 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-14T11:33:47.713 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-14T11:33:48.207 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-14T11:33:48.651 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-14T11:33:49.123 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-14T11:33:49.606 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-14T11:33:50.086 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-14T11:33:50.590 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-14T11:33:51.014 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-14T11:33:51.769 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-14T11:33:52.536 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-14T11:33:53.263 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-14T11:33:53.780 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-14T11:33:54.329 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-14T11:33:54.865 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-14T11:33:55.508 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-14T11:33:56.081 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-14T11:33:56.671 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-14T11:33:57.312 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-14T11:33:57.919 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-14T11:33:58.419 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-14T11:33:58.900 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-14T11:33:59.406 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-14T11:33:59.977 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-14T11:34:00.548 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-14T11:34:01.177 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-14T11:34:02.061 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-14T11:34:04.202 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-14T11:34:04.829 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-14T11:34:05.494 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:34:06.078 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-14T11:34:06.957 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-14T11:34:07.646 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-14T11:34:08.147 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-14T11:34:08.830 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-14T11:34:09.201 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-14T11:34:09.572 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-14T11:34:09.945 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-14T11:34:10.348 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-14T11:34:10.843 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-14T11:34:11.256 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-14T11:34:11.893 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-14T11:34:12.267 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-14T11:34:12.677 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-14T11:34:13.075 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-14T11:34:13.458 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-14T11:34:13.858 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-14T11:34:14.309 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-14T11:34:14.674 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-14T11:34:15.042 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-14T11:34:15.456 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-14T11:34:15.871 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-14T11:34:16.278 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-14T11:34:16.744 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-14T11:34:17.249 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-14T11:34:17.676 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-14T11:34:18.035 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-14T11:34:18.519 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-14T11:34:18.980 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-14T11:34:19.395 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-14T11:34:19.840 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-14T11:34:20.239 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-14T11:34:20.672 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-14T11:34:21.080 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:34:21.570 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-14T11:34:22.027 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-14T11:34:22.549 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-14T11:34:22.945 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-14T11:34:23.389 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-14T11:34:23.810 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-14T11:34:24.293 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-14T11:34:24.750 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-14T11:34:25.215 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:34:25.743 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-14T11:34:26.093 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-14T11:34:26.494 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-14T11:34:26.906 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-14T11:34:37.206 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-14T11:34:37.680 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-14T11:34:47.268 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-14T11:34:47.800 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-14T11:34:48.335 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-14T11:34:48.743 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-14T11:34:49.152 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:34:49.610 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:34:50.119 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-14T11:34:50.568 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-14T11:34:51.016 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-14T11:34:51.423 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-14T11:34:51.871 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-14T11:34:52.386 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-14T11:34:52.853 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-14T11:34:53.439 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-14T11:34:53.947 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-14T11:34:54.450 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-14T11:34:54.875 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-14T11:34:55.523 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-14T11:34:56.492 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-14T11:34:56.855 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:34:57.320 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:34:57.781 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-14T11:34:58.259 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-14T11:34:58.835 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-14T11:34:59.317 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-14T11:35:00.065 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-14T11:35:00.747 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-14T11:35:01.217 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-14T11:35:06.798 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-14T11:35:12.238 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-14T11:35:12.725 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-14T11:35:13.441 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-14T11:35:14.677 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-14T11:35:15.887 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-14T11:35:17.057 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-14T11:35:17.917 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-14T11:35:18.752 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-14T11:35:19.493 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-14T11:35:20.094 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-14T11:35:21.119 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-14T11:35:22.255 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-14T11:35:24.118 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-14T11:35:25.246 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-14T11:35:26.025 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-14T11:35:26.694 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-14T11:35:27.266 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-14T11:35:28.124 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-14T11:35:28.930 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-14T11:35:29.733 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-14T11:35:30.429 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-14T11:35:31.251 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-14T11:35:32.016 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-14T11:35:32.856 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-14T11:35:33.659 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-14T11:35:33.918 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-14T11:35:35.220 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-14T11:35:36.523 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-14T11:35:37.356 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-14T11:35:38.075 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-14T11:35:38.734 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-14T11:35:54.260 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-14T11:35:54.518 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-14T11:35:55.265 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-14T11:35:55.868 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-14T11:35:56.286 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-14T11:35:56.886 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-14T11:35:56.908 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-14T11:35:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.908 INFO:teuthology.orchestra.run.smithi002.stdout:=============================== warnings summary =============================== 2024-09-14T11:35:56.908 INFO:teuthology.orchestra.run.smithi002.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-14T11:35:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-14T11:35:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: import imp 2024-09-14T11:35:56.908 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py:120 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: if boto_type is 'S3Connection': 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_headers.py:124 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: elif boto_type is 'HTTPRequest': 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3.py:359 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-14T11:35:56.909 INFO:teuthology.orchestra.run.smithi002.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py:176 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: if k is 'BucketName': 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py:253 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: @pytest.mark.timeout(10) 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-14T11:35:56.910 INFO:teuthology.orchestra.run.smithi002.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: @pytest.mark.s3website_routing_rules 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.911 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.912 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.913 INFO:teuthology.orchestra.run.smithi002.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-14T11:35:56.914 INFO:teuthology.orchestra.run.smithi002.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi002.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: warnings.warn( 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-14T11:35:56.915 INFO:teuthology.orchestra.run.smithi002.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 667.96s (0:11:07) = 2024-09-14T11:35:57.048 INFO:teuthology.orchestra.run.smithi002.stdout:___________________________________ summary ____________________________________ 2024-09-14T11:35:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: py: commands succeeded 2024-09-14T11:35:57.049 INFO:teuthology.orchestra.run.smithi002.stdout: congratulations :) 2024-09-14T11:35:57.066 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-14T11:35:57.066 DEBUG:teuthology.orchestra.run.smithi002:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:35:57.182 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:35:57.182 INFO:tasks.s3tests:Cleaning up boto... 2024-09-14T11:35:57.183 DEBUG:teuthology.orchestra.run.smithi002:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-14T11:35:57.212 INFO:tasks.s3tests:Removing s3-tests... 2024-09-14T11:35:57.212 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-14T11:35:57.424 INFO:teuthology.run_tasks:Running task workunit... 2024-09-14T11:35:57.435 INFO:tasks.workunit:Pulling workunits from ref 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:35:57.435 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-14T11:35:57.436 DEBUG:teuthology.orchestra.run.smithi002:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:35:57.465 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:35:57.465 INFO:teuthology.orchestra.run.smithi002.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-14T11:35:57.466 DEBUG:teuthology.orchestra.run.smithi002:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:35:57.535 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-14T11:35:57.536 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-14T11:35:57.605 INFO:tasks.workunit:timeout=3h 2024-09-14T11:35:57.605 INFO:tasks.workunit:cleanup=True 2024-09-14T11:35:57.606 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1c941a66c1b420259b8fc5ac19e792dbbf60aded 2024-09-14T11:35:57.676 INFO:tasks.workunit.client.0.smithi002.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-14T11:36:55.852 INFO:tasks.workunit.client.0.smithi002.stderr:Updating files: 93% (12082/12889) Updating files: 94% (12116/12889) Updating files: 95% (12245/12889) Updating files: 96% (12374/12889) Updating files: 97% (12503/12889) Updating files: 98% (12632/12889) Updating files: 99% (12761/12889) Updating files: 100% (12889/12889) Updating files: 100% (12889/12889), done. 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:Note: switching to '1c941a66c1b420259b8fc5ac19e792dbbf60aded'. 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:state without impacting any branches by switching back to a branch. 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr: git switch -c 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:36:56.477 INFO:tasks.workunit.client.0.smithi002.stderr:Or undo this operation with: 2024-09-14T11:36:56.478 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:36:56.478 INFO:tasks.workunit.client.0.smithi002.stderr: git switch - 2024-09-14T11:36:56.478 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:36:56.478 INFO:tasks.workunit.client.0.smithi002.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-14T11:36:56.478 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:36:56.478 INFO:tasks.workunit.client.0.smithi002.stderr:HEAD is now at 1c941a66c1b Merge pull request #54777 from cbodley/wip-rgw-meta-handlers 2024-09-14T11:36:56.479 DEBUG:teuthology.orchestra.run.smithi002:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-14T11:36:56.548 INFO:tasks.workunit.client.0.smithi002.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-14T11:36:56.551 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:36:56.551 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-14T11:36:56.600 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-14T11:36:56.650 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-14T11:36:56.692 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:36:56.693 INFO:tasks.workunit.client.0.smithi002.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-14T11:36:56.734 INFO:tasks.workunit.client.0.smithi002.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-14T11:36:56.738 DEBUG:teuthology.orchestra.run.smithi002:> set -ex 2024-09-14T11:36:56.738 DEBUG:teuthology.orchestra.run.smithi002:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-14T11:36:56.808 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-14T11:36:56.809 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-14T11:36:56.809 DEBUG:teuthology.orchestra.run.smithi002:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1c941a66c1b420259b8fc5ac19e792dbbf60aded TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:36:56.882 INFO:tasks.workunit.client.0.smithi002.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-14T11:36:56.883 INFO:tasks.workunit.client.0.smithi002.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:36:56.883 INFO:tasks.workunit.client.0.smithi002.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:36:59.269 INFO:tasks.workunit.client.0.smithi002.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ deactivate nondestructive 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ hash -r 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ unset VIRTUAL_ENV 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ export VIRTUAL_ENV 2024-09-14T11:36:59.270 INFO:tasks.workunit.client.0.smithi002.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:36:59.271 INFO:tasks.workunit.client.0.smithi002.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:36:59.271 INFO:tasks.workunit.client.0.smithi002.stderr:++ export PATH 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n '' ']' 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -z '' ']' 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ PS1='(rgw) ' 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ export PS1 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:++ hash -r 2024-09-14T11:36:59.272 INFO:tasks.workunit.client.0.smithi002.stderr:+ pip install pip --upgrade 2024-09-14T11:36:59.508 INFO:tasks.workunit.client.0.smithi002.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-14T11:36:59.693 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting pip 2024-09-14T11:36:59.698 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-14T11:36:59.744 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: pip 2024-09-14T11:36:59.745 INFO:tasks.workunit.client.0.smithi002.stdout: Attempting uninstall: pip 2024-09-14T11:36:59.745 INFO:tasks.workunit.client.0.smithi002.stdout: Found existing installation: pip 21.3.1 2024-09-14T11:36:59.908 INFO:tasks.workunit.client.0.smithi002.stdout: Uninstalling pip-21.3.1: 2024-09-14T11:36:59.913 INFO:tasks.workunit.client.0.smithi002.stdout: Successfully uninstalled pip-21.3.1 2024-09-14T11:37:00.692 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed pip-24.2 2024-09-14T11:37:00.741 INFO:tasks.workunit.client.0.smithi002.stderr:+ pip install boto3 2024-09-14T11:37:01.711 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting boto3 2024-09-14T11:37:01.713 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached boto3-1.35.19-py3-none-any.whl.metadata (6.6 kB) 2024-09-14T11:37:02.264 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting botocore<1.36.0,>=1.35.19 (from boto3) 2024-09-14T11:37:02.265 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached botocore-1.35.19-py3-none-any.whl.metadata (5.7 kB) 2024-09-14T11:37:02.310 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-14T11:37:02.328 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-14T11:37:02.365 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-14T11:37:02.366 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-14T11:37:02.416 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:37:02.418 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-14T11:37:02.494 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:37:02.495 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-14T11:37:02.696 INFO:tasks.workunit.client.0.smithi002.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.19->boto3) 2024-09-14T11:37:02.698 INFO:tasks.workunit.client.0.smithi002.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-14T11:37:02.702 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached boto3-1.35.19-py3-none-any.whl (139 kB) 2024-09-14T11:37:02.703 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached botocore-1.35.19-py3-none-any.whl (12.5 MB) 2024-09-14T11:37:02.713 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-14T11:37:02.714 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-14T11:37:02.715 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-14T11:37:02.717 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-14T11:37:02.718 INFO:tasks.workunit.client.0.smithi002.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-14T11:37:02.795 INFO:tasks.workunit.client.0.smithi002.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-14T11:37:03.859 INFO:tasks.workunit.client.0.smithi002.stdout:Successfully installed boto3-1.35.19 botocore-1.35.19 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-14T11:37:03.978 INFO:tasks.workunit.client.0.smithi002.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-14T11:37:04.104 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-14T11:37:04.140 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:04.140 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:04.179 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.181+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 20 realm 2024-09-14T11:37:04.181 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:04.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.182 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.183+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.184+0000 7f3483cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:04.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.184+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.184+0000 7f3483cbb800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:04.183 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.184+0000 7f3483cbb800 20 searching for the correct realm 2024-09-14T11:37:04.186 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.188+0000 7f3481fa6640 0 -- 172.21.15.2:0/701681932 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f3478019400 msgr2=0x7f3478019860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:04.190 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.192+0000 7f34817a5640 0 -- 172.21.15.2:0/701681932 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f347800a430 msgr2=0x7f347800a890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:04.397 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.399+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 zone default found 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 4 Realm: () 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:04.400 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 zonegroup default 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.400+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.401+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.401+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.401+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.401+0000 7f3483cbb800 20 started sync module instance, tier type = 2024-09-14T11:37:04.401 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.401+0000 7f3483cbb800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:37:04.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.411+0000 7f3483cbb800 20 add_watcher() i=0 2024-09-14T11:37:04.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.411+0000 7f3483cbb800 20 add_watcher() i=1 2024-09-14T11:37:04.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.411+0000 7f3483cbb800 20 add_watcher() i=2 2024-09-14T11:37:04.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.411+0000 7f3483cbb800 20 add_watcher() i=3 2024-09-14T11:37:04.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.411+0000 7f3483cbb800 20 add_watcher() i=4 2024-09-14T11:37:04.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.411+0000 7f3483cbb800 20 add_watcher() i=5 2024-09-14T11:37:04.409 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.411+0000 7f3483cbb800 20 add_watcher() i=6 2024-09-14T11:37:04.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.412+0000 7f3483cbb800 20 add_watcher() i=7 2024-09-14T11:37:04.410 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.412+0000 7f3483cbb800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:04.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.414+0000 7f33377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:04.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.414+0000 7f3483cbb800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:04.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.414+0000 7f3483cbb800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:04.412 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.414+0000 7f3483cbb800 5 note: GC not initialized 2024-09-14T11:37:04.413 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.415+0000 7f33367e4640 20 reqs_thread_entry: start 2024-09-14T11:37:04.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.415+0000 7f3483cbb800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:04.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.415+0000 7f3483cbb800 20 Filter name: none 2024-09-14T11:37:04.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.415+0000 7f32a7fff640 20 reqs_thread_entry: start 2024-09-14T11:37:04.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.415+0000 7f3483cbb800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-14T11:37:04.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.415+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-14T11:37:04.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:37:04.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-14T11:37:04.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-14T11:37:04.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:37:04.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:37:04.416 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.416+0000 7f3483cbb800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-14T11:37:04.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.418+0000 7f3483cbb800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:37:04.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.418+0000 7f3483cbb800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:37:04.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.418+0000 7f3483cbb800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-14T11:37:04.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.418+0000 7f3364ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367364 cookie 94113463263024 notifier 9267 bl.length()=613 2024-09-14T11:37:04.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.418+0000 7f3364ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-14T11:37:04.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.418+0000 7f3364ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-14T11:37:04.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.419+0000 7f3483cbb800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:37:04.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.420+0000 7f3483cbb800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:37:04.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.420+0000 7f3483cbb800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-14T11:37:04.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.420+0000 7f3357fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366666 cookie 94113463259184 notifier 9267 bl.length()=191 2024-09-14T11:37:04.418 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.420+0000 7f3357fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-14T11:37:04.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.420+0000 7f3357fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-14T11:37:04.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.421+0000 7f33377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:04.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.424+0000 7f3483cbb800 20 remove_watcher() i=0 2024-09-14T11:37:04.422 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.424+0000 7f3483cbb800 2 removed watcher, disabling cache 2024-09-14T11:37:04.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.425+0000 7f3483cbb800 20 remove_watcher() i=1 2024-09-14T11:37:04.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.426+0000 7f3483cbb800 20 remove_watcher() i=2 2024-09-14T11:37:04.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.427+0000 7f3483cbb800 20 remove_watcher() i=3 2024-09-14T11:37:04.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.428+0000 7f3483cbb800 20 remove_watcher() i=4 2024-09-14T11:37:04.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.429+0000 7f3483cbb800 20 remove_watcher() i=5 2024-09-14T11:37:04.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.430+0000 7f3483cbb800 20 remove_watcher() i=6 2024-09-14T11:37:04.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.431+0000 7f3483cbb800 20 remove_watcher() i=7 2024-09-14T11:37:04.576 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:04.576 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:04.622 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:04.622 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:04.668 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:04.668 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:04.679 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:04.680 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:04.683 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-14T11:37:04.683 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:37:04.686 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:04.686 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:04.696 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:04.696 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:04.703 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:04.703 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:04.715 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:37:04.745 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:04.745 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:04.785 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.787+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 20 realm 2024-09-14T11:37:04.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:04.788 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:04.789 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.789+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.790+0000 7f9b48d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:04.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.790+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:04.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.791+0000 7f9b48d23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:04.790 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.791+0000 7f9b48d23800 20 searching for the correct realm 2024-09-14T11:37:04.791 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.793+0000 7f9b3ffff640 0 -- 172.21.15.2:0/2995301333 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7f9b3804abd0 msgr2=0x7f9b38029470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:04.997 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:04.999+0000 7f9b44a0c640 0 -- 172.21.15.2:0/2995301333 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f9b30073610 msgr2=0x7f9b3008c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:05.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:05.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:05.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:37:05.206 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.207+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 zone default found 2024-09-14T11:37:05.207 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 4 Realm: () 2024-09-14T11:37:05.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:37:05.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:37:05.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:05.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 zonegroup default 2024-09-14T11:37:05.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:05.208 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:05.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.208+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.209+0000 7f9b48d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:05.209 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.209+0000 7f9b48d23800 20 started sync module instance, tier type = 2024-09-14T11:37:05.210 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.209+0000 7f9b48d23800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:37:05.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.219+0000 7f9b48d23800 20 add_watcher() i=0 2024-09-14T11:37:05.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.219+0000 7f9b48d23800 20 add_watcher() i=1 2024-09-14T11:37:05.217 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.219+0000 7f9b48d23800 20 add_watcher() i=2 2024-09-14T11:37:05.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.219+0000 7f9b48d23800 20 add_watcher() i=3 2024-09-14T11:37:05.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.219+0000 7f9b48d23800 20 add_watcher() i=4 2024-09-14T11:37:05.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.219+0000 7f9b48d23800 20 add_watcher() i=5 2024-09-14T11:37:05.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.219+0000 7f9b48d23800 20 add_watcher() i=6 2024-09-14T11:37:05.218 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.220+0000 7f9b48d23800 20 add_watcher() i=7 2024-09-14T11:37:05.219 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.220+0000 7f9b48d23800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:05.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.222+0000 7f99fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:05.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.222+0000 7f9b48d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:05.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.222+0000 7f9b48d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:05.221 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.222+0000 7f9b48d23800 5 note: GC not initialized 2024-09-14T11:37:05.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.223+0000 7f99fa7e4640 20 reqs_thread_entry: start 2024-09-14T11:37:05.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.223+0000 7f9b48d23800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:05.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.223+0000 7f9b48d23800 20 Filter name: none 2024-09-14T11:37:05.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.223+0000 7f99f3fff640 20 reqs_thread_entry: start 2024-09-14T11:37:05.222 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.223+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.223+0000 7f9b48d23800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:37:05.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.223+0000 7f9b48d23800 20 rados->read ofs=0 len=0 2024-09-14T11:37:05.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.224+0000 7f9b48d23800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:37:05.223 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.224+0000 7f9b48d23800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:05.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.224+0000 7f9b48d23800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:37:05.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.224+0000 7f9b48d23800 20 INFO: main: starting shard=0 2024-09-14T11:37:05.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.224+0000 7f9b48d23800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.782.0 2024-09-14T11:37:05.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.225+0000 7f9b48d23800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:05.224 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.225+0000 7f9b48d23800 20 INFO: main: done 2024-09-14T11:37:05.225 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.226+0000 7f99fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:05.226 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.228+0000 7f9b48d23800 20 remove_watcher() i=0 2024-09-14T11:37:05.227 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.228+0000 7f9b48d23800 2 removed watcher, disabling cache 2024-09-14T11:37:05.228 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.230+0000 7f9b48d23800 20 remove_watcher() i=1 2024-09-14T11:37:05.229 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.231+0000 7f9b48d23800 20 remove_watcher() i=2 2024-09-14T11:37:05.232 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.234+0000 7f9b48d23800 20 remove_watcher() i=3 2024-09-14T11:37:05.233 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.235+0000 7f9b48d23800 20 remove_watcher() i=4 2024-09-14T11:37:05.234 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.236+0000 7f9b48d23800 20 remove_watcher() i=5 2024-09-14T11:37:05.235 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.237+0000 7f9b48d23800 20 remove_watcher() i=6 2024-09-14T11:37:05.236 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.238+0000 7f9b48d23800 20 remove_watcher() i=7 2024-09-14T11:37:05.250 INFO:tasks.workunit.client.0.smithi002.stderr:rados -p default.rgw.buckets.data ls | grep 269aa6ae-eb0e-4e0e-9cfd-3caacc8ca269 2024-09-14T11:37:05.273 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:05.273 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:05.351 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:05.353+0000 7fe9f99c5640 0 -- 172.21.15.2:0/449898001 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7fe9ec01fb80 msgr2=0x7fe9ec0281b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:05.365 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-14T11:37:05.365 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:37:05.366 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:37:06.780 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:06.780 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:06.791 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:37:07.212 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-14T11:37:07.241 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:07.241 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:07.280 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.282+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:07.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 20 realm 2024-09-14T11:37:07.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.282 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:07.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:07.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:07.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.284+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.285+0000 7f77b212a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:07.283 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.285+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.286+0000 7f77b212a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:07.284 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.286+0000 7f77b212a800 20 searching for the correct realm 2024-09-14T11:37:07.287 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.289+0000 7f77ad616640 0 -- 172.21.15.2:0/3787789729 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x5555961ce9b0 msgr2=0x5555961d0e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:07.291 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.293+0000 7f77ade17640 0 -- 172.21.15.2:0/3787789729 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f77a4084830 msgr2=0x7f77a40982e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:07.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:07.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:07.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:37:07.296 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:37:07.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:07.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:07.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:07.297 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.298+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 zone default found 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 4 Realm: () 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 zonegroup default 2024-09-14T11:37:07.298 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:07.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.299+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.300+0000 7f77b212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:07.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.300+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.300+0000 7f77b212a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:07.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.300+0000 7f77b212a800 20 started sync module instance, tier type = 2024-09-14T11:37:07.299 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.300+0000 7f77b212a800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:37:07.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.309+0000 7f77b212a800 20 add_watcher() i=0 2024-09-14T11:37:07.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.309+0000 7f77b212a800 20 add_watcher() i=1 2024-09-14T11:37:07.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.309+0000 7f77b212a800 20 add_watcher() i=2 2024-09-14T11:37:07.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.309+0000 7f77b212a800 20 add_watcher() i=3 2024-09-14T11:37:07.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.309+0000 7f77b212a800 20 add_watcher() i=4 2024-09-14T11:37:07.307 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.309+0000 7f77b212a800 20 add_watcher() i=5 2024-09-14T11:37:07.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.309+0000 7f77b212a800 20 add_watcher() i=6 2024-09-14T11:37:07.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.310+0000 7f77b212a800 20 add_watcher() i=7 2024-09-14T11:37:07.308 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.310+0000 7f77b212a800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:07.309 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.311+0000 7f765f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:07.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f77b212a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:07.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f77b212a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:07.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f77b212a800 5 note: GC not initialized 2024-09-14T11:37:07.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f765e7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:07.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f77b212a800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:07.310 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f77b212a800 20 Filter name: none 2024-09-14T11:37:07.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f75cffff640 20 reqs_thread_entry: start 2024-09-14T11:37:07.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.312+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.313+0000 7f77b212a800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:37:07.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.313+0000 7f77b212a800 20 rados->read ofs=0 len=0 2024-09-14T11:37:07.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.313+0000 7f77b212a800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:37:07.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.313+0000 7f77b212a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-14T11:37:07.311 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.313+0000 7f77b212a800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=1 2024-09-14T11:37:07.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.313+0000 7f77b212a800 20 INFO: main: starting shard=0 2024-09-14T11:37:07.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.313+0000 7f77b212a800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.782.0 2024-09-14T11:37:07.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.314+0000 7f77b212a800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-14T11:37:07.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.314+0000 7f77b212a800 20 INFO: main: done 2024-09-14T11:37:07.312 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.314+0000 7f765f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:07.314 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.317+0000 7f77b212a800 20 remove_watcher() i=0 2024-09-14T11:37:07.315 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.317+0000 7f77b212a800 2 removed watcher, disabling cache 2024-09-14T11:37:07.316 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.318+0000 7f77b212a800 20 remove_watcher() i=1 2024-09-14T11:37:07.317 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.319+0000 7f77b212a800 20 remove_watcher() i=2 2024-09-14T11:37:07.318 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.320+0000 7f77b212a800 20 remove_watcher() i=3 2024-09-14T11:37:07.319 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.321+0000 7f77b212a800 20 remove_watcher() i=4 2024-09-14T11:37:07.320 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.322+0000 7f77b212a800 20 remove_watcher() i=5 2024-09-14T11:37:07.321 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.323+0000 7f77b212a800 20 remove_watcher() i=6 2024-09-14T11:37:07.322 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.324+0000 7f77b212a800 20 remove_watcher() i=7 2024-09-14T11:37:07.335 INFO:tasks.workunit.client.0.smithi002.stderr:rados -p default.rgw.buckets.data ls | grep e77142a6-ff94-48e2-ab62-5e8903d9c0d1 2024-09-14T11:37:07.357 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:07.357 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:07.433 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:07.435+0000 7f8a9b8e0640 0 -- 172.21.15.2:0/341092791 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x7f8a84013850 msgr2=0x7f8a840143a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-14T11:37:07.444 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-14T11:37:07.445 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:37:07.447 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:07.447 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:07.453 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:07.453 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:07.461 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:07.461 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:07.466 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-14T11:37:08.876 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:08.877 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:08.932 INFO:tasks.workunit.client.0.smithi002.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-14T11:37:08.934 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-14T11:37:09.356 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:09.356 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:09.363 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:09.363 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:09.366 INFO:tasks.workunit.client.0.smithi002.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-14T11:37:09.366 INFO:tasks.workunit.client.0.smithi002.stderr: 2024-09-14T11:37:09.367 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:09.368 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:09.413 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:09.413 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:09.456 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:09.456 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:09.466 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-14T11:37:10.880 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:10.880 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:10.881 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:10.881 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:12.897 INFO:tasks.workunit.client.0.smithi002.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-14T11:37:13.316 INFO:tasks.workunit.client.0.smithi002.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-14T11:37:13.347 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:13.348 INFO:tasks.workunit.client.0.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:13.387 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.388+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.389+0000 7f6a4db46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:13.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.389+0000 7f6a4db46800 20 realm 2024-09-14T11:37:13.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.389+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.390+0000 7f6a4db46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:13.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.390+0000 7f6a4db46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:13.389 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.390+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.390+0000 7f6a4db46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:13.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.390+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.391+0000 7f6a4db46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:13.390 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.391+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.391+0000 7f6a4db46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:13.391 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.391+0000 7f6a4db46800 20 searching for the correct realm 2024-09-14T11:37:13.394 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.395+0000 7f6a4ae36640 0 -- 172.21.15.2:0/4072372206 >> [v2:172.21.15.2:6816/1337492648,v1:172.21.15.2:6817/1337492648] conn(0x55c70fb20e80 msgr2=0x55c70fb23340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:13.398 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.399+0000 7f6a4b637640 0 -- 172.21.15.2:0/4072372206 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f6a400bef00 msgr2=0x7f6a400b4a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:13.402 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:13.403 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.403+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:13.404 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 zone default found 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 4 Realm: () 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 zonegroup default 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.404+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.405 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.405+0000 7f6a4db46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:13.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.405+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.405+0000 7f6a4db46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:13.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.405+0000 7f6a4db46800 20 started sync module instance, tier type = 2024-09-14T11:37:13.406 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.405+0000 7f6a4db46800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:37:13.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.415+0000 7f6a4db46800 20 add_watcher() i=0 2024-09-14T11:37:13.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.415+0000 7f6a4db46800 20 add_watcher() i=1 2024-09-14T11:37:13.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.415+0000 7f6a4db46800 20 add_watcher() i=2 2024-09-14T11:37:13.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.415+0000 7f6a4db46800 20 add_watcher() i=3 2024-09-14T11:37:13.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.415+0000 7f6a4db46800 20 add_watcher() i=4 2024-09-14T11:37:13.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.415+0000 7f6a4db46800 20 add_watcher() i=5 2024-09-14T11:37:13.414 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.415+0000 7f6a4db46800 20 add_watcher() i=6 2024-09-14T11:37:13.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.416+0000 7f6a4db46800 20 add_watcher() i=7 2024-09-14T11:37:13.415 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.416+0000 7f6a4db46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:13.417 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.418+0000 7f6901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6a4db46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6a4db46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6a4db46800 5 note: GC not initialized 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6900fe1640 20 reqs_thread_entry: start 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6a4db46800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6a4db46800 20 Filter name: none 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f687a7fc640 20 reqs_thread_entry: start 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6a4db46800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.419+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 20 rados_obj.operate() r=0 bl.length=209 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-14T11:37:13.419 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-14T11:37:13.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.782 : miss 2024-09-14T11:37:13.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:13.420 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 20 rados_obj.operate() r=0 bl.length=431 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.782 info.flags=0x17 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.782 to cache LRU end 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.420+0000 7f6a4db46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:17edae97-cd6b-4c90-863d-862429a20cf3.4538.782 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.421+0000 7f6a4db46800 20 bucket index object: :.dir.17edae97-cd6b-4c90-863d-862429a20cf3.4538.782.0 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.421+0000 7f6a4db46800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.421+0000 7f6a4db46800 1 NOTICE: finished all shards (0 entries found) 2024-09-14T11:37:13.421 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.422+0000 7f6901fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:13.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.424+0000 7f6a4db46800 20 remove_watcher() i=0 2024-09-14T11:37:13.423 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.424+0000 7f6a4db46800 2 removed watcher, disabling cache 2024-09-14T11:37:13.424 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.426+0000 7f6a4db46800 20 remove_watcher() i=1 2024-09-14T11:37:13.425 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.427+0000 7f6a4db46800 20 remove_watcher() i=2 2024-09-14T11:37:13.426 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.428+0000 7f6a4db46800 20 remove_watcher() i=3 2024-09-14T11:37:13.427 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.429+0000 7f6a4db46800 20 remove_watcher() i=4 2024-09-14T11:37:13.428 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.430+0000 7f6a4db46800 20 remove_watcher() i=5 2024-09-14T11:37:13.429 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.431+0000 7f6a4db46800 20 remove_watcher() i=6 2024-09-14T11:37:13.430 INFO:tasks.workunit.client.0.smithi002.stderr:2024-09-14T11:37:13.431+0000 7f6a4db46800 20 remove_watcher() i=7 2024-09-14T11:37:13.442 INFO:tasks.workunit.client.0.smithi002.stderr:Deleting bucket versioning-bucket 2024-09-14T11:37:13.445 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:13.445 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:13.449 INFO:tasks.workunit.client.0.smithi002.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-14T11:37:13.449 INFO:tasks.workunit.client.0.smithi002.stderr: warnings.warn( 2024-09-14T11:37:13.464 INFO:tasks.workunit.client.0.smithi002.stderr:Completed bucket versioning tests 2024-09-14T11:37:13.464 INFO:tasks.workunit.client.0.smithi002.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-14T11:37:13.464 INFO:tasks.workunit.client.0.smithi002.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-14T11:37:13.464 INFO:tasks.workunit.client.0.smithi002.stdout:connected to https://localhost:443 2024-09-14T11:37:13.527 INFO:tasks.workunit.client.0.smithi002.stderr:+ deactivate 2024-09-14T11:37:13.527 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ export PATH 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n '' ']' 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ hash -r 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' -n '' ']' 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset VIRTUAL_ENV 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ unset -f deactivate 2024-09-14T11:37:13.528 INFO:tasks.workunit.client.0.smithi002.stderr:+ echo OK. 2024-09-14T11:37:13.532 INFO:tasks.workunit.client.0.smithi002.stdout:OK. 2024-09-14T11:37:13.532 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-14T11:37:13.532 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-14T11:37:13.613 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-14T11:37:13.613 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-14T11:37:14.028 DEBUG:teuthology.parallel:result is None 2024-09-14T11:37:14.028 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:37:14.068 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:37:14.069 DEBUG:teuthology.orchestra.run.smithi002:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-14T11:37:14.138 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-14T11:37:14.138 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-14T11:37:14.151 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-14T11:37:14.194 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-14T11:37:14.194 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-14T11:37:14.194 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-14T11:37:14.258 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-14T11:37:14.259 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-14T11:37:14.318 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:14.318 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:14.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.355+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 20 realm 2024-09-14T11:37:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.357 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.358+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.359+0000 7fa2e2b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:14.358 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.359+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.359+0000 7fa2e2b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:14.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.359+0000 7fa2e2b46800 20 searching for the correct realm 2024-09-14T11:37:14.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.363+0000 7fa2dfe36640 0 -- 172.21.15.2:0/3627653714 >> [v2:172.21.15.86:6802/1990035204,v1:172.21.15.86:6803/1990035204] conn(0x7fa2d001a040 msgr2=0x7fa2d0040970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:14.365 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.367+0000 7fa2e0637640 0 -- 172.21.15.2:0/3627653714 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7fa2d40c9b90 msgr2=0x7fa2d40af5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:14.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.574 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.574+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:14.575 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 zone default found 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 4 Realm: () 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 zonegroup default 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.575+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.576+0000 7fa2e2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.576+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.576+0000 7fa2e2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:14.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.576+0000 7fa2e2b46800 20 started sync module instance, tier type = 2024-09-14T11:37:14.577 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.576+0000 7fa2e2b46800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:37:14.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.585+0000 7fa2e2b46800 20 add_watcher() i=0 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.585+0000 7fa2e2b46800 20 add_watcher() i=1 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.585+0000 7fa2e2b46800 20 add_watcher() i=2 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.585+0000 7fa2e2b46800 20 add_watcher() i=3 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.585+0000 7fa2e2b46800 20 add_watcher() i=4 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.585+0000 7fa2e2b46800 20 add_watcher() i=5 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.585+0000 7fa2e2b46800 20 add_watcher() i=6 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.586+0000 7fa2e2b46800 20 add_watcher() i=7 2024-09-14T11:37:14.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.586+0000 7fa2e2b46800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.588+0000 7fa196fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.588+0000 7fa2e2b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:14.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.588+0000 7fa2e2b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.627+0000 7fa195fdb640 20 reqs_thread_entry: start 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.627+0000 7fa2e2b46800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.627+0000 7fa2e2b46800 20 Filter name: none 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.627+0000 7fa1077fe640 20 reqs_thread_entry: start 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.627+0000 7fa2e2b46800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-14T11:37:14.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.627+0000 7fa2e2b46800 20 rados->read ofs=0 len=0 2024-09-14T11:37:14.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.628+0000 7fa2e2b46800 20 rados_obj.operate() r=0 bl.length=482 2024-09-14T11:37:14.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.628+0000 7fa2e2b46800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-14T11:37:14.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.628+0000 7fa2e2b46800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-14T11:37:14.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.628+0000 7fa2e2b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-14T11:37:14.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.629+0000 7fa2e2b46800 10 removing key index: VEZPFXEBUYOGLTGUXZRK 2024-09-14T11:37:14.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.630+0000 7fa2e2b46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.keys:VEZPFXEBUYOGLTGUXZRK, ofs0, ns] 2024-09-14T11:37:14.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.630+0000 7fa1b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367734 cookie 94444078051008 notifier 8864 bl.length()=170 2024-09-14T11:37:14.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.631+0000 7fa2e2b46800 10 removing email index: tester.client.0_test@test.test 2024-09-14T11:37:14.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.632+0000 7fa2e2b46800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-14T11:37:14.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.632+0000 7fa1b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366363 cookie 94444078047232 notifier 8864 bl.length()=181 2024-09-14T11:37:14.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.633+0000 7fa2e2b46800 10 removing user buckets index 2024-09-14T11:37:14.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.634+0000 7fa2e2b46800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-14T11:37:14.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.634+0000 7fa1b6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871367370 cookie 94444078049440 notifier 8864 bl.length()=172 2024-09-14T11:37:14.634 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.635+0000 7fa2e2b46800 10 removing user index: tester.client.0 2024-09-14T11:37:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.636+0000 7fa2e2b46800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-14T11:37:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.636+0000 7fa2e2b46800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-14T11:37:14.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.636+0000 7fa1b77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1133871366669 cookie 94444078058304 notifier 8864 bl.length()=164 2024-09-14T11:37:14.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.637+0000 7fa196fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:14.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.640+0000 7fa2e2b46800 20 remove_watcher() i=0 2024-09-14T11:37:14.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.640+0000 7fa2e2b46800 2 removed watcher, disabling cache 2024-09-14T11:37:14.640 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.641+0000 7fa2e2b46800 20 remove_watcher() i=1 2024-09-14T11:37:14.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.642+0000 7fa2e2b46800 20 remove_watcher() i=2 2024-09-14T11:37:14.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.643+0000 7fa2e2b46800 20 remove_watcher() i=3 2024-09-14T11:37:14.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.644+0000 7fa2e2b46800 20 remove_watcher() i=4 2024-09-14T11:37:14.644 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.645+0000 7fa2e2b46800 20 remove_watcher() i=5 2024-09-14T11:37:14.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.646+0000 7fa2e2b46800 20 remove_watcher() i=6 2024-09-14T11:37:14.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:14.647+0000 7fa2e2b46800 20 remove_watcher() i=7 2024-09-14T11:37:14.662 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-14T11:37:14.674 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-14T11:37:14.684 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-14T11:37:14.744 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-14T11:37:14.755 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-14T11:37:14.755 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:37:14.756 INFO:tasks.rgw.client.0.smithi002.stdout:2024-09-14T11:37:14.757+0000 7f0a3d398640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 44307) UID: 0 2024-09-14T11:37:14.756 INFO:tasks.rgw.client.0.smithi002.stdout:2024-09-14T11:37:14.757+0000 7f0a40bf3880 -1 shutting down 2024-09-14T11:37:45.263 INFO:tasks.rgw.client.0:Stopped 2024-09-14T11:37:45.263 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-14T11:37:45.300 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /etc/ceph/vault-root-token 2024-09-14T11:37:45.385 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-14T11:37:45.427 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-14T11:37:45.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-14T11:37:45.428 DEBUG:teuthology.orchestra.run.smithi002:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-14T11:37:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setuser ceph since I am not root 2024-09-14T11:37:45.529 INFO:teuthology.orchestra.run.smithi002.stderr:ignoring --setgroup ceph since I am not root 2024-09-14T11:37:45.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.567+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.569+0000 7f676d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.569+0000 7f676d32e800 20 realm 2024-09-14T11:37:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.569+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.569+0000 7f676d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.569+0000 7f676d32e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-14T11:37:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.569+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.570+0000 7f676d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:45.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.570+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.570+0000 7f676d32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:45.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.570+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.571+0000 7f676d32e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-14T11:37:45.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.571+0000 7f676d32e800 20 searching for the correct realm 2024-09-14T11:37:45.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.574+0000 7f67698de640 0 -- 172.21.15.2:0/3458714241 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f6760040020 msgr2=0x7f6760076040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:45.576 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.578+0000 7f67690dd640 0 -- 172.21.15.2:0/3458714241 >> [v2:172.21.15.2:6808/4195093750,v1:172.21.15.2:6809/4195093750] conn(0x7f6760076c20 msgr2=0x7f6760087a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:45.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 RGWRados::pool_iterate: got zonegroup_info.b52584c4-0fad-4fce-bde0-b313ccaf124c 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 RGWRados::pool_iterate: got zone_info.17edae97-cd6b-4c90-863d-862429a20cf3 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:45.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.784+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 zone default found 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 4 Realm: () 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 4 ZoneGroup: default (b52584c4-0fad-4fce-bde0-b313ccaf124c) 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 4 Zone: default (17edae97-cd6b-4c90-863d-862429a20cf3) 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 zonegroup default 2024-09-14T11:37:45.785 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.785+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.786+0000 7f676d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.786+0000 7f676d32e800 20 rados->read ofs=0 len=0 2024-09-14T11:37:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.786+0000 7f676d32e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-14T11:37:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.786+0000 7f676d32e800 20 started sync module instance, tier type = 2024-09-14T11:37:45.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.786+0000 7f676d32e800 20 started zone id=17edae97-cd6b-4c90-863d-862429a20cf3 (name=default) with tier type = 2024-09-14T11:37:45.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.796+0000 7f676d32e800 20 add_watcher() i=0 2024-09-14T11:37:45.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.796+0000 7f676d32e800 20 add_watcher() i=1 2024-09-14T11:37:45.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.796+0000 7f676d32e800 20 add_watcher() i=2 2024-09-14T11:37:45.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.796+0000 7f676d32e800 20 add_watcher() i=3 2024-09-14T11:37:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.796+0000 7f676d32e800 20 add_watcher() i=4 2024-09-14T11:37:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.796+0000 7f676d32e800 20 add_watcher() i=5 2024-09-14T11:37:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.796+0000 7f676d32e800 20 add_watcher() i=6 2024-09-14T11:37:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.797+0000 7f676d32e800 20 add_watcher() i=7 2024-09-14T11:37:45.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.797+0000 7f676d32e800 2 all 8 watchers are set, enabling cache 2024-09-14T11:37:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.799+0000 7f661ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.799+0000 7f676d32e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-14T11:37:45.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.799+0000 7f676d32e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-14T11:37:45.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.837+0000 7f661efe5640 20 reqs_thread_entry: start 2024-09-14T11:37:45.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.837+0000 7f676d32e800 20 init_complete bucket index max shards: 1 2024-09-14T11:37:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.837+0000 7f676d32e800 20 Filter name: none 2024-09-14T11:37:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.837+0000 7f661cfe1640 20 reqs_thread_entry: start 2024-09-14T11:37:45.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.837+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-14T11:37:45.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.839+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:45.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.840+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=99, truncated=0, next_marker='' 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1586343683222628925', time=2024-09-14T13:24:51.580343+0000, chain.objs.size()=1 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.148__shadow_.rk9oPr3qFc2qaFuQ6TtW4ICPlBp2nHB_0 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8237285433096529399', time=2024-09-14T13:26:37.526393+0000, chain.objs.size()=1 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.230__shadow_.ZIp6dRxNFmEs_kNLw-FbR6kpzAAHNYY_0 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1628389246699413857', time=2024-09-14T13:26:42.358948+0000, chain.objs.size()=1 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.239__shadow_.xccg6qOhLuAES9kGqSHZRmRR_9KhptL_0 2024-09-14T11:37:45.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3408979596546382209', time=2024-09-14T13:26:50.353738+0000, chain.objs.size()=1 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.254__shadow_.lIGvJSmT49vLZFKWRCwbxaK3OIAA0lh_0 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5300083298294648497', time=2024-09-14T13:27:01.245677+0000, chain.objs.size()=1 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kjb6ZgmrIX3C51crhy-CoQv3cm3rXHY_0 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17090060986716533244', time=2024-09-14T13:27:01.312513+0000, chain.objs.size()=1 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.b01xdnnvy5Zro-miHG_n_em5eaWr5f7_0 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3557237341249394711', time=2024-09-14T13:27:01.417738+0000, chain.objs.size()=1 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._FOjgMHsR_N9D5B6TzgCMjuu1ud0V74_0 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6147561780983641580', time=2024-09-14T13:27:01.707501+0000, chain.objs.size()=1 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pSqNildgFG0us5Ny71cAGIN-ZVPpK9-_0 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17656845700325472642', time=2024-09-14T13:27:01.959228+0000, chain.objs.size()=1 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XM7PjvoZRH6fnlLG1j33nxEw1buhSTk_0 2024-09-14T11:37:45.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.960907397170459534', time=2024-09-14T13:27:01.996788+0000, chain.objs.size()=1 2024-09-14T11:37:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TyUTZxdPBxatNIu0WfWe6ril6EtgHUb_0 2024-09-14T11:37:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4690027487797839356', time=2024-09-14T13:27:02.139996+0000, chain.objs.size()=1 2024-09-14T11:37:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bPwqPUXNX_hVgTCGhjE4g5nsqcgrEaa_0 2024-09-14T11:37:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5433260330588067272', time=2024-09-14T13:27:02.183706+0000, chain.objs.size()=1 2024-09-14T11:37:45.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.U3fN2WQM_2U002M1K_ZXm42YJinj0DG_0 2024-09-14T11:37:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.843+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16913399780392780807', time=2024-09-14T13:27:02.265305+0000, chain.objs.size()=1 2024-09-14T11:37:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.843+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.i6yuMomVlHKPKH4wWwi4UQa3HEyVEyI_0 2024-09-14T11:37:45.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.843+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7906815732421037043', time=2024-09-14T13:27:02.272865+0000, chain.objs.size()=1 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.843+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ho5L7bM3-SQW1iuWmx7QmuH4mG4xUPM_0 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15409846783749352648', time=2024-09-14T13:27:02.445936+0000, chain.objs.size()=1 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DlmhaUYYSSkpLd56ttQuBHGkWFQfXLg_0 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13738953044136295528', time=2024-09-14T13:27:02.498411+0000, chain.objs.size()=1 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Oa_sDhZXApMwcL8Y0l33unyFSuxaO9I_0 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.651300218864562469', time=2024-09-14T13:27:02.521586+0000, chain.objs.size()=1 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FWgcS-KGJinwGduoAMooWuKTFELkVGB_0 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3188149560835339303', time=2024-09-14T13:27:02.615576+0000, chain.objs.size()=1 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.57ZN_tIGcxEkJFqLGMFMmn_lJwm77Kd_0 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16598637333974097158', time=2024-09-14T13:27:02.668845+0000, chain.objs.size()=1 2024-09-14T11:37:45.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vF-1PCz5xVyJEf5WbTu6MNztz9BspwE_0 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7582098236264301193', time=2024-09-14T13:27:02.674445+0000, chain.objs.size()=1 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KIkt1X79_34sbO2JgnZbDqPQ-END2B-_0 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4663065056963658682', time=2024-09-14T13:27:02.700583+0000, chain.objs.size()=1 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3Zpa7srhAWuxTmSkd5yadXELk0JPn4f_0 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11548957925053218244', time=2024-09-14T13:27:02.889516+0000, chain.objs.size()=1 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TXKJVPCFFMEkQSNX5jQamDyTtkLKkNo_0 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11315786736818123606', time=2024-09-14T13:27:02.901294+0000, chain.objs.size()=1 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VR75v9bsPmvX0F1efIiUpd3qfBjemk2_0 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8902962770207216975', time=2024-09-14T13:27:05.711144+0000, chain.objs.size()=1 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.268__shadow_.P_w0BRTPwcNqIW78XJz0F7q8QMO4Ynd_0 2024-09-14T11:37:45.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11334999865022173246', time=2024-09-14T13:27:12.287736+0000, chain.objs.size()=1 2024-09-14T11:37:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.282__shadow_.Fy4N2wANNuzTEBiA4-3MSF890WsZQNf_0 2024-09-14T11:37:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3839249452267610508', time=2024-09-14T13:27:17.693199+0000, chain.objs.size()=1 2024-09-14T11:37:45.846 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.845+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.EkyubuEYTrXRKOyTgaNGj6isT5KaSk8_0 2024-09-14T11:37:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10316111907695079423', time=2024-09-14T13:27:18.492547+0000, chain.objs.size()=1 2024-09-14T11:37:45.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.FxzapWuiFSoNLcCac9YunJLt8FLpwvZ_0 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7305237792000595493', time=2024-09-14T13:27:18.499950+0000, chain.objs.size()=1 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.jwD7dl4DuDKHUxfn4orLldW03uFwaAJ_0 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2279286356106409631', time=2024-09-14T13:27:22.566452+0000, chain.objs.size()=1 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.301__shadow_.H11ALQWwQ8gdnlNkfB3HrVBHmDm5bLe_0 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1778213605867976607', time=2024-09-14T13:27:40.837177+0000, chain.objs.size()=1 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BlSnfZKz_Mr203kTbX8tUMmy_IOT7Bc_0 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1656200006785093992', time=2024-09-14T13:27:40.883185+0000, chain.objs.size()=1 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Jv3EIv3dTPk1rVnPXXU2eJ8WskFi-B9_0 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4059426480335889274', time=2024-09-14T13:27:40.884028+0000, chain.objs.size()=1 2024-09-14T11:37:45.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ed_0BUTiltyvz0u8iwHT0A5Pk1nU5dy_0 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6961869179245895980', time=2024-09-14T13:27:41.086855+0000, chain.objs.size()=1 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jEyKM88SRob-a00q1dQTAyZkPtxVpHM_0 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12139925851719913964', time=2024-09-14T13:27:41.166214+0000, chain.objs.size()=1 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0p1EPjI6-dOKCj7rfJO74CxKWI6m8y6_0 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8902852380093914157', time=2024-09-14T13:27:41.373672+0000, chain.objs.size()=1 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.c1ez85FoCsKbbxWDqiZCziJo-AjCaGN_0 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9005448524894629188', time=2024-09-14T13:27:41.384236+0000, chain.objs.size()=1 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4ZBllz61oECAPFXcpfdZ2nojVe1Zf0f_0 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2257682054867807733', time=2024-09-14T13:27:41.406772+0000, chain.objs.size()=1 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.847+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lIIUwyuyLlr1injtDr2ofUurfLjAFPt_0 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16382016500083707633', time=2024-09-14T13:27:41.608417+0000, chain.objs.size()=1 2024-09-14T11:37:45.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hWMEY6epRQ0whgtXOEgxUfhfY4LTFfo_0 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.849+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6277478143079026609', time=2024-09-14T13:27:41.637986+0000, chain.objs.size()=1 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.849+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VvOQdJFBB92Qq5cfnV9uwsx5ok63QW8_0 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.849+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11473535325413733764', time=2024-09-14T13:27:41.814621+0000, chain.objs.size()=1 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.849+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.45rJNRlNVwcHlRcdWrURDJvYdDLdTQe_0 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15920028691887352567', time=2024-09-14T13:27:41.830059+0000, chain.objs.size()=1 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yiARaNui8wtMGldvUwy9o5JaoZ5wZq-_0 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3801427238344480127', time=2024-09-14T13:27:41.929453+0000, chain.objs.size()=1 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3yLI0l_Yhy6x4-Y5mqmO6axOgQx8RoY_0 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13419364640209324645', time=2024-09-14T13:27:41.943235+0000, chain.objs.size()=1 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-qsbylh9lPeuwCX_cDMjMcG0sIfUmvu_0 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11236252262226016158', time=2024-09-14T13:27:41.949124+0000, chain.objs.size()=1 2024-09-14T11:37:45.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Z5begR_EJ2JyoZRQvju7KvZTB6UmFuz_0 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8499623972486051473', time=2024-09-14T13:27:42.098445+0000, chain.objs.size()=1 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vXeGZHJeywKfOw419YOc4D6anR-bVn-_0 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16016890819350664355', time=2024-09-14T13:27:42.147941+0000, chain.objs.size()=1 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.M8CgwmzMzbwIIFKfpPigsqdQ6M69z61_0 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7962451297245376739', time=2024-09-14T13:27:42.166509+0000, chain.objs.size()=1 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JZwsPwsRy_jraWcNFTkTC3T03g7PLEn_0 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14037705344244294345', time=2024-09-14T13:27:42.214756+0000, chain.objs.size()=1 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.P5KLvqn_CJAQHS_kv2-7CN5SSq1N020_0 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.521928046269003970', time=2024-09-14T13:27:42.218044+0000, chain.objs.size()=1 2024-09-14T11:37:45.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xrn3S-Sje793ixOJeQ40tFS-Ls6LMww_0 2024-09-14T11:37:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.851+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10753832466845934565', time=2024-09-14T13:27:42.343178+0000, chain.objs.size()=1 2024-09-14T11:37:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QlQlGIS6VshExnpftPiFHd49KsC8yeU_0 2024-09-14T11:37:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15793683049662904065', time=2024-09-14T13:27:42.385132+0000, chain.objs.size()=1 2024-09-14T11:37:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mup7esMZgFJR06OjEFZIYv9_nLfsJQ__0 2024-09-14T11:37:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11504011041219235480', time=2024-09-14T13:27:42.577290+0000, chain.objs.size()=1 2024-09-14T11:37:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OfsZpbhBMBUzTOwuhi9vueABFb4weJA_0 2024-09-14T11:37:45.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5523507048545501968', time=2024-09-14T13:27:42.621449+0000, chain.objs.size()=1 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5H9c0GqBaU6tE6zMI2RO4WD6SVcIRsm_0 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11509413016331579963', time=2024-09-14T13:27:42.627084+0000, chain.objs.size()=1 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.95X6_-nyeqtB07AK_eDBy1zlM-dxZry_0 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8812536381624365228', time=2024-09-14T13:27:42.636162+0000, chain.objs.size()=1 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.oIK-tSMx1ykQZ488Gk7STT3XVG8p87Z_0 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4612966072580057509', time=2024-09-14T13:27:42.684421+0000, chain.objs.size()=1 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._REAqf9Y6KjRpL9VdJ1ELxkaKn-pbJt_0 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16286775310257421987', time=2024-09-14T13:27:50.453750+0000, chain.objs.size()=1 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.S-HQj-ct-qPy8jaXmMaXWYYoc1aDno7_0 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9245429583096654587', time=2024-09-14T13:27:50.530496+0000, chain.objs.size()=1 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.PHlyphwBDE-66vZ0_vveABzoyKF8Vg4_0 2024-09-14T11:37:45.857 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17491798962437415855', time=2024-09-14T13:27:50.732105+0000, chain.objs.size()=1 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.mlyYpHbIib5jQmbmbIMhB1jIShj84yW_0 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16114606835944148421', time=2024-09-14T13:27:50.949108+0000, chain.objs.size()=1 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dzpO-TbJ8HsUlyLNkjHsQ63rTzg2duX_0 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.853+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11636556532284384691', time=2024-09-14T13:27:51.059210+0000, chain.objs.size()=1 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.853+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1ZLsYXXTZeVJ_-pqXbP-KIHuVzdMm0q_0 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9295652237736343124', time=2024-09-14T13:27:51.105705+0000, chain.objs.size()=1 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LRE2y1O8VWkmJPDJalRgWOPSIfh0IvV_0 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11797607085364222526', time=2024-09-14T13:27:51.371374+0000, chain.objs.size()=1 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.33xXaUhkqupDaObRMzA3arv8H6hEXCG_0 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1830879907715786457', time=2024-09-14T13:27:51.455942+0000, chain.objs.size()=1 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.o-lx4Mv7SXT75keh-aTOY8i61hlVbV8_0 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9231483554091481506', time=2024-09-14T13:27:51.475240+0000, chain.objs.size()=1 2024-09-14T11:37:45.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.2AaRkVl-Q2CHlpLrFPX-QXxOBmUN1Ff_0 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12693432533519623167', time=2024-09-14T13:27:51.538427+0000, chain.objs.size()=1 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Wruhrd1k1cA5qc3nUzvsQd3pa5MLLZu_0 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9861539564593417923', time=2024-09-14T13:27:51.571383+0000, chain.objs.size()=1 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5OllHSQ2TSUhbHTFBtPnrlcGwfleFPX_0 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3450751420287923684', time=2024-09-14T13:27:51.589203+0000, chain.objs.size()=1 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.enSfKt27NnhmW687rQTtNwCATE0SN0N_0 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1563582785484983969', time=2024-09-14T13:27:51.623435+0000, chain.objs.size()=1 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lZVI2eafb9Kq11m43bQyLcEKxxILjjZ_0 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4571976445813565359', time=2024-09-14T13:27:51.708081+0000, chain.objs.size()=1 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.XcpNqIkDzgqNt28C2nzbd73WDlri7X7_0 2024-09-14T11:37:45.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8426732217163081918', time=2024-09-14T13:27:51.718555+0000, chain.objs.size()=1 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.H0-BzTZJNRFOIjfUAnhXAYx-MmbzPhP_0 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16508991445840936867', time=2024-09-14T13:27:51.849084+0000, chain.objs.size()=1 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.teqSvhlv5nag1Zkok_LIf9qcxR2nq0S_0 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1637582389046713482', time=2024-09-14T13:27:51.864727+0000, chain.objs.size()=1 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NgjNITjvvozjn6HCZYdum2GVZqcuCN6_0 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11510992444932350068', time=2024-09-14T13:27:51.968589+0000, chain.objs.size()=1 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.K2diLfEnKEVuECL4nzZJ1JgPUQ5JKeU_0 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7165300168433174561', time=2024-09-14T13:27:51.983811+0000, chain.objs.size()=1 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._EpKQ5n2NugGarp7dALc5OpUIs1EqsM_0 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9829919130113878692', time=2024-09-14T13:27:52.056704+0000, chain.objs.size()=1 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gTsMkgK1ddnsjG119LON2rEptICk3je_0 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15274593350447814155', time=2024-09-14T13:27:52.215249+0000, chain.objs.size()=1 2024-09-14T11:37:45.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fHPWRqsR1OsvCYc5zyxxCmOf8XMwKxI_0 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13649048090138487129', time=2024-09-14T13:27:52.216024+0000, chain.objs.size()=1 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YDZUhsc13blRuK0c1UAnYbhp-_3Lgok_0 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11490389632677572397', time=2024-09-14T13:27:52.251552+0000, chain.objs.size()=1 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qQRNelGOMROpnNo4K0d6eTTcFPlhmsO_0 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1296394348252107811', time=2024-09-14T13:27:52.321433+0000, chain.objs.size()=1 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jhTEcTLI2AGpeZNg6l_QYboZClF3zFV_0 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12296463441187488409', time=2024-09-14T13:27:52.334315+0000, chain.objs.size()=1 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TdviX2KT5ORFzvG30DuXrnwrzZVaCfq_0 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2463552037629742782', time=2024-09-14T13:28:45.933297+0000, chain.objs.size()=1 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.434__shadow_.o8Nhvhunv9UlahbnsyVZU-b7Kwf7Nc1_0 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5472557265284880384', time=2024-09-14T13:28:57.493317+0000, chain.objs.size()=1 2024-09-14T11:37:45.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.455__shadow_.G9ACDeIk_pBvVsvz4fdfivdi_la4p9c_0 2024-09-14T11:37:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14771536554605726325', time=2024-09-14T13:29:00.389256+0000, chain.objs.size()=1 2024-09-14T11:37:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.857+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.459__shadow_.QvKabS-guqTRQ9fBfjSRxlZity88W8b_0 2024-09-14T11:37:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.858+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7922599667476521021', time=2024-09-14T13:29:05.062037+0000, chain.objs.size()=1 2024-09-14T11:37:45.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.858+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.466__shadow_.w655WqclQ_CvLZ5LblKZFqjL1BuUy-g_0 2024-09-14T11:37:45.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.859+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11190840384413929404', time=2024-09-14T13:29:15.010019+0000, chain.objs.size()=1 2024-09-14T11:37:45.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.859+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.491__shadow_.Rl16BevSL4QYhkmQbeCvy1UOQ8x6bXY_0 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.859+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10063294811932126608', time=2024-09-14T13:29:22.525937+0000, chain.objs.size()=6 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.859+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.1 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.859+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.2 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.859+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.3 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.4 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.5 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.6 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12783813618432901620', time=2024-09-14T13:29:47.555346+0000, chain.objs.size()=2 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~KieLCyXv5Lb8CjLhO_Rnvmp6_MLfcbf.1 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~KieLCyXv5Lb8CjLhO_Rnvmp6_MLfcbf.2 2024-09-14T11:37:45.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14272821613834807751', time=2024-09-14T13:30:43.387753+0000, chain.objs.size()=1 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:we6Le1ZiVr1IL60AOI7b0Hm7TnYLwic_._5WU7xxvmHh-mJLEXNB-ahRkJ4b8bi5_0 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13493314325123007367', time=2024-09-14T13:30:43.982744+0000, chain.objs.size()=1 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.860+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:Y9D.-OjmPCQ13ZKq4nE79k2-SiDWvH2_.PY9Z1b7LNzV-CjZ6eNXd8mY07RdGnMr_0 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.861+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16057447701153338409', time=2024-09-14T13:31:15.265160+0000, chain.objs.size()=1 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.861+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:J1Jlm04csfePGI40.GEn38yV7ngfCj1_.g1iO0sCK7u1os0SlZZMGZVOFAv5JhHB_0 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.861+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8390451116137622410', time=2024-09-14T13:31:15.280664+0000, chain.objs.size()=1 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.861+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:jeOKx-mjkQgrtZ6.9zybg6lHcPll7ZN_.zbhXmT6kqeg31mAzl5dJrw2Mj4prnsM_0 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.861+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4862327786426420327', time=2024-09-14T13:31:19.216534+0000, chain.objs.size()=1 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.861+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:CT86v2h3m0TPbkmV44sLVItjq3PNu4U_.Bw8TJiRLV_Qp6lml7KhGmgYPJhGHuQi_0 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1371649636131282255', time=2024-09-14T13:31:27.849839+0000, chain.objs.size()=1 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.607__shadow_.p5kDE8E6YJ8MrgtGc55gXcGvBKXSAx6_0 2024-09-14T11:37:45.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3226690386392606133', time=2024-09-14T13:31:33.486718+0000, chain.objs.size()=6 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.613__multipart_multipart_enc.2~H-rZN8UeVSUb-vIkAd3MqvYB66lIJFi.1 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.613__multipart_multipart_enc.2~H-rZN8UeVSUb-vIkAd3MqvYB66lIJFi.2 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.613__multipart_multipart_enc.2~H-rZN8UeVSUb-vIkAd3MqvYB66lIJFi.3 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.613__multipart_multipart_enc.2~H-rZN8UeVSUb-vIkAd3MqvYB66lIJFi.4 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.613__multipart_multipart_enc.2~H-rZN8UeVSUb-vIkAd3MqvYB66lIJFi.5 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.613__multipart_multipart_enc.2~H-rZN8UeVSUb-vIkAd3MqvYB66lIJFi.6 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.521435508450072996', time=2024-09-14T13:34:05.253136+0000, chain.objs.size()=1 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.862+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.664__shadow_.ccSLbOARSnR5LxYCkeCMkFMTfLKQnU2_0 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12699733941951747152', time=2024-09-14T13:34:05.837442+0000, chain.objs.size()=1 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.665__shadow_.tuIiZW9-dUWkd38oKxHfRQoF8DjXnPA_0 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9837957653810035666', time=2024-09-14T13:34:58.593095+0000, chain.objs.size()=1 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.740__shadow_.ckLBDgVpV_FmItqbkAMZPbKwkvNx-gC_0 2024-09-14T11:37:45.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6197144046693210999', time=2024-09-14T13:35:30.182810+0000, chain.objs.size()=1 2024-09-14T11:37:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.769__shadow_.jEfA0wqutcAIXxPInsQEmYklq2mRywC_0 2024-09-14T11:37:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.866+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:45.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.869+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-14T11:37:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.870+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:45.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.870+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47697' 2024-09-14T11:37:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3258448129903626537', time=2024-09-14T13:26:37.526668+0000, chain.objs.size()=1 2024-09-14T11:37:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.230__shadow_.oKX_B-20T5heywBdObrkfR3JtE9xrFi_0 2024-09-14T11:37:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12608531036532544264', time=2024-09-14T13:26:44.625679+0000, chain.objs.size()=1 2024-09-14T11:37:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.243__shadow_.dXUFsprIsyovqQErskhPN_yEEiBR_aF_0 2024-09-14T11:37:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6516249555078301684', time=2024-09-14T13:26:45.937742+0000, chain.objs.size()=1 2024-09-14T11:37:45.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.245__shadow_.-Tw7NHRlKsUAPb0EQdI4tQvX5XQK6EH_0 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15143766330047764987', time=2024-09-14T13:26:47.854431+0000, chain.objs.size()=1 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.249__shadow_.e9sHcuiV3Q7hro7VI1mrqTTM0krx05L_0 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8781654824740737407', time=2024-09-14T13:27:01.457397+0000, chain.objs.size()=1 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.mtZvwsDcY-OJ-XU-k7ymyn7ZWxKpR5u_0 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1859401477566457292', time=2024-09-14T13:27:01.461255+0000, chain.objs.size()=1 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.W3vu_hdbSgKGCUn5Sx6JqDzzy86iCRQ_0 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15084454010370121436', time=2024-09-14T13:27:01.482069+0000, chain.objs.size()=1 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nGw9IOM0za6D4WDKX5Vi1wVw0YAccF0_0 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12746848929358210446', time=2024-09-14T13:27:01.679018+0000, chain.objs.size()=1 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kjzosTpFumkvYD12OKHZixv0ccl1YcU_0 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9106517732448163599', time=2024-09-14T13:27:01.756619+0000, chain.objs.size()=1 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.AD00f57KJwqs-P244g4dUeeoM7ZUz53_0 2024-09-14T11:37:45.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17186455835261242244', time=2024-09-14T13:27:01.774932+0000, chain.objs.size()=1 2024-09-14T11:37:45.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.mI_emU9pdkhoZxM_4XjKzsTgx5zxjg7_0 2024-09-14T11:37:45.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.854696042731923175', time=2024-09-14T13:27:01.794527+0000, chain.objs.size()=1 2024-09-14T11:37:45.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.muix9yqrPvyH9PgYIyLubK2e-X9dX9S_0 2024-09-14T11:37:45.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1110347564212962872', time=2024-09-14T13:27:01.900796+0000, chain.objs.size()=1 2024-09-14T11:37:45.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9PV30dzX3FbXQvRX8KE88Ox7ML29fYi_0 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.873+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5695249692846399293', time=2024-09-14T13:27:01.969575+0000, chain.objs.size()=1 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.873+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZScEermyv2MVhuAqCIE6SJTtkNIbrbf_0 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9050051647593581171', time=2024-09-14T13:27:02.008747+0000, chain.objs.size()=1 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yG2Ppn6nfIsEGfjCaHTsHFSHhsmaGNv_0 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11623342038571074213', time=2024-09-14T13:27:02.032733+0000, chain.objs.size()=1 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7WvaffomRJRZ7ZYMIGqU6_tHehn0dl2_0 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11587494101272004329', time=2024-09-14T13:27:02.202844+0000, chain.objs.size()=1 2024-09-14T11:37:45.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kudyh3cNJTGn6buaWK7ZWud5LxMbiHH_0 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6777064799381394620', time=2024-09-14T13:27:02.207854+0000, chain.objs.size()=1 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QKfqmaNmAfGDSZSryZkL7hCQV2M4JN1_0 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13022346649291875077', time=2024-09-14T13:27:02.211072+0000, chain.objs.size()=1 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kqbLvkMNXAHPVENsyx1IUSTVDtmYrwn_0 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4980649147177716151', time=2024-09-14T13:27:02.286821+0000, chain.objs.size()=1 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7J5PyStASK_INivYa57mBQW4MD8EWW2_0 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5819323326836466119', time=2024-09-14T13:27:02.412933+0000, chain.objs.size()=1 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OoPSpWm1fzewedsva6krxh2H0-7AEkU_0 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4936792768368834917', time=2024-09-14T13:27:02.420330+0000, chain.objs.size()=1 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5pWvbbrPPghrkg5BcftjasWogfHUFUk_0 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4695657783010863152', time=2024-09-14T13:27:02.625260+0000, chain.objs.size()=1 2024-09-14T11:37:45.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZIlNkVhPud2OShbae1GdiZ5eToQS7ix_0 2024-09-14T11:37:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17092587630522162101', time=2024-09-14T13:27:02.642243+0000, chain.objs.size()=1 2024-09-14T11:37:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VZeeq7tzSNJ-ejGOrLJUDz2KQrGoTzd_0 2024-09-14T11:37:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10746999809751713828', time=2024-09-14T13:27:02.673283+0000, chain.objs.size()=1 2024-09-14T11:37:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FI5trn6yPYwsA2nloHb0KjTcHMb2Dih_0 2024-09-14T11:37:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.875+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7861115374430580634', time=2024-09-14T13:27:02.677702+0000, chain.objs.size()=1 2024-09-14T11:37:45.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.875+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bQ7aM8H4JMxWWueDBggvEKR5soNLfn1_0 2024-09-14T11:37:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18166388379183598063', time=2024-09-14T13:27:02.683502+0000, chain.objs.size()=1 2024-09-14T11:37:45.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.E9e4inifPwusfIp1svOF8iTVR5uKlBG_0 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11345503942578572586', time=2024-09-14T13:27:02.698899+0000, chain.objs.size()=1 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-RlZjqHWqi__J7J311Uu9w2NClYfr0y_0 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1829883630715561661', time=2024-09-14T13:27:02.756173+0000, chain.objs.size()=1 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IfFO47jEi9RfvggF_T5mNQrtTtdLR_f_0 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17607579273950044098', time=2024-09-14T13:27:02.832353+0000, chain.objs.size()=1 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1FO8in9xT141j3TyYaEURm9xJtE6HlJ_0 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16649532796210760107', time=2024-09-14T13:27:02.834581+0000, chain.objs.size()=1 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BKIOMU8KlHfcpcXEymfYEURL-LogOMV_0 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4913686732948368807', time=2024-09-14T13:27:02.866633+0000, chain.objs.size()=1 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eIZS7jwiZcu3kFHaeS0Ao1_PrNnV7pI_0 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7694652896868799567', time=2024-09-14T13:27:02.875053+0000, chain.objs.size()=1 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZJ5Ahu4jTjiFQscl5BMl1I8cOvdCGOI_0 2024-09-14T11:37:45.878 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3381349136303751854', time=2024-09-14T13:27:02.911336+0000, chain.objs.size()=1 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6381NcusIbcXD8GUKD9ymfYDVdqnir-_0 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16050734062829223838', time=2024-09-14T13:27:04.830569+0000, chain.objs.size()=1 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.266__shadow_.uCTtAq1YS5WsHu30P6IDg91OV2mPrXV_0 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11915986772227838636', time=2024-09-14T13:27:06.180289+0000, chain.objs.size()=1 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.269__shadow_.kD4fUG8VfjSpAs13JYtR17MkV6f6X41_0 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.877+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3550208394023751156', time=2024-09-14T13:27:06.650694+0000, chain.objs.size()=1 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.877+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.270__shadow_.Sc4YWw-q_WvANp5WS8IQRtcRwdCpv4y_0 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.413077813208646809', time=2024-09-14T13:27:17.692168+0000, chain.objs.size()=1 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.-2dVIB-0MnpKkyUdIiwN9z8LJpn_j_J_0 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4590965606900353917', time=2024-09-14T13:27:17.692805+0000, chain.objs.size()=1 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.mnk6Rv1gAQ6oNjj-1A0TIfaz5NZcK44_0 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4884716951835634177', time=2024-09-14T13:27:17.694847+0000, chain.objs.size()=1 2024-09-14T11:37:45.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.MZYIF06Bwnhd_XFtSmkv7ulGt-Czbxk_0 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4696190816245819541', time=2024-09-14T13:27:18.485210+0000, chain.objs.size()=1 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.iAG3PYxJmDknPMK27CosWGcj4EBfZKg_0 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14292515786435363909', time=2024-09-14T13:27:19.452570+0000, chain.objs.size()=1 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.295__shadow_.EhF_0g08zRRlshF_XNwQSaC4_tDC8LB_0 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14213112287895884931', time=2024-09-14T13:27:19.937139+0000, chain.objs.size()=1 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.296__shadow_.I2nVjkAd86O0HqgMghxgv-Uf8mb52Nc_0 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2854227115373813234', time=2024-09-14T13:27:22.566889+0000, chain.objs.size()=1 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.301__shadow_.PJf55ggWJwDl9Qy5qQqMPe0-It3mVfY_0 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4277644328708258521', time=2024-09-14T13:27:24.434342+0000, chain.objs.size()=1 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.305__shadow_.FuYP8LkJzN1X-CIoxMKsNQiSR9g9KDv_0 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1478168469684712766', time=2024-09-14T13:27:30.020794+0000, chain.objs.size()=1 2024-09-14T11:37:45.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.315__shadow_.TXbWX8Lr_v1K7ByVAhPQWWimIa1RLWv_0 2024-09-14T11:37:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7067732344403450666', time=2024-09-14T13:27:40.799371+0000, chain.objs.size()=1 2024-09-14T11:37:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HUa-PSNvkbBgr2jbLiAAZHMP7epBs0r_0 2024-09-14T11:37:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9657554891806810099', time=2024-09-14T13:27:40.802182+0000, chain.objs.size()=1 2024-09-14T11:37:45.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8tI-6q_ZeDPy3lU1msyGcRhuVPEsf0l_0 2024-09-14T11:37:45.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.880+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16186086590391682369', time=2024-09-14T13:27:41.038414+0000, chain.objs.size()=1 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.880+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6xMHHoZgzU68RAG9BdlI5Y8XepL2pce_0 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12613453096833620507', time=2024-09-14T13:27:41.040615+0000, chain.objs.size()=1 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.y9Pz1ttgICX_Xr2wNKX6x7nBDGHm3Cq_0 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18062199995941910782', time=2024-09-14T13:27:41.050972+0000, chain.objs.size()=1 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t3cOIb6n1vfJwQt1n1lqtqYOCInU45I_0 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14244810779721906612', time=2024-09-14T13:27:41.106921+0000, chain.objs.size()=1 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Py8r4VEP-vcfwIl6AEIIy5GTx6x-yK9_0 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.577957091158862303', time=2024-09-14T13:27:41.189764+0000, chain.objs.size()=1 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0fJnWPvIPPaGjeaIdXdk7N6CNkduzQi_0 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4457584222758828568', time=2024-09-14T13:27:41.297857+0000, chain.objs.size()=1 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ZdZTJjuZszgepoNOxTSvK1w01FeRXCR_0 2024-09-14T11:37:45.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14214065198271961845', time=2024-09-14T13:27:41.589060+0000, chain.objs.size()=1 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qihm2WIcJ07RUwGXNZrN8VDeffMysGh_0 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12171677225744573964', time=2024-09-14T13:27:41.610953+0000, chain.objs.size()=1 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PKk8MhUpeJsVgn9JFqhdI9TtsSjJRXC_0 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7149189776801310076', time=2024-09-14T13:27:41.654104+0000, chain.objs.size()=1 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vxUJGusCKE3fBI8x4AbQHyNrKVZyW1K_0 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13269575076990601854', time=2024-09-14T13:27:41.665429+0000, chain.objs.size()=1 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cz0hTTsNljmJ98Y4JdN13j_Mpb2Q09k_0 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15553199270194816373', time=2024-09-14T13:27:41.675215+0000, chain.objs.size()=1 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._k1sNHON3ZHnd4StJFBkFCrWkOycL7U_0 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1502762718624191000', time=2024-09-14T13:27:41.823810+0000, chain.objs.size()=1 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zFBlae54alqF2g8Hy-yWCrR9z8jjvGl_0 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4990610555664609685', time=2024-09-14T13:27:41.840112+0000, chain.objs.size()=1 2024-09-14T11:37:45.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WgqHYLWSmEQqwIlCu0q-4Jw9D-_6l3T_0 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11214570064703482591', time=2024-09-14T13:27:41.860466+0000, chain.objs.size()=1 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.z7UtJtOXH07ls5o6EfravvNJ4KWaCPq_0 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17447076445155778431', time=2024-09-14T13:27:41.934025+0000, chain.objs.size()=1 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QaDD-csDahPpx8EhhQXy_BOrLKctdp3_0 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7475940459814566731', time=2024-09-14T13:27:42.101177+0000, chain.objs.size()=1 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.d7mfmhMC8zAYQeq5aYfOBlTWKYVbDRn_0 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9348758530214482685', time=2024-09-14T13:27:42.106256+0000, chain.objs.size()=1 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Vr8YDQ1NuyfHcLTGjeS1i4awg-C1NuT_0 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9370258218116017141', time=2024-09-14T13:27:42.172970+0000, chain.objs.size()=1 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.D7SReYQqUUtkEJvjBxIfFCw-ca2h6AH_0 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11419120917394572471', time=2024-09-14T13:27:42.223827+0000, chain.objs.size()=1 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xnj8AcjBEqKi8u3rc6lN_stF7RDk6_y_0 2024-09-14T11:37:45.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14648220479318028362', time=2024-09-14T13:27:42.318583+0000, chain.objs.size()=1 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3Ei6Zwr6N9ZMOWFxO1XkIxQrlTGgpQ1_0 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1967474538802825147', time=2024-09-14T13:27:42.359532+0000, chain.objs.size()=1 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hZM9Uh0hXiGAya7sm9taJRGK0m4TRr7_0 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9266062355130252061', time=2024-09-14T13:27:42.436538+0000, chain.objs.size()=1 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hrmQQjq1O_XewyPPtwaMYIGsNii8Dua_0 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.885+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16223918788044435553', time=2024-09-14T13:27:42.438034+0000, chain.objs.size()=1 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.885+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KAyjFKI2k5x6dZO7qdfJrGgvUDHoGbT_0 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.885+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9574437516721196708', time=2024-09-14T13:27:42.569897+0000, chain.objs.size()=1 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.885+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.u95oQgZHCXPHMpXZzX1hYp3mCwOQ7vp_0 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17106153100972042246', time=2024-09-14T13:27:42.599826+0000, chain.objs.size()=1 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ubp_Z8DMvn0W0axYV_nNrlC1xrPoafa_0 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10212738827295424916', time=2024-09-14T13:27:42.638162+0000, chain.objs.size()=1 2024-09-14T11:37:45.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dgNTF_Xy9jUayNBOouAGFjL6D9spK5O_0 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7041106205697725239', time=2024-09-14T13:27:42.699600+0000, chain.objs.size()=1 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kZyM9R1cqDgrKFTgxySke9lNHM_EidE_0 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13033176148329436578', time=2024-09-14T13:27:42.702445+0000, chain.objs.size()=1 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SdFL883SN8kU1U-oRRhIhx9EdC12tBG_0 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11922997633204650219', time=2024-09-14T13:27:50.464778+0000, chain.objs.size()=1 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ObQwT6neHb7XDwaq6pARzyeW8ikJ1Jz_0 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13822471546536557495', time=2024-09-14T13:27:50.476944+0000, chain.objs.size()=1 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.IwfcKfx33Wb3RaN4n4ZE-HS6OgvDJVy_0 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.334752054951576729', time=2024-09-14T13:27:50.540678+0000, chain.objs.size()=1 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fp7A5rktAaiijanI7bTe0UYCUmFPnNP_0 2024-09-14T11:37:45.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10405689320628778550', time=2024-09-14T13:27:50.568716+0000, chain.objs.size()=1 2024-09-14T11:37:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TtYidUZIFfZmNfSYjGsuA7iHGzbM8UY_0 2024-09-14T11:37:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16050773675622596682', time=2024-09-14T13:27:50.722220+0000, chain.objs.size()=1 2024-09-14T11:37:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.886+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ClswlmtYAV2HyFaaWl6VEzMzLK8jQuH_0 2024-09-14T11:37:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6895961587174106312', time=2024-09-14T13:27:50.756377+0000, chain.objs.size()=1 2024-09-14T11:37:45.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.X56VpiDUpIl4mq8ff8zCU1K4Gq2q1gh_0 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13407112976176666682', time=2024-09-14T13:27:50.788459+0000, chain.objs.size()=1 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.caLyv_6igJrRj6o2HS96zm5eB9NrQ6A_0 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12508277473273631460', time=2024-09-14T13:27:50.961681+0000, chain.objs.size()=1 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bIWWS-fYEXn7BhOdrP9vColLSvwy4aK_0 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9224973419352811380', time=2024-09-14T13:27:51.087766+0000, chain.objs.size()=1 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.D6a7D6qGcrdDHqxJ5dfHqynY_OGEW1r_0 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8125325456170008944', time=2024-09-14T13:27:51.203928+0000, chain.objs.size()=1 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.x_gySOl0BWPDRuwDgEd1QbIeZRwbc9t_0 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.711899378796239881', time=2024-09-14T13:27:51.250704+0000, chain.objs.size()=1 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.888+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-4q2Ph4tHxMKnFauZ9CvBQo6r1HCqYi_0 2024-09-14T11:37:45.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10043931990061483344', time=2024-09-14T13:27:51.511443+0000, chain.objs.size()=1 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TlX3LQ2QYJqEHux0Jb_f-m40Wgc8YFe_0 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16448188494558771114', time=2024-09-14T13:27:51.537233+0000, chain.objs.size()=1 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EbGGPbVO8v9SycnfbJQyCU-hhyVFj7r_0 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2040811232597168125', time=2024-09-14T13:27:51.552247+0000, chain.objs.size()=1 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kW2M2-UYzXd2YL8bDJkpJXlvqK9yT6C_0 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6315786203209693222', time=2024-09-14T13:27:51.563583+0000, chain.objs.size()=1 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3JQU4rwSPVoeGwoMe8lwDYQrI9i-f4n_0 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14906065487826903049', time=2024-09-14T13:27:51.578155+0000, chain.objs.size()=1 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.889+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LSz9OIeNbVZVLrb2-g2BVqp-Qovyi20_0 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3875407462862104962', time=2024-09-14T13:27:51.588017+0000, chain.objs.size()=1 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DbKrDlmsMJfxvtgH5RjTiTenNbrAXqW_0 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11879481734150124388', time=2024-09-14T13:27:51.718108+0000, chain.objs.size()=1 2024-09-14T11:37:45.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tE4fmCky8vHzOconvDbXrmQnlLO2a98_0 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10108088106533694006', time=2024-09-14T13:27:51.734152+0000, chain.objs.size()=1 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.agdP4AdialYLv4nQHI8IhXNtXIEkXQQ_0 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12416275873780916106', time=2024-09-14T13:27:51.806471+0000, chain.objs.size()=1 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aDJKlNDaATC281XJDo7SU-OmlHamJsh_0 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1437901539098218672', time=2024-09-14T13:27:51.817873+0000, chain.objs.size()=1 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.A2nEnvq5kqpKovzK1AQjhhY8EMzObqO_0 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5938726716428575482', time=2024-09-14T13:27:51.869906+0000, chain.objs.size()=1 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.y8oNtso0FNZ_0fGOizdamydsLiDww78_0 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.891+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14742447767607871441', time=2024-09-14T13:27:51.877922+0000, chain.objs.size()=1 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.891+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JfuhpkqDIZm09QsH0EJywk-LRbNFNTP_0 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.891+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8442164657934387056', time=2024-09-14T13:27:52.109982+0000, chain.objs.size()=1 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.891+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pzY7sY1dEAcOa1bU7hLR7OOWUB1Kp2r_0 2024-09-14T11:37:45.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.891+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17262116004285857108', time=2024-09-14T13:27:52.217378+0000, chain.objs.size()=1 2024-09-14T11:37:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.891+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zpmvRgCLd1263FqxewUdPe9MPZ-Q6UC_0 2024-09-14T11:37:45.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.894+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47697 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5732385872717298847', time=2024-09-14T13:28:53.280986+0000, chain.objs.size()=1 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.447__shadow_.aiE982Tx8FtGkAxVt9t83Dsz9Y3yfze_0 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5627436750325088616', time=2024-09-14T13:28:58.945185+0000, chain.objs.size()=1 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.457__shadow_.nMkjxrtDN4TuZnKj_rI3hUbNIsASuoq_0 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8166545456047596668', time=2024-09-14T13:29:00.388564+0000, chain.objs.size()=1 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.459__shadow_.c450gDlQ1Bb4KmkcS85nmvdQTFHc28I_0 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10621267957516773586', time=2024-09-14T13:29:03.762880+0000, chain.objs.size()=1 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.464__shadow_.GjCPH-Hi5qW8830ivMpKgFdse9_Z_qq_0 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1327090945216719648', time=2024-09-14T13:29:04.497516+0000, chain.objs.size()=1 2024-09-14T11:37:45.896 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.465__shadow_.jieyTb5GvU734NCCMbVn94dkrrEVEiC_0 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16873339106487311904', time=2024-09-14T13:29:10.602351+0000, chain.objs.size()=1 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.AhcFwM1uVSqxihJGyfNo0Uig2eVFXzm_0 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15764131727574947070', time=2024-09-14T13:29:11.138838+0000, chain.objs.size()=1 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.484__shadow_.HbAgX_Hm6I-Uj89uX6rCi7o3nWSEb9E_0 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5111458332586503154', time=2024-09-14T13:29:11.139499+0000, chain.objs.size()=1 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.484__shadow_.vsl8aCYnJa65SZ4PItCoQtfH1UNWeQz_0 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17164995523928030802', time=2024-09-14T13:29:44.856924+0000, chain.objs.size()=3 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~ZJFFrr-zw9SbWSyxwlGre7Q4wIhqZEl.1 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~ZJFFrr-zw9SbWSyxwlGre7Q4wIhqZEl.2 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~ZJFFrr-zw9SbWSyxwlGre7Q4wIhqZEl.3 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17479972482019480974', time=2024-09-14T13:30:33.524141+0000, chain.objs.size()=1 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.561__multipart_mymultipart.vnIlko0sG-vxq8bPF_mZB0c8PorGzf9j.1 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.897+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13537668290524384578', time=2024-09-14T13:30:39.977785+0000, chain.objs.size()=1 2024-09-14T11:37:45.897 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.897+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.566__shadow_.5JmT1FPtxyo79-avP0D1OzntkW9vrf3_0 2024-09-14T11:37:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.897+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5554261194227253299', time=2024-09-14T13:30:47.054493+0000, chain.objs.size()=1 2024-09-14T11:37:45.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.897+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:AMSwXTSU6DMwnVldZtC-.9UsgXUy-Qk_.w_T7janJ2goNdjl_-TXDB4LDlO1p6Pz_0 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15012829316822013612', time=2024-09-14T13:30:49.500785+0000, chain.objs.size()=1 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.572__shadow_.2pGzRaWV-nFN2GwrdUKDLkUR7mklQxh_0 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1603949244127472801', time=2024-09-14T13:30:53.826039+0000, chain.objs.size()=1 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.575__shadow:XH.p4v5AqInA.xp.06r3uQtL3QowDKu_._i7cN7EU-VixNbE3gAZIrmhPutDxCwo_0 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6340939001984544003', time=2024-09-14T13:30:55.327747+0000, chain.objs.size()=1 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:2pFp3i32vO.zA9WR9ujetGknFZAxF1Z_.sp0mPHINwl9mihZ5askdLntm0nVhRmF_0 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18118204879304172412', time=2024-09-14T13:30:56.430116+0000, chain.objs.size()=1 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:edhLc3C30gp-VxZoFlYJjjcrNes4MWM_.bQONcdtOUkj1eJxYhI1kuXcMCLkR3N3_0 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11757107936963743730', time=2024-09-14T13:31:04.413664+0000, chain.objs.size()=1 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.898+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:6lxQ3xpjpJqE2qSzAUNWI0dftnOaW26_.ASzjY-F34sRrKZzR2BPEu63BbUS6tAq_0 2024-09-14T11:37:45.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.105523016118302657', time=2024-09-14T13:31:07.534640+0000, chain.objs.size()=1 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:-QThli8HUNwgYAyOPREKxKjgDhjBczp_.SjSLEcFqTqvV4OZd7EwffKqnIch7q_3_0 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12527864605861608286', time=2024-09-14T13:31:15.272593+0000, chain.objs.size()=1 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:J1Jlm04csfePGI40.GEn38yV7ngfCj1_.g1iO0sCK7u1os0SlZZMGZVOFAv5JhHB_0 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12115583974886171837', time=2024-09-14T13:31:17.967980+0000, chain.objs.size()=1 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.585__shadow:znHhI4ntsq26GrsQ1QZ0bR0AwtOrOHm_.1Y5jzrSjUHbRSkEAR2aJXKoMhaaS8dt_0 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4358362477632620904', time=2024-09-14T13:33:47.468299+0000, chain.objs.size()=1 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.630__shadow_.UBVY8uiCOWQhv3Ett_aBZxlCN7TsyQf_0 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8572673601304823323', time=2024-09-14T13:34:07.301418+0000, chain.objs.size()=1 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.668__shadow_.R4Y0pwJHyeQ0ZgLsMdE5nXzwaS-Dk7c_0 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2524263329297573589', time=2024-09-14T13:34:36.945140+0000, chain.objs.size()=1 2024-09-14T11:37:45.900 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.899+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.715__shadow:eqKZf0O-pRDAn8tpksix1liBIpCuqlx_.MfCnLvyvWgMX9gp1EvaYLqxyR-CzoRu_0 2024-09-14T11:37:45.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:45.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.904+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-14T11:37:45.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.905+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:45.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.906+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:45.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43790' 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2097430653279095659', time=2024-09-14T13:26:37.526749+0000, chain.objs.size()=1 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.230__shadow_.SZIezxE-TBysxcV7Ty_6eUagkrtICvg_0 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11813206449198255707', time=2024-09-14T13:26:47.373576+0000, chain.objs.size()=1 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.248__shadow_.t45EkCt97KF05-HBWtjiJW_OIr2svix_0 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6399630333251160838', time=2024-09-14T13:26:49.216208+0000, chain.objs.size()=1 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.252__shadow_.Sc1wwSgRioU88VtLoTfCn2LHstudBqX_0 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12191689737369798289', time=2024-09-14T13:27:01.167556+0000, chain.objs.size()=1 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GSsI931CidvKEA8G_xjHU_22lCdT4pb_0 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13532178171255946710', time=2024-09-14T13:27:01.203318+0000, chain.objs.size()=1 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tDHa3ipEL5_UFUzUqtOAyfZN2hBX0LF_0 2024-09-14T11:37:45.906 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6319690262395962121', time=2024-09-14T13:27:01.244396+0000, chain.objs.size()=1 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.xeSyN5lW164NuP5UU1lTL5KjkqyyHm8_0 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14122423255712630378', time=2024-09-14T13:27:01.252276+0000, chain.objs.size()=1 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Hntl9KYd5TK8CQD8TGFWFwRZpvINFFV_0 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12216534232389597772', time=2024-09-14T13:27:01.537391+0000, chain.objs.size()=1 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Pbjqh8HrtoGb3dOIHLVk193-qZtnwPS_0 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14574765621458742706', time=2024-09-14T13:27:01.559182+0000, chain.objs.size()=1 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3XxZqTLLB1u3aEMbUA-p5iqXS8OSwVz_0 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12312908578747481981', time=2024-09-14T13:27:01.562847+0000, chain.objs.size()=1 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8N8YTTf3vO8nLuUwMlSFfvoDGCQuowC_0 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16276339372890396337', time=2024-09-14T13:27:01.650198+0000, chain.objs.size()=1 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XVb1GFdMHVfsI6pKEkEls92WIEJXwdF_0 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11089551270666507340', time=2024-09-14T13:27:01.659035+0000, chain.objs.size()=1 2024-09-14T11:37:45.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UMXKy1btyMIxJiacuZFk20ZDBjwkCxF_0 2024-09-14T11:37:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12686817635118853889', time=2024-09-14T13:27:01.697661+0000, chain.objs.size()=1 2024-09-14T11:37:45.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PlcIt9MQyZn7x5S86EDzkE8VSO-N5dL_0 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16628984154654909361', time=2024-09-14T13:27:01.770494+0000, chain.objs.size()=1 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nn8HU-3et85-yrtpbTAgF93IxN9FklH_0 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7163782720990478942', time=2024-09-14T13:27:01.782360+0000, chain.objs.size()=1 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.913m2r28TWgbQHGqTiYtXU72X933nWO_0 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3869129810079992063', time=2024-09-14T13:27:01.896205+0000, chain.objs.size()=1 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qykZSrc8U0MGwK2x8zKKCDfX4mKs8O5_0 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11748950600657507272', time=2024-09-14T13:27:02.006540+0000, chain.objs.size()=1 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fyNe5PO51mKyzt5yDFkTBNIpgyecgQQ_0 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7679917944917158364', time=2024-09-14T13:27:02.015059+0000, chain.objs.size()=1 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qQiyqrO-ZGjduRM67Sac468wCBds0hL_0 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5200700151329394259', time=2024-09-14T13:27:02.136835+0000, chain.objs.size()=1 2024-09-14T11:37:45.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6z4gVmbwmSfSXviD7MFTwA5-Do0Uv_T_0 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10062037164799250829', time=2024-09-14T13:27:02.149568+0000, chain.objs.size()=1 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hWKgWtmMV_nq6g7IS94gh5J02Q1GM6n_0 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8524676429302219023', time=2024-09-14T13:27:02.195497+0000, chain.objs.size()=1 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qBuTITOUw5D3gi2JHJd0lPhLqYMCnZu_0 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3685999782631301120', time=2024-09-14T13:27:02.228586+0000, chain.objs.size()=1 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vqtpZuMfmqteQ4rar0UfqUxyqSpF3MJ_0 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11941295494568080388', time=2024-09-14T13:27:02.238165+0000, chain.objs.size()=1 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QNali_E9vPujpuC6YJ2fuG2sH7ccnxJ_0 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1657496485021160917', time=2024-09-14T13:27:02.253598+0000, chain.objs.size()=1 2024-09-14T11:37:45.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vOtz0dqetyboHPCS5arMZ1z2_52o-32_0 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.911+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11871388367587381894', time=2024-09-14T13:27:02.279278+0000, chain.objs.size()=1 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.911+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.svgYuCRyMAsxUAaGANU62GnzzLGs8e8_0 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12621445097079980495', time=2024-09-14T13:27:02.392160+0000, chain.objs.size()=1 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fMGNA7nv_H5sZO86jwADUKgfrYGIjLu_0 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2040490773989552847', time=2024-09-14T13:27:02.430011+0000, chain.objs.size()=1 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pIsizZM20hfAALqDBpEkJXb5R6HpYqW_0 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15224302381671215235', time=2024-09-14T13:27:02.479594+0000, chain.objs.size()=1 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rMp4-XV7x9TjH0bdTlHrgL9Bt8LG6hp_0 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2030074703149217900', time=2024-09-14T13:27:02.513021+0000, chain.objs.size()=1 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aJ6bGo8umA98FuRcbDFoh3ZSNfMRfw0_0 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17301063742523992896', time=2024-09-14T13:27:02.519341+0000, chain.objs.size()=1 2024-09-14T11:37:45.912 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0Js-DPRwFrRy9wmcyO6osrxyvU78psw_0 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.118330745328292240', time=2024-09-14T13:27:02.607525+0000, chain.objs.size()=1 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HENfxSsZerDx2q6AY5YiD4PXWWUh8wB_0 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9169856196712829099', time=2024-09-14T13:27:02.641562+0000, chain.objs.size()=1 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CvwOM5q0lGT88UxvGy7fkc7EuwZxEdl_0 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13137528527590717657', time=2024-09-14T13:27:02.663809+0000, chain.objs.size()=1 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.s5g0n6phzj4Cx0zlkF0cyFJ0RZaPlhr_0 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9515755443329032756', time=2024-09-14T13:27:02.722531+0000, chain.objs.size()=1 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LG4LWfy0N5bZ2i4JBhde4rhRc9Lh-yc_0 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11520475864915881703', time=2024-09-14T13:27:02.735113+0000, chain.objs.size()=1 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4iH8h-ENuKxlZHYTBeKv0M6eiFkrhCf_0 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.913+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10294917540670483854', time=2024-09-14T13:27:02.845958+0000, chain.objs.size()=1 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.913+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rDdiduL7OT97cnKHtMLFxFphD65XvpS_0 2024-09-14T11:37:45.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.913+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12765716185434267200', time=2024-09-14T13:27:02.873713+0000, chain.objs.size()=1 2024-09-14T11:37:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.913+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gHm-rwrnJ8InNlPx774yOXsVC_IoTX7_0 2024-09-14T11:37:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4115257053233864541', time=2024-09-14T13:27:02.929350+0000, chain.objs.size()=1 2024-09-14T11:37:45.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Da5ncM0jGP3vsCKods08AGtXdjPhldK_0 2024-09-14T11:37:45.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17411739660209566125', time=2024-09-14T13:27:02.931090+0000, chain.objs.size()=1 2024-09-14T11:37:45.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FSFcmukZ0bVuAkOG5HKWuhamJGVGRR0_0 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12816435161788684897', time=2024-09-14T13:27:08.530354+0000, chain.objs.size()=1 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.274__shadow_.EnQde0s8EIPZOgYiSElEdQSVIwu9fd__0 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12220120974761414132', time=2024-09-14T13:27:09.458027+0000, chain.objs.size()=1 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.276__shadow_.V0HazoJC_I-vkqmovJilVibfLlW6Ipo_0 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2619437063987130052', time=2024-09-14T13:27:15.209065+0000, chain.objs.size()=1 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.288__shadow_.btqTNO8ZcsZkttu4gZdutJNuu_HtPn5_0 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16082539811565370604', time=2024-09-14T13:27:15.210127+0000, chain.objs.size()=1 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.288__shadow_.Ug3m2zpirsqVJFtsnMwS9Lcr3XqEl-v_0 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.364535616328539762', time=2024-09-14T13:27:18.510391+0000, chain.objs.size()=1 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.1fxuzC-eCxSlr9XaTrg6XTKyHvhTZ-4_0 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16823580981965646315', time=2024-09-14T13:27:19.935514+0000, chain.objs.size()=1 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.296__shadow_.56kt0eziKYo6x8BJc39L_IxY9vhuDtj_0 2024-09-14T11:37:45.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.915+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17054827286087082650', time=2024-09-14T13:27:20.415493+0000, chain.objs.size()=1 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.915+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.297__shadow_.Vh_O7fTCyv-B7nRwWIKJwuL3t-6A-VU_0 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.915+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14017688206903094258', time=2024-09-14T13:27:40.853844+0000, chain.objs.size()=1 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.915+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HV3R3q2kC86WfxKHu_TTh5wXU9ZNJp6_0 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.916+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10038578511951868960', time=2024-09-14T13:27:40.942815+0000, chain.objs.size()=1 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.916+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.u-3y8hzfnXne3ZuV_KcnaajFEOyiXXT_0 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.916+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15855574064262156287', time=2024-09-14T13:27:40.949303+0000, chain.objs.size()=1 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.916+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8Pr9csKIMO1BEHKpp2p8Uyp_jMZtc7q_0 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2463479823631992945', time=2024-09-14T13:27:40.955135+0000, chain.objs.size()=1 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ek4dcqXMi6sda61KQ9fOtCOYN44QjHx_0 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2498347761984288579', time=2024-09-14T13:27:41.065065+0000, chain.objs.size()=1 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.eGI2N-woeGjvT8pae5MeNbKkMfYzYgC_0 2024-09-14T11:37:45.917 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13063516917353972227', time=2024-09-14T13:27:41.167857+0000, chain.objs.size()=1 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tKepMEdXm5c9IKFgTK3qGuh2NG4s6ow_0 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2702042919497308402', time=2024-09-14T13:27:41.293097+0000, chain.objs.size()=1 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qF6Aqvrq_67BgeDPI0dJDygIotbwig8_0 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9043534436840918410', time=2024-09-14T13:27:41.335307+0000, chain.objs.size()=1 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ltXhzJpbbdUaHZJq2uk_lK-mS-JFSK__0 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12219724943465357331', time=2024-09-14T13:27:41.377770+0000, chain.objs.size()=1 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GsSRjq1YBf2tve8mcaR8Zu-grgpl9vo_0 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11873208919686532098', time=2024-09-14T13:27:41.388213+0000, chain.objs.size()=1 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Q6akXW3jS0rQsfr0jb3zb7wwSmEyf4__0 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15309650968925121467', time=2024-09-14T13:27:41.419186+0000, chain.objs.size()=1 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HJv9oJIjmeG3vIkK-pd5Pr6fP8zdZvU_0 2024-09-14T11:37:45.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.526578563727783369', time=2024-09-14T13:27:41.551992+0000, chain.objs.size()=1 2024-09-14T11:37:45.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.K753wpCuDhAjTiqKs4Ap5TeVjQO9BTy_0 2024-09-14T11:37:45.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6394189546363129286', time=2024-09-14T13:27:41.631654+0000, chain.objs.size()=1 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OW8AGicmYxE5qVQsnDGXsInEG8o4RTp_0 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7001395181373546049', time=2024-09-14T13:27:41.712425+0000, chain.objs.size()=1 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.R3MszrHaSx7OS9fbNWf2_FhxPOtTPo6_0 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8477176695714579443', time=2024-09-14T13:27:41.836125+0000, chain.objs.size()=1 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.b0lBHPpJ6OK2vVc2t11l7ns5lLj0FLG_0 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16700028471173057152', time=2024-09-14T13:27:41.859229+0000, chain.objs.size()=1 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ZUUQFePWt8DHgH0v7_MU6b-rkmBCWv8_0 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11582896985707006487', time=2024-09-14T13:27:41.871062+0000, chain.objs.size()=1 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.a_TsH08T39IaGih4i_jrutxAwldqsMf_0 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8151316619794240460', time=2024-09-14T13:27:41.900778+0000, chain.objs.size()=1 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9Mzqx9ia4t5U1zTVbskYZb3foprANry_0 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4574424476070111245', time=2024-09-14T13:27:41.904432+0000, chain.objs.size()=1 2024-09-14T11:37:45.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BWXsoVyeQKXmVsv-G3KCYhtGRALkA6E_0 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10863625433277705067', time=2024-09-14T13:27:41.918793+0000, chain.objs.size()=1 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ObFjmlE3Sb0QJ2m_qGUnCIZfViJ3pIw_0 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6329046339897631762', time=2024-09-14T13:27:41.950715+0000, chain.objs.size()=1 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.b7Gj_7E7vKuSQHPhCaMjhE9jDDoQXPa_0 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2381103102125165595', time=2024-09-14T13:27:42.057870+0000, chain.objs.size()=1 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.h34-Hx7yMIyrayM2P3u0rtaAtKFtvny_0 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13311123077497395792', time=2024-09-14T13:27:42.091972+0000, chain.objs.size()=1 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XZUmve2N1hFYW1RuO0TzNyvoFQJTEwL_0 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13417090647684490785', time=2024-09-14T13:27:42.109135+0000, chain.objs.size()=1 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.pHvHmRpPOhsgXZsJGrTuAh7B3mKeibQ_0 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4720991682646415876', time=2024-09-14T13:27:42.110532+0000, chain.objs.size()=1 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.TRnVhOq2GMMExyIxrqH5ZHLahaOhDEP_0 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.828610852947840701', time=2024-09-14T13:27:42.386170+0000, chain.objs.size()=1 2024-09-14T11:37:45.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0xtVZPNBho3X3cL1GY3Q7Lj2NTu_g9x_0 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17149043759564644421', time=2024-09-14T13:27:42.404223+0000, chain.objs.size()=1 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.f1Cf2H65KcDYPqJBx7rQD1CL8endCjE_0 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12998145354280287689', time=2024-09-14T13:27:42.440943+0000, chain.objs.size()=1 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Mf4T4ba1eP5LtjTZEigHExxO_Jo2btc_0 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5193356764939905185', time=2024-09-14T13:27:42.447022+0000, chain.objs.size()=1 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.920+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GisgYn3gUV6CQlu2PG0bK0BNIymDaFS_0 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.921+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.845320433713633499', time=2024-09-14T13:27:42.475472+0000, chain.objs.size()=1 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.921+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.aPYzjy1PGdkqArII2N4XKApg38nHBsC_0 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.921+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14084291580531687726', time=2024-09-14T13:27:42.560235+0000, chain.objs.size()=1 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.921+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jjbbPLB6NSPLt88y4T9O6BmeCfHcIq0_0 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.921+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12706882820635189398', time=2024-09-14T13:27:42.605093+0000, chain.objs.size()=1 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.921+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VBX-MVMtteDdQUGpJ1KO-97JS2Qzj32_0 2024-09-14T11:37:45.924 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.801119752599607328', time=2024-09-14T13:27:42.627125+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ohYLGysOQaYV1IRKMJWgUVba_vB1o_j_0 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11159630403843489322', time=2024-09-14T13:27:50.545193+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.E8MAf1kzRPLjTqnuqn8ylx56p3eX2V-_0 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15705617451278195532', time=2024-09-14T13:27:50.700419+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Osp_oKb86EIRZV8hETGLF7-nXhdR5fP_0 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6352999063879268047', time=2024-09-14T13:27:50.714770+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ya-DzUtDwaU3LzYBt-Wum63X2MauMC6_0 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6534394662586992704', time=2024-09-14T13:27:50.780988+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8Dn82EEYSDOu33tf4R2ILe5nii1vBNp_0 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3126324637710011803', time=2024-09-14T13:27:50.810939+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-hsO1WFUusDeMy35vmr1i6iQBZ0uIhO_0 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18407187154018131795', time=2024-09-14T13:27:50.814169+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RaUBI1gYn19ULBVI_iuhOwUjpQHKLIC_0 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5488604292768361845', time=2024-09-14T13:27:50.941042+0000, chain.objs.size()=1 2024-09-14T11:37:45.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TnhIqYgRVRfj_aEeQfNPmqUmPmVy5zA_0 2024-09-14T11:37:45.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9370185963315775503', time=2024-09-14T13:27:50.975825+0000, chain.objs.size()=1 2024-09-14T11:37:45.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.IC97OeA7VMWdp1-jCbr9D1LGJGS29vw_0 2024-09-14T11:37:45.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16059520019763096974', time=2024-09-14T13:27:50.999588+0000, chain.objs.size()=1 2024-09-14T11:37:45.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DpdMTTs2cmmcSqra6WFlE7kjQxi9sIY_0 2024-09-14T11:37:45.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4124101379230067023', time=2024-09-14T13:27:51.209152+0000, chain.objs.size()=1 2024-09-14T11:37:45.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.923+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vXfpY-3Gh_mz-YtKAUcgAQ6cpqHz176_0 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3511839834510322627', time=2024-09-14T13:27:51.477189+0000, chain.objs.size()=1 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._MOTE2N_at9Q-Y5VEyDhPbYTS_JIyhC_0 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7068044915241918881', time=2024-09-14T13:27:51.491443+0000, chain.objs.size()=1 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qGYmpak3c-u_5wOpZGteOObOx3a_bXV_0 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17114880959428659920', time=2024-09-14T13:27:51.723428+0000, chain.objs.size()=1 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ua_zDGqcuW5rXS8KJw1ZSnaTbpgvgvG_0 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9447349537277607013', time=2024-09-14T13:27:51.796156+0000, chain.objs.size()=1 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Rd0LbmKOC1Meo3xCsHwwM0wFBB4K8nl_0 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5778295556166927784', time=2024-09-14T13:27:52.048104+0000, chain.objs.size()=1 2024-09-14T11:37:45.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.U0k_JEqRVBaiGlcJLf-rTHyjgp0D-9W_0 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7639535964141395248', time=2024-09-14T13:27:52.225735+0000, chain.objs.size()=1 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DbBhQSeIOiZLNBQw1-e7H8h1r7Y8ttR_0 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16431270161716426739', time=2024-09-14T13:27:52.308902+0000, chain.objs.size()=1 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bHNIexwfm-tMoYyPYQbAM5FVH5ry__g_0 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13658057062846903862', time=2024-09-14T13:27:52.331163+0000, chain.objs.size()=1 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-py7s7RY2fAj1wqcBWhBewOXn3t4NDw_0 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14779605291485773362', time=2024-09-14T13:27:52.333577+0000, chain.objs.size()=1 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.OEuyg7ug6_j1P674ikaGanF_AHewt_q_0 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12453987981060820271', time=2024-09-14T13:27:52.349328+0000, chain.objs.size()=1 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wW2i1GUlVORP8zXR3wVEJzJUw4njpFf_0 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16546042505236380860', time=2024-09-14T13:28:00.259623+0000, chain.objs.size()=1 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.925+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.342__shadow_.6Tiz0k5hUhjYEMZAb_WeoJw4yniyW3U_0 2024-09-14T11:37:45.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/43790 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=19, truncated=0, next_marker='' 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1438219173742738255', time=2024-09-14T13:28:01.109509+0000, chain.objs.size()=1 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.344__shadow_.yut8ELRuTLD_QAl2cxKykAjwUg_TBD2_0 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16421896859113623585', time=2024-09-14T13:28:16.131522+0000, chain.objs.size()=1 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.377__shadow_.UVp8Hyl3dmy6-_jpPU2OUFMJm1bsHrQ_0 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7193689922558522997', time=2024-09-14T13:28:32.415693+0000, chain.objs.size()=1 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.407__shadow_.FRimk_dJjVZWUZpR9EVPfdQ8thLqSeL_0 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9786580311799206788', time=2024-09-14T13:28:59.660698+0000, chain.objs.size()=1 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.458__shadow_.rvmGHF-SZHmxGsgLDq4riZZGMmqNeSZ_0 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15063413148825406760', time=2024-09-14T13:29:01.098911+0000, chain.objs.size()=1 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.460__shadow_.kRJFuxyzT_pwE5ykS_jio4hwp7NJGPQ_0 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10828810926884197332', time=2024-09-14T13:29:03.306892+0000, chain.objs.size()=1 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.463__shadow_.7DA4LaJotIVk7mDNBUFhRIxhWZI04Vw_0 2024-09-14T11:37:45.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10239244401030718017', time=2024-09-14T13:30:26.724940+0000, chain.objs.size()=1 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.550__shadow_.km25PowvoyPa5mYkWSFB82Y7baJsSlu_0 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10630579895294132265', time=2024-09-14T13:30:46.774587+0000, chain.objs.size()=1 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:gruyMCKWLgTaIcZThJ-EChX9WjlE7fp_.Uw9jHAJpVwxi-BYCWFXfPU-LevtcGhy_0 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5693448414563831570', time=2024-09-14T13:30:54.384290+0000, chain.objs.size()=1 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:aQvyVHFAtJrmCx1gIZZpZPRYn-4vEJc_.MOwANDRNMNmb4Us7Eok1H5klTYHMUbn_0 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1058374509871439088', time=2024-09-14T13:31:00.575591+0000, chain.objs.size()=1 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:Hh-37QRgPmKiy5q01pqEdyY40DZ0lZ4_.OHfpRaxnVrxf2t77NQuWAdCpmvdJs_m_0 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14644349964088835323', time=2024-09-14T13:31:06.482965+0000, chain.objs.size()=1 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:hRAR.XP0q6G4sSi9PuaYGWmxG3wpN7y_.a7mcfwW813I2_fYNZtgsyGKdsvuMphq_0 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6071922962408530442', time=2024-09-14T13:31:12.685232+0000, chain.objs.size()=4 2024-09-14T11:37:45.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~OKoWzduTQFf7ohOUWry-iPKwPqy5miv.1 2024-09-14T11:37:45.932 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~OKoWzduTQFf7ohOUWry-iPKwPqy5miv.2 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~OKoWzduTQFf7ohOUWry-iPKwPqy5miv.3 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~OKoWzduTQFf7ohOUWry-iPKwPqy5miv.4 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14163194320620484840', time=2024-09-14T13:31:12.908209+0000, chain.objs.size()=4 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~3fB-RV3Hk5fO96pkRTnA_TyTwgiUuKu.1 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~3fB-RV3Hk5fO96pkRTnA_TyTwgiUuKu.2 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~3fB-RV3Hk5fO96pkRTnA_TyTwgiUuKu.3 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~3fB-RV3Hk5fO96pkRTnA_TyTwgiUuKu.4 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18445618304579763462', time=2024-09-14T13:31:19.145407+0000, chain.objs.size()=1 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:EX-WdBkEwF6kkba7RmaTphaqQJsV01B_.hO8xOw7bFi0YyRNDW1TKTA7SHSWV2Uk_0 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4834665835237130374', time=2024-09-14T13:33:49.365407+0000, chain.objs.size()=1 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.634__shadow_.3G6kD8nN9DKA12j1H5khv6l0y9zd063_0 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11107931797912375291', time=2024-09-14T13:34:06.703223+0000, chain.objs.size()=1 2024-09-14T11:37:45.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.666__shadow_.kA3DHYbDZqa9ZMx5G7I2MpjiLXqOKGj_0 2024-09-14T11:37:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10998619583817032893', time=2024-09-14T13:34:17.372107+0000, chain.objs.size()=1 2024-09-14T11:37:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.932+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.693__shadow:uP7SeKdw9xK1Qd5oY1991ksJbMFAr.q_.P4FdDHMa6LwKGYogXOaaYb7JuJw7-S2_0 2024-09-14T11:37:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.933+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9075079582102075914', time=2024-09-14T13:34:37.434740+0000, chain.objs.size()=1 2024-09-14T11:37:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.933+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.716__shadow:tAQRvjfMsxdz0iYNoL0k1h9Ot3ViqoJ_.wt5K4rJNLlzJ9nhP_NtGhY52j1AJ9AI_0 2024-09-14T11:37:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.934+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12724468003908234757', time=2024-09-14T13:35:20.874119+0000, chain.objs.size()=1 2024-09-14T11:37:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.934+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.759__shadow_.WePQZDZCI7I369htNqglCJ0PvF2phBX_0 2024-09-14T11:37:45.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.935+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:45.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.937+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-14T11:37:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.938+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:45.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.938+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44223' 2024-09-14T11:37:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4848217374851571908', time=2024-09-14T13:24:55.881289+0000, chain.objs.size()=2 2024-09-14T11:37:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.158__shadow_.qjGxXH8eQ2Aku8MDeul8Iyt-fSN4cWq_0 2024-09-14T11:37:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.158__shadow_.qjGxXH8eQ2Aku8MDeul8Iyt-fSN4cWq_1 2024-09-14T11:37:45.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3904142283802776409', time=2024-09-14T13:24:55.886527+0000, chain.objs.size()=2 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.158__shadow_.ZDwXdvAfDCPidNrJaN-Cg8dHbii-MLp_0 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.158__shadow_.ZDwXdvAfDCPidNrJaN-Cg8dHbii-MLp_1 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18020141049242302754', time=2024-09-14T13:26:41.904199+0000, chain.objs.size()=1 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.238__shadow_.ZjbSrqa97Wj026P264s7W0BRcDFaei__0 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7751552847682436556', time=2024-09-14T13:26:47.854230+0000, chain.objs.size()=1 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.249__shadow_.XPyaJBHAGxBEiKc57Q4k_IU18sYdjWm_0 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11211231790281595590', time=2024-09-14T13:27:01.175930+0000, chain.objs.size()=1 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ejufe8HUa7edYWZ0bupMyG7cWjNh2ks_0 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1199215120871889237', time=2024-09-14T13:27:01.225389+0000, chain.objs.size()=1 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HyAFOHm_W5Xdt-b_Am-DQJGJss-Ym9e_0 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4482471051455058040', time=2024-09-14T13:27:01.228250+0000, chain.objs.size()=1 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.A74fPu1z0jANorMYbd4l186w29AdxDx_0 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2024353527864523597', time=2024-09-14T13:27:01.238850+0000, chain.objs.size()=1 2024-09-14T11:37:45.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kKkFPkvCkjts3-2deibPfqMqu9L4Kzx_0 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15932535809688913498', time=2024-09-14T13:27:01.437148+0000, chain.objs.size()=1 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0jGS5xuGUt7w9ecyDDMH2HxD7aydrwF_0 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12179453717877957237', time=2024-09-14T13:27:01.534004+0000, chain.objs.size()=1 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.939+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WKMrP3LPS-9lgIb1RKhJW-FoKZuX7fK_0 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14032502195461407673', time=2024-09-14T13:27:01.539999+0000, chain.objs.size()=1 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.i5vBg5xAN8ecfixbQwSRwewdAXEiiQt_0 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12419726803929067034', time=2024-09-14T13:27:01.564496+0000, chain.objs.size()=1 2024-09-14T11:37:45.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sf4DEDiMUlRQmhWnoSqYToPq11QIATW_0 2024-09-14T11:37:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16662943399665455351', time=2024-09-14T13:27:01.648164+0000, chain.objs.size()=1 2024-09-14T11:37:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EuRKVpyT9BZslxDEJ5yBf_hbVRHdnKV_0 2024-09-14T11:37:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14214474013638215355', time=2024-09-14T13:27:01.687624+0000, chain.objs.size()=1 2024-09-14T11:37:45.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.zLvmrIwo823t7_wv74kFbIha8GpUP6V_0 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18162429148563174335', time=2024-09-14T13:27:01.898490+0000, chain.objs.size()=1 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qlqq7Z5PvALOCDfvyhLKgtgV0TrxvGh_0 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9431232350954309236', time=2024-09-14T13:27:02.006476+0000, chain.objs.size()=1 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nXVgwkluO03aUap5lXS4LxvCrIoejnY_0 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6572598603305679259', time=2024-09-14T13:27:02.025867+0000, chain.objs.size()=1 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.cPYPe--1c9hm6Zb_Ui022UDW9v_nStT_0 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13756053635342102819', time=2024-09-14T13:27:02.037204+0000, chain.objs.size()=1 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.u7L2h2KdMMrcYbgREzF6zo5xV-485sj_0 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11926594080131013686', time=2024-09-14T13:27:02.129789+0000, chain.objs.size()=1 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EF-DAzsdA-5dlu9PyM7WvzyUV5o4qXp_0 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18242236836752931061', time=2024-09-14T13:27:02.137217+0000, chain.objs.size()=1 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pMLldUH3RGw83Kr6iuZRl9b_XpgtqOk_0 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14448496561247948637', time=2024-09-14T13:27:02.138854+0000, chain.objs.size()=1 2024-09-14T11:37:45.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bK7a8ivkEHF_nyTgsZccc1maFwoU07S_0 2024-09-14T11:37:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.944+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11945218771735903184', time=2024-09-14T13:27:02.187345+0000, chain.objs.size()=1 2024-09-14T11:37:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.944+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TZiADaEGy0EsSMhA6Olro2OPxsGq6lw_0 2024-09-14T11:37:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.944+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9669429796212459677', time=2024-09-14T13:27:02.196669+0000, chain.objs.size()=1 2024-09-14T11:37:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.944+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qGEenNIX2vNv2dDCrjCtR75fdPHyXLH_0 2024-09-14T11:37:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13084879921146657333', time=2024-09-14T13:27:02.258235+0000, chain.objs.size()=1 2024-09-14T11:37:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iq7LkArjUdvd92QP8i47GiefN1y0NTk_0 2024-09-14T11:37:45.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7779761284049520490', time=2024-09-14T13:27:02.283037+0000, chain.objs.size()=1 2024-09-14T11:37:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VwD9H3PwhqVBp7fUbNqrwPoeq4HrAVl_0 2024-09-14T11:37:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5156954555626398742', time=2024-09-14T13:27:02.380815+0000, chain.objs.size()=1 2024-09-14T11:37:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EtN1UgJgsM9w0ULRb-foyfvb85w1XDK_0 2024-09-14T11:37:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15225962753859059816', time=2024-09-14T13:27:02.390168+0000, chain.objs.size()=1 2024-09-14T11:37:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.945+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.q2l2ivTsM6eWcQEH8VKxK_RjAqENWah_0 2024-09-14T11:37:45.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6481858039701537712', time=2024-09-14T13:27:02.400460+0000, chain.objs.size()=1 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eZojzJwbOJyoLx3u5aFthf6ZY0kb_oY_0 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.891649047256666382', time=2024-09-14T13:27:02.446553+0000, chain.objs.size()=1 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kkI8vwjrm30OO6hD0X8fkJH3LIv367R_0 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15949384215621490481', time=2024-09-14T13:27:02.453245+0000, chain.objs.size()=1 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lIkBhAE7rWT5SiElbazhiJ1PDd5FWQW_0 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10972306741804911989', time=2024-09-14T13:27:02.495874+0000, chain.objs.size()=1 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LVdmXIzYyM7MsmpAhtNYQ6KVFsoVpln_0 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8917049262922019880', time=2024-09-14T13:27:02.501841+0000, chain.objs.size()=1 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.N3agLoml_uaTC6MyADrGnpzwvZye_to_0 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15592877059802001741', time=2024-09-14T13:27:02.619656+0000, chain.objs.size()=1 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8V_RBsObjdS7cm_fxrcNYpemlf4Vvo9_0 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12726360735645110744', time=2024-09-14T13:27:02.624111+0000, chain.objs.size()=1 2024-09-14T11:37:45.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.xnauB8JoNpFv9c-2TY6hsAFWTah536r_0 2024-09-14T11:37:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16173930762861740437', time=2024-09-14T13:27:02.690310+0000, chain.objs.size()=1 2024-09-14T11:37:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TVPQc8KQsMSExkrYfZACLSar2W43wIe_0 2024-09-14T11:37:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14565388865675211128', time=2024-09-14T13:27:02.694332+0000, chain.objs.size()=1 2024-09-14T11:37:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tnC1ELUnM9oGnkEBsctITPKYExdnIOA_0 2024-09-14T11:37:45.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11740481724313036845', time=2024-09-14T13:27:02.756331+0000, chain.objs.size()=1 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ce4lyWkHFaqXrubL-wRl3QDvRYIqUgD_0 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5191712219830399214', time=2024-09-14T13:27:02.852800+0000, chain.objs.size()=1 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.947+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wqbEhbBvoZdJWeCD_gKqZksg09f6GAC_0 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16009657187414344011', time=2024-09-14T13:27:02.903000+0000, chain.objs.size()=1 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hF7TCoouCVdJNThWkOzffZAoKu5Gsk6_0 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1365469664554791320', time=2024-09-14T13:27:02.948499+0000, chain.objs.size()=1 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WWKWgNa9ARqPOxqC9hIPiQHEfoAm6tz_0 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13623314864941165896', time=2024-09-14T13:27:14.734690+0000, chain.objs.size()=1 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.287__shadow_.8yWkleZQx7AdqOB76cFb6WiSSpylY3i_0 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14882975771262379286', time=2024-09-14T13:27:17.683284+0000, chain.objs.size()=1 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.sEvfNHtFYCzuFJa7c3LnvMMbaPMAVsJ_0 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7190631299940643368', time=2024-09-14T13:27:17.692064+0000, chain.objs.size()=1 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.yfxC2ZiF_Jw58lAEGNCgzZ57Y-lMr_1_0 2024-09-14T11:37:45.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3149325411248273665', time=2024-09-14T13:27:18.504878+0000, chain.objs.size()=1 2024-09-14T11:37:45.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.Ty958fMRzTgNjK3gtKgqjoEDQUhkY4M_0 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13487287109548739228', time=2024-09-14T13:27:18.972469+0000, chain.objs.size()=1 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.294__shadow_.kGc14rmJxm9xZEKYQdb8Wz2uz2tWOS7_0 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4588556512974521374', time=2024-09-14T13:27:23.497000+0000, chain.objs.size()=1 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.303__shadow_.qp4mhEiqT20ayhVgbTbTDgFWqDN5cmn_0 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8814015547723985669', time=2024-09-14T13:27:40.798148+0000, chain.objs.size()=1 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qEUc7sWoo1xcXWjfs9_9Uv1DSlZT6Qz_0 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.894328107759463267', time=2024-09-14T13:27:40.861830+0000, chain.objs.size()=1 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ogEHsN1GrVvNHt_W7mzQoOU9Qg7E2k8_0 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4641988488928911975', time=2024-09-14T13:27:40.867056+0000, chain.objs.size()=1 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.J5Fsw1Vx2hnSMGCnuaKyxH0E8_afdEv_0 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8626947302946803603', time=2024-09-14T13:27:40.905685+0000, chain.objs.size()=1 2024-09-14T11:37:45.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._qcSuDqZArzbtp1lDtlbiaxvqEsOVMT_0 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17377352225083679659', time=2024-09-14T13:27:41.035259+0000, chain.objs.size()=1 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zxDMn6TXAk_O5NxrGOby7BBBc7N3Wxr_0 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12638030724119609327', time=2024-09-14T13:27:41.099429+0000, chain.objs.size()=1 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PpmpO6__SuvnoQoTJyXVyNOvxbX2m5Z_0 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11416863044008155635', time=2024-09-14T13:27:41.153908+0000, chain.objs.size()=1 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.S1mwGRqMnSBVovoRK7M7cvUAEUulSAA_0 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9520851882814409858', time=2024-09-14T13:27:41.176418+0000, chain.objs.size()=1 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JKbeykERKgM1kvpfDiwxrOE2Fw6Jez7_0 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2961049835273846416', time=2024-09-14T13:27:41.300411+0000, chain.objs.size()=1 2024-09-14T11:37:45.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NJzJcxBirfuB4kutaTL40d16Lnj9uxF_0 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1983513775154663124', time=2024-09-14T13:27:41.320509+0000, chain.objs.size()=1 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qUNwFyqTBdFLCautYLo1kgP_YrkvbiK_0 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11740772998389495853', time=2024-09-14T13:27:41.365361+0000, chain.objs.size()=1 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1Vv8oV6EiPygkOD3MgQrk6NEpbr7zdv_0 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9379671758434808156', time=2024-09-14T13:27:41.394716+0000, chain.objs.size()=1 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KwgdQ_rTaWbIBslIHtxW3lDt7zcwUbj_0 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17278668428820998913', time=2024-09-14T13:27:41.435813+0000, chain.objs.size()=1 2024-09-14T11:37:45.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BxeXwC7WzYVRXxj5PLW6msJ9oUXNJLL_0 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6840074674601746590', time=2024-09-14T13:27:41.645827+0000, chain.objs.size()=1 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.84KDUAS9dVBOZB2MlYAA4vjdBcjGHwn_0 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4239827316031208500', time=2024-09-14T13:27:41.692214+0000, chain.objs.size()=1 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.T9uJLLKyUEZRS3uwsl6hEULZue7Chrf_0 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4499124487968990800', time=2024-09-14T13:27:41.851386+0000, chain.objs.size()=1 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0pE4DouDMNjjKVl3SWPyKvKcAz9f-U1_0 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8318781146837463987', time=2024-09-14T13:27:41.917708+0000, chain.objs.size()=1 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.63-woihbg0oaBaHaY1vd1TJTdAVNijK_0 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12102897562271789936', time=2024-09-14T13:27:42.074130+0000, chain.objs.size()=1 2024-09-14T11:37:45.952 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.952+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.iyutOXMIDCPC6LnhZU9AOrkwB3Cc2qe_0 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3313013840067220751', time=2024-09-14T13:27:42.157436+0000, chain.objs.size()=1 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.J1X0luDxPmp4zjK97WLMpt0dHakODnY_0 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2079021083237101336', time=2024-09-14T13:27:42.593569+0000, chain.objs.size()=1 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ne-iUDoMhfHhVzDosSNWHI71yjWaP2V_0 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1147716784390520627', time=2024-09-14T13:27:42.671887+0000, chain.objs.size()=1 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.RBezwWQejujOhjNu5VBFYTqbAuMD43a_0 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18219446329279040141', time=2024-09-14T13:27:50.423553+0000, chain.objs.size()=1 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xlsLgGlXo4gWitJvZwVZzI5614TSn4O_0 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.954+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11321403528548298938', time=2024-09-14T13:27:50.426194+0000, chain.objs.size()=1 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.954+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tKAtVKR3jWRYHfRNLLEvhk6VEMWQ454_0 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.954+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2342529892261067525', time=2024-09-14T13:27:50.432415+0000, chain.objs.size()=1 2024-09-14T11:37:45.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.954+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jHGw390fHlFvvNW5ZYtQS6t4Pk7CmbQ_0 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.954+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18024286380104483009', time=2024-09-14T13:27:50.523796+0000, chain.objs.size()=1 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.954+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NVE2F4fpKi608HGwmtbVsdzKRWTvC_b_0 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17344829962821355831', time=2024-09-14T13:27:50.548446+0000, chain.objs.size()=1 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LDOh3zUWXNFHXAetL4Zh04E5ex_E_iR_0 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16550120982261941966', time=2024-09-14T13:27:50.684956+0000, chain.objs.size()=1 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JPRAs7BMrJZwnDnVo9SDLl3-4WiFkqY_0 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16575004830227542674', time=2024-09-14T13:27:50.705440+0000, chain.objs.size()=1 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.QpVL7ZOgz2bbkwC90_KHHCldWP_9iYS_0 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11931917647854318686', time=2024-09-14T13:27:50.789952+0000, chain.objs.size()=1 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LhHlVphkUW5DZHHJRQTViQoj5vUxXpn_0 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8722120500761246816', time=2024-09-14T13:27:50.955891+0000, chain.objs.size()=1 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.I3B2EVf78hSDq0LhtlpgGiCzd9OiqkF_0 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11653803134193491905', time=2024-09-14T13:27:51.010917+0000, chain.objs.size()=1 2024-09-14T11:37:45.955 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jXvxj9ElY02bdOoXvalTUc1hYA0Ska1_0 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1560493419250619192', time=2024-09-14T13:27:51.021816+0000, chain.objs.size()=1 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.MB7rc9g9QowtctMD4QzlwF6sAVO3mLz_0 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15108125736064949512', time=2024-09-14T13:27:51.049895+0000, chain.objs.size()=1 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SM7X9KAlopPie3qroc6FtiYtIiX7kkE_0 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.956+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9118543004835532237', time=2024-09-14T13:27:51.200543+0000, chain.objs.size()=1 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.956+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.T7qsOybsthZDO04r2fJbOlgdo9xWfgR_0 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.956+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12928439218309503630', time=2024-09-14T13:27:51.201301+0000, chain.objs.size()=1 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.956+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.A0YIl6xz8ocPxUWBBFlrtDe4cu2RSlC_0 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.956+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5461867325859257994', time=2024-09-14T13:27:51.251384+0000, chain.objs.size()=1 2024-09-14T11:37:45.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.956+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.A_HxITJGQ369XLJdlY3LBe4mvTGjEm-_0 2024-09-14T11:37:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1308651129778345273', time=2024-09-14T13:27:51.254310+0000, chain.objs.size()=1 2024-09-14T11:37:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fB7BYV8dtbbq1R5tzU-mDFDl46y7OhG_0 2024-09-14T11:37:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6043426939223248495', time=2024-09-14T13:27:51.323795+0000, chain.objs.size()=1 2024-09-14T11:37:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zuMx2a7FfXvU2MynhAtC0eA-NN34eBs_0 2024-09-14T11:37:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2741263778990573989', time=2024-09-14T13:27:51.449497+0000, chain.objs.size()=1 2024-09-14T11:37:45.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Nucf_WV53zWaTSR5L3gnzW2AjUVB1bX_0 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6681731451720668932', time=2024-09-14T13:27:51.456653+0000, chain.objs.size()=1 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uSFNu3h15G6Id39y4FA3MjldVCzMItp_0 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4965855274256145987', time=2024-09-14T13:27:51.547506+0000, chain.objs.size()=1 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.OMBcxHPJoGDehD-QjkJ9jhHGrzWFlmq_0 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5869062482486630359', time=2024-09-14T13:27:51.565557+0000, chain.objs.size()=1 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4LLPitHhkzq5Vsyprtl0eyJ8NX0nC-P_0 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.958+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.583631234036135453', time=2024-09-14T13:27:51.605242+0000, chain.objs.size()=1 2024-09-14T11:37:45.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.958+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UeLHrzSy3Sj-Co5M72_KhmPXZQJXG9N_0 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11171906573003816468', time=2024-09-14T13:27:51.706527+0000, chain.objs.size()=1 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7i22UHQLR6l1Y3A3x2oEZ6fIXe0ck9P_0 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17869236368495786600', time=2024-09-14T13:27:51.767361+0000, chain.objs.size()=1 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gaJ3QmAuyfPWnxxdXVdnfRXHuCEX53w_0 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7881310326956789574', time=2024-09-14T13:27:51.877711+0000, chain.objs.size()=1 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VmgkKTv_dlOiDRkVl9NUo4oj82DElAC_0 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10669316119770133918', time=2024-09-14T13:27:51.965157+0000, chain.objs.size()=1 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EBUBq5Tba8lZIdqzd8gwY6nBAftjB34_0 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12813102604013003782', time=2024-09-14T13:27:52.134866+0000, chain.objs.size()=1 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zmYv3yNZKRYE1N19GltlEHGmRE2VokD_0 2024-09-14T11:37:45.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12078947819020782415', time=2024-09-14T13:27:52.243038+0000, chain.objs.size()=1 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ax4DuGA6kFBiZGx4BNVea5_dr_LTtgY_0 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3092511570907817876', time=2024-09-14T13:27:52.243884+0000, chain.objs.size()=1 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.66PJNBP9ZYVsMXhruY1HjER1jCY46R4_0 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3533899908360100139', time=2024-09-14T13:27:52.273065+0000, chain.objs.size()=1 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.urRoIZTb8P52aOI090QxLOXImoVuqDo_0 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10946661353671136168', time=2024-09-14T13:27:52.307928+0000, chain.objs.size()=1 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bjgfLah_DlS48zb6IjbFSgV6U8Xcsew_0 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.961+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6470473278651814013', time=2024-09-14T13:27:57.096964+0000, chain.objs.size()=1 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.961+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.335__shadow_.rKfJI_caJfieG0RaaDXWpz5GoZBYGZk_0 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.961+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15182964243498690269', time=2024-09-14T13:28:45.602840+0000, chain.objs.size()=1 2024-09-14T11:37:45.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.961+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.433__shadow_.URl_4YYWkhZMuQDu71bw9ex40s9FLpD_0 2024-09-14T11:37:45.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.963+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44223 2024-09-14T11:37:45.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:37:45.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17167926348793952401', time=2024-09-14T13:29:16.751680+0000, chain.objs.size()=1 2024-09-14T11:37:45.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.496__shadow_.bXpZKQSJSpmROilcV0C-mPkvay7qNnk_0 2024-09-14T11:37:45.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9242134183521311731', time=2024-09-14T13:29:25.700748+0000, chain.objs.size()=1 2024-09-14T11:37:45.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.516__multipart_mymultipartcopy.2~xG13uKNnets3BTvcLRqhoeAFgCxxEL4.1 2024-09-14T11:37:45.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7200845050468300279', time=2024-09-14T13:29:27.556090+0000, chain.objs.size()=2 2024-09-14T11:37:45.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.517__shadow_.PTXcYX52VbEy0d1riJhTF1psKy3Rw2k_0 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.517__shadow_.PTXcYX52VbEy0d1riJhTF1psKy3Rw2k_1 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9919671021016899516', time=2024-09-14T13:29:32.798752+0000, chain.objs.size()=1 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.520__shadow:LjZ7UKeBAAmKg4UlP-9lXiWYlsIKEPX_.nKwAmXMIRmAlC-bduLt379TVL3p_Hvn_0 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15628745370437852430', time=2024-09-14T13:30:47.628701+0000, chain.objs.size()=1 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:JuEPvZp7PqJQ8Qcd8VAZOKuZwHhV6-H_.eryulYFFkjezl90EiZMHCynqTBl4XnN_0 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8841216396205975662', time=2024-09-14T13:30:50.175347+0000, chain.objs.size()=1 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.573__shadow_.fkNzRoP-aCWUpg_8Jts2YXOsvQHxi3H_0 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10447166679108187859', time=2024-09-14T13:31:05.788511+0000, chain.objs.size()=1 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:5k92NxYODUtkQzlzqL6lQ4QJNqkgI5S_.iegNHob9Sc-A3po4ZChtV9s-dgJK_8D_0 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1029702836181588106', time=2024-09-14T13:31:14.036075+0000, chain.objs.size()=1 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:3F93sZycLCBdAMU-Rn.bpUVvpksdXYJ_.NbUw4Fp3IZpsAUyIhIVuWCnhP_qzAtK_0 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17038117804106310690', time=2024-09-14T13:31:23.203037+0000, chain.objs.size()=1 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.596__shadow_.4bXXlEdSdub0NS7npOF7IEMFW6cINjH_0 2024-09-14T11:37:45.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16583213938474700056', time=2024-09-14T13:31:25.680465+0000, chain.objs.size()=1 2024-09-14T11:37:45.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.602__shadow_.7n5W9H6aOsZl2ixx4qB___HI0xniT18_0 2024-09-14T11:37:45.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6458038802200576260', time=2024-09-14T13:31:26.981843+0000, chain.objs.size()=1 2024-09-14T11:37:45.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.605__shadow_.Ap2I9DDYyFtQZtYaxgbzhzgYBmdmQ1T_0 2024-09-14T11:37:45.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.967+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7606886511869724783', time=2024-09-14T13:33:50.861976+0000, chain.objs.size()=1 2024-09-14T11:37:45.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.967+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.637__shadow_.GE9o0NlSjsZAuEl0WymabIZryMBchrn_0 2024-09-14T11:37:45.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.967+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3137810999153684191', time=2024-09-14T13:34:04.587418+0000, chain.objs.size()=1 2024-09-14T11:37:45.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.967+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.663__shadow_.jcaXF6uzHqsqISQsbQQuKD0glXiMmlV_0 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5346476493618804449', time=2024-09-14T13:34:08.576638+0000, chain.objs.size()=1 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.672__shadow_.CeUK0rbBTeTqbxSXsuUfXAY1NdM_Cpf_0 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.357314308897319185', time=2024-09-14T13:34:15.966901+0000, chain.objs.size()=1 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.690__shadow:FYIOk8RHAvWI.UQ3nNxSU-YcYsAucL6_.hAJa7HeeisNJWczImnm9mFK6DVe5uLk_0 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17132541857125176700', time=2024-09-14T13:35:12.483169+0000, chain.objs.size()=1 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.747__shadow_.P5-NU1YSXI_jCc6S8xYaDFuT7U9cTye_0 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4299629729672267511', time=2024-09-14T13:35:19.237302+0000, chain.objs.size()=1 2024-09-14T11:37:45.966 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.968+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.757__shadow_.k06JdM9VYd3-XIGvYKqPaNMTa2xde7B_0 2024-09-14T11:37:45.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.969+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:45.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.971+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-14T11:37:45.970 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.972+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:45.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.973+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48603' 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10135089293308549971', time=2024-09-14T13:25:10.931528+0000, chain.objs.size()=1 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.177__shadow_.g287UqoXV3VkCbojnUao2oKaX-gbBl0_0 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8423673197257618484', time=2024-09-14T13:25:15.691516+0000, chain.objs.size()=1 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.188__shadow_.DOF2QxX3CjlEpafPStMEy5LidACSkf6_0 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7996503810348096972', time=2024-09-14T13:26:48.775061+0000, chain.objs.size()=1 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.251__shadow_.3wguADjcdYdqzxreuKZ6RNMwAsoLQsz_0 2024-09-14T11:37:45.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16686558242368284363', time=2024-09-14T13:27:01.170378+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1Pe78NHca7LDcrVM5JGGuqcdwMAgq9o_0 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4639836057814737439', time=2024-09-14T13:27:01.171106+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kFU7vziwcFpdyPm_Dt8WJbUEUe0bf9w_0 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16727658289313052060', time=2024-09-14T13:27:01.264673+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0Som447kL7PMTNGvZLq_Mj7-5yHO5Vr_0 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14413632247876434473', time=2024-09-14T13:27:01.413283+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BGJDJHJeZeTPyK0Wg5oDOkghWNL4fr4_0 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18178382596566915868', time=2024-09-14T13:27:01.440526+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PfJhvggE87vr5OEUjnCkrXvnG6vrmGZ_0 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7987228994263568851', time=2024-09-14T13:27:01.448585+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CBH9UTD7gyZu2WcQy39hLUks2fpAz5E_0 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13872160985403751139', time=2024-09-14T13:27:01.543592+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bn0QPlskNvqPIzdG7M37Eju4Wnjc9XH_0 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16915894931104266419', time=2024-09-14T13:27:01.678391+0000, chain.objs.size()=1 2024-09-14T11:37:45.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3z9TfwaUZyby8cHmADuus78sOpCWXj2_0 2024-09-14T11:37:45.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13043343291654745224', time=2024-09-14T13:27:01.719498+0000, chain.objs.size()=1 2024-09-14T11:37:45.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XHZ7JDuM1xUgXEIdK6sQVgV5Op4xu9e_0 2024-09-14T11:37:45.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13549533133890411851', time=2024-09-14T13:27:01.721570+0000, chain.objs.size()=1 2024-09-14T11:37:45.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.u1cVOYxNM8FPIl2m32Vl70DYSmPStdg_0 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9168288441924538308', time=2024-09-14T13:27:01.756588+0000, chain.objs.size()=1 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.YHLCHwHigoR8Pwu6EozF43gx8b4M3BC_0 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10915422441974593270', time=2024-09-14T13:27:01.761504+0000, chain.objs.size()=1 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aXUpH549GDtaQjKqsRlT7AJ9j7L8Ay8_0 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.356990227456439696', time=2024-09-14T13:27:01.799073+0000, chain.objs.size()=1 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.L0uhzVIAepjVFfoCaJSQW9995hnYk5w_0 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4550447590560878257', time=2024-09-14T13:27:01.898308+0000, chain.objs.size()=1 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6EStELsyWq1nmBeBeHKCcL3nqvs9dSC_0 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8813129306499472140', time=2024-09-14T13:27:01.905538+0000, chain.objs.size()=1 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.B3haQePH5tLaLwm1BbejvCdvOnh_JHZ_0 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3383374121856025846', time=2024-09-14T13:27:01.958515+0000, chain.objs.size()=1 2024-09-14T11:37:45.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3P-kKvncOJZbi0mEbUmV_ybNPOelOlJ_0 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2805603957726611281', time=2024-09-14T13:27:01.983198+0000, chain.objs.size()=1 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.r4aRVoF7NOuKB7Y5YoBFb3O_2CyETRi_0 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18170566880337775356', time=2024-09-14T13:27:01.985058+0000, chain.objs.size()=1 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.uhvIvNpme7DRcYxFY9R24BIMc7pcX96_0 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1703353518202183653', time=2024-09-14T13:27:02.018608+0000, chain.objs.size()=1 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.18GMcfc8HgDQ2f9KBdx39SlObzZBh8e_0 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13065166455402031423', time=2024-09-14T13:27:02.019302+0000, chain.objs.size()=1 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7M-hSfsqafVy4HQ1EN-vMGCrFXxIItE_0 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6511264199348856913', time=2024-09-14T13:27:02.186127+0000, chain.objs.size()=1 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8YbtD5vNMHVVh24Fmistty8BNRYMdOr_0 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.978+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13697767573918491591', time=2024-09-14T13:27:02.214618+0000, chain.objs.size()=1 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.978+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Cc0tHqOsOrublmzBUV_kT9SPHKkvasL_0 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.978+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16939528484978559226', time=2024-09-14T13:27:02.253565+0000, chain.objs.size()=1 2024-09-14T11:37:45.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.978+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HaH0Ou9GCTykwF77uAG81DKZ3ab8oeH_0 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.978+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4904624128563622046', time=2024-09-14T13:27:02.363680+0000, chain.objs.size()=1 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.978+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.n4HevCBqvGbAEIS1LR15J3sBt-Znz8p_0 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9459348807729507533', time=2024-09-14T13:27:02.416533+0000, chain.objs.size()=1 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XsLsP6J_JTi3HHZmSIRS4ig4us0Aaua_0 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7451747271617206224', time=2024-09-14T13:27:02.458585+0000, chain.objs.size()=1 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Mo3bg_6nzNJHDZ8PG2eL47rKRD4exqe_0 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8467252009485432209', time=2024-09-14T13:27:02.461074+0000, chain.objs.size()=1 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.N_UZ4Z9CmGDEHsujsqgI3rvPK2QdjSd_0 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14468433165174660771', time=2024-09-14T13:27:02.521735+0000, chain.objs.size()=1 2024-09-14T11:37:45.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Zt5nkCeW_5Q6-kOSYnJ9LVp0NvCPRYO_0 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14317636913873517040', time=2024-09-14T13:27:02.601389+0000, chain.objs.size()=1 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nNSb3enehMVA-nMWnUwRxqVkXVxfPmC_0 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.482356173531661015', time=2024-09-14T13:27:02.614791+0000, chain.objs.size()=1 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TTc1w_hH6VPx2Sar9t5YvmM64VZl--A_0 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11032577576834814784', time=2024-09-14T13:27:02.732717+0000, chain.objs.size()=1 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pGmnCgR5TZJodfbYwsy1uD1U8mFGyXb_0 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3951908724061692677', time=2024-09-14T13:27:02.890830+0000, chain.objs.size()=1 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DfYfF7ZlqnGlRB9LsFx87NDcycOgN1M_0 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1561605014877669635', time=2024-09-14T13:27:02.933407+0000, chain.objs.size()=1 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.979+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0m9IhxltL0vnkaCYyJP6SFt-Yd9vTBp_0 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13992392238568042873', time=2024-09-14T13:27:15.654357+0000, chain.objs.size()=1 2024-09-14T11:37:45.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.289__shadow_.ZkFpPheINLDn1kz7DJKQw9zfRsq_Kxt_0 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4440907131527389207', time=2024-09-14T13:27:18.498522+0000, chain.objs.size()=1 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.Xy8wIXJs5_apWtNk6tTGBhbw-C_308B_0 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.569607983062156139', time=2024-09-14T13:27:20.920047+0000, chain.objs.size()=1 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.298__shadow_.Nga8CyhzZGMFSZ2NDdveLlwsqPTvFdl_0 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15184230046838269736', time=2024-09-14T13:27:21.441288+0000, chain.objs.size()=1 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.299__shadow_.WzVFuRGRnvdweoxai6HA7_mG40d3tBg_0 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8589273487747476881', time=2024-09-14T13:27:23.496473+0000, chain.objs.size()=1 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.303__shadow_.Xg2c_lYOKdwMqjzVq_n8qjdIqYTrtei_0 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7516877614554973472', time=2024-09-14T13:27:40.780071+0000, chain.objs.size()=1 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CYNTziab5F6pilHuBHNiuk8Scd0a5qJ_0 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8581010885264018463', time=2024-09-14T13:27:40.783848+0000, chain.objs.size()=1 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.D1o1dNlDCtlN60a2xclu8BeEPuW0rDH_0 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11682455025109153045', time=2024-09-14T13:27:40.825899+0000, chain.objs.size()=1 2024-09-14T11:37:45.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.C4AqJnanQ8fAoPOMxXzSEUtOqyDLxj1_0 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2271688274015694304', time=2024-09-14T13:27:40.894797+0000, chain.objs.size()=1 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._2elpYK92ZbpSDqv-miHrs1l7lKKJpV_0 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1965949648123559430', time=2024-09-14T13:27:40.916170+0000, chain.objs.size()=1 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HUw_eB5yh8YpTEKxfxNSFP-j9n9RdHE_0 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16862731437804060750', time=2024-09-14T13:27:40.935895+0000, chain.objs.size()=1 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.y8FRovdW9App-6lofB5IiVniGRDYIed_0 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11853961903925334118', time=2024-09-14T13:27:41.130704+0000, chain.objs.size()=1 2024-09-14T11:37:45.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.981+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ewjJIMzDIL9qYORt1EUs0fxTQ_7gyd9_0 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16718676390142846298', time=2024-09-14T13:27:41.160674+0000, chain.objs.size()=1 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EMVpJiZHSkiWcn85Brvib0AUs7N91uc_0 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8705385517212595481', time=2024-09-14T13:27:41.179040+0000, chain.objs.size()=1 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HnaihyXV57scMoKq3gTCuHYTONvr8Yb_0 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9476489726846304905', time=2024-09-14T13:27:41.299415+0000, chain.objs.size()=1 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GlhToM5b_RSX4hZupdLKUXO87cMkx9u_0 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13554617669780761168', time=2024-09-14T13:27:41.326105+0000, chain.objs.size()=1 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LpSk_8IJBV5Q_sqUYC_btFdkOWLDWwb_0 2024-09-14T11:37:45.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14058790551673363471', time=2024-09-14T13:27:41.560270+0000, chain.objs.size()=1 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.iBwbSZA-IRZv1DSzuplPcFYV7zKQVYq_0 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10381903356499852686', time=2024-09-14T13:27:41.573525+0000, chain.objs.size()=1 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UEcESzvdNkrzoh_xY74-EPmbj3q7EBI_0 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3292279641587211281', time=2024-09-14T13:27:41.582062+0000, chain.objs.size()=1 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lVtFIBz1aW-TU3Apty6sb62G00PPVv8_0 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4419147211668460664', time=2024-09-14T13:27:41.606824+0000, chain.objs.size()=1 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XDF5Hh2RnlQ-Pe3LCTvAzfOC2J0Yk-6_0 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13465811954692396650', time=2024-09-14T13:27:41.629831+0000, chain.objs.size()=1 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wnxRpD6DUoxiVZuJ4wyRuJNJL2ObBH8_0 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7986311165454908951', time=2024-09-14T13:27:41.642386+0000, chain.objs.size()=1 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EVj2jnW25URnnOIOc7pr2VqhOEMAYpI_0 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16564919510964494234', time=2024-09-14T13:27:41.715414+0000, chain.objs.size()=1 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tENgktn2-WIOnGIJo2j5nwcshNzjp_J_0 2024-09-14T11:37:45.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2691870342999030', time=2024-09-14T13:27:41.717145+0000, chain.objs.size()=1 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sMpZEGKDWxxO-sQs1cgv0rke7HLv4gq_0 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15977641322938858013', time=2024-09-14T13:27:41.870931+0000, chain.objs.size()=1 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.n3-9Xm9utzKwapkRyjICH1NGnkQNgkE_0 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10546622735861321900', time=2024-09-14T13:27:41.913290+0000, chain.objs.size()=1 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DHrJQXO4uo2aEQ190Tb80u7rFkNsNGt_0 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9750951118896296290', time=2024-09-14T13:27:42.058244+0000, chain.objs.size()=1 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.eBFyQR8pNtyp0-jEipg2ONCbg5247Ll_0 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17626392595552240563', time=2024-09-14T13:27:42.068272+0000, chain.objs.size()=1 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FU1PTN_UWemdZK6KeNSFU6T1zyKOdcK_0 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7505769122996043670', time=2024-09-14T13:27:42.069087+0000, chain.objs.size()=1 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xUwCLe50eQ7LUPkD4rytGlwyMWSnkn2_0 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12991279657891597547', time=2024-09-14T13:27:42.134134+0000, chain.objs.size()=1 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.af8fQwYNpNkhG-AZfoTGuuuhW0GEvwd_0 2024-09-14T11:37:45.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11780864065868876065', time=2024-09-14T13:27:42.315298+0000, chain.objs.size()=1 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9kn33Y8HJ-VoybGUuT1k0DEdJUe_2W6_0 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10698580613107569615', time=2024-09-14T13:27:42.340912+0000, chain.objs.size()=1 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KXAdrEG9ae4E6K3lDNVH8TScF8JslZ-_0 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6072655457633095536', time=2024-09-14T13:27:42.351560+0000, chain.objs.size()=1 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7XMAD7UeROm-zNQ_cKJ4ihrUdgBH3fv_0 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4636804072792476822', time=2024-09-14T13:27:42.433602+0000, chain.objs.size()=1 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SEkm6ceU1cR_whSsTklgHa9qFhZYBYx_0 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.987+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10952854491572904446', time=2024-09-14T13:27:42.647896+0000, chain.objs.size()=1 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.987+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VmTl-mqpUipihPP5MpSOOfEjZPUtpF4_0 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.987+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16266626775953487836', time=2024-09-14T13:27:42.657789+0000, chain.objs.size()=1 2024-09-14T11:37:45.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.987+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nrOuMwk79Jk3EvPsxhTMQER3qOfO2_j_0 2024-09-14T11:37:45.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.987+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15129962938022696972', time=2024-09-14T13:27:50.733903+0000, chain.objs.size()=1 2024-09-14T11:37:45.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.987+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CglZlxUkGAj6zmSBrdija5ttgvCQVb9_0 2024-09-14T11:37:45.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1534201298470369285', time=2024-09-14T13:27:50.781782+0000, chain.objs.size()=1 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.IyDYR7HXxywfmPdhmX-5h25D-XWj-Yy_0 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13298134560970728', time=2024-09-14T13:27:50.940658+0000, chain.objs.size()=1 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ti7T4VVo59j1uYIEIZVN6VQ4JVHU_dq_0 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4584082736950541134', time=2024-09-14T13:27:50.953355+0000, chain.objs.size()=1 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uaTnAiM9wlx_0OZt0XOE31BlF6KfI8L_0 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9530742215478810451', time=2024-09-14T13:27:51.072068+0000, chain.objs.size()=1 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rNNq_EyADnGNOWAmGI-O1QQyQQqmqyH_0 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14954374745332856380', time=2024-09-14T13:27:51.222295+0000, chain.objs.size()=1 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fREtB04c-qDavj-rGtSH7c5P77PnJFg_0 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17397731381608761933', time=2024-09-14T13:27:51.222848+0000, chain.objs.size()=1 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.W1TxEp6Qd-CT5aD1KeBflp1GF_YJ4as_0 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18415124936320538086', time=2024-09-14T13:27:51.231413+0000, chain.objs.size()=1 2024-09-14T11:37:45.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cTzCJVhM1-_5o7q0rMZDEmHD9lg9yo5_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.989+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.737889148692694206', time=2024-09-14T13:27:51.235138+0000, chain.objs.size()=1 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.989+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AqpSjE3kj0Mj3yLqHda32yBvHiFwOCG_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.989+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5436224345073473180', time=2024-09-14T13:27:51.328332+0000, chain.objs.size()=1 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.989+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jlKyobdqpa3EyarBef3eUMvl0Grbtxr_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.989+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15898029856160509609', time=2024-09-14T13:27:51.467336+0000, chain.objs.size()=1 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.989+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZjRPCIVYMP7Ypdcf5TPQNxt11FdbH-O_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17110358918331981699', time=2024-09-14T13:27:51.495246+0000, chain.objs.size()=1 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Pp_SrAXItiMjIehfqlPKUp0h9uJdBhX_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3215579990000757714', time=2024-09-14T13:27:51.517009+0000, chain.objs.size()=1 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DNePnoe0BV1ma75rknD967g8HkES73A_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12747558579472939720', time=2024-09-14T13:27:51.528689+0000, chain.objs.size()=1 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iAGZFpHM-FsiY6X-vVHpvfWOF_X7wwd_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15959382664196197359', time=2024-09-14T13:27:51.557004+0000, chain.objs.size()=1 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8zneus7LEKSFQNb1_E2j96DTJDvRDSf_0 2024-09-14T11:37:45.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16035934816861520268', time=2024-09-14T13:27:51.558800+0000, chain.objs.size()=1 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Nw0Ck4TDPcnBl8NDOvL1kRfWPvO131p_0 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9219039746750775467', time=2024-09-14T13:27:51.766537+0000, chain.objs.size()=1 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._-yKtA7j4jsg2do0HW0FeElfCv7qm0U_0 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6172151775724739227', time=2024-09-14T13:27:51.786824+0000, chain.objs.size()=1 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.d38fxB9wsk1vl8kSU2duuFswONX4nwH_0 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7442371059151289255', time=2024-09-14T13:27:51.969374+0000, chain.objs.size()=1 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wXKnIaqJkcWNVlYmBpLYbNYLp3Lmppb_0 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.991+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16114801137490151761', time=2024-09-14T13:27:51.989109+0000, chain.objs.size()=1 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.991+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.scVd3hmN3oighadXptMKIZZ0n4MCjjp_0 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.991+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17080857325912031631', time=2024-09-14T13:27:52.275793+0000, chain.objs.size()=1 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.991+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iLIT213qOmgkx1heh-riR9q1v6h9d_B_0 2024-09-14T11:37:45.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.991+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11893321923595454558', time=2024-09-14T13:28:16.850774+0000, chain.objs.size()=1 2024-09-14T11:37:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.991+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.378__shadow_.SwspuSxS_fCWvV7jlC5MxuW-x7bMvaI_0 2024-09-14T11:37:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4082050730472192581', time=2024-09-14T13:29:03.710318+0000, chain.objs.size()=1 2024-09-14T11:37:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.464__shadow_.uvxVv6Fc8Kr9mlq7waTvi8K5ywrgDUX_0 2024-09-14T11:37:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5140082776298874501', time=2024-09-14T13:29:13.835930+0000, chain.objs.size()=1 2024-09-14T11:37:45.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.489__shadow_.2zCCDF3ZI-q_IIUtQ3876nVWn4IvwlB_0 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11181480559523969278', time=2024-09-14T13:29:24.367533+0000, chain.objs.size()=1 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.513__multipart_mymultipart.2~ZViKJxMZ9yp_z8qUsC-c6nGZ3J-Oshn.1 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17050604640913576683', time=2024-09-14T13:29:46.508557+0000, chain.objs.size()=2 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~b9Y7l7Ma3SBPDh1nbH-w6zQH1S4alWO.1 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~b9Y7l7Ma3SBPDh1nbH-w6zQH1S4alWO.2 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12820091768792755512', time=2024-09-14T13:29:48.871184+0000, chain.objs.size()=4 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.527__multipart_mymultipart.2~BWXTV-IrW5LQEFyczNU8fzmJiR5hxTn.1 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.527__multipart_mymultipart.2~BWXTV-IrW5LQEFyczNU8fzmJiR5hxTn.2 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.527__multipart_mymultipart.2~BWXTV-IrW5LQEFyczNU8fzmJiR5hxTn.3 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.527__multipart_mymultipart.2~BWXTV-IrW5LQEFyczNU8fzmJiR5hxTn.4 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.993+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12978046805196914372', time=2024-09-14T13:31:14.033502+0000, chain.objs.size()=1 2024-09-14T11:37:45.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.993+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:E02HvUKhTALVbq8j1DOEvF-H6.LQvrD_.ob3pHyWZ3lbJGkdcol0hh_n5a6T6CB7_0 2024-09-14T11:37:45.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.996+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48603 2024-09-14T11:37:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-14T11:37:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2918113997566697221', time=2024-09-14T13:31:14.074238+0000, chain.objs.size()=1 2024-09-14T11:37:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:T9rvVBAGhAXxWHfBx4oQFQecj7npALY_.GVkwrEiUrC2cKwociOdg3DcDxyZbmFx_0 2024-09-14T11:37:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1082171550807701526', time=2024-09-14T13:31:14.074779+0000, chain.objs.size()=1 2024-09-14T11:37:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:1JUagqVRZqL-M2CZlEAb68fN1mZPwzy_.4zp-Rut3Nb64NHRqkFdNsfoFHm27s_4_0 2024-09-14T11:37:45.996 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~G1pcp6oLM7KZOD6dQkf23IJ38uc1sJ5', time=2024-09-14T13:33:45.322312+0000, chain.objs.size()=6 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.625__multipart_multipart_enc.2~G1pcp6oLM7KZOD6dQkf23IJ38uc1sJ5.1 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.625__multipart_multipart_enc.2~G1pcp6oLM7KZOD6dQkf23IJ38uc1sJ5.2 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.625__multipart_multipart_enc.2~G1pcp6oLM7KZOD6dQkf23IJ38uc1sJ5.3 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.625__multipart_multipart_enc.2~G1pcp6oLM7KZOD6dQkf23IJ38uc1sJ5.4 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.625__multipart_multipart_enc.2~G1pcp6oLM7KZOD6dQkf23IJ38uc1sJ5.5 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.625__multipart_multipart_enc.2~G1pcp6oLM7KZOD6dQkf23IJ38uc1sJ5.6 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1406421130238216853', time=2024-09-14T13:33:46.152823+0000, chain.objs.size()=1 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.627__shadow_.yLOhXmvQ_NU2VgIXK7PAjsDB9flr42T_0 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2810964522587720565', time=2024-09-14T13:34:23.151798+0000, chain.objs.size()=1 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.706__shadow_.mqDh0xXtsit4UXZ2wAzlfeUPDESLuyL_0 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1596073842418225254', time=2024-09-14T13:35:27.883697+0000, chain.objs.size()=1 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.766__shadow_.MQeUB0VM51dDVY-C2k9JVnNqlnZpf___0 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8894528616797571105', time=2024-09-14T13:35:34.978021+0000, chain.objs.size()=1 2024-09-14T11:37:45.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:45.998+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.774__shadow_.Q9Yl9b6zv_Pc3EbCJJFm9CeJxh1v1zE_0 2024-09-14T11:37:46.000 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.002+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.002 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.005+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-14T11:37:46.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.006+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.006+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/54268' 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3644510615046917570', time=2024-09-14T13:24:56.909083+0000, chain.objs.size()=3 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-LUKEWARM.2~TXDiDEoeZ7xtfsSOGYW1tiyNA2pfknq.1 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-LUKEWARM.2~TXDiDEoeZ7xtfsSOGYW1tiyNA2pfknq.2 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-LUKEWARM.2~TXDiDEoeZ7xtfsSOGYW1tiyNA2pfknq.3 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9244492351621385026', time=2024-09-14T13:25:29.574183+0000, chain.objs.size()=1 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.204__shadow_.ND3xYDLOuRLm7grzIVgwLTbkLLdtS0j_0 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9725318589995233033', time=2024-09-14T13:26:41.099768+0000, chain.objs.size()=1 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.237__shadow_.Hwhs2AUiiXN6tLHHqOmYCgn_t_Bmjgg_0 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11033124085635130554', time=2024-09-14T13:26:41.102070+0000, chain.objs.size()=1 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.237__shadow_.pwPePcO5x-qDsMyu3077NU3nH5idxIr_0 2024-09-14T11:37:46.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8842602545470958055', time=2024-09-14T13:26:44.627973+0000, chain.objs.size()=1 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.243__shadow_.RLXG6ZjCyvzsaT7XfNrxDSCdxCWE2MM_0 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10861924217778744879', time=2024-09-14T13:26:45.454610+0000, chain.objs.size()=1 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.244__shadow_.utwyf1dn-oYvwjp4DuvmD8GjzNQ3voK_0 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9570513603893239824', time=2024-09-14T13:26:50.354423+0000, chain.objs.size()=1 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.254__shadow_.KQfTAW30-iym03zpoix1AzBpZgF0e22_0 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4706414309983031713', time=2024-09-14T13:26:51.788142+0000, chain.objs.size()=1 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.257__shadow_.GcBcxDihj07WP7SDxGAWNVtsBD5THik_0 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12697430322510663704', time=2024-09-14T13:26:52.719212+0000, chain.objs.size()=1 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.007+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.259__shadow_.mU3w1MHTK7bYbCf5TnWO-S9ipcLMJwU_0 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.008+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.446211269132448026', time=2024-09-14T13:27:01.199357+0000, chain.objs.size()=1 2024-09-14T11:37:46.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.008+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FpwbWybl1oRD2nVNO0J98Ndkua_nNHe_0 2024-09-14T11:37:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6958436423394061985', time=2024-09-14T13:27:01.481084+0000, chain.objs.size()=1 2024-09-14T11:37:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VP0necKDQObEAWqMV64txhDZDJ61WIN_0 2024-09-14T11:37:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4198559042490937789', time=2024-09-14T13:27:01.517790+0000, chain.objs.size()=1 2024-09-14T11:37:46.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2kzVE6ABbpP78ZK31L3vnswlF2kb79T_0 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4046117728532678914', time=2024-09-14T13:27:01.545905+0000, chain.objs.size()=1 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.AIGIHbUXhHkjH45e8tz7k9FuhXpjt90_0 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9464131585446186296', time=2024-09-14T13:27:01.552865+0000, chain.objs.size()=1 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.U9tr3CvUxT-YVRQ09dlyGBBPhXqJl0P_0 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3840595649434165289', time=2024-09-14T13:27:01.553897+0000, chain.objs.size()=1 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.dbQfRrcQMWNvbSQVLclnLotNoj3nOtG_0 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9626225879581261133', time=2024-09-14T13:27:01.665415+0000, chain.objs.size()=1 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6MV9K1eupcN66X_lfXEja-1vkIMsIbW_0 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5138465764292676443', time=2024-09-14T13:27:01.686193+0000, chain.objs.size()=1 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.P2JDqvm7SJuNLZLTAz8h-uLD_JLy-eI_0 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16807210205903838774', time=2024-09-14T13:27:01.750061+0000, chain.objs.size()=1 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.djCvSYo-0PTyWZ8TtqdBjs1oVj_EzVq_0 2024-09-14T11:37:46.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12864212429744885191', time=2024-09-14T13:27:01.765556+0000, chain.objs.size()=1 2024-09-14T11:37:46.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Rn19cR1qmV2AlXmf4P-7IzC7FykRiVt_0 2024-09-14T11:37:46.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3892370934016470944', time=2024-09-14T13:27:01.777820+0000, chain.objs.size()=1 2024-09-14T11:37:46.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.uZVyiEqlWgmCwBpWl-OEGS33UVXMt2W_0 2024-09-14T11:37:46.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17439138931290928765', time=2024-09-14T13:27:01.780330+0000, chain.objs.size()=1 2024-09-14T11:37:46.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.010+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FiDElS68Fe-OeEHHfze_jBZp_Ln5NKs_0 2024-09-14T11:37:46.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9647125207961103585', time=2024-09-14T13:27:01.807082+0000, chain.objs.size()=1 2024-09-14T11:37:46.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ePW0IHq9c-DVlzoqspU1E5xNDoN8PSN_0 2024-09-14T11:37:46.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2467770596109869884', time=2024-09-14T13:27:01.921130+0000, chain.objs.size()=1 2024-09-14T11:37:46.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wGiHx3mm10uTvWJnNXr-28hFOXjSZaq_0 2024-09-14T11:37:46.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7175706944891548924', time=2024-09-14T13:27:02.004065+0000, chain.objs.size()=1 2024-09-14T11:37:46.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VOruAW1L1OtsTu9u2QfLV7HgotdXSOC_0 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1225392743370469737', time=2024-09-14T13:27:02.014984+0000, chain.objs.size()=1 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wPAc4RpZr6DvwO86nIXB9F-WS30-132_0 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4911548814642255645', time=2024-09-14T13:27:02.040906+0000, chain.objs.size()=1 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0RBSHZE__LtWPDGD6Bzj9jbwiWnAvsG_0 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13012018748377638951', time=2024-09-14T13:27:02.131614+0000, chain.objs.size()=1 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MG66WNY0vBSfTuOjYQvJ7VnJtrWEIod_0 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1521556409924746592', time=2024-09-14T13:27:02.145110+0000, chain.objs.size()=1 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LEyEG8rDtoS-pCDcnN7qhm0m0RiAf2Q_0 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17769877907048239597', time=2024-09-14T13:27:02.160751+0000, chain.objs.size()=1 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LuSCugcXWtYGNQwfuZAbajWCAp9GcNh_0 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11131095126497426988', time=2024-09-14T13:27:02.219500+0000, chain.objs.size()=1 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VZTLyTdpgKxjt-KLRt2jho6ltcnJQh8_0 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5011606534449856661', time=2024-09-14T13:27:02.244001+0000, chain.objs.size()=1 2024-09-14T11:37:46.012 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.H6QJlWjtwkZS-gvL_EpGgd-9x3qta0b_0 2024-09-14T11:37:46.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13192719364398728324', time=2024-09-14T13:27:02.447847+0000, chain.objs.size()=1 2024-09-14T11:37:46.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.013+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XI5Nl6WJbvMOwmAJrH4B_EvtfwxM9lj_0 2024-09-14T11:37:46.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8274018716112407105', time=2024-09-14T13:27:02.612333+0000, chain.objs.size()=1 2024-09-14T11:37:46.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.x5yuL3LRr-iTFCaO1bEgoZDdsBKjJwF_0 2024-09-14T11:37:46.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2626865384019535276', time=2024-09-14T13:27:02.658169+0000, chain.objs.size()=1 2024-09-14T11:37:46.013 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tNNEJSwZs5fUy2QNbqEZM6FD7T9n4wu_0 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12237158581926418580', time=2024-09-14T13:27:02.711219+0000, chain.objs.size()=1 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9ZSs2Zb6_bnpiZOLnzu_RqCIX0FZ4Pi_0 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7489654822913354725', time=2024-09-14T13:27:02.739304+0000, chain.objs.size()=1 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TnPOxLAIbcfQxwrOAjj2ZoZlQsY7s0M_0 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14764150042112156911', time=2024-09-14T13:27:12.287862+0000, chain.objs.size()=1 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.282__shadow_.n9LqWNR9oCVKW6OtxerN90YS7mEOPdR_0 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4552396314077065313', time=2024-09-14T13:27:12.766869+0000, chain.objs.size()=1 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.283__shadow_.bi0CHsVpdCs9xgwv50HRXQUzmd80JzH_0 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.497558640626954836', time=2024-09-14T13:27:13.248242+0000, chain.objs.size()=1 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.284__shadow_.l29Mc753bDNNNJwplimqM_o4PHNxQlz_0 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18318864884231763443', time=2024-09-14T13:27:13.249907+0000, chain.objs.size()=1 2024-09-14T11:37:46.014 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.015+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.284__shadow_.hQYLJI5CT9AP3NXxR_HDGd1dLjXkav6_0 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.016+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13449099537078505439', time=2024-09-14T13:27:13.778819+0000, chain.objs.size()=1 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.016+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.285__shadow_.v_tv8cahyr9Bk3Q2TtYRkpQk09nlpOi_0 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.016+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15510437169569332590', time=2024-09-14T13:27:16.860063+0000, chain.objs.size()=1 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.016+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.291__shadow_.xGkXE7B6Z3Q5jU-1krYrCpjdIn7VdfJ_0 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.016+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11740919524492921302', time=2024-09-14T13:27:18.511739+0000, chain.objs.size()=1 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.016+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.AnQNP6fws-MKcsqYNyHRBwF0IoLNxjP_0 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4852595434632844679', time=2024-09-14T13:27:20.416632+0000, chain.objs.size()=1 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.297__shadow_.6ogbGU6Vd-dGIg-Wb_DOMM3OxIu7xvF_0 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10673956533239281952', time=2024-09-14T13:27:23.974751+0000, chain.objs.size()=1 2024-09-14T11:37:46.015 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.304__shadow_.QBdrmFbZPfgSozYeCaeXv_YeP2G4_7d_0 2024-09-14T11:37:46.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16611538524551301754', time=2024-09-14T13:27:40.806140+0000, chain.objs.size()=1 2024-09-14T11:37:46.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Hn5z2TfEVK9F1LPgdp19m2_X-2SXvTP_0 2024-09-14T11:37:46.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15594956533883269702', time=2024-09-14T13:27:40.824164+0000, chain.objs.size()=1 2024-09-14T11:37:46.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.v6Lhzk2NnJOOLyvr70TRUKNNpZkxTF9_0 2024-09-14T11:37:46.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13429354941167312841', time=2024-09-14T13:27:40.880775+0000, chain.objs.size()=1 2024-09-14T11:37:46.016 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.665-pNxanCKF3lIAsZRjOcmwcm5nup9_0 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11449513799812601071', time=2024-09-14T13:27:40.940946+0000, chain.objs.size()=1 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PrBEyuWJ1OFcqD6__F4ro1KUf_WBkE1_0 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7670166740217122635', time=2024-09-14T13:27:41.044414+0000, chain.objs.size()=1 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.u4ILtTm3B1kz4ewtdnp89OTkEzlclTu_0 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14582387551542005404', time=2024-09-14T13:27:41.120720+0000, chain.objs.size()=1 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.017+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DbnGc4RtPMOpLVTZqzb4lZ9vZpUd3hz_0 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11386521415983438786', time=2024-09-14T13:27:41.202185+0000, chain.objs.size()=1 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.oa4Zrk3HwufUopAlVw74jKU-AYTHTzu_0 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18076610037517497638', time=2024-09-14T13:27:41.202734+0000, chain.objs.size()=1 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.b6PrVf7cOblnGPIOnsQ5WJMnUdMdNoH_0 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10671156613558490680', time=2024-09-14T13:27:41.400183+0000, chain.objs.size()=1 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kgPhksmflvVim3W8ZlzgO9ktqPVJixX_0 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.643380494893465455', time=2024-09-14T13:27:41.574763+0000, chain.objs.size()=1 2024-09-14T11:37:46.017 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.018+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.j857nE-Rv2zV_EeRNnGvdoiXLszYWYu_0 2024-09-14T11:37:46.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8904869533712052864', time=2024-09-14T13:27:41.601720+0000, chain.objs.size()=1 2024-09-14T11:37:46.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BPhkcP5p4AwbX3KEC6LgThoRQDo0B0s_0 2024-09-14T11:37:46.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9599770531586562796', time=2024-09-14T13:27:41.620385+0000, chain.objs.size()=1 2024-09-14T11:37:46.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rksHxSfcQW13MF5Tmd0ItfmH-vIPGOT_0 2024-09-14T11:37:46.018 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15967996988598865829', time=2024-09-14T13:27:41.684244+0000, chain.objs.size()=1 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tin2IFxAmKzQiNF7hlpcXxgdvd5Ge6s_0 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17814498175390791526', time=2024-09-14T13:27:41.685412+0000, chain.objs.size()=1 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.019+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.erHMFrnCXnhF0Twnj11-1pzZrKYatyu_0 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14094489306410947545', time=2024-09-14T13:27:41.714946+0000, chain.objs.size()=1 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UVFkOBv-0ocRTWnArrJKCBtLJmCKnee_0 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17332922128643743145', time=2024-09-14T13:27:41.826758+0000, chain.objs.size()=1 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7VvUfXmVJKnNPiNt2Ptynf-aCfD_BXD_0 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2197767303330551839', time=2024-09-14T13:27:41.864177+0000, chain.objs.size()=1 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.RO2FEVEB-IlBeQnMM5y-e-tNVCYS2C-_0 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4804251827857145613', time=2024-09-14T13:27:41.875599+0000, chain.objs.size()=1 2024-09-14T11:37:46.019 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.020+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GOoHGHtEAN_wVFLWzJF-0hqW8_9tML5_0 2024-09-14T11:37:46.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10199363481503167026', time=2024-09-14T13:27:41.895779+0000, chain.objs.size()=1 2024-09-14T11:37:46.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ww3dhBFpTX8oFtQf-8D1A8zScXRM9wq_0 2024-09-14T11:37:46.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2028443541262535025', time=2024-09-14T13:27:41.927468+0000, chain.objs.size()=1 2024-09-14T11:37:46.020 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mX-_auwq9z9vVxWe_0W4PS3J1H_qcQv_0 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.933705120600668296', time=2024-09-14T13:27:41.942421+0000, chain.objs.size()=1 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.z2gF8NiKHzUmavjji2AF71Pjl6b-HeT_0 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16442163946180065601', time=2024-09-14T13:27:41.959963+0000, chain.objs.size()=1 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GJzh4P3JdoWJ40fwlJIn-KaF3LDqsBK_0 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17853724264047660168', time=2024-09-14T13:27:41.961415+0000, chain.objs.size()=1 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._sNRj7d3L97aSTOwYVeOrUjFhrkapD7_0 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4251274927976706956', time=2024-09-14T13:27:41.963023+0000, chain.objs.size()=1 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0x5xRnGZHziV4ekTJ3KAc2Oe2d_Wbpn_0 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7898776871567308948', time=2024-09-14T13:27:42.062739+0000, chain.objs.size()=1 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Mu2-LIkd-G1eQKIOBpEjZMMAbY6EBZG_0 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15987342901050925365', time=2024-09-14T13:27:42.068049+0000, chain.objs.size()=1 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UfdyT91HUpckP8tqhmKYbLSIazo_RZs_0 2024-09-14T11:37:46.021 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13575527336227801168', time=2024-09-14T13:27:42.077439+0000, chain.objs.size()=1 2024-09-14T11:37:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Fe4AAkLkArl6hdUZrLpE3hpVaBfaAKQ_0 2024-09-14T11:37:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15514491008322213233', time=2024-09-14T13:27:42.089772+0000, chain.objs.size()=1 2024-09-14T11:37:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.021+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.RVom7C_2Ih-TLpdkZf1r80qKJysd17f_0 2024-09-14T11:37:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.022+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17229136698092089490', time=2024-09-14T13:27:42.103891+0000, chain.objs.size()=1 2024-09-14T11:37:46.022 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.022+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.U2CYfAvtJo5qXVQoYGqHi96SfbvXX3X_0 2024-09-14T11:37:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14130026710849479111', time=2024-09-14T13:27:42.165913+0000, chain.objs.size()=1 2024-09-14T11:37:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cC9AyDi_wioSec5Pe6coQQNkM5eCull_0 2024-09-14T11:37:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17353935847930232354', time=2024-09-14T13:27:42.188384+0000, chain.objs.size()=1 2024-09-14T11:37:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ZMujmgc0nl-4jwWwcMcM9h1hrJmbuSB_0 2024-09-14T11:37:46.023 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8764558309490789910', time=2024-09-14T13:27:42.312670+0000, chain.objs.size()=1 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.RFpB5fz27kICO6Bf_h_M_Py7EVzLXQk_0 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2754043876312218015', time=2024-09-14T13:27:42.563834+0000, chain.objs.size()=1 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.K_KwdxxbW2f3c7AQsTBqz7f_2EMxbsV_0 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2054523463228006290', time=2024-09-14T13:27:42.621868+0000, chain.objs.size()=1 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qBggTQP54cAogvc2xtqnV_Kig8-8Via_0 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16289138278021007737', time=2024-09-14T13:27:50.424113+0000, chain.objs.size()=1 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.piIy2mE0z3izVWklZ01nJMKBPuHdFM7_0 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14864577915835356078', time=2024-09-14T13:27:50.446243+0000, chain.objs.size()=1 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.N28sKOkgz9WsPqWwg65HFmJVdpq0o1A_0 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17478357091376124931', time=2024-09-14T13:27:50.457679+0000, chain.objs.size()=1 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RId3_acimS111r9kHtm762q6SEymA2e_0 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15023746820428155859', time=2024-09-14T13:27:50.469585+0000, chain.objs.size()=1 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AkYHMlThEBfr8UZ8rHjhrPSqdevTNrB_0 2024-09-14T11:37:46.024 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9907902276148643540', time=2024-09-14T13:27:50.506197+0000, chain.objs.size()=1 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.023+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jRQV5ewd4jVmwEmyZQzBv3QU3z4XqHQ_0 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10889362249095783716', time=2024-09-14T13:27:50.521363+0000, chain.objs.size()=1 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7p0-ltMashYiPK13xBvrv3Zt0GjLvdB_0 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3877963965514032331', time=2024-09-14T13:27:50.532618+0000, chain.objs.size()=1 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FvEuMx8PSHyN7OJN-yKsCfOE-lxqarV_0 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8290177561796992629', time=2024-09-14T13:27:50.543730+0000, chain.objs.size()=1 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Scjd8InLPby86zSLjzgvchFT6wgKEO4_0 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8696449505832052617', time=2024-09-14T13:27:50.551309+0000, chain.objs.size()=1 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EyHoaCO2U6vzzH3J4Xv6Vb8_0C5qBDi_0 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2562460294934788800', time=2024-09-14T13:27:50.564163+0000, chain.objs.size()=1 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hHQRrfNUlE79A2GZwFTxtzya5xm3fAH_0 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8820166253164303120', time=2024-09-14T13:27:50.680520+0000, chain.objs.size()=1 2024-09-14T11:37:46.025 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.KPX88QeXuE0DV7OpiKn-mxIpZyGR96u_0 2024-09-14T11:37:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2519411417098794591', time=2024-09-14T13:27:50.698459+0000, chain.objs.size()=1 2024-09-14T11:37:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZFNK8SIZsax8Z0vbYEUuoOPRqVDrDH4_0 2024-09-14T11:37:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9067789095091245589', time=2024-09-14T13:27:50.727723+0000, chain.objs.size()=1 2024-09-14T11:37:46.026 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Fd9DnwZjmF9MISI6JHoA5eFrHp8Y0hb_0 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15012806613447224496', time=2024-09-14T13:27:50.740854+0000, chain.objs.size()=1 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.025+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LMFDdq7UwhIz64GXyeOWhNG9LNNjjJl_0 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12432055715700519860', time=2024-09-14T13:27:50.831271+0000, chain.objs.size()=1 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.eOHv9dkTwB3TXwcSlG3apjI_nQTIej6_0 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3821913881562235957', time=2024-09-14T13:27:50.839526+0000, chain.objs.size()=1 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.X2chhcxoAveEHSDR4DEpoE8PkWhB2UY_0 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9778347254626997550', time=2024-09-14T13:27:50.966358+0000, chain.objs.size()=1 2024-09-14T11:37:46.027 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-3wYsIcWpLl1Fmf9vRZ4AnVt3EpGPtC_0 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17607281735614763689', time=2024-09-14T13:27:51.006416+0000, chain.objs.size()=1 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.026+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wh-MRh2asckEe38PYSjgKNJRbczsrPR_0 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.027+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9146534197909290238', time=2024-09-14T13:27:51.061137+0000, chain.objs.size()=1 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.027+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ePuDKde10PlmXUsXlGC1cNt_GjHLbnC_0 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.028+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5570390288440546155', time=2024-09-14T13:27:51.261331+0000, chain.objs.size()=1 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.028+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._nG5jPXEMnunxSisuBbZp7rpQGKm0Qc_0 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.028+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12734526039178027832', time=2024-09-14T13:27:51.303463+0000, chain.objs.size()=1 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.028+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ch6nsFcoIHH9yGVpB07L9Q0oEfP7ljj_0 2024-09-14T11:37:46.028 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.029+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/54268 2024-09-14T11:37:46.029 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=36, truncated=0, next_marker='' 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11662255446866968343', time=2024-09-14T13:27:51.308840+0000, chain.objs.size()=1 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4OiDoxa1v1GvyNN5DDzrX6uxiDQUWg2_0 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9754971508182121005', time=2024-09-14T13:27:51.337493+0000, chain.objs.size()=1 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BjsCr1LFnAIZbynYlnl2Kv_5to7Pe4B_0 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.503514013721068313', time=2024-09-14T13:27:51.462976+0000, chain.objs.size()=1 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.voIQR44JtjSu1uNiiUF7ITlB7cNg9c5_0 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12576492054214698527', time=2024-09-14T13:27:51.479140+0000, chain.objs.size()=1 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xp0W27v1YDespSDx-eU7NdA1OSGUdro_0 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6202010113067458914', time=2024-09-14T13:27:51.560996+0000, chain.objs.size()=1 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rXrQ7h2iBGkdf42dSsS8Jy4mBMPSgvB_0 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4719209480610355346', time=2024-09-14T13:27:51.566275+0000, chain.objs.size()=1 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AE8rVEVkxk12CRA3Ly9x9Wa8RX1MknL_0 2024-09-14T11:37:46.030 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11312977771865424298', time=2024-09-14T13:27:51.783939+0000, chain.objs.size()=1 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Vy3bOluinl2U2AooqpZE1-eUZg_yv5c_0 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1204692237025084190', time=2024-09-14T13:27:51.788773+0000, chain.objs.size()=1 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RD0G_7RU2kncIXO7Ec3geuElTs2iqjd_0 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17465278208021437303', time=2024-09-14T13:27:51.815931+0000, chain.objs.size()=1 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kNbn9PaNnbJOifnmL1cyXqK0FVs-IUf_0 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3721140271003589249', time=2024-09-14T13:27:51.839372+0000, chain.objs.size()=1 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.QlJXGY0S9PYiQ_GvrOPAox_JmbdGd4H_0 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16440546380118750669', time=2024-09-14T13:27:51.992519+0000, chain.objs.size()=1 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.E4L4R1T8Qiy6DlN0fjtwg803fp6DqBW_0 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.372387603840348250', time=2024-09-14T13:27:52.025608+0000, chain.objs.size()=1 2024-09-14T11:37:46.031 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.031+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ERFFFjDdIAL2mVQzndxPtj6fBvKnnlS_0 2024-09-14T11:37:46.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4895132174413290189', time=2024-09-14T13:27:52.051937+0000, chain.objs.size()=1 2024-09-14T11:37:46.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.D5og9rrRi2bZLTmvn_4PNuaTFB3uueI_0 2024-09-14T11:37:46.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17083471452443614349', time=2024-09-14T13:27:52.132632+0000, chain.objs.size()=1 2024-09-14T11:37:46.032 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.v2PWgLXL479HMhxSnbiH8qfT_wekHsU_0 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18071132721646760556', time=2024-09-14T13:27:52.239360+0000, chain.objs.size()=1 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GDtnyeXQeOc-HJ_W0bI7VbwnDHf6XN4_0 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15330535741546893485', time=2024-09-14T13:27:52.258906+0000, chain.objs.size()=1 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bkL5mXwdTipQEcVCG0aFd2FOMf8Wr-y_0 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11821225413460286757', time=2024-09-14T13:27:52.300620+0000, chain.objs.size()=1 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gZQckevFhBLDdcEFqc83VxlBsqfwsjh_0 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3116841479721535434', time=2024-09-14T13:27:52.339250+0000, chain.objs.size()=1 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oZHWpVb1R6LE4E1JOMZkQHnKmhoPBYy_0 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5941125120097152991', time=2024-09-14T13:28:10.517673+0000, chain.objs.size()=1 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.367__shadow_.VRpkJHPsTsD-xEAMJSGK-xgbXJmdauz_0 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17993096740658333743', time=2024-09-14T13:29:22.328124+0000, chain.objs.size()=6 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.1 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.2 2024-09-14T11:37:46.033 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.3 2024-09-14T11:37:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.033+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.4 2024-09-14T11:37:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.034+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.5 2024-09-14T11:37:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.035+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.6 2024-09-14T11:37:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~eGB-ZOhEtSmmGd90d8dYspz8HQQKK7d', time=2024-09-14T13:29:36.084213+0000, chain.objs.size()=1 2024-09-14T11:37:46.034 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~eGB-ZOhEtSmmGd90d8dYspz8HQQKK7d.2 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~YwlSQdOs6AXRBAuDMltvYDIpMV21r-W', time=2024-09-14T13:29:51.235009+0000, chain.objs.size()=2 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.531__multipart_mymultipart.2~YwlSQdOs6AXRBAuDMltvYDIpMV21r-W.1 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.531__multipart_mymultipart.2~YwlSQdOs6AXRBAuDMltvYDIpMV21r-W.2 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9797015456738565281', time=2024-09-14T13:30:28.306802+0000, chain.objs.size()=1 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.553__shadow_.rRSQDLEQZ8CocWxj95V3FwIc-IszdeF_0 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.918185128383394801', time=2024-09-14T13:30:43.706617+0000, chain.objs.size()=1 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:Cr1HMSRblIRmyYJ8YvMfPaKrDqeLseI_.OdLQ1gaddipzAozYNvsVsAwXt_sgKZs_0 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9668205491171633982', time=2024-09-14T13:31:00.054663+0000, chain.objs.size()=1 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:rMlwpZLQKYAWI71GWxXwpfTubuH2xjk_.dwxun4vAqgLIdmRCNdt2mB84BLSTFYc_0 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3983336270050543448', time=2024-09-14T13:31:04.011611+0000, chain.objs.size()=1 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:xF7vNr.f.GxtNGAJ6Uus0L769QQXZTh_.lDxTnsP4KfpnQcNXvkIygFhhPej7h7P_0 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2290533900467188442', time=2024-09-14T13:31:09.872778+0000, chain.objs.size()=1 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:QoRHayxVBWcIYioJPSKJu1Cjqw28u1w_.BtQT2wb3JWgfkFVckz3OnRqSP115MVk_0 2024-09-14T11:37:46.035 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13165763723960963230', time=2024-09-14T13:33:40.408726+0000, chain.objs.size()=1 2024-09-14T11:37:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.620__shadow_.22699O-lkgDhN9xphlCTTYxbnmlJ8eb_0 2024-09-14T11:37:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4723407508986168574', time=2024-09-14T13:33:58.644794+0000, chain.objs.size()=1 2024-09-14T11:37:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.036+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.652__shadow_.HkV1maDSiUIu6P2u82jSMUIJttnjYqO_0 2024-09-14T11:37:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.037+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7158619666041066586', time=2024-09-14T13:34:00.923581+0000, chain.objs.size()=1 2024-09-14T11:37:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.037+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.656__shadow_.Jk8npEWE1qj7_ybKP9VpYWdVwg6hmBA_0 2024-09-14T11:37:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.037+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5856995271562898278', time=2024-09-14T13:34:03.860873+0000, chain.objs.size()=6 2024-09-14T11:37:46.036 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.037+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.661__multipart_baz.2~TvzFdVpRsgXXzi4-juu01ZjzJpwMGON.1 2024-09-14T11:37:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.661__multipart_baz.2~TvzFdVpRsgXXzi4-juu01ZjzJpwMGON.2 2024-09-14T11:37:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.661__multipart_baz.2~TvzFdVpRsgXXzi4-juu01ZjzJpwMGON.3 2024-09-14T11:37:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.661__multipart_baz.2~TvzFdVpRsgXXzi4-juu01ZjzJpwMGON.4 2024-09-14T11:37:46.037 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.661__multipart_baz.2~TvzFdVpRsgXXzi4-juu01ZjzJpwMGON.5 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.661__multipart_baz.2~TvzFdVpRsgXXzi4-juu01ZjzJpwMGON.6 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17880567843616770010', time=2024-09-14T13:34:05.837506+0000, chain.objs.size()=1 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.665__shadow_._vmRP7Dp5AH19u53-ciMV2oERZBqtH-_0 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7935106800310568317', time=2024-09-14T13:34:07.301092+0000, chain.objs.size()=1 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.668__shadow_.nhLOIk_GmBgdMS0QufaWQRskKmYOpPu_0 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8491393782226946990', time=2024-09-14T13:34:07.906699+0000, chain.objs.size()=1 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.670__shadow_.lneaE27br_nKfCCCGP0LTpzF5M_MfzL_0 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~iTBsYJ6_Mmsdv5ob4AQY_5JPTSGaiJy', time=2024-09-14T13:34:59.846812+0000, chain.objs.size()=1 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.742__multipart_mymultipart2.2~iTBsYJ6_Mmsdv5ob4AQY_5JPTSGaiJy.1 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9458234023064267579', time=2024-09-14T13:35:54.017788+0000, chain.objs.size()=3 2024-09-14T11:37:46.038 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.779__shadow_._IRkpoEIhuKP_04ufHKdg3_BbPw9szF_0 2024-09-14T11:37:46.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.039+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.779__shadow_._IRkpoEIhuKP_04ufHKdg3_BbPw9szF_1 2024-09-14T11:37:46.039 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.041+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.779__shadow_._IRkpoEIhuKP_04ufHKdg3_BbPw9szF_2 2024-09-14T11:37:46.041 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.043+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.043 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.045+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-14T11:37:46.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.047+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.045 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.047+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48073' 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11666821756537967900', time=2024-09-14T13:24:57.716365+0000, chain.objs.size()=2 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.G2nMuJ8gK5zQ3s1q8kexFzR7s5acUbU_0 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.G2nMuJ8gK5zQ3s1q8kexFzR7s5acUbU_1 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_V9gZUnLLrPmvbAuPFShDKpbDLHFmY5n', time=2024-09-14T13:24:57.945608+0000, chain.objs.size()=2 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.x6KATXTkqNjYgCAI8HSS_HQWk1IhPIs_0 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.x6KATXTkqNjYgCAI8HSS_HQWk1IhPIs_1 2024-09-14T11:37:46.046 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~E4CjeYk_sgEkLMIqACwB3k8Wys7idYW', time=2024-09-14T13:25:28.518271+0000, chain.objs.size()=1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.202__multipart_mymultipart.2~E4CjeYk_sgEkLMIqACwB3k8Wys7idYW.1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10060222821123910248', time=2024-09-14T13:26:43.784201+0000, chain.objs.size()=1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.242__shadow_.zCMQlwLk7hHnsyJYeWs17kvlZg2wTl9_0 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4943045018368089279', time=2024-09-14T13:26:46.416973+0000, chain.objs.size()=1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.246__shadow_.vgtrQncjlsX9kwIEwrivN5dFzrH1Bwi_0 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15141824321765494462', time=2024-09-14T13:26:46.895843+0000, chain.objs.size()=1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.247__shadow_.5NtXmdpO_WIf0NHiH45L3aneuhB2ang_0 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7804459171360877310', time=2024-09-14T13:27:01.171484+0000, chain.objs.size()=1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ucs23WG3Mk8naGZtqBHhxOwIatFx2Qp_0 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16916368618164220959', time=2024-09-14T13:27:01.212633+0000, chain.objs.size()=1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4gHVGaa3S3unsQafbVE0PmCW2Dv-SnD_0 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17993698330697768510', time=2024-09-14T13:27:01.220790+0000, chain.objs.size()=1 2024-09-14T11:37:46.047 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.S5e5cfmrXQ-T_HKZT8KpW-CCeLTbG52_0 2024-09-14T11:37:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3934501635148731867', time=2024-09-14T13:27:01.266777+0000, chain.objs.size()=1 2024-09-14T11:37:46.048 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.048+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5d_AYLL-Ob7ORRZiMRv8z62eTH_gbLC_0 2024-09-14T11:37:46.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16063640976495135679', time=2024-09-14T13:27:01.275931+0000, chain.objs.size()=1 2024-09-14T11:37:46.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EVjImVCkUmmTNX4dWko7iPBrh9Vhv1r_0 2024-09-14T11:37:46.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17222770540373807102', time=2024-09-14T13:27:01.297584+0000, chain.objs.size()=1 2024-09-14T11:37:46.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.D6wGYt27VD936z9bS21QS71Z50z1Jy-_0 2024-09-14T11:37:46.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3334889374908037455', time=2024-09-14T13:27:01.300159+0000, chain.objs.size()=1 2024-09-14T11:37:46.049 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GBGZUB6WM6nlqRX22aYKI6SNWMvL9WC_0 2024-09-14T11:37:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13318849764800256283', time=2024-09-14T13:27:01.739924+0000, chain.objs.size()=1 2024-09-14T11:37:46.050 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.051+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eWb72U1lL3mn-XtvW8NV1m2f9Ux-jUy_0 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10642173818592994064', time=2024-09-14T13:27:01.785266+0000, chain.objs.size()=1 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yJvMCArQfHXi5Jpt33ZujNx4PeRtIjd_0 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13222547112744995479', time=2024-09-14T13:27:01.971444+0000, chain.objs.size()=1 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._dsXpXkAQnf9ioRuuqxfMgbbu_acY2N_0 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2497785183438083010', time=2024-09-14T13:27:01.978063+0000, chain.objs.size()=1 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Py4w8Uetiz-69OpwxHGDO-peyZHLyFZ_0 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13884495557986398073', time=2024-09-14T13:27:02.021947+0000, chain.objs.size()=1 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EsFMEJLcT7pCj-vFns_7upV8_2EdBwz_0 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7877973654570240511', time=2024-09-14T13:27:02.138998+0000, chain.objs.size()=1 2024-09-14T11:37:46.051 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oDhaxI-txSEkZn-omxeH4wkHBDQ7XoF_0 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11455276378906029214', time=2024-09-14T13:27:02.159442+0000, chain.objs.size()=1 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lWjfxqxJYTNAravkkyCN_l3T_-I46vf_0 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13369278210113371710', time=2024-09-14T13:27:02.216845+0000, chain.objs.size()=1 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.W0MnHYU3Gb3QNsuMdCRecukQ1E3iqsk_0 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15952923025783195881', time=2024-09-14T13:27:02.217451+0000, chain.objs.size()=1 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7WEa6QFsggUQE4FW42evn2DML5bRBLi_0 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17887493277025561253', time=2024-09-14T13:27:02.263290+0000, chain.objs.size()=1 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.052+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MeRLftuKtuFB8tIAlSL7JO3CIpsSkwt_0 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.053+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13584773399428747266', time=2024-09-14T13:27:02.391808+0000, chain.objs.size()=1 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.053+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Jo1XdZVZhx21BD3k1XGo6FWc7P3RhQt_0 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.053+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7069907135292341838', time=2024-09-14T13:27:02.398987+0000, chain.objs.size()=1 2024-09-14T11:37:46.052 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.053+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.xlPUgQ51nfUAxi2pX9LWMXNdjmnwfe1_0 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.054+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16712151244376009702', time=2024-09-14T13:27:02.407192+0000, chain.objs.size()=1 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.054+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._tzkFBx9Wd_HV3crXNOX7AnESZwgOsI_0 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4551906559418738233', time=2024-09-14T13:27:02.413807+0000, chain.objs.size()=1 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.e_MFOzg9STOGWdH-zMJaArInvj7Ooah_0 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.611637599200593899', time=2024-09-14T13:27:02.431618+0000, chain.objs.size()=1 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iUG8k7hSCJ3BlpiRGr6Efso0U63mwXC_0 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8366681112232046436', time=2024-09-14T13:27:02.454161+0000, chain.objs.size()=1 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3W3MCUiftHvnqHQl-CcPFVbfB_i3N0s_0 2024-09-14T11:37:46.053 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9872053146986839047', time=2024-09-14T13:27:02.464154+0000, chain.objs.size()=1 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.enw84HUne_iCqiFPJsZH7zzlgYLAvxa_0 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2266807679800865038', time=2024-09-14T13:27:02.486404+0000, chain.objs.size()=1 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TISYGNU97OerVsIEUGAWu6M1XI0wsSE_0 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.605728629296268846', time=2024-09-14T13:27:02.617089+0000, chain.objs.size()=1 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._IkQ7qWinlybB--o4UKz9cDO1AIcWZR_0 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9889843156705591093', time=2024-09-14T13:27:02.698740+0000, chain.objs.size()=1 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WN1POI1Re_b1f-eFNVR19qvPqtQlTMa_0 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15800811269391988451', time=2024-09-14T13:27:02.750717+0000, chain.objs.size()=1 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1pqBzlN-5lvdijo82yDyLv9XQg23UE8_0 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1796129714665845166', time=2024-09-14T13:27:02.830923+0000, chain.objs.size()=1 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oO1WrBOtBTQPU0kJnr0pREfisCSa-lB_0 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16736103289747486033', time=2024-09-14T13:27:02.849180+0000, chain.objs.size()=1 2024-09-14T11:37:46.054 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._7LFOBcNRYFB0N4VmPLK3rLCwd8ucvC_0 2024-09-14T11:37:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17010860734062461157', time=2024-09-14T13:27:02.946722+0000, chain.objs.size()=1 2024-09-14T11:37:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.055+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yQ60ruFP2R9BZri3ZANfCev4TohOuX__0 2024-09-14T11:37:46.055 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.056+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11026231246988214945', time=2024-09-14T13:27:07.616083+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.056+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.272__shadow_.T3Xuccb9ZMetNL96JtfPqovGJfZi7dd_0 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11475198173669600654', time=2024-09-14T13:27:08.081768+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.273__shadow_.GThrxnOw4lOIG7qYRP8eyY5C3kKfEgQ_0 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.611341409495581168', time=2024-09-14T13:27:17.701625+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_._nbGEv-FicCKW4el4efyM466oZgulF0_0 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.933696543483859014', time=2024-09-14T13:27:17.705292+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.BJg3F2nPYPKpYiGW7dcQtjeyaRNTqTJ_0 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4645872861978528223', time=2024-09-14T13:27:18.490098+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.3fUMkUE07V9ZynHBL-73L700PAfIHna_0 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1666905642291527359', time=2024-09-14T13:27:25.053626+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.306__shadow_.dcfCfzTTNzfs14lLUXN2CO-SysPRTt0_0 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6534041241994907523', time=2024-09-14T13:27:25.812011+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.307__shadow:sAGyrlsUad5Dl5SDpQ4D4zqN132ud3B_.zUCAPe2G6lIuuxL2361n0oFRkLbhkRp_0 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5170767766023537873', time=2024-09-14T13:27:40.778057+0000, chain.objs.size()=1 2024-09-14T11:37:46.056 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Fop2ddjof53SFNqF3PxOP-I7GSm565M_0 2024-09-14T11:37:46.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17620286828706402590', time=2024-09-14T13:27:40.842753+0000, chain.objs.size()=1 2024-09-14T11:37:46.057 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zoIhaeak6zH07kCEpBnZx73hNLfvFlo_0 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6504802759182975368', time=2024-09-14T13:27:40.850435+0000, chain.objs.size()=1 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9P5WSsxjzCShMEslB9OKpPqj-nGjHeM_0 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9846642499980080203', time=2024-09-14T13:27:40.923576+0000, chain.objs.size()=1 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.057+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sep6GNPGArVG7y_aE0dYI_RYUr2nkK-_0 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.058+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13105583176292622720', time=2024-09-14T13:27:41.039509+0000, chain.objs.size()=1 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.058+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5It8dhnqxNX3DgLO_cG4I6sKMuL7FWT_0 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12066053017257425494', time=2024-09-14T13:27:41.059567+0000, chain.objs.size()=1 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UyKAKDfMBZAIP8_uAIYDHhlRwZT3U7I_0 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10463451389794323713', time=2024-09-14T13:27:41.068967+0000, chain.objs.size()=1 2024-09-14T11:37:46.058 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1nxeos9Up3o2KKA4eTSMuRR24EdRwg2_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13373351692052895944', time=2024-09-14T13:27:41.079226+0000, chain.objs.size()=1 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7l5XsXJpyvIFnvhvA18mMVRltiF81Ie_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17166936890107665880', time=2024-09-14T13:27:41.105424+0000, chain.objs.size()=1 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UsX2P5CZpHrEJUzzYE6kDeZwNgou1S7_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12978683410231235304', time=2024-09-14T13:27:41.114021+0000, chain.objs.size()=1 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lTiVdmdo5xhD5KaoPjFC3JO6ruywm77_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8874267315097349471', time=2024-09-14T13:27:41.151226+0000, chain.objs.size()=1 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Wlvxl_bR6O9ayhfOByNT5yoQyiE9bz1_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11932196734865706919', time=2024-09-14T13:27:41.163250+0000, chain.objs.size()=1 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mg12har3KO1cY2ETA0_3zl1EckFg2qt_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17888830025190122834', time=2024-09-14T13:27:41.296823+0000, chain.objs.size()=1 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.059+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ennPmIEC5TeiN66-4Ruvo2FWPtIANnL_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.720075372586412003', time=2024-09-14T13:27:41.615418+0000, chain.objs.size()=1 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8cGTJy711Tt4lrgZy6UE3oZSyw9TmhA_0 2024-09-14T11:37:46.059 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15615207643546341398', time=2024-09-14T13:27:41.809675+0000, chain.objs.size()=1 2024-09-14T11:37:46.060 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4l6HDEh91qteQ9hu0WdYzL5cWZpX8Fu_0 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.232567547332727256', time=2024-09-14T13:27:41.818461+0000, chain.objs.size()=1 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.A3GNkqNUc74tsn7pTI7zF7j2T1a1T37_0 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.387283871731017907', time=2024-09-14T13:27:41.834545+0000, chain.objs.size()=1 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rGNeJrkt1zQRs1POT8eKXrYJDTyKULO_0 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15597942371268295802', time=2024-09-14T13:27:41.841161+0000, chain.objs.size()=1 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.060+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0NzGa_iBvAzAXYon4U3hQ9sJ_RNJr6e_0 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.061+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13579898562662649299', time=2024-09-14T13:27:41.910687+0000, chain.objs.size()=1 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.061+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SzrIZYLYHMx5vOR4XzfjyHML75P6Lmi_0 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10068356202062593491', time=2024-09-14T13:27:41.973228+0000, chain.objs.size()=1 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YlcSzzH_Tmk3IdzVzxPwRdlTE6QRbJJ_0 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12629341733273690500', time=2024-09-14T13:27:42.065563+0000, chain.objs.size()=1 2024-09-14T11:37:46.061 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FFyYNKeubnu5xxdCPP7jpZ4E9kyShV__0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11660552816165209628', time=2024-09-14T13:27:42.095435+0000, chain.objs.size()=1 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Py-gBIp8aEwwK0a4U5ekabKPPAzDzrk_0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10268410790104942509', time=2024-09-14T13:27:42.156999+0000, chain.objs.size()=1 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.b2-NFjIdUwBh9oGPGhs6DBMk_0Yuc5h_0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10941527274945319335', time=2024-09-14T13:27:42.410744+0000, chain.objs.size()=1 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-gSIpCQlgzh_Rdt4ro36XW_daVhEzbl_0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1464572210520837960', time=2024-09-14T13:27:42.419092+0000, chain.objs.size()=1 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.gzR3KQVlRwCiyhw_LOhCsJ5KrHPVApW_0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16280033421564848201', time=2024-09-14T13:27:42.421600+0000, chain.objs.size()=1 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.o2ul8wD9xeul26V7jTo6Eijbi8iyhiv_0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11120697863466059415', time=2024-09-14T13:27:42.423593+0000, chain.objs.size()=1 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SijoikZ5Nv4U3R54FNCXkNqLJ1-eLgQ_0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2361044711300263378', time=2024-09-14T13:27:42.464513+0000, chain.objs.size()=1 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.S8saFLtVQfiLet9ZHhgED-yH80XQ0-7_0 2024-09-14T11:37:46.062 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2497062019102986201', time=2024-09-14T13:27:42.559470+0000, chain.objs.size()=1 2024-09-14T11:37:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.409ZXnZfieWCou557HuZGMExWylTj0Q_0 2024-09-14T11:37:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17580882158206846568', time=2024-09-14T13:27:42.616817+0000, chain.objs.size()=1 2024-09-14T11:37:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.062+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SZWikKr41JfLJtGWSAQzsx2ThHSh8gt_0 2024-09-14T11:37:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14318127581219553451', time=2024-09-14T13:27:42.623699+0000, chain.objs.size()=1 2024-09-14T11:37:46.063 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1NNBpVAZRNwTUibnu2zm8TBQW5UFUjN_0 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6248527081727740780', time=2024-09-14T13:27:42.659314+0000, chain.objs.size()=1 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hipiAqZ5o_gU89X-QtmDHHZrK-AFqQ9_0 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5645108385523887202', time=2024-09-14T13:27:42.678435+0000, chain.objs.size()=1 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5HEe5m2s-6bjwkuUKJ84LBylBAX69N__0 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8886372794479154012', time=2024-09-14T13:27:50.436722+0000, chain.objs.size()=1 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CcNzLJXGVUqNKJlvSTusPYjfETLXukC_0 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6757460540477321925', time=2024-09-14T13:27:50.437346+0000, chain.objs.size()=1 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.eGr-gIt-Qk6SGVQN4sfosRYDRYD2a-U_0 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9488546945450429177', time=2024-09-14T13:27:50.483455+0000, chain.objs.size()=1 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Q8Gmefjdm_38S7fkk3R-_1yUHLXC8Hw_0 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11217033479653273769', time=2024-09-14T13:27:50.549616+0000, chain.objs.size()=1 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BJMIpDOq9_6ekDWZfa4_FUyF26L3jFJ_0 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5187819892439105054', time=2024-09-14T13:27:50.586266+0000, chain.objs.size()=1 2024-09-14T11:37:46.064 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3ek_7fWYVtcxRsdKq1hwY09THCWF_ET_0 2024-09-14T11:37:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17000214723906105335', time=2024-09-14T13:27:50.596663+0000, chain.objs.size()=1 2024-09-14T11:37:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.064+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.no2USgZFrjLUpEk4aWzUxY5df3AIc70_0 2024-09-14T11:37:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.065+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.19749264577177420', time=2024-09-14T13:27:50.694279+0000, chain.objs.size()=1 2024-09-14T11:37:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.065+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.m8Znbbb_DkQL91Q1owUF5TxpEnsUii2_0 2024-09-14T11:37:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.065+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14891187037747475127', time=2024-09-14T13:27:50.767542+0000, chain.objs.size()=1 2024-09-14T11:37:46.065 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.065+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.KbgP-FQBVjch25Vu3Q5FVb5Geyit8tv_0 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10116413740302931621', time=2024-09-14T13:27:50.776678+0000, chain.objs.size()=1 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Q1KtyGFdyYjzqyGfbsp9n8B3ISou16j_0 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15130896737792225833', time=2024-09-14T13:27:50.829523+0000, chain.objs.size()=1 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BjuuB0zKqRF-8Xcc6aIun0whdyicG0U_0 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.445109137539893954', time=2024-09-14T13:27:50.831464+0000, chain.objs.size()=1 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3YL411pPyt-pdWix3jVbHD_2xdM2xgO_0 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11371400719262910652', time=2024-09-14T13:27:50.849434+0000, chain.objs.size()=1 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6LbaM97ckJvWzkAOgGKVWwZcDfSV_Jy_0 2024-09-14T11:37:46.066 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12199705643591201073', time=2024-09-14T13:27:50.938073+0000, chain.objs.size()=1 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.KJCrryHg3SPrOyXh3Qmxu6ZeAmlNDtN_0 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16673393008020364799', time=2024-09-14T13:27:51.064604+0000, chain.objs.size()=1 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uQvUN2pJKtQ7dj9JBhmwmr91EDjE7rH_0 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16369690536830376776', time=2024-09-14T13:27:51.196280+0000, chain.objs.size()=1 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GjSnPtv_L8NR8T3wFZnGgUBFK_t5kpt_0 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3021287014676632989', time=2024-09-14T13:27:51.271467+0000, chain.objs.size()=1 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.avoVsIJTd9Gb2lDWq5nLQWO9CI9zh9Y_0 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1205632058385883263', time=2024-09-14T13:27:51.317280+0000, chain.objs.size()=1 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CdM_6a9WwHPH3kwWfMEnjemoUPKwlg6_0 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8607820897253547462', time=2024-09-14T13:27:51.335893+0000, chain.objs.size()=1 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.066+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.r8PjvWkGh38TMlvLGwo6lwZYXiqCu1P_0 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.067+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4853257994357657375', time=2024-09-14T13:27:51.522520+0000, chain.objs.size()=1 2024-09-14T11:37:46.067 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.067+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FPzMUQcSjhkQ4OEmdHEbUlF8d3KzHt0_0 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16584100860456840380', time=2024-09-14T13:27:51.543107+0000, chain.objs.size()=1 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.XWteAXQyoJlMWKrnMKvM2gxQx-HKs5-_0 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13214048957379348850', time=2024-09-14T13:27:51.604827+0000, chain.objs.size()=1 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aMu-aS1GUvCTrKy1XtgaCfQ7qTArAQS_0 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9716883437997876518', time=2024-09-14T13:27:51.606873+0000, chain.objs.size()=1 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.y2i5qkA3dglZTM2YAH2zfro6_i7tc9k_0 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17970259505722085996', time=2024-09-14T13:27:51.852124+0000, chain.objs.size()=1 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.068+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.m5xXfsoryvPDnRSFyeDqIyWMLg_byyy_0 2024-09-14T11:37:46.068 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.070+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48073 2024-09-14T11:37:46.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:37:46.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.356456741098870918', time=2024-09-14T13:27:52.007710+0000, chain.objs.size()=1 2024-09-14T11:37:46.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6neArDtuca9utV_IeYx6D-Xx0cCXIya_0 2024-09-14T11:37:46.071 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4777907400408361985', time=2024-09-14T13:27:52.019692+0000, chain.objs.size()=1 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-0a8q4rD5F2qq53rrLV8X0JHyP_E2-Q_0 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7240955967294367570', time=2024-09-14T13:27:52.025099+0000, chain.objs.size()=1 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UYByGDIUjHsKlKLOw5OR07gTuu_pvtC_0 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.194337168735963818', time=2024-09-14T13:27:52.068747+0000, chain.objs.size()=1 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FiI1k5c6M__u7-M8nRSS7_U1xva8vvI_0 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5245097695957464199', time=2024-09-14T13:27:52.091545+0000, chain.objs.size()=1 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1xKowkbUD9S-BHAQsYrGc596-3dynro_0 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15719959833704493364', time=2024-09-14T13:27:52.211849+0000, chain.objs.size()=1 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cqf4lSyKIyEuCyFuRyesCwPxZNmE8V__0 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8586276275052551240', time=2024-09-14T13:27:52.262952+0000, chain.objs.size()=1 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zB6qd3u6GmekNg0uFJxIdmjurDXTVq6_0 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10308610884034837884', time=2024-09-14T13:27:54.021965+0000, chain.objs.size()=1 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.328__shadow_.5oepKuxGN-aM-fkBJlCpA6mNrcglLPg_0 2024-09-14T11:37:46.072 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8743790436056193753', time=2024-09-14T13:27:56.204572+0000, chain.objs.size()=1 2024-09-14T11:37:46.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.333__shadow_.kcmDVgbb8Hm7FR4NDhujWt3ExzzlthG_0 2024-09-14T11:37:46.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15545440205027626001', time=2024-09-14T13:28:00.679878+0000, chain.objs.size()=1 2024-09-14T11:37:46.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.343__shadow_.C6bBdgLSYHkgRCvbcfFWQbDqHXo6DEa_0 2024-09-14T11:37:46.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15209009880619429389', time=2024-09-14T13:28:05.064332+0000, chain.objs.size()=1 2024-09-14T11:37:46.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.353__shadow_.9sLOUgHMYvNB4aFDf8U2TRYVQeiJbz7_0 2024-09-14T11:37:46.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8388480009224213735', time=2024-09-14T13:28:51.268716+0000, chain.objs.size()=1 2024-09-14T11:37:46.073 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.073+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.444__shadow_.viZwYy0pH7PwU1LUjUHW0N7APGPltdg_0 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16156345455033668804', time=2024-09-14T13:29:11.137643+0000, chain.objs.size()=1 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.484__shadow_.y6EoguJobxI-pdS9D0TxWAMfbsboFyA_0 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4440489569391790628', time=2024-09-14T13:29:16.751728+0000, chain.objs.size()=1 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.496__shadow_.bXpZKQSJSpmROilcV0C-mPkvay7qNnk_0 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3243207467365275658', time=2024-09-14T13:30:44.550387+0000, chain.objs.size()=1 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:NFrnYDtuXSwv4U4ITsz41cE69dtUpZX_.u5UtJ7Ir1nuofc-eWf8lZpA1KoBsANh_0 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7415676307806073672', time=2024-09-14T13:30:45.573095+0000, chain.objs.size()=1 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:eaxAwbCbSyl4ZhCIyKlDAw0KMU5y1IV_.2q1VFUBoB_INc2WczMdM2Y3tPMuhGmp_0 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11301801372047152924', time=2024-09-14T13:30:48.246843+0000, chain.objs.size()=1 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.570__shadow:QusaLSZku-aKG6hJcXtu6ZEUpTcdHhW_.l2y3J6XezRuIN7Or1fHpF4NTOSwE-i8_0 2024-09-14T11:37:46.074 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4619305886910282946', time=2024-09-14T13:30:53.802728+0000, chain.objs.size()=1 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.575__shadow_.-zJo7naLdrnOX9ZpYSe-XemoKfH62hu_0 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6185385700022148449', time=2024-09-14T13:31:07.193605+0000, chain.objs.size()=1 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:4VtJmg4x2wPLv48RGn1fwpKDa6vIICh_.WZb64Iu0Rg-5vx2mt3h_-lhXzcGtwmt_0 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12958509303491923635', time=2024-09-14T13:31:12.388020+0000, chain.objs.size()=4 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~M0gqKGn-CUgmYknuUOcg2oNvcp53Eu6.1 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~M0gqKGn-CUgmYknuUOcg2oNvcp53Eu6.2 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~M0gqKGn-CUgmYknuUOcg2oNvcp53Eu6.3 2024-09-14T11:37:46.075 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.075+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.578__multipart_testobj.2~M0gqKGn-CUgmYknuUOcg2oNvcp53Eu6.4 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7996587919350855976', time=2024-09-14T13:31:15.264025+0000, chain.objs.size()=1 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:m2TCnfgQxTvaXjeT2VBMKN7DqU1KiIm_.Ium0zqcfQkMFtUwhhE7YeTh1wUxk_Gj_0 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10781947010198229239', time=2024-09-14T13:31:15.357794+0000, chain.objs.size()=1 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:J1Jlm04csfePGI40.GEn38yV7ngfCj1_.g1iO0sCK7u1os0SlZZMGZVOFAv5JhHB_0 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16295236683235292826', time=2024-09-14T13:31:17.960580+0000, chain.objs.size()=1 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.585__shadow:093ESVQhmpckez9TJC-smDl6bN13z3M_.GfqcAtJNkv4w9Zu36pVefmN6Y_RbwNQ_0 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6601069013253058275', time=2024-09-14T13:31:19.149820+0000, chain.objs.size()=1 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:ozDTvc.XJYrVkCw5t9tIasiPLCrYEDu_.aUsULCi1-hZX1bizvZCvtI1C-XWX636_0 2024-09-14T11:37:46.076 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.802371348076206553', time=2024-09-14T13:33:53.539495+0000, chain.objs.size()=1 2024-09-14T11:37:46.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.643__shadow_.G76CV9dbKniQ2Gp5ySwWQbtmg41y9PR_0 2024-09-14T11:37:46.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9719835351318246577', time=2024-09-14T13:34:47.024627+0000, chain.objs.size()=1 2024-09-14T11:37:46.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.717__shadow:GS.pZtqC.E9eEU-EtpN0GmMgIAt97IQ_.W6YRQ-FpTkynP-uqgmnUr2n5J2fvpkO_0 2024-09-14T11:37:46.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16655435078798657712', time=2024-09-14T13:35:32.613700+0000, chain.objs.size()=1 2024-09-14T11:37:46.077 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.077+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.772__shadow_.8s3-xCGjQC762E1_tZ87gRr24QKNVgP_0 2024-09-14T11:37:46.078 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.080+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.080 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.083+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-14T11:37:46.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.084+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.082 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.084+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47075' 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14694762457768585866', time=2024-09-14T13:24:56.914203+0000, chain.objs.size()=3 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-STANDARD.2~DQYdvupc23pPmTZWP7KAbWb-uaV7pZk.1 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-STANDARD.2~DQYdvupc23pPmTZWP7KAbWb-uaV7pZk.2 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-STANDARD.2~DQYdvupc23pPmTZWP7KAbWb-uaV7pZk.3 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10392205358558608826', time=2024-09-14T13:25:00.929550+0000, chain.objs.size()=2 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.164__multipart_foo.2~eGJpXcppG5b1qaPKQaYJiQndz-CqxwU.1 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.164__multipart_foo.2~eGJpXcppG5b1qaPKQaYJiQndz-CqxwU.2 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3259622267186369699', time=2024-09-14T13:26:39.341389+0000, chain.objs.size()=1 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.234__shadow_.yq4qTy07k3hKDDjr8989MTid_AWd6sr_0 2024-09-14T11:37:46.084 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.806190054856970967', time=2024-09-14T13:26:39.342143+0000, chain.objs.size()=1 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.234__shadow_.PhTCG-aWvCZeftAkBniT3NiCzPUecyZ_0 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17487699667542446561', time=2024-09-14T13:26:43.784596+0000, chain.objs.size()=1 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.242__shadow_.lEysJI-JPSeyrqWO6fcdD2u2YuiHMkL_0 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16779084059606613347', time=2024-09-14T13:26:46.896560+0000, chain.objs.size()=1 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.247__shadow_.26nCDf5jc4FpTY6-6NavEqkapynM-3l_0 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17604406071445494654', time=2024-09-14T13:26:53.210590+0000, chain.objs.size()=1 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.260__shadow_.4FCM9JyLUSe0ix5mTUFiFB5sSygvAHm_0 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10263575901142254442', time=2024-09-14T13:27:01.166051+0000, chain.objs.size()=1 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ESL9zCOaPqJa1TyfUBa0wMrZl6NtopI_0 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15233912779061548660', time=2024-09-14T13:27:01.184819+0000, chain.objs.size()=1 2024-09-14T11:37:46.085 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.085+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eCRM3fulCnWCtLBK9JGApLGZEsXgNEA_0 2024-09-14T11:37:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.087+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13925030668429462807', time=2024-09-14T13:27:01.269980+0000, chain.objs.size()=1 2024-09-14T11:37:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.087+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3aWIs6x8f1iSF-FQp3reANA8QYRLUHU_0 2024-09-14T11:37:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.087+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16934427632379751209', time=2024-09-14T13:27:01.279158+0000, chain.objs.size()=1 2024-09-14T11:37:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.087+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.62Si2lT4GQbaGd3g4IbjqVtqzBDIqt9_0 2024-09-14T11:37:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.087+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18228221226585580327', time=2024-09-14T13:27:01.303487+0000, chain.objs.size()=1 2024-09-14T11:37:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.087+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.P4DmTcDfui1OktfV0gQVmUZCZ1erh7h_0 2024-09-14T11:37:46.086 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7689820505449155145', time=2024-09-14T13:27:01.436116+0000, chain.objs.size()=1 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eTGsvTlD0dU8rQ-dOKNiOO7bDsqwRIs_0 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11584516278358685631', time=2024-09-14T13:27:01.439457+0000, chain.objs.size()=1 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iN6fMK3-wmv1TGPzFfmk2pyky8h57sJ_0 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13680376161758837681', time=2024-09-14T13:27:01.732612+0000, chain.objs.size()=1 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.x9zaqljq1gA7pO6W8McRdgLpfZyAle6_0 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2183928041605417365', time=2024-09-14T13:27:01.788505+0000, chain.objs.size()=1 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.58fObQ_RmxW0nxO5WOZbdBcG_YXexpo_0 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7062211822971099677', time=2024-09-14T13:27:01.916473+0000, chain.objs.size()=1 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2qdWuAYodryuq23rMVZhhG-6ZyTl8rq_0 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13367608075388467791', time=2024-09-14T13:27:01.948884+0000, chain.objs.size()=1 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QNrMwn5lbb_TBrmyjP9aJ18R600aC6a_0 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17868130328452408068', time=2024-09-14T13:27:01.954189+0000, chain.objs.size()=1 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._x0uxv5xJRaU3OCkBS_D3suooGOoP2l_0 2024-09-14T11:37:46.087 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15860015967084413101', time=2024-09-14T13:27:01.979761+0000, chain.objs.size()=1 2024-09-14T11:37:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.088+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pEYJ4yeu9odqVHyHV_PSNjTBmYgioHA_0 2024-09-14T11:37:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.089+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6663801375579837255', time=2024-09-14T13:27:01.986770+0000, chain.objs.size()=1 2024-09-14T11:37:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.089+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.X88r8tfIFWvjBLHXQPAQtRNUNolplvM_0 2024-09-14T11:37:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.090+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4219281672385990142', time=2024-09-14T13:27:01.994221+0000, chain.objs.size()=1 2024-09-14T11:37:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.090+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2mdAUHKn2tpMM5Ylfm7J7gKSmiKozvo_0 2024-09-14T11:37:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.090+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17334814978493144047', time=2024-09-14T13:27:02.146235+0000, chain.objs.size()=1 2024-09-14T11:37:46.088 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.090+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BAR010sYVFGBbhWCgr3F9zI91_2YZXJ_0 2024-09-14T11:37:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.090+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11837389713796022901', time=2024-09-14T13:27:02.163197+0000, chain.objs.size()=1 2024-09-14T11:37:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.090+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fa1fJoRFsb3XJvpOmgOvVhaIXwNkYHT_0 2024-09-14T11:37:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2438957866000264050', time=2024-09-14T13:27:02.214741+0000, chain.objs.size()=1 2024-09-14T11:37:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ya5vnm5ohQgzPc7_LBuyzUUpVw2K17N_0 2024-09-14T11:37:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1460288924229540179', time=2024-09-14T13:27:02.243373+0000, chain.objs.size()=1 2024-09-14T11:37:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.os5hSQB9blLPFZzUrsu9ApbiARDcqyQ_0 2024-09-14T11:37:46.089 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.608378784442968351', time=2024-09-14T13:27:02.249731+0000, chain.objs.size()=1 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.88Zq8Pdjd28sttqbLpQCS4SEtfEIbLj_0 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5199240033558808734', time=2024-09-14T13:27:02.275026+0000, chain.objs.size()=1 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.70EgNo3vqFOWgI8KF19TuKgZDnivdjQ_0 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17065542589640555423', time=2024-09-14T13:27:02.403834+0000, chain.objs.size()=1 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JemWRPMeUfrPFJSxdeRhyTOJiV_xVdI_0 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14421888188813470879', time=2024-09-14T13:27:02.409752+0000, chain.objs.size()=1 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.YlExyfzYmh27bI-dq_NDNxK0tTR_6t3_0 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17690995615458739143', time=2024-09-14T13:27:02.506230+0000, chain.objs.size()=1 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HRFG84Y23QWNTZCMUMKIsA4EOyuhJ-n_0 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9934680627538993960', time=2024-09-14T13:27:02.607599+0000, chain.objs.size()=1 2024-09-14T11:37:46.090 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.091+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ppUUeTBHTW6Er4CkZeNkoF42GQMBexm_0 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.092+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6930336695647409364', time=2024-09-14T13:27:02.647676+0000, chain.objs.size()=1 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.092+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.mCskA5TZXRfFjC2ZElg-m7ptFtRP_XA_0 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.092+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16652529710403122781', time=2024-09-14T13:27:02.665485+0000, chain.objs.size()=1 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.092+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yGRpQfrR0MrpeZS6bW-P_ZjPRxDW8iu_0 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.092+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8959466069097149440', time=2024-09-14T13:27:02.677187+0000, chain.objs.size()=1 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.092+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LtsirIaMB0NqdnJWUv9WD3FFBIqr6sX_0 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.093+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3428965745456045506', time=2024-09-14T13:27:02.684860+0000, chain.objs.size()=1 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.093+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.xSWqfMMD7JMpFHNtARezi6mpercjXan_0 2024-09-14T11:37:46.091 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.093+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.954329102914911641', time=2024-09-14T13:27:02.858045+0000, chain.objs.size()=1 2024-09-14T11:37:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.093+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TV6RB-gi8ooNECIZNACXVa44PTnAZ6l_0 2024-09-14T11:37:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4737473512399149406', time=2024-09-14T13:27:02.934455+0000, chain.objs.size()=1 2024-09-14T11:37:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BgcEZSAFY9AQSz8zNN-MWVBv5RC2Jsz_0 2024-09-14T11:37:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16530368225849027968', time=2024-09-14T13:27:07.170049+0000, chain.objs.size()=1 2024-09-14T11:37:46.092 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.271__shadow_.XV-X2JIj1qZLojHaigQIWjvkcMuq8GL_0 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3088440189223736676', time=2024-09-14T13:27:07.170788+0000, chain.objs.size()=1 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.271__shadow_.diDlpDDSGYyZFdqNllp2cCKVK4ciQIh_0 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14230397652188168795', time=2024-09-14T13:27:17.684236+0000, chain.objs.size()=1 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.lccHOemfE0ypQ_VAu8nJSk5sPlrCD-H_0 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3698585189709376619', time=2024-09-14T13:27:17.688147+0000, chain.objs.size()=1 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.xx_sArK1aMxDI3k5w6kvUIGEYkSL9D__0 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5637179337105823262', time=2024-09-14T13:27:21.441008+0000, chain.objs.size()=1 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.299__shadow_.JgLlcecJXQqPotZaAf8SMc6avHH0Aey_0 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7273327144309821036', time=2024-09-14T13:27:21.643446+0000, chain.objs.size()=1 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.299__shadow_.emcvZWSJdoPG8GroIl6zVRXtsRLjrEO_0 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13015727773720266843', time=2024-09-14T13:27:22.568731+0000, chain.objs.size()=1 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.301__shadow_.-8I9okOzXeyD0giPOvn3p5WP2MI5CSk_0 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3285199951073363789', time=2024-09-14T13:27:31.726579+0000, chain.objs.size()=1 2024-09-14T11:37:46.093 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.319__shadow:8SDGYZkdkwIDcr7vwsAK5n-RCc4VGxH_.D6A6Poel8RLLr5Q1C56XQtuieQsJE--_0 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4921296082973977831', time=2024-09-14T13:27:31.733210+0000, chain.objs.size()=1 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.094+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.319__shadow:S6mV37sELLb7uAwVH551FWDv6QOU1DT_.sXm3nKpJxMOVKfi1DlsfohXQLvV-rZv_0 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.095+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17658921820011033017', time=2024-09-14T13:27:40.785864+0000, chain.objs.size()=1 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.095+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Io919SRFULncMOPw0QrgpNk2MuGeZSI_0 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9434893759769375953', time=2024-09-14T13:27:40.796495+0000, chain.objs.size()=1 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.E29_MTM5GWZCbi4XE-WsX9VojtaBZ0B_0 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14394819510394378030', time=2024-09-14T13:27:40.932995+0000, chain.objs.size()=1 2024-09-14T11:37:46.094 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xr6jHPBAd2bGIrqY4j1ZbvomH05ZLFv_0 2024-09-14T11:37:46.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5488776073477114574', time=2024-09-14T13:27:41.037223+0000, chain.objs.size()=1 2024-09-14T11:37:46.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.aA6YemNWaI9DNPZIw73fb7H4kJ3p6sw_0 2024-09-14T11:37:46.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5454481090393230211', time=2024-09-14T13:27:41.053667+0000, chain.objs.size()=1 2024-09-14T11:37:46.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5g-wKrVe2yZwIc1EhlIZhzo1ODmnWPi_0 2024-09-14T11:37:46.095 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12383197529161240228', time=2024-09-14T13:27:41.057135+0000, chain.objs.size()=1 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.E6cGhw9Bvek6nQFDy089dfl0FCaJrGW_0 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10525587260247743348', time=2024-09-14T13:27:41.301343+0000, chain.objs.size()=1 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.G82ZikRm_V9LK5ycx3LTLT0_gGACwYS_0 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15828116245875943508', time=2024-09-14T13:27:41.439954+0000, chain.objs.size()=1 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PXyoQa3ItEKbiUB5f7gX8VwPaIV2a5Z_0 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1073222278611878193', time=2024-09-14T13:27:41.450709+0000, chain.objs.size()=1 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.096+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-c0bEbx08s1_qgLS2e-fg2W03Vmnzd9_0 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14116464017117701501', time=2024-09-14T13:27:41.550486+0000, chain.objs.size()=1 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.M0zdn0O9SJVBUAlFuAOaW00NzHGH-75_0 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.871810135273078477', time=2024-09-14T13:27:41.560835+0000, chain.objs.size()=1 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.up2craYgdf8oBrF5OrkM7oXEyZ5x-aT_0 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12026765638937628232', time=2024-09-14T13:27:41.586625+0000, chain.objs.size()=1 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.TeJ2xQPappZDxZhnLXce_Mpl8jikaN__0 2024-09-14T11:37:46.096 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9281288410370521634', time=2024-09-14T13:27:41.876988+0000, chain.objs.size()=1 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.iI6VDFxpgn5sha-8ouMIOBQyI_W52dy_0 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1197244830008652702', time=2024-09-14T13:27:41.886061+0000, chain.objs.size()=1 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.097+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wsPLJQyJGYWvzm0eHjLiQULa9MyanmC_0 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.098+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12628225855530736775', time=2024-09-14T13:27:42.067992+0000, chain.objs.size()=1 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.098+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UsaOy4FNcrP0qDDO_Kd4R1lisOXVud3_0 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.098+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14897995359366562468', time=2024-09-14T13:27:42.084029+0000, chain.objs.size()=1 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.098+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5YT3GxjkRCO6caxw7fZ6oZc85EZVzK__0 2024-09-14T11:37:46.097 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.098+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11742638070320537200', time=2024-09-14T13:27:42.089494+0000, chain.objs.size()=1 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.098+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tCW3FmU_TUFObc5rzlmmIsbE_LbZ6dw_0 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6366743161269328279', time=2024-09-14T13:27:42.090474+0000, chain.objs.size()=1 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JborvhdQrQKCzMYnuI57K-DPSxJKFws_0 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4438048752589266369', time=2024-09-14T13:27:42.102519+0000, chain.objs.size()=1 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ufd1y3_k2pep3t-WHy9VYFJUMRHoeY5_0 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7011105162654885990', time=2024-09-14T13:27:42.170440+0000, chain.objs.size()=1 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jVyuNABctTVikQArpVUOGuutIsTxPYc_0 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1178327163506945420', time=2024-09-14T13:27:42.219585+0000, chain.objs.size()=1 2024-09-14T11:37:46.098 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.099+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2X7HJwC7lIybEhK8RPC7IFACgh_Mc8K_0 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15643749440703779040', time=2024-09-14T13:27:42.315746+0000, chain.objs.size()=1 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FDrBJBA37nbU0Qw0LTbkZppWsRHM2s5_0 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6884110146358406212', time=2024-09-14T13:27:42.360678+0000, chain.objs.size()=1 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.R4eDuG_3ILtVV4mg9L0HM45E369OKSB_0 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1638016014485700501', time=2024-09-14T13:27:42.409159+0000, chain.objs.size()=1 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FWjLZp6vYeDFozsLYHft8dMVSrY95Bq_0 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8104429432793363659', time=2024-09-14T13:27:42.415231+0000, chain.objs.size()=1 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bb9dW4tMTNkL2LHXBb2zZqKXGB_VX-r_0 2024-09-14T11:37:46.099 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2850819835319853178', time=2024-09-14T13:27:42.482289+0000, chain.objs.size()=1 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.507rwpej82vDquFqsVs-33s1Fh9Rwl3_0 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12483553266196722672', time=2024-09-14T13:27:42.580243+0000, chain.objs.size()=1 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Dks7ofLhPKT3iHlOA3QWkKK26h51dsu_0 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.307198599780190048', time=2024-09-14T13:27:42.592086+0000, chain.objs.size()=1 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tFT-wPf-UUMS_dyN9Bfrc6t0GQozD6j_0 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1592015487471908758', time=2024-09-14T13:27:42.699631+0000, chain.objs.size()=1 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.100+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nFFJXc_q8RubUvWiK7hVYd-vz93yUv8_0 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.101+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2165451312781739567', time=2024-09-14T13:27:50.515399+0000, chain.objs.size()=1 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.101+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.w68TfagTMD8P4d7k8rMs-Gkhm2uMQLX_0 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.101+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12584270131203399308', time=2024-09-14T13:27:50.531702+0000, chain.objs.size()=1 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.101+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cRbCzvhIjh2JXOQLq_8Swq94eX8HwmL_0 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.101+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10815086771183343658', time=2024-09-14T13:27:50.562715+0000, chain.objs.size()=1 2024-09-14T11:37:46.100 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.101+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.x8WucEBST1Q78_Us9h_4Ol_GUrE-Mq4_0 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2938845071433547576', time=2024-09-14T13:27:50.732625+0000, chain.objs.size()=1 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rWnV62ETNwAHLp6GD7-nTS4lxUT1b-J_0 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3693525721591798365', time=2024-09-14T13:27:50.743838+0000, chain.objs.size()=1 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1Y3t-_m9JjVXj1raT9N4OlMYApGi5Ni_0 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14328172276216532490', time=2024-09-14T13:27:50.794431+0000, chain.objs.size()=1 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0MsKH60XYKuxJAopcM_5Fh_kDV5FQAT_0 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10550901559646678347', time=2024-09-14T13:27:50.809717+0000, chain.objs.size()=1 2024-09-14T11:37:46.101 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.103+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ETG9KYTXVLzrYCpt-pdXX7RyyidLobb_0 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5600738562979165039', time=2024-09-14T13:27:50.854126+0000, chain.objs.size()=1 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UCX9LKY5QyQgDG3QW5M84qB7umniGay_0 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.83246472075362292', time=2024-09-14T13:27:50.958132+0000, chain.objs.size()=1 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BsiKABjk5stT4jvubmzlemwxpPSxvPL_0 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4942843816903130450', time=2024-09-14T13:27:50.991370+0000, chain.objs.size()=1 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4MsbpvxRHM78-9WAY1c1U5ak61_FgAo_0 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1715929549293281354', time=2024-09-14T13:27:51.210927+0000, chain.objs.size()=1 2024-09-14T11:37:46.102 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4mKRYr2JADG-CmkN5zf651CubaFwAUg_0 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2632654686608600551', time=2024-09-14T13:27:51.214583+0000, chain.objs.size()=1 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.B4Dk98WuhgR0gdSdvGZlc7LcaOe2a9K_0 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8706540984126400261', time=2024-09-14T13:27:51.230288+0000, chain.objs.size()=1 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.V4-xS4E0nWeN5-DEGmrVRdk8OLQEM7S_0 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11612275249323441218', time=2024-09-14T13:27:51.276528+0000, chain.objs.size()=1 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.C9z1TnGCbdoKxe3KclwD0n5Fb-bUAuQ_0 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11357419743982865902', time=2024-09-14T13:27:51.326537+0000, chain.objs.size()=1 2024-09-14T11:37:46.103 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.104+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0s3aNokbg4CSapXMA-6GaWg6vDqE80G_0 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4216312714354541428', time=2024-09-14T13:27:51.356869+0000, chain.objs.size()=1 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.w1kG0JiFtD_HesfldzicaK8lqCAYgl3_0 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7696723903355798155', time=2024-09-14T13:27:51.366030+0000, chain.objs.size()=1 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vIIPO61bZ3-KlMXvxmBm30AUiCnO5NP_0 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16016540712351794959', time=2024-09-14T13:27:51.459921+0000, chain.objs.size()=1 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._IwAvOc7oA9Kn8o5jMb4nFQ3rchZoH6_0 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7439197833024218022', time=2024-09-14T13:27:51.611634+0000, chain.objs.size()=1 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.105+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YMQNih6Pn5ZjmTjAzx8kC_Bb8oVFQCY_0 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15897524295898831643', time=2024-09-14T13:27:51.797506+0000, chain.objs.size()=1 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rjM-DJVlIzrMw_04wG5GBbXVSXy01Jz_0 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14924134163646971346', time=2024-09-14T13:27:51.798390+0000, chain.objs.size()=1 2024-09-14T11:37:46.104 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dMApukdIWn0IBL74z-Zn2oNltKKP7-U_0 2024-09-14T11:37:46.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1027042138955164824', time=2024-09-14T13:27:51.807833+0000, chain.objs.size()=1 2024-09-14T11:37:46.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Gz-mobdir_L4AQhTkeUZWeORuLKNx9m_0 2024-09-14T11:37:46.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14158725120919969943', time=2024-09-14T13:27:51.828158+0000, chain.objs.size()=1 2024-09-14T11:37:46.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HWb3IgRILtXINnxeyVf_n-6zuPxvONE_0 2024-09-14T11:37:46.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5620243948814881161', time=2024-09-14T13:27:51.970766+0000, chain.objs.size()=1 2024-09-14T11:37:46.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.106+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tWmmiz61QuV58t5PD9PhgXnI99MCgBD_0 2024-09-14T11:37:46.105 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.107+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47075 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1560198462210883289', time=2024-09-14T13:27:52.113337+0000, chain.objs.size()=1 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dcZJgFOOIm5g3gFY8CaADkJj2q1Fc6a_0 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1518011994786858862', time=2024-09-14T13:27:52.114867+0000, chain.objs.size()=1 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xhS_NDA6fg7lsCjFPZwK2lkmmYCJyJQ_0 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5108553870436142583', time=2024-09-14T13:27:52.123311+0000, chain.objs.size()=1 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yLhkJ1xyn5yarOgecodJx4Ij3TzB8nH_0 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15634723751851819349', time=2024-09-14T13:27:52.140076+0000, chain.objs.size()=1 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Yke_CmVE_Guv_ngdHUQuv7HqP6zh3V__0 2024-09-14T11:37:46.108 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5576563321443090253', time=2024-09-14T13:27:52.250217+0000, chain.objs.size()=1 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EMlldiVBvJ6t165l-hgTX28HCPMv_i4_0 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12736066746198113088', time=2024-09-14T13:27:52.286956+0000, chain.objs.size()=1 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1IHMsQNjuUVsWuUD8190Z1xjV3GDCuE_0 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15625522410347806976', time=2024-09-14T13:27:52.288857+0000, chain.objs.size()=1 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YC0lz7ikXpNmFBdDlTuQ0enRMICH7ts_0 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.279166232680246678', time=2024-09-14T13:27:52.311604+0000, chain.objs.size()=1 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uiOhEs6Uik1DQSbzhBmH--ZguyI_8em_0 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8465542957757319024', time=2024-09-14T13:27:52.351916+0000, chain.objs.size()=1 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UxwgDSApf8u69rvU3uBZ2X7uNGochVg_0 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7972796558553274917', time=2024-09-14T13:28:17.258740+0000, chain.objs.size()=1 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.379__shadow_.6hX9trDLObwhIvjg6HoMcC1fXDge77H_0 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8811086000620833605', time=2024-09-14T13:28:45.092004+0000, chain.objs.size()=1 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.432__shadow_.DvyH9Bdobu0Hcf5KZ_RmB6P8Ovl-d3k_0 2024-09-14T11:37:46.109 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5695796545246787543', time=2024-09-14T13:29:10.597866+0000, chain.objs.size()=1 2024-09-14T11:37:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.109+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.O9S9P74yvVpQ0O0PyDr5f7UtTAv0Dmg_0 2024-09-14T11:37:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7703694868069193904', time=2024-09-14T13:29:15.443976+0000, chain.objs.size()=1 2024-09-14T11:37:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.493__shadow_.WdP0gPlkIiasvNWazx3IXygFVmmzLU5_0 2024-09-14T11:37:46.110 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12589499679209354709', time=2024-09-14T13:29:20.019631+0000, chain.objs.size()=1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.503__shadow:mTcNqOeSoMdp1SFsn-oYFj8mNhIIfUb_.m4lffY6UOEudOA076OqtE8cz_-frwwK_0 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~tBtr1wkcEjB2WYKi0vy8X9Rklj78TSH', time=2024-09-14T13:29:50.004305+0000, chain.objs.size()=2 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.529__multipart_mymultipart.2~tBtr1wkcEjB2WYKi0vy8X9Rklj78TSH.1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.529__multipart_mymultipart.2~tBtr1wkcEjB2WYKi0vy8X9Rklj78TSH.2 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11130058953233786358', time=2024-09-14T13:30:31.582069+0000, chain.objs.size()=1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.558__shadow_.5pkWQLae0nu1U6dWR1FD035y2l22egF_0 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12386256113124111703', time=2024-09-14T13:30:33.242825+0000, chain.objs.size()=1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.561__multipart_mymultipart.2~ivmE3BCbuH8QeWvbAc9JD8LDbHyUZys.1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2802028094592089819', time=2024-09-14T13:30:42.511060+0000, chain.objs.size()=1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.111+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:CWNy6hRpErX1efjBr6Rzyw1729rUNnH_.00sEPo6PAJZyfRdV5YHYpw0Xpiy1gVB_0 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10219847380215360728', time=2024-09-14T13:30:51.174294+0000, chain.objs.size()=1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:T1I43fDCdDl1MMgc8tXfSsdh8sESWQU_.p7gY-65UERA4_z4YDvZP7cJ0B6zDa3V_0 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11386545309073478864', time=2024-09-14T13:30:52.775980+0000, chain.objs.size()=1 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:xdIEl73mGDYxj7nloVe0XqsqJKu80Ou_.w_Y6Ny_vNwstNe1dYuoBZWJTe_qHLIh_0 2024-09-14T11:37:46.111 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5160942070975272127', time=2024-09-14T13:30:53.744315+0000, chain.objs.size()=1 2024-09-14T11:37:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.575__shadow_.-zJo7naLdrnOX9ZpYSe-XemoKfH62hu_0 2024-09-14T11:37:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16548439620404669763', time=2024-09-14T13:30:56.711897+0000, chain.objs.size()=1 2024-09-14T11:37:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.112+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:7412r7wK8gvBaK-fBj.tPhdarcrvogW_.OYVUoI0ECyh07E8w8qjdU4RGVshneFy_0 2024-09-14T11:37:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.113+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14440661588382246074', time=2024-09-14T13:34:08.475381+0000, chain.objs.size()=1 2024-09-14T11:37:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.113+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.671__shadow_.wILhuBoYAPBOA2rgYMDYas9jQQqDFC5_0 2024-09-14T11:37:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.113+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6800785288369025773', time=2024-09-14T13:35:37.822242+0000, chain.objs.size()=1 2024-09-14T11:37:46.112 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.113+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.777__shadow_._rlcTJEx1yEsTFJFKXG85FOfltj7ub7_0 2024-09-14T11:37:46.113 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.115+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.115 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.117+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-14T11:37:46.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.119+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.117 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.119+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48207' 2024-09-14T11:37:46.118 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7688670999996591087', time=2024-09-14T13:25:10.536998+0000, chain.objs.size()=1 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.176__shadow_.nCrNpt90E0USBhCm8MKDI7zSEMYpENY_0 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5413968590982418308', time=2024-09-14T13:25:12.685011+0000, chain.objs.size()=1 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.181__shadow_.WbgaJ2sNz0qKju-_jIKdDHxgdFP6tXd_0 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11727458847770146651', time=2024-09-14T13:26:39.789919+0000, chain.objs.size()=1 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.235__shadow_.vv0zyVXMQdVfK99ODZOZ-c_UnkAvpbt_0 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6175025090528512680', time=2024-09-14T13:26:46.417542+0000, chain.objs.size()=1 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.246__shadow_.xpvVTkTmF65SbSs8RiJDzB82Hw0CrHO_0 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2996705725902388610', time=2024-09-14T13:26:48.774983+0000, chain.objs.size()=1 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.251__shadow_.ZC41GcIsjblkDgN5NTyqZIK3elYnicE_0 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3270374574320148115', time=2024-09-14T13:26:49.215789+0000, chain.objs.size()=1 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.252__shadow_.uNqR2ai10NDtleG2VCVBxHbMmIcZ0TF_0 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14836103653272164380', time=2024-09-14T13:26:52.719023+0000, chain.objs.size()=1 2024-09-14T11:37:46.119 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.259__shadow_.wMZbEsOHY-ZFnS9WGebOlOEmjxCWGxX_0 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14594016513458258351', time=2024-09-14T13:27:01.182720+0000, chain.objs.size()=1 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.laG8JGNKaX-2JZxss47WN3sD0EBZsBc_0 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8947894082515415036', time=2024-09-14T13:27:01.194391+0000, chain.objs.size()=1 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7POKbN75taryMyY9BZKh6vQGGbmaBG5_0 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11538831388813975375', time=2024-09-14T13:27:01.212942+0000, chain.objs.size()=1 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.esR-2X4mPFWK7ELhxvvWG5dvMlBf-sJ_0 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.102719836531823731', time=2024-09-14T13:27:01.218851+0000, chain.objs.size()=1 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.99X_luVJ1GHK6JcJXsx6xGhkY6giatk_0 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15738021117828002435', time=2024-09-14T13:27:01.249496+0000, chain.objs.size()=1 2024-09-14T11:37:46.120 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.120+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lnhp_qTzJNKoS0_4sT5Lh7sONsnH3-P_0 2024-09-14T11:37:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.122+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11236634077069090905', time=2024-09-14T13:27:01.269967+0000, chain.objs.size()=1 2024-09-14T11:37:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.122+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ncr2B8kuUNAh92YufACY_9zzIveaYFt_0 2024-09-14T11:37:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.122+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12824105964687256969', time=2024-09-14T13:27:01.281821+0000, chain.objs.size()=1 2024-09-14T11:37:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.122+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.l9v1dYl80GGi0yyntCkw_RzWTdIVg5G_0 2024-09-14T11:37:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10317678644568172298', time=2024-09-14T13:27:01.302724+0000, chain.objs.size()=1 2024-09-14T11:37:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.F93o3NDjS20TtocIu8IRTf3iYpejtRp_0 2024-09-14T11:37:46.121 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16180264718810730090', time=2024-09-14T13:27:01.408981+0000, chain.objs.size()=1 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.i-QG0kdDKXp9sK7-xEy_tLcDXVn5tME_0 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3145705687564500131', time=2024-09-14T13:27:01.486090+0000, chain.objs.size()=1 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6bTmtSUONnDrAjsKkPBihanN3OwvX-f_0 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11917365235588699742', time=2024-09-14T13:27:01.652764+0000, chain.objs.size()=1 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rXwDV4ePBuDvRkpBgbHsh0TL_g7XS7h_0 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14859938462298910535', time=2024-09-14T13:27:01.653873+0000, chain.objs.size()=1 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.AuvIvtSRgxx9Vpget8-yKcXx5QbPvX0_0 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12576850564382840512', time=2024-09-14T13:27:01.673063+0000, chain.objs.size()=1 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JkoesihwxDTWjxi3Ylx1Nsz_y_iav4V_0 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4124291649917703276', time=2024-09-14T13:27:01.688565+0000, chain.objs.size()=1 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.81o1Vqy7xyYO3dNEd6kKK4zXUEk4ui__0 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13109391572923712281', time=2024-09-14T13:27:01.712308+0000, chain.objs.size()=1 2024-09-14T11:37:46.122 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sLt0XqlSCmA5rqYR1cf2WmPzdp5CIRC_0 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3991558370675424674', time=2024-09-14T13:27:01.802996+0000, chain.objs.size()=1 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.123+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8C0C5WZ4UUARwq-aZ1cEaXhXfDdWxuZ_0 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9872462647405737064', time=2024-09-14T13:27:01.892197+0000, chain.objs.size()=1 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oowqHqlC3SYnNoRMRvunj0s317uoPpr_0 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5549312135550481940', time=2024-09-14T13:27:01.937595+0000, chain.objs.size()=1 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tJBEnA1lqN8y0Mi4jFxf11KprnbCNe4_0 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14784611662654634385', time=2024-09-14T13:27:01.987826+0000, chain.objs.size()=1 2024-09-14T11:37:46.123 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aj0gd3mLE9Vqe3D7wtMdBHu6JtJDUjy_0 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9188178850968989153', time=2024-09-14T13:27:02.182119+0000, chain.objs.size()=1 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JiI0kr2dxAzEahBIPaL-EvzaiS2kfr-_0 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12670489976571141682', time=2024-09-14T13:27:02.230848+0000, chain.objs.size()=1 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ilU4N4b0L8h7RZcaJzpCbUaW5CQZmyz_0 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15837332409428099293', time=2024-09-14T13:27:02.381336+0000, chain.objs.size()=1 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kFUyjsnVeCFQKHFpnANSCXg4lH-OApA_0 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1340967743102288915', time=2024-09-14T13:27:02.440261+0000, chain.objs.size()=1 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.125+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eYCSppOLYGfeiXiOPq3wAf1dA6arOeW_0 2024-09-14T11:37:46.124 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1711807432910998029', time=2024-09-14T13:27:02.484851+0000, chain.objs.size()=1 2024-09-14T11:37:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.83eTRK7WL6PyrTxjbOtZro1LUVZVQW6_0 2024-09-14T11:37:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.947379718433568089', time=2024-09-14T13:27:02.509885+0000, chain.objs.size()=1 2024-09-14T11:37:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iyri-RM9YUWVv9s_v2mBlvf4HZVe-xn_0 2024-09-14T11:37:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1577976641349639758', time=2024-09-14T13:27:02.650526+0000, chain.objs.size()=1 2024-09-14T11:37:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gFKuwl_jVHP8cZU2pJL7CZJ-KLtiiuQ_0 2024-09-14T11:37:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2097538848646935511', time=2024-09-14T13:27:02.675830+0000, chain.objs.size()=1 2024-09-14T11:37:46.125 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.126+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bLP90zkEGiZpQ42xMEBwgtcGE59B-rU_0 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4658711360575008390', time=2024-09-14T13:27:02.704085+0000, chain.objs.size()=1 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HOZQd530VM4qf_1PR8m7zYn7mZuoLyJ_0 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13726501248093921136', time=2024-09-14T13:27:02.706638+0000, chain.objs.size()=1 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rd45u6bj3p-pAcVfevAcuA5kDaj8-DD_0 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16267733084434422993', time=2024-09-14T13:27:02.707898+0000, chain.objs.size()=1 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Tmu5v1jLUdXxXv8lFR47jI0glc9JCRe_0 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3831051431565308771', time=2024-09-14T13:27:02.716268+0000, chain.objs.size()=1 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.mS2oryHNlsWungrPK5r0F6wPMMFGY3Q_0 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14157004586506934567', time=2024-09-14T13:27:02.840645+0000, chain.objs.size()=1 2024-09-14T11:37:46.126 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eMI4mjY3qpgNi2Lor4mFq8B0apa7W7K_0 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17400789334206517032', time=2024-09-14T13:27:02.954540+0000, chain.objs.size()=1 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CU-NCFR_63Xzywb90kWDSfOLccbcFs0_0 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8688121247817261436', time=2024-09-14T13:27:03.919775+0000, chain.objs.size()=1 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.264__shadow_.At98PDGbOq7n3W996w9p45rA-kDh5-W_0 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4509449171927548332', time=2024-09-14T13:27:09.010204+0000, chain.objs.size()=1 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.127+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.275__shadow_.rrrOAKn099M0lwVOGjvTSqkFIJpCGup_0 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.128+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1006255670314146140', time=2024-09-14T13:27:10.436716+0000, chain.objs.size()=1 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.128+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.278__shadow_.cnjJCFCJOg06HAfnNh2V10PzFiczt5p_0 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.128+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7413321949371803999', time=2024-09-14T13:27:12.286300+0000, chain.objs.size()=1 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.128+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.282__shadow_.3f_a8kJKBK2zQqg4AFVZ2Vy_kgjIw-Y_0 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.128+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6309725624068387275', time=2024-09-14T13:27:17.698429+0000, chain.objs.size()=1 2024-09-14T11:37:46.127 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.128+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.4jKJgg-s6CEgjPITeYKFPKJC34lbL8w_0 2024-09-14T11:37:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8707703950111786917', time=2024-09-14T13:27:19.935789+0000, chain.objs.size()=1 2024-09-14T11:37:46.128 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.296__shadow_.3oROQF5-xjrtCcD3Hp4eCW1G2Tw3w5Q_0 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8186990545131586948', time=2024-09-14T13:27:23.496371+0000, chain.objs.size()=1 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.303__shadow_.nluCE9I54U0Uu3lpHwZOAwcBaQlg2Yh_0 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6063624320572486584', time=2024-09-14T13:27:32.833699+0000, chain.objs.size()=1 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.322__shadow_.ttyYtWzrywOhtKmyGxaZpFtFq0YiJ7__0 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11686777647166248427', time=2024-09-14T13:27:40.786926+0000, chain.objs.size()=1 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.129+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LS3OVezWndHqzt6C3ImnUNrH5hMujDL_0 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4336119507611762741', time=2024-09-14T13:27:40.793058+0000, chain.objs.size()=1 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zZ8EM8hAorAYAH0aF301m0gUoSUUqXP_0 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12922302295527093533', time=2024-09-14T13:27:40.793982+0000, chain.objs.size()=1 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Gtq8l6M1zPuaAu0EF_VNkQHUbAkKw9M_0 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8249928315876728990', time=2024-09-14T13:27:40.795194+0000, chain.objs.size()=1 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zuyF4YnnjApmMy0foeZ64v8dDYAgKKK_0 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4772342844479222231', time=2024-09-14T13:27:40.807225+0000, chain.objs.size()=1 2024-09-14T11:37:46.129 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mSFsNjA6g0VEI8w1VWHc_kpUOe98NQJ_0 2024-09-14T11:37:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4730801350898800883', time=2024-09-14T13:27:40.840053+0000, chain.objs.size()=1 2024-09-14T11:37:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nN3VowfU2Rcnh2fsl62X1Yfdd7Kh6Pc_0 2024-09-14T11:37:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9710656603666483411', time=2024-09-14T13:27:40.860631+0000, chain.objs.size()=1 2024-09-14T11:37:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8RZ9fGig-3tgnsJAhRKuG3M3RK0R6EL_0 2024-09-14T11:37:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16255305518639659800', time=2024-09-14T13:27:41.041393+0000, chain.objs.size()=1 2024-09-14T11:37:46.130 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.130+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Bfnb_pd3dhp0AJilvj2NmeU8dW4NSpB_0 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11742444672872224573', time=2024-09-14T13:27:41.053992+0000, chain.objs.size()=1 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.g1gNjBSqNhKFqQ5z3qVi8L4FG6dqFzV_0 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11852643396629620319', time=2024-09-14T13:27:41.136783+0000, chain.objs.size()=1 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qFehpfKYFrX4v0UKgeB2l86sYaWH7kL_0 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15476860561894534846', time=2024-09-14T13:27:41.184500+0000, chain.objs.size()=1 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VfIvqb9OpS3sjexoX9CRyjhxTUW72jN_0 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15743663514206062080', time=2024-09-14T13:27:41.186154+0000, chain.objs.size()=1 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.eMWxrNCF2WPpfMD1IoyzxvVsxXrdKzH_0 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11417008569376353180', time=2024-09-14T13:27:41.313938+0000, chain.objs.size()=1 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6_TczkP0TEiLcXrU-T8TJ4tww-GHXgp_0 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16475994205870886246', time=2024-09-14T13:27:41.385924+0000, chain.objs.size()=1 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.waGDxOEgSyFaihp5qyqXQ-BoKtBtDYD_0 2024-09-14T11:37:46.131 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12942330097355543218', time=2024-09-14T13:27:41.401472+0000, chain.objs.size()=1 2024-09-14T11:37:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1f0AlMLLRKa576FVFkv7aZfJcQOsoea_0 2024-09-14T11:37:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14410145269785662681', time=2024-09-14T13:27:41.433499+0000, chain.objs.size()=1 2024-09-14T11:37:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uhCBXGV1pcaEGwX0cgAi-003wZDoaBb_0 2024-09-14T11:37:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1635580675956831845', time=2024-09-14T13:27:41.556168+0000, chain.objs.size()=1 2024-09-14T11:37:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.132+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.meGElOMyM74aVCfT1-djrbbtMwUMC1k_0 2024-09-14T11:37:46.132 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.133+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1572978136474938074', time=2024-09-14T13:27:41.603899+0000, chain.objs.size()=1 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.133+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.l93RUWao7GewJA9NTEInY6t9GvSzfKf_0 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.133+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13539481407976949690', time=2024-09-14T13:27:41.634036+0000, chain.objs.size()=1 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.133+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-xZIzvrWFeeH19FBV31MrVFr8pydiXB_0 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17019921867409397613', time=2024-09-14T13:27:41.636951+0000, chain.objs.size()=1 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.v3n0poQ7bjXEPOTYfNsGUbIcpwycWk5_0 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1777573659322950807', time=2024-09-14T13:27:41.676195+0000, chain.objs.size()=1 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qGdXzMEMatVnWJ32C2CMv1OgNUq2mGt_0 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2338211502927365006', time=2024-09-14T13:27:41.682340+0000, chain.objs.size()=1 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Xh2w2bUmnFrLXDdglPA1iU0TT8kIJor_0 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2046435306501379580', time=2024-09-14T13:27:41.712295+0000, chain.objs.size()=1 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.AwVi5HZsSgHpGL2EgfECs-8hx4g-m8k_0 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7405455225711887025', time=2024-09-14T13:27:41.812659+0000, chain.objs.size()=1 2024-09-14T11:37:46.133 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.134+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.P3iFJwTjyP8ER8jYZiXbITE2BTuzAJ3_0 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5565621063599226275', time=2024-09-14T13:27:41.821707+0000, chain.objs.size()=1 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1BvdbiE5niVRIZVwshcck-8U2V2lE7k_0 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10566198813116949876', time=2024-09-14T13:27:41.828247+0000, chain.objs.size()=1 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GMVrx3KZFPr6gzHx_aHhu0E4J5pT8SK_0 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17030947613628372872', time=2024-09-14T13:27:41.877048+0000, chain.objs.size()=1 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.F7m9lmIn-6tUTIIb4fw-Y_BWX_raezM_0 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7981354450939022647', time=2024-09-14T13:27:41.908507+0000, chain.objs.size()=1 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SeYkgfV7EMHdVEBU6YDJbFIwbOqdAQs_0 2024-09-14T11:37:46.134 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10351933458656066490', time=2024-09-14T13:27:41.979131+0000, chain.objs.size()=1 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.pdCdYE1gHDJCKe5ayrJrKjMuI45xAiw_0 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2680260141643558127', time=2024-09-14T13:27:42.058162+0000, chain.objs.size()=1 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1Yb-HsWpktvPqegOV-cD-rEfk3aq1Cf_0 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2456006558562606884', time=2024-09-14T13:27:42.122616+0000, chain.objs.size()=1 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tJjiq2IB7P50eqA3YWd1earR2Z8cimB_0 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8641137427590983735', time=2024-09-14T13:27:42.126983+0000, chain.objs.size()=1 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ry7dDk3xhH2ztgj0T79kHccnGcx5I9T_0 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4700030139030932755', time=2024-09-14T13:27:42.162462+0000, chain.objs.size()=1 2024-09-14T11:37:46.135 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.135+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IulzH6U7UX5S_i4uepyiLdDHdgyOxjA_0 2024-09-14T11:37:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3337989354089657764', time=2024-09-14T13:27:42.178463+0000, chain.objs.size()=1 2024-09-14T11:37:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Lr4xCbw0-j5WS9fR_A1oAPqjEKWbm-E_0 2024-09-14T11:37:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18327165768058297039', time=2024-09-14T13:27:42.204058+0000, chain.objs.size()=1 2024-09-14T11:37:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._Dcas9QmS-GR2_JEDMS0j-tWWjtvjMH_0 2024-09-14T11:37:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17801878893640570405', time=2024-09-14T13:27:42.312679+0000, chain.objs.size()=1 2024-09-14T11:37:46.136 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Q3xay8CW7elXhWswPDyPjM271ezOvt0_0 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6675051574251175974', time=2024-09-14T13:27:42.325137+0000, chain.objs.size()=1 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rbCTdzD84nnJ_StOTs4p_RoKnn2v7zk_0 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14412129946754450669', time=2024-09-14T13:27:42.490816+0000, chain.objs.size()=1 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FrAYrBQ7TyWUtMRztkYxgoNlhD5zcCZ_0 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9250938005511453374', time=2024-09-14T13:27:42.560861+0000, chain.objs.size()=1 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.R1vOUxbzOsof1nEo3oyZAmM_DMvjWeI_0 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2067496672380402694', time=2024-09-14T13:27:42.569680+0000, chain.objs.size()=1 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.18jPbVV-EeMMbFaaRtZkiwczjZNSWS4_0 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1228944264587356444', time=2024-09-14T13:27:42.582156+0000, chain.objs.size()=1 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rWhIzOgLO6Gnq-lb1pqRhcLivibFG38_0 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11345053847958611510', time=2024-09-14T13:27:42.590160+0000, chain.objs.size()=1 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6npwROPRWK1GPsNKveyL03_VGMrn3bI_0 2024-09-14T11:37:46.137 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9188309756154119480', time=2024-09-14T13:27:42.653271+0000, chain.objs.size()=1 2024-09-14T11:37:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3pyx8omyRi5fLagJqZOx1weeY9A5MGb_0 2024-09-14T11:37:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.65090150319305706', time=2024-09-14T13:27:50.432958+0000, chain.objs.size()=1 2024-09-14T11:37:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.137+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.15q4wQ_mm2x2Nh0RtR7uSKWV7lg1Bzt_0 2024-09-14T11:37:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17851885625699711604', time=2024-09-14T13:27:50.454953+0000, chain.objs.size()=1 2024-09-14T11:37:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jD2moQFgwmRPjd57WJncsmo7FKvktTI_0 2024-09-14T11:37:46.138 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11982128023086416969', time=2024-09-14T13:27:50.458974+0000, chain.objs.size()=1 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pq5vKjqA-SArGXj-0wlKQBhP0n0BFiY_0 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.785822900711903704', time=2024-09-14T13:27:50.496055+0000, chain.objs.size()=1 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uPHg5mgOieg6_F3ztUDPt1t7QjjBqHk_0 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4606166542827807943', time=2024-09-14T13:27:50.507293+0000, chain.objs.size()=1 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.r3pE-LlgtBG2e8ic-JNsgUIIxgiGaKe_0 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16129759648533951170', time=2024-09-14T13:27:50.684053+0000, chain.objs.size()=1 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rikzaxlp_2Sk0RGzvG05LCbzxUxeo0o_0 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12595473061242267044', time=2024-09-14T13:27:50.685553+0000, chain.objs.size()=1 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oEFtgNv1Eje6o3UIWgpKOj-rN5YjVbC_0 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14351804580245544845', time=2024-09-14T13:27:50.756055+0000, chain.objs.size()=1 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.eaY17UFrkGGZXEI0-LKyZBHYO_41xLe_0 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7879402809679294682', time=2024-09-14T13:27:50.825673+0000, chain.objs.size()=1 2024-09-14T11:37:46.139 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.139+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pmhQkk72ZHa2cA0f5V8VbpzqdfUyYpA_0 2024-09-14T11:37:46.140 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.141+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48207 2024-09-14T11:37:46.141 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=54, truncated=0, next_marker='' 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8603258115925792184', time=2024-09-14T13:27:50.844203+0000, chain.objs.size()=1 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NlzMJ9vtzTCKcB42lYp8ozNqmNPFxMP_0 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13170574320398526961', time=2024-09-14T13:27:50.943104+0000, chain.objs.size()=1 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cBpAHHXB9Dd8pQmBJDiUXGTteImP-bj_0 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4636755412579712295', time=2024-09-14T13:27:50.980043+0000, chain.objs.size()=1 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._lVNMjmIKszAkM3L_JQulgUQtfqaZ_o_0 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7567413628165779669', time=2024-09-14T13:27:51.023667+0000, chain.objs.size()=1 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pH6SA3s7pWEEDBbihO0BjrqW8O3LiMS_0 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4769038081801904295', time=2024-09-14T13:27:51.044950+0000, chain.objs.size()=1 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8skkcBZLLH-eH5uAmm6MpplHJ07LzXA_0 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6747726069100799166', time=2024-09-14T13:27:51.045713+0000, chain.objs.size()=1 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hoJWD6pgnvMxVfsU4R1jJC2HFKkFRzY_0 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12412938451916708946', time=2024-09-14T13:27:51.069114+0000, chain.objs.size()=1 2024-09-14T11:37:46.142 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wpNQn1VD7edUAjSr9fqX_eNI4gwlN4E_0 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8264618449493899277', time=2024-09-14T13:27:51.080266+0000, chain.objs.size()=1 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.thwPDJjqQ1wNnNoOpo1qtKSJv3JqGc8_0 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9273518876138606081', time=2024-09-14T13:27:51.084185+0000, chain.objs.size()=1 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5gSF0c9coBQN9RtB6SuzlHs1GivMAo__0 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4339037198364913792', time=2024-09-14T13:27:51.099135+0000, chain.objs.size()=1 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.F_AXr1W0jvrsvF5dVr7s5jufWpocQI6_0 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15457114114837951762', time=2024-09-14T13:27:51.099690+0000, chain.objs.size()=1 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kFGDgtpZCrkKT87y5veAbBWel0PkZFm_0 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3121372954787686878', time=2024-09-14T13:27:51.101563+0000, chain.objs.size()=1 2024-09-14T11:37:46.143 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.143+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.o5czO4bDDSk4nMe2idv2vm49VyGns88_0 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12123549034739332134', time=2024-09-14T13:27:51.192019+0000, chain.objs.size()=1 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ys51KlaUTaKaelzfaofodWNMgDxaLYb_0 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9006976718429591619', time=2024-09-14T13:27:51.212675+0000, chain.objs.size()=1 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kze0sl_wIynXNFiQ76IyUlOh-8dczti_0 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8658441954029809718', time=2024-09-14T13:27:51.259296+0000, chain.objs.size()=1 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wpOP8GRfSiqaKRdlXwu3EChmRZjTkkF_0 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9780040840056848229', time=2024-09-14T13:27:51.275877+0000, chain.objs.size()=1 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.145+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dB9DaSamWjeoNFFKO3EFsaqLaQOjuPF_0 2024-09-14T11:37:46.144 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4451685955996761267', time=2024-09-14T13:27:51.318444+0000, chain.objs.size()=1 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dn8x11_f4WF_oOMp7_xv-Sktw6mNEjb_0 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14218922386879337058', time=2024-09-14T13:27:51.339215+0000, chain.objs.size()=1 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VI_J0F1qtrORzbt3l6GBfFfHAIAf0NE_0 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17037929330876536792', time=2024-09-14T13:27:51.367809+0000, chain.objs.size()=1 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RPkI_Eu69aTDFpRz8CKdsl589sq4yRJ_0 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10632582308469144774', time=2024-09-14T13:27:51.565956+0000, chain.objs.size()=1 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nXjM_I7noS08SS2SRiVIIja--O7RF5V_0 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2524053144838219861', time=2024-09-14T13:27:51.582721+0000, chain.objs.size()=1 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.917JJDg6L7MOcS4DJhJF8cnRtmsTFjV_0 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7685625406263959809', time=2024-09-14T13:27:51.590925+0000, chain.objs.size()=1 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7xC4ccwfPYcobDiERUQ_yEjmh0AkNNm_0 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11133445793378434760', time=2024-09-14T13:27:51.602731+0000, chain.objs.size()=1 2024-09-14T11:37:46.145 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.146+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jDWkLsQe4-KCqWOAxDhXyv0RZveNCn-_0 2024-09-14T11:37:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9985184250400467558', time=2024-09-14T13:27:51.615434+0000, chain.objs.size()=1 2024-09-14T11:37:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rt4CdsS5T46gqqAwNKsk6wH8fx91poB_0 2024-09-14T11:37:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17847927535402028419', time=2024-09-14T13:27:51.718570+0000, chain.objs.size()=1 2024-09-14T11:37:46.146 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.puFSRY4JZ_H5rgxBUHJdOPjRt6YERHy_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5500061624300910579', time=2024-09-14T13:27:51.741935+0000, chain.objs.size()=1 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.d3PrTkPIBlVelC3J-sEvuLzzhP-NTbJ_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2449101794845675766', time=2024-09-14T13:27:51.758272+0000, chain.objs.size()=1 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8Wu5znzHlRfuVf8SszvQNWatUT_uDMn_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16124771335696399424', time=2024-09-14T13:27:51.762716+0000, chain.objs.size()=1 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.147+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SpyhEDVlnAVQBYmiY3weaJHTAu3Q7a2_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12592056319301311070', time=2024-09-14T13:27:51.763785+0000, chain.objs.size()=1 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.QbpGIKo9O67BMQBi9gbU41aBBSALLJV_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18158420980702444449', time=2024-09-14T13:27:51.771821+0000, chain.objs.size()=1 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rxpT0IDvHEjtQQJdnvclUCM66F_dq4t_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6729449991981981035', time=2024-09-14T13:27:51.784503+0000, chain.objs.size()=1 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FJ91H20v8jjdyDDo3B9Gcv2wDpSO4kl_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5800864151681491143', time=2024-09-14T13:27:51.981162+0000, chain.objs.size()=1 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aDViK12qV80ZJbogK1xltlZafHDIobo_0 2024-09-14T11:37:46.147 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4755423096434079329', time=2024-09-14T13:27:52.047965+0000, chain.objs.size()=1 2024-09-14T11:37:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bjrS9c0C-rOQQcloy6RVkpOPWKUIjZE_0 2024-09-14T11:37:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12037714206137823124', time=2024-09-14T13:27:52.077261+0000, chain.objs.size()=1 2024-09-14T11:37:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Z9081QkiRD_UggHJEmQny0Mz1fjw2nv_0 2024-09-14T11:37:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14678313635097814946', time=2024-09-14T13:27:52.232384+0000, chain.objs.size()=1 2024-09-14T11:37:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.148+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.30k-bpsHe7BbEvMOWeExOEST-w-l_GW_0 2024-09-14T11:37:46.148 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.149+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17999714450137195998', time=2024-09-14T13:27:52.278423+0000, chain.objs.size()=1 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.149+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HQS_vf_yRs8q4n3HKzeikHk8AsUFIqj_0 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.149+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1538866814072312436', time=2024-09-14T13:27:52.297641+0000, chain.objs.size()=1 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.149+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.PWbBKMYKuu9zm8xG5M43IFHOjgmUxnY_0 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.149+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8109554032452164144', time=2024-09-14T13:29:10.597649+0000, chain.objs.size()=1 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.149+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.-fUAlhfrmwxzIZgjqvs0YbCGJYugYQo_0 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.149+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12486503826591807341', time=2024-09-14T13:29:12.214407+0000, chain.objs.size()=1 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.486__shadow_.eD3uTuIDfAQCFQYHxkLVC2KeNlMCjEi_0 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4378131926566556071', time=2024-09-14T13:29:24.264751+0000, chain.objs.size()=2 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.512__shadow_.DPOhU4L9POZFZH9IRnoXCwE7T65O977_0 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.512__shadow_.DPOhU4L9POZFZH9IRnoXCwE7T65O977_1 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10205114492011654858', time=2024-09-14T13:29:32.789807+0000, chain.objs.size()=1 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.520__shadow:BKkDOYlkbIoLUMfJKL4R9nv6aLZBrDl_.n_B-8Mj6s1z1sTvshfkHGqkAr2Ke_Uk_0 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9535778913649068740', time=2024-09-14T13:29:43.643884+0000, chain.objs.size()=6 2024-09-14T11:37:46.149 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.O5brrW3gwcrXUlUYmVNPTMg5Kx8CfAPC.1 2024-09-14T11:37:46.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.d8HZrSsAl40lMVbQ4rc_vrqkV5CrUpZ6.2 2024-09-14T11:37:46.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.XWbLUZmMpuRzXqkQFYzjEkdD8FcuPRRF.3 2024-09-14T11:37:46.150 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.150+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.WpFC2odvq3huxYXlcPtanrOS0CkEfcIc.4 2024-09-14T11:37:46.152 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.-zobyA9p8sEGNbw2tSc3XJ0frrcCd10c.5 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.LFhf65_OdK8jyt6m9qIKFxY9x_upEUcF.6 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17619395450660805485', time=2024-09-14T13:30:41.681500+0000, chain.objs.size()=1 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:iB7RO8RBe-az5dNdfaBZ0GDnufW4NST_.2lRvNPI1HkHWzlZrgh6HkipQ5m7KUeH_0 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15590943179808945821', time=2024-09-14T13:30:42.367939+0000, chain.objs.size()=1 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:xTPEsfCr6n55Y1oFyshUDAc9V.uz1sR_.Ii94ch3-Ywoe2tKwYDCGpQ-VI1cRP2P_0 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16003301189520704766', time=2024-09-14T13:30:42.681076+0000, chain.objs.size()=1 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.153+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:CJxlReE9oVQXoxjNa1d2gQkk.o7D4D6_.y4-AMMsCqg476Fmvvj82fGgWuh-Qfgm_0 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11448110060371391349', time=2024-09-14T13:30:45.747002+0000, chain.objs.size()=1 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:RcsDsCJIht9t57YvFcTeivLK0wmFYgZ_.V-_br1G_3HOD4JC9dnfw6hjf-9oGHEf_0 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12335891193021913275', time=2024-09-14T13:30:50.965478+0000, chain.objs.size()=1 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow_.YOF2auldmK4hOritJxN2GKfGw3ynG2l_0 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16471915013727657485', time=2024-09-14T13:31:14.047091+0000, chain.objs.size()=1 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:xvQn3zTqcnF97LfDinr-gShz.Ws7qVa_.1zE62Y29KDeLBFfl-iMMixH80PuG_JF_0 2024-09-14T11:37:46.153 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1983235149855872286', time=2024-09-14T13:31:14.061981+0000, chain.objs.size()=1 2024-09-14T11:37:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.154+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:XochpiCjvUrsO9DDGfUsop975PjzQH9_.XFmrZu9GIfHGLexOyfk5ZVQ23yhQN1j_0 2024-09-14T11:37:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.458276205853200380', time=2024-09-14T13:31:15.790399+0000, chain.objs.size()=1 2024-09-14T11:37:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.582__shadow:2AosAHI-WoIQa9sjGGaLGihui4QsKE4_.ppfeScFZhey2K54H8YCzL4a2fK4XDug_0 2024-09-14T11:37:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13171665723078817845', time=2024-09-14T13:31:16.417381+0000, chain.objs.size()=1 2024-09-14T11:37:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.583__shadow:3CGhfWcNsHp3WY-U1RxUuWddsU99sli_.rhMkRvOQTbULlKTgkD8Q-FnZewnp7Xt_0 2024-09-14T11:37:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5873747641275217101', time=2024-09-14T13:32:38.931740+0000, chain.objs.size()=1 2024-09-14T11:37:46.154 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.617__shadow_.tT88FfQlSo7pWHQoJM4bSPKpsPjW9iu_0 2024-09-14T11:37:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10803737031571007483', time=2024-09-14T13:33:39.973301+0000, chain.objs.size()=1 2024-09-14T11:37:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.619__shadow_.bky1NaH48BkAGMOxIPzbA95lrzHTnHy_0 2024-09-14T11:37:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6630536269288265326', time=2024-09-14T13:33:45.728701+0000, chain.objs.size()=1 2024-09-14T11:37:46.155 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.156+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.626__shadow_.It9V0k90xRWhChaSR2JNG43he5qvmDZ_0 2024-09-14T11:37:46.156 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.158+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.158 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.160+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-14T11:37:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.162+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.160 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.162+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46085' 2024-09-14T11:37:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_sYtye1vWEKueuzGI0tfEUdCTnB4qJin', time=2024-09-14T13:24:57.489023+0000, chain.objs.size()=2 2024-09-14T11:37:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.9oY5dfkR4bkUzx99AVNI3RTghfpBWZy_0 2024-09-14T11:37:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.9oY5dfkR4bkUzx99AVNI3RTghfpBWZy_1 2024-09-14T11:37:46.162 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_GJdECsyr9z-XWfpHUHTw9jO5q57yqmB', time=2024-09-14T13:24:57.803265+0000, chain.objs.size()=2 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.VJeLbzaq4BcKAlZURokf8POawMWpgXY_0 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.VJeLbzaq4BcKAlZURokf8POawMWpgXY_1 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15428673172891788812', time=2024-09-14T13:26:52.719132+0000, chain.objs.size()=1 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.259__shadow_.es4vj0i6owZZ-U3ZPwSu_7YPIQ1nbyS_0 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8684665320435539571', time=2024-09-14T13:26:53.212222+0000, chain.objs.size()=1 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.260__shadow_.hQq8IxLn3N_lb1L_U86y2QvZRqeyyB6_0 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11070668612717184864', time=2024-09-14T13:27:01.192133+0000, chain.objs.size()=1 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.SpJ4koFuD89X5nMv3OJ2RP_cOs9Yiu7_0 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4796631068161646606', time=2024-09-14T13:27:01.220798+0000, chain.objs.size()=1 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.j9usD3FKFK7ZSRRtPezx4e8JiWVNfE9_0 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2720925422826598262', time=2024-09-14T13:27:01.236622+0000, chain.objs.size()=1 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oQUVDo0awkvBxaG7SgOvFOaDpUGP-Mi_0 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9930257188925632040', time=2024-09-14T13:27:01.248506+0000, chain.objs.size()=1 2024-09-14T11:37:46.163 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2W5DL9c_5vteomadE7YAA9y9RsOXarH_0 2024-09-14T11:37:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7492992667835151126', time=2024-09-14T13:27:01.271935+0000, chain.objs.size()=1 2024-09-14T11:37:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gBYdmDyj_h_G8l62F4IlJ_QK-ZpJbqe_0 2024-09-14T11:37:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5556346303349709932', time=2024-09-14T13:27:01.281965+0000, chain.objs.size()=1 2024-09-14T11:37:46.164 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.164+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hkd99BAoDCfk_58eYdFY2QeITCkeEGF_0 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.75809712366176778', time=2024-09-14T13:27:01.319733+0000, chain.objs.size()=1 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.T8nbF3kP67ZjAowqXrECGU68Nqh30bF_0 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13897379905717549790', time=2024-09-14T13:27:01.444040+0000, chain.objs.size()=1 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9Gz4Xe-T2ju_KsZGP0OnVXrQnbNxMAv_0 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9581640123718472561', time=2024-09-14T13:27:01.445875+0000, chain.objs.size()=1 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VY2QiuXrDYrO_m7wZr24OgFcdo1qu6q_0 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14105431957247394422', time=2024-09-14T13:27:01.460664+0000, chain.objs.size()=1 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eSoObOWXKHlZ6cryOLj65iononWO11a_0 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12749170323660526569', time=2024-09-14T13:27:01.476854+0000, chain.objs.size()=1 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XJn60JcRhu3CurMVXVcMlbXh89T6AlO_0 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17891485284945399120', time=2024-09-14T13:27:01.530854+0000, chain.objs.size()=1 2024-09-14T11:37:46.166 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Vukoaxo-0gfc3bl0Ih54nHNfAMblwYa_0 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.402296401001228884', time=2024-09-14T13:27:01.547122+0000, chain.objs.size()=1 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bc2rEs0XC1rgy6pxlHJGudtqNUIsiSc_0 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3437276829909714046', time=2024-09-14T13:27:01.566424+0000, chain.objs.size()=1 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kGnJNAJUZPRMTGRmlzGvm34QYi6HJvp_0 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1018982120926973773', time=2024-09-14T13:27:01.656108+0000, chain.objs.size()=1 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sjwSgRPNm6PLxIx90xm6-WvB8D9SazH_0 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.269102562369264931', time=2024-09-14T13:27:01.683818+0000, chain.objs.size()=1 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.S4bS4NXfvpwg1SGdrL1utyWW7WHD-W-_0 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14458986551201376297', time=2024-09-14T13:27:01.693356+0000, chain.objs.size()=1 2024-09-14T11:37:46.167 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.167+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6IGF8UqRl4sbmUUXPM3jlT46PdIkVmX_0 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6007778702286320793', time=2024-09-14T13:27:01.701093+0000, chain.objs.size()=1 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WYAZhfwn4c8K0evAPnjok8aIn-tAjPZ_0 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3886850449091627656', time=2024-09-14T13:27:01.730441+0000, chain.objs.size()=1 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.foyEJVgi_ibJYPt3jsGUvlxDgJOchpA_0 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7320726467218762889', time=2024-09-14T13:27:01.771366+0000, chain.objs.size()=1 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ddfk34wsM0VQaKzldUdMEyR3miMcT4i_0 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1773375306674569176', time=2024-09-14T13:27:01.782778+0000, chain.objs.size()=1 2024-09-14T11:37:46.168 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DCS8J0D7dWZGy2BR5qozwRnDM8Yx6mD_0 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3917965437127012930', time=2024-09-14T13:27:01.785803+0000, chain.objs.size()=1 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tC4GYQBB0dL6wxr6k7xRaL61oYxWymA_0 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15158578997893299807', time=2024-09-14T13:27:01.912056+0000, chain.objs.size()=1 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3ffpCHGFjYhevbTYQXJkBnmEn4Mco8i_0 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6801959563091797927', time=2024-09-14T13:27:01.976555+0000, chain.objs.size()=1 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.L84TjxTBgEIpVmP92dd5HfV7NZK-qxI_0 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16395236635280708142', time=2024-09-14T13:27:02.042535+0000, chain.objs.size()=1 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6_yqeGQCqdidL75yihgyMoigjFOPrX0_0 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12493338193096388666', time=2024-09-14T13:27:02.048176+0000, chain.objs.size()=1 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.snkduSxjxfsMsC0fYVVeWHm7U543FGz_0 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2026349382573152644', time=2024-09-14T13:27:02.147790+0000, chain.objs.size()=1 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0vM_0f3lKxMKwxT9Txia9eCOeixup9P_0 2024-09-14T11:37:46.169 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11501512810992100266', time=2024-09-14T13:27:02.150937+0000, chain.objs.size()=1 2024-09-14T11:37:46.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.169+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.k4o1yrr6ZSFMqilYHFQzDa58EuAsd03_0 2024-09-14T11:37:46.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8626143643852226995', time=2024-09-14T13:27:02.168464+0000, chain.objs.size()=1 2024-09-14T11:37:46.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6faNpTEMLjT9p2irwBA6wbgzcrXEwBy_0 2024-09-14T11:37:46.170 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7350667633653988398', time=2024-09-14T13:27:02.216650+0000, chain.objs.size()=1 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ai-fA3OpzXKLFPP-PPpdZxFjdSdgTs1_0 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8816127872119683171', time=2024-09-14T13:27:02.235034+0000, chain.objs.size()=1 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eCb6LwOaao0Sk8NmPS8VOv5taUAwtbM_0 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17109773136043381465', time=2024-09-14T13:27:02.252519+0000, chain.objs.size()=1 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LCfVpY1wEd-UcvE9xxhe2kcReng5grd_0 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.917374337439813780', time=2024-09-14T13:27:02.283567+0000, chain.objs.size()=1 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5spT-cJFbDEHqKHxRe5--Qc0oQdxb8Z_0 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8490979389802000233', time=2024-09-14T13:27:02.388158+0000, chain.objs.size()=1 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8FIY5J4RG3ErzJnBIZIWWiW08Y6elvA_0 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8698334332619761111', time=2024-09-14T13:27:02.396247+0000, chain.objs.size()=1 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bKjerflJIApCTHmWWdtochjDRdGTigm_0 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1690617947154932129', time=2024-09-14T13:27:02.464871+0000, chain.objs.size()=1 2024-09-14T11:37:46.171 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.171+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1Hfft2elD9Ywq0UV2qq20zilezgVulw_0 2024-09-14T11:37:46.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.172+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16114862197370531910', time=2024-09-14T13:27:02.504348+0000, chain.objs.size()=1 2024-09-14T11:37:46.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.172+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wQW5L6l9bmTxH7Qo-Uw0tRjewfvPk5G_0 2024-09-14T11:37:46.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.172+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17667015772841399180', time=2024-09-14T13:27:02.514085+0000, chain.objs.size()=1 2024-09-14T11:37:46.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.172+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GaY5D7pbkdWgDzIIx7uWyP6RNgfexxI_0 2024-09-14T11:37:46.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.172+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7930210638864972060', time=2024-09-14T13:27:02.644129+0000, chain.objs.size()=1 2024-09-14T11:37:46.172 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.172+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Z9h-QVeHbnvUjCmbLOn5VT7GikBEJXK_0 2024-09-14T11:37:46.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1079521019848439552', time=2024-09-14T13:27:02.742979+0000, chain.objs.size()=1 2024-09-14T11:37:46.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wxBlVdDh67ojMmK5G0k6Z2hs3jDmGl1_0 2024-09-14T11:37:46.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14522087257100888355', time=2024-09-14T13:27:02.881046+0000, chain.objs.size()=1 2024-09-14T11:37:46.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.cgAf_h2HrdwGyNRwYnghPSG4obN543P_0 2024-09-14T11:37:46.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7242455276948220345', time=2024-09-14T13:27:17.688943+0000, chain.objs.size()=1 2024-09-14T11:37:46.173 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.r_ZwIQyM8UVbNc6jFHI8rJuEEr4hEFz_0 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3502748187329449494', time=2024-09-14T13:27:18.503560+0000, chain.objs.size()=1 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.t0WrLh2HsXcO_H742q4QJel2gzEb2_0_0 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14360607678528033827', time=2024-09-14T13:27:22.568672+0000, chain.objs.size()=1 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.173+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.301__shadow_.N9NkZXTo9aU-e2krCerQ5xoIPFlw00v_0 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.50270251839745635', time=2024-09-14T13:27:24.435192+0000, chain.objs.size()=1 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.305__shadow_.tf6Rjje2BcwNrExinAZIGKBPr4w8Z3A_0 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6668464421556259456', time=2024-09-14T13:27:40.783498+0000, chain.objs.size()=1 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.z5uOCAzsc3-4SNEL2uDUSt-3TJ6JwwD_0 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15617368913772380482', time=2024-09-14T13:27:40.809904+0000, chain.objs.size()=1 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.s_5uoiyiGC10aEK8TjegF1fQPJ12n3C_0 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15792991472911970433', time=2024-09-14T13:27:40.888471+0000, chain.objs.size()=1 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ovITNU3UNPgKp8mRBRmwxC8hKbEnC4X_0 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4870593932285609389', time=2024-09-14T13:27:40.912830+0000, chain.objs.size()=1 2024-09-14T11:37:46.174 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.C6aHEPzyVnVjiWlFUch0O0wrYJdnD6h_0 2024-09-14T11:37:46.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15046462843996318121', time=2024-09-14T13:27:41.112531+0000, chain.objs.size()=1 2024-09-14T11:37:46.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.174+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LdoEyMWo-Cu3m7FzQlEEeqQS5mhvJbf_0 2024-09-14T11:37:46.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.175+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10407082582415261279', time=2024-09-14T13:27:41.308572+0000, chain.objs.size()=1 2024-09-14T11:37:46.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.175+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.gZmRo9LAn00z2ee9CXZduwMZeWRisYg_0 2024-09-14T11:37:46.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.175+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14850259664871631801', time=2024-09-14T13:27:41.367305+0000, chain.objs.size()=1 2024-09-14T11:37:46.175 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.175+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.B1wnWdmVYHVD1xSQhq7HlK4pUsecJw7_0 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.175+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9954584505706286021', time=2024-09-14T13:27:41.396726+0000, chain.objs.size()=1 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.175+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ArpBRlnmVtmJtRlQ-dSRdtXpMhGMv3L_0 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7173990836476947181', time=2024-09-14T13:27:41.413636+0000, chain.objs.size()=1 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Y1m5mHnWy6iwmTiwFcg2ppY99KlI9bw_0 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17237211490923397181', time=2024-09-14T13:27:41.572289+0000, chain.objs.size()=1 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Lkgk6JHK9mtLmBasYu5_5K2acX-cL70_0 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7650144685099885178', time=2024-09-14T13:27:41.602589+0000, chain.objs.size()=1 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.i76loCXs6IloNyoxnkwVIX2fRrnr-5B_0 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6079118031679216265', time=2024-09-14T13:27:41.676281+0000, chain.objs.size()=1 2024-09-14T11:37:46.176 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xA8kz5Oz7gC5SbFZNiZiEg2-7V5SbLq_0 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16226978656212577922', time=2024-09-14T13:27:41.710742+0000, chain.objs.size()=1 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Oz-Ahp7l6yPDpi9J9BZRNJauvvIiK8j_0 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.553963274756057863', time=2024-09-14T13:27:41.825363+0000, chain.objs.size()=1 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.176+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0BiQIHHK6eL4jTCt8nEunVO0vFGzJIe_0 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.177+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16525519371690910848', time=2024-09-14T13:27:41.922014+0000, chain.objs.size()=1 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.177+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.fRGVhuvsPK4kASxcf20DFFW9TIv-a23_0 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10045734825281896298', time=2024-09-14T13:27:41.938991+0000, chain.objs.size()=1 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XXPF07mRMbIEyEwcdby6FcM9Iq55p5A_0 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2827621871847495497', time=2024-09-14T13:27:41.939757+0000, chain.objs.size()=1 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KpIkQ7usuTKgfrjshCEZTgWKd41jS59_0 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.681371955474830831', time=2024-09-14T13:27:42.080078+0000, chain.objs.size()=1 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._z8e0vBi-8Zle2ZEqpeWyHaqVnPS6Re_0 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4357635041919139884', time=2024-09-14T13:27:42.115756+0000, chain.objs.size()=1 2024-09-14T11:37:46.177 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mwRvWVvJlMNzQLoqBoUo2AjEW0F7aNu_0 2024-09-14T11:37:46.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.875182615082180862', time=2024-09-14T13:27:42.222007+0000, chain.objs.size()=1 2024-09-14T11:37:46.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wE3n4MKIGdY9To82CiyzlLGSnGOEsDl_0 2024-09-14T11:37:46.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14865591954811810831', time=2024-09-14T13:27:42.227592+0000, chain.objs.size()=1 2024-09-14T11:37:46.178 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.178+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.s3wnzOE6f9nTEnjPTE3ijdlERkpqvTr_0 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5673981215581170694', time=2024-09-14T13:27:42.309452+0000, chain.objs.size()=1 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.j1J6GButeBiK-1dJoXZKaikXccMDX05_0 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1143307957370240919', time=2024-09-14T13:27:42.362176+0000, chain.objs.size()=1 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mhWSCnVycHWOIucIa5p4n3BPx0Lj248_0 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6710314721406854910', time=2024-09-14T13:27:42.376052+0000, chain.objs.size()=1 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mM9T7uQOkJsiseLuqK2XwRXm2Ebj7GT_0 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16408785245704514978', time=2024-09-14T13:27:42.399711+0000, chain.objs.size()=1 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rVZ1aat4pL3vITyrt7yfpzCQlrtclUk_0 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9535148212093493105', time=2024-09-14T13:27:42.430643+0000, chain.objs.size()=1 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ktPqLSncZLW19aLIMdhU7sROm9HkYCL_0 2024-09-14T11:37:46.179 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1008533285672227405', time=2024-09-14T13:27:42.631662+0000, chain.objs.size()=1 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.arxPjnf9aoW0wT7CP348Zgl6v5px_UT_0 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12556488282916317912', time=2024-09-14T13:27:50.420050+0000, chain.objs.size()=1 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3w83sbNvuMPL3azOHC5Q7yprkG20_Qv_0 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16955970777100435767', time=2024-09-14T13:27:50.448650+0000, chain.objs.size()=1 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.179+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ecE2Efn5bfMU6o50Dfz9zPhPKQhlkKn_0 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14698201187966663301', time=2024-09-14T13:27:50.471595+0000, chain.objs.size()=1 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ylr1sm6g7ktjl45Xx4YP_mWejWDo8Dm_0 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2556062401454811978', time=2024-09-14T13:27:50.517756+0000, chain.objs.size()=1 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZJlJeVtLV3psyO7l5l83G9GsS9bWrHu_0 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15266204653180256936', time=2024-09-14T13:27:50.580813+0000, chain.objs.size()=1 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dOWiNf14QgNNLu8dF9zf6Zse3fCIzbz_0 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.435607380049977346', time=2024-09-14T13:27:50.677532+0000, chain.objs.size()=1 2024-09-14T11:37:46.180 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.180+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.J7u12iDrJBY0znALZlNdPLF6aShQ-iB_0 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3902713017023698682', time=2024-09-14T13:27:50.688598+0000, chain.objs.size()=1 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zbQHpg4jBMZRgXdlIktPbS3y8yOmihY_0 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12734769194211836469', time=2024-09-14T13:27:50.742872+0000, chain.objs.size()=1 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ukLwPMREA5zG1LYNw7qV_zGRRZRwK7L_0 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3788624551465554188', time=2024-09-14T13:27:50.763008+0000, chain.objs.size()=1 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7L9lPE5qMDTNtv7hi-qjuX08xRMZViY_0 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4552633365914586524', time=2024-09-14T13:27:50.776597+0000, chain.objs.size()=1 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bqj-N0b3ZK4vPQHRpk9FW1Owt4yy8NA_0 2024-09-14T11:37:46.181 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2118525990467801586', time=2024-09-14T13:27:50.797434+0000, chain.objs.size()=1 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TZHMquIPAy7xinwnThZXUIJFw3pW74c_0 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5657628104858089531', time=2024-09-14T13:27:50.838077+0000, chain.objs.size()=1 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vRwdAC-5XksCz28w_rO8jnYuUj_2mu1_0 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16727419158695109151', time=2024-09-14T13:27:51.015308+0000, chain.objs.size()=1 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8iOGg-0hN2tkYtYa5jFpfoHoJTMZUIG_0 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11613742486058028438', time=2024-09-14T13:27:51.050173+0000, chain.objs.size()=1 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Hocp3lDH3HFWCaBUPLhnAnD_PoYRPL-_0 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3000771079552698239', time=2024-09-14T13:27:51.076649+0000, chain.objs.size()=1 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5m2VSN04j9F98uNhAm25_8oJ7Pjn0FE_0 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15276420961380936564', time=2024-09-14T13:27:51.078049+0000, chain.objs.size()=1 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.WPmp-yHdfqd7LMgDZyvgaAMBPmG-rLv_0 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9213587614617850716', time=2024-09-14T13:27:51.088944+0000, chain.objs.size()=1 2024-09-14T11:37:46.182 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.182+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._G2j9MI1llewNi41srtKgDSlr6nOEGx_0 2024-09-14T11:37:46.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.183+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12903406471252493714', time=2024-09-14T13:27:51.206169+0000, chain.objs.size()=1 2024-09-14T11:37:46.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.183+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zFebWzPAJLL32nPQwdjv4JjhYKX8UM0_0 2024-09-14T11:37:46.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.183+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9097384632066029401', time=2024-09-14T13:27:51.254400+0000, chain.objs.size()=1 2024-09-14T11:37:46.183 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.183+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5Rbs9mGNmV9yiPidNySP5Evzi5_Y4z7_0 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3684863527256548878', time=2024-09-14T13:27:51.358498+0000, chain.objs.size()=1 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.caw-chw46ddIIc4-LvmCGox-s1yw1Wd_0 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1337917102743576281', time=2024-09-14T13:27:51.452959+0000, chain.objs.size()=1 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aNHLmc_v5wJDjtaQJ2_qVmfjbFsWn-x_0 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6571680469551955033', time=2024-09-14T13:27:51.503320+0000, chain.objs.size()=1 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gk3klmfIYxcBzjBFKQKSOFmmbx54MYW_0 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12389340327504906539', time=2024-09-14T13:27:51.539699+0000, chain.objs.size()=1 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hP5A8JbXkb_wsKnz2WOia5X0G5mSLJ__0 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14180780820311307888', time=2024-09-14T13:27:51.708690+0000, chain.objs.size()=1 2024-09-14T11:37:46.184 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.184+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.K9H8dMaN38EuY_20BIMtsX6fPuB7ohx_0 2024-09-14T11:37:46.185 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.187+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/46085 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7727885101305931083', time=2024-09-14T13:27:51.731692+0000, chain.objs.size()=1 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.c_XXe5t-q8dOZ9h0mGRGEpatGcLHzev_0 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17614162717911678285', time=2024-09-14T13:27:51.732240+0000, chain.objs.size()=1 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pVGhQPx2GQQCjU-ompCz_um4ll-J2hr_0 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6975583355512144563', time=2024-09-14T13:27:51.762529+0000, chain.objs.size()=1 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.IEkiWRwWwsuXCM_Yekw6RTzRUtlDh94_0 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15262384056599093882', time=2024-09-14T13:27:51.778286+0000, chain.objs.size()=1 2024-09-14T11:37:46.187 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GGeIGrbJBs-VXU9JX4lODPcRTsPhalh_0 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2608119446686569851', time=2024-09-14T13:27:51.799291+0000, chain.objs.size()=1 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LEcWxWuBXlRLXbm-I1Z8CNF50ZeYL2i_0 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12319435358762163310', time=2024-09-14T13:27:51.820988+0000, chain.objs.size()=1 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ms4-i6ivTRPJS49W6g4nUWvE3o_vCdJ_0 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8418498517888237233', time=2024-09-14T13:27:51.863019+0000, chain.objs.size()=1 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8f9_RE_Bc3yyzwYyAsjXEPvgR8kL-Ck_0 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16874195540405520987', time=2024-09-14T13:27:51.874187+0000, chain.objs.size()=1 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.psiZj4GLzOBWtM5rk2aDN4_ruyk01Rf_0 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11264349812407226243', time=2024-09-14T13:27:51.961234+0000, chain.objs.size()=1 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3nq1lcAbQlE2IaI5gtNyVw5TBdGJUY7_0 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9521086735611467197', time=2024-09-14T13:27:51.975665+0000, chain.objs.size()=1 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.q7ggrKnz-I9XJ7r-HhfCMhQR8eUM51a_0 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16795341834194567222', time=2024-09-14T13:27:52.041519+0000, chain.objs.size()=1 2024-09-14T11:37:46.188 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fTxlEf2GXg0oFR1R3pDsUFUrggEPzno_0 2024-09-14T11:37:46.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13146206641346842039', time=2024-09-14T13:27:52.212031+0000, chain.objs.size()=1 2024-09-14T11:37:46.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.189+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.epXp-GWrmeEFamDY-7ZqZBnFHZUuJSF_0 2024-09-14T11:37:46.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.190+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.436508752562665907', time=2024-09-14T13:27:52.226033+0000, chain.objs.size()=1 2024-09-14T11:37:46.189 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.190+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BS6xmztu6_o1vmzrpJQ77ULgEU0F_qv_0 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15336837081259002974', time=2024-09-14T13:28:44.082402+0000, chain.objs.size()=1 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.430__shadow_.lM-ncBc8vczycz0SyN6yrpF0qsuy_Le_0 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1101268179259676369', time=2024-09-14T13:28:50.038986+0000, chain.objs.size()=1 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.442__shadow_.RPIzRAMSTTSzt_4ZEon0f4FlTW26BGG_0 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11605809005199029506', time=2024-09-14T13:28:58.252357+0000, chain.objs.size()=1 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.456__shadow_.nYihn93fbFG-5cwhba81AFKqKHH0eDV_0 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17674463828402967474', time=2024-09-14T13:29:44.662883+0000, chain.objs.size()=3 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~p4Xxwv-zLtgxxpFiAye7Ca1dwEq_Jeq.1 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~p4Xxwv-zLtgxxpFiAye7Ca1dwEq_Jeq.2 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~p4Xxwv-zLtgxxpFiAye7Ca1dwEq_Jeq.3 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~fCbkudoVfJy4QRCc76pdd8Uybc8KGxj', time=2024-09-14T13:29:52.829963+0000, chain.objs.size()=1 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.534__multipart_mymultipart.2~fCbkudoVfJy4QRCc76pdd8Uybc8KGxj.1 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1190730318664059362', time=2024-09-14T13:30:27.288545+0000, chain.objs.size()=1 2024-09-14T11:37:46.190 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.551__shadow_.NGn443xgZXJgfUEl1q3ro_zA_1starF_0 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6658253525056721388', time=2024-09-14T13:31:03.670401+0000, chain.objs.size()=1 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:E7HlVYjGbjX9JeWQEadtXSLGiz4kmyI_.OztLRY0MarNwRcjPPE57m10uzUtrDj4_0 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15077950028220249155', time=2024-09-14T13:31:19.154294+0000, chain.objs.size()=1 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.191+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:aY2.rzh42GxK8elZWOVdnKtib6Y3Xh2_.doMegLA2gDnzo2jROobhi2mG_9UhbAw_0 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.192+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11938382940636012913', time=2024-09-14T13:34:19.931687+0000, chain.objs.size()=1 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.192+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.699__shadow:4Unh8Zc.TdAeTvvAudt6qEUtQW7kboa_.bAZ1BHuCFZOdnApUA0jZFLJkYFBDZfU_0 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.192+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.667805823594811162', time=2024-09-14T13:35:13.198381+0000, chain.objs.size()=1 2024-09-14T11:37:46.191 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.192+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.748__shadow_.bQOSGQV_oyyYxZbZ0mdlPe0DTb0ImTx_0 2024-09-14T11:37:46.192 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.194+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.194 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.196+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-14T11:37:46.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.198+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.196 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.198+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47192' 2024-09-14T11:37:46.197 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_q9YeIiL34Xx4vH19Z3-uRryIzNS6ahS', time=2024-09-14T13:24:57.187867+0000, chain.objs.size()=2 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.cTkfC-dm5YE3Fbj8go4FQK6F3s_-4dP_0 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.cTkfC-dm5YE3Fbj8go4FQK6F3s_-4dP_1 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15487366123373747209', time=2024-09-14T13:25:11.842547+0000, chain.objs.size()=1 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.179__shadow_.9Lk9sr6mZzmdA4DeNReNNxCyPQUatiZ_0 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2169452166255943341', time=2024-09-14T13:26:40.267967+0000, chain.objs.size()=1 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.236__shadow_.KOUwVPBshFB5TEcRF3a2Ox4Zw6owNyz_0 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14367569617297025617', time=2024-09-14T13:26:43.306242+0000, chain.objs.size()=1 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.241__shadow_.vujcLzhf_WdVXN6zrZ-9pWJVFlqVrbz_0 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13057699557671471701', time=2024-09-14T13:26:48.295739+0000, chain.objs.size()=1 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.250__shadow_.YpkAJ5OkoP2cMjgwOa1XkQ0i7-J6uaq_0 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12322646876969811986', time=2024-09-14T13:26:49.704356+0000, chain.objs.size()=1 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.253__shadow_.2jLcKkZg7bcnLXkhrLcSQZhB_AvZnQd_0 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5484137929915945361', time=2024-09-14T13:26:52.271048+0000, chain.objs.size()=1 2024-09-14T11:37:46.198 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.258__shadow_.s0v_v2FsnteN1DreMhPmPoyj3E9f8HJ_0 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3055717099161532841', time=2024-09-14T13:27:01.183616+0000, chain.objs.size()=1 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZgBEmHdD4qkAi5sEKlH-f1-xcerPsMJ_0 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12044865359024245097', time=2024-09-14T13:27:01.189908+0000, chain.objs.size()=1 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MIPC5hO0Fa0-NTRF6LDxpOtcCQre997_0 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.244965378836218211', time=2024-09-14T13:27:01.258382+0000, chain.objs.size()=1 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.xqDT1ZAW2haYyGy5T9_rjKINwBBpOzL_0 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11592025698745698400', time=2024-09-14T13:27:01.302910+0000, chain.objs.size()=1 2024-09-14T11:37:46.199 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.199+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wAOgWSsBugyACPMVIIpEkWa8rTM2K2M_0 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13408401966078653996', time=2024-09-14T13:27:01.308685+0000, chain.objs.size()=1 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JHx-KOm97pz7lIcjPbqOwZoh9PK7shR_0 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13882632461755773486', time=2024-09-14T13:27:01.409006+0000, chain.objs.size()=1 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.j2BBG53QHVk-OQCGXIAtQGzomzPKCVQ_0 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6370868674997328250', time=2024-09-14T13:27:01.420476+0000, chain.objs.size()=1 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.P0Dg9OoxUACYh6JSy4I1rjMJw-T4IlR_0 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11970002447395356448', time=2024-09-14T13:27:01.426747+0000, chain.objs.size()=1 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.R9WVQbin4UEAr0RHd_Mt5UusQL_p41e_0 2024-09-14T11:37:46.200 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6552083836421974135', time=2024-09-14T13:27:01.469187+0000, chain.objs.size()=1 2024-09-14T11:37:46.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.202+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aXWRCeaDsyiA245Ww9fJsKItx_fs10Q_0 2024-09-14T11:37:46.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.203+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18190555148830385764', time=2024-09-14T13:27:01.486183+0000, chain.objs.size()=1 2024-09-14T11:37:46.201 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.203+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.a-6izitSGqjIl32-MYp9oFaBVZVD6N5_0 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11326696367687605155', time=2024-09-14T13:27:01.662836+0000, chain.objs.size()=1 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.b1eA2axLO_H_VJWpUJ_6U_IimasWMLF_0 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2982177013451768974', time=2024-09-14T13:27:01.705002+0000, chain.objs.size()=1 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZjDm9OmYjsDROp1_MLp_bg1WrrfqdQj_0 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14731855470732862861', time=2024-09-14T13:27:01.725799+0000, chain.objs.size()=1 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ATakvPxIDTwV6Eo3Uimf0EUgD_kbu2F_0 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6688927036401900', time=2024-09-14T13:27:01.752598+0000, chain.objs.size()=1 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.cBHoSGQLmRY9u5GFf7FY0YIuf3iXk9N_0 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4935028199459010776', time=2024-09-14T13:27:01.768045+0000, chain.objs.size()=1 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sfHN_cN9ERwpf1LehxWq-g8pVDPW4qD_0 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6396261371047783661', time=2024-09-14T13:27:01.891580+0000, chain.objs.size()=1 2024-09-14T11:37:46.202 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Q3FxHc5CrWMkKOKIHT4wOUH6oNOY5SQ_0 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1035566186733790080', time=2024-09-14T13:27:01.905295+0000, chain.objs.size()=1 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.litjh2RCc0-SzYfE1wQ-qaH9pFdaeyt_0 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12698733793008205597', time=2024-09-14T13:27:01.938677+0000, chain.objs.size()=1 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JBRHWv9gefhAbp7gu4g9vLI9hAB_7DI_0 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6290634052979979247', time=2024-09-14T13:27:01.954921+0000, chain.objs.size()=1 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FXvrPd0BSQ5PUrWfr8GqIWWv7FkYC6P_0 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6613515766964369023', time=2024-09-14T13:27:01.991808+0000, chain.objs.size()=1 2024-09-14T11:37:46.203 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.204+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FY7PXPVKm1r1VWBMzgGH7av816Z5Hai_0 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.205+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4358892012589356162', time=2024-09-14T13:27:02.024302+0000, chain.objs.size()=1 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.205+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ah3m_5hp-R_dtbdXoEuiIenwo00wjDH_0 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.205+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16407819529783253631', time=2024-09-14T13:27:02.134131+0000, chain.objs.size()=1 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.205+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tKG9UNmK1XopGiNPR_yzs_upw8PltK1_0 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2439110733672527208', time=2024-09-14T13:27:02.180083+0000, chain.objs.size()=1 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Sg5MJVoF5Zz5ODWmLIE1Iqi0XU56oJ9_0 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11885621468010627462', time=2024-09-14T13:27:02.227309+0000, chain.objs.size()=1 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iiS_tifmTur42HM4M9_J9COsV9K3BGf_0 2024-09-14T11:37:46.204 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16290875142027504531', time=2024-09-14T13:27:02.231776+0000, chain.objs.size()=1 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7zQR2NpPGJTt3TkqC43Vz0Bn0z5kSTl_0 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6294570530833103440', time=2024-09-14T13:27:02.246932+0000, chain.objs.size()=1 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DW-J_e31gkDUhTpH7y1tw1G1rCSAUnx_0 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1584972027438203829', time=2024-09-14T13:27:02.424358+0000, chain.objs.size()=1 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3uho08f3NTWYb_ZxkRYoae0d6q0PeFS_0 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9630973025970423720', time=2024-09-14T13:27:02.425243+0000, chain.objs.size()=1 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZpsX99iFqoYcPIkbJwg2gyc_uxSES6P_0 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5964557959989072994', time=2024-09-14T13:27:02.467031+0000, chain.objs.size()=1 2024-09-14T11:37:46.205 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.p24wf5HBQH345OsCJkwDgOTLkcGetjk_0 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6697675736339977514', time=2024-09-14T13:27:02.481191+0000, chain.objs.size()=1 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ez_p40FeumK0KRTyfQCFhDY6SizWG3F_0 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.295102556515375989', time=2024-09-14T13:27:02.604543+0000, chain.objs.size()=1 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MZfgh2w40YN3mJwQNmzFMtunKd1G5wt_0 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18327966878069835936', time=2024-09-14T13:27:02.607331+0000, chain.objs.size()=1 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.206+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OvX5CMPedctNbRJ6Tqs5rjPDeAPzQwF_0 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.207+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2576764660160567173', time=2024-09-14T13:27:02.672652+0000, chain.objs.size()=1 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.207+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iki_LC3cFW2Sasn4q-W3iAcaNigQ701_0 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.207+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15585039028895637300', time=2024-09-14T13:27:02.686575+0000, chain.objs.size()=1 2024-09-14T11:37:46.206 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.207+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZvZWWWdk1jddZXQm7e3GxkZVMKNdC41_0 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2677986430441283610', time=2024-09-14T13:27:02.716538+0000, chain.objs.size()=1 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.RC5-JvZFCA2Wi8sQbx1ZDw11NlUGWyu_0 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15835732347642976764', time=2024-09-14T13:27:02.726525+0000, chain.objs.size()=1 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZyprGsEByN5UdlaH82eiJHqVWecO1x-_0 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1276532215346121617', time=2024-09-14T13:27:02.835358+0000, chain.objs.size()=1 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NIQHD2sa6fdOUELZYacGZl4ozjlweSv_0 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14909038165329153165', time=2024-09-14T13:27:02.859313+0000, chain.objs.size()=1 2024-09-14T11:37:46.207 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.208+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vfCXBKEQvwgUkjLvYicA7GD8mXucc28_0 2024-09-14T11:37:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12919440431195735476', time=2024-09-14T13:27:02.918487+0000, chain.objs.size()=1 2024-09-14T11:37:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EGugSXrHedIRWkVLm8pAqsB3c4YGy6v_0 2024-09-14T11:37:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9297154171635749465', time=2024-09-14T13:27:02.931292+0000, chain.objs.size()=1 2024-09-14T11:37:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.E9cdvYPqXMFWauEzPAl9Gt-VWNcDhY-_0 2024-09-14T11:37:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8099119883953015843', time=2024-09-14T13:27:10.435867+0000, chain.objs.size()=1 2024-09-14T11:37:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.278__shadow_.KTBpSqfmNjJa_iiB60dcP0R9VCCgZcu_0 2024-09-14T11:37:46.208 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15157520058977356924', time=2024-09-14T13:27:10.436768+0000, chain.objs.size()=1 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.278__shadow_.ulcRNSE8G51QxurqZj9eGFn_OcD__gj_0 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11216858836326433997', time=2024-09-14T13:27:11.840428+0000, chain.objs.size()=1 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.281__shadow_.IiFurb1pQvVByUzqlwxHkj90_8D6sRS_0 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2407209517803725521', time=2024-09-14T13:27:14.293639+0000, chain.objs.size()=1 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.286__shadow_.Agr1Cpd2m5z5jwMEROW6iH5ceMRn7-x_0 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9871368931867458299', time=2024-09-14T13:27:18.502251+0000, chain.objs.size()=1 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.209+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.GBdA_3GlRaQMJyOmwW-eokxLsVUkGLc_0 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.210+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9345858953627669495', time=2024-09-14T13:27:23.974494+0000, chain.objs.size()=1 2024-09-14T11:37:46.209 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.210+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.304__shadow_._1d6DZ-vYYYu3vz9Qy_XV-FpWd39Ra6_0 2024-09-14T11:37:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6600811276691173768', time=2024-09-14T13:27:40.787388+0000, chain.objs.size()=1 2024-09-14T11:37:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2R6QBra7qLFgMoGL-My_PiAWOsVPv02_0 2024-09-14T11:37:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11240347936435221694', time=2024-09-14T13:27:40.854258+0000, chain.objs.size()=1 2024-09-14T11:37:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.x3iW2QJTCblcgOUdb38M-FEXGA4HhMA_0 2024-09-14T11:37:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14396309768333821410', time=2024-09-14T13:27:41.095102+0000, chain.objs.size()=1 2024-09-14T11:37:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1nBYZE-oVlKrB7oq3Z5k2UsdcIQhsLW_0 2024-09-14T11:37:46.210 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17389685874241131803', time=2024-09-14T13:27:41.100623+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mGF5FbNvin3L93OUec6bO2p85AP-uKM_0 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8771525569765921040', time=2024-09-14T13:27:41.329079+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t2LhjGTEbC3unrfcyzZqwCpSHqEu616_0 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3131980640650958462', time=2024-09-14T13:27:41.696663+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QIKXYjHEF9BYRuElVkUVEchLtrywUB7_0 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4791632309881874662', time=2024-09-14T13:27:41.705363+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PwwcYiSka0jAgjQgV711OxhRURDL6Mt_0 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10621841084585204291', time=2024-09-14T13:27:41.953792+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BAHTPsM-R4fhUh3PGIs_KPKlvWKnXyy_0 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2049840050357287837', time=2024-09-14T13:27:41.960188+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LqwSVEUA8W7p76q42w82IzjVF8iqukX_0 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14172521007430954723', time=2024-09-14T13:27:41.977736+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qF-xfZmxTNOCIX7Q5fD3BvuGq6xec9m_0 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7556935183174787337', time=2024-09-14T13:27:42.158062+0000, chain.objs.size()=1 2024-09-14T11:37:46.211 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.211+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.u2hUoYsTT6gG3OXuAFHHXIG6awZNMZf_0 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.212+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14369142893308997877', time=2024-09-14T13:27:42.168665+0000, chain.objs.size()=1 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.212+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bEk5H35ob8VZeQ3rwY5Hf8X2AySXeS3_0 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7542484725640691827', time=2024-09-14T13:27:42.213847+0000, chain.objs.size()=1 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xlNPdDoQh-gf0L_ZD8fHlXT92loRSz7_0 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12649470532048461581', time=2024-09-14T13:27:42.322612+0000, chain.objs.size()=1 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QbiR9JckseMB53TAChzc3PcRdJUxkJZ_0 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5537116519132146824', time=2024-09-14T13:27:42.327283+0000, chain.objs.size()=1 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JVHR9XLBtEwCW7i7_aVw1a0RVi4MsuH_0 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4021680388861299578', time=2024-09-14T13:27:42.395890+0000, chain.objs.size()=1 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ryYRRSXYMBWgFR_eUqU5BTS6aEsuRXA_0 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10472327552484725114', time=2024-09-14T13:27:42.424490+0000, chain.objs.size()=1 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NWB5xPInyO8yuLuAmoa4CWV8mUEv53L_0 2024-09-14T11:37:46.213 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8359245555123114602', time=2024-09-14T13:27:42.426616+0000, chain.objs.size()=1 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0Sz48Wif4q8mEJCghb-Utrzy-OjGKGf_0 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2711292994229117510', time=2024-09-14T13:27:42.629077+0000, chain.objs.size()=1 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.66TxLxOXIQ4s7EaQ94EBpefCZCJmdNQ_0 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6811864986241881751', time=2024-09-14T13:27:42.651004+0000, chain.objs.size()=1 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ja7whdlkmiMOz0rFkPoHUwWe2hXXWRg_0 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18420420053957841742', time=2024-09-14T13:27:42.694874+0000, chain.objs.size()=1 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UCJh8YEORRNgEr362FgVA-i1v1u_1Dl_0 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.333767213391280964', time=2024-09-14T13:27:50.416135+0000, chain.objs.size()=1 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.213+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9LeARleUhb2pNdGCQmzt_Ga6ZZXZqiM_0 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.214+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10905065298546688643', time=2024-09-14T13:27:50.450126+0000, chain.objs.size()=1 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.214+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lsFMTmtHUlwtZf5uAsyb5OxPjAH0O9O_0 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.214+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4631459339304723860', time=2024-09-14T13:27:50.487531+0000, chain.objs.size()=1 2024-09-14T11:37:46.214 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.214+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ajEPOgfpxp6mT97iH4607c8KE46LUXO_0 2024-09-14T11:37:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11974481849870540354', time=2024-09-14T13:27:50.685765+0000, chain.objs.size()=1 2024-09-14T11:37:46.215 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3gKBev65j24lxmkBs2EST2wna7Z8D-k_0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5364753715355380835', time=2024-09-14T13:27:50.754685+0000, chain.objs.size()=1 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xHLPBkBEbxKtf5c6Gj6KvLY_2Unj4in_0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5959923619651206044', time=2024-09-14T13:27:50.830655+0000, chain.objs.size()=1 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-GCt0w4Lov9Rg_WsKcuPa2G6lVM8D21_0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3461411552407241628', time=2024-09-14T13:27:50.962938+0000, chain.objs.size()=1 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.215+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GM3Ppj_mGXT62a4vhHug16NlNuq7HQd_0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7275947547985227873', time=2024-09-14T13:27:51.023430+0000, chain.objs.size()=1 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0Va4dMGHMEZzMTM3YF7TKjVvzwOz_L__0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11322129424503955157', time=2024-09-14T13:27:51.091848+0000, chain.objs.size()=1 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.v427HQ8bFpsLixDbYlLurm5GaeArFBV_0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10064711468588544319', time=2024-09-14T13:27:51.233598+0000, chain.objs.size()=1 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CcJC0hxBC2F9wFEa7T23EHrt1bbTNKe_0 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17571345853877142549', time=2024-09-14T13:27:51.304064+0000, chain.objs.size()=1 2024-09-14T11:37:46.216 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dZTATRWaCOcaESSSUcwuh3Umw3zsbmc_0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15574712665591742328', time=2024-09-14T13:27:51.350189+0000, chain.objs.size()=1 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.f04XB1a57iA0HqB6z5mqcKeFRJmuuyl_0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14424060211574278134', time=2024-09-14T13:27:51.365878+0000, chain.objs.size()=1 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.V49g4Pg1bPdJnha8NgncUjFvYju7hS__0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.676191778504289900', time=2024-09-14T13:27:51.471633+0000, chain.objs.size()=1 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.216+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Fn9KUIGlgc-krm6X2WKDfPuUSdQ0otO_0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4721145971963962114', time=2024-09-14T13:27:51.488646+0000, chain.objs.size()=1 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0ziEZhI-n8sr7h8GP5lh0AvEMqx7nSM_0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17879982991195865925', time=2024-09-14T13:27:51.581276+0000, chain.objs.size()=1 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8S74OXQsli2N6ivcuDCY1uaFzfA37yH_0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13917200602602295349', time=2024-09-14T13:27:51.712306+0000, chain.objs.size()=1 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LA8T2zKCQys_tcJ5ZW0DU2y1yx_CDar_0 2024-09-14T11:37:46.217 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7633620734273266506', time=2024-09-14T13:27:51.748577+0000, chain.objs.size()=1 2024-09-14T11:37:46.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.217+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZF2hK6pZJTJShPQLupjKfRgBV9JYT7L_0 2024-09-14T11:37:46.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.218+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.246503659180808383', time=2024-09-14T13:27:51.756121+0000, chain.objs.size()=1 2024-09-14T11:37:46.218 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.218+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.t2ciPYPwtTOA2XrTkSh4J7hKCrQ2OGx_0 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16731031589467344297', time=2024-09-14T13:27:51.775752+0000, chain.objs.size()=1 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.PNsa6ukGuBTejE-8SJqrXgL6tihnFwh_0 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.707590545839553212', time=2024-09-14T13:27:51.864560+0000, chain.objs.size()=1 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SH01emHogMHZ-4Nbl1AktTakNePtx0Z_0 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15958630274527452479', time=2024-09-14T13:27:51.970916+0000, chain.objs.size()=1 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LTolufsfaFZ5CHFUygo_02woqoij0v6_0 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7244607882009931574', time=2024-09-14T13:27:51.975697+0000, chain.objs.size()=1 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.13OBETptTGIrrf_1BB2VUq0y_LkMAMY_0 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12293712349224496998', time=2024-09-14T13:27:52.032709+0000, chain.objs.size()=1 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CRR7INvdLVqIG1ZxWn5J73k2E0nNaO5_0 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11268136796311298941', time=2024-09-14T13:27:52.290714+0000, chain.objs.size()=1 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.IPEHhWjqkadcLT_ptLwmrjYdNbRpk3l_0 2024-09-14T11:37:46.219 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8652137259921992643', time=2024-09-14T13:27:52.346231+0000, chain.objs.size()=1 2024-09-14T11:37:46.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.219+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7DAC0rtoE-IujHL2OD6_RGzEddUixus_0 2024-09-14T11:37:46.220 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.221+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47192 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=15, truncated=0, next_marker='' 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14211494603722045084', time=2024-09-14T13:27:52.350840+0000, chain.objs.size()=1 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gj1qsvBY747HZ-2yJL6ee4PbrjX5zXK_0 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5500848588726965565', time=2024-09-14T13:27:58.872309+0000, chain.objs.size()=1 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.339__shadow_.ZLXRXQNfityUw1-DVCNWlqfKHuVQUMn_0 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6571775477119496206', time=2024-09-14T13:29:10.604254+0000, chain.objs.size()=1 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.wZtmDIoYcjzaYmKZhc4qZQQeqnFMnDs_0 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.209217521500776292', time=2024-09-14T13:29:16.164953+0000, chain.objs.size()=1 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.495__shadow_.DudgC6zcgd35BNBOO3o0a_ST93UKmJ9_0 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10263951514004020925', time=2024-09-14T13:29:20.019322+0000, chain.objs.size()=1 2024-09-14T11:37:46.222 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.503__shadow:mTcNqOeSoMdp1SFsn-oYFj8mNhIIfUb_.m4lffY6UOEudOA076OqtE8cz_-frwwK_0 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4720538323825749434', time=2024-09-14T13:29:20.211562+0000, chain.objs.size()=1 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.503__shadow:mTcNqOeSoMdp1SFsn-oYFj8mNhIIfUb_.m4lffY6UOEudOA076OqtE8cz_-frwwK_0 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14231276993493710029', time=2024-09-14T13:29:22.427699+0000, chain.objs.size()=6 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.1 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.2 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.3 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.4 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.5 2024-09-14T11:37:46.223 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.223+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.6 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11802062964119427464', time=2024-09-14T13:29:49.367648+0000, chain.objs.size()=1 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.528__shadow_.0_nkw434aAT9DqdTcHtnUB6mlYmYFv0_0 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7463893053140012216', time=2024-09-14T13:30:52.258873+0000, chain.objs.size()=1 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:SJ5AUVZhb536yMVL0Z6JGXsSr7Urhkg_.uQpGc4U4z9KaOvLp2ZBKViyoaJqy78V_0 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11090712486439024801', time=2024-09-14T13:31:14.024752+0000, chain.objs.size()=1 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:Mg2g9YGALTipT-RFu8fSj3ySVjPiKww_.AzGnt8w8aWcvTXglLOwFp4iTWy9NS-W_0 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4306953030490019676', time=2024-09-14T13:31:14.048817+0000, chain.objs.size()=1 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:bpBYqfc6soXKDwhzpw-lwtyctsWm9nd_.LGtlEO2x43uN6OKcPFCrYH81SpY0zqo_0 2024-09-14T11:37:46.224 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13008929083640711207', time=2024-09-14T13:34:59.796310+0000, chain.objs.size()=1 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.225+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.742__multipart_mymultipart3.2~Ff2EIY5L32ZTn-yoBvJHBl8ubv7rlCP.1 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.226+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8382118956114508128', time=2024-09-14T13:35:17.675109+0000, chain.objs.size()=1 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.226+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.755__shadow_.cKmyhiKF7hNLOtd24pmBxC0FOedU8Ik_0 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.226+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8134935125557688802', time=2024-09-14T13:35:37.114109+0000, chain.objs.size()=1 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.226+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.776__shadow_.gQW1TBLig0JbEzD_OUfTaA9q2kot5oA_0 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.226+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17659394366748247014', time=2024-09-14T13:35:38.448079+0000, chain.objs.size()=1 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.226+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.778__shadow_.G3Clhk8I0z17Izygqek5AJl5BfMAct1_0 2024-09-14T11:37:46.225 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.227+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.227 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.229+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-14T11:37:46.228 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.230+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.229 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.231+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48613' 2024-09-14T11:37:46.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2294159390189678281', time=2024-09-14T13:24:51.421128+0000, chain.objs.size()=1 2024-09-14T11:37:46.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.147__shadow_.tuQfGxyHEUrIkaA5v7zB_o-cJNAB8My_0 2024-09-14T11:37:46.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_IWNa0sxFCWx1aDfNSGBCcaoT6Fol4lF', time=2024-09-14T13:24:57.955966+0000, chain.objs.size()=2 2024-09-14T11:37:46.230 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.FOiid4DsyxVsG08xJNTXXHjJIlIcMWs_0 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.FOiid4DsyxVsG08xJNTXXHjJIlIcMWs_1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11157780385890623505', time=2024-09-14T13:25:02.078179+0000, chain.objs.size()=1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.170__shadow_.GzjLPeOoRugx7hTVc66LcwbNJHsoD0r_0 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.129657620503305324', time=2024-09-14T13:26:38.012379+0000, chain.objs.size()=1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.231__shadow_.VttwMUx5elXn_0mU-mNkjGsLMICFig4_0 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13081285868683282155', time=2024-09-14T13:26:38.898310+0000, chain.objs.size()=1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.233__shadow_.28K3nAg1MwD7IaW_UyTrvDHBuMQ9FFu_0 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16369241702793164805', time=2024-09-14T13:26:40.268221+0000, chain.objs.size()=1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.236__shadow_.QhlHZ_UlYyEXK9oCrevIlsXQSR1vy61_0 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14352336490337781121', time=2024-09-14T13:26:43.784410+0000, chain.objs.size()=1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.242__shadow_.a4ncrNz0ene3_bwXl8L2eloy4JhuOny_0 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12677728736738560596', time=2024-09-14T13:26:45.455710+0000, chain.objs.size()=1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.244__shadow_.u_EJyMCAEr7fMSfHfOQnsrHyznB6LWH_0 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13267970563437040256', time=2024-09-14T13:27:01.165014+0000, chain.objs.size()=1 2024-09-14T11:37:46.231 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.zoHu2u2Vvvg-jUXFufjM7MqCKSTEBqJ_0 2024-09-14T11:37:46.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14913954343626471835', time=2024-09-14T13:27:01.216970+0000, chain.objs.size()=1 2024-09-14T11:37:46.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wKzy8JlcNuwi0MRUZYpYTrgpDlxynhy_0 2024-09-14T11:37:46.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14991829704466000160', time=2024-09-14T13:27:01.246995+0000, chain.objs.size()=1 2024-09-14T11:37:46.232 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.232+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ozFDwZQswauaLcykrUG8X882QKBh4Vb_0 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3183738472497065780', time=2024-09-14T13:27:01.260979+0000, chain.objs.size()=1 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-vmQ4a3UmNLSdybz0kyiwMJ_XUQdkxX_0 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6289459758929703016', time=2024-09-14T13:27:01.459906+0000, chain.objs.size()=1 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.urFixZJ29_UwGDrYyOsJX_McRK0Yor6_0 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12432171229749903536', time=2024-09-14T13:27:01.499402+0000, chain.objs.size()=1 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.O2HiWd7RT4NZ9nsR7XAJGRUlpZIEt0O_0 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13603511043114980011', time=2024-09-14T13:27:01.506580+0000, chain.objs.size()=1 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pmpZ5QV1IQ1a4qSUaQkdVkdBl-9ZrEp_0 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13923827694510636761', time=2024-09-14T13:27:01.551203+0000, chain.objs.size()=1 2024-09-14T11:37:46.233 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.234+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rOSp3DXaldMYLyscttTknFoLpcyfPDI_0 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8808107662307389381', time=2024-09-14T13:27:01.558060+0000, chain.objs.size()=1 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NIQJQnupke1iZcnz5DA_wSk0zKBc8yw_0 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12154332704257311309', time=2024-09-14T13:27:01.675557+0000, chain.objs.size()=1 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3ySiJjuFPFK9klA4_HPXVWfQXCg-uSU_0 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8929860389477726109', time=2024-09-14T13:27:01.717198+0000, chain.objs.size()=1 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Esc_fggacbhXQIRHtkxGIE9ewRyq3mp_0 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8598572879827172328', time=2024-09-14T13:27:01.729810+0000, chain.objs.size()=1 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GQ9BgS6pOdDWBD76YWvRTN41-rEzJ6c_0 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3723471440727967428', time=2024-09-14T13:27:01.749775+0000, chain.objs.size()=1 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TGa_ulm7oGmsoevXuwmDiwpz8wW4GYj_0 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2284992713637978234', time=2024-09-14T13:27:01.753862+0000, chain.objs.size()=1 2024-09-14T11:37:46.234 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.235+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.owjjf3D32Fvqrp3cy7tiEvETyq7ccEg_0 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.236+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10112149876005747578', time=2024-09-14T13:27:01.919271+0000, chain.objs.size()=1 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.236+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5QOUI5AtnjxEnCt907CwhuRRI2xf1JG_0 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.236+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5283568137187383954', time=2024-09-14T13:27:01.931565+0000, chain.objs.size()=1 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.236+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.40gIiVFLY3skerWBCMt7PhRAVDIPBbZ_0 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.236+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8305681671100915736', time=2024-09-14T13:27:01.934738+0000, chain.objs.size()=1 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.236+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Zuzxaqe7mOKJd90BlpS56hZ6qib2nJ4_0 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17159366137107715431', time=2024-09-14T13:27:01.989522+0000, chain.objs.size()=1 2024-09-14T11:37:46.235 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CzEKX580IjXiBfTF2TG4HMTbIMoheGt_0 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11090739783317282884', time=2024-09-14T13:27:02.035291+0000, chain.objs.size()=1 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IjJ2C7axagrtxA5Iu1ivOhmaRd6BmcF_0 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17927910955701371394', time=2024-09-14T13:27:02.128298+0000, chain.objs.size()=1 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZdrCvytlO8XEQ5BZdnwGswKoj6DAWMh_0 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6973982439021841740', time=2024-09-14T13:27:02.133485+0000, chain.objs.size()=1 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7ZGMWTtWGt0Fd0ysXe_lsYL-REZGvjh_0 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5412836574773560288', time=2024-09-14T13:27:02.143022+0000, chain.objs.size()=1 2024-09-14T11:37:46.236 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.48jr37p88QFGyFywIO6UMSYNRWP43DT_0 2024-09-14T11:37:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11527588712836723515', time=2024-09-14T13:27:02.151961+0000, chain.objs.size()=1 2024-09-14T11:37:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EHF1nZ5jky_4VPPOnQwaGun8WwerJ5a_0 2024-09-14T11:37:46.237 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18070367363222763203', time=2024-09-14T13:27:02.156517+0000, chain.objs.size()=1 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7N17648u0fU_3sD5BmHtJowACQXEm7b_0 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2513864837895946900', time=2024-09-14T13:27:02.159399+0000, chain.objs.size()=1 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.237+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8vnDEraGTnmI-PA70u7tXvkkqmtQNkM_0 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.238+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4396510914054599221', time=2024-09-14T13:27:02.188983+0000, chain.objs.size()=1 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.238+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NqyHaGLeWTKWESC9ctbhZgnqLrZurzp_0 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.238+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10198063623101403885', time=2024-09-14T13:27:02.417728+0000, chain.objs.size()=1 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.238+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bT3AdJrZn2vnKBPrXprmTyUtQE-bFtJ_0 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9478968090546749416', time=2024-09-14T13:27:02.436472+0000, chain.objs.size()=1 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yMD7JCLnc7ca3Rt3Doiw5_2ED4upKvH_0 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7147433529455741310', time=2024-09-14T13:27:02.469530+0000, chain.objs.size()=1 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Pd25_TnBiUPJlh-itlcF1loFcdap2i5_0 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.990980155990943524', time=2024-09-14T13:27:02.470714+0000, chain.objs.size()=1 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IXxluDhEdM9QYNIi8tXqv_sw4KeQlco_0 2024-09-14T11:37:46.238 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8418542522320019656', time=2024-09-14T13:27:02.491869+0000, chain.objs.size()=1 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZA26hxEY45ZKDr2GjTAgX8qA4uh7M-X_0 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12423313232765817256', time=2024-09-14T13:27:02.605977+0000, chain.objs.size()=1 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CwnLgGBR399nvygpo69IEc32zBvMeOG_0 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8897713804502165548', time=2024-09-14T13:27:02.643786+0000, chain.objs.size()=1 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.T0IQ_uNIXUk8KU36vu8_8_cnNDve02P_0 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11692922303097806583', time=2024-09-14T13:27:02.645224+0000, chain.objs.size()=1 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nn5SkbYOQL3_qXa-H45Ag6vN81QCkuk_0 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10413258525280919192', time=2024-09-14T13:27:02.665015+0000, chain.objs.size()=1 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.koHr09DBir34YTID9J99teBCCER8CWG_0 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10255665196673076834', time=2024-09-14T13:27:02.730278+0000, chain.objs.size()=1 2024-09-14T11:37:46.239 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.239+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.h3m4WUihf7WdQakUkWXFNpucnRuAeXm_0 2024-09-14T11:37:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14417693068153287819', time=2024-09-14T13:27:02.898761+0000, chain.objs.size()=1 2024-09-14T11:37:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iIf4DYlQa94kAONia-sDDWNFcpurCIe_0 2024-09-14T11:37:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.340680098954925328', time=2024-09-14T13:27:02.928323+0000, chain.objs.size()=1 2024-09-14T11:37:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.y3zAmL5kgRZbAEKcR4LBSHtApEtDgm2_0 2024-09-14T11:37:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18223336144094804291', time=2024-09-14T13:27:02.956101+0000, chain.objs.size()=1 2024-09-14T11:37:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5OsFdtp_CxE0w5P4uq1JNLKbDbiHbPK_0 2024-09-14T11:37:46.240 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7325427818160782057', time=2024-09-14T13:27:06.650867+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.270__shadow_.F-He6ddDUA9kRUThRxzFr5jiPXyBgKO_0 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3018313555484234787', time=2024-09-14T13:27:07.616404+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.272__shadow_.XF2PxfHe_B5DeeWB8f0J1XNtuZL1SPe_0 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12053571935751373541', time=2024-09-14T13:27:09.009092+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.275__shadow_.I0X2QVf3wP3HVMu7OevciCWcb-vyu-9_0 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16444655224948234454', time=2024-09-14T13:27:09.989401+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.277__shadow_.5_N5jpi9cjisVEmoSodIvyGHS2C22lM_0 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12873868356292339475', time=2024-09-14T13:27:11.391195+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.280__shadow_.QhtZIZaB4nIlRJZB9r3PjjJ2UCpw-___0 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2362751207502837493', time=2024-09-14T13:27:18.971616+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.294__shadow_.31OaIGTvzeePKexiJwhdATsDzt2SBDc_0 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4723054238719115103', time=2024-09-14T13:27:19.452772+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.295__shadow_.X9MyG-aPGsjTooCsXGBiZWP0ZCv_VkJ_0 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7281346020524333513', time=2024-09-14T13:27:20.417372+0000, chain.objs.size()=1 2024-09-14T11:37:46.241 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.241+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.297__shadow_.p8AZ36bvcb4eCKRYvMDgZ4Fn1GtZKn5_0 2024-09-14T11:37:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.243+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3388689451767576332', time=2024-09-14T13:27:22.075630+0000, chain.objs.size()=1 2024-09-14T11:37:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.300__shadow_.zJNFDC37N2yHSmbl1_Q_OMdHIBwcG7u_0 2024-09-14T11:37:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2697034491023013405', time=2024-09-14T13:27:40.778205+0000, chain.objs.size()=1 2024-09-14T11:37:46.242 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NJCmrWjb2tpvT35vgexpkiLGnoHvWo3_0 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3884815797639797905', time=2024-09-14T13:27:40.784047+0000, chain.objs.size()=1 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.N2L98jqVLIhIeOzZ291iTwY-IHhw7Af_0 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2059701926493185727', time=2024-09-14T13:27:40.900752+0000, chain.objs.size()=1 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5ocrb3TKQmtF1ipY5Fj5umBTd3njVBH_0 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5431138308080307216', time=2024-09-14T13:27:40.942409+0000, chain.objs.size()=1 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.A9qEOTQfWP6XAy8z1bKr6flR21LZzEk_0 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12966239536318032029', time=2024-09-14T13:27:40.946410+0000, chain.objs.size()=1 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.V_13m5TwmqOG7cS6j5bofemwgbvTt5F_0 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11298606383150507795', time=2024-09-14T13:27:41.150840+0000, chain.objs.size()=1 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4pzUxcb5F2qo8g9_aCdX4RndVkc0RnG_0 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3096651279613812177', time=2024-09-14T13:27:41.152568+0000, chain.objs.size()=1 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.srtuCNuvfNzLTyuCKvHkpoYA9ffiUon_0 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2192064572927248353', time=2024-09-14T13:27:41.317644+0000, chain.objs.size()=1 2024-09-14T11:37:46.243 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yVNAv8egawIAREDPJvyiMPKdz2SqNs-_0 2024-09-14T11:37:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2374274714261845422', time=2024-09-14T13:27:41.342819+0000, chain.objs.size()=1 2024-09-14T11:37:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.S2BErodcRPamxin0tts9A3-b4vgVfMQ_0 2024-09-14T11:37:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2689297046890367031', time=2024-09-14T13:27:41.347328+0000, chain.objs.size()=1 2024-09-14T11:37:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.244+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3-BmSNq4Kdvb00dvbcBpLuMODrdHdIp_0 2024-09-14T11:37:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10008949581345040998', time=2024-09-14T13:27:41.420747+0000, chain.objs.size()=1 2024-09-14T11:37:46.244 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sczQPpY8U0FluLsHNwyYTgeWhw-feTq_0 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14481087940812369076', time=2024-09-14T13:27:41.438827+0000, chain.objs.size()=1 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HwGVLVmmKeHpxzIy_TtmHhshrn3Wnci_0 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17278600022341552245', time=2024-09-14T13:27:41.455515+0000, chain.objs.size()=1 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1Fi82Ik5NVBlffF_u4TVJMgZfbHHViv_0 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9201038631294958550', time=2024-09-14T13:27:41.460307+0000, chain.objs.size()=1 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.245+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Aqwyui2ITEkZAr_nrYnjhEX6MmiTZSO_0 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11854181878839236267', time=2024-09-14T13:27:41.579758+0000, chain.objs.size()=1 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1L6l_F9qYCPWW2Q5TukUjCYqNYyMD66_0 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15033592465755613169', time=2024-09-14T13:27:41.597056+0000, chain.objs.size()=1 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OzYlmvsjnSP_JELDuuQwZI1sA6R8ZcT_0 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11645486191358587581', time=2024-09-14T13:27:41.626387+0000, chain.objs.size()=1 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PtOwjUqNw5rnHwFWU0UYtOd5UYIeArq_0 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10297201484712400110', time=2024-09-14T13:27:41.658675+0000, chain.objs.size()=1 2024-09-14T11:37:46.245 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HvRe9bAj5KSCFU_BoeGamhsp6FmpFvU_0 2024-09-14T11:37:46.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4844942945618152597', time=2024-09-14T13:27:41.687403+0000, chain.objs.size()=1 2024-09-14T11:37:46.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ho1xOaZd8YTACcVx_K8lHDsl0HWFLDo_0 2024-09-14T11:37:46.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11425512752775771380', time=2024-09-14T13:27:41.688009+0000, chain.objs.size()=1 2024-09-14T11:37:46.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qn6Gw7WEiBz8XVv37yqIPvn2f2pLRyo_0 2024-09-14T11:37:46.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1797775949858207648', time=2024-09-14T13:27:41.857709+0000, chain.objs.size()=1 2024-09-14T11:37:46.246 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.246+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uHmxMPixnvfpuXGqgqe5bJBjar5K76A_0 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.247+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6784105055344423673', time=2024-09-14T13:27:41.873755+0000, chain.objs.size()=1 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.247+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rh-itqNIIctr8j8_2XA5BExi1IR9OiW_0 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.247+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8683562389972816983', time=2024-09-14T13:27:41.952992+0000, chain.objs.size()=1 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.247+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.onTmuzBr9BXNtc-O23mygHslYvZDjQV_0 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4093899746759881244', time=2024-09-14T13:27:41.970656+0000, chain.objs.size()=1 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vL0DIw5jhZDZ-OK11yLq7FgRlEezxK6_0 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13604117750647994277', time=2024-09-14T13:27:42.058705+0000, chain.objs.size()=1 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Is5zYvfpGw6ZMC2M551ibKDHvuTnomq_0 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6905701412269258400', time=2024-09-14T13:27:42.076014+0000, chain.objs.size()=1 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5ZgXGvIRqIOBqAZVd5NZsUuf5h13HsX_0 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17524791151486417826', time=2024-09-14T13:27:42.158156+0000, chain.objs.size()=1 2024-09-14T11:37:46.247 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.s5E8gi6VnfOJXn_V1WNHx1le5WPKTwr_0 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13032942886830214912', time=2024-09-14T13:27:42.184051+0000, chain.objs.size()=1 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ELupq4GHx-N8-yRsErk_wiEgc16s5bI_0 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5225698325776611328', time=2024-09-14T13:27:42.608806+0000, chain.objs.size()=1 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WORLJCejJJsDCOA8jjdpO1Wck_jUqYG_0 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9719087422007925772', time=2024-09-14T13:27:42.679874+0000, chain.objs.size()=1 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KtR2QPywKbH3wge5uhcun1urrgYR_xQ_0 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8962524491997486940', time=2024-09-14T13:27:42.693523+0000, chain.objs.size()=1 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9RRMlsejSuo-RaMmbYwsPYL9fpIr5Ov_0 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16695448088931572280', time=2024-09-14T13:27:50.416180+0000, chain.objs.size()=1 2024-09-14T11:37:46.248 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.248+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yQRxk6rLtqaOnxLBwPQUN7ewmcgliVK_0 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.249+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4670455089210487369', time=2024-09-14T13:27:50.427812+0000, chain.objs.size()=1 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.249+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-M-XEp1wbL3_dtYi9z05uUNhNxCEsH8_0 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.249+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1549694373916964878', time=2024-09-14T13:27:50.494179+0000, chain.objs.size()=1 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.249+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.E6-TXQAxBG_g3neYOQbTSFacM8zVIur_0 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.249+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5868165155864795250', time=2024-09-14T13:27:50.494834+0000, chain.objs.size()=1 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.249+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oDqCGZuRJFkbI-dtv7exCFn2mHv2fLO_0 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.250+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1908168539219014775', time=2024-09-14T13:27:50.586322+0000, chain.objs.size()=1 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.250+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4CAn7pWK-RqMDIEkua3UFLP2xB6Ddye_0 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.250+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17961157765289083763', time=2024-09-14T13:27:50.934484+0000, chain.objs.size()=1 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.250+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gS6ik3YeHHHXuScl73SZI9vcb9bhjqe_0 2024-09-14T11:37:46.249 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.250+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17292797527944789338', time=2024-09-14T13:27:50.970007+0000, chain.objs.size()=1 2024-09-14T11:37:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.250+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wHD0Coiiw96oKAFOVKoZ_95jZKwHCsr_0 2024-09-14T11:37:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14100331839093741331', time=2024-09-14T13:27:51.082959+0000, chain.objs.size()=1 2024-09-14T11:37:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.QIxx-q6Y3YwTd82t5NN1K2xZyYlceMX_0 2024-09-14T11:37:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14285045789861650508', time=2024-09-14T13:27:51.100950+0000, chain.objs.size()=1 2024-09-14T11:37:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wTZ1SGiIoLGpb7NCn6S4iw2uIkJHDzo_0 2024-09-14T11:37:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17706928211233082046', time=2024-09-14T13:27:51.526016+0000, chain.objs.size()=1 2024-09-14T11:37:46.250 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nxoqkZXXVFRHa074KufgSvSHcr_uYeI_0 2024-09-14T11:37:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10950568148772982189', time=2024-09-14T13:27:51.549641+0000, chain.objs.size()=1 2024-09-14T11:37:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lDrfp-UhHUtqo6tCLw7PVzKD5gzFW78_0 2024-09-14T11:37:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4886669489312625761', time=2024-09-14T13:27:51.590826+0000, chain.objs.size()=1 2024-09-14T11:37:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.izwHF8Rtr86qQ_zad1Lfy-1tjuscn2-_0 2024-09-14T11:37:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12545204881740475360', time=2024-09-14T13:27:51.610819+0000, chain.objs.size()=1 2024-09-14T11:37:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.251+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EIuPoNGslLM-QHUnPyM_p708xWDnCFd_0 2024-09-14T11:37:46.251 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.253+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48613 2024-09-14T11:37:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T11:37:46.253 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13168357844378342606', time=2024-09-14T13:27:51.727983+0000, chain.objs.size()=1 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.u32VC7ZQWhFFfqLMXveYHFAeT4ciUtA_0 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2561526115057679758', time=2024-09-14T13:27:51.811988+0000, chain.objs.size()=1 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bQyls64AF_Q1y2xwkxgZtpon74oSyG3_0 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5280528728256057316', time=2024-09-14T13:27:51.827183+0000, chain.objs.size()=1 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qHqnEP9fJUjgRKx0AdIhLhOYDUt2_TL_0 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16638854539187602037', time=2024-09-14T13:27:51.881010+0000, chain.objs.size()=1 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iSeQv9ewZCCTVg3p4C8MzHVthecPZr3_0 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1381283284509037117', time=2024-09-14T13:27:51.883861+0000, chain.objs.size()=1 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Uzb5TF4UxpWXkphnDgWBx-S4y7Y7G1Q_0 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7764289365777387853', time=2024-09-14T13:27:51.990187+0000, chain.objs.size()=1 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Q11Li8pTVS0BiB3Q5AkRFynoZoTvDFw_0 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.692631847963214392', time=2024-09-14T13:27:52.046575+0000, chain.objs.size()=1 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LaSfGNoTevGXsdll4vfiH0mnijiA8Ts_0 2024-09-14T11:37:46.254 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4521057264434399025', time=2024-09-14T13:27:52.086563+0000, chain.objs.size()=1 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.y35QakdY2T5NCS_WeKK_xkAYmMYSZUP_0 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14949308750961401459', time=2024-09-14T13:27:52.094578+0000, chain.objs.size()=1 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Nax87ifyd1qQEbGff-uukJtkCsz0x9o_0 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6260299790881832994', time=2024-09-14T13:27:52.219984+0000, chain.objs.size()=1 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Uko0tjny5aP3pfS2PSumopcpYhaUMq1_0 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2511442727969868724', time=2024-09-14T13:27:52.230384+0000, chain.objs.size()=1 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yRUZL9mcENzVcOhN4DPuS1amvg38fTZ_0 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10318317343415434905', time=2024-09-14T13:27:52.252417+0000, chain.objs.size()=1 2024-09-14T11:37:46.255 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.255+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5RZYV9BmpWNnW7NOxEIXzOfefcbJnjH_0 2024-09-14T11:37:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.256+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13219598135057744671', time=2024-09-14T13:28:12.790074+0000, chain.objs.size()=1 2024-09-14T11:37:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.256+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.372__shadow_.JXrxkIX9SDhu75nhS4tgPxznkFzJexV_0 2024-09-14T11:37:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10581887429217326996', time=2024-09-14T13:29:10.604539+0000, chain.objs.size()=1 2024-09-14T11:37:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.Qa5VP258Z_m3pL0ncGBCq3A33sL3Bho_0 2024-09-14T11:37:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13220422805296770237', time=2024-09-14T13:29:12.737589+0000, chain.objs.size()=1 2024-09-14T11:37:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.487__shadow_.f9YRlNZwDc4yds7C5AuJX3x0gdXHzoO_0 2024-09-14T11:37:46.256 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13354704926290850059', time=2024-09-14T13:29:13.285761+0000, chain.objs.size()=1 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.488__shadow_.oYAxHybj3nAiTj6SQ2MS5GiYe_P2OGk_0 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2106370697665489257', time=2024-09-14T13:29:18.089042+0000, chain.objs.size()=1 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.257+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.499__shadow_.jpRN5exid2x3IAJ9dE4BZpZNcU9j1KR_0 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10679957710370557466', time=2024-09-14T13:30:28.955674+0000, chain.objs.size()=1 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.554__shadow_.Q11y1n4IlZ68BeXa_1QhpCkcdcQ8uM-_0 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4826825832925366885', time=2024-09-14T13:30:29.925902+0000, chain.objs.size()=1 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.555__shadow_.UE-bqObxvUgz0eD3QPETeJl3ODyRKJf_0 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11030351868710182982', time=2024-09-14T13:30:32.327174+0000, chain.objs.size()=1 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.559__shadow_.0SA-NelESVbqnkRgq_gdf3UVj8hxa38_0 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13778206275051389637', time=2024-09-14T13:30:52.538971+0000, chain.objs.size()=1 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:Zx11WVbXo2bOw2JjMqp6LmtYlnA.5gS_.xSgdI7BpV3Gk8T-S_warI_SONDUYXdw_0 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6874800341048997362', time=2024-09-14T13:30:59.730285+0000, chain.objs.size()=1 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:EB0UtM6mBcsNSvXMh.DJ.F-q5MhSyHH_.ZOFLHDAjV2VIt2UTVGcYPc-ofa32HHf_0 2024-09-14T11:37:46.257 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.556244042644820938', time=2024-09-14T13:31:03.153459+0000, chain.objs.size()=1 2024-09-14T11:37:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:5dXxYPDnQ40-6RZI.wePdCGL4KjAH2S_.iB8-vaoqVQ7JEAH6V9yZKiOJEg4teiV_0 2024-09-14T11:37:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17125042373222759962', time=2024-09-14T13:31:03.863526+0000, chain.objs.size()=1 2024-09-14T11:37:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.258+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:dhJPs743R7DshuNxlsUpXR39.wrO9c6_.VPF1n3yWAd0wiM3OiOBUPDWueIjl5Di_0 2024-09-14T11:37:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.260+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.82347811855745870', time=2024-09-14T13:31:14.061397+0000, chain.objs.size()=1 2024-09-14T11:37:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.260+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:9oWK-6Re5MGoViEId6w9xp.iRdWFlbU_.V5y2vkivs0Hdyd1Cyb2nkF7JJxX9bSj_0 2024-09-14T11:37:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.260+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3767351631021871526', time=2024-09-14T13:33:52.280460+0000, chain.objs.size()=1 2024-09-14T11:37:46.258 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.260+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.641__shadow_.YXrdrHdewTtFN6ZhPpPbW_HRKKaLFem_0 2024-09-14T11:37:46.259 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.261+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.261 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.263+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-14T11:37:46.262 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.264+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.263 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.265+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51070' 2024-09-14T11:37:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.688014045526335995', time=2024-09-14T13:25:01.052006+0000, chain.objs.size()=1 2024-09-14T11:37:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.166__shadow_.SmQld453VBbQEIsMi53O3-2hpiJAuxK_0 2024-09-14T11:37:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13033430493988105798', time=2024-09-14T13:26:41.904932+0000, chain.objs.size()=1 2024-09-14T11:37:46.264 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.238__shadow_.V4--u08-az7AmxUWq4xs4-lx6znbqaC_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11146127921729412926', time=2024-09-14T13:26:43.783230+0000, chain.objs.size()=1 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.242__shadow_.4sFA6KY4m0Igdw9jfD_ly3Z9_gTKiJm_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16105362303911008506', time=2024-09-14T13:26:48.295943+0000, chain.objs.size()=1 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.250__shadow_.IuTj58-H5stxsHpGzdfMmWVVOYt3W2S_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14039434275384100951', time=2024-09-14T13:26:50.355503+0000, chain.objs.size()=1 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.254__shadow_.zDB1CTuMihCSUszA4gT2nmxS_rO7BGf_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4328330864920833200', time=2024-09-14T13:26:50.837118+0000, chain.objs.size()=1 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.255__shadow_.RcnPRxXlM86aW5RZb9ZA18y1tsjSdae_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18340821929599791021', time=2024-09-14T13:26:53.691147+0000, chain.objs.size()=1 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.261__shadow_.WRa0lC8yQ_3WEXp4w-2Aj4lsWFgpXPJ_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7958011219798504975', time=2024-09-14T13:27:01.238153+0000, chain.objs.size()=1 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.c-TlESWljKUluMYH_etBpmmR7K8BkDf_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13882644105503229652', time=2024-09-14T13:27:01.293293+0000, chain.objs.size()=1 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.euGSFaE3LUJMyEv0UE7pG-8hUwq5BzP_0 2024-09-14T11:37:46.265 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12662798166823138364', time=2024-09-14T13:27:01.294599+0000, chain.objs.size()=1 2024-09-14T11:37:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.z2gsT8-RcMvJ_kfSTxPblwMIT66b-2h_0 2024-09-14T11:37:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8814386075304662642', time=2024-09-14T13:27:01.489396+0000, chain.objs.size()=1 2024-09-14T11:37:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9mCxNQKmwDLidtqxt0lETlU_6xDPCOx_0 2024-09-14T11:37:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10369607569922887385', time=2024-09-14T13:27:01.507976+0000, chain.objs.size()=1 2024-09-14T11:37:46.266 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.266+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1MqwBgi-IexbKKIdrba4uPCdU3UPK1S_0 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13352828253562361606', time=2024-09-14T13:27:01.528680+0000, chain.objs.size()=1 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.X7GPdrF4TMK35lm97Om6Qmi8upAt0nx_0 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15878325366967777239', time=2024-09-14T13:27:01.674532+0000, chain.objs.size()=1 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1nt2T7K_ZadzVl2i2iLeH_Tp2JQNOx0_0 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8610681312022116550', time=2024-09-14T13:27:01.709518+0000, chain.objs.size()=1 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OHP7DcP-ugXwzJCtpaIconWqYUvYwip_0 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13929053639010832028', time=2024-09-14T13:27:01.715668+0000, chain.objs.size()=1 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rethPx5su9Q7gu7kDPaQAybK-s-myCS_0 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9789091489306573139', time=2024-09-14T13:27:01.719342+0000, chain.objs.size()=1 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IWJsJPqf-ef9gEkJGJVbZUwposr4FwX_0 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3519053836145002098', time=2024-09-14T13:27:01.723908+0000, chain.objs.size()=1 2024-09-14T11:37:46.267 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-YDrAkA7jDQvuxSLS03FwKiwKsThYSX_0 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.366668174473522236', time=2024-09-14T13:27:01.760162+0000, chain.objs.size()=1 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nqHDmIPG9B74_a03HWiaiUy6-d7Vog5_0 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1100782534917199525', time=2024-09-14T13:27:01.795851+0000, chain.objs.size()=1 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.mVgu8KMwwtpRz-x6dVZ6DLO47bjOpal_0 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5470780449179955978', time=2024-09-14T13:27:01.901958+0000, chain.objs.size()=1 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DEMj4WmD9EJUj-oapviyCY2hq6hi_VK_0 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17687688739640975455', time=2024-09-14T13:27:01.918074+0000, chain.objs.size()=1 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-yJ_VxZaGljVqb_opuWFsLJkAkM1_nj_0 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7693813033064085832', time=2024-09-14T13:27:01.924546+0000, chain.objs.size()=1 2024-09-14T11:37:46.268 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.268+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MhjXx4kHYd_i-l0Tkp1zQVJGLM1Uzas_0 2024-09-14T11:37:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.269+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12787284400075256886', time=2024-09-14T13:27:01.928063+0000, chain.objs.size()=1 2024-09-14T11:37:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.269+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hRGXnI2dXuCrDOjLb0QGZ_GFLixZCeU_0 2024-09-14T11:37:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.131501840204948041', time=2024-09-14T13:27:01.943288+0000, chain.objs.size()=1 2024-09-14T11:37:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iFNSlZhEF-U4cSqNaqtSbpbf79dxpKv_0 2024-09-14T11:37:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1137048768797022914', time=2024-09-14T13:27:02.249404+0000, chain.objs.size()=1 2024-09-14T11:37:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JgHRRnIkSUdfMNG9NKCys0fCE07GPnU_0 2024-09-14T11:37:46.269 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3063107711233483838', time=2024-09-14T13:27:02.280947+0000, chain.objs.size()=1 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.b2vBMEZgwwYKncDny3s8p1Y4tlZ0qff_0 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6788747176076431842', time=2024-09-14T13:27:02.449963+0000, chain.objs.size()=1 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.voYierd5YPXiOVKnisJ7F7nVAJDaVSd_0 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5491235616483588993', time=2024-09-14T13:27:02.475024+0000, chain.objs.size()=1 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5SDmlVLCVIfo1e0_bzDJOsYM9O9-FrI_0 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10077714985414833912', time=2024-09-14T13:27:02.502098+0000, chain.objs.size()=1 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.270+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ua30XzYYieMxADOmR9BGdVG8MWRIyIi_0 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1516047096297259810', time=2024-09-14T13:27:02.652622+0000, chain.objs.size()=1 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IrNEHSmw2nS70JZVtTV9wMwo8WI3IDr_0 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15117906161803666018', time=2024-09-14T13:27:02.689727+0000, chain.objs.size()=1 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Qg6jv6RFSxTLGwpngauYDl7H2S73DNA_0 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3514272106408544399', time=2024-09-14T13:27:02.692970+0000, chain.objs.size()=1 2024-09-14T11:37:46.270 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.l0XvcUubfyP_mtRZXeqiJGyxSZZt7Pp_0 2024-09-14T11:37:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8558420919972447301', time=2024-09-14T13:27:02.851909+0000, chain.objs.size()=1 2024-09-14T11:37:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sxj8i6b-RklteHAMifKkw0iRmwDNTQR_0 2024-09-14T11:37:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3345439424006650972', time=2024-09-14T13:27:02.918273+0000, chain.objs.size()=1 2024-09-14T11:37:46.271 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.271+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FSGXlRh7yvcxLSccYfQmvskSoZhAl_L_0 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.153550633234829138', time=2024-09-14T13:27:02.922890+0000, chain.objs.size()=1 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Mn_eweJ-MyUbpUD8UFxRFqcdhBkzOCV_0 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16122808762949790971', time=2024-09-14T13:27:08.530215+0000, chain.objs.size()=1 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.274__shadow_.hWjNZF5quSavkhF_ohor2zX-Fu3wHlK_0 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8128866005807081274', time=2024-09-14T13:27:09.010151+0000, chain.objs.size()=1 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.275__shadow_.m_4WLl7ztEAA3BlBP9-cZywm0-0gKJn_0 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16513065458213072992', time=2024-09-14T13:27:12.288477+0000, chain.objs.size()=1 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.272+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.282__shadow_.0CI0Nyisy2fQ_iR_OKCcohoO1FwzPjs_0 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17800285955114467283', time=2024-09-14T13:27:23.051478+0000, chain.objs.size()=1 2024-09-14T11:37:46.272 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.302__shadow_.YSWd3gMSOuSoa4vkUSz0rM78FuUsdNY_0 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5639990365806457903', time=2024-09-14T13:27:40.843987+0000, chain.objs.size()=1 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XtorVM1bJ7LRfqlQXxWPkPCvyGus8WH_0 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3400977402115388636', time=2024-09-14T13:27:40.881443+0000, chain.objs.size()=1 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rTpVZAwUo8dL4qq6w1x-DP7LroR_MTI_0 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3941864690494853162', time=2024-09-14T13:27:40.931688+0000, chain.objs.size()=1 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wx89OVhGTUGnOQLO-WQCEXWPhd8A-TW_0 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15380480007112841014', time=2024-09-14T13:27:41.042482+0000, chain.objs.size()=1 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bE-0AFv1bpjJ2-62lGHA-xKK4sqrErm_0 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2687466214706565122', time=2024-09-14T13:27:41.295911+0000, chain.objs.size()=1 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zEpDJZGiSmKdZwrh8Kf0Lvb-NwZTv1O_0 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5756934416404635882', time=2024-09-14T13:27:41.636291+0000, chain.objs.size()=1 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.pMhtBy3RcN1xwKzEUJfwm1KJYIGkr4x_0 2024-09-14T11:37:46.273 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.75499862410799320', time=2024-09-14T13:27:41.652563+0000, chain.objs.size()=1 2024-09-14T11:37:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.273+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.pHio4m-Udy6NZjLcvGsH2SYKXTkCL1M_0 2024-09-14T11:37:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.274+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12098907051159767810', time=2024-09-14T13:27:41.657038+0000, chain.objs.size()=1 2024-09-14T11:37:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.274+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OfrbbN09b3lnEsHMwUDbynTx5AXlR5w_0 2024-09-14T11:37:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.274+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13091990514192006689', time=2024-09-14T13:27:41.819151+0000, chain.objs.size()=1 2024-09-14T11:37:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.274+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NcNzvnFeT10ErFVKzRxGWIQL7CX3xyt_0 2024-09-14T11:37:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.274+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2182201893626181041', time=2024-09-14T13:27:41.898600+0000, chain.objs.size()=1 2024-09-14T11:37:46.274 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.274+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PBbhZHmsrjl9A48Ad94GWP8YH1QkW0A_0 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.275+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13787277145165379995', time=2024-09-14T13:27:41.901773+0000, chain.objs.size()=1 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.275+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9YKn6MWCYA3Wsvm_e47-m9Ah2oBakIL_0 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.275+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8123602991154049515', time=2024-09-14T13:27:41.926592+0000, chain.objs.size()=1 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.275+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YBylRp_XUHxZQtodA5AEwfet7E4vcjG_0 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.275+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1104857101344452524', time=2024-09-14T13:27:41.969989+0000, chain.objs.size()=1 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.275+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KrPgDXq31ErvfE4GAAlr_5veVq-xR5s_0 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.895517780060483431', time=2024-09-14T13:27:42.119222+0000, chain.objs.size()=1 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.33J39AeZDxHNZhwAmjzWPcvmi6Wqy0I_0 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11390752522308712767', time=2024-09-14T13:27:42.341026+0000, chain.objs.size()=1 2024-09-14T11:37:46.275 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CFDrCzAIShvlVSDqw13falUp4ogFblp_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18317620830776771960', time=2024-09-14T13:27:42.357642+0000, chain.objs.size()=1 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DGqGPjXVNcT93Zu4vo5c2uR05o38rl2_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2960016516038307823', time=2024-09-14T13:27:42.372850+0000, chain.objs.size()=1 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xuF76d_nwDb3O_H7JCuLNn-YLddFuGX_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6269588937236883984', time=2024-09-14T13:27:42.445136+0000, chain.objs.size()=1 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JcHE17M1RvQbPqrvn42XkyxaiyNJEgs_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8548493759822778211', time=2024-09-14T13:27:42.449968+0000, chain.objs.size()=1 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Kxza0Ztb2kDqjjB2A7xJ422dNIfMgxG_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9925811740580110517', time=2024-09-14T13:27:42.454897+0000, chain.objs.size()=1 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DjLHsKdcu_0LvJ2_TQf2biqV5So--Ey_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7312162952676829205', time=2024-09-14T13:27:42.592749+0000, chain.objs.size()=1 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2wmq9c14auzm0j7P5onPRu-F6Zj76CZ_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11553513546614480026', time=2024-09-14T13:27:42.655798+0000, chain.objs.size()=1 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sR56cQXyGz_LAho6K-J6DCH0veG8tgN_0 2024-09-14T11:37:46.276 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17865644691167929246', time=2024-09-14T13:27:42.666465+0000, chain.objs.size()=1 2024-09-14T11:37:46.277 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.276+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.G3VqZ2sLSmvIRg9OV2sqK74DxXSNxZO_0 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.277+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17244212986650750037', time=2024-09-14T13:27:42.695406+0000, chain.objs.size()=1 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.277+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MacrweCRwdPJndnLF4nJ_yHd-_Tp1eN_0 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.277+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9818478997912458035', time=2024-09-14T13:27:50.421897+0000, chain.objs.size()=1 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.277+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.X8O7tKPpY3dfP_OOJDoCuF5XI7J9n-3_0 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.277+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15665391449902835165', time=2024-09-14T13:27:50.434341+0000, chain.objs.size()=1 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.277+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.l_DYzL5I7YrYI5H7z2KzgOmLY8J-8BE_0 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13688780464912170045', time=2024-09-14T13:27:50.589170+0000, chain.objs.size()=1 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5QIukAjvONEPMUWmaI4WNrODCzJwqrN_0 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6832882160856599837', time=2024-09-14T13:27:50.698311+0000, chain.objs.size()=1 2024-09-14T11:37:46.278 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.g4S2rCHG1w5AN1WMb9UrCwjQLZVt084_0 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1315851522702654083', time=2024-09-14T13:27:50.792412+0000, chain.objs.size()=1 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jaoyixei_bbUy0IvWv2rQTb4N63RG-U_0 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9046182953444772276', time=2024-09-14T13:27:50.944288+0000, chain.objs.size()=1 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.278+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.geKThWNbWu36HkbrKcZ151ymECayKxz_0 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8683769340296488493', time=2024-09-14T13:27:51.042053+0000, chain.objs.size()=1 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.J8mK5xl1fuSnj9yU1g9lpT4xeEiZ3GY_0 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15228039210702191312', time=2024-09-14T13:27:51.068991+0000, chain.objs.size()=1 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3gRAa1EJDPi4j-ir6ai7p_ytHcu1u3a_0 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16393734323421205267', time=2024-09-14T13:27:51.071404+0000, chain.objs.size()=1 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nx4Nyace1CQ8InxfItU8nT-wgejOMST_0 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13788372252283952304', time=2024-09-14T13:27:51.090533+0000, chain.objs.size()=1 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bwd6Q_Hwj55UjKW2HFvZ2ckhLnSlKC2_0 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6573558484468209805', time=2024-09-14T13:27:51.259323+0000, chain.objs.size()=1 2024-09-14T11:37:46.279 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zuTvGzlv1ZgTyV308tpOZm5yk8xrOid_0 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9067144499207739044', time=2024-09-14T13:27:51.320127+0000, chain.objs.size()=1 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.sPE_hmff_Sh0ZDO3Pxs0iO81nFVxNj-_0 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.520204840365388256', time=2024-09-14T13:27:51.347786+0000, chain.objs.size()=1 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.PXENmkcYtR6b5xPJsppFew5HtLWPPEH_0 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16206873222242735481', time=2024-09-14T13:27:51.464800+0000, chain.objs.size()=1 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.I20qcGkpchBWY08BHjPbVPlnqjtBSaB_0 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15995943679020736311', time=2024-09-14T13:27:51.506415+0000, chain.objs.size()=1 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-i-szj3Ap4lG3iO4-n3FseTvmG3_9ba_0 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8307006842090535194', time=2024-09-14T13:27:51.738754+0000, chain.objs.size()=1 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GIPmK_QH4FzyZ9FSZATGIGhNZmhhpBM_0 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13391354811126618704', time=2024-09-14T13:27:51.752444+0000, chain.objs.size()=1 2024-09-14T11:37:46.280 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.279+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HWy968z-mK1t0Sv5AO9FGQXnzzBxKmo_0 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.280+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2036278174823182820', time=2024-09-14T13:27:51.803891+0000, chain.objs.size()=1 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.280+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bCLC9Q2wJPxcxMulSX2IZkEzEf-ptCp_0 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.281+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17910358936277821714', time=2024-09-14T13:27:51.859972+0000, chain.objs.size()=1 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.281+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.eDB8pI9OJar86mC2K4DW2EEIgPgwKID_0 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12310221563903007184', time=2024-09-14T13:27:51.994342+0000, chain.objs.size()=1 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qVhYf96810yVL7B8Ndu-5m2S-aj4N8n_0 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12281972771707393668', time=2024-09-14T13:27:51.996848+0000, chain.objs.size()=1 2024-09-14T11:37:46.282 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BYOBO2Gk9x3zKfdK9IJSC5BUSlGggbL_0 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.580872645149045813', time=2024-09-14T13:27:52.022166+0000, chain.objs.size()=1 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cT513tyhfpXETMjjQ3vxGHUKRNQY0gJ_0 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8051566739881609700', time=2024-09-14T13:27:52.052337+0000, chain.objs.size()=1 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uZMnE3ysRq57H96TRPV3U9j61cAvJmx_0 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6203644990129925479', time=2024-09-14T13:27:52.078124+0000, chain.objs.size()=1 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1vbxoqfTF7770Py16Tq7Zvgb278nJWK_0 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.645459131449573552', time=2024-09-14T13:27:52.087670+0000, chain.objs.size()=1 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.e1Iu4vAISyc3BLlQ07ELRStMQ38hMBP_0 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11545768871847808401', time=2024-09-14T13:27:52.102124+0000, chain.objs.size()=1 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3w7nl1riG0aGuc55B3W0QhfhwIQb8JT_0 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13873819905881289492', time=2024-09-14T13:27:52.135023+0000, chain.objs.size()=1 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.t-MAuc-S5EQ8YsLMYX-hrDwNuB8LwUD_0 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4354274689045078784', time=2024-09-14T13:27:52.235019+0000, chain.objs.size()=1 2024-09-14T11:37:46.283 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NhpeBjwGgLbsjUQPDjyr9knbIYJDa1k_0 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7419136680513733247', time=2024-09-14T13:27:52.268056+0000, chain.objs.size()=1 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.282+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hasAvMpN4UIUapFYHcQAfjvPCWyINpo_0 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.283+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15982256494687681485', time=2024-09-14T13:27:54.952342+0000, chain.objs.size()=1 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.283+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.330__shadow_.0myn5GuaphmxbRNoeCWlOe28gdnhqDz_0 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.283+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6138808090244074769', time=2024-09-14T13:29:18.190407+0000, chain.objs.size()=1 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.283+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.500__shadow_.M23mieO3NKCcd4Kelwcd2Aq9dAc99XP_0 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.283+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6164179753675093498', time=2024-09-14T13:29:22.327874+0000, chain.objs.size()=6 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.283+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.1 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.283+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.2 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.3 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.4 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.5 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.6 2024-09-14T11:37:46.284 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ZPuBGjWOuz7_yOnqSvYjlz4lo3vs-gH', time=2024-09-14T13:29:52.313247+0000, chain.objs.size()=1 2024-09-14T11:37:46.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.533__multipart_mymultipart.2~ZPuBGjWOuz7_yOnqSvYjlz4lo3vs-gH.1 2024-09-14T11:37:46.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6312108213543628892', time=2024-09-14T13:30:07.185540+0000, chain.objs.size()=4 2024-09-14T11:37:46.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.535__multipart_mymultipart.2~7G5Rsb68QfhuNqUNGcK3VOhNAGEAvRl.1 2024-09-14T11:37:46.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.284+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.535__multipart_mymultipart.2~7G5Rsb68QfhuNqUNGcK3VOhNAGEAvRl.2 2024-09-14T11:37:46.285 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.285+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.535__multipart_mymultipart.L1o6X5i1B8p92xJE-Yrz9m0gFutvwT4e.3 2024-09-14T11:37:46.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.286+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.535__multipart_mymultipart.2~7G5Rsb68QfhuNqUNGcK3VOhNAGEAvRl.4 2024-09-14T11:37:46.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.286+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10704889247878717945', time=2024-09-14T13:30:42.182076+0000, chain.objs.size()=1 2024-09-14T11:37:46.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.286+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:LPzyp269toEDD22x5GeWTCTIIy5kGHj_.jAZ8V5LP2noE7zfdkiwjGAGF8z6iG-n_0 2024-09-14T11:37:46.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.286+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14787371026789370752', time=2024-09-14T13:30:44.721528+0000, chain.objs.size()=1 2024-09-14T11:37:46.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.286+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:JA5N1NPGmuyay6EAEOkMCP9c96iB-Ic_.5c88R4aUbvsjIEC-qyr1Edaz2nYfFmP_0 2024-09-14T11:37:46.286 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.288+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/51070 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4771445043259787009', time=2024-09-14T13:31:06.158224+0000, chain.objs.size()=1 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:7JEYfVD5TM-.ynsMD50-mPgkheuLBKg_.OkD_o_O9HpJdqrwTUbCjaH-JbcwI8pa_0 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15126957646431067145', time=2024-09-14T13:31:26.529835+0000, chain.objs.size()=1 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.604__shadow_.ck0UIh6TvLrMrfiQSS3-eWUVn-MFOXn_0 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16608124585098453751', time=2024-09-14T13:33:56.428081+0000, chain.objs.size()=1 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.648__shadow_.xSa-RMBs_FxYDcVf0Y12Q5DH12GSPc2_0 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17145556581756330500', time=2024-09-14T13:34:11.653143+0000, chain.objs.size()=1 2024-09-14T11:37:46.288 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.679__shadow_.ki9dZpd3s36rB3GXmG2B2P87WyIj_oS_0 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3892833282274033644', time=2024-09-14T13:34:20.366699+0000, chain.objs.size()=1 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.700__shadow:xb5bdB3.HpAwfkMD-dD4qRBSjQfe4EB_.xKwvwAELNdAOloZLFMZIlJ3oXoU4BAu_0 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18077743599926681818', time=2024-09-14T13:34:20.763544+0000, chain.objs.size()=1 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.701__shadow:pu3WvhkjZk7unC5yivtpzIJf17PgCIo_.Q-PtW8Rz_CFY81YqteeDMLVrNHB5_V1_0 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14030166032798476269', time=2024-09-14T13:34:25.507402+0000, chain.objs.size()=1 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.711__multipart_file1.2~Vg2WxN-p15EIN3UDPtrl3mikvUECp9d.1 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.670716133388905252', time=2024-09-14T13:34:47.549227+0000, chain.objs.size()=1 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.718__shadow_.Ba1MPS78hrujeZQ3D0A0By5jdYEsrt5_0 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16995585599846838722', time=2024-09-14T13:35:16.815340+0000, chain.objs.size()=1 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.290+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.753__shadow_.5d22obyiWSCpNduW-4X1Y7k6OazoEKN_0 2024-09-14T11:37:46.289 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.292+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.291 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.294+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-14T11:37:46.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.295+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.293 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.295+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48907' 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.940269576363297057', time=2024-09-14T13:25:01.223655+0000, chain.objs.size()=1 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.166__shadow_.i2JOGQ0RCmLdRbxC4nM5MxQgA0iEqar_0 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16724512514684288332', time=2024-09-14T13:26:39.789979+0000, chain.objs.size()=1 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.235__shadow_.kRqPSLPOMaqsiK3iadTXpgOy2z7Awrt_0 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8115118753738855585', time=2024-09-14T13:26:49.215745+0000, chain.objs.size()=1 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.252__shadow_.a7q4Y3S7djkT0uR-6YVJhXAZOETC9Xa_0 2024-09-14T11:37:46.295 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7026849772682057826', time=2024-09-14T13:27:01.165204+0000, chain.objs.size()=1 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2O1WIKsqQYttfpLeCx1cObY027vtmL5_0 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14343855564368268911', time=2024-09-14T13:27:01.168103+0000, chain.objs.size()=1 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8MmRttGGBerKZr4Mhugkx6ukq2vLL7U_0 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2237077116587581592', time=2024-09-14T13:27:01.172441+0000, chain.objs.size()=1 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.djOQ1tqEhnO-UnNwPt9Xkh-w2oHx31N_0 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2008003288349564901', time=2024-09-14T13:27:01.180708+0000, chain.objs.size()=1 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3kqv_YSfAhSHZSJcfbo69Hbai76MOqK_0 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17856291729689416908', time=2024-09-14T13:27:01.188875+0000, chain.objs.size()=1 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.jjK30YGLA9kGLi2pzIX3pYUNpc3qc9V_0 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2227391034838783088', time=2024-09-14T13:27:01.253029+0000, chain.objs.size()=1 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JN6IPu0rCopX2GeMtfv1yAUvQbfeQ8z_0 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1888841928501009997', time=2024-09-14T13:27:01.419772+0000, chain.objs.size()=1 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JdU87hqtH-HDAiik1jewgfdjJL_zWs__0 2024-09-14T11:37:46.296 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18076810850284857668', time=2024-09-14T13:27:01.463592+0000, chain.objs.size()=1 2024-09-14T11:37:46.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gWgB8WLI04KDr4-xjPd2X2Eqcxkt4EK_0 2024-09-14T11:37:46.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7663142841765044083', time=2024-09-14T13:27:01.465612+0000, chain.objs.size()=1 2024-09-14T11:37:46.297 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.296+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.l_HyBPsdJZnI_WoXRxQ_6bsDKdROxDP_0 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9226046714309282568', time=2024-09-14T13:27:01.471341+0000, chain.objs.size()=1 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EXv6s_J1qU4lvpL2LchDdDwrF9UiRKV_0 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6036154521281246518', time=2024-09-14T13:27:01.474785+0000, chain.objs.size()=1 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lqYSMmO_o_ZcgJZVWibICk_TN0LQdEC_0 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3271282984191821157', time=2024-09-14T13:27:01.523928+0000, chain.objs.size()=1 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FSagdhWDEuqQgxSPlaLTcmfa0eeTic6_0 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4047940855484872265', time=2024-09-14T13:27:01.550188+0000, chain.objs.size()=1 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KJRMaxo4KoPCTdAYm2vzbG7buX9Q_IR_0 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16443562475785159539', time=2024-09-14T13:27:01.661787+0000, chain.objs.size()=1 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KAzOC3NYI3MKPnUQ-O_r2y2PbgX26fG_0 2024-09-14T11:37:46.298 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1079298186611417654', time=2024-09-14T13:27:01.698092+0000, chain.objs.size()=1 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Kkx0GaNwIj6h87aFxmUCrnKN8GXDltK_0 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12346235782162169664', time=2024-09-14T13:27:01.729012+0000, chain.objs.size()=1 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.f0MIOY8072aZVfQHmJaGimx3a8ps_wW_0 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5950561045960666078', time=2024-09-14T13:27:01.760319+0000, chain.objs.size()=1 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KeY8CFY1xNyWxPs-CspFgQcxmBvatlL_0 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17934207190804904102', time=2024-09-14T13:27:01.895727+0000, chain.objs.size()=1 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IdFRP6By8O3qxV_McWvS3tD_8pTOm8M_0 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10729194136164640794', time=2024-09-14T13:27:01.908645+0000, chain.objs.size()=1 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.c3AzWGlFYHLPEUT-A98ddFv18JQ0Oe3_0 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4503231275493040611', time=2024-09-14T13:27:01.913263+0000, chain.objs.size()=1 2024-09-14T11:37:46.299 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.298+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Q5AW0rsRZXycVK4rs8jRsqJJEwzOifH_0 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8876054490744459149', time=2024-09-14T13:27:01.936085+0000, chain.objs.size()=1 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.H_hCUS47BgYXmXEDOFoKCmI474aiO7q_0 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7547083200573476418', time=2024-09-14T13:27:01.976017+0000, chain.objs.size()=1 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.F9HxE3896-jH-ZnshnqtXgVFiqI3F4R_0 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14189305727090114344', time=2024-09-14T13:27:02.020559+0000, chain.objs.size()=1 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.F6kpqcIRA12vHzE7f1s1zmCMJjNWhoP_0 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9498660678291971260', time=2024-09-14T13:27:02.038543+0000, chain.objs.size()=1 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bB0lY-KGpgeu7SJH-DD20ZGcznmD_TF_0 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11287099843792579019', time=2024-09-14T13:27:02.166811+0000, chain.objs.size()=1 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.k3fni235AqKUn5OjPJpjhGr3UPnOdNp_0 2024-09-14T11:37:46.301 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.441760260908253686', time=2024-09-14T13:27:02.207735+0000, chain.objs.size()=1 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.300+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.uHj5VosaK9qD64ILsrlL94dZ95OA22__0 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7501118861089818178', time=2024-09-14T13:27:02.245156+0000, chain.objs.size()=1 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oLzIfK3sgvhEUoDmpVV-Am4V2fVojiM_0 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16051903722573539301', time=2024-09-14T13:27:02.421615+0000, chain.objs.size()=1 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PO5fcMy7rnJ2NUTy0Wjc0JHp5G9LXcQ_0 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9089000345764419450', time=2024-09-14T13:27:02.467147+0000, chain.objs.size()=1 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DRjPDsl8y6VLID_hqNY_X0CxrsUJgHR_0 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15678434766355037013', time=2024-09-14T13:27:02.473243+0000, chain.objs.size()=1 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4J0CtDsCO1-yTrYazfnEMRsxRB1bvKn_0 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13047856480754556179', time=2024-09-14T13:27:02.516383+0000, chain.objs.size()=1 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.301+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.B6Xopj39GmmomJoUuyU19Vb0B8O305N_0 2024-09-14T11:37:46.302 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15915615999366257459', time=2024-09-14T13:27:02.620097+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PL7sK6T0fX-FI03doeCLDQbHOrIbsRj_0 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9225231871032346736', time=2024-09-14T13:27:02.621692+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.D0cl8ISZ835xdmYtrUSlMVvPwX6J0-D_0 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5854706721132510337', time=2024-09-14T13:27:02.648684+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1MU5ZOZoI2KK_fWTc-QPmCXRTzrLPhh_0 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5149871487094338681', time=2024-09-14T13:27:02.667963+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iqPfFfp2ZqYbvli84vufBzdA7z4k7C8_0 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5869693875537351860', time=2024-09-14T13:27:02.699206+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rKHpGcteqAbiuysAE5PHFd_V0cOzdc3_0 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9633844420908792191', time=2024-09-14T13:27:02.713549+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.302+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._Avz7BkcdS5u3z7HnWuGQfpdMsglf9k_0 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.303+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8630626039943025577', time=2024-09-14T13:27:02.840920+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.303+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6JxSlG7ABOsmDqfSlhdvZELU014Lj2f_0 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.303+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8939044776465662047', time=2024-09-14T13:27:02.846105+0000, chain.objs.size()=1 2024-09-14T11:37:46.303 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.303+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FNUYSk3eTPgP8FrkPZk2MVqU4hGbQML_0 2024-09-14T11:37:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5937547261934710692', time=2024-09-14T13:27:02.860513+0000, chain.objs.size()=1 2024-09-14T11:37:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.84ojCcBcplvPmDyrVlzoHjSSxShNHe1_0 2024-09-14T11:37:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10724406964662035193', time=2024-09-14T13:27:02.938266+0000, chain.objs.size()=1 2024-09-14T11:37:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gAc7E2HOdDaj4VMRVzSgILTD11PF7nt_0 2024-09-14T11:37:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9081559415609354210', time=2024-09-14T13:27:03.403482+0000, chain.objs.size()=1 2024-09-14T11:37:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.263__shadow_.iHtDhCPE589e4kmMT_v6KOHkAg90SK__0 2024-09-14T11:37:46.305 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12513466351916007947', time=2024-09-14T13:27:03.404235+0000, chain.objs.size()=1 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.263__shadow_.VW0TF6WUEOn7kQHe3-rnLm1rcvqnP7u_0 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12982351716817773863', time=2024-09-14T13:27:04.385754+0000, chain.objs.size()=1 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.265__shadow_.b8zwgaCD08FM7nkO2FQxlZn9D9F8Ern_0 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16704279276519986502', time=2024-09-14T13:27:05.277785+0000, chain.objs.size()=1 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.267__shadow_.-AQALZf8J47sRZfRA28Zb1JFrhvkeAI_0 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6111057447286075916', time=2024-09-14T13:27:10.894067+0000, chain.objs.size()=1 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.279__shadow_.rl3mLREq3ENhZqtHGGb6OMlZvhleEL9_0 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10578512838415262506', time=2024-09-14T13:27:14.294305+0000, chain.objs.size()=1 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.286__shadow_.qJwV1DjGH5rPChrD1SOe6A0wPhV91bh_0 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.193476583699379086', time=2024-09-14T13:27:14.295224+0000, chain.objs.size()=1 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.286__shadow_.hZpn-nUAPq7gyuG5JaF4cu1TddVA4m8_0 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17281749965268712052', time=2024-09-14T13:27:16.108108+0000, chain.objs.size()=1 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.290__shadow_.zUIjC24Qyp37hhA9e8H-TQDjWeRMzrz_0 2024-09-14T11:37:46.306 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10392535654865799297', time=2024-09-14T13:27:18.493464+0000, chain.objs.size()=1 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.304+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.D9BKHNwa-v9synjFvu-wCCKhCxjrioT_0 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.306+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11663270151568580332', time=2024-09-14T13:27:19.453656+0000, chain.objs.size()=1 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.306+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.295__shadow_.WnQS6yv3vAUH8oisnmsQqSSUV-eAXR3_0 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5488208313012315916', time=2024-09-14T13:27:40.804264+0000, chain.objs.size()=1 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._Dpyp6MbTskfIQp7lTkenXLFfgAl_um_0 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4857052775835874916', time=2024-09-14T13:27:40.818442+0000, chain.objs.size()=1 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XzyRN_CPt1D3JsfsDqwV_y4LUTecniq_0 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13069692082824449348', time=2024-09-14T13:27:40.861710+0000, chain.objs.size()=1 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ng-vJDcbtMrFTTQb2P96iiPbi3tymzS_0 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14424092071890998842', time=2024-09-14T13:27:40.873553+0000, chain.objs.size()=1 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.F3fLdGAbyo3OtOdUn0iFXCNjnfTtOKd_0 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13722227610522158684', time=2024-09-14T13:27:40.907135+0000, chain.objs.size()=1 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.r3526unrTeaKmcPaD2kBXCJIqmIdQ-N_0 2024-09-14T11:37:46.307 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6064938650979819298', time=2024-09-14T13:27:41.072957+0000, chain.objs.size()=1 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.fQc5B2V6t104s9vzeHNUWN0RT9GyaG__0 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13491942083070958602', time=2024-09-14T13:27:41.147115+0000, chain.objs.size()=1 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.218B3WlT9scAiwty8EzTexxx2ehYxFN_0 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3594584650479830507', time=2024-09-14T13:27:41.293152+0000, chain.objs.size()=1 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.L7N6Ldg6i4vmJPyl2ikSm3qrL8qJgJV_0 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1317977921816337353', time=2024-09-14T13:27:41.339389+0000, chain.objs.size()=1 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bU3geNvigrI5Flljsg32ypWF949J-50_0 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15299549118203585833', time=2024-09-14T13:27:41.377460+0000, chain.objs.size()=1 2024-09-14T11:37:46.308 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.307+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kJNWwFZ5xGQlqeeHCkN-NJXJlri-GfD_0 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.308+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14515546277813211790', time=2024-09-14T13:27:41.412801+0000, chain.objs.size()=1 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.308+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vDtNNNnoDCZCjn_2-h-a5_v1Rtd7Lsb_0 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.308+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4613488288855248943', time=2024-09-14T13:27:41.581210+0000, chain.objs.size()=1 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.308+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dlXnt2Kp_leSQn_Sg0Yu8qI5Dd2LaOn_0 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.308+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10425036570973637111', time=2024-09-14T13:27:41.659813+0000, chain.objs.size()=1 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.308+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.fqDsKqy9BQTr35jNOsMa8M3cuKT6D_x_0 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.309+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1432649375764992728', time=2024-09-14T13:27:41.844843+0000, chain.objs.size()=1 2024-09-14T11:37:46.309 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.309+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lavrwmFAbpM5asmvnEiCNSrMPPXKn9D_0 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.309+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7374022665309495305', time=2024-09-14T13:27:42.065772+0000, chain.objs.size()=1 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.309+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WTAfV_1xyA1E7ieKcEZ4ARTZlz7qwAa_0 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7224667749739975161', time=2024-09-14T13:27:42.097576+0000, chain.objs.size()=1 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uqXg2FObrPG0I6bBitUrokzOFOfa4J7_0 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5535077052984318253', time=2024-09-14T13:27:42.129868+0000, chain.objs.size()=1 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BqNUxC1ixw1PrzOtskp3wQ3O4t2Gpkh_0 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10203196127709371863', time=2024-09-14T13:27:42.130662+0000, chain.objs.size()=1 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qR2bliuWwHKPS3jpC0WHnDvKksPuYP-_0 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4079218009869482187', time=2024-09-14T13:27:42.137759+0000, chain.objs.size()=1 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.310+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2y3_t4C98w5LF3orh4TlBTb-boyqCYn_0 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.311+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8430454602106027923', time=2024-09-14T13:27:42.157299+0000, chain.objs.size()=1 2024-09-14T11:37:46.310 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.311+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GIj42b_UjBrggL_w--dJmQsWx79FKuQ_0 2024-09-14T11:37:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5100281060883047862', time=2024-09-14T13:27:42.160340+0000, chain.objs.size()=1 2024-09-14T11:37:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.35MYQLHplD2_WWOOw2mxFhGLgjgJcC9_0 2024-09-14T11:37:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8875690229570087224', time=2024-09-14T13:27:42.168970+0000, chain.objs.size()=1 2024-09-14T11:37:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IFReeuCAUU-u9PXDR22isdo8AChQUBU_0 2024-09-14T11:37:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7181473868378393486', time=2024-09-14T13:27:42.181620+0000, chain.objs.size()=1 2024-09-14T11:37:46.311 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yz7P4TUTorVaCxIXQz2h4YXHiMNSFgQ_0 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1677624630955777480', time=2024-09-14T13:27:42.202147+0000, chain.objs.size()=1 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.iOKyUxaYLCEp4RZAprhlpV6cMvjOapg_0 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2324951228799397474', time=2024-09-14T13:27:42.226177+0000, chain.objs.size()=1 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.P-cxPIu-hUtb1sKpGJAP1uMXSwzjLP__0 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5400889222292628302', time=2024-09-14T13:27:42.230194+0000, chain.objs.size()=1 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zZEeSBfC9HE523XutwpPx9lR-NA1Cbd_0 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6765072373013437811', time=2024-09-14T13:27:42.343467+0000, chain.objs.size()=1 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.brtHFsJKO4O5RRsGCap8nmh1AQClIKY_0 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3615850411156986061', time=2024-09-14T13:27:42.369566+0000, chain.objs.size()=1 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UcfaB-TQvtzlbUvYQ603Wt4TCOJ1rxV_0 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4670068206266343542', time=2024-09-14T13:27:42.378083+0000, chain.objs.size()=1 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VVdNsUh3oHVvu14rxTAgNFDHW2zX0C7_0 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10968204036679223331', time=2024-09-14T13:27:42.380957+0000, chain.objs.size()=1 2024-09-14T11:37:46.312 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0R1WMRBcT5v_CksyzwAA3CdwwRQBwV5_0 2024-09-14T11:37:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4502320067428277310', time=2024-09-14T13:27:42.392742+0000, chain.objs.size()=1 2024-09-14T11:37:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.312+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.O1QcAtAuUidIil1SRY6VVNaB48bjxC5_0 2024-09-14T11:37:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.313+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5740080375430870227', time=2024-09-14T13:27:42.400260+0000, chain.objs.size()=1 2024-09-14T11:37:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.313+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IL1jKi5iiMNhNbQwBz1YihnXePv_fgd_0 2024-09-14T11:37:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17887050930587234601', time=2024-09-14T13:27:42.441349+0000, chain.objs.size()=1 2024-09-14T11:37:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YVXLRIT5kTfYirY7znwVzhHS-yWVQBJ_0 2024-09-14T11:37:46.313 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14746121286178009431', time=2024-09-14T13:27:42.454858+0000, chain.objs.size()=1 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9q_uitYn7C1OGNiY6qWn9Wif-Mo3ekN_0 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2230119479261997161', time=2024-09-14T13:27:42.606855+0000, chain.objs.size()=1 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rtdgfzZcHO2ToxTtmu48Pwo2llQ_IGK_0 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.912740233326996660', time=2024-09-14T13:27:42.660586+0000, chain.objs.size()=1 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ed1avrziG835nVT0GYHzkDenTXatYRd_0 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7672444810845299936', time=2024-09-14T13:27:50.423245+0000, chain.objs.size()=1 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.314+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZWlNXsqoNMdlUHBoWoSMkGNBpR6Ewjc_0 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8682027281486412698', time=2024-09-14T13:27:50.439878+0000, chain.objs.size()=1 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZcZnr57d-e1qdUDETjOKSs-1R1xi2qD_0 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18122778260694180504', time=2024-09-14T13:27:50.442837+0000, chain.objs.size()=1 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ksJcv88NGMVkUygVuMbGWQSXpTVpupt_0 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18368925619484796233', time=2024-09-14T13:27:50.463690+0000, chain.objs.size()=1 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3y50PC0HS42wW95e7cgJWeHk5L-j75s_0 2024-09-14T11:37:46.314 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15921587854526347711', time=2024-09-14T13:27:50.500275+0000, chain.objs.size()=1 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NCjLug8QRrFYAN2koK0n1F-ErFb57_E_0 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9550015237470494261', time=2024-09-14T13:27:50.724163+0000, chain.objs.size()=1 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VAFqiV18--HPo7Ofh2AD7TpkBdcbTPv_0 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9385996200956791019', time=2024-09-14T13:27:51.009767+0000, chain.objs.size()=1 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.315+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ClXlMM_1vW9XhBlwbSio2QinlEyMpXW_0 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.317+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10397158158181169311', time=2024-09-14T13:27:51.039051+0000, chain.objs.size()=1 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.317+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zX3cFulKFwjgBe1XA4rfCAB-4t8xbX0_0 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.317+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16269685815186455347', time=2024-09-14T13:27:51.188795+0000, chain.objs.size()=1 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.317+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tuBVnr7WdlH8YZE07qOltqhsh2_o7Bk_0 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.317+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.366031489981667737', time=2024-09-14T13:27:51.195936+0000, chain.objs.size()=1 2024-09-14T11:37:46.315 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.317+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rB4yQ0b6vkJACal_mwPQ0aAE3uFnoh__0 2024-09-14T11:37:46.316 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.318+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48907 2024-09-14T11:37:46.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=40, truncated=0, next_marker='' 2024-09-14T11:37:46.319 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5745187477255979668', time=2024-09-14T13:27:51.228027+0000, chain.objs.size()=1 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.E3XRW2ekK6k4l_mr3_3GQN86FsX86wW_0 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12351214401182676568', time=2024-09-14T13:27:51.276072+0000, chain.objs.size()=1 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jcp4ZKnohn2BYduVm2ph1iHZ9ZygVGL_0 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6790740619142052170', time=2024-09-14T13:27:51.318195+0000, chain.objs.size()=1 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.sglsRytm4N8KLFwMVevN1PQbNTzxMyW_0 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16328311941896817743', time=2024-09-14T13:27:51.323657+0000, chain.objs.size()=1 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yxYvp3f9aVs-8q213A3RMlv9-LyyORk_0 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8928844868725941980', time=2024-09-14T13:27:51.348316+0000, chain.objs.size()=1 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tDyjmfbbAOSNrIghJlD7psuAJybuklL_0 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9799546189385056650', time=2024-09-14T13:27:51.360516+0000, chain.objs.size()=1 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kvkk8PShkX-zON06hUqlDmE27-_6EOw_0 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18219105162324556584', time=2024-09-14T13:27:51.516393+0000, chain.objs.size()=1 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uWZfR1J7eNb-A-JWE-R7ei5FOa54JgA_0 2024-09-14T11:37:46.320 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.62941902536013614', time=2024-09-14T13:27:51.549131+0000, chain.objs.size()=1 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yXpxDdU5JF--YDNg1KFUFoONVWcbVJQ_0 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17926873697950001999', time=2024-09-14T13:27:51.551596+0000, chain.objs.size()=1 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NhHjeLp2CyBKaT0MdcPAagq2tbgTuzG_0 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2720124319257560724', time=2024-09-14T13:27:51.581885+0000, chain.objs.size()=1 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Fo7phhcckrDFvZMQq7EQZW2ylkrE6b7_0 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4425531292425523790', time=2024-09-14T13:27:51.709868+0000, chain.objs.size()=1 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SkwdSNbkRGFsF-EWKmEvL5gOFPgFzV3_0 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7499126302794384486', time=2024-09-14T13:27:51.719000+0000, chain.objs.size()=1 2024-09-14T11:37:46.321 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.321+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xTh31hA24L7HkKYkqDEpI663BKmsrNs_0 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18110863238832551627', time=2024-09-14T13:27:51.750301+0000, chain.objs.size()=1 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-EaK6vE6qLZjhqMHKOIT7ry8iF1uHgA_0 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8617394303948577962', time=2024-09-14T13:27:51.959583+0000, chain.objs.size()=1 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rRbtehjedzz42ZmDD8Qus8jAZ0Lkv0y_0 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14931480019661964564', time=2024-09-14T13:27:51.962843+0000, chain.objs.size()=1 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VdH6G0hV4nXePu4-C6U4POg6LU8FW_5_0 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4032846688984940493', time=2024-09-14T13:27:52.024874+0000, chain.objs.size()=1 2024-09-14T11:37:46.322 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UbclcZizW-M2M_Q0C24PXAcSEhKGh-O_0 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4357798582668637646', time=2024-09-14T13:27:52.128451+0000, chain.objs.size()=1 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._6FZc_YqTBRgW-4mHOzDaMLFzOK2PL7_0 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1316376837820999196', time=2024-09-14T13:27:52.214808+0000, chain.objs.size()=1 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.61Y-E6Cd830JH_BlBAza2K6bwPfHFdE_0 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.74484977319149279', time=2024-09-14T13:27:52.284111+0000, chain.objs.size()=1 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aRpkSqhCcbfVhm5xxHHC1Ltu56pdpK9_0 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2754777642857051285', time=2024-09-14T13:27:52.301105+0000, chain.objs.size()=1 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.2WLv7BpTxa3ywWh1pEMIITufCaeS2Hp_0 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17790275413964692756', time=2024-09-14T13:27:52.336938+0000, chain.objs.size()=1 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zUgvEo6GMwfMDZP_DC82Pw4JzadXanT_0 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.426706686461901326', time=2024-09-14T13:27:56.662883+0000, chain.objs.size()=1 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.334__shadow_.va_vm351GqLTI39rlwhNVeE5okA0StL_0 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.106752019890136322', time=2024-09-14T13:28:15.245266+0000, chain.objs.size()=1 2024-09-14T11:37:46.323 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.323+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.375__shadow_.19EuLxQiUaR1pA7lwZNwiyHcEMUb9AZ_0 2024-09-14T11:37:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13104172672225002854', time=2024-09-14T13:28:15.727993+0000, chain.objs.size()=1 2024-09-14T11:37:46.324 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.376__shadow_.S7C7y91cMGWIeu8GDQ6y9hf-4Pe6CKL_0 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16980039571334056249', time=2024-09-14T13:28:33.325537+0000, chain.objs.size()=1 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.409__shadow_.Qv4kQgiEbu52Ay5dgIC-IdRfjBH835S_0 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8132587095807237314', time=2024-09-14T13:28:58.945387+0000, chain.objs.size()=1 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.457__shadow_.dsUtxjQagNJo2ItBZkHlFX35irTaXHu_0 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12460625838388932572', time=2024-09-14T13:28:59.660203+0000, chain.objs.size()=1 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.458__shadow_.F84qgiekYYCQdNPVhsOyBy4Bm4P5Qxh_0 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1835141551497518904', time=2024-09-14T13:29:18.089445+0000, chain.objs.size()=1 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.499__shadow_.jpRN5exid2x3IAJ9dE4BZpZNcU9j1KR_0 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10955620727709107219', time=2024-09-14T13:29:26.545394+0000, chain.objs.size()=1 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.518__multipart_mymultipart.2~1us3dthVEoeGG4ar2CA23Um1coq6yCR.1 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2851121973601103913', time=2024-09-14T13:29:39.958933+0000, chain.objs.size()=6 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~dKGDC6_FVB4tkDS1fmxUU_l-lvJ6-1b.1 2024-09-14T11:37:46.325 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~dKGDC6_FVB4tkDS1fmxUU_l-lvJ6-1b.2 2024-09-14T11:37:46.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.fStvsPcaJBCRn7eUxEQAMBb2P_Ai0wMZ.3 2024-09-14T11:37:46.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~dKGDC6_FVB4tkDS1fmxUU_l-lvJ6-1b.4 2024-09-14T11:37:46.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.325+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~dKGDC6_FVB4tkDS1fmxUU_l-lvJ6-1b.5 2024-09-14T11:37:46.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.326+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~dKGDC6_FVB4tkDS1fmxUU_l-lvJ6-1b.6 2024-09-14T11:37:46.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.326+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10690603179356799132', time=2024-09-14T13:30:27.077107+0000, chain.objs.size()=1 2024-09-14T11:37:46.326 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.326+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.551__shadow_.FkVyGfYcBdaXdEVHbJUB2_XZ0ttaOD8_0 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6651118392523678795', time=2024-09-14T13:30:30.335758+0000, chain.objs.size()=1 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.556__shadow_.FcOREawhjcK-jsMRVd5dljcuk7ItAC6_0 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17133388285838775256', time=2024-09-14T13:30:32.206852+0000, chain.objs.size()=1 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.559__shadow_.7sN_8ObNF3Dzel7HxEEwe5KiYPEaHxo_0 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8923873892659547303', time=2024-09-14T13:30:43.535619+0000, chain.objs.size()=1 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:1xm5dBLVldcqdjgr0Pth2wl1SPu2PY6_.aL3x8YTbSRhKjjX7y8UXoSgSzXg25nb_0 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4475189092168526578', time=2024-09-14T13:34:05.253711+0000, chain.objs.size()=1 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.664__shadow_.hWe7yGZJyGRbeliJWsGrbG2sm_CFosr_0 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4665188372266674638', time=2024-09-14T13:34:06.703603+0000, chain.objs.size()=1 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.666__shadow_.l5OE_VGkygfAzY3mxRI7aO6ELHQyOvs_0 2024-09-14T11:37:46.327 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7546223457357069262', time=2024-09-14T13:34:19.523368+0000, chain.objs.size()=1 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.698__shadow:FdTFCObskZ7eicofT2Y.i8dSUptDOuE_.W0xVzUr1qOduTTMZntFgLO6skNwjXbg_0 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8575547281183690592', time=2024-09-14T13:34:22.160007+0000, chain.objs.size()=1 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.704__shadow:Zj926MfJ1pbe70CSLf0f9j3qrXaWJ.v_.U_Vdb7DmWzztsbGsRnRwENz_Qoq7Ii7_0 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1568199073934043001', time=2024-09-14T13:34:23.574093+0000, chain.objs.size()=1 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.707__shadow:M1Vdi3l7BRf3Yq0AY5zOkNaB3cDu3Yp_.gGP5jgK7frQdRpnATeCznNFUrR3vGQT_0 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17776019891489217415', time=2024-09-14T13:35:29.490847+0000, chain.objs.size()=1 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.327+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.768__shadow_.ucH8k3lD-gfeI5qadDr_ZsW4hasbPiC_0 2024-09-14T11:37:46.328 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.330+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.330 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.332+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-14T11:37:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.333+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.331 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46246' 2024-09-14T11:37:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_9xEamHWaBqQD1xvE-T1p-NbjWqbmEew', time=2024-09-14T13:24:59.519155+0000, chain.objs.size()=2 2024-09-14T11:37:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.y8oP1qo722gIUW6DOyVUlK13gvq8_ya_0 2024-09-14T11:37:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.y8oP1qo722gIUW6DOyVUlK13gvq8_ya_1 2024-09-14T11:37:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_et4EvTJdREmaMt2q7e444PlMDSo78OC', time=2024-09-14T13:24:59.680978+0000, chain.objs.size()=2 2024-09-14T11:37:46.333 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.O_Qwv5wRnmUZUbpoIoG35qR9aZBqk-R_0 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.O_Qwv5wRnmUZUbpoIoG35qR9aZBqk-R_1 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_WHax27pWhi4gciJAWU_3T0OYDYHvSF8', time=2024-09-14T13:25:00.990863+0000, chain.objs.size()=2 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.165__shadow_.6YlB1LXr9Qyy8xg6PxwJMd-AlWmRpte_0 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.165__shadow_.6YlB1LXr9Qyy8xg6PxwJMd-AlWmRpte_1 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.116974605234640069', time=2024-09-14T13:26:38.897143+0000, chain.objs.size()=1 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.233__shadow_.y7TXqGkOzryYtkOLtHBi4QpxzYh3g6p_0 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7189949395531766854', time=2024-09-14T13:26:41.905416+0000, chain.objs.size()=1 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.238__shadow_.u7HNgF-MYG9nn3q-rnkQf-AnBTGazZl_0 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17137825176394974768', time=2024-09-14T13:27:01.205851+0000, chain.objs.size()=1 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GOd3Tf652y4NhjjKAt1Aoecj9MtFpGX_0 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14071310311810091213', time=2024-09-14T13:27:01.215021+0000, chain.objs.size()=1 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6-j_HJ2UaE7JBeh9xkqRPtRifdfmLce_0 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18383598304660785895', time=2024-09-14T13:27:01.260514+0000, chain.objs.size()=1 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.h_pe8hWrKSpFcd-UhD4lELyXN2hFJX1_0 2024-09-14T11:37:46.334 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14224985257403643162', time=2024-09-14T13:27:01.285779+0000, chain.objs.size()=1 2024-09-14T11:37:46.335 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.334+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VJ_QMTOXHetyYIBaQMKgodQ2loTj64p_0 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10604806249843284666', time=2024-09-14T13:27:01.289159+0000, chain.objs.size()=1 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vSrdUTp4j7Mll2BGI0mttRvUkkvT7bI_0 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6897355403015705915', time=2024-09-14T13:27:01.307017+0000, chain.objs.size()=1 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IcO2bXRVW9lOmYRORtFAhZ6gKZEJgjv_0 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8066779538601566098', time=2024-09-14T13:27:01.541510+0000, chain.objs.size()=1 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5xQ-wKO_aWccewDpmZTKwj7zZ5H6K04_0 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6212726458158651392', time=2024-09-14T13:27:01.544648+0000, chain.objs.size()=1 2024-09-14T11:37:46.336 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qvo7fdZguRC3QVflTM766ZS2YlRmIfS_0 2024-09-14T11:37:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16123240565160910199', time=2024-09-14T13:27:01.704758+0000, chain.objs.size()=1 2024-09-14T11:37:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VN1pOHml_Wsgq4cDMzbdJrK0BScOZ-3_0 2024-09-14T11:37:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8172872578650144875', time=2024-09-14T13:27:02.022663+0000, chain.objs.size()=1 2024-09-14T11:37:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.88alG1lCRi7ZlTSHCNfskTeoBSqSez7_0 2024-09-14T11:37:46.337 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.148530584635582958', time=2024-09-14T13:27:02.027154+0000, chain.objs.size()=1 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.338+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TH9IN4FvZ1KPcfkXE5yp_r9_fhkGGPD_0 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1431400715921512754', time=2024-09-14T13:27:02.131983+0000, chain.objs.size()=1 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9NMtJrfiksyPc6KA_Urvd1F4UYo8o-G_0 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3635901090307761555', time=2024-09-14T13:27:02.263606+0000, chain.objs.size()=1 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.a7YT6nzPLCNlFOA270zpuiVug_eVAep_0 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12323607226287441286', time=2024-09-14T13:27:02.270032+0000, chain.objs.size()=1 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CwlEh_ev14ETzfm_ctJBNO_QD4Ofc2e_0 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.126201418241525475', time=2024-09-14T13:27:02.394273+0000, chain.objs.size()=1 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.E2vB1FktR4FF83ThA0bV5MF2tmfngVU_0 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17537991675709281539', time=2024-09-14T13:27:02.401728+0000, chain.objs.size()=1 2024-09-14T11:37:46.338 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.339+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Czh7MQ4fv0VYJG7PEoGcWz9eUZlWAqV_0 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.340+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16156649700012863932', time=2024-09-14T13:27:02.604714+0000, chain.objs.size()=1 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.340+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oi_qkrUjzG30RwrlAFL4iR9gbzvFhzR_0 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.340+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9186673824668930492', time=2024-09-14T13:27:02.611995+0000, chain.objs.size()=1 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.340+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-rDBC64OLfE4V_pvWe5__2RbQ-8W8an_0 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.340+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3348356567147169702', time=2024-09-14T13:27:02.649198+0000, chain.objs.size()=1 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.340+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.b6uWtR07sRp846K521L3vkFsT7xbpYj_0 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5233449735104686755', time=2024-09-14T13:27:02.670052+0000, chain.objs.size()=1 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MDkb3qjEjGbDpmePY5B8MWSwpJ4dJa8_0 2024-09-14T11:37:46.339 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8752699333096000233', time=2024-09-14T13:27:02.705045+0000, chain.objs.size()=1 2024-09-14T11:37:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9VKH6ivyjHLlx6Xn-vO1dNpQlkOaCrX_0 2024-09-14T11:37:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3052744445281787708', time=2024-09-14T13:27:02.837262+0000, chain.objs.size()=1 2024-09-14T11:37:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rQ6JVGn_oKnIn_lJji5-gb3ARxZoOlR_0 2024-09-14T11:37:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5333065550859054437', time=2024-09-14T13:27:02.842001+0000, chain.objs.size()=1 2024-09-14T11:37:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.341+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JbMw-FLhP_BnvwiDIV9iDQZF8fAb3-T_0 2024-09-14T11:37:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3794634737361230037', time=2024-09-14T13:27:02.856265+0000, chain.objs.size()=1 2024-09-14T11:37:46.340 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oxw9AdfmBxd-NiFsrW3KBwCUYb2-XpF_0 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7312165763754922182', time=2024-09-14T13:27:02.950882+0000, chain.objs.size()=1 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.g6Ef5YqL12KeZXeHfAfuQhHNn7o5Q9f_0 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17464144031427106759', time=2024-09-14T13:27:02.959717+0000, chain.objs.size()=1 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3zbYOvfNAX_j4KoTfy7Kk4TmLwogbjI_0 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12613603252212811526', time=2024-09-14T13:27:02.964314+0000, chain.objs.size()=1 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WsA9ZnPX69-qAKEM1NvHhgYOIE3iCSg_0 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11870440149499811591', time=2024-09-14T13:27:03.403890+0000, chain.objs.size()=1 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.263__shadow_.uddp8A4hyjn2op4Fd5s51V07crzpWX-_0 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11398552533867057296', time=2024-09-14T13:27:03.920340+0000, chain.objs.size()=1 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.264__shadow_.-pdfEwbbFY4yJmOJwkNDgHLCl0X3Jy4_0 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12177289761128851450', time=2024-09-14T13:27:18.507339+0000, chain.objs.size()=1 2024-09-14T11:37:46.341 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.342+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.2PffLgVcjBMQMvPPaH13iifMRQbaWGL_0 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12794953306730928959', time=2024-09-14T13:27:20.416684+0000, chain.objs.size()=1 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.297__shadow_.Fey-HGS6Go1lt16xukC2jL9Su7KrwbR_0 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13867103823701659407', time=2024-09-14T13:27:40.788267+0000, chain.objs.size()=1 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MD7DuPfYRIVif7JGwO-6mbh8V-zbZMf_0 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1657146433857303299', time=2024-09-14T13:27:40.807434+0000, chain.objs.size()=1 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QrKXETUyszfuJv5JTsxU0rUcRhREp9E_0 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14644861228111716457', time=2024-09-14T13:27:40.814750+0000, chain.objs.size()=1 2024-09-14T11:37:46.342 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.K5GgVNQudIEZyrrkDEVfE58RiHCW2vu_0 2024-09-14T11:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14137960241100988462', time=2024-09-14T13:27:40.832138+0000, chain.objs.size()=1 2024-09-14T11:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Wxuom6m7zJoa4FDqFDQajBv1APL0zH8_0 2024-09-14T11:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2750065605952794795', time=2024-09-14T13:27:40.847913+0000, chain.objs.size()=1 2024-09-14T11:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.343+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LoMpcWoic2bZiYUPUnhEjyN7e3Nd6Yf_0 2024-09-14T11:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.344+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2878047501787500235', time=2024-09-14T13:27:40.892432+0000, chain.objs.size()=1 2024-09-14T11:37:46.343 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.344+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.G-hJuhHpQVEptE3kxcZeAPTSB-EjtKt_0 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.344+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14621939871287706988', time=2024-09-14T13:27:40.920643+0000, chain.objs.size()=1 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.344+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UwFvajsNnOZOkikMKMd7OE-CNnt8OqA_0 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12546540955589894699', time=2024-09-14T13:27:40.921921+0000, chain.objs.size()=1 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.60ZYKezlJR1N1JPt73U1govXGCOPHBZ_0 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6785307855315713026', time=2024-09-14T13:27:41.040203+0000, chain.objs.size()=1 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._rEY0ANMkLirF1DRwnniBzWMuIDiW_3_0 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6299489842333599843', time=2024-09-14T13:27:41.082703+0000, chain.objs.size()=1 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.j5-kjHzr0ur_gQdFPdnHRuxMTdjohJe_0 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16163975388851119833', time=2024-09-14T13:27:41.303011+0000, chain.objs.size()=1 2024-09-14T11:37:46.344 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.345+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.B5fRzTKMFzFhcuj6fKhHMiC-SRMV64B_0 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13480795481968973056', time=2024-09-14T13:27:41.360999+0000, chain.objs.size()=1 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.RIOZgFMZ97lguv8wrCHxB7WMtZRNEf0_0 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6207798475051325775', time=2024-09-14T13:27:41.371587+0000, chain.objs.size()=1 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YVlFu0s2lFW3yktJ9iteeTVj3GCwTQl_0 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2967320667594520587', time=2024-09-14T13:27:41.561863+0000, chain.objs.size()=1 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.61dW_LVTI5cmfG7aEGW-Qk6o-zV1XeI_0 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2591500441047383234', time=2024-09-14T13:27:41.562625+0000, chain.objs.size()=1 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rKATP5zF5VylbSf84qj4Yfbx5rYPElY_0 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3978207016758244506', time=2024-09-14T13:27:41.621300+0000, chain.objs.size()=1 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SYh4a0k5f_aZY9CApVmjIJ2bH6Xj1Sp_0 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11104655816036128461', time=2024-09-14T13:27:41.640316+0000, chain.objs.size()=1 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ANB0KMNrQ4GIlqMZ3nuxdMBTLsQQOso_0 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18058917026099189890', time=2024-09-14T13:27:41.652418+0000, chain.objs.size()=1 2024-09-14T11:37:46.345 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.346+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Qej9LuoZYxrkqrMR1I1Uf_7N_u3pxzg_0 2024-09-14T11:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.347+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.99129784861809298', time=2024-09-14T13:27:41.856156+0000, chain.objs.size()=1 2024-09-14T11:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.347+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rTUdH1Q5-vqe3eD_hoQVteMumIywkj8_0 2024-09-14T11:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.347+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6986317060996999093', time=2024-09-14T13:27:42.112384+0000, chain.objs.size()=1 2024-09-14T11:37:46.346 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.347+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.j_E4HGNbz7q_3U0d4GmBFnPuviUmYUN_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.347+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12082622235246109759', time=2024-09-14T13:27:42.114999+0000, chain.objs.size()=1 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.347+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FXXDzpDfKvYH3K-aDcWxkGqv_uVys1E_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10791808555619057367', time=2024-09-14T13:27:42.140623+0000, chain.objs.size()=1 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sBQ4dFEWNcBIC4PY7Nw7cLHjG5lOhoI_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6587266626258185458', time=2024-09-14T13:27:42.142576+0000, chain.objs.size()=1 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dPR0wBhgnmuwf1kXPSTXFUOdPYGiZhF_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1992226360588059062', time=2024-09-14T13:27:42.307173+0000, chain.objs.size()=1 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yTXxNNwiGSdouGIhwGTcnkLk74panse_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3537638470423941787', time=2024-09-14T13:27:42.344472+0000, chain.objs.size()=1 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ByybyugABVJwacewgu2VKFUXLWvu-Dg_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6286747635509931743', time=2024-09-14T13:27:42.408449+0000, chain.objs.size()=1 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Z2ZmSilub9TJfry_k5m5zuDkPAMgbB1_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13520183176477448113', time=2024-09-14T13:27:42.457449+0000, chain.objs.size()=1 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.weEB0mdFO5XA2CwgeSTlhOfY-KvwKPF_0 2024-09-14T11:37:46.347 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3701633987512683773', time=2024-09-14T13:27:42.648401+0000, chain.objs.size()=1 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.348+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LEm8inEZ7HUXbqiGk2jRdqRU40qdN-s_0 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1817026764547723791', time=2024-09-14T13:27:50.534884+0000, chain.objs.size()=1 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CMh8lMg4YqnjM_e4ESZB1xvKQj-ZCma_0 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8092983639780748894', time=2024-09-14T13:27:50.558329+0000, chain.objs.size()=1 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FIME_gOM3a_DjdQGegNhvYfOMBynm41_0 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4699656892714682284', time=2024-09-14T13:27:50.682261+0000, chain.objs.size()=1 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cBENwUFWl5ZH8SBODXFwdDRyM_b-d2F_0 2024-09-14T11:37:46.348 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9301103783601644206', time=2024-09-14T13:27:50.687794+0000, chain.objs.size()=1 2024-09-14T11:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.349+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HPpikI5nPZlAenNSmyaYv7zM4FPDY5c_0 2024-09-14T11:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.350+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4550844130814559225', time=2024-09-14T13:27:50.707380+0000, chain.objs.size()=1 2024-09-14T11:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.350+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.PMo-A4EpYv2BxmG2o2SQZ2qc8J_cZRf_0 2024-09-14T11:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4897634126258710452', time=2024-09-14T13:27:50.712118+0000, chain.objs.size()=1 2024-09-14T11:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nPlRsRslnyGG7C1Uk_rH2brGzWfrzjy_0 2024-09-14T11:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11218185368831323851', time=2024-09-14T13:27:50.737949+0000, chain.objs.size()=1 2024-09-14T11:37:46.349 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DM9VOTKj110T8KCdBb81O-FSeWA75Fe_0 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13078437825664839606', time=2024-09-14T13:27:50.798674+0000, chain.objs.size()=1 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.s4BdOZeN4eJ-GaiwBYerGx58gim3nmY_0 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12675363733144528596', time=2024-09-14T13:27:50.945063+0000, chain.objs.size()=1 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.c8d0gQbX2xX1UUl-ymsYCAquPq6JYPI_0 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9601142249648501029', time=2024-09-14T13:27:50.956401+0000, chain.objs.size()=1 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.brimiyuKF2IN8Bp7mrHY27lSEM8N_9C_0 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1644122285994144929', time=2024-09-14T13:27:50.958221+0000, chain.objs.size()=1 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.paPlnVLZKd940oLr1jBqU04hNzV2Mni_0 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2589569097252362307', time=2024-09-14T13:27:50.977506+0000, chain.objs.size()=1 2024-09-14T11:37:46.350 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.351+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.sTwMTOTeeOY7iZsAwJEV-YATH-K6_Xq_0 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17292367652041576451', time=2024-09-14T13:27:50.988898+0000, chain.objs.size()=1 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1t1ZuultNcUJsyI4yMsobbzGcLGEyXt_0 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5505257490909761128', time=2024-09-14T13:27:51.026754+0000, chain.objs.size()=1 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YpeDQrd-2oXdLb_DLePx7JFktbFRCiw_0 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16874363423400951521', time=2024-09-14T13:27:51.033875+0000, chain.objs.size()=1 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hEnSbgsIVZ5ETHzXN14gg8uWoE7MOXr_0 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14380795393977716157', time=2024-09-14T13:27:51.065187+0000, chain.objs.size()=1 2024-09-14T11:37:46.351 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lIE4vV90oMqyXXJF4QqY4U9ti1TPkfE_0 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.36848103422615063', time=2024-09-14T13:27:51.194417+0000, chain.objs.size()=1 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5IXcgXUxUU3L_wmGq9oDTHZu8Zy5-fc_0 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5598769549878698039', time=2024-09-14T13:27:51.199329+0000, chain.objs.size()=1 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uUWsb4Aq4zR1rLC85fTWK9FC4M6wz_J_0 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10597652260108764280', time=2024-09-14T13:27:51.265333+0000, chain.objs.size()=1 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.352+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zbNt8R8ZATkGKgFPc2kdS5oXlc_9txQ_0 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.353+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10635596845050224766', time=2024-09-14T13:27:51.294270+0000, chain.objs.size()=1 2024-09-14T11:37:46.352 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.353+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Aw651gPbBWdzez8FOoQsju7J1HBf07W_0 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2967523954282402473', time=2024-09-14T13:27:51.485007+0000, chain.objs.size()=1 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lI4ru77TLVMKpO6YWS_F7fPmWpt6ezN_0 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13954622296953422159', time=2024-09-14T13:27:51.502860+0000, chain.objs.size()=1 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.QjdkIXYcFXSI2MrhOJGlLu5X3RJpivn_0 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8215149546038259628', time=2024-09-14T13:27:51.514982+0000, chain.objs.size()=1 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YEYvxO4fHYMx1g_xgq9mHR9G4NPKlS4_0 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8240377996959068693', time=2024-09-14T13:27:51.559570+0000, chain.objs.size()=1 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YMWtx9VXhFZ4kViMga4M4yI4v-TqZxw_0 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4757799700825558435', time=2024-09-14T13:27:51.587511+0000, chain.objs.size()=1 2024-09-14T11:37:46.353 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gr5DJOeInvjrdi6cePgee3N6JnRs4RW_0 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7857123310675730989', time=2024-09-14T13:27:51.594382+0000, chain.objs.size()=1 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6GnqPB97XesRbUpN4Hgl9iFbta45QyP_0 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.487553255625767962', time=2024-09-14T13:27:51.598942+0000, chain.objs.size()=1 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qNcthGGceQudQK04bd2KIQtSUirIyFD_0 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5064151438097041615', time=2024-09-14T13:27:51.608655+0000, chain.objs.size()=1 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wZnhLvdyyj9b9-47zCgvM4tZLUurrh6_0 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6490068436448966894', time=2024-09-14T13:27:51.771415+0000, chain.objs.size()=1 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kNjmlvYu3ITJjF9ZJsvWyuGoBej2wjM_0 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.436194401446338961', time=2024-09-14T13:27:51.967513+0000, chain.objs.size()=1 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZIxDPR_uZqR5JrTRJaCnciDoFXlTrgK_0 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12970563891407992982', time=2024-09-14T13:27:52.016918+0000, chain.objs.size()=1 2024-09-14T11:37:46.354 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.354+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YKJDbbD8fX1tYxQDM1sHuTirMEj4ahu_0 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2181729812896582151', time=2024-09-14T13:27:52.220759+0000, chain.objs.size()=1 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.WlOfpJrWYkSuM-rXAPH4M7wFtwCrCEi_0 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.246816661666850845', time=2024-09-14T13:27:52.328716+0000, chain.objs.size()=1 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ymxgJtxrHpE4zUuY9CiHerRIc5A5NvG_0 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14872947334991329910', time=2024-09-14T13:27:52.339502+0000, chain.objs.size()=1 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8fDN1xnl7DMDI-YPHRt85Pim4LM3Ap0_0 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8980022789549704372', time=2024-09-14T13:27:55.776540+0000, chain.objs.size()=1 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.332__shadow_.vszYvMxarzLe2k6Z2SNRYL10vp9WjQt_0 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13059178792491106638', time=2024-09-14T13:28:22.883287+0000, chain.objs.size()=1 2024-09-14T11:37:46.355 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.356+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.390__shadow_.DFuofQUZ7as7R8gyWHkoJpJ5gbH_pEi_0 2024-09-14T11:37:46.356 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.358+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/46246 2024-09-14T11:37:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=17, truncated=0, next_marker='' 2024-09-14T11:37:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3725063423616385771', time=2024-09-14T13:28:47.604143+0000, chain.objs.size()=1 2024-09-14T11:37:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.437__shadow_.unA47iio31MO4V8kweZ7rGOWWwBiLOw_0 2024-09-14T11:37:46.359 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15094135921673040214', time=2024-09-14T13:28:48.479330+0000, chain.objs.size()=1 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.439__shadow_.7LHf37WbgDkU0z418j9claJOiObdf76_0 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8466990901347836492', time=2024-09-14T13:29:03.921671+0000, chain.objs.size()=1 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.464__shadow_.6AMFKfIjM3O77XbiveDjLBTneTdcnT1_0 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8159616986073164883', time=2024-09-14T13:29:04.341128+0000, chain.objs.size()=1 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.465__shadow_.NwNTym7A6srSQalWM4Pbv8_ngK6LI3H_0 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15109653132877243880', time=2024-09-14T13:29:04.497262+0000, chain.objs.size()=1 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.465__shadow_.v1sE35fdlfeDz0rLNnkq_ZM3UCkno9I_0 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2630194669004526019', time=2024-09-14T13:29:12.214777+0000, chain.objs.size()=1 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.486__shadow_.eD3uTuIDfAQCFQYHxkLVC2KeNlMCjEi_0 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8745035662046432574', time=2024-09-14T13:29:24.881323+0000, chain.objs.size()=1 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.514__shadow_.TlixqAEtFsMxt2WZ8cTqhEnX5gcrhaM_0 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11348433670071762702', time=2024-09-14T13:29:27.556195+0000, chain.objs.size()=1 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.517__shadow_.rgzQMUUUfm6GfKd7r29m-yzAGlvlquK_0 2024-09-14T11:37:46.360 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3322557944118553260', time=2024-09-14T13:29:30.472112+0000, chain.objs.size()=6 2024-09-14T11:37:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.519__multipart_mymultipart.2~fInjxoVAi7VufSSLwqhrUH7Bnq0RxqN.1 2024-09-14T11:37:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.519__multipart_mymultipart.2~fInjxoVAi7VufSSLwqhrUH7Bnq0RxqN.2 2024-09-14T11:37:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.519__multipart_mymultipart.2~fInjxoVAi7VufSSLwqhrUH7Bnq0RxqN.3 2024-09-14T11:37:46.361 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.361+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.519__multipart_mymultipart.2~fInjxoVAi7VufSSLwqhrUH7Bnq0RxqN.4 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.519__multipart_mymultipart.2~fInjxoVAi7VufSSLwqhrUH7Bnq0RxqN.5 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.519__multipart_mymultipart.2~fInjxoVAi7VufSSLwqhrUH7Bnq0RxqN.6 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8496053581182684255', time=2024-09-14T13:30:26.559243+0000, chain.objs.size()=1 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.550__shadow_.M1gMBaLaj3Tw0zAxvtV6qfM9HFe7bjg_0 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3692310193385324081', time=2024-09-14T13:30:46.026000+0000, chain.objs.size()=1 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:xwPQzBUNh8leS3N84mZpyXXlrOyLo2X_.6oLEGZd8Gmmw5kp5Xl1paooEx47WeQa_0 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2008417066589365294', time=2024-09-14T13:31:02.459709+0000, chain.objs.size()=1 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:uzgvF.njXTp-6qrprqJM4tw3bdQosez_.YsvtVrLsNU4PUL8kEDkA8v3OJ-cEV7N_0 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7234171757810366513', time=2024-09-14T13:31:08.029934+0000, chain.objs.size()=1 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:oKEmjhbOxPB8dulrUsQCxb7PR7Xmhqf_.CB9-h5jW5zQLfwnRe9MZWmELSjYKdGh_0 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.180693209292026976', time=2024-09-14T13:31:19.212389+0000, chain.objs.size()=1 2024-09-14T11:37:46.362 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:kRt1H3t.Laec9wuj32nFnKhtmYNSC.t_.K3M5GQncP1C9BUwUBWRnK0rHs_mz6ij_0 2024-09-14T11:37:46.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10307942944821390423', time=2024-09-14T13:34:03.964478+0000, chain.objs.size()=6 2024-09-14T11:37:46.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.662__multipart_foo.2~Il_YBnh-OZHbvaCPir5Hh871TGYhdaR.1 2024-09-14T11:37:46.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.662__multipart_foo.2~Il_YBnh-OZHbvaCPir5Hh871TGYhdaR.2 2024-09-14T11:37:46.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.662__multipart_foo.2~Il_YBnh-OZHbvaCPir5Hh871TGYhdaR.3 2024-09-14T11:37:46.363 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.363+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.662__multipart_foo.2~Il_YBnh-OZHbvaCPir5Hh871TGYhdaR.4 2024-09-14T11:37:46.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.366+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.662__multipart_foo.2~Il_YBnh-OZHbvaCPir5Hh871TGYhdaR.5 2024-09-14T11:37:46.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.366+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.662__multipart_foo.2~Il_YBnh-OZHbvaCPir5Hh871TGYhdaR.6 2024-09-14T11:37:46.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.366+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4978692688364897389', time=2024-09-14T13:35:25.769173+0000, chain.objs.size()=1 2024-09-14T11:37:46.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.366+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.763__shadow_.-0pIpmCbvuIHah7lqoBnisumw_oYBwx_0 2024-09-14T11:37:46.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.366+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13680282640261593178', time=2024-09-14T13:35:30.992474+0000, chain.objs.size()=1 2024-09-14T11:37:46.364 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.366+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.770__shadow_.mJoUg_IFSEKqAgmoTbLjgG8yq8flzEA_0 2024-09-14T11:37:46.367 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.369+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.369 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.371+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-14T11:37:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.372+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.370 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43923' 2024-09-14T11:37:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_44fhgZwFYlxZiAmH2GgfsE8Q9bFF3-v', time=2024-09-14T13:24:57.950814+0000, chain.objs.size()=2 2024-09-14T11:37:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.yPdBiOl79IVY9KYRrX5ljNtXgxDO6JQ_0 2024-09-14T11:37:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.yPdBiOl79IVY9KYRrX5ljNtXgxDO6JQ_1 2024-09-14T11:37:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_TjmCaQIGuaePrw0PRSuvW2spjB8Nd8w', time=2024-09-14T13:24:58.413664+0000, chain.objs.size()=1 2024-09-14T11:37:46.372 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.PMdE-_WMF6nIUbBvIazcOBLdhEx2n-A_0 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_RH-VQNHi2_U8XDBUeKOv0QDaxDxXceT', time=2024-09-14T13:25:00.225997+0000, chain.objs.size()=1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.163__shadow_.eZOOmWFvuWIf8XY4LUARzyLtrr2Fod-_0 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1322628327605093196', time=2024-09-14T13:25:26.918664+0000, chain.objs.size()=1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.373+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.199__shadow_.I1ni6Y0533uGQSLr4-Nq5co0DO38DlW_0 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~ypXFnbS_0-QX8XXJYqvFep2wYLWqOp7', time=2024-09-14T13:25:27.985943+0000, chain.objs.size()=1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.201__multipart_mymultipart.2~ypXFnbS_0-QX8XXJYqvFep2wYLWqOp7.1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1135886831464353245', time=2024-09-14T13:26:41.904074+0000, chain.objs.size()=1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.238__shadow_.em4eH7BSUf59M5kYcbcwZWBvL7Zge9R_0 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11055106246020955967', time=2024-09-14T13:26:47.374755+0000, chain.objs.size()=1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.248__shadow_.qj0dtEjWQvhNgQhmzPLztJs9S5uCjdI_0 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3869314263188917945', time=2024-09-14T13:26:48.774880+0000, chain.objs.size()=1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.251__shadow_.JYs1qU47Cmig3MBMn57EKPrkGCYugjo_0 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11805248731649144217', time=2024-09-14T13:26:51.336338+0000, chain.objs.size()=1 2024-09-14T11:37:46.373 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.256__shadow_.HZtxc7_XowzcVQ38GtpMMoZ7GOu7bPr_0 2024-09-14T11:37:46.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15928082812879299680', time=2024-09-14T13:27:01.202030+0000, chain.objs.size()=1 2024-09-14T11:37:46.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UnOVzWfdaf0MqDzCDemd7Rvx8fZXE8w_0 2024-09-14T11:37:46.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11828621853848467196', time=2024-09-14T13:27:01.412353+0000, chain.objs.size()=1 2024-09-14T11:37:46.374 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.374+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nNMebKaNvgQKTPaVGq47feVSiP84AVm_0 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9491692552574157571', time=2024-09-14T13:27:01.436514+0000, chain.objs.size()=1 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yjc4C8Nks0MQm15BvaNoN50WiLEGN39_0 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12403245622721470310', time=2024-09-14T13:27:01.512415+0000, chain.objs.size()=1 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Pwx9MnyuZqxvNW_CDG_1xt1K1VYuQLp_0 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14316933141467527627', time=2024-09-14T13:27:01.528153+0000, chain.objs.size()=1 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BSOKAgQ5iwIZOHclJ-tRtircuLf9dPJ_0 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10492307617525605062', time=2024-09-14T13:27:01.668701+0000, chain.objs.size()=1 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9byf4lnVc1wGqGfAkyM-DhwYw4LWFw4_0 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15706083609201545048', time=2024-09-14T13:27:01.740595+0000, chain.objs.size()=1 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.96tHhQwj3k9QppLX8i_xYb6TqcCVwrM_0 2024-09-14T11:37:46.375 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1072571676169587801', time=2024-09-14T13:27:01.803178+0000, chain.objs.size()=1 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._maMQ8QPAGTT709btdcWJCzFU05pzM5_0 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16106295072880336733', time=2024-09-14T13:27:02.157882+0000, chain.objs.size()=1 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lm2GKh7M3lLVdGyefMMNJF7-lxAeC4X_0 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17254326899882330172', time=2024-09-14T13:27:02.169789+0000, chain.objs.size()=1 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-3HGylXkRTg23queSnDxjYSPSnsOn2N_0 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5833324001138166238', time=2024-09-14T13:27:02.190227+0000, chain.objs.size()=1 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5NLlRH2RXp9td_Rf9MBvv-XpCVeWAH__0 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12486360865339133872', time=2024-09-14T13:27:02.225440+0000, chain.objs.size()=1 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Kzg4QJmYewraHLr8CNcdo95wsg0A8JM_0 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11006280873288598175', time=2024-09-14T13:27:02.242232+0000, chain.objs.size()=1 2024-09-14T11:37:46.376 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.376+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.k60nccVBCAMBpNTOCrGBvHBs4V4nhzC_0 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.378+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17415321617950390007', time=2024-09-14T13:27:02.373634+0000, chain.objs.size()=1 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.378+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._09UTQGbXLOw0QgEw7sdlZ46iVBrG3s_0 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12379987247913869286', time=2024-09-14T13:27:02.419181+0000, chain.objs.size()=1 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.AjVIbXq2T_LGx08ETn1SBFbZJQ6Q-8I_0 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18325072414681584533', time=2024-09-14T13:27:02.422890+0000, chain.objs.size()=1 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FkCc77Y6yV4I1bwZcygb9zhPn23-1dP_0 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2841024604713013690', time=2024-09-14T13:27:02.442810+0000, chain.objs.size()=1 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.juPwiGKdYMCmmmO2MBZFrFfgYsaPx7u_0 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6580989695036241573', time=2024-09-14T13:27:02.453515+0000, chain.objs.size()=1 2024-09-14T11:37:46.377 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.L280R6V9hHQx79cmrdf27O0yb4vXJKN_0 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17199806813365859943', time=2024-09-14T13:27:02.609302+0000, chain.objs.size()=1 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.AwqGFh7v4QZDKREg-Wn_5vlzBJFk-Ms_0 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17768468880460931395', time=2024-09-14T13:27:02.632407+0000, chain.objs.size()=1 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XCAICUUmB1F97_lw7goJaazXmzFj-jl_0 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3301219879248645649', time=2024-09-14T13:27:02.651885+0000, chain.objs.size()=1 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.YY6-gf5ttwb85DiOQ6KZWTfZ34wtIJO_0 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8146117190482155190', time=2024-09-14T13:27:02.750766+0000, chain.objs.size()=1 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nD_HW7GGLKSULGhHp1sE2hljDn5p5Mn_0 2024-09-14T11:37:46.378 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3918671651241034210', time=2024-09-14T13:27:02.869766+0000, chain.objs.size()=1 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nWqqyvREAuKoJOTv_vofWWjX7t_zFCB_0 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11681372957613348158', time=2024-09-14T13:27:02.895767+0000, chain.objs.size()=1 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.379+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8RZn2VroJKcOcM4Ctg-BM7ZPDXKf7hF_0 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16914801550576058322', time=2024-09-14T13:27:08.082668+0000, chain.objs.size()=1 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.273__shadow_.3lkYOJz5r818bmrh4i7I0De23P-tC0J_0 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8637524837903698261', time=2024-09-14T13:27:17.686474+0000, chain.objs.size()=1 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.MAT_nr4pUZGkgkXrGxjm3x3GJ7F2Ly__0 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3348169506972710684', time=2024-09-14T13:27:18.972493+0000, chain.objs.size()=1 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.294__shadow_.-ne1AOe6LdpyYGCVqrYW9JgsdEbIr70_0 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8396963671109303067', time=2024-09-14T13:27:23.052147+0000, chain.objs.size()=1 2024-09-14T11:37:46.379 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.381+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.302__shadow_.p_ERDgbem3fkwx5CcGGyMkzKNKmP_Xc_0 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15670100632778989618', time=2024-09-14T13:27:23.052957+0000, chain.objs.size()=1 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.302__shadow_.yd1LW2FxIZPiqYEadbjjftV6Iiuk0Gu_0 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4344662726126915122', time=2024-09-14T13:27:23.975469+0000, chain.objs.size()=1 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.304__shadow_.Je3nwONV5EcxAp6TnwwMbExpdcvqesK_0 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3063925926086130880', time=2024-09-14T13:27:31.726011+0000, chain.objs.size()=1 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.319__shadow:CFbdOgjTGmEKbcGAWlQvpd7iyRBaqDK_.TewaAsyElYR4Lf7WUesum1gUAql7Jvo_0 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7059845575974322196', time=2024-09-14T13:27:40.829478+0000, chain.objs.size()=1 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t8wbrratwZXEkhDKMUGrUnWjCGxzuCb_0 2024-09-14T11:37:46.380 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6514777694775222349', time=2024-09-14T13:27:40.914694+0000, chain.objs.size()=1 2024-09-14T11:37:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7pbfL_HYr8rOoOJaATwAA7A-MbJQjvT_0 2024-09-14T11:37:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12559976126449772263', time=2024-09-14T13:27:41.057693+0000, chain.objs.size()=1 2024-09-14T11:37:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HFkSH6RUgYVPlKVRr8ZV6aIKujdsXKP_0 2024-09-14T11:37:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17475320237970337363', time=2024-09-14T13:27:41.061872+0000, chain.objs.size()=1 2024-09-14T11:37:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mV-RGN6q0VWV0uf6-I6uK4j1oUY2dln_0 2024-09-14T11:37:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7575501484242359765', time=2024-09-14T13:27:41.070965+0000, chain.objs.size()=1 2024-09-14T11:37:46.381 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6qrgAA5kHR0TEmc8E1LGnjJMIzGMDWI_0 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10536172206228718115', time=2024-09-14T13:27:41.093064+0000, chain.objs.size()=1 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.382+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.TQtDFcnqUunIRUqu0dRtCBY8lrueVVl_0 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.383+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14903472419684745643', time=2024-09-14T13:27:41.097272+0000, chain.objs.size()=1 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.383+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.iJuCtJnlQOdIPvunS4BBEWaIpN_qAIq_0 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.383+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.482307700151435899', time=2024-09-14T13:27:41.129918+0000, chain.objs.size()=1 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.383+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GzuGXQuHfnmWE5BmuMlI5M523PtczRi_0 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2737486325693511705', time=2024-09-14T13:27:41.141543+0000, chain.objs.size()=1 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NC-viMgacIwt2sNrJeLN1QRBKTNdvC5_0 2024-09-14T11:37:46.382 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6129602642719179454', time=2024-09-14T13:27:41.300030+0000, chain.objs.size()=1 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KhTq_aNa9CCC2LpT9hJh-ihqqGb47BJ_0 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12927169057691505026', time=2024-09-14T13:27:41.319026+0000, chain.objs.size()=1 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WC7FeIgcdZIBE4sMoOlzOQhAAZbJN_F_0 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1390539737317174829', time=2024-09-14T13:27:41.347204+0000, chain.objs.size()=1 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SBUi4_4RCh7SbGhiuPWTuiegtp8DoCq_0 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16211521033850944100', time=2024-09-14T13:27:41.359405+0000, chain.objs.size()=1 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.E47RVC4haPvAAuiWgsJZ2a1KM7PE11T_0 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1558415873624741219', time=2024-09-14T13:27:41.391745+0000, chain.objs.size()=1 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1WVU2KpKJqyredx7rQXk9dh8XlhxFeP_0 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8560504051247003527', time=2024-09-14T13:27:41.425767+0000, chain.objs.size()=1 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lHWLNmNIYSk7GUise2ehYSDdv6MLWdI_0 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6921068556141789620', time=2024-09-14T13:27:41.473587+0000, chain.objs.size()=1 2024-09-14T11:37:46.383 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.384+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.faTs7H1f9nfC5O183-TC4zF_EclcfhX_0 2024-09-14T11:37:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.385+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16982375152024381696', time=2024-09-14T13:27:41.642814+0000, chain.objs.size()=1 2024-09-14T11:37:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.385+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.w8KgJzRMiOYfn-hqEG3Od4bS8VycoNl_0 2024-09-14T11:37:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.385+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.23206401001654324', time=2024-09-14T13:27:41.677316+0000, chain.objs.size()=1 2024-09-14T11:37:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.385+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.fjBN88I1lAzO9x26qB_uN8fK8fqLQdc_0 2024-09-14T11:37:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.385+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3019966585368030561', time=2024-09-14T13:27:41.717995+0000, chain.objs.size()=1 2024-09-14T11:37:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.385+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kSZ7JxhscX_APLlrVeS9sgmA9-_lt9__0 2024-09-14T11:37:46.384 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17921737125976159233', time=2024-09-14T13:27:41.849444+0000, chain.objs.size()=1 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._UH5McZAYp-H2BkZJjB7iaE_ofnbyO5_0 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2954766004132930236', time=2024-09-14T13:27:41.922610+0000, chain.objs.size()=1 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VTa7-vsbW724SZokZlgDax_D44yGaow_0 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1043233755496663128', time=2024-09-14T13:27:42.172312+0000, chain.objs.size()=1 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2sUQTfH7b6VIGx37fnrEiYn7vQPqOGt_0 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3715242478839122061', time=2024-09-14T13:27:42.184328+0000, chain.objs.size()=1 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.B5zVgAw52FZJKMNwf6UJhNJC6HIluOU_0 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1616135630588844117', time=2024-09-14T13:27:42.336114+0000, chain.objs.size()=1 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Im_qB1HxKOkZ7VDeLRnJ0M_ly5RhIOr_0 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6923794818704543445', time=2024-09-14T13:27:42.363708+0000, chain.objs.size()=1 2024-09-14T11:37:46.385 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3FajYAi3q32hdr-nVgGhZGfSM1DsCuF_0 2024-09-14T11:37:46.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10318256034425002208', time=2024-09-14T13:27:42.413041+0000, chain.objs.size()=1 2024-09-14T11:37:46.386 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6N1mkKcSrV1RODn7TthoEDD2WhebegZ_0 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8823347227473008777', time=2024-09-14T13:27:42.471157+0000, chain.objs.size()=1 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.n8I-56tkr-HMeYHVZf79PvfYEf1_vYH_0 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9906047340419740353', time=2024-09-14T13:27:42.602335+0000, chain.objs.size()=1 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.386+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dv2393U3Soys_PEeTydi4r96NkrgmPf_0 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.387+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17550387505742350298', time=2024-09-14T13:27:42.612575+0000, chain.objs.size()=1 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.387+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Vlr4h4ZAvgxmZuTXPSCIKeF6l7dwKc-_0 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.387+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8733070624899270133', time=2024-09-14T13:27:42.640448+0000, chain.objs.size()=1 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.387+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SIU3bfSPLXMonTmwkqhGzw8zQPMT37e_0 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8436784217956602063', time=2024-09-14T13:27:42.652067+0000, chain.objs.size()=1 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FIGZgcKpwNV-5FX26j-_3bOaOXe-eJC_0 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16172351095888436855', time=2024-09-14T13:27:42.675334+0000, chain.objs.size()=1 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DWfiUm7aMvlvhCX_bow19JExyOgfbO3_0 2024-09-14T11:37:46.387 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2759963100531206143', time=2024-09-14T13:27:50.428033+0000, chain.objs.size()=1 2024-09-14T11:37:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4EyMCFXWCr1o5rHQ58-5eOvjW-4-dZU_0 2024-09-14T11:37:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12732148068976260618', time=2024-09-14T13:27:50.428769+0000, chain.objs.size()=1 2024-09-14T11:37:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xDTjjLNbkInQtQohYwwfncJOKYb-rEU_0 2024-09-14T11:37:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12010417849720686409', time=2024-09-14T13:27:50.528346+0000, chain.objs.size()=1 2024-09-14T11:37:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.388+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DpmJX-jZ_slxsS0AlAqCVeryPpqQXq9_0 2024-09-14T11:37:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7171782694906020919', time=2024-09-14T13:27:50.557985+0000, chain.objs.size()=1 2024-09-14T11:37:46.388 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8CZQd4tmyRDABnZSDl0uwCeNDsU9WW6_0 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15289385559056533244', time=2024-09-14T13:27:50.720316+0000, chain.objs.size()=1 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bc2FovK-9JQaiJmUCj-xdSDKvX2xCQX_0 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16591461014529866478', time=2024-09-14T13:27:50.772901+0000, chain.objs.size()=1 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uyin065kMz4CCE4sM86G3K2nTg5N1Ur_0 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5329399973745591641', time=2024-09-14T13:27:50.940608+0000, chain.objs.size()=1 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aJovPCHb3Mj33LbzDqKDypFtY8uUhWl_0 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6406602451172299848', time=2024-09-14T13:27:50.944369+0000, chain.objs.size()=1 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.XB34Fh65XJ0sYpOOaOJTr32AwHLBm5k_0 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9906324213358161543', time=2024-09-14T13:27:50.965521+0000, chain.objs.size()=1 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SwBJUsAquXQwJYn2YRzB4H6I3cOTfwG_0 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3321736157972652879', time=2024-09-14T13:27:50.993133+0000, chain.objs.size()=1 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AIMljJ7vqZJFYqkQWyTjyOz8ThhIqPY_0 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8094949710805595284', time=2024-09-14T13:27:51.072364+0000, chain.objs.size()=1 2024-09-14T11:37:46.389 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ryTDi7etB37gaNxqJ7sV8OIj3ZptEFt_0 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14726494201491604993', time=2024-09-14T13:27:51.225828+0000, chain.objs.size()=1 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Jha58sjAe_ofnEz839dDq9qqlHNLb4D_0 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13078611893461574780', time=2024-09-14T13:27:51.242615+0000, chain.objs.size()=1 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HZEP5GWVIdFB4oDqXzWCeBE7zVFSXXB_0 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.389+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1655491808380670946', time=2024-09-14T13:27:51.272050+0000, chain.objs.size()=1 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.390+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1vAORtfIAOihWMMbRtod1DkwDfmjsqq_0 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.391+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8787066613930135294', time=2024-09-14T13:27:51.286487+0000, chain.objs.size()=1 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.391+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6GYL05MTA_IWtj8DEw9TixqkS_rEwew_0 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.391+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15845963565939301571', time=2024-09-14T13:27:51.343836+0000, chain.objs.size()=1 2024-09-14T11:37:46.390 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0EoNNc_cfdgiOoVV4JdRjzJ77S2fQYD_0 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.876597482870721224', time=2024-09-14T13:27:51.356103+0000, chain.objs.size()=1 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.T50k-sXmdRC91uoL1tX5-DzQyueoZdD_0 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14948957211579729912', time=2024-09-14T13:27:51.448557+0000, chain.objs.size()=1 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.C9LwDcsF5o982wTw56cJBhPXqol5GXq_0 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2687736554948608286', time=2024-09-14T13:27:51.450408+0000, chain.objs.size()=1 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.41dj7ZoB3aUIpXewdcPMlScJnGUOO4Z_0 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14583417827769402096', time=2024-09-14T13:27:51.455879+0000, chain.objs.size()=1 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Affcg2tKoRxHS2c8VbpjiwDUoI461sY_0 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9061560804754562154', time=2024-09-14T13:27:51.514894+0000, chain.objs.size()=1 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.f0DcIZD4hT1-2mt2aaCPWoNticpYYZW_0 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13858532354818047811', time=2024-09-14T13:27:51.612550+0000, chain.objs.size()=1 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aEOEnguhHXZVh_kzA2GN1gC_d_2s58R_0 2024-09-14T11:37:46.391 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13657360795954997684', time=2024-09-14T13:27:51.713819+0000, chain.objs.size()=1 2024-09-14T11:37:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.392+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TakF1-eiEXAFDKmUNJC333I0addFdw7_0 2024-09-14T11:37:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12814624788841698719', time=2024-09-14T13:27:51.773406+0000, chain.objs.size()=1 2024-09-14T11:37:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JGgGAgkDLNRAHMVo-JliY46VKXYbR7-_0 2024-09-14T11:37:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3316352039326591897', time=2024-09-14T13:27:51.839363+0000, chain.objs.size()=1 2024-09-14T11:37:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nnviLvmaml68QWWxokx_hR5us_5xFzM_0 2024-09-14T11:37:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11311342501810374834', time=2024-09-14T13:27:52.011384+0000, chain.objs.size()=1 2024-09-14T11:37:46.392 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.prhFAzevxp2SwPI54QgCznvoTAg4YAC_0 2024-09-14T11:37:46.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1218794458033204867', time=2024-09-14T13:27:52.035098+0000, chain.objs.size()=1 2024-09-14T11:37:46.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qLPmk22DRURLyIuzW83i3J6D_mYGEyn_0 2024-09-14T11:37:46.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9994686332162952569', time=2024-09-14T13:27:52.040717+0000, chain.objs.size()=1 2024-09-14T11:37:46.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.394+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.2HSpX3HhwGcC2qV-WF4ydyIAx83-iBx_0 2024-09-14T11:37:46.393 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.395+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/43923 2024-09-14T11:37:46.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=28, truncated=0, next_marker='' 2024-09-14T11:37:46.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11450957828509792720', time=2024-09-14T13:27:52.043401+0000, chain.objs.size()=1 2024-09-14T11:37:46.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YOYnWrSNhrpgudhjvMtH3H6Ka44sMXA_0 2024-09-14T11:37:46.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8892835916137907062', time=2024-09-14T13:27:52.060966+0000, chain.objs.size()=1 2024-09-14T11:37:46.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oRn_lOYtjnw2OiTwwYgcZCCA7k9RzU0_0 2024-09-14T11:37:46.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7427974407241026854', time=2024-09-14T13:27:52.112687+0000, chain.objs.size()=1 2024-09-14T11:37:46.396 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.J1wi_9f7igT92bVaTCk2N7uDOmnm_gL_0 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16248082278458031523', time=2024-09-14T13:27:52.215513+0000, chain.objs.size()=1 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YyAi7pCNxU4jeY083GZnOWF-QaGf5FU_0 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10151612949927606582', time=2024-09-14T13:27:52.228136+0000, chain.objs.size()=1 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wmVA5-cp39hQDjgE9W3hZT-7dbEi82C_0 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.760542323512598970', time=2024-09-14T13:27:52.309164+0000, chain.objs.size()=1 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5VUvXzAoxMbqT4kIB4TXiyfRokZ8gc3_0 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5867512047289476207', time=2024-09-14T13:27:52.313956+0000, chain.objs.size()=1 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8QfOtIgnb4GAkNCS1zOTJGiIB11VH7E_0 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3246829847507109553', time=2024-09-14T13:27:52.353036+0000, chain.objs.size()=1 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5nhlfKwq6dUUxxWrhvERCh1PtYuzKyJ_0 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14192192208219165140', time=2024-09-14T13:28:46.461761+0000, chain.objs.size()=1 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.435__shadow_.i9jMImxoKkC4o4iKisJJBCP1GVgZXPN_0 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9738004433521994889', time=2024-09-14T13:29:14.158260+0000, chain.objs.size()=1 2024-09-14T11:37:46.397 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.490__shadow_.68Zg0d5DHusF_5FwxOV2n74nhBGjzI0_0 2024-09-14T11:37:46.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9738004433521994889', time=2024-09-14T13:29:14.308479+0000, chain.objs.size()=1 2024-09-14T11:37:46.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.490__shadow_.68Zg0d5DHusF_5FwxOV2n74nhBGjzI0_0 2024-09-14T11:37:46.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11858313240210969757', time=2024-09-14T13:29:17.402449+0000, chain.objs.size()=1 2024-09-14T11:37:46.398 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.398+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.497__shadow_.BagqLBMl3p_n_RyhrH_fZkmdfQjQh83_0 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.399+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9554574718090070084', time=2024-09-14T13:29:22.328559+0000, chain.objs.size()=6 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.399+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.1 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.399+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.2 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.399+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.3 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.400+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.4 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.400+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.5 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.400+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.6 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.400+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3505249097637150052', time=2024-09-14T13:29:46.078957+0000, chain.objs.size()=2 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.400+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~FRCrl704hf_WRZdArWX9-CkEv3d7TSl.1 2024-09-14T11:37:46.399 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~FRCrl704hf_WRZdArWX9-CkEv3d7TSl.2 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2134195203901569045', time=2024-09-14T13:29:47.451610+0000, chain.objs.size()=1 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.524__shadow_.2j0cUKoqRyg8gD_qrCXaH559-tqxtJY_0 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6008783887118424633', time=2024-09-14T13:30:30.898368+0000, chain.objs.size()=1 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.557__shadow_.OzSmmOWmjVGL_wWkDl-0l0jB4B0M4KF_0 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10930372914924213906', time=2024-09-14T13:30:31.027118+0000, chain.objs.size()=1 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.557__shadow_.iohY74_y8rsLU9T4wDhk1S_oZHZip9V_0 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7588295473744451054', time=2024-09-14T13:31:01.100652+0000, chain.objs.size()=1 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:HXJJPKfc8vD7ANJdwrFPs264FVVA-9T_.D50OD8DpBqAZ9pMFdI22RoqeJQ9L0yR_0 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7791392120733685712', time=2024-09-14T13:31:02.048341+0000, chain.objs.size()=1 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:AXQzQgAhxeqbl1-cJ4cmym5H32DXdj0_.lL7nfAU1TE_Kk8dJZcnNOP6nsw_fAZ4_0 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10580435428998437005', time=2024-09-14T13:31:14.026671+0000, chain.objs.size()=1 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.579__shadow:xnHnq0W94xIZIhsqnysNisyEdBBWEOi_.0XlNnaJzI4JFkymYAHXXbz1ESwTiR1s_0 2024-09-14T11:37:46.400 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6495418143547785810', time=2024-09-14T13:31:16.413460+0000, chain.objs.size()=1 2024-09-14T11:37:46.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.583__shadow:wsl4U6FgVqGVvAE0xiyA9Ch3ES81kNX_.J7cOXQJOMlNtLXWdNIEFplMDX3jsH-v_0 2024-09-14T11:37:46.401 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11456286541644166302', time=2024-09-14T13:31:38.147114+0000, chain.objs.size()=1 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.616__shadow_.y5jZn2Fzujhun99urS18pxGnxn_Eczl_0 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11364706885187973647', time=2024-09-14T13:33:43.615877+0000, chain.objs.size()=6 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.401+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.623__multipart_multipart_enc.2~FkNBwDB8RqMtG-59iiPvPJAq97RXf8M.1 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.623__multipart_multipart_enc.2~FkNBwDB8RqMtG-59iiPvPJAq97RXf8M.2 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.623__multipart_multipart_enc.2~FkNBwDB8RqMtG-59iiPvPJAq97RXf8M.3 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.623__multipart_multipart_enc.2~FkNBwDB8RqMtG-59iiPvPJAq97RXf8M.4 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.623__multipart_multipart_enc.2~FkNBwDB8RqMtG-59iiPvPJAq97RXf8M.5 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.623__multipart_multipart_enc.2~FkNBwDB8RqMtG-59iiPvPJAq97RXf8M.6 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15011454407574402221', time=2024-09-14T13:33:47.013630+0000, chain.objs.size()=1 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.629__shadow_.xyC8laNjVeVHfVsKSqUg2aOezJUsKeG_0 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8488686875085776054', time=2024-09-14T13:33:49.842478+0000, chain.objs.size()=1 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.635__shadow_.iCb-lCj0-_7AlqcADYpwLywIGzDquQ-_0 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16188247411790126776', time=2024-09-14T13:34:07.403942+0000, chain.objs.size()=1 2024-09-14T11:37:46.402 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.668__shadow_.nhLOIk_GmBgdMS0QufaWQRskKmYOpPu_0 2024-09-14T11:37:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.512432572365412840', time=2024-09-14T13:34:11.653426+0000, chain.objs.size()=1 2024-09-14T11:37:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.679__shadow_.IweKVJxXm5IcIk07Jn3HYZ0UlpQ-rmS_0 2024-09-14T11:37:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15127635966661687602', time=2024-09-14T13:35:14.431366+0000, chain.objs.size()=1 2024-09-14T11:37:46.403 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.403+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.750__shadow_.hiXFfwPEjoDQgfykHvsJcpStRF7K0un_0 2024-09-14T11:37:46.405 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.407+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.408 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.409+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-14T11:37:46.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.411+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.409 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.412+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50643' 2024-09-14T11:37:46.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5309193570746967305', time=2024-09-14T13:24:55.891286+0000, chain.objs.size()=2 2024-09-14T11:37:46.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.158__shadow_.nyhpDIf7gMB7WnyO-mfij2agbG3JCKG_0 2024-09-14T11:37:46.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.158__shadow_.nyhpDIf7gMB7WnyO-mfij2agbG3JCKG_1 2024-09-14T11:37:46.411 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1109300619087049994', time=2024-09-14T13:25:16.147977+0000, chain.objs.size()=1 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.189__shadow_.Npn84H0NBZMQw6MMW1H4taWwiisKKRP_0 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9173418640117019764', time=2024-09-14T13:25:25.994135+0000, chain.objs.size()=1 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.197__shadow_.yxnHK_fBQ6cq5c4oYCsLCh0nC5KfNFS_0 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8665102982887809889', time=2024-09-14T13:26:45.457025+0000, chain.objs.size()=1 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.244__shadow_.4_XHcrPlW8YmbEZMKeA8LM8iF_VYkfW_0 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6235708866273039198', time=2024-09-14T13:26:50.355624+0000, chain.objs.size()=1 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.254__shadow_.-j2rFyHv09oBkT9vHoF3Sdz6Kqbw9-__0 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6670135934976454201', time=2024-09-14T13:27:01.165710+0000, chain.objs.size()=1 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2PkzpzxUxrLU3CseM8YXS-hvB2bFLa3_0 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9909512749015962213', time=2024-09-14T13:27:01.185629+0000, chain.objs.size()=1 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DY_OhYbvW4utSBzLcgvClqulbL8jbG6_0 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16681572126423679230', time=2024-09-14T13:27:01.186981+0000, chain.objs.size()=1 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.R4Mlu9_E3wDU58tWj-GT6-Tkj03VerO_0 2024-09-14T11:37:46.412 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4021668700016333899', time=2024-09-14T13:27:01.191529+0000, chain.objs.size()=1 2024-09-14T11:37:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tlfHa75N5tTillPsvBnrsizE9wuX3pW_0 2024-09-14T11:37:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14606449875356760997', time=2024-09-14T13:27:01.229433+0000, chain.objs.size()=1 2024-09-14T11:37:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Szksa9g4YJutbYwTjvxHF6rjNtnj7Xc_0 2024-09-14T11:37:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17691541806428987869', time=2024-09-14T13:27:01.258372+0000, chain.objs.size()=1 2024-09-14T11:37:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.413+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.IMqadvQkvXApxHZGsM0JWH06eYGz4Ex_0 2024-09-14T11:37:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.415+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7400626480748011797', time=2024-09-14T13:27:01.260206+0000, chain.objs.size()=1 2024-09-14T11:37:46.413 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.415+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sYdcBakzVFtKZOMXiRHYzf8wG_KstL9_0 2024-09-14T11:37:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15513408900023882933', time=2024-09-14T13:27:01.323925+0000, chain.objs.size()=1 2024-09-14T11:37:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZAO8RsWhVE7RLPSY13w0xZPPi07ncIl_0 2024-09-14T11:37:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12947500655671555162', time=2024-09-14T13:27:01.465912+0000, chain.objs.size()=1 2024-09-14T11:37:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._H5T3el3YekVDDK0pCo3yJLdMLwquC4_0 2024-09-14T11:37:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4278456957912227310', time=2024-09-14T13:27:01.491137+0000, chain.objs.size()=1 2024-09-14T11:37:46.414 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WwQXy_kwpLx_BDu5e6ZkyLQLrUnEqjb_0 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13866158491854697936', time=2024-09-14T13:27:01.702476+0000, chain.objs.size()=1 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.SeCgwBuYmPCmF4K2InFf3rH_mA99Eh0_0 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16771576007177372333', time=2024-09-14T13:27:01.792259+0000, chain.objs.size()=1 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.91HaAsHqjJh61BONBmlI8PjTcp8A2ui_0 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2884316626845314271', time=2024-09-14T13:27:01.892210+0000, chain.objs.size()=1 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MbSTOxgDLozW6rFHFZjWVn2Si-sVq4q_0 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5118139189316185874', time=2024-09-14T13:27:01.926397+0000, chain.objs.size()=1 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.SnCH5troRQY7eu7Dmh1cxrJJ8K0JPYS_0 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1425298801691487463', time=2024-09-14T13:27:01.998373+0000, chain.objs.size()=1 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nkjf-VKDjuHg3g9NLUNqSvUOtEzXvlx_0 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.438851570329517964', time=2024-09-14T13:27:02.011286+0000, chain.objs.size()=1 2024-09-14T11:37:46.415 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ERa8TCgDkZCWhYsNpuX34ikHdGPgFYR_0 2024-09-14T11:37:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11033998640162162051', time=2024-09-14T13:27:02.180151+0000, chain.objs.size()=1 2024-09-14T11:37:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.416+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QcK2ebOWWxkwJ05b6LXVisqP_Nwm-WT_0 2024-09-14T11:37:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.417+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.848678538154703502', time=2024-09-14T13:27:02.238604+0000, chain.objs.size()=1 2024-09-14T11:37:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.417+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.D8QbAQBwyPwUtIveIwngDQlntribXhm_0 2024-09-14T11:37:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.417+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8368384870371559782', time=2024-09-14T13:27:02.261877+0000, chain.objs.size()=1 2024-09-14T11:37:46.416 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.417+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.X3JSqlaAi2OdXWr5yxwwObCGU5l0jW1_0 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.417+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6109051636765346761', time=2024-09-14T13:27:02.369765+0000, chain.objs.size()=1 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.417+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QMGsd8pG5P_CXTdpsJvREx6ZAwTLmjO_0 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16470914819686623223', time=2024-09-14T13:27:02.382704+0000, chain.objs.size()=1 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4hPW_X1PxoS8B3b4ZExS1gao20E9SMj_0 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18323216205484912717', time=2024-09-14T13:27:02.440988+0000, chain.objs.size()=1 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QtnB5X9rBSAIIZ649CFt8kckpt0PqN-_0 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8344193816789632751', time=2024-09-14T13:27:02.600249+0000, chain.objs.size()=1 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.RrljEXrnFHxy9z5i8UXa1OSPnRpqwYU_0 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2931247204092860743', time=2024-09-14T13:27:02.636479+0000, chain.objs.size()=1 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.RrrvMBWRtjeA-BbPHMSo5KxLc5fA-vj_0 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13566869439040941328', time=2024-09-14T13:27:02.653876+0000, chain.objs.size()=1 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CktA5N3AIM-lZg5qakMJ25G8P6q5xFO_0 2024-09-14T11:37:46.417 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5589922378444412138', time=2024-09-14T13:27:02.899337+0000, chain.objs.size()=1 2024-09-14T11:37:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bNfJqS0TfmS_BdxHNMkMxjS0kGSVOx2_0 2024-09-14T11:37:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6213721227613558182', time=2024-09-14T13:27:10.894546+0000, chain.objs.size()=1 2024-09-14T11:37:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.279__shadow_.zHnE-fCDzBtA1SNGuGyeRmn_KP2jMyI_0 2024-09-14T11:37:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17529035928799575605', time=2024-09-14T13:27:11.389617+0000, chain.objs.size()=1 2024-09-14T11:37:46.418 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.418+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.280__shadow_.qLBHU9490z5rIjuffT8M2az8QdfycsG_0 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1726267225629579536', time=2024-09-14T13:27:12.766535+0000, chain.objs.size()=1 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.283__shadow_.hZ3RKSDoovZVV0c0CS4l00fCWe5r5IQ_0 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14187525676849507720', time=2024-09-14T13:27:40.897952+0000, chain.objs.size()=1 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Z7ncDX5nLitv21sTlCbzKm29JnLda-z_0 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14378212872210300240', time=2024-09-14T13:27:41.103252+0000, chain.objs.size()=1 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.z9FAFLufj-0id1E_ZbLp4K_yk2X5Ii9_0 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15385873115195798254', time=2024-09-14T13:27:41.323023+0000, chain.objs.size()=1 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7mdveWpVEtq-Pv9MNdpD7zQ1P7zGdHQ_0 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6733686883673475398', time=2024-09-14T13:27:41.323679+0000, chain.objs.size()=1 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QqCuGnLhkPMTNpN9Z68gqzKDT0Lfdi4_0 2024-09-14T11:37:46.419 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3063007388602304684', time=2024-09-14T13:27:41.430917+0000, chain.objs.size()=1 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.419+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-E8BPibYend6IzNdVq7kHjrPWier7U7_0 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1405049480896293116', time=2024-09-14T13:27:41.448304+0000, chain.objs.size()=1 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0buu5IbU1lraoeNa10xO2FVOb3k4vUX_0 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16578068707779030794', time=2024-09-14T13:27:41.552775+0000, chain.objs.size()=1 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MteZNtOT6aZk9pt1eH3LH6x9N4NITZn_0 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5704665881033265663', time=2024-09-14T13:27:41.592660+0000, chain.objs.size()=1 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2TacXTf8E39Bpt55_s50OBFwB1-eU-h_0 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9385446543920811151', time=2024-09-14T13:27:41.609547+0000, chain.objs.size()=1 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-Ti2vgM7EhuzOcD6Dsc25KRxFA7b5f9_0 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7042515678965144471', time=2024-09-14T13:27:41.726630+0000, chain.objs.size()=1 2024-09-14T11:37:46.420 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.420+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ayaZaTorgcmhAQ_xcN6d8RIlI9Zzfuk_0 2024-09-14T11:37:46.421 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.421+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17236205112081058279', time=2024-09-14T13:27:41.817994+0000, chain.objs.size()=1 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.421+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.oscTquFDpC0Kn5vg_EXq5fGP4Lo_1yh_0 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.421+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18282589188464944136', time=2024-09-14T13:27:41.848357+0000, chain.objs.size()=1 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.421+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.iRQT3hGj25p3KXp2bBYbejIy9MUUtCq_0 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5488688683093680192', time=2024-09-14T13:27:41.862370+0000, chain.objs.size()=1 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.aIoUiPVOJyqxY2MmYXbcYRjj7GsjF2A_0 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14544157608887833925', time=2024-09-14T13:27:41.890933+0000, chain.objs.size()=1 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.habaujumfPsvetGo5FsIjk5vhUA5hW9_0 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14204006327624492553', time=2024-09-14T13:27:41.896458+0000, chain.objs.size()=1 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.AXEEntS1d6zkyheDCtAsQFz_wLh2O_a_0 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13311328232510688594', time=2024-09-14T13:27:41.956197+0000, chain.objs.size()=1 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CDS1_OgpuWV5AGR07FXZZJW0E9MtOaI_0 2024-09-14T11:37:46.422 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11151584597973296225', time=2024-09-14T13:27:42.078601+0000, chain.objs.size()=1 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qxpFG1WFzNz_B2JvlQdyPb5XSGDXYMc_0 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.866935064429414327', time=2024-09-14T13:27:42.108133+0000, chain.objs.size()=1 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tiadI93BJrI5DzGouWs7oyZgiK8CQp4_0 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12141732878861194368', time=2024-09-14T13:27:42.123989+0000, chain.objs.size()=1 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ht8VgMFgveDmGIqURb-8s8Lm9ozzUUA_0 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9460872334745968789', time=2024-09-14T13:27:42.194889+0000, chain.objs.size()=1 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YIfTi8lgJ_SQRos8oFeto8sE4g_NooQ_0 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7811326738222462015', time=2024-09-14T13:27:42.210088+0000, chain.objs.size()=1 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.422+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4uI4VEp8hxNBbpafuGFitKscjChPrj3_0 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7632657726350059586', time=2024-09-14T13:27:42.317395+0000, chain.objs.size()=1 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5mERiJBwhaHiyfywwGEFB1Ur1bQ3Kwv_0 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.235119368433667085', time=2024-09-14T13:27:42.405911+0000, chain.objs.size()=1 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cWiQEtCHPvx2K2qKjEIXvu0sVgAdQmW_0 2024-09-14T11:37:46.423 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7285470636597144130', time=2024-09-14T13:27:42.456776+0000, chain.objs.size()=1 2024-09-14T11:37:46.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wO4NsH9uxDesjJkO6Orgctfvaz-bG2T_0 2024-09-14T11:37:46.424 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.805927456354060868', time=2024-09-14T13:27:42.609389+0000, chain.objs.size()=1 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bK3Zk0zBIB1uscR3Drck-5lX3f2IKam_0 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16023346963780445608', time=2024-09-14T13:27:42.622237+0000, chain.objs.size()=1 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CHxmZmkp7eCgfspSEQOMg9S6bhPbVKe_0 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1734923310326040238', time=2024-09-14T13:27:42.642857+0000, chain.objs.size()=1 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.s4Qe1qGPs7iwggY1yfSwKHvniA79MaQ_0 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12297121735976401447', time=2024-09-14T13:27:50.425973+0000, chain.objs.size()=1 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.K4ZSl3aqZnl22htBh8BQ3ylHpXDpEqC_0 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.850006719939958066', time=2024-09-14T13:27:50.463463+0000, chain.objs.size()=1 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.04Dq-ldSCDPGTa4qaIrUcWy6sUdLANU_0 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1917010082054613363', time=2024-09-14T13:27:50.480889+0000, chain.objs.size()=1 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bxKqgenkeX1lcLJlN0NB01pNkegTveP_0 2024-09-14T11:37:46.425 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5639103873324408179', time=2024-09-14T13:27:50.541705+0000, chain.objs.size()=1 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0YiajIJRF6SIyCDvJkdtjx9rvMUxrEP_0 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.632098341415386096', time=2024-09-14T13:27:50.559041+0000, chain.objs.size()=1 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.424+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9QkmvKBtvRkWZv__yeH26uSD15KvuvP_0 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.425+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4600750147249938371', time=2024-09-14T13:27:50.578836+0000, chain.objs.size()=1 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.425+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.OeherhTxHKMIZ2RouGrAe7uJxfketNC_0 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.426+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17129990665241869600', time=2024-09-14T13:27:50.682344+0000, chain.objs.size()=1 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.426+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gu98uwNCeCtP_NA1FEnKkcZfIL0VhSW_0 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.426+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.735675191690541220', time=2024-09-14T13:27:50.705491+0000, chain.objs.size()=1 2024-09-14T11:37:46.426 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.426+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.QINdMQwvLvyowm7ebhjpmEsJEzUC23C_0 2024-09-14T11:37:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.427+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12883527757495509907', time=2024-09-14T13:27:50.764621+0000, chain.objs.size()=1 2024-09-14T11:37:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.427+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NKr4upyTQ-_f0QV-n4WKrAoGVkQ_-0L_0 2024-09-14T11:37:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.427+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5030844672444181939', time=2024-09-14T13:27:50.804626+0000, chain.objs.size()=1 2024-09-14T11:37:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.427+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YWjObuasUqr1U-DCo3Ql8Cyw2cDW1Bh_0 2024-09-14T11:37:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13235782445802701869', time=2024-09-14T13:27:50.850040+0000, chain.objs.size()=1 2024-09-14T11:37:46.427 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1KtLOY6yVvRf3iz_1tmsgcx8OSeUFrF_0 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4650004272742772132', time=2024-09-14T13:27:51.038205+0000, chain.objs.size()=1 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tHu6ZEUI_2c-l3XKZpN_KPcoMOGZiww_0 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8962688226022025472', time=2024-09-14T13:27:51.054877+0000, chain.objs.size()=1 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-fuCzZdcPf5v0bFUBqIPiKUh_GlBPFp_0 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1195139800671977235', time=2024-09-14T13:27:51.108139+0000, chain.objs.size()=1 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.OPz5NaNr69nWIbbKnvORTMHPcFz4wUu_0 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11769185988469762555', time=2024-09-14T13:27:51.259430+0000, chain.objs.size()=1 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CKY_P4jaOkqG9Ny3mqxu4ZFx9THwb3k_0 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3018794065153111702', time=2024-09-14T13:27:51.265670+0000, chain.objs.size()=1 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.WYJxZAnAY7rArKwefAviL2ZFR2h8y1u_0 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9095593857208177301', time=2024-09-14T13:27:51.286251+0000, chain.objs.size()=1 2024-09-14T11:37:46.428 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qJhsUxvwIhmV1z08IAzlBd1tfu9L547_0 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14134492717216837203', time=2024-09-14T13:27:51.289590+0000, chain.objs.size()=1 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tm7iflq-7ixe58_jHWPLs8eLSFfprxy_0 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13346775098330121680', time=2024-09-14T13:27:51.555458+0000, chain.objs.size()=1 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UQDugbWlQ_-Jhc9lW8oWcWn0dj2SFWg_0 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13592376197430474187', time=2024-09-14T13:27:51.718039+0000, chain.objs.size()=1 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.s7DHVueGJRSQyq2fUk2Ozau15s6Xxj1_0 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9289120821268183768', time=2024-09-14T13:27:51.740255+0000, chain.objs.size()=1 2024-09-14T11:37:46.429 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.428+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LsS5xZ6s2W__DUqPk9H0cDLk6JMa12d_0 2024-09-14T11:37:46.430 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7516524159602897849', time=2024-09-14T13:27:51.748351+0000, chain.objs.size()=1 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.PEMoeoovi5fKc_iN7x893sQpmAiffLy_0 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12168988868712332848', time=2024-09-14T13:27:51.851831+0000, chain.objs.size()=1 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Hlfm4o0fGCYuObX-SACKTXyYXtA8Dhu_0 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1758683964014643850', time=2024-09-14T13:27:51.861664+0000, chain.objs.size()=1 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.e-8aRRyw-rAbRGerh5iMd32gtYNsa71_0 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.369360631084144935', time=2024-09-14T13:27:51.867206+0000, chain.objs.size()=1 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4STsze5WxW1_WcoN2-rgFVgnPbDnV5p_0 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13272341147769252940', time=2024-09-14T13:27:51.962856+0000, chain.objs.size()=1 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.l0EweINazANDdqo33ahDwJnszP3Dhug_0 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1864926500159757769', time=2024-09-14T13:27:51.988304+0000, chain.objs.size()=1 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VSWeftyd-cUEnEFjMU_cbLlCZvhAMvO_0 2024-09-14T11:37:46.431 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5515627968167978432', time=2024-09-14T13:27:52.002608+0000, chain.objs.size()=1 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.430+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vYgXSNIflbwBPrTxm-m3I_UH0U-dmah_0 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13435384128146996834', time=2024-09-14T13:27:52.084129+0000, chain.objs.size()=1 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qr11rk3SPPgLdVUlaNfWvIiwiSe7Q0l_0 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8816773795158486476', time=2024-09-14T13:27:52.249380+0000, chain.objs.size()=1 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vsHNv9Nv9BXjTDmU08kUQ_sBXxE_opa_0 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16408946215895987305', time=2024-09-14T13:27:52.323059+0000, chain.objs.size()=1 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Vt7_a1pnAYNf7Cwtoe05vNpeZBCEV0L_0 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9528719925039588168', time=2024-09-14T13:27:52.342094+0000, chain.objs.size()=1 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.431+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3m1D1VZFuFOTEDifSBfxW1BypBd3FH7_0 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12489737975159229731', time=2024-09-14T13:27:52.348633+0000, chain.objs.size()=1 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vG0ZtOE3zj7VBYsXwFLuywIMb0FcR7E_0 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12255089776914969464', time=2024-09-14T13:27:52.352791+0000, chain.objs.size()=1 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DpXSrNbsUbBxGEIlkNuraO10RfuokzE_0 2024-09-14T11:37:46.432 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6450652459359525827', time=2024-09-14T13:28:12.322758+0000, chain.objs.size()=1 2024-09-14T11:37:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.371__shadow_.bQFFfb69_vtdMxMqSZR9buQL58Ktgjc_0 2024-09-14T11:37:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2658689040761959609', time=2024-09-14T13:28:56.741077+0000, chain.objs.size()=1 2024-09-14T11:37:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.454__shadow_.AGJ-oPxunG3LLvOJDEBfQs8R1lcx85g_0 2024-09-14T11:37:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10041805784222840844', time=2024-09-14T13:28:57.492790+0000, chain.objs.size()=1 2024-09-14T11:37:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.432+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.455__shadow_._A_blFUg5IWdXEuosrk-YM_wJeIwU91_0 2024-09-14T11:37:46.433 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.433+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11634779445594420013', time=2024-09-14T13:29:09.449573+0000, chain.objs.size()=1 2024-09-14T11:37:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.433+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.481__shadow_.0qolNhEn0hLsSzpzAP5yluHc0reuYXt_0 2024-09-14T11:37:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.433+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14847711870334041347', time=2024-09-14T13:29:10.605535+0000, chain.objs.size()=1 2024-09-14T11:37:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.433+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.XKOQ71DBt5al88FkGkpuvtFIe8p1xyS_0 2024-09-14T11:37:46.434 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.434+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/50643 2024-09-14T11:37:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=22, truncated=0, next_marker='' 2024-09-14T11:37:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6023198187187409788', time=2024-09-14T13:29:11.137607+0000, chain.objs.size()=1 2024-09-14T11:37:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.484__shadow_.0acdN7kKkTFwhYQX6sAZm5exLNWff0P_0 2024-09-14T11:37:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7614813479359849766', time=2024-09-14T13:29:11.138802+0000, chain.objs.size()=1 2024-09-14T11:37:46.435 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.484__shadow_.lCOVkQKpNrsdsAjS94nupFiTkzH9GMc_0 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1875078308184331542', time=2024-09-14T13:29:17.402843+0000, chain.objs.size()=1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.497__shadow_.BagqLBMl3p_n_RyhrH_fZkmdfQjQh83_0 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3918442092032593516', time=2024-09-14T13:29:20.115148+0000, chain.objs.size()=1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.503__shadow:mTcNqOeSoMdp1SFsn-oYFj8mNhIIfUb_.m4lffY6UOEudOA076OqtE8cz_-frwwK_0 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10479433425324095582', time=2024-09-14T13:29:26.895405+0000, chain.objs.size()=1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.518__multipart_mymultipart.2~DDRfjaskmD79p9SMKxetgM_i7-s509T.1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm', time=2024-09-14T13:29:42.156090+0000, chain.objs.size()=1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm.1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm', time=2024-09-14T13:29:42.157671+0000, chain.objs.size()=1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm.2 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm', time=2024-09-14T13:29:42.158924+0000, chain.objs.size()=1 2024-09-14T11:37:46.436 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm.3 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm', time=2024-09-14T13:29:42.160300+0000, chain.objs.size()=1 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm.4 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm', time=2024-09-14T13:29:42.161534+0000, chain.objs.size()=1 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm.5 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm', time=2024-09-14T13:29:42.162798+0000, chain.objs.size()=1 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~-SgSfA0FCN7r4mzA2uX2pxdDNS8jbCm.6 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6816916390495242184', time=2024-09-14T13:29:44.181163+0000, chain.objs.size()=1 2024-09-14T11:37:46.437 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.437+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~1xss9FUViuUzw_8z2KlhfJ78uT8Jr4I.1 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.439+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14287179874879455065', time=2024-09-14T13:30:09.788613+0000, chain.objs.size()=1 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.439+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.537__shadow_.3RTW9m_yvt7VOtzKxTB0MQV01ZM7Rsu_0 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.439+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7716737817298818289', time=2024-09-14T13:30:30.877808+0000, chain.objs.size()=1 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.439+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.557__shadow_.ieEy4IkzrAi-EqbEeajVteecD9f75cy_0 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10274703902742816555', time=2024-09-14T13:30:39.061626+0000, chain.objs.size()=1 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.564__shadow_.si2jGYsIuS1FtfUaVOIBb0SNmq6d1ie_0 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6600635508074079818', time=2024-09-14T13:30:45.233751+0000, chain.objs.size()=1 2024-09-14T11:37:46.438 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:prY97ZKGKzvEl5ryVX3yXkx49UAw4o2_.xcPVnIFNVKz1Fl25-BxOEhQmxjN3Vqb_0 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.542341612193844663', time=2024-09-14T13:31:09.266186+0000, chain.objs.size()=1 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:rc0cIDBtuV1dx7d5igne7.cdoOBi3cl_.54zhTm9dcdnbW70A0YwL6WEVPTfxTQP_0 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8559707753783979803', time=2024-09-14T13:31:18.635240+0000, chain.objs.size()=1 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.586__shadow:RnMJrFfabnKN64HyuDymopwBRCLPTBM_.WuWKgWpp0gK83hdCOBp8jlUpShnFI5S_0 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3276815396334197213', time=2024-09-14T13:31:19.101620+0000, chain.objs.size()=1 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:k1KYy9.aLAEpXfDArb.YD7PVmWqatm-_.yVBScb7dze0Gz0cDyWeRaMJg-pjMG1y_0 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14127506052127612765', time=2024-09-14T13:33:57.068818+0000, chain.objs.size()=1 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.649__shadow_.OHuxvaSbtrIq4bJepce0l0LDMrkB27__0 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4489715566923674188', time=2024-09-14T13:34:06.600884+0000, chain.objs.size()=1 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.666__shadow_.kA3DHYbDZqa9ZMx5G7I2MpjiLXqOKGj_0 2024-09-14T11:37:46.439 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16674838426150349539', time=2024-09-14T13:34:22.117318+0000, chain.objs.size()=1 2024-09-14T11:37:46.440 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.440+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.704__shadow:nh.1zAna0u4ziMOTi2slfeAGOq65AcX_.lO0dbkKYPOpFzdMCpbvDL5vBaeYE8Fv_0 2024-09-14T11:37:46.441 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.443+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.443 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.445+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-14T11:37:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.446+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.444 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/46884' 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3121995364844013480', time=2024-09-14T13:24:58.844053+0000, chain.objs.size()=3 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-LUKEWARM.2~bSvhWVaF0-4maxO2Af9AdGoqwQjWrnU.1 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-LUKEWARM.2~bSvhWVaF0-4maxO2Af9AdGoqwQjWrnU.2 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-LUKEWARM.2~bSvhWVaF0-4maxO2Af9AdGoqwQjWrnU.3 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2625393564518981354', time=2024-09-14T13:25:27.581727+0000, chain.objs.size()=1 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.200__shadow_.SDAhF92AOShfjcRI7L_em_BmVxmK4Wx_0 2024-09-14T11:37:46.446 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7828463759625953998', time=2024-09-14T13:26:38.897278+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.233__shadow_.C5QZCrBb-pd2huWNWtAlZFCliapJRki_0 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1912496749072272057', time=2024-09-14T13:26:46.418004+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.246__shadow_.RYhGDCBvAP6Zp7IsZ7ggXsrCqE0ely3_0 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10863411449890066788', time=2024-09-14T13:26:51.336116+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.447+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.256__shadow_.TRNrkuCSL12ZAYMmd1yBuZ8rx4SgJDw_0 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10007768187658267149', time=2024-09-14T13:27:01.173941+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rxlkVwCMC5-9bJvujDeJJweT-eAVVPM_0 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11940860325076250856', time=2024-09-14T13:27:01.176045+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lytly3JEjHeIJAdJ0zMAXdpYhlYad9b_0 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15700113117704259257', time=2024-09-14T13:27:01.234144+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wZ2DSfINURZ8cih1uxDVkns53L7lVjW_0 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11422818281809723767', time=2024-09-14T13:27:01.247011+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Cc1bf0L0bQtGqisS9KWDcDEKpnwMhRr_0 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13711760841491129313', time=2024-09-14T13:27:01.256233+0000, chain.objs.size()=1 2024-09-14T11:37:46.447 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.448+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.dlT4oiLw8l9CSyV0ZdbUH2DDkNvqwJT_0 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12313512275484861141', time=2024-09-14T13:27:01.274728+0000, chain.objs.size()=1 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hE9nUXDwGA2PaZ0cxScMChEHzDVMCM4_0 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16339634857080995495', time=2024-09-14T13:27:01.280407+0000, chain.objs.size()=1 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7u0l74pR587n72q86Ni6xR1Ez8FnXBn_0 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13913871865229920121', time=2024-09-14T13:27:01.296449+0000, chain.objs.size()=1 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Wm5k6I7ykN3ppN6HdrTYcB23h--mtf9_0 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2854576049837435292', time=2024-09-14T13:27:01.306983+0000, chain.objs.size()=1 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._MFXCcUeEz2IW-RXAcIxlLlWzT_rrei_0 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2493896753760094239', time=2024-09-14T13:27:01.309722+0000, chain.objs.size()=1 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kB3AHB9iUl49QmUw5rzfSskIBbudw5l_0 2024-09-14T11:37:46.450 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17352549786712768534', time=2024-09-14T13:27:01.410335+0000, chain.objs.size()=1 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.c4C9slKxsYdZ5qZLZHAA5EdugK25tiP_0 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17443412936085268680', time=2024-09-14T13:27:01.412028+0000, chain.objs.size()=1 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UY38eCFZ_G1FlH5cfmGlhsGusee7Xz6_0 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17338524128390798213', time=2024-09-14T13:27:01.423570+0000, chain.objs.size()=1 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.81hpCD9qseFy8U1IUdgpL9VPqMnGavD_0 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3146320224884166035', time=2024-09-14T13:27:01.428308+0000, chain.objs.size()=1 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.D5aiS6k1IZR7ESBxxwPgLUHPUYoNiCc_0 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3391582506395530567', time=2024-09-14T13:27:01.449794+0000, chain.objs.size()=1 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.y3jDsS6plZaZ0GIPP1tClCN401o_UHf_0 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10767525299105180781', time=2024-09-14T13:27:01.476452+0000, chain.objs.size()=1 2024-09-14T11:37:46.451 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.451+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sCexv19tmiyWLxZCCOGXFhjw1kfoGX6_0 2024-09-14T11:37:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.453+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1322571307173065140', time=2024-09-14T13:27:01.495842+0000, chain.objs.size()=1 2024-09-14T11:37:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.453+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.t7AL_-gn5Q504FZxmrfMpIxqrGaBkBm_0 2024-09-14T11:37:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.453+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9421721885350055713', time=2024-09-14T13:27:01.516553+0000, chain.objs.size()=1 2024-09-14T11:37:46.452 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.453+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.p8tblvhE5h7mQN7sX17Tw0BMPLNaYK7_0 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.453+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11580767064692580297', time=2024-09-14T13:27:01.537803+0000, chain.objs.size()=1 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.453+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Z1-at9y7t4wDPJoZwNWCUstD9XaZFGs_0 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17244024169820903659', time=2024-09-14T13:27:01.556082+0000, chain.objs.size()=1 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.e2CbLVns4Qf81aUTBmQ1_hoOlEwA3QR_0 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7365707668109984593', time=2024-09-14T13:27:01.656323+0000, chain.objs.size()=1 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.d47-7w2j21S1FkbxxOtKlYRSXXCY6eq_0 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10422778091992092529', time=2024-09-14T13:27:01.658330+0000, chain.objs.size()=1 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._8erBUmAC2zya_3afJw58yJREXHbO42_0 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12365981743883650370', time=2024-09-14T13:27:01.664526+0000, chain.objs.size()=1 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vIhdSj-YwUGJSRTxfOBuj0XFC6fjU4r_0 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17507352646789313273', time=2024-09-14T13:27:01.677104+0000, chain.objs.size()=1 2024-09-14T11:37:46.453 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ro8k9xizejJC871BEWXU1Vmx-GEqq98_0 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.241240068997672026', time=2024-09-14T13:27:01.940078+0000, chain.objs.size()=1 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5HzBt8LW2-WRvz1bjxc9FOemMEdbGfc_0 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1848870775299441658', time=2024-09-14T13:27:01.964961+0000, chain.objs.size()=1 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Md3hztJncMccsgDS4lhYXcLH7ae-QSg_0 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.246301502078147969', time=2024-09-14T13:27:01.981107+0000, chain.objs.size()=1 2024-09-14T11:37:46.454 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.454+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MzzO4tiR5RAKyyBuF7jQBCz5gW9WN2x_0 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.455+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7646593700758111721', time=2024-09-14T13:27:02.190220+0000, chain.objs.size()=1 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.455+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VuVsS1XOPIhdVJwMZybtcFB5pipxMxQ_0 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.455+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5884339854397724820', time=2024-09-14T13:27:02.193810+0000, chain.objs.size()=1 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.455+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OTTb3SpTsPLtbq9bnMWC97yHGYl1nwB_0 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4164578666075934279', time=2024-09-14T13:27:02.254775+0000, chain.objs.size()=1 2024-09-14T11:37:46.455 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hh4jCG-KPplRsGnfZ0HAnma5Pf8KS-O_0 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9032364284101464813', time=2024-09-14T13:27:02.258075+0000, chain.objs.size()=1 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3Gw6plV_FlGsUxXMi9-kDYNWTHezNiU_0 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12641262989329134436', time=2024-09-14T13:27:02.279956+0000, chain.objs.size()=1 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3x1_BTRGK9e1ANwU43r89lAHyWm8lYR_0 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4268513813916686541', time=2024-09-14T13:27:02.371106+0000, chain.objs.size()=1 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.28yWL82ah6hHCoHicxo_cvAUyIEbtS__0 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13209784936314631738', time=2024-09-14T13:27:02.379436+0000, chain.objs.size()=1 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EvUvw0IvqLyfpMv59wiDLjxKJj4e6ME_0 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10708978812449134696', time=2024-09-14T13:27:02.609153+0000, chain.objs.size()=1 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6HQYlHBTLRvUgOA4czUUf0VuOzl8bcK_0 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15240172425052346348', time=2024-09-14T13:27:02.636157+0000, chain.objs.size()=1 2024-09-14T11:37:46.456 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.o60cGO8QfRPaE80ITe1FZNxCrMCbJ8R_0 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8475598102491485555', time=2024-09-14T13:27:02.685790+0000, chain.objs.size()=1 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DnHjWSEGbYyJ-G7tf2ME2vrg5TLV_mT_0 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5291947228685414904', time=2024-09-14T13:27:02.829401+0000, chain.objs.size()=1 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.456+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZEwNWAYuQ3BRqbnkiJncGaa56AVTtqf_0 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.457+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16872896723541477551', time=2024-09-14T13:27:02.838907+0000, chain.objs.size()=1 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.457+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iBCuMJHU2nNIaPBmLWBPZO4xBzHsOrT_0 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.457+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7216800867165041471', time=2024-09-14T13:27:02.844227+0000, chain.objs.size()=1 2024-09-14T11:37:46.457 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.457+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.zwr7hAu0LKsZaBPecRLuSDGdB2RWmUt_0 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6789762394030635292', time=2024-09-14T13:27:02.854138+0000, chain.objs.size()=1 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.P5O140ti4ArfKMasksCWAK-Q7yJOYOe_0 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9472367185258931886', time=2024-09-14T13:27:02.892458+0000, chain.objs.size()=1 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZBqP3TAD3DA3zQQqVatVsLFoh209DPY_0 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15300579705818548210', time=2024-09-14T13:27:02.922410+0000, chain.objs.size()=1 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KIalhJSq4O7v9pekB8DgyUEPF4kA1vY_0 2024-09-14T11:37:46.459 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17633197968653205935', time=2024-09-14T13:27:02.955111+0000, chain.objs.size()=1 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.m2SI3LzaYueznd9R7k1cTCx3jaD891K_0 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14022675366532902743', time=2024-09-14T13:27:04.830602+0000, chain.objs.size()=1 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.266__shadow_.Cjs3-SjcHYphyRob6uj9-oM4DWAh6uV_0 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16707245565208388943', time=2024-09-14T13:27:06.179979+0000, chain.objs.size()=1 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.458+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.269__shadow_.dhNJGVCPgAH1U72YnbUDRH2UsR-vw3n_0 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18235330994990772537', time=2024-09-14T13:27:07.168782+0000, chain.objs.size()=1 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.271__shadow_.u_yHCxQ7jgzvXzn1k1HDqOxZr3N9gfa_0 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18392349053324732096', time=2024-09-14T13:27:09.457081+0000, chain.objs.size()=1 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.276__shadow_.bJtzcDobLt8Nbzq9PsttU24R602AM_B_0 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2948622561539144831', time=2024-09-14T13:27:17.679156+0000, chain.objs.size()=1 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.UgyGwW4VjqcISx_UHsdbF5SYH90iwyC_0 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14409913913119359632', time=2024-09-14T13:27:18.484333+0000, chain.objs.size()=1 2024-09-14T11:37:46.460 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.nggY_cpoUJWTUKSZvXhK3lBtWXvg4ko_0 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.236177396809417896', time=2024-09-14T13:27:21.441120+0000, chain.objs.size()=1 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.459+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.299__shadow_.SAyjIYr7xZ8Ic45eUTR7mRQnwgjK3Qe_0 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.460+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2145618772431995713', time=2024-09-14T13:27:40.838900+0000, chain.objs.size()=1 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.460+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zxX9vuPv6GXjgmTZrxxJSW0mtJmwU07_0 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.460+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11212429060439218468', time=2024-09-14T13:27:40.855892+0000, chain.objs.size()=1 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.460+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qb6SiB86YZtdSO03tSfimsbI_gPeF-6_0 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.460+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8859717363867249665', time=2024-09-14T13:27:40.857228+0000, chain.objs.size()=1 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.460+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.is4_MClSgZetsfKF3tGifBmU-KKN7ow_0 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11658515871182896073', time=2024-09-14T13:27:40.864562+0000, chain.objs.size()=1 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uT0frVfvNh7Vdpu-dHyNSHNr4xNZRhx_0 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14469073652889800727', time=2024-09-14T13:27:40.885321+0000, chain.objs.size()=1 2024-09-14T11:37:46.461 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IcdXFljLzqPkfoZaZDJxzNKwa8cwm7A_0 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12806278111715505351', time=2024-09-14T13:27:40.888968+0000, chain.objs.size()=1 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.E2Ec0-RhE7fmbcK39AlbZYaRPMi6eMl_0 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15236260984907020488', time=2024-09-14T13:27:40.918761+0000, chain.objs.size()=1 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.thacGTJ4-hyoRg9onAmRk1vCqIOEdeI_0 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2938472686264978758', time=2024-09-14T13:27:40.923722+0000, chain.objs.size()=1 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FBPcExvcDLT-WJP7ZzhbHWMCDoMAAjb_0 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8428662643975409414', time=2024-09-14T13:27:40.927168+0000, chain.objs.size()=1 2024-09-14T11:37:46.462 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Yv7c7IlcpsuKjcrtkPM65M3OjnCRPkn_0 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18373494643596385188', time=2024-09-14T13:27:40.948518+0000, chain.objs.size()=1 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SFEDkczZI0bDbYSenme4Mi-xtWkEGZm_0 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16910536533071131018', time=2024-09-14T13:27:41.078415+0000, chain.objs.size()=1 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.461+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BHBE7CYgjtCMUFZGh5HK_BUj4qswAGj_0 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.462+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16237604602272184559', time=2024-09-14T13:27:41.091217+0000, chain.objs.size()=1 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.462+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bLF5tMZLZuVhxLjwdNM02zmAC2pixhy_0 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.463+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8065092236758040897', time=2024-09-14T13:27:41.108704+0000, chain.objs.size()=1 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.463+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.r64E44atabbQ9co5lrLG_XbsMikM7u4_0 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.463+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3525428869482673541', time=2024-09-14T13:27:41.180996+0000, chain.objs.size()=1 2024-09-14T11:37:46.463 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.POWbEzbX9aGqWlyyP2s9XLWGqxxFqcr_0 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6367896472092678247', time=2024-09-14T13:27:41.404399+0000, chain.objs.size()=1 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7-9Pp2BMPdmvvF81W51pSqIy__EF4Nf_0 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2281252525916276859', time=2024-09-14T13:27:41.409933+0000, chain.objs.size()=1 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rZidSvTHAM6EZczQ4hu-L9Dc6nOrrm5_0 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6785297339005994685', time=2024-09-14T13:27:41.429905+0000, chain.objs.size()=1 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t40miZOTeEn-Lh8ow2W9KHv8N_R9ziv_0 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12994014186183594969', time=2024-09-14T13:27:41.584681+0000, chain.objs.size()=1 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NKxzMACOxc7qWhxtPpNsR8ESYglcWDF_0 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12180844205093854690', time=2024-09-14T13:27:41.607115+0000, chain.objs.size()=1 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BiJIaUUCmML_OtqitjUSKQD540jETiB_0 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9517014636662234695', time=2024-09-14T13:27:41.662553+0000, chain.objs.size()=1 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t17eLPEQn8BUUbF9xpiWWhWcOGnuSsk_0 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14868801087146456224', time=2024-09-14T13:27:41.855395+0000, chain.objs.size()=1 2024-09-14T11:37:46.464 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mt2lD7_ZTAfHPV_3zP8n1BwdenSBXwZ_0 2024-09-14T11:37:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1773393919061012133', time=2024-09-14T13:27:41.886940+0000, chain.objs.size()=1 2024-09-14T11:37:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1fNunZJ_D-czmBlcf7eNCSTb8pl_0Ry_0 2024-09-14T11:37:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5348662423592545332', time=2024-09-14T13:27:41.915535+0000, chain.objs.size()=1 2024-09-14T11:37:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.464+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.AU7I1fw-YeUxYboe_JPOUXehhlpBmM1_0 2024-09-14T11:37:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.465+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2591465730997561395', time=2024-09-14T13:27:41.930907+0000, chain.objs.size()=1 2024-09-14T11:37:46.465 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.465+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t2A3BWOewTGOfZsZ7VHsHFN2Sm6IS55_0 2024-09-14T11:37:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.465+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2605689032376239924', time=2024-09-14T13:27:41.965020+0000, chain.objs.size()=1 2024-09-14T11:37:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.465+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wk9vVJrVMzXk69whLGJTRyK8q7AELVX_0 2024-09-14T11:37:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1661204019998474427', time=2024-09-14T13:27:41.975168+0000, chain.objs.size()=1 2024-09-14T11:37:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jtKzCJkU4zTk4u5va6fsh_sTfqJMZN2_0 2024-09-14T11:37:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3366002614878070793', time=2024-09-14T13:27:42.136969+0000, chain.objs.size()=1 2024-09-14T11:37:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lHliOgPiih4rDL31UY0qVRSZVTvQHuh_0 2024-09-14T11:37:46.466 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2986069720950643315', time=2024-09-14T13:27:42.186830+0000, chain.objs.size()=1 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lspZmLGYODraIOv8g0ov2octRRN9lIt_0 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2283479724406223043', time=2024-09-14T13:27:42.227869+0000, chain.objs.size()=1 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5F6cNjsQUg6OfuCyJlnnQOztZFOhiB7_0 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1966653712589627257', time=2024-09-14T13:27:42.413094+0000, chain.objs.size()=1 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3ttLf18i6ogmihRP2gCKNrMhkaxvByH_0 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8512988907196113219', time=2024-09-14T13:27:42.459173+0000, chain.objs.size()=1 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7MTDWxAxw8tDV-Tn8U7-3SAHaVhf5BF_0 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7628814445721611493', time=2024-09-14T13:27:42.466135+0000, chain.objs.size()=1 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DbNKJbJoHWjsxk76bQF7Opsar4Qqog4_0 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9926764513516158439', time=2024-09-14T13:27:42.467663+0000, chain.objs.size()=1 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rv66cMgSADPSFMO_9Wof0hNUBx5_cIq_0 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13958867029169087231', time=2024-09-14T13:27:42.680999+0000, chain.objs.size()=1 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.466+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mTkj3YSQ8u3myX1uE0VaRLMBCVie2Jv_0 2024-09-14T11:37:46.467 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14283175192411960398', time=2024-09-14T13:27:50.511635+0000, chain.objs.size()=1 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pTVprt0RpvtdjnxrAMeG_0WmqC8CQqn_0 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4499526169338756250', time=2024-09-14T13:27:50.552903+0000, chain.objs.size()=1 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jjSVnHqtOgan3rWHDOlTfJS1tOU1aFQ_0 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18017251808575153047', time=2024-09-14T13:27:50.560757+0000, chain.objs.size()=1 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iHhw44lOJ0mcp1GlMVnGD32pNbAhU5__0 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11063397713057986352', time=2024-09-14T13:27:50.788378+0000, chain.objs.size()=1 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fglwM663Lmu2isUFIrq_k_fyThbLFsZ_0 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.467+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11537118042084956190', time=2024-09-14T13:27:50.804033+0000, chain.objs.size()=1 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YE2PVrZls-qvkYTTIOpkzk0YvhX74AV_0 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12384547621893616751', time=2024-09-14T13:27:50.815677+0000, chain.objs.size()=1 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.r4zmWym02rEZmJIUXbgg69Wprz33wrA_0 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17757799911377232550', time=2024-09-14T13:27:50.820572+0000, chain.objs.size()=1 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GcLrKCuP7N2B_nJgREx5UvTI4QDJogS_0 2024-09-14T11:37:46.468 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.657583936187954640', time=2024-09-14T13:27:50.834157+0000, chain.objs.size()=1 2024-09-14T11:37:46.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FaqV2WGyIceGLTUYjoyFXrpwWrs2TUY_0 2024-09-14T11:37:46.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8051072773974877481', time=2024-09-14T13:27:50.841100+0000, chain.objs.size()=1 2024-09-14T11:37:46.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nqA8TQiIBHUnPKlfyTFd4CBOJklJaqY_0 2024-09-14T11:37:46.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15625237782785250003', time=2024-09-14T13:27:50.842321+0000, chain.objs.size()=1 2024-09-14T11:37:46.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.468+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vM9w5Da-zBarV1f28QCKkuebg1b9BPT_0 2024-09-14T11:37:46.469 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.470+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/46884 2024-09-14T11:37:46.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.472+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=31, truncated=0, next_marker='' 2024-09-14T11:37:46.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.472+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18383552605851146055', time=2024-09-14T13:27:50.992812+0000, chain.objs.size()=1 2024-09-14T11:37:46.471 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.472+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yBiLv3l9fL13en9AHd0T_JfMpClbZ7E_0 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.472+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3500300736898025918', time=2024-09-14T13:27:51.009535+0000, chain.objs.size()=1 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.472+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ADLsChX1NxRnQZ6MZT-RdOmmnHLTCBY_0 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.472+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1528712132692132549', time=2024-09-14T13:27:51.019473+0000, chain.objs.size()=1 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8PcwIwizle7EtDUVGplSEt8mwlF8h3b_0 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12015078129716525146', time=2024-09-14T13:27:51.049336+0000, chain.objs.size()=1 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EOKRpJClgr4qg9MJGZFZSzfKWML57_Y_0 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15661748629851689616', time=2024-09-14T13:27:51.193296+0000, chain.objs.size()=1 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uZ7Wqsge0H4KHQg3cto7nsuu5F8j42O_0 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.907577753907688902', time=2024-09-14T13:27:51.239824+0000, chain.objs.size()=1 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YOLLZLnnTnPN7-3M7mHmQlK6mTEP_oo_0 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13165735110664927458', time=2024-09-14T13:27:51.345331+0000, chain.objs.size()=1 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AMfoczxMfAXtomBqZxlVuFZygj1QhTw_0 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4102240576242341093', time=2024-09-14T13:27:51.479113+0000, chain.objs.size()=1 2024-09-14T11:37:46.472 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aWptCVi-ENbGVCP8BSeeIjMHFOpi-Hx_0 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7201436461355587826', time=2024-09-14T13:27:51.542654+0000, chain.objs.size()=1 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NsgTFjyvsz2y6zr0RJHSfQqjPLemodn_0 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15374694108311993744', time=2024-09-14T13:27:51.561478+0000, chain.objs.size()=1 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ulmkuto46SpMTv6mlgQXopmmxw0nXPL_0 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7700242217773180123', time=2024-09-14T13:27:51.709565+0000, chain.objs.size()=1 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.mqPZsodNMLJqVnA9pV_bFHVsvoba8gp_0 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13531321718010233550', time=2024-09-14T13:27:51.747109+0000, chain.objs.size()=1 2024-09-14T11:37:46.473 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.473+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.q6uSxK4HF_eNLQTvkr9Vv_fC5MAUj8v_0 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17934251729964299322', time=2024-09-14T13:27:51.811869+0000, chain.objs.size()=1 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZqAe7V58pwQaJjGWJ0CCCHOsckFcz4G_0 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13147540264898244505', time=2024-09-14T13:27:51.819817+0000, chain.objs.size()=1 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Xu0cb0pHuDJFXmYrFRNxzxpIhRyMJF8_0 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16532189007730726643', time=2024-09-14T13:27:52.247728+0000, chain.objs.size()=1 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.60QnGcHrIgDO6anUXL8r4hzelZ1cfJE_0 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11154905318726480404', time=2024-09-14T13:27:52.285535+0000, chain.objs.size()=1 2024-09-14T11:37:46.474 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AB9UY7aVOuIuUkFQxly-vN-RrKiV7bn_0 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12349861140887131870', time=2024-09-14T13:27:52.294268+0000, chain.objs.size()=1 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cpup114nlJNYZCQ_JyTQnrabl8dwKQx_0 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15944150415564638140', time=2024-09-14T13:27:54.476025+0000, chain.objs.size()=1 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.329__shadow_.i37pYlk2aJcMT8TTPxSpqqKrnMvwctP_0 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16115192461465215586', time=2024-09-14T13:28:19.498555+0000, chain.objs.size()=1 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.383__shadow_.5biRHbzMJO7izMjIzPNHmZoafNqt9fe_0 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9066992247868122703', time=2024-09-14T13:28:33.923094+0000, chain.objs.size()=1 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.410__shadow_.EmJ0R17ILsd7TRfQOdm6AvThpvUfQyE_0 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11892976019254971683', time=2024-09-14T13:28:48.955711+0000, chain.objs.size()=1 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.475+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.440__shadow_.bBxY9kmsY2cUTbLXZ1xe6hB4EfM3y6E_0 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.476+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18310425074305941177', time=2024-09-14T13:28:50.585971+0000, chain.objs.size()=1 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.476+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.443__shadow_.EVXJhGNKtPkXLiGlZJg1J3i04_LfYd7_0 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.476+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6248286544496984350', time=2024-09-14T13:28:55.290513+0000, chain.objs.size()=1 2024-09-14T11:37:46.475 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.476+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.451__shadow_.7kRXE1n_S6gHBh3r8hrbYGI5Jlt7Pha_0 2024-09-14T11:37:46.476 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.477+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10792231832253361379', time=2024-09-14T13:29:22.526506+0000, chain.objs.size()=6 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.477+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.1 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.2 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.3 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.4 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.5 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.507__multipart_srcmultipart.2~ut4H0DFZeBmRKhnzjZQFLK0jDzD7Szq.6 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3098241411356840034', time=2024-09-14T13:30:32.857398+0000, chain.objs.size()=1 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.560__shadow_.olaE4GBzOwHANNrIXAdZe-lrvjviL1t_0 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15563407037786194420', time=2024-09-14T13:30:48.098973+0000, chain.objs.size()=1 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.570__shadow:bC4vek0N01hpZTKrESN7C2L.jCQZKxj_.PP3i6Zu3Uvq2G3aQkYObpH2Hwb7G4jH_0 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13563025804074918490', time=2024-09-14T13:30:55.737960+0000, chain.objs.size()=1 2024-09-14T11:37:46.477 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:a1eBDlDdAFdV7aYIQKMqFGB.t3Z5YF3_.nFtZTNqSett4gxLM_oT1_-COm3owGr2_0 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8118050615847479177', time=2024-09-14T13:31:03.433101+0000, chain.objs.size()=1 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:6ZQephs6uhzRCAOsmIQPTPS4o5zp3EA_.kJWkGMdRKagSHzN5RIKq8-xa9CsrhzG_0 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8615676973606218462', time=2024-09-14T13:33:48.882593+0000, chain.objs.size()=1 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.633__shadow_.3OpzSOoxk4V3UpNKL2G5SgkBSW01kIn_0 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16113089025573893051', time=2024-09-14T13:34:55.277388+0000, chain.objs.size()=1 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.478+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.734__shadow_.lKyuVDPp4kqEc7TZop9LPeMX3TDeYx-_0 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.479+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14876951622318758031', time=2024-09-14T13:35:33.415471+0000, chain.objs.size()=1 2024-09-14T11:37:46.478 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.479+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.773__shadow_.2Q-ItwdgE0JBbtl7lTUiPVpiCz9Zc2d_0 2024-09-14T11:37:46.479 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.481+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.481 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.483+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-14T11:37:46.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.485+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.483 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.485+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44234' 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_-_J-cqm1pdyWNShkDvE6W1HabCRv4si', time=2024-09-14T13:25:00.220973+0000, chain.objs.size()=1 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.163__shadow_.r0Za9AYhNsNGYVy5P90K9l4B4DVyBsH_0 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15626519855588261398', time=2024-09-14T13:25:13.524485+0000, chain.objs.size()=1 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.183__shadow_.iOfmM2NV97SDOpffkYbBHOpYFM-d3WF_0 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9754292036891240934', time=2024-09-14T13:25:29.047584+0000, chain.objs.size()=1 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.203__shadow_.V4wGyabiDMK3-RWAe569hRBCSlJsbTe_0 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16829073053311995960', time=2024-09-14T13:26:45.935933+0000, chain.objs.size()=1 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.245__shadow_.BABTM-YTiFcMuUsH9pz0_icoRJRhvhO_0 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5242382654084577299', time=2024-09-14T13:26:51.788854+0000, chain.objs.size()=1 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.257__shadow_.zVxUT5gOua2FRE2LEOly7V7qRWcEBMT_0 2024-09-14T11:37:46.485 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10596412664864696419', time=2024-09-14T13:27:01.226857+0000, chain.objs.size()=1 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2Pv8GIhjfSOCbSLlQ9BFUmVY0bbpXFt_0 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16647818678529061489', time=2024-09-14T13:27:01.231852+0000, chain.objs.size()=1 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3ZH1KyZcO0wyHDin5u8J8GZtFkHaI3a_0 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9368090608468640801', time=2024-09-14T13:27:01.233054+0000, chain.objs.size()=1 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kje4B_56ctWqyZWA8plEpwwbSpc6gC8_0 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1207423679358930651', time=2024-09-14T13:27:01.315461+0000, chain.objs.size()=1 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.mJmBIsTMbBh-3TXgtYJPvlz85hXal7l_0 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11275415353957096045', time=2024-09-14T13:27:01.316849+0000, chain.objs.size()=1 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.s4uVcpgg1veWbFLBZ1YapDtKqThhCNk_0 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8217471799340773757', time=2024-09-14T13:27:01.412013+0000, chain.objs.size()=1 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-cxMXP9xzyqSR1JnJOOq6ZK6N6U9UAX_0 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3510507059221599096', time=2024-09-14T13:27:01.714473+0000, chain.objs.size()=1 2024-09-14T11:37:46.486 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.486+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Kn4Fk8PD81rJN2NMUUhmXZIOB6Hqh7Z_0 2024-09-14T11:37:46.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.488+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10566458643491776058', time=2024-09-14T13:27:01.722618+0000, chain.objs.size()=1 2024-09-14T11:37:46.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.488+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Zh4R1uJ4zxw_VeMLjlKMLsKZz0qM_T0_0 2024-09-14T11:37:46.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.488+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6324716996164135296', time=2024-09-14T13:27:01.781043+0000, chain.objs.size()=1 2024-09-14T11:37:46.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.488+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.za_2JOegAOVCndG3MURVMW93yNqnMKJ_0 2024-09-14T11:37:46.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.488+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9840146053409297499', time=2024-09-14T13:27:02.175053+0000, chain.objs.size()=1 2024-09-14T11:37:46.487 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.488+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.viIKsKZ64bfduEUB5kgmK7mpLkrr8Eg_0 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18256728116123154454', time=2024-09-14T13:27:02.181971+0000, chain.objs.size()=1 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.in_sE64F4MLBArGTqU8q4OUpH4cJ04__0 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2336457407377250146', time=2024-09-14T13:27:02.200070+0000, chain.objs.size()=1 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gi3agoBkXsNoMDwtDXhYn6TxHWzxrJM_0 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6887688653065985317', time=2024-09-14T13:27:02.224926+0000, chain.objs.size()=1 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8hPyDfDV4JXCrvpJY2cJmdMECKhZ2th_0 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9341468210708704500', time=2024-09-14T13:27:02.366138+0000, chain.objs.size()=1 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Tyz_wXcctEc-hnZMWloZZLPXSoVNpDY_0 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2164620668196470561', time=2024-09-14T13:27:02.373780+0000, chain.objs.size()=1 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FMqCW88xMhie---0xMeJgeuwVMh5Qmm_0 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16173727501943863987', time=2024-09-14T13:27:02.429016+0000, chain.objs.size()=1 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ACmfzgUpCBHXW7Q11q06fMenGRTGNjj_0 2024-09-14T11:37:46.488 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14002188523597604784', time=2024-09-14T13:27:02.431708+0000, chain.objs.size()=1 2024-09-14T11:37:46.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JG6WEM_w334UjCTPYak3-dXMdl2c_BS_0 2024-09-14T11:37:46.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.958113574243454329', time=2024-09-14T13:27:02.436463+0000, chain.objs.size()=1 2024-09-14T11:37:46.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.489+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ED4de3GteTfsz-4NI6gj44f6g4rtaYw_0 2024-09-14T11:37:46.489 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12717522540762718383', time=2024-09-14T13:27:02.501987+0000, chain.objs.size()=1 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rDdR8Q1YGhCAcAfyvinNv2PRSd0Z5yJ_0 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18363311756945238793', time=2024-09-14T13:27:02.518034+0000, chain.objs.size()=1 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.s00BX3vBbeICANW5WPfjIGn85Im3WSh_0 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11854780462378053640', time=2024-09-14T13:27:02.665276+0000, chain.objs.size()=1 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pikUkAdURMiXZTjnSPqvggArF8SlTY0_0 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18218890264101708521', time=2024-09-14T13:27:02.709102+0000, chain.objs.size()=1 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.cE8wkE6pQsD4Bzi6KOGRvDcEx9BjEXo_0 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6598143967310855699', time=2024-09-14T13:27:02.721532+0000, chain.objs.size()=1 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JywBZbN3EelRV0Ma_fOFdbaXizdMGAV_0 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2295692714103222929', time=2024-09-14T13:27:02.831907+0000, chain.objs.size()=1 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FfkopoCTG-YA6CM46WRIvQmJYNv7lD7_0 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13965716630041882138', time=2024-09-14T13:27:02.966339+0000, chain.objs.size()=1 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CpCvC2WQxkgnSTdntOlekI1cHJtaViE_0 2024-09-14T11:37:46.490 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16452416783363450759', time=2024-09-14T13:27:04.385796+0000, chain.objs.size()=1 2024-09-14T11:37:46.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.265__shadow_.xB_3gzWH9Mg3LI3XSxc0pd8RoZXtaJP_0 2024-09-14T11:37:46.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10869675932051884632', time=2024-09-14T13:27:13.778855+0000, chain.objs.size()=1 2024-09-14T11:37:46.491 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.491+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.285__shadow_.0QrFqmQ9Ily7cpOoPLigNLMK0w7YBqP_0 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.492+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.461942545329307185', time=2024-09-14T13:27:17.682010+0000, chain.objs.size()=1 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.492+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.X3ql2_H9RBJspM0vyzYaUlAWEIRb3vm_0 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.492+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6007849290626227709', time=2024-09-14T13:27:17.686397+0000, chain.objs.size()=1 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.492+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.4A4lZPoV35DXjJKFrzbDB057kqlpiVw_0 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13924776591208350212', time=2024-09-14T13:27:18.486648+0000, chain.objs.size()=1 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.r70EsnHJtsOmilnKvqlIS9HwoO0Pu-4_0 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7067241717859939668', time=2024-09-14T13:27:40.817220+0000, chain.objs.size()=1 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cxHzuhnLaYfIt-wlVR75lHhMLqTmjzJ_0 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16392615628157657206', time=2024-09-14T13:27:41.044378+0000, chain.objs.size()=1 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-BQonza5IYzKwnvENtmfCGAKNWtsiAC_0 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14038708441705957869', time=2024-09-14T13:27:41.084765+0000, chain.objs.size()=1 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2Vz9f6hcoq_yDjlcXMFdx4RMJYGIu9I_0 2024-09-14T11:37:46.492 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16554885212017224974', time=2024-09-14T13:27:41.114048+0000, chain.objs.size()=1 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bOzU5Tdqa8KkEoZdPCafhDcPVh9TxGo_0 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15247429411056109873', time=2024-09-14T13:27:41.144986+0000, chain.objs.size()=1 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.O1GTgMxg8rGJs665V7EmzLWLV-Q7P_P_0 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4730380226059933971', time=2024-09-14T13:27:41.183168+0000, chain.objs.size()=1 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.X67IB-hzLTq-_GqZTcve7oumcw67Jud_0 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6712679022768221973', time=2024-09-14T13:27:41.291851+0000, chain.objs.size()=1 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.493+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LB7SQsX7ZDzDdnTXptD3N4Yk7VjkJ2T_0 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.494+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4354851980116887856', time=2024-09-14T13:27:41.342478+0000, chain.objs.size()=1 2024-09-14T11:37:46.493 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.494+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3J5FEqAy8NHPZaSCh-BdaEtRjIuLoqg_0 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.494+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8420459409141990987', time=2024-09-14T13:27:41.390024+0000, chain.objs.size()=1 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.494+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.r2o0Pz0yZ54ldM7SN4_OyTUBcyAfRzM_0 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.494+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.607346083687560222', time=2024-09-14T13:27:41.397483+0000, chain.objs.size()=1 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.494+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KSkskLhxpJxRrTZxFlw2mmg3UD2HlFC_0 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.495+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13924348950853125704', time=2024-09-14T13:27:41.452597+0000, chain.objs.size()=1 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.495+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wqlOJzmA_3osPhUisSurUi49XKXzqkc_0 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.495+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15648912824220777511', time=2024-09-14T13:27:41.556214+0000, chain.objs.size()=1 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.495+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.h7vMCdAini5j4ivr0a5YuC_eQxSlXU2_0 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.495+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1185945664031984677', time=2024-09-14T13:27:41.582964+0000, chain.objs.size()=1 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.495+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ipRt-y1Sm8lFAmeEGSdGnbY-ehD-WvO_0 2024-09-14T11:37:46.494 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1073587577028952111', time=2024-09-14T13:27:41.621555+0000, chain.objs.size()=1 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zsI_hvbndUru1wpsGnyP4WAlXtDZGo3_0 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6891029820170982509', time=2024-09-14T13:27:41.687157+0000, chain.objs.size()=1 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ErzGxZ_XdXJhvtOOadHL0WZlka_aMpP_0 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5949275739021955659', time=2024-09-14T13:27:41.708524+0000, chain.objs.size()=1 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-yYuBVm65sdwDXhgyNHO13XH8FI8Hsl_0 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13059823762039692005', time=2024-09-14T13:27:41.721626+0000, chain.objs.size()=1 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HI3cfV0lLphCLk4JGlKycNp_DxTs7fO_0 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17132882631087077358', time=2024-09-14T13:27:41.722423+0000, chain.objs.size()=1 2024-09-14T11:37:46.495 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jbl-AT2KRs6WhweFxUaqd1MVu5qZHYW_0 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10711667884599043467', time=2024-09-14T13:27:42.062274+0000, chain.objs.size()=1 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tZHNowTsdG_nKKYIF3ePni3iT3qMSil_0 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17491152564801029243', time=2024-09-14T13:27:42.086084+0000, chain.objs.size()=1 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wLqz2Yza0vckKa2kOkvd6XIiqT5hGRa_0 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13667698639796331200', time=2024-09-14T13:27:42.191143+0000, chain.objs.size()=1 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qwqj6xEu14MujLV7Ld2-uUknKgzH094_0 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11843575910976343889', time=2024-09-14T13:27:42.371680+0000, chain.objs.size()=1 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.496+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5i9O-NkoNTMdQZfysJI7S3_30qc2wuW_0 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.497+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6739559556525127039', time=2024-09-14T13:27:42.584880+0000, chain.objs.size()=1 2024-09-14T11:37:46.496 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.497+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4WhtsYOm8yFj8JGc31QBU-7cmoK16dY_0 2024-09-14T11:37:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.497+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8328643078808373655', time=2024-09-14T13:27:42.589520+0000, chain.objs.size()=1 2024-09-14T11:37:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.497+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xLBaEG4jU2w458FIu7kQ_d4KS656KLI_0 2024-09-14T11:37:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8111615738114700789', time=2024-09-14T13:27:50.416390+0000, chain.objs.size()=1 2024-09-14T11:37:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4s0iRlapvtnALUnqgJeGtjTnTy1D2MO_0 2024-09-14T11:37:46.497 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17850296355104365400', time=2024-09-14T13:27:50.460175+0000, chain.objs.size()=1 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6bjZocAXJUSyg-muEoCwkIv70hvdWC7_0 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16431166551262070848', time=2024-09-14T13:27:50.494756+0000, chain.objs.size()=1 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wBfIzNLKqwa8EVm92i7OKa6iBBB8k2w_0 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16302206692311003796', time=2024-09-14T13:27:50.563606+0000, chain.objs.size()=1 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9htF0YuOV3IpFPB96UXnLsQjC0tNhEv_0 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3239373363006263234', time=2024-09-14T13:27:50.744912+0000, chain.objs.size()=1 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.raYlVwQjby8EX-i2M9PDX42t9R8ogPB_0 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9944995664925499810', time=2024-09-14T13:27:50.765466+0000, chain.objs.size()=1 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dr4edjsCL4hpXiyBmUlSzWzO3usGkgZ_0 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7820583968425780519', time=2024-09-14T13:27:50.823975+0000, chain.objs.size()=1 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SAkUpbe-ltn4phGGy05zvP59nwu4X1k_0 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.242127040372322769', time=2024-09-14T13:27:50.825969+0000, chain.objs.size()=1 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fOTUExxSUhzEQA9dBNRyxvLurkgS7SD_0 2024-09-14T11:37:46.498 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.321509141217271249', time=2024-09-14T13:27:50.846551+0000, chain.objs.size()=1 2024-09-14T11:37:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aEqTNRYpcX2Otlt2Msxe8J1Ql5a20TK_0 2024-09-14T11:37:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3639815719491276926', time=2024-09-14T13:27:50.998180+0000, chain.objs.size()=1 2024-09-14T11:37:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.498+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.I5OqHfd-7AKVj4OEdsXw2tS76hKpizK_0 2024-09-14T11:37:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.499+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16172429241282421072', time=2024-09-14T13:27:51.189246+0000, chain.objs.size()=1 2024-09-14T11:37:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.499+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RTBP-PawQzBBn_2HCEx9NDyu3oBiawU_0 2024-09-14T11:37:46.499 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.500+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13727612487235896381', time=2024-09-14T13:27:51.240486+0000, chain.objs.size()=1 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.500+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.n_HomRS_CQtU31OKX1LLxP3qFewoMBO_0 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.500+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7030550942468028644', time=2024-09-14T13:27:51.289845+0000, chain.objs.size()=1 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.500+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fve2GBNMbG9UykMZUkEO7j4XBUKmChm_0 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.500+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7440320642898634031', time=2024-09-14T13:27:51.294282+0000, chain.objs.size()=1 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.500+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.i8852H-GWPCSnXfI56Roc-1gH97lGho_0 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.501+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4542132803816428745', time=2024-09-14T13:27:51.469705+0000, chain.objs.size()=1 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.501+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.U0KWN203ewu35-ysTmCfTrWXfgJzmFr_0 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11260992775273864575', time=2024-09-14T13:27:51.493012+0000, chain.objs.size()=1 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.N_ZzzzLtiQJW5E_tyZL3PbdmdLaU4Ap_0 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11155990233807902775', time=2024-09-14T13:27:51.511500+0000, chain.objs.size()=1 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ta3hNqJ7JwK6eoAQ6ZBR7W9ODD9AliI_0 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5980081055344517880', time=2024-09-14T13:27:51.521363+0000, chain.objs.size()=1 2024-09-14T11:37:46.500 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.akR1JQiqpu758EsS56ICualwH9Lf9Pv_0 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9285479397092332669', time=2024-09-14T13:27:51.612558+0000, chain.objs.size()=1 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7-3pHLYJSbx9Vs95rdxTYCtOfnFTcXJ_0 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11217549723729705410', time=2024-09-14T13:27:51.725785+0000, chain.objs.size()=1 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.D-H6Iw9k1refqTiZGvi86X5HfFEAQVW_0 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9312501753926654308', time=2024-09-14T13:27:51.726793+0000, chain.objs.size()=1 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Zc2zP2n37wxgYIvzcc5am6omI1afaad_0 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10288871880214824898', time=2024-09-14T13:27:51.739513+0000, chain.objs.size()=1 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.03RxsZEXAYMetjIvQCG-HoM-LCoatW__0 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.534836748802793160', time=2024-09-14T13:27:52.044191+0000, chain.objs.size()=1 2024-09-14T11:37:46.501 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.502+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9_Y5R-Yud1nuLgu0xqg_G3Y3aQAQ0U9_0 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1538167076819657404', time=2024-09-14T13:27:52.082164+0000, chain.objs.size()=1 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5VMn-7g76KLAKyLikd-PnRxTKpRDWz1_0 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10275933681762296947', time=2024-09-14T13:27:52.105502+0000, chain.objs.size()=1 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.C3gfqSP_uQ_bGtzeaPnBkakC4AwWcLn_0 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2615832986991657076', time=2024-09-14T13:27:52.124329+0000, chain.objs.size()=1 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iZZXOfOE0TGt6yqxjniFDIucAUl9_t6_0 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5326232419167233587', time=2024-09-14T13:27:52.241737+0000, chain.objs.size()=1 2024-09-14T11:37:46.502 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.503+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.S7ckBDcpRpC9jweZ_C7xJKRhSdjYeYy_0 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15638171750661868738', time=2024-09-14T13:27:52.263293+0000, chain.objs.size()=1 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lMCxZmTp0WkDYibJx7z475bX6D1nJq5_0 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8780764121010282544', time=2024-09-14T13:28:14.777502+0000, chain.objs.size()=1 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.374__shadow_.y9zq1CxBukDt_BUPxBlw8mdIjs5xHRY_0 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3781262471084621749', time=2024-09-14T13:28:20.102694+0000, chain.objs.size()=1 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.384__shadow_.S2tngLTGJ_2MOdQsDyOt9ip6Oe5m0ao_0 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17503623598152461609', time=2024-09-14T13:28:58.252911+0000, chain.objs.size()=1 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.456__shadow_.r208IUYyjjmTqrMSTwCd5_SCsWqNTL4_0 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.874676681155424074', time=2024-09-14T13:29:10.607272+0000, chain.objs.size()=1 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.TF3iNzt7KmhbpeckxDvismbMnTEN-WR_0 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11979234038590766585', time=2024-09-14T13:29:14.907278+0000, chain.objs.size()=1 2024-09-14T11:37:46.503 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.504+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.491__shadow_.Rl16BevSL4QYhkmQbeCvy1UOQ8x6bXY_0 2024-09-14T11:37:46.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7470832269206710813', time=2024-09-14T13:29:49.588161+0000, chain.objs.size()=2 2024-09-14T11:37:46.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.528__multipart_mymultipart.2~cnJOZSs6q0j4B8gwuMROeruyNmbm_Ry.1 2024-09-14T11:37:46.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.528__multipart_mymultipart.2~cnJOZSs6q0j4B8gwuMROeruyNmbm_Ry.2 2024-09-14T11:37:46.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14386806713753631190', time=2024-09-14T13:30:33.986426+0000, chain.objs.size()=1 2024-09-14T11:37:46.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.562__shadow_.MIYZld6Fi937s3j8jSXVbpiZDn2uAYZ_0 2024-09-14T11:37:46.504 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15439560605049087700', time=2024-09-14T13:30:38.599998+0000, chain.objs.size()=2 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.563__shadow_._O3awyjlvuvtD9zeCMSIxbkgHrZhSkf_0 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.563__shadow_._O3awyjlvuvtD9zeCMSIxbkgHrZhSkf_1 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3252914429260995487', time=2024-09-14T13:30:43.195000+0000, chain.objs.size()=1 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.505+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:BUB5eU4O.nRv2t4ekgeeU0FE31BMeRh_.1jNz2X2i_-lU2-Oyh81gLOzp4c4THl9_0 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5137207971129786666', time=2024-09-14T13:30:52.968844+0000, chain.objs.size()=1 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:6hYVyQ0CleRAlEhaRwxXpuKFlX5W85T_.siVGoRX5lTbfjqV2scy_A63-UT1e6T8_0 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16243724686503559489', time=2024-09-14T13:31:00.917385+0000, chain.objs.size()=1 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:EHiJacC-kVs9vpftNlY0pE4U3hG.orx_.pGPyaVWNs3JIuj8aTlttRY5ckoNLEMX_0 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7607979742072901170', time=2024-09-14T13:31:02.829695+0000, chain.objs.size()=1 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:mTg2FqVTwC-J4ts8eb3-K9ew3M9FnTK_.2kwiebmvv7V2GYZrYoV9YRQqfo5ZVn0_0 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13989144726105301464', time=2024-09-14T13:31:06.765392+0000, chain.objs.size()=1 2024-09-14T11:37:46.505 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.506+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:etEH5Mx.CxphiZYyfQ.9-nn6KSmR.Pi_.yGzlPMFeHzl5GN7BeoqA7KFxg8I4MMO_0 2024-09-14T11:37:46.506 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.508+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44234 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15812868107888532542', time=2024-09-14T13:31:10.109749+0000, chain.objs.size()=1 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:Ash73ut-vnMn2sBlTHBCTH5uhsEFSFR_.TDGRcPvonTfbI9XiOkjfXOGEsVs08DU_0 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17281996206260671650', time=2024-09-14T13:33:54.088377+0000, chain.objs.size()=1 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.644__shadow_.0P5lcPZ38SxVUQFW-8rVzqH4yHQjX0N_0 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3000486694657692455', time=2024-09-14T13:34:56.237090+0000, chain.objs.size()=10 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.1 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.2 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.3 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.4 2024-09-14T11:37:46.509 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.5 2024-09-14T11:37:46.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.6 2024-09-14T11:37:46.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.7 2024-09-14T11:37:46.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.8 2024-09-14T11:37:46.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.9 2024-09-14T11:37:46.510 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.510+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.735__multipart_foo.2~-y8o7IhiGabnIe9NsntzTrrioQxw_LT.10 2024-09-14T11:37:46.511 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.513+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.513 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.515+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-14T11:37:46.514 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.516+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.515 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.517+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/50445' 2024-09-14T11:37:46.516 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2281002077970929834', time=2024-09-14T13:24:52.017515+0000, chain.objs.size()=1 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.151__shadow_.8_xF4TvCkRSDq0Rl_uNUKZOunOycFQN_0 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4790994046977204014', time=2024-09-14T13:25:11.406862+0000, chain.objs.size()=1 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.178__shadow_.36uWCnmD7PzOWVtBLfEaV5Azy3I0MhJ_0 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6840429692934151997', time=2024-09-14T13:26:38.012391+0000, chain.objs.size()=1 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.231__shadow_.PYF42Pbs9CKrEG10exEqu967fUnHWBa_0 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6454616783851024071', time=2024-09-14T13:26:42.816556+0000, chain.objs.size()=1 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.240__shadow_.LGJIS2wdwAC_ek3H-LVSS2XmyA14JKK_0 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9155400061187535857', time=2024-09-14T13:26:44.625462+0000, chain.objs.size()=1 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.243__shadow_.8W52diBPinX-KSVGT3umPffWLm_xQfO_0 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11806633622478861152', time=2024-09-14T13:26:45.454391+0000, chain.objs.size()=1 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.244__shadow_.rgAcBGyq7l62FLnBR9HOg6Lx2Dq_wTH_0 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9328565080938590845', time=2024-09-14T13:27:01.209077+0000, chain.objs.size()=1 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-8qTmRHXuEhxDCYdWQJp-znAdT6082E_0 2024-09-14T11:37:46.517 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1996029725625587244', time=2024-09-14T13:27:01.287757+0000, chain.objs.size()=1 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.q1tN05kK39zmnikEiUpcHuwIrYxbN7G_0 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4192902098944792716', time=2024-09-14T13:27:01.313610+0000, chain.objs.size()=1 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZZ_uUklWMMdVbCMZeaoEjnFNUEHO4Tk_0 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.269334778035765986', time=2024-09-14T13:27:01.423539+0000, chain.objs.size()=1 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.jkUmFKTqELSLnoR3uFramvr4_cm8bTm_0 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9498888281127499271', time=2024-09-14T13:27:01.477155+0000, chain.objs.size()=1 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hN3iYMXFNYMIyXGejYsCMYwmyz01DYp_0 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3594152760221192706', time=2024-09-14T13:27:01.513724+0000, chain.objs.size()=1 2024-09-14T11:37:46.518 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.518+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oR5sxK_ePKWYEI7BuZewEs9HLZQRbwj_0 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.519+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10842473812249626463', time=2024-09-14T13:27:01.524207+0000, chain.objs.size()=1 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.519+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oAt03PDFshvfpievfSOaOLfEGLpfctr_0 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.519+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11231334353043315564', time=2024-09-14T13:27:01.536232+0000, chain.objs.size()=1 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.519+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7uLXv4NlNDoVO7fPcHphHDY16cJQmk1_0 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.520+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11704822865838868605', time=2024-09-14T13:27:01.552642+0000, chain.objs.size()=1 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.520+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vX3uq0K6FseCKhN0HqHMryk9CNzNR6m_0 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.520+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13923388423292941999', time=2024-09-14T13:27:01.561143+0000, chain.objs.size()=1 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.520+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.SQxbMe_9ePueB41FHW3EhfI1YPF7AeG_0 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.520+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9095901443698077297', time=2024-09-14T13:27:01.670696+0000, chain.objs.size()=1 2024-09-14T11:37:46.519 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.520+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gAnzTnY5yEK8HeeqL0rbueJtWwwhb1H_0 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5819868016703898198', time=2024-09-14T13:27:01.735087+0000, chain.objs.size()=1 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4YX1qICXdQw3XLi5-EfWjvzYEW1tkBR_0 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1726689162223600876', time=2024-09-14T13:27:01.790583+0000, chain.objs.size()=1 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XbbT0go_7s5rVDxFDSNEzKdssTLXKiN_0 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7262932722421552782', time=2024-09-14T13:27:01.923957+0000, chain.objs.size()=1 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tsK151uyK_KEy3d4Zy54StOHunX8fP3_0 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1552392746891335592', time=2024-09-14T13:27:01.941292+0000, chain.objs.size()=1 2024-09-14T11:37:46.520 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.521+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BJMD11M66I5h8iuxUSISLv1-ptndsOp_0 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16306641967946862652', time=2024-09-14T13:27:01.945949+0000, chain.objs.size()=1 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eo6N2a9Jy3q_yhQpnMcusvGqA4hnJwx_0 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6982000417581164863', time=2024-09-14T13:27:01.966640+0000, chain.objs.size()=1 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.uOxdvuRXlwgZ_Cqfj0iM2Nk5BG9aH6Z_0 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2308826618567033676', time=2024-09-14T13:27:02.047977+0000, chain.objs.size()=1 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZFAnTWhW6VlFpuLez-8A6G1Nx9YyORD_0 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4469109550598220641', time=2024-09-14T13:27:02.269972+0000, chain.objs.size()=1 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WkFYDuxqrHxOgxhxB7pxqyenDRKk5kY_0 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4126374961582297554', time=2024-09-14T13:27:02.275601+0000, chain.objs.size()=1 2024-09-14T11:37:46.521 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.522+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wrCPEDk36y0LRahEIbBPm2POuj19hzG_0 2024-09-14T11:37:46.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18387749508936705105', time=2024-09-14T13:27:02.283806+0000, chain.objs.size()=1 2024-09-14T11:37:46.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.F4DylOEeg56GwG_Ynm8GjcCuU_CXI5e_0 2024-09-14T11:37:46.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.623517752097350609', time=2024-09-14T13:27:02.362052+0000, chain.objs.size()=1 2024-09-14T11:37:46.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Sdpqvg97h0Ue-IbJGcjWthV1i6IWKVu_0 2024-09-14T11:37:46.522 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8177077285752350127', time=2024-09-14T13:27:02.387278+0000, chain.objs.size()=1 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TQWZBW-DJXLJFyDtPcEJdg2Vco3uAhb_0 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10291403684464042314', time=2024-09-14T13:27:02.408181+0000, chain.objs.size()=1 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BavrC8vDi1fqC1sMF8tDCVeRk1sw8Sm_0 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.533883527039150561', time=2024-09-14T13:27:02.632735+0000, chain.objs.size()=1 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Qp9UrwLHdTGK_TD0LcYm5cSW63klqCg_0 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10447478560598993855', time=2024-09-14T13:27:02.637472+0000, chain.objs.size()=1 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.523+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ha6omWq3S54tvJdjUfgJay8ezXDfaTL_0 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4436651575909457821', time=2024-09-14T13:27:02.657457+0000, chain.objs.size()=1 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.H8tDewz4a-k8TvpF7LWQlot4cR2SooU_0 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11800450706679249154', time=2024-09-14T13:27:02.748432+0000, chain.objs.size()=1 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3U0ufDcUY_nfOTjyhdpQovypqEkLN_j_0 2024-09-14T11:37:46.523 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5348025189340591671', time=2024-09-14T13:27:02.753372+0000, chain.objs.size()=1 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.dZfCMYog7QyJMAAZ5cjudPpUFnTlsZv_0 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15891143120709881426', time=2024-09-14T13:27:02.865219+0000, chain.objs.size()=1 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.zYCEEc2pPhRTCLkh844ewzIG2v0hjPs_0 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7035555406656487403', time=2024-09-14T13:27:02.871430+0000, chain.objs.size()=1 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.524+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.h627XctwUztmW7D3PcsxiJ_z8bu0cRw_0 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3636803633208213807', time=2024-09-14T13:27:11.840550+0000, chain.objs.size()=1 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.281__shadow_.n7rPhewNZ9Tf093Bx96Mjac-QI3pgy__0 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5854099399414349707', time=2024-09-14T13:27:14.734344+0000, chain.objs.size()=1 2024-09-14T11:37:46.524 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.287__shadow_.HyGGc2IcRU0TTEAtW5gtzO_ZjJmmOfg_0 2024-09-14T11:37:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8725975025702066817', time=2024-09-14T13:27:17.680600+0000, chain.objs.size()=1 2024-09-14T11:37:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.kocLd6I0hUI9ufw83G009OzYV8ja9CQ_0 2024-09-14T11:37:46.525 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11761940508773426204', time=2024-09-14T13:27:18.486349+0000, chain.objs.size()=1 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.PXr4c2ipHaUDKrfP6cRxuK8JrBTlsrA_0 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16077027480699747357', time=2024-09-14T13:27:18.489433+0000, chain.objs.size()=1 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.a6Sc_zO3ihhkKhlKBr9ev8ZOXsF9H2u_0 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1215821443373383630', time=2024-09-14T13:27:19.451878+0000, chain.objs.size()=1 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.525+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.295__shadow_.-DE6E7d2RvmOmdn6UQE5mnLnZOIZOeE_0 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.526+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11024212993849861108', time=2024-09-14T13:27:23.976315+0000, chain.objs.size()=1 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.526+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.304__shadow_.KY3DU9eJyR4hgY_7X9uX7_hXneCeHAJ_0 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.526+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2613313936747630027', time=2024-09-14T13:27:32.216064+0000, chain.objs.size()=1 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.526+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.321__shadow_.0adfvIfiZf600O113_vCvT_HiAtviTI_0 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11269212760610816402', time=2024-09-14T13:27:40.775547+0000, chain.objs.size()=1 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BeN_Bv-PVUL73e6CysW5yLzeBIk8XUj_0 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15959564100066986776', time=2024-09-14T13:27:40.780930+0000, chain.objs.size()=1 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.fYL_CWJMxfyd1EtpmymzCLKRDYLgCgc_0 2024-09-14T11:37:46.526 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2245170034322729409', time=2024-09-14T13:27:40.792340+0000, chain.objs.size()=1 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.seIzCefhvmWByxGDpaGVU2n-LhYHR9G_0 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17732053500527129897', time=2024-09-14T13:27:40.823792+0000, chain.objs.size()=1 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ok8l5ihUW1VrsVVg244FiYXLIthhPah_0 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13723932957812007250', time=2024-09-14T13:27:40.929055+0000, chain.objs.size()=1 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Wp52C4y7XyXL7AdTaVqAf6pgDy6wzRH_0 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11150533295568964210', time=2024-09-14T13:27:40.939409+0000, chain.objs.size()=1 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.X5Jv1kFVj5RVePvbY9uYOZ5QkjB8nF1_0 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6046745265513427579', time=2024-09-14T13:27:41.073271+0000, chain.objs.size()=1 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t_cD8QH3_JjEgZOG-gvYr9kTGuNSNVg_0 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8883397984508954067', time=2024-09-14T13:27:41.137813+0000, chain.objs.size()=1 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KByQTthr40qHvZ5U5RJ7qgA3iXomjNc_0 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10235893252343615281', time=2024-09-14T13:27:41.141549+0000, chain.objs.size()=1 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ybXjoHuwFwBn88x2k0w3Km5LF4kfDE7_0 2024-09-14T11:37:46.527 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18407955647792790528', time=2024-09-14T13:27:41.210620+0000, chain.objs.size()=1 2024-09-14T11:37:46.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.82XS5TO41bkBxSsAOt1hEJG01Cl59YA_0 2024-09-14T11:37:46.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4328710830766001108', time=2024-09-14T13:27:41.297516+0000, chain.objs.size()=1 2024-09-14T11:37:46.528 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.527+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NN-rBlW9i61UABgnIKo9AmUqosm-JMz_0 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2857524048264479532', time=2024-09-14T13:27:41.331735+0000, chain.objs.size()=1 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.03CXJwWo9c_33PUb49y-kG3jq9PcuDn_0 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11811961818065625561', time=2024-09-14T13:27:41.408645+0000, chain.objs.size()=1 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.M0v7UIVTAlPsOwdAFCWQ5lGalxeSfS0_0 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16450546686281349392', time=2024-09-14T13:27:41.424630+0000, chain.objs.size()=1 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Q77fTOXQRUWIcHg7Nzd2DVVMSnGtv3-_0 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12293992321006071867', time=2024-09-14T13:27:41.630226+0000, chain.objs.size()=1 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ElBRtyAlNDIhZMQRGVEayWu32p7XdPx_0 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3761655257219925726', time=2024-09-14T13:27:41.821735+0000, chain.objs.size()=1 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5pENe3nRTL7wxTI0FAclKng3U8isZFB_0 2024-09-14T11:37:46.529 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12949954471294321430', time=2024-09-14T13:27:41.919862+0000, chain.objs.size()=1 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SZCOwQAjgmfS0nK4PEYFUXrj47_FK3a_0 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12304460099362314148', time=2024-09-14T13:27:41.932823+0000, chain.objs.size()=1 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.eKajbgDyM7abkZVmBApVLvLI-Dckvyy_0 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11581563716493178766', time=2024-09-14T13:27:41.962202+0000, chain.objs.size()=1 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6QbnGmDXLlk0KR0lLzw34UNa7zvbjZd_0 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13495840874438616292', time=2024-09-14T13:27:42.190901+0000, chain.objs.size()=1 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LzahjHSY-VmxgZCwbD-pBfajQabdeal_0 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7693035717357566175', time=2024-09-14T13:27:42.210372+0000, chain.objs.size()=1 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._FGhRD6C8ksUkOCB9I0laignVN-bdq-_0 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9431215432945740502', time=2024-09-14T13:27:42.310310+0000, chain.objs.size()=1 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.529+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.aeJ-LPqBrpCh2KWNJo1_wXYcul7qPC__0 2024-09-14T11:37:46.530 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.531+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2632960683948165327', time=2024-09-14T13:27:42.335864+0000, chain.objs.size()=1 2024-09-14T11:37:46.531 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.531+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XKS0Zu_25uXTwMIZjg4AgEUeHg4y6gG_0 2024-09-14T11:37:46.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.531+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11041592461611995432', time=2024-09-14T13:27:42.346875+0000, chain.objs.size()=1 2024-09-14T11:37:46.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.531+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.gOkBANdeImksW8Pv-r-9qCYIXuJuC4m_0 2024-09-14T11:37:46.532 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15928516934390908148', time=2024-09-14T13:27:42.348599+0000, chain.objs.size()=1 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.m3RuTIvIICS-D6CanMUGZ3ezVNYoI66_0 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12617115955211509805', time=2024-09-14T13:27:42.368057+0000, chain.objs.size()=1 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.j-S9Y3lf-PzBymX1EHey7gbzliqDXYc_0 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10305470048657099250', time=2024-09-14T13:27:42.381132+0000, chain.objs.size()=1 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Q_5lN6xyPVLdGFnHKFONxTs8J64xxRN_0 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11672917578309224836', time=2024-09-14T13:27:42.394634+0000, chain.objs.size()=1 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kFYReM1_vHDYoYn4ES9rISSp2gsnMnh_0 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11930688725687502235', time=2024-09-14T13:27:42.443754+0000, chain.objs.size()=1 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MtW-WhjtVcy-k2ssXSGx1t--0ZWqsj3_0 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2559411529343988441', time=2024-09-14T13:27:42.561823+0000, chain.objs.size()=1 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Jgieu_u86YpzTn78e0EMtI471s2UJEf_0 2024-09-14T11:37:46.533 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6406938562910717043', time=2024-09-14T13:27:42.566602+0000, chain.objs.size()=1 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1009DS8veKUlEJYBrDmqR20HZhWY41t_0 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2061304618966363181', time=2024-09-14T13:27:42.577911+0000, chain.objs.size()=1 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DFX9chnivBsn8zAJkTIunP1h1YA_Qr4_0 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5921872602439777619', time=2024-09-14T13:27:42.597846+0000, chain.objs.size()=1 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.532+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kjt1xKXf9X6x5xomqQ-BluNik4GGxqu_0 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.533+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4246852560966071083', time=2024-09-14T13:27:42.629737+0000, chain.objs.size()=1 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.533+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CdBbkzZjSsWfk2V3D3mQkgAuVEItv68_0 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.533+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8911074409851297240', time=2024-09-14T13:27:42.664996+0000, chain.objs.size()=1 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.533+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.q8vTtCGHvS2SXa5r_v1VSMi_tzDpoyP_0 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3516130521088181446', time=2024-09-14T13:27:42.670670+0000, chain.objs.size()=1 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9OkIRb_WIeM4LfVaqF6zR1WrZO185Nd_0 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7559901708088239608', time=2024-09-14T13:27:42.685474+0000, chain.objs.size()=1 2024-09-14T11:37:46.534 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wKCw2lyA2o_5NuZmxFEXfke79WzHvdB_0 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7888858406646974055', time=2024-09-14T13:27:42.690463+0000, chain.objs.size()=1 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9Y555ySSd9OSEGcNIyyzklslN87f7d__0 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16610297980112050473', time=2024-09-14T13:27:42.691629+0000, chain.objs.size()=1 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cBUE4MO1cz6OPTW0yIgk_T6SdFvio0v_0 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8836250275638105218', time=2024-09-14T13:27:50.418764+0000, chain.objs.size()=1 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gcbWI9-5hLh__WHP5oZ2mUKLqFOX81A_0 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8883522288277691872', time=2024-09-14T13:27:50.443339+0000, chain.objs.size()=1 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YTcohN2GYHnxVUC-ToVYFlrxwtCY56q_0 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15441081361789981392', time=2024-09-14T13:27:50.469989+0000, chain.objs.size()=1 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Bljxm9HXE3vkNVXvPyAQe2-icIMNMZo_0 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17983841548432945136', time=2024-09-14T13:27:50.511463+0000, chain.objs.size()=1 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.E4CYBZpoJFUoHXFrS3JjFS15MuIJvI1_0 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14586707517141040425', time=2024-09-14T13:27:50.537143+0000, chain.objs.size()=1 2024-09-14T11:37:46.535 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.534+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0hCSzF9sjjDm8WjkEi28Z_QXfAftRr6_0 2024-09-14T11:37:46.536 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.535+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3282078694457271962', time=2024-09-14T13:27:50.537652+0000, chain.objs.size()=1 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.535+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tkcZ28JxwJSFeYauqGIlzM8joWEbGrv_0 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.535+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16821789741100179108', time=2024-09-14T13:27:50.567249+0000, chain.objs.size()=1 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.535+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rFivgvk_K0fE49ISUt2ugMhapEl_Rks_0 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.535+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3475803752549064960', time=2024-09-14T13:27:50.740547+0000, chain.objs.size()=1 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.535+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cHV3qHqqXkqgqczwtXcTNXZenDvVDVW_0 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.536+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16352004032338441618', time=2024-09-14T13:27:50.748576+0000, chain.objs.size()=1 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.536+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Yds7j5yRbz4x5T88I4rg9YloolsLTwZ_0 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.536+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2940641575822608280', time=2024-09-14T13:27:50.749174+0000, chain.objs.size()=1 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.536+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LbLlSGdZjjIFSF0Wi7Vs5S1VxlxcBKM_0 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.536+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12251345285602377083', time=2024-09-14T13:27:50.751258+0000, chain.objs.size()=1 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.536+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aDmBth8MmhfVdRikr0HTMfe4912dOI5_0 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13432070251477756366', time=2024-09-14T13:27:50.796204+0000, chain.objs.size()=1 2024-09-14T11:37:46.537 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.P4E5Ffl_U3Ie2XOIUUWgj8HPolgdyj0_0 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5209617629781027733', time=2024-09-14T13:27:50.965070+0000, chain.objs.size()=1 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6eRdRLxkRvS8mqBRSgcrWbRJrU9g77a_0 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4723210153694521068', time=2024-09-14T13:27:51.006436+0000, chain.objs.size()=1 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.d1i6ZlZXZhkeKym5gg2eS7n9Uzrx015_0 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14694579495024974366', time=2024-09-14T13:27:51.064515+0000, chain.objs.size()=1 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.g_n6HcumaDTR1u6h46u2i5XaxdnOT1D_0 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13282893125323256445', time=2024-09-14T13:27:51.216895+0000, chain.objs.size()=1 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.537+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.OCNexumyJrJ8KeXnoo9PlHs9ccsXTza_0 2024-09-14T11:37:46.538 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.539+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/50445 2024-09-14T11:37:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=37, truncated=0, next_marker='' 2024-09-14T11:37:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1354989093538350518', time=2024-09-14T13:27:51.282322+0000, chain.objs.size()=1 2024-09-14T11:37:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JANoPBRankZakpT4eQDjn0oJOgyfcW1_0 2024-09-14T11:37:46.539 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17245481543085927056', time=2024-09-14T13:27:51.298487+0000, chain.objs.size()=1 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._o6ST6xZ-HdptWcuiNAyAxb-xuueZfS_0 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8849558935098779293', time=2024-09-14T13:27:51.321683+0000, chain.objs.size()=1 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.IwruylIaWbrdPfUM_UwCZkXc1lAx6Sj_0 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10952385801746520843', time=2024-09-14T13:27:51.364037+0000, chain.objs.size()=1 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cdW_uUfD1CNcPW55MYc-7HNzpIH7s1__0 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2565009040815096739', time=2024-09-14T13:27:51.454007+0000, chain.objs.size()=1 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.khsa4MLN61TrC8g3cNcj5ewZEexQkb1_0 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16934352091903816481', time=2024-09-14T13:27:51.475341+0000, chain.objs.size()=1 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.m9LcqY620a8rguyAJ8R1NrxgMCzzGza_0 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13445131012076121127', time=2024-09-14T13:27:51.744757+0000, chain.objs.size()=1 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.27yhiXiURSY7cAn4GETw2xb_AGOjPFp_0 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6048908861482457262', time=2024-09-14T13:27:51.778066+0000, chain.objs.size()=1 2024-09-14T11:37:46.540 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RAC9bSaSZV6P0PwqYsKeT8iMtrvjNEh_0 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9216379399566926024', time=2024-09-14T13:27:51.796927+0000, chain.objs.size()=1 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.eEq207sAyoqJk3AxoTJNQfsZ3iJq-1h_0 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5464908536543464699', time=2024-09-14T13:27:51.800230+0000, chain.objs.size()=1 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iBNsAOZjK7wNJziA9eGb4pEpl8iuyrh_0 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8718607933055077076', time=2024-09-14T13:27:51.803730+0000, chain.objs.size()=1 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4ESMp8aV3vNuo-mj_H3oXWO5puBhK1T_0 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6971962107103032593', time=2024-09-14T13:27:51.811627+0000, chain.objs.size()=1 2024-09-14T11:37:46.541 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.541+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jQnIhnxrljB25L8lnHWQ6vNsxGQEJxg_0 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.542+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8614169557138138806', time=2024-09-14T13:27:51.832094+0000, chain.objs.size()=1 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.542+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9HaqiPQEk-FwryzWtPXTOPjCBJ4HeLe_0 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4053801845934059586', time=2024-09-14T13:27:51.971928+0000, chain.objs.size()=1 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3_3NzWhn0ptTJmOfZKb2Eh6W1cguAJT_0 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17769406762628821409', time=2024-09-14T13:27:51.983613+0000, chain.objs.size()=1 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.X1ToNxk56TPDHPcJRXxb3xKmjOmKNz5_0 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17609352312601671677', time=2024-09-14T13:27:51.994308+0000, chain.objs.size()=1 2024-09-14T11:37:46.542 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3QK3lz1njb2HCacIhVJFFKlWszYywkI_0 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16633811926801079380', time=2024-09-14T13:27:52.264112+0000, chain.objs.size()=1 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NkHnJcArEXRhOo_mgCxqIG7bv5n2LkV_0 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12480049189707344094', time=2024-09-14T13:27:52.275856+0000, chain.objs.size()=1 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LlB6VzlS8yIBVNQgL1BeHlpqiDUhk4V_0 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3178574582169977207', time=2024-09-14T13:27:52.317005+0000, chain.objs.size()=1 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._92J_7HMZrKGflQsSLM7PNC2MQnqKNn_0 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17922586926265468999', time=2024-09-14T13:27:52.319830+0000, chain.objs.size()=1 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ins8371HHd1oYnrsDPrWokw5I701tVC_0 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9867028182759039144', time=2024-09-14T13:28:13.293391+0000, chain.objs.size()=1 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.373__shadow_.YnVV589-IiQ5h6KP50WapFYcoEpOpeP_0 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14421158240524459849', time=2024-09-14T13:29:05.062436+0000, chain.objs.size()=1 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.466__shadow_.L0chSLL3W9UW3XMDa78TBE5xvlLhYAE_0 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.628972806978391893', time=2024-09-14T13:29:10.597589+0000, chain.objs.size()=1 2024-09-14T11:37:46.543 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.543+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.euyQirwAXCOlRbPKQGbkyDYoJxmq4o__0 2024-09-14T11:37:46.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.544+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13403081595983523513', time=2024-09-14T13:29:16.636081+0000, chain.objs.size()=1 2024-09-14T11:37:46.544 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.544+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.496__shadow_.bXpZKQSJSpmROilcV0C-mPkvay7qNnk_0 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.545+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6267744105497612162', time=2024-09-14T13:29:47.255623+0000, chain.objs.size()=3 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.545+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~pmXe7hX6jVu2RGbPUjmBcEemoQQTXmI.1 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~pmXe7hX6jVu2RGbPUjmBcEemoQQTXmI.2 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~pmXe7hX6jVu2RGbPUjmBcEemoQQTXmI.3 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14540185643589723907', time=2024-09-14T13:30:31.562952+0000, chain.objs.size()=2 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.558__shadow_.0iSOSIK8DNySlLIkpThcqkUhl_mTF8Y_0 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.558__shadow_.0iSOSIK8DNySlLIkpThcqkUhl_mTF8Y_1 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2773633265923170944', time=2024-09-14T13:30:41.953170+0000, chain.objs.size()=1 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:upyKEts9d6r6fPkcau6cidHV1HpneXw_.6faIS38R8ebuGW1aw-jv6G_0VSDJCLc_0 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12928421514315769098', time=2024-09-14T13:30:48.235218+0000, chain.objs.size()=1 2024-09-14T11:37:46.545 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.570__shadow:HQVpHWRvnXOJrN2GnINmdQ.cwXBNW6M_.dgyTHjLyeZLeQH02QuV6AAYSnq_ab7L_0 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.700363541089630826', time=2024-09-14T13:30:51.578011+0000, chain.objs.size()=1 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:WwsTetlZmY3GW5o2DQEGAehpQpWn22T_.XxZkg6kT46SiTDE9mVN-DzgNOPtEsrm_0 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3553349729769078533', time=2024-09-14T13:31:15.267441+0000, chain.objs.size()=1 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:jeOKx-mjkQgrtZ6.9zybg6lHcPll7ZN_.zbhXmT6kqeg31mAzl5dJrw2Mj4prnsM_0 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8299803930148195015', time=2024-09-14T13:31:28.320737+0000, chain.objs.size()=1 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.608__shadow_.1Jw2jD6wNYlp4GXR4Ugkz1fmPKucV0F_0 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14138516201050797885', time=2024-09-14T13:31:36.677424+0000, chain.objs.size()=6 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.546+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.614__multipart_multipart_enc.2~p3AkQMbxZJwYsxweUfBwxLvmkY-Wrp2.1 2024-09-14T11:37:46.546 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.547+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.614__multipart_multipart_enc.2~p3AkQMbxZJwYsxweUfBwxLvmkY-Wrp2.2 2024-09-14T11:37:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.614__multipart_multipart_enc.2~p3AkQMbxZJwYsxweUfBwxLvmkY-Wrp2.3 2024-09-14T11:37:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.614__multipart_multipart_enc.2~p3AkQMbxZJwYsxweUfBwxLvmkY-Wrp2.4 2024-09-14T11:37:46.548 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.614__multipart_multipart_enc.2~p3AkQMbxZJwYsxweUfBwxLvmkY-Wrp2.5 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.614__multipart_multipart_enc.2~p3AkQMbxZJwYsxweUfBwxLvmkY-Wrp2.6 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15350774584687360839', time=2024-09-14T13:34:11.652852+0000, chain.objs.size()=1 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.679__shadow_.V15GuDTnpWZnFj54zpZSsvng7QR156M_0 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6235824917197536124', time=2024-09-14T13:34:21.722862+0000, chain.objs.size()=1 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.703__shadow:C0F2r9XfVmp1uveSOfsGvWDnrxctv7N_.jCG0Sa-nkCWc0zNpj-v1jRwTa7VVlQW_0 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2333592560167746066', time=2024-09-14T13:34:24.045425+0000, chain.objs.size()=1 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.708__shadow:.HHpJK0oshTgHJMJf425pqmrh0Aj8Pe_.7qOi3Sp4u7g6tDMH61NWYMQU9okjA4L_0 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7938677039141420178', time=2024-09-14T13:34:48.075397+0000, chain.objs.size()=1 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.719__shadow_.igN2fKbHa15LbAeThVd-cYxC1BnZap0_0 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14211637719594751169', time=2024-09-14T13:35:22.000074+0000, chain.objs.size()=1 2024-09-14T11:37:46.549 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.550+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.760__shadow_.QxCfgPcs81eEMjvMV8ahiTITSk2md0V_0 2024-09-14T11:37:46.552 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.554+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.554 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.556+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-14T11:37:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.560+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.558 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.560+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/51357' 2024-09-14T11:37:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8879076601559636872', time=2024-09-14T13:26:44.625356+0000, chain.objs.size()=1 2024-09-14T11:37:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.243__shadow_.FUqX7014Fk2jO6yfrQvGv-plQsst9Se_0 2024-09-14T11:37:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3982817339451045104', time=2024-09-14T13:26:49.704518+0000, chain.objs.size()=1 2024-09-14T11:37:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.253__shadow_.nGHnEeO4KNN5TsT53AYyneVVueGHw_F_0 2024-09-14T11:37:46.560 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4782872354883486450', time=2024-09-14T13:26:53.211037+0000, chain.objs.size()=1 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.260__shadow_.iO3h-xGaZAZgzcl4WQMaPMM3_xHaqlu_0 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17995091143656656562', time=2024-09-14T13:26:53.691048+0000, chain.objs.size()=1 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.261__shadow_.bnejeuddfSWrIG5EGA-dyEqpwys9djr_0 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1933779917388116435', time=2024-09-14T13:26:53.692200+0000, chain.objs.size()=1 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.261__shadow_.XKvhD0uecoCvGfxRhML-4QCQ8gA5kQE_0 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12643740960036996048', time=2024-09-14T13:27:01.226807+0000, chain.objs.size()=1 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JsJdRmPgxsj849ED6IH8DdKADFy3t9n_0 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13597112477467344594', time=2024-09-14T13:27:01.268246+0000, chain.objs.size()=1 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.p6BLwoBGWPrTihVAMosR4z6kB4w56N3_0 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14104218829946409786', time=2024-09-14T13:27:01.324240+0000, chain.objs.size()=1 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oMm_S3k-exH1iSKMq2EJoPt13GLBq2Y_0 2024-09-14T11:37:46.561 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11254210483507784853', time=2024-09-14T13:27:01.409189+0000, chain.objs.size()=1 2024-09-14T11:37:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ppqPfwtQjq1eBZRPTnPGRxeoZe1N2pr_0 2024-09-14T11:37:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14470734830390315183', time=2024-09-14T13:27:01.432522+0000, chain.objs.size()=1 2024-09-14T11:37:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LLLTZ1QUJCc5JRVjJIDPlVFn3JBhxyY_0 2024-09-14T11:37:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5002524804426075482', time=2024-09-14T13:27:01.434400+0000, chain.objs.size()=1 2024-09-14T11:37:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.S22FaNVmfPZe9ySfd5q_X414n9yfewl_0 2024-09-14T11:37:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9872600559884845530', time=2024-09-14T13:27:01.440881+0000, chain.objs.size()=1 2024-09-14T11:37:46.562 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.562+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.adcOLPR11P10JSaS9-MBCPt-fYbFnOh_0 2024-09-14T11:37:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.565+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14325519496824279419', time=2024-09-14T13:27:01.443861+0000, chain.objs.size()=1 2024-09-14T11:37:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.565+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hC-o3QKjmRY7csLK-m8hba0UU224ctt_0 2024-09-14T11:37:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.565+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11085988354812217015', time=2024-09-14T13:27:01.472962+0000, chain.objs.size()=1 2024-09-14T11:37:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.565+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WUXDh16wGHE_y7jpmdLSQxKrPvuhp71_0 2024-09-14T11:37:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.565+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17275209789146204909', time=2024-09-14T13:27:01.492591+0000, chain.objs.size()=1 2024-09-14T11:37:46.563 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.565+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LAWv1ep_iQSBqkCVbiBdP6eEXsPmm2e_0 2024-09-14T11:37:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7355440543606085626', time=2024-09-14T13:27:01.539595+0000, chain.objs.size()=1 2024-09-14T11:37:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WxVveEJFXC34Q2DV47zE18VqUC3rJ92_0 2024-09-14T11:37:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13874895389140722287', time=2024-09-14T13:27:01.649066+0000, chain.objs.size()=1 2024-09-14T11:37:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZqCBS2I31WBDLb7Q99W5MI0Dj55Id61_0 2024-09-14T11:37:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1248613558395164597', time=2024-09-14T13:27:01.650713+0000, chain.objs.size()=1 2024-09-14T11:37:46.564 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OXKujhRme5pIxvRnSX4TjWZoM7XKuxW_0 2024-09-14T11:37:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12909605972198121037', time=2024-09-14T13:27:01.654952+0000, chain.objs.size()=1 2024-09-14T11:37:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.566+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2ABLUldElaVpfS6MCehwUpeO_YpLGE9_0 2024-09-14T11:37:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.618203014895925151', time=2024-09-14T13:27:01.695429+0000, chain.objs.size()=1 2024-09-14T11:37:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eDeHrf2QXSl5heiI1lpsRAJ86sd1JRD_0 2024-09-14T11:37:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5789599060094510869', time=2024-09-14T13:27:01.738972+0000, chain.objs.size()=1 2024-09-14T11:37:46.565 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5wBNrXhYI5T0STKVYsB5DiK0ngLhD3R_0 2024-09-14T11:37:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4374710936869720869', time=2024-09-14T13:27:01.759081+0000, chain.objs.size()=1 2024-09-14T11:37:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TxlphM-LM1_fyBmaNDEEHm1yGLrEev-_0 2024-09-14T11:37:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12486472303432657754', time=2024-09-14T13:27:01.771807+0000, chain.objs.size()=1 2024-09-14T11:37:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ChKuJf76oOpBfHcLjwF8B6WS5FHE4G5_0 2024-09-14T11:37:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2759353343547548617', time=2024-09-14T13:27:01.787479+0000, chain.objs.size()=1 2024-09-14T11:37:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.567+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.uCkmQiPiAaGNt9qXiH6uDRBHJSoz06z_0 2024-09-14T11:37:46.566 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7084133965014264646', time=2024-09-14T13:27:02.143213+0000, chain.objs.size()=1 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._yiBra_KC5d8TIBSbTOzu9W8NoXvLvl_0 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17603327527997916334', time=2024-09-14T13:27:02.165386+0000, chain.objs.size()=1 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yk3JA7mxKHbLYLkFCHZ0LeXzq1hYMqy_0 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11392733651606752399', time=2024-09-14T13:27:02.204350+0000, chain.objs.size()=1 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OexYhv4mTORjlzH8HqqNWQpuk7aIpJv_0 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18275520044325821327', time=2024-09-14T13:27:02.488136+0000, chain.objs.size()=1 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eZaV7lFpSHq8aQKxHCKTjCOob4s3zBU_0 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9542617680382078262', time=2024-09-14T13:27:02.513400+0000, chain.objs.size()=1 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.TdJFsO9xmtm9RcoTEg9YpYhT1X6sbv-_0 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3492392396826830257', time=2024-09-14T13:27:02.639887+0000, chain.objs.size()=1 2024-09-14T11:37:46.567 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.568+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.jb-ins_RDZ4Xqo7Aw5c6O2_OYahYq9b_0 2024-09-14T11:37:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15681176495216053344', time=2024-09-14T13:27:02.737633+0000, chain.objs.size()=1 2024-09-14T11:37:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KbtUwlFD1-mZoSoJo8USZL5-sUrhbtq_0 2024-09-14T11:37:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9121115263698300073', time=2024-09-14T13:27:02.836976+0000, chain.objs.size()=1 2024-09-14T11:37:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6YXsibZLKJrqLvns5SS76pLYxzk61E3_0 2024-09-14T11:37:46.568 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5825911029304372', time=2024-09-14T13:27:02.860757+0000, chain.objs.size()=1 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5rfh-tJ1qsE1dVu9MeOW8OBqBRDwe1j_0 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14581714922187585397', time=2024-09-14T13:27:02.868479+0000, chain.objs.size()=1 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ElhCzBCcq9PJEMqTwS1mRxOVVFfW_bu_0 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11196698688340050022', time=2024-09-14T13:27:02.876444+0000, chain.objs.size()=1 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.569+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.R0Pr_TLyg4c6kLzSk0g5c4ke7eSJMSs_0 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.570+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6921219018613528612', time=2024-09-14T13:27:02.909997+0000, chain.objs.size()=1 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.570+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wAOyqHiPJNJ7uQ1kUA3whjNrHabLLEq_0 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.570+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14448103055412424564', time=2024-09-14T13:27:02.940306+0000, chain.objs.size()=1 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.570+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KGCOf8rg9He71jqvVcYxseO4JNtMpxJ_0 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.570+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16060036824337146848', time=2024-09-14T13:27:03.920375+0000, chain.objs.size()=1 2024-09-14T11:37:46.569 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.570+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.264__shadow_.f8Cv5e1XImFIKnJ6Ct7UkMVeGLodcQs_0 2024-09-14T11:37:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.571+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14249024830598582867', time=2024-09-14T13:27:10.435659+0000, chain.objs.size()=1 2024-09-14T11:37:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.571+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.278__shadow_.Zab2QrHJZQONDz2eDAp1lkRkmN7s0OU_0 2024-09-14T11:37:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.571+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5083261355281819622', time=2024-09-14T13:27:11.840535+0000, chain.objs.size()=1 2024-09-14T11:37:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.571+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.281__shadow_.weNvdU2CSb-idR9cMjARHjOZg17n4Uw_0 2024-09-14T11:37:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.571+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14414482827708408678', time=2024-09-14T13:27:14.293475+0000, chain.objs.size()=1 2024-09-14T11:37:46.570 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.571+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.286__shadow_.MCdYonfbqJ1-LocscS5rYBk9MM5m9D0_0 2024-09-14T11:37:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2204977701459471176', time=2024-09-14T13:27:16.107209+0000, chain.objs.size()=1 2024-09-14T11:37:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.290__shadow_.zLpIAz6PLsRF4h_uZNPuPky-AH_lyRm_0 2024-09-14T11:37:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16244516981025738821', time=2024-09-14T13:27:17.698670+0000, chain.objs.size()=1 2024-09-14T11:37:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.4OJFHMZQvDxk84X_nZwwKcn44Tta-CU_0 2024-09-14T11:37:46.571 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4381410938565942084', time=2024-09-14T13:27:18.483580+0000, chain.objs.size()=1 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.jiPb66nyEttDvc0ERrfC8eDS1jYwskQ_0 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16963252854499492144', time=2024-09-14T13:27:19.936925+0000, chain.objs.size()=1 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.296__shadow_.QmyXJHJQP2Jl1NmiUJoRwNrsGLuj_CA_0 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9115971379485414842', time=2024-09-14T13:27:22.075456+0000, chain.objs.size()=1 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.300__shadow_.xvvopSP5aHkBJkDGkZLPBx-FoJ4OhOJ_0 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15233968483075799027', time=2024-09-14T13:27:24.433585+0000, chain.objs.size()=1 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.305__shadow_.lc0H1fSvyNuppEVWXuAr4eZcHxvwTmI_0 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7542339140142464792', time=2024-09-14T13:27:25.053181+0000, chain.objs.size()=1 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.306__shadow_.mjwaMd5s0wwnZAoI7oeSH-JpF_2TdsW_0 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6762430631773529966', time=2024-09-14T13:27:28.822677+0000, chain.objs.size()=1 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.572+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.313__shadow_.K8TOnrESGqudxcaCYNpHC_XqXErCUdD_0 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.573+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7995030925687318362', time=2024-09-14T13:27:40.793866+0000, chain.objs.size()=1 2024-09-14T11:37:46.572 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.573+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XtjmkP8tutqNptJnnYGg1_2GSNE6To5_0 2024-09-14T11:37:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.574+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13417146577186288717', time=2024-09-14T13:27:40.884884+0000, chain.objs.size()=1 2024-09-14T11:37:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.574+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ZjEDt_hiGYG4MELT5BuH1b-Mksl7BF3_0 2024-09-14T11:37:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.574+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12356246797909527498', time=2024-09-14T13:27:40.927141+0000, chain.objs.size()=1 2024-09-14T11:37:46.573 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.574+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cGOfTXsuApVKV9wMe8PUmWaouHG_NaV_0 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13861820074931770739', time=2024-09-14T13:27:40.938366+0000, chain.objs.size()=1 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WDJU0leahaJJBqIhScxJTSbnPdlZUi8_0 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1580728025372692777', time=2024-09-14T13:27:41.075261+0000, chain.objs.size()=1 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jplSuLYIr91WG05fb483HRHhDRxRW-D_0 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.153310800384221292', time=2024-09-14T13:27:41.167013+0000, chain.objs.size()=1 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zyeT0JRG6sOhmz2DhWBdualV_6K4BVt_0 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6719883590433428221', time=2024-09-14T13:27:41.168221+0000, chain.objs.size()=1 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uBj-E9SgPlksu71eRMJKxdf2J6S1p1f_0 2024-09-14T11:37:46.578 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9656239919296841938', time=2024-09-14T13:27:41.172031+0000, chain.objs.size()=1 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nlS2bPEYv8c0IDSUQAXNqaDQZPji3YH_0 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16968769074488435774', time=2024-09-14T13:27:41.175038+0000, chain.objs.size()=1 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hni8YnoG4eSnqoXuMaXFYF7jkis7m2W_0 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9449481970867563213', time=2024-09-14T13:27:41.182570+0000, chain.objs.size()=1 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QOKlYdyvv3XbZOLDzQDhcDBAGtlvdIl_0 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13702154208669089997', time=2024-09-14T13:27:41.190875+0000, chain.objs.size()=1 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ZZya7gPFvcT8qoN8JEC8QV8iK4zzKrb_0 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5976326573859801337', time=2024-09-14T13:27:41.208583+0000, chain.objs.size()=1 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.53ZMXTsJB-idezm-7qrdttid041zLQH_0 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16677976527759994698', time=2024-09-14T13:27:41.309428+0000, chain.objs.size()=1 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CTPWUYqlKi1IzWpx1C83lJFXTyc_bRd_0 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7615485196026594054', time=2024-09-14T13:27:41.331703+0000, chain.objs.size()=1 2024-09-14T11:37:46.579 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.579+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wPGTzdj47dOOaZjusUlxSy48sK0ZAXW_0 2024-09-14T11:37:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10835390007124911023', time=2024-09-14T13:27:41.364851+0000, chain.objs.size()=1 2024-09-14T11:37:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5NHF9qBcLarq32exZTO2GPAVfj_-Uzt_0 2024-09-14T11:37:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.334786780033918545', time=2024-09-14T13:27:41.379371+0000, chain.objs.size()=1 2024-09-14T11:37:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sUg_Mfg1eAXYCGqzaz1v7upd_AH1o0m_0 2024-09-14T11:37:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3814711044782411633', time=2024-09-14T13:27:41.403248+0000, chain.objs.size()=1 2024-09-14T11:37:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lB52IVDFXS4QCt4USkw4tTG_wtH5a4__0 2024-09-14T11:37:46.582 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8712667004049010477', time=2024-09-14T13:27:41.428680+0000, chain.objs.size()=1 2024-09-14T11:37:46.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.584+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2kTyqYlli-lMeA5C7bpl-8ZfT-xfDfp_0 2024-09-14T11:37:46.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7413456335655151833', time=2024-09-14T13:27:41.461921+0000, chain.objs.size()=1 2024-09-14T11:37:46.583 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.o-Y8TEpiJYL9guu_MUwUfBN2yK62tgI_0 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10406556511376773516', time=2024-09-14T13:27:41.463064+0000, chain.objs.size()=1 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sIh_jgFh8yKoJRgeSXSIJT3DaLcuCGW_0 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11158011061799299759', time=2024-09-14T13:27:41.560701+0000, chain.objs.size()=1 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ce1XiPiXHcN8FQHiEQphfnxsrwd1wGY_0 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11156651318199887454', time=2024-09-14T13:27:41.573491+0000, chain.objs.size()=1 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rBllqaNppnwUaZfiZQdI3wSDfqXKzmg_0 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13300715628871379640', time=2024-09-14T13:27:41.622891+0000, chain.objs.size()=1 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JYoYa6HCNo3I3vrz-iRS2uIi3I8v36N_0 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10057076679272569057', time=2024-09-14T13:27:41.678771+0000, chain.objs.size()=1 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2fCHguzV5ROcoyr-9eoA0pjJmAjh2gT_0 2024-09-14T11:37:46.584 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13466847767175961176', time=2024-09-14T13:27:41.865636+0000, chain.objs.size()=1 2024-09-14T11:37:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.585+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xXp38Ad35s8k9SQ0huUpU7amgbZcFYs_0 2024-09-14T11:37:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14158984882574781629', time=2024-09-14T13:27:41.949832+0000, chain.objs.size()=1 2024-09-14T11:37:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.W1hfTP-1_7Zo-gBVcZHr4aLkjoKF1yR_0 2024-09-14T11:37:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16868391400735825935', time=2024-09-14T13:27:41.972528+0000, chain.objs.size()=1 2024-09-14T11:37:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.36Udk1A7cnkXSO5bMeoHqiO79bv2Z2q_0 2024-09-14T11:37:46.585 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4950091396854909835', time=2024-09-14T13:27:42.092515+0000, chain.objs.size()=1 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1U3fFDCtDstu-l_DQIcNQtNRMWuQ_Bw_0 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16014517648812409596', time=2024-09-14T13:27:42.101781+0000, chain.objs.size()=1 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.586+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-FedVFvWgm7H1Dpnj6HptZhtQT8ecE1_0 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.587+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5461231457417592441', time=2024-09-14T13:27:42.195228+0000, chain.objs.size()=1 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.587+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.gaCMnyQ9xchxdz9yTkZeF6ZaWQHs1ZK_0 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.587+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10530777760252961850', time=2024-09-14T13:27:42.337539+0000, chain.objs.size()=1 2024-09-14T11:37:46.586 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.587+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SyeyAdjayeuPSYTDUiktgkGB_lMn9mv_0 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.207954207114205046', time=2024-09-14T13:27:42.383991+0000, chain.objs.size()=1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9weGoziA_vNAmHSyFMxh2bsgepYFdUd_0 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9845100074959615741', time=2024-09-14T13:27:42.389211+0000, chain.objs.size()=1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ZBJnbyFre02Ug08uWtWb6mvhUimNM5r_0 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1058758010502352634', time=2024-09-14T13:27:42.391249+0000, chain.objs.size()=1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.f22LZoUWH9DDBwfjJh1FWvv6uqVYcTF_0 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16579350031104400898', time=2024-09-14T13:27:42.399575+0000, chain.objs.size()=1 2024-09-14T11:37:46.587 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.588+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EOA8kz3pmyHdmziiVB8-nNLSlTWo8Vb_0 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5481291662880377443', time=2024-09-14T13:27:42.460900+0000, chain.objs.size()=1 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UjqSsCRALQsEf2qS5RmJVU_HEPllaSE_0 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1141272655225790715', time=2024-09-14T13:27:42.634809+0000, chain.objs.size()=1 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JhXGxO6XkRHBsNmU9_IyzSV20vhiCUj_0 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6670870094513870370', time=2024-09-14T13:27:42.662974+0000, chain.objs.size()=1 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tEl1SPqAfkkwnsb1aPJEIMKuNv4xfGz_0 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5851095104262930072', time=2024-09-14T13:27:42.678123+0000, chain.objs.size()=1 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xg13X3iwjhXUBdMt0Fw8XR6g4mnIDAR_0 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2223254431418443825', time=2024-09-14T13:27:42.693615+0000, chain.objs.size()=1 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FzMUPZR57FYBtST2tfFwx2sOaP7Hvt-_0 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6120788179864293196', time=2024-09-14T13:27:50.467769+0000, chain.objs.size()=1 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.D3sor5cbkOPiMwJnOcqRMtAiEFeOGaL_0 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16472021321442599150', time=2024-09-14T13:27:50.561569+0000, chain.objs.size()=1 2024-09-14T11:37:46.588 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.THW7tz9kXUCp2ldcNB25JV1VBC5Vs9g_0 2024-09-14T11:37:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18286305045006513021', time=2024-09-14T13:27:50.572348+0000, chain.objs.size()=1 2024-09-14T11:37:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.O-D8UBQlR9eK5LwbFP1D7ZIPVYOy2eF_0 2024-09-14T11:37:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17468528565922262131', time=2024-09-14T13:27:50.758135+0000, chain.objs.size()=1 2024-09-14T11:37:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.589+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yyuC_qTEHLWN28zFikQzUMV4QHqZz2x_0 2024-09-14T11:37:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.590+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9965401529913732851', time=2024-09-14T13:27:50.820768+0000, chain.objs.size()=1 2024-09-14T11:37:46.589 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.590+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Vku-VXDgO8UAPLlEGJNwV14J7YAeIVi_0 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.590+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6461854223305647584', time=2024-09-14T13:27:50.824397+0000, chain.objs.size()=1 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.590+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.K_gjERvBrK4l8Ytx4iU_4dMwgefs6zi_0 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.590+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15009458576488278157', time=2024-09-14T13:27:50.944384+0000, chain.objs.size()=1 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.590+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CSQNNMfZOacDe80hGQhV5-M80_Fvosn_0 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.591+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5011726981307764072', time=2024-09-14T13:27:50.948214+0000, chain.objs.size()=1 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.591+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HFUJ7m4-6CT9nCoel2W7l_BuqivEUlx_0 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.592+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.36978276310074111', time=2024-09-14T13:27:50.987690+0000, chain.objs.size()=1 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.592+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zy6Y6kcVgkJaqzxUadne1xfPvJfbMqv_0 2024-09-14T11:37:46.590 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.592+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5750523182651845024', time=2024-09-14T13:27:51.037578+0000, chain.objs.size()=1 2024-09-14T11:37:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.592+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HKQcdudvLJv8F0uMZRnA--8UlrFSQS4_0 2024-09-14T11:37:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.592+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6070450664015375501', time=2024-09-14T13:27:51.067839+0000, chain.objs.size()=1 2024-09-14T11:37:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.592+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DQnzZzGWilC7RFjSjqwnF1l-q9SBbtx_0 2024-09-14T11:37:46.591 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.593+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/51357 2024-09-14T11:37:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=38, truncated=0, next_marker='' 2024-09-14T11:37:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11781076359173674639', time=2024-09-14T13:27:51.229459+0000, chain.objs.size()=1 2024-09-14T11:37:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.PvcnNMKLfUuH8niho43pk03whFPGS5-_0 2024-09-14T11:37:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13203581870518252435', time=2024-09-14T13:27:51.233826+0000, chain.objs.size()=1 2024-09-14T11:37:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.eWfeNgElDqOdyjAzOmIc4lWZSCX3T1K_0 2024-09-14T11:37:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10747914687894768112', time=2024-09-14T13:27:51.242500+0000, chain.objs.size()=1 2024-09-14T11:37:46.594 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.g6be77MnymkvyoMKGMCRxFm7iO8YbgJ_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1852753864143787012', time=2024-09-14T13:27:51.264578+0000, chain.objs.size()=1 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.M4jHzao15gpcRA8VX2DA-_Z4plKVI-H_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17819961165286006645', time=2024-09-14T13:27:51.296647+0000, chain.objs.size()=1 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5JTOgckcXQCBRArKfZm3qoLaaZ985so_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5228999478505667771', time=2024-09-14T13:27:51.302864+0000, chain.objs.size()=1 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SLfKAzC2g6Oe-VXTpQR5rBIOfwijJK5_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7384452673427770222', time=2024-09-14T13:27:51.323335+0000, chain.objs.size()=1 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AS0DH6dxK4OofPpN7qZ-pk23xOdVcqK_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3396275630263297486', time=2024-09-14T13:27:51.542292+0000, chain.objs.size()=1 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.595+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nLJPpgEvpYEOwO37IpSQZqtL83Jonzc_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8412696192856424966', time=2024-09-14T13:27:51.770945+0000, chain.objs.size()=1 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pq-IKG8gOO0LxyBeodaEfFbWola7N_4_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9761088377605300988', time=2024-09-14T13:27:51.831639+0000, chain.objs.size()=1 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.XM_xcwrtVyQZ3sAfFA0lUN54--rMT73_0 2024-09-14T11:37:46.595 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17006586031330474017', time=2024-09-14T13:27:51.886281+0000, chain.objs.size()=1 2024-09-14T11:37:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JTzra98vfr-tzpSbTgWes5nj8Vj9XY0_0 2024-09-14T11:37:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8097628154975762158', time=2024-09-14T13:27:52.001135+0000, chain.objs.size()=1 2024-09-14T11:37:46.596 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.596+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aCSl4ndhXp8XnC0m23cDmrDr6Gh5H9x_0 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5260746450154415927', time=2024-09-14T13:27:52.023225+0000, chain.objs.size()=1 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.11Ca3Zt2Af3Yk78iyn_xR5o6YK6xqrE_0 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1898382055381520356', time=2024-09-14T13:27:52.026715+0000, chain.objs.size()=1 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.v4QEqS6jNhVhIApRww3i_5Zf5sleAzF_0 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10137202339264416487', time=2024-09-14T13:27:52.137811+0000, chain.objs.size()=1 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.QF6KmUjWpii3uXxnYA8zxY7OeLMEVrQ_0 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6705216306221061048', time=2024-09-14T13:27:52.220142+0000, chain.objs.size()=1 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.u0Ohv3k_F7DEJzlwPLuHC_A8B8pYh8A_0 2024-09-14T11:37:46.597 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13675233961186307602', time=2024-09-14T13:27:52.234413+0000, chain.objs.size()=1 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zeZj8aVIv5kJHhKWXAEBOgMzcHYpPEz_0 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.737316863444441077', time=2024-09-14T13:27:52.317789+0000, chain.objs.size()=1 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Bn0BYWKoo9cFbpJxUhG02PxC1CY98k1_0 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13370633688776884357', time=2024-09-14T13:27:52.338008+0000, chain.objs.size()=1 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UpX8C8p9numfxM3PH3H_GgWONEUe868_0 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16675925392094704525', time=2024-09-14T13:27:52.344659+0000, chain.objs.size()=1 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gt_PX50OSM7-aAGbi912pXO4i7ku803_0 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16459959732675053023', time=2024-09-14T13:28:44.629692+0000, chain.objs.size()=1 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.431__shadow_.262YX6WR8iwJsokPp-ANa3xsLYz5Z8h_0 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.886982241006950978', time=2024-09-14T13:29:04.497842+0000, chain.objs.size()=1 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.465__shadow_.mqhiim1CvqxD__qisGjxvcyMWoqiAqG_0 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11377383595395325700', time=2024-09-14T13:29:05.062938+0000, chain.objs.size()=1 2024-09-14T11:37:46.598 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.598+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.466__shadow_._sZFR1AGjA2LqtnjTAgvUNuWvxLBQh3_0 2024-09-14T11:37:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12041979670322861458', time=2024-09-14T13:29:11.455397+0000, chain.objs.size()=1 2024-09-14T11:37:46.599 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.485__shadow_.ioowrxnlfcF4x0oij3WSyiFwtd1M9KR_0 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6877187242705148603', time=2024-09-14T13:29:17.508332+0000, chain.objs.size()=1 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.498__shadow_.HgmJfv3qk3LlQi1N6HcJYZoGNnXx_RJ_0 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16674483470095457269', time=2024-09-14T13:29:17.509001+0000, chain.objs.size()=1 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.498__shadow_.HgmJfv3qk3LlQi1N6HcJYZoGNnXx_RJ_0 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18066314632580116308', time=2024-09-14T13:29:27.556529+0000, chain.objs.size()=1 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.517__shadow_.xJUykIK6mswgIATDVQtE9vS96xC7nbi_0 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13810913692655304284', time=2024-09-14T13:30:29.159693+0000, chain.objs.size()=1 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.554__shadow_.BszJeS4QFefy5IMy5BZNb1Wkn5IMvG9_0 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10771970998708238499', time=2024-09-14T13:30:51.938657+0000, chain.objs.size()=1 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:GwxSqPZtzZWP3t27wFrtuwZfLZcehGq_.SAmXVWdox5aMBtPP_3XvqShiowS7hbL_0 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16426065080183132367', time=2024-09-14T13:30:54.876671+0000, chain.objs.size()=1 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:Id3bGwdllzO5VJh.BWPAyOHRHIKK5sp_.C1uFQPrflu_PGnfyNfpOA_ogh0RAF4x_0 2024-09-14T11:37:46.600 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13145848760396332783', time=2024-09-14T13:31:15.357014+0000, chain.objs.size()=1 2024-09-14T11:37:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:m2TCnfgQxTvaXjeT2VBMKN7DqU1KiIm_.Ium0zqcfQkMFtUwhhE7YeTh1wUxk_Gj_0 2024-09-14T11:37:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1987140851880004536', time=2024-09-14T13:31:18.630172+0000, chain.objs.size()=1 2024-09-14T11:37:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.586__shadow:lLT-3GrIbvKGQ1kZ75BKrizCzEvV8Qa_.YyrgA333pgtyFFbAMsMDZGJQ1zIQWc7_0 2024-09-14T11:37:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4285129555355167792', time=2024-09-14T13:31:37.685378+0000, chain.objs.size()=6 2024-09-14T11:37:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.600+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.615__multipart_multipart_enc.2~OBjKps7QM7ec4DQ4lDcZ_2sBoATKnZV.1 2024-09-14T11:37:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.601+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.615__multipart_multipart_enc.2~OBjKps7QM7ec4DQ4lDcZ_2sBoATKnZV.2 2024-09-14T11:37:46.601 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.602+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.615__multipart_multipart_enc.2~OBjKps7QM7ec4DQ4lDcZ_2sBoATKnZV.3 2024-09-14T11:37:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.615__multipart_multipart_enc.2~OBjKps7QM7ec4DQ4lDcZ_2sBoATKnZV.4 2024-09-14T11:37:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.615__multipart_multipart_enc.2~OBjKps7QM7ec4DQ4lDcZ_2sBoATKnZV.5 2024-09-14T11:37:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.615__multipart_multipart_enc.2~OBjKps7QM7ec4DQ4lDcZ_2sBoATKnZV.6 2024-09-14T11:37:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8454069146306293968', time=2024-09-14T13:33:39.401755+0000, chain.objs.size()=1 2024-09-14T11:37:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.618__shadow_.qSop8bKvvvvJQApTRFTwUNHk-vvXNI7_0 2024-09-14T11:37:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4970672098445023418', time=2024-09-14T13:34:17.731697+0000, chain.objs.size()=1 2024-09-14T11:37:46.603 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.694__shadow:x3.fVlL6eSeoOzIUIFwhOPdisEr7AjJ_.1bmWcdxCTcipLRPQg5Q22z54eeG8LPO_0 2024-09-14T11:37:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12525650651006938947', time=2024-09-14T13:34:18.732588+0000, chain.objs.size()=1 2024-09-14T11:37:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.696__shadow:5MAnoqWNfsTh3nsRBT9hct01yBfbBgQ_.gVbV2woW-f__MA1Xaf5VQ0nFJwwDQp8_0 2024-09-14T11:37:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17357515458453044301', time=2024-09-14T13:34:48.075516+0000, chain.objs.size()=1 2024-09-14T11:37:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.719__shadow_.igN2fKbHa15LbAeThVd-cYxC1BnZap0_0 2024-09-14T11:37:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13088946735097258196', time=2024-09-14T13:37:09.424737+0000, chain.objs.size()=1 2024-09-14T11:37:46.604 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.605+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.782__shadow_.57_r9frg5zAe_aa9GMVjUeyzggEA3rM_0 2024-09-14T11:37:46.606 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.608+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.608 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.610+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-14T11:37:46.609 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.612+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.610 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.612+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44203' 2024-09-14T11:37:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_cuCsPSeAM0fBIEwYQdsuhoA6Qs33a1z', time=2024-09-14T13:24:59.686029+0000, chain.objs.size()=1 2024-09-14T11:37:46.611 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.DV7ITjUg6LN7SQtUEs1_fJUz6hYNF-H_0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3125484718070286290', time=2024-09-14T13:26:41.098244+0000, chain.objs.size()=1 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.237__shadow_.R6Q3pz-X4CEz91gAlS1q4HVR5ppCKli_0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2513252357881714970', time=2024-09-14T13:26:47.855310+0000, chain.objs.size()=1 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.249__shadow_.NwV6A8pHIFm6GazJZHHkExkGflTcDZa_0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10683522640580272705', time=2024-09-14T13:26:49.215827+0000, chain.objs.size()=1 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.252__shadow_.jhDGQrgTf5muRPzdVvc7hu8qCCNR6qk_0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17545193421558875739', time=2024-09-14T13:27:01.195632+0000, chain.objs.size()=1 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tmOp9lQAl-zE6XZfKbgZ7RlIdDMuSdR_0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16889794317971930499', time=2024-09-14T13:27:01.206738+0000, chain.objs.size()=1 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.SM67GCSNPTw6iOZzSoh22isMcqQlqMB_0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10486970788987019593', time=2024-09-14T13:27:01.323852+0000, chain.objs.size()=1 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fUorKJ7z-9iDZfxVEJ8nciIivybtDff_0 2024-09-14T11:37:46.612 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8049633171276119465', time=2024-09-14T13:27:01.447683+0000, chain.objs.size()=1 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ESrCVGGkM-9RPhFkZ18Q0dFVQxuylon_0 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18162050067488193063', time=2024-09-14T13:27:01.469285+0000, chain.objs.size()=1 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UNYP90qTxOv34c3a0mAOvwa2Gsa_Ipu_0 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12883370908357406887', time=2024-09-14T13:27:01.471307+0000, chain.objs.size()=1 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Xo74qvhUxXp9R3cRJzH9EtTV26uFKe2_0 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2585688707816086374', time=2024-09-14T13:27:01.497739+0000, chain.objs.size()=1 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ujBONaHnwrljO0i_Y-j1TAvjFd5S9Ax_0 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11335326308713551035', time=2024-09-14T13:27:01.560526+0000, chain.objs.size()=1 2024-09-14T11:37:46.613 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.613+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZXt2MFPt38JzFr4uCYNEmaFZDEIOIWO_0 2024-09-14T11:37:46.614 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.615+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2497176775084693162', time=2024-09-14T13:27:01.566462+0000, chain.objs.size()=1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.615+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MyO5HYQCgUf8Bm0bnp1-z0iWuupL5Pl_0 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.615+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9635801425186742821', time=2024-09-14T13:27:01.739564+0000, chain.objs.size()=1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.615+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NWSHSZ3J6flZBsw0c-fl1iRZxTn5mrc_0 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8465099460258732758', time=2024-09-14T13:27:01.775542+0000, chain.objs.size()=1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.z3ljfOYCh2H9osLorlZZckcQarRjIyp_0 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2710904515692137104', time=2024-09-14T13:27:01.804876+0000, chain.objs.size()=1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3IYA6dN9hUzxevUU4nFc0Ua1sxVAWfy_0 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.251373773593427009', time=2024-09-14T13:27:01.909491+0000, chain.objs.size()=1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JR4VsJW1-bpKz4Io2j4CfGXua7Erlnl_0 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4066262704428362444', time=2024-09-14T13:27:01.931298+0000, chain.objs.size()=1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.79gxbJnaTpKCUprtnvRp4RR_8Bm6MO9_0 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.792811504994037201', time=2024-09-14T13:27:01.952001+0000, chain.objs.size()=1 2024-09-14T11:37:46.615 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XxndnReNOllyL4Qqug32TOaqjrEfAPm_0 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11456041591299978957', time=2024-09-14T13:27:01.993116+0000, chain.objs.size()=1 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hONXxGX7YaZ3M0TCE27HfyDVwuv0nAk_0 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17802638455960845111', time=2024-09-14T13:27:02.000350+0000, chain.objs.size()=1 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fD0Iuc7KLXRAhbwE9ThlhPn0YTOc-TY_0 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7236047981711260289', time=2024-09-14T13:27:02.001090+0000, chain.objs.size()=1 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CciVhMc3ybFRKaWoPTiTSmNWw8ibO99_0 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8898453925500822439', time=2024-09-14T13:27:02.132491+0000, chain.objs.size()=1 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BuTldbULTAgpCfdNeHr2Lwl8at8Ho1L_0 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11285551047138270506', time=2024-09-14T13:27:02.206395+0000, chain.objs.size()=1 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kbCJ-RjsX5Yf2aNNesLzIuADSQCVFut_0 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14194450324273133165', time=2024-09-14T13:27:02.363517+0000, chain.objs.size()=1 2024-09-14T11:37:46.616 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.616+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.g4xxlj0HMXhdD3Sz_GfUsIHyXknAzBX_0 2024-09-14T11:37:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2822602624265901480', time=2024-09-14T13:27:02.369657+0000, chain.objs.size()=1 2024-09-14T11:37:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yA_tPMogBiqNY_YD_0yaUIXkOqzglBn_0 2024-09-14T11:37:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10085720927234117970', time=2024-09-14T13:27:02.415052+0000, chain.objs.size()=1 2024-09-14T11:37:46.617 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.P10Ur92ScVwg4NnFIhmUkqBjRKgIkX-_0 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16345218523616683302', time=2024-09-14T13:27:02.484374+0000, chain.objs.size()=1 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ArBQJdbkZjWx-aJP_fIVYo4hlpKmo8u_0 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9098353126852893736', time=2024-09-14T13:27:02.721764+0000, chain.objs.size()=1 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.60Tc2BOGJkf2P3uhwEJkPRQFIo4xtcL_0 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6440366733206702974', time=2024-09-14T13:27:02.727865+0000, chain.objs.size()=1 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4nbGG11hqm0-andwod90ZoL5s8PR8eh_0 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13433961417686802116', time=2024-09-14T13:27:02.742275+0000, chain.objs.size()=1 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.RW5LWslbafKgz7mYIMp5COVqlGbOj9i_0 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14076310543275157109', time=2024-09-14T13:27:02.747297+0000, chain.objs.size()=1 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NPKdDeWcQG7NOv3kjGeIiG2yphS7iS2_0 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18151141010001332465', time=2024-09-14T13:27:02.758390+0000, chain.objs.size()=1 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.n2BUoaPhD8VyeO7HWkqwxnpcIdBEpeQ_0 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4924771404432290739', time=2024-09-14T13:27:02.906977+0000, chain.objs.size()=1 2024-09-14T11:37:46.618 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.VtSMq9Wg_Brivy-KMxXzw1ODF38yY4r_0 2024-09-14T11:37:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13914876616266915649', time=2024-09-14T13:27:02.951316+0000, chain.objs.size()=1 2024-09-14T11:37:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Zn_MDV80bDaurVCOYvoe-GGKLe3iBb5_0 2024-09-14T11:37:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2686267705441164057', time=2024-09-14T13:27:06.180944+0000, chain.objs.size()=1 2024-09-14T11:37:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.618+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.269__shadow_.uUQVew5U1bFdlUDel06NywLlaRFZQ9t_0 2024-09-14T11:37:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.619+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9913335956957676115', time=2024-09-14T13:27:09.991665+0000, chain.objs.size()=1 2024-09-14T11:37:46.619 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.619+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.277__shadow_.a7juoKjk4omXBeQhWUir8rqgQ96iR3L_0 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.620+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5866782056050456117', time=2024-09-14T13:27:18.490852+0000, chain.objs.size()=1 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.620+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.A16U2lPPkTsZ29kwpnNhNWVOCJEfZGR_0 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16736958800240500326', time=2024-09-14T13:27:25.054116+0000, chain.objs.size()=1 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.306__shadow_.j43u5TB1l_GUVa_bNsYXH9oq12FwxeV_0 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4782281094321230613', time=2024-09-14T13:27:40.815777+0000, chain.objs.size()=1 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.oUyiFc332dVkFIAqUAPqNDekQbmdKRO_0 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11518323908399307280', time=2024-09-14T13:27:40.820311+0000, chain.objs.size()=1 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xgjb0IX-r8AdSzuPM1v5ojn2_i7xnmY_0 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13111256022079622258', time=2024-09-14T13:27:40.896588+0000, chain.objs.size()=1 2024-09-14T11:37:46.620 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Es1p_Z2jksMZsJLm9lHU-LV4BUbYTSR_0 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1132886638038798840', time=2024-09-14T13:27:40.912060+0000, chain.objs.size()=1 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mupAbatG9vco9SgD2s4uWUi39eEQPXL_0 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1082490237727459885', time=2024-09-14T13:27:41.046511+0000, chain.objs.size()=1 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YORU_FDxUaIyImSh49vrRR5Puf5WPtz_0 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5494990795905952761', time=2024-09-14T13:27:41.106192+0000, chain.objs.size()=1 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tcE_35TeAHCTZtLBfDiQ8ZOOILaSZcZ_0 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6718184307684875733', time=2024-09-14T13:27:41.117817+0000, chain.objs.size()=1 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Y1YIqyFHU-gQW-lpwgcg6Deixp7WQdg_0 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6900434145565346507', time=2024-09-14T13:27:41.118732+0000, chain.objs.size()=1 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.z86PxQeRc-oTakeQ8AegKg0zL6aHyLZ_0 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17507357521615341583', time=2024-09-14T13:27:41.122978+0000, chain.objs.size()=1 2024-09-14T11:37:46.621 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-uscpPCvxXS4uJxg89UZ5LBpj5ROnfX_0 2024-09-14T11:37:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5109963575633593933', time=2024-09-14T13:27:41.174371+0000, chain.objs.size()=1 2024-09-14T11:37:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.621+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.a7BXKwC-DTT5cocZoz-Xikzad28kiPF_0 2024-09-14T11:37:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10831657234722290663', time=2024-09-14T13:27:41.195031+0000, chain.objs.size()=1 2024-09-14T11:37:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1PkFp51bHzBb3PG1W21sGwQAhtEt-yK_0 2024-09-14T11:37:46.622 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2652737395728632540', time=2024-09-14T13:27:41.330939+0000, chain.objs.size()=1 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hG6pDmao_fKS2NLBPDgIgs8uWX8R-DP_0 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10766440478513778342', time=2024-09-14T13:27:41.342283+0000, chain.objs.size()=1 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7K_-yrCB0E6--SHaeqnmjY0SMaCxEHL_0 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17985023101034769313', time=2024-09-14T13:27:41.439317+0000, chain.objs.size()=1 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ocXNK6nVQrlFxtOdu8nkBP_jKkmjLUN_0 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11735774182127228484', time=2024-09-14T13:27:41.466566+0000, chain.objs.size()=1 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HnUmjqntRb1xleZqhYQ6ZNB_FGQMFD1_0 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5249242908707119539', time=2024-09-14T13:27:41.566567+0000, chain.objs.size()=1 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UCd0oyWNUYRR3FQdgjm9HuaIqVs_sGU_0 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11290954007953322916', time=2024-09-14T13:27:41.810868+0000, chain.objs.size()=1 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.623+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Et6LhABdeJQZ_U0Bf7kEeYtXa9iXjD4_0 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7227593201559763354', time=2024-09-14T13:27:41.838586+0000, chain.objs.size()=1 2024-09-14T11:37:46.623 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wWe0qp7CGKd0wNLzf5sPOiqpFCoS_1L_0 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10825411854576985448', time=2024-09-14T13:27:41.890934+0000, chain.objs.size()=1 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FEf2U6nk7pBLM0THsNtd9GSenzOMLN3_0 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17847458729610603548', time=2024-09-14T13:27:41.977609+0000, chain.objs.size()=1 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6JwFBltK016i739mBe7tvUnBFcTbm27_0 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14899374127672487900', time=2024-09-14T13:27:42.063998+0000, chain.objs.size()=1 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1uyiQ3E4onM3Tfhj0AAWbmEj-5SlZaB_0 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8856441588151046323', time=2024-09-14T13:27:42.119070+0000, chain.objs.size()=1 2024-09-14T11:37:46.624 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.624+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BfClc8YJoiJ09e4Wmw2H53LwnCy0cqM_0 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17582049582403173652', time=2024-09-14T13:27:42.178751+0000, chain.objs.size()=1 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2lISqRXfIcF8jFODfF8YPYq1Bomf2ay_0 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10860644215166153370', time=2024-09-14T13:27:42.199388+0000, chain.objs.size()=1 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1rmO_AEMGp3ZtQXW4W-DGKaSih-_eEq_0 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14501667489194739398', time=2024-09-14T13:27:42.201799+0000, chain.objs.size()=1 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MTNxqlMwelWhTUEJHGcG2uOBlu9JX6W_0 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3355803100130933625', time=2024-09-14T13:27:42.225360+0000, chain.objs.size()=1 2024-09-14T11:37:46.625 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YYvHF2Enc7tto9jzyU7IO0PyV6GUbgq_0 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17100830686456480507', time=2024-09-14T13:27:42.403580+0000, chain.objs.size()=1 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.625+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Wq3p0TIfxKmn-YdqQEZMsaGPXKYlXhc_0 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3520404210199937964', time=2024-09-14T13:27:42.582010+0000, chain.objs.size()=1 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.i8DH67QhfWpr8bVzwANShpiQtGokY-u_0 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1025450939904428632', time=2024-09-14T13:27:42.606792+0000, chain.objs.size()=1 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.z3tzOc6xM1opxK7OUCz1rn33fAqunCG_0 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18302431014606663568', time=2024-09-14T13:27:42.633342+0000, chain.objs.size()=1 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JFnTx1aqyY-dakKSuGzvXg4QxdtKFLa_0 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15905546494296544911', time=2024-09-14T13:27:50.450404+0000, chain.objs.size()=1 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.V9u4idlE_0dqjKb89SfCtxWedYpDgn8_0 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3717477803470799203', time=2024-09-14T13:27:50.520585+0000, chain.objs.size()=1 2024-09-14T11:37:46.626 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.626+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.LP5slSmZvrjEhbtxDWBkTrZOc4P7BnL_0 2024-09-14T11:37:46.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.627+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12876912017274563053', time=2024-09-14T13:27:50.583361+0000, chain.objs.size()=1 2024-09-14T11:37:46.627 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.627+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.H4aZ5rkQhtHwl7axn8yzvFaF5SaXF3k_0 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.627+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4844508081071387391', time=2024-09-14T13:27:50.679612+0000, chain.objs.size()=1 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.627+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.IVgNI3E2Kj_VGWT6asZBXCEoobsLIFH_0 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.628+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6860761011739143243', time=2024-09-14T13:27:50.693763+0000, chain.objs.size()=1 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.628+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.luCrzzdGlGbrKwx5pavV4gGBfN0xyYA_0 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.628+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.513761228748267517', time=2024-09-14T13:27:50.792077+0000, chain.objs.size()=1 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.628+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Zsg5l5zTmBxjadYW5YjH05W_gZpuDwA_0 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.628+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1712716858550385340', time=2024-09-14T13:27:50.984368+0000, chain.objs.size()=1 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.628+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jfrGts5lSAoRW_CC--JMnguQM0rEpiG_0 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9165997170611059610', time=2024-09-14T13:27:51.035416+0000, chain.objs.size()=1 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yOYPdqZID4z1TuMLk0dx1xcCTPar4Vz_0 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.412775924037448622', time=2024-09-14T13:27:51.097588+0000, chain.objs.size()=1 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.J02C8QTQTxMiWa6saEL3zUl_gShHqKt_0 2024-09-14T11:37:46.628 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12102665621485346865', time=2024-09-14T13:27:51.198849+0000, chain.objs.size()=1 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0xRw4OXvgN-4Nxkll21gOPmn6oBncxF_0 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8386978975127480395', time=2024-09-14T13:27:51.232610+0000, chain.objs.size()=1 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AV9MMAZciz9ht3mlkMX4vqCUepKT6Ng_0 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1648422129513935340', time=2024-09-14T13:27:51.247925+0000, chain.objs.size()=1 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7Wcv8JYGyVrPBxUw5i8M5wxCXy4IAAC_0 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.407912752493794545', time=2024-09-14T13:27:51.292057+0000, chain.objs.size()=1 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZM2UdsM2gWqovx5IXPv4TZE0GTs1xpS_0 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4819514843727711769', time=2024-09-14T13:27:51.298733+0000, chain.objs.size()=1 2024-09-14T11:37:46.629 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.629+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VzXmAlC7hU0qTPWmXp0W60fNyCpmvr1_0 2024-09-14T11:37:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1527974245093929972', time=2024-09-14T13:27:51.299449+0000, chain.objs.size()=1 2024-09-14T11:37:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1LN0rl2RyhxUMsPS9CgPcs_TPZ7jPCC_0 2024-09-14T11:37:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17915948377442210832', time=2024-09-14T13:27:51.344539+0000, chain.objs.size()=1 2024-09-14T11:37:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cUi1qVA16Gg9V7gmVZTYoPBcbl4bx31_0 2024-09-14T11:37:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9215608174171691075', time=2024-09-14T13:27:51.369703+0000, chain.objs.size()=1 2024-09-14T11:37:46.630 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.C8ULzDlkHQQ0u2tu3L_TAORXLFfe2Lr_0 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10384220157298699842', time=2024-09-14T13:27:51.507458+0000, chain.objs.size()=1 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.S4HUYYkSf38wTPnfQr5yuX-76iJkrPk_0 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11132094914660892439', time=2024-09-14T13:27:51.535022+0000, chain.objs.size()=1 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.630+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.touAw84sOPWZPB0i1bdKAZa83aC8y8P_0 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2292411084300784709', time=2024-09-14T13:27:51.575787+0000, chain.objs.size()=1 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nPEkttDYXvn7kZt4wO2tAzAc13SwZV0_0 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12610987974620969194', time=2024-09-14T13:27:51.577505+0000, chain.objs.size()=1 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.MCweh7gi0dN_HFzY1Pkb4YaSIux2K9h_0 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2927515778173024414', time=2024-09-14T13:27:51.713118+0000, chain.objs.size()=1 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NtjnvTAPmiOf18sjZNQxzhJ-2GlXHAG_0 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11171996718630332049', time=2024-09-14T13:27:51.827177+0000, chain.objs.size()=1 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bXi2vkrpbTNTQAiSmPBUabj3UWdVA4k_0 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9403234451236636516', time=2024-09-14T13:27:52.103918+0000, chain.objs.size()=1 2024-09-14T11:37:46.631 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.WOUA1XIPYl6kfK9yK1aDXFDKDFGKlkg_0 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5285997572237507313', time=2024-09-14T13:27:52.104782+0000, chain.objs.size()=1 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.631+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fux1-evwCta8CXYj_8MiDn3vXb2Efph_0 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.632+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16726815837770292460', time=2024-09-14T13:27:52.244307+0000, chain.objs.size()=1 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.632+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6kyQdTWStM3gHwPMlShcx9lkxlTkGsH_0 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.632+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13360189747675670376', time=2024-09-14T13:27:52.280073+0000, chain.objs.size()=1 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.632+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.y_1NCYibbW4hOYjZskBpdB3SFFJdops_0 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.632+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16736288696346613047', time=2024-09-14T13:27:52.302688+0000, chain.objs.size()=1 2024-09-14T11:37:46.632 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.632+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dO1Zbrx1WMTKf3g0O2t5VcV2k70Bm_H_0 2024-09-14T11:37:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.633+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7828804222200288971', time=2024-09-14T13:27:52.305485+0000, chain.objs.size()=1 2024-09-14T11:37:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.633+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.znlkmyo6X2qjHt7G1OQE1ysrP21hA_W_0 2024-09-14T11:37:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.633+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12326921781566824902', time=2024-09-14T13:27:52.308021+0000, chain.objs.size()=1 2024-09-14T11:37:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.633+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aAc3UuvQAUG5QalFhiFHRGC-ijTMwj8_0 2024-09-14T11:37:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.633+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8150309081301656938', time=2024-09-14T13:28:17.411621+0000, chain.objs.size()=1 2024-09-14T11:37:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.633+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.379__shadow_.ajwAI2FzRUTU9DgOxFjooTWVBRZnM0z_0 2024-09-14T11:37:46.633 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.635+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44203 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=14, truncated=0, next_marker='' 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5564705852593618582', time=2024-09-14T13:29:02.587138+0000, chain.objs.size()=1 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.462__shadow_.I-qMcj9jrsVylLiiNvkbJhS0gqsNSz2_0 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7547694574624991859', time=2024-09-14T13:29:04.286929+0000, chain.objs.size()=1 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.465__shadow_.TGFjoJ9owr6h4btcAInbnqWMeumWCCs_0 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.934962544393496963', time=2024-09-14T13:29:16.165484+0000, chain.objs.size()=1 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.495__shadow_.DudgC6zcgd35BNBOO3o0a_ST93UKmJ9_0 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~UR2pPLEd9kGamZzsbN6K5fFwJKUJEO1', time=2024-09-14T13:29:33.731067+0000, chain.objs.size()=1 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~UR2pPLEd9kGamZzsbN6K5fFwJKUJEO1.1 2024-09-14T11:37:46.635 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7949157472717831988', time=2024-09-14T13:29:42.169699+0000, chain.objs.size()=6 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp.1 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.JnZo2kfyjGYYaJbfo7HgDECa4ZVev2EE.2 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.4lvqxYgiP_69YA2jj1uyesCLXlB4GH5b.3 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp.4 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp.5 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp.6 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18363747343052156207', time=2024-09-14T13:30:09.280709+0000, chain.objs.size()=1 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.536__multipart_mymultipart.2~8lQfyxkBrZtIiCQvhuWth6v3WXrZ7mR.1 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7939961132742357846', time=2024-09-14T13:30:46.261436+0000, chain.objs.size()=1 2024-09-14T11:37:46.636 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.637+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:2LO-qugKEDEhK2Q2MxriJpiytM52JAX_.X4SeWC8xqUPXIyut0yLUCnJa7kbwvFi_0 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7656006854526821196', time=2024-09-14T13:30:48.223153+0000, chain.objs.size()=1 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.570__shadow:XGr0IBpGalPTfsnS1VEoy7JQ8WiG7bw_._XLKrNnsl9vB8qOBkrkyxzW9TMfjcp5_0 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2316963390408932206', time=2024-09-14T13:30:58.490604+0000, chain.objs.size()=1 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:1CoP2GWGq2C3Wco0QzNtohPeXynz59x_.i-f5CdVj9dMdFdy0aNcsvnH83ZY0UZB_0 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2934458423797946452', time=2024-09-14T13:33:59.734459+0000, chain.objs.size()=1 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.654__shadow_.FsjkMH8S3iOs58Mo81KPhnNjhB2pJt4_0 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3882139421512584076', time=2024-09-14T13:34:21.265816+0000, chain.objs.size()=1 2024-09-14T11:37:46.637 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.702__multipart_file1.2~KS1Ujp4UFfGNLoEdmbUpaoAB8CtgOMB.1 2024-09-14T11:37:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2824722795628271050', time=2024-09-14T13:34:24.499625+0000, chain.objs.size()=1 2024-09-14T11:37:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.709__shadow_.aBJwPmr5n7ASBw8ZyYzufdg43Pi_RTX_0 2024-09-14T11:37:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4168294335784963753', time=2024-09-14T13:35:00.974403+0000, chain.objs.size()=1 2024-09-14T11:37:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.744__shadow_.9J1X5bXfNrX9PRSM6CiFChp_70V7d6m_0 2024-09-14T11:37:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2135070273828726068', time=2024-09-14T13:35:15.589866+0000, chain.objs.size()=1 2024-09-14T11:37:46.638 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.639+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.752__shadow_.ml7M4FPb1Yyey0vrQ1GFG785JRs10hg_0 2024-09-14T11:37:46.639 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.641+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.641 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.643+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-14T11:37:46.642 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.644+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.643 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.645+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/52342' 2024-09-14T11:37:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17287937206134236392', time=2024-09-14T13:24:57.099205+0000, chain.objs.size()=2 2024-09-14T11:37:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.wUhdDYL3iSj4nnUjAxynw2FDT7cIb-6_0 2024-09-14T11:37:46.645 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.wUhdDYL3iSj4nnUjAxynw2FDT7cIb-6_1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4524461091307630657', time=2024-09-14T13:25:13.145809+0000, chain.objs.size()=1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.182__shadow_.0lIlccBI3MIYL9KW9sb_Op4p1C-_S_V_0 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3648040248939187301', time=2024-09-14T13:26:47.854517+0000, chain.objs.size()=1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.249__shadow_.aVUYJdivcRZmzG-Zg0TqEBkkX6zS15e_0 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13783104934040029539', time=2024-09-14T13:26:53.211798+0000, chain.objs.size()=1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.260__shadow_.6ocIETnIEB3TlotKrpSdWBhoAoMHAmH_0 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15034696003960980762', time=2024-09-14T13:27:01.196986+0000, chain.objs.size()=1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.8o3K5UiGkEJBKCJEPgPgFDwp3zlYL6__0 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14010306440385509168', time=2024-09-14T13:27:01.240833+0000, chain.objs.size()=1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ojBzQbnnwZeA9wRffm5DpikN6jg1_x6_0 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14465057689602409645', time=2024-09-14T13:27:01.243590+0000, chain.objs.size()=1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JsjT1Xqy8jklpAv-_7v1raX504TMvUb_0 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5030316441020221652', time=2024-09-14T13:27:01.263626+0000, chain.objs.size()=1 2024-09-14T11:37:46.646 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HBTM9JpHPPZupJBM5zgiTJreu9hL2BE_0 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17659086393708265478', time=2024-09-14T13:27:01.499352+0000, chain.objs.size()=1 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eFMx_nxd-jZIP-cCXfdSI-uz82RYjtN_0 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6039016933225220090', time=2024-09-14T13:27:01.510196+0000, chain.objs.size()=1 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7PWX3SN2kaKfop71frDyJ7aEElDcXwj_0 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8427801354558676098', time=2024-09-14T13:27:01.745479+0000, chain.objs.size()=1 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.647+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EZ4E1rv7tx2CGtETAG8etiKKQlJC_S8_0 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1563746712784563271', time=2024-09-14T13:27:01.748516+0000, chain.objs.size()=1 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.z1PlTuARXei35Fg1l4hKSlCcljBJiBh_0 2024-09-14T11:37:46.647 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1472569693335837651', time=2024-09-14T13:27:01.795957+0000, chain.objs.size()=1 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6cvKhbnRWog0CV5c1fldXRyq5097O38_0 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10253494606295071730', time=2024-09-14T13:27:01.807328+0000, chain.objs.size()=1 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.N0S5rD2jg3_Zu7TYIg_zB9yRSgmc50k_0 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17275561285577867396', time=2024-09-14T13:27:01.898904+0000, chain.objs.size()=1 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.649+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._4_n7Sm3q97TeSrO5Dj_dzN5PKu5q1f_0 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7514252241563518393', time=2024-09-14T13:27:01.928795+0000, chain.objs.size()=1 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._uEClIluIHcnuoCvKDVaNpMEGHB976N_0 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6697276204618165517', time=2024-09-14T13:27:01.931434+0000, chain.objs.size()=1 2024-09-14T11:37:46.648 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vdepPAZKXI0MATi9xQmWCuC7LVen2bU_0 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8604865167824872422', time=2024-09-14T13:27:01.990097+0000, chain.objs.size()=1 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bc-HfHVEsJW8u8lKYLF4bsdL_YsPoDG_0 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3384922637187775016', time=2024-09-14T13:27:02.044125+0000, chain.objs.size()=1 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nYnOx1-OwJ-09OJXy3N1J_Rp5JuT2ds_0 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15095812090874217063', time=2024-09-14T13:27:02.136472+0000, chain.objs.size()=1 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.A9HYNONKGibm9jKY6GgFmVlh3bHo4xo_0 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11301153204870393040', time=2024-09-14T13:27:02.197093+0000, chain.objs.size()=1 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LxZ6jHwczg-LBUvxLU3uuDZrIcIEX51_0 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15913125100705668787', time=2024-09-14T13:27:02.370151+0000, chain.objs.size()=1 2024-09-14T11:37:46.649 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.650+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.79Qebw7x9OjM8eWb3ClYSYNFSNAWo7a_0 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.651+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11576549272870114916', time=2024-09-14T13:27:02.373839+0000, chain.objs.size()=1 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.651+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.S1MLJTFHFZJpcgDci2GDmYLrfVWJmxR_0 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.651+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9860846894764770520', time=2024-09-14T13:27:02.488192+0000, chain.objs.size()=1 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.651+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DocUPLo1K2WEkCOGIlxTgoqnOirsbQ8_0 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.651+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11871147456691546642', time=2024-09-14T13:27:02.496740+0000, chain.objs.size()=1 2024-09-14T11:37:46.650 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.651+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4sK0mepS_C4dZ3IOx6bKb2J92_7xcA3_0 2024-09-14T11:37:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.652+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1538308835472077193', time=2024-09-14T13:27:02.604208+0000, chain.objs.size()=1 2024-09-14T11:37:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.652+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3Aw5GXdOKk1yeJ-EZoyNGf85DgqW4ze_0 2024-09-14T11:37:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.652+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10554972756645703783', time=2024-09-14T13:27:02.862567+0000, chain.objs.size()=1 2024-09-14T11:37:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.652+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.COZ7aHRsG0KxDTSfbpHi8iIQ1xBL8FF_0 2024-09-14T11:37:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.652+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1928113436792459589', time=2024-09-14T13:27:02.863560+0000, chain.objs.size()=1 2024-09-14T11:37:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.652+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FvdrBsIzyAIK3uA0XxMkx7c8dv1RQ-2_0 2024-09-14T11:37:46.651 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.652+0000 7f67698de640 0 -- 172.21.15.2:0/3458714241 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f676401d400 msgr2=0x7f663408fa80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4257696478321674026', time=2024-09-14T13:27:02.914991+0000, chain.objs.size()=1 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oy1Ei2TbTiSUuPVW9qb69CcZsrkd4lo_0 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9119380667452298453', time=2024-09-14T13:27:02.952075+0000, chain.objs.size()=1 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pHTEjtF5wojIxBITQ4DgOb-vUppA9ES_0 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7011953429628872314', time=2024-09-14T13:27:02.960793+0000, chain.objs.size()=1 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.f2f6Sp6prz1GkmuCCd2lJnTyi_L6BSV_0 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16803673682830115819', time=2024-09-14T13:27:05.711286+0000, chain.objs.size()=1 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.268__shadow_.PHp7I9VRLhUQHaahZJb2iO1xYg2Fush_0 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3115728120996613078', time=2024-09-14T13:27:13.250279+0000, chain.objs.size()=1 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.284__shadow_.fGPXw_IML4K3zUgn4-FtmluxHKbhqQm_0 2024-09-14T11:37:46.652 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12891818221649828741', time=2024-09-14T13:27:14.734481+0000, chain.objs.size()=1 2024-09-14T11:37:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.287__shadow_.XCIqPxDQIT9-Jha89ExvVf9GBQWZ8Jn_0 2024-09-14T11:37:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9892202319098390933', time=2024-09-14T13:27:18.492587+0000, chain.objs.size()=1 2024-09-14T11:37:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.Eoi5tfHvQ61B1DgoPsMS4nNzcsful-C_0 2024-09-14T11:37:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12217318611225107346', time=2024-09-14T13:27:22.075777+0000, chain.objs.size()=1 2024-09-14T11:37:46.653 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.653+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.300__shadow_.xximsyUkGcjzuap1gBVMJMPFAztDcck_0 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.654+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.537026619439865298', time=2024-09-14T13:27:32.833646+0000, chain.objs.size()=1 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.654+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.322__shadow_.tX45JZHGFjbvPBuypYS_BZMKZiEdP7Y_0 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.654+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7815703449373467108', time=2024-09-14T13:27:40.824048+0000, chain.objs.size()=1 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.654+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bIIwdZoKnluJbvFi-_5FnjZBR_Y2ZYN_0 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1079107144971101968', time=2024-09-14T13:27:40.828418+0000, chain.objs.size()=1 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xMkgdxLyxeg8Bo8jM-vw-2tNE_bKN2r_0 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18430070190844057932', time=2024-09-14T13:27:40.835586+0000, chain.objs.size()=1 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mH-KhVrEWmSBgcdtIjB-mpLwUtAD7YD_0 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15837131119915621891', time=2024-09-14T13:27:40.866899+0000, chain.objs.size()=1 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._qHdCFk_rVmtuNVGcZu6qDBVczubJ-B_0 2024-09-14T11:37:46.654 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1101254576991807067', time=2024-09-14T13:27:40.890596+0000, chain.objs.size()=1 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nFII4EUDoIa6TECqwlF2gzdGYPhMd2X_0 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8685434157810270784', time=2024-09-14T13:27:40.906500+0000, chain.objs.size()=1 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0ux3xsElbzc71Rd4jVWk-ipN9mWrpVH_0 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6426193575963601995', time=2024-09-14T13:27:40.920573+0000, chain.objs.size()=1 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._QzYEH99o-OuvdDPXLT7k2yHTWeJlnN_0 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6076896755995519455', time=2024-09-14T13:27:41.082276+0000, chain.objs.size()=1 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.A5quarIJcYv6S_ikFcAqIimPb-7qNGB_0 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4169250065829118650', time=2024-09-14T13:27:41.129020+0000, chain.objs.size()=1 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1QniAAmUOgdig4PMwFbJB-DySrpXtVK_0 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7509665837730763309', time=2024-09-14T13:27:41.146427+0000, chain.objs.size()=1 2024-09-14T11:37:46.655 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.655+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.M01WgkMJask9Xr1VQG0rhpf0ZxCC653_0 2024-09-14T11:37:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10141599359327205601', time=2024-09-14T13:27:41.468759+0000, chain.objs.size()=1 2024-09-14T11:37:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7Mo9VD7n6wrQHLfsEf9mrsBMYwwTGEh_0 2024-09-14T11:37:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7746952304706698920', time=2024-09-14T13:27:41.572258+0000, chain.objs.size()=1 2024-09-14T11:37:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.V_M892D3XuI6pdW4kR8X2QW1PO0r2YS_0 2024-09-14T11:37:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11793328701816475750', time=2024-09-14T13:27:41.586808+0000, chain.objs.size()=1 2024-09-14T11:37:46.656 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dw5kl7pEnU4QPXSinq8qQbejpzeMMLc_0 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9744321638967451142', time=2024-09-14T13:27:41.608319+0000, chain.objs.size()=1 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.656+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.TjE7PoPE81MpiHQZWdIt3AV-2jC8LaE_0 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6903367128669206565', time=2024-09-14T13:27:41.624938+0000, chain.objs.size()=1 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.pAYA3tu_mAJI7oN7UTMjuswQMjh-ZkI_0 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3337106037760761221', time=2024-09-14T13:27:41.664257+0000, chain.objs.size()=1 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.v8QiTAJDhbmcch2d3M3YirOMd5wp_T-_0 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3237379539833062725', time=2024-09-14T13:27:41.718001+0000, chain.objs.size()=1 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uhEztHzptKqOHG_UWwIVV831RAe29rH_0 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14504570594124796867', time=2024-09-14T13:27:41.816153+0000, chain.objs.size()=1 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UD5ITLRnNi2sySthpG9fYcaK9LwsoKS_0 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7606330584132422155', time=2024-09-14T13:27:41.817354+0000, chain.objs.size()=1 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ddPQlGls5FqKaocLcLUDtMEPpaupzdK_0 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10765613611381806163', time=2024-09-14T13:27:41.884407+0000, chain.objs.size()=1 2024-09-14T11:37:46.657 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ls6zWlHNZd0hMAtOZKUWvRXTgDhqCHC_0 2024-09-14T11:37:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12513975240803388063', time=2024-09-14T13:27:41.896198+0000, chain.objs.size()=1 2024-09-14T11:37:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.657+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4uLXEOKLp1Hvh3K6XhnP9YdRuHYN4I2_0 2024-09-14T11:37:46.658 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.658+0000 7f67690dd640 0 -- 172.21.15.2:0/3458714241 >> [v2:172.21.15.2:6824/3479486070,v1:172.21.15.2:6825/3479486070] conn(0x7f6760040020 msgr2=0x7f663408cc20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4754448178473376877', time=2024-09-14T13:27:41.896834+0000, chain.objs.size()=1 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.g78O4LWhwu-iMzyWcUXtK_5OaSe3b78_0 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.502784355344601632', time=2024-09-14T13:27:41.932089+0000, chain.objs.size()=1 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1rRSUWe8LOmK4lJBaREMwpjZo6F-Xjj_0 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17534193533392855053', time=2024-09-14T13:27:41.940265+0000, chain.objs.size()=1 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UiG6ZFbwoa_3kMfaXCTIB7Rtj36oyPR_0 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9233591894873855499', time=2024-09-14T13:27:41.960691+0000, chain.objs.size()=1 2024-09-14T11:37:46.659 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Dz_jQXTRnKMfgObkYf9f-5w75pm_05u_0 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6989217629729021569', time=2024-09-14T13:27:42.322326+0000, chain.objs.size()=1 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mUDLOHoiHDoDyVA9oUiipejFlTeSSnY_0 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1588350004848465894', time=2024-09-14T13:27:42.324800+0000, chain.objs.size()=1 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BJKKpHIWqSdCZnEPdkxkfDEaLaxYhLo_0 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4074492102259799770', time=2024-09-14T13:27:42.448002+0000, chain.objs.size()=1 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xL9aYlLTRABL3Kcby-00_62YfYEj0Hv_0 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8682642697133763879', time=2024-09-14T13:27:42.585565+0000, chain.objs.size()=1 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uD-6woRXJCB1LOT7cP2v10q8VhLcIHM_0 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17637305542162421544', time=2024-09-14T13:27:42.669064+0000, chain.objs.size()=1 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5uFF2gwEtbErtMCFEKJo2nkM1WwA0py_0 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14988499906228401150', time=2024-09-14T13:27:42.677025+0000, chain.objs.size()=1 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tm7I3hqL5-ZYpBFq_aTS_andhlpjjJI_0 2024-09-14T11:37:46.660 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3455319437221783376', time=2024-09-14T13:27:42.706836+0000, chain.objs.size()=1 2024-09-14T11:37:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.659+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OsK80oCe2qLxXNU1Ez0dR1na_7_rc0a_0 2024-09-14T11:37:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.660+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14429669798440433651', time=2024-09-14T13:27:50.443023+0000, chain.objs.size()=1 2024-09-14T11:37:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.660+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3SfjJrYF3yRcEyXRcqWuJPS11oYktd1_0 2024-09-14T11:37:46.661 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.661+0000 7f67698de640 0 -- 172.21.15.2:0/3458714241 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f6634092a60 msgr2=0x7f6634094e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.661+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1337923068499834715', time=2024-09-14T13:27:50.455288+0000, chain.objs.size()=1 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.661+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EJilE-dSi8x5p_fdev59I0jVSKhZPW2_0 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.661+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7841969688478257459', time=2024-09-14T13:27:50.475014+0000, chain.objs.size()=1 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.661+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rXlS76vad0QQAu02qM1pFMcUsqiI8G4_0 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.661+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1214077514090413272', time=2024-09-14T13:27:50.506294+0000, chain.objs.size()=1 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.661+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bdA-_fsTgdXcUgYD3py-8o-4s1Pz3OY_0 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1732886350311240318', time=2024-09-14T13:27:50.524195+0000, chain.objs.size()=1 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8MVtTfJ0VPJGN1_kS7dkfSupwf4mD3u_0 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17645803560088039181', time=2024-09-14T13:27:50.574989+0000, chain.objs.size()=1 2024-09-14T11:37:46.662 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.M5gFRtzepEJKAHUnlP7JNe6a-tyJQDx_0 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16843237440163246887', time=2024-09-14T13:27:50.711328+0000, chain.objs.size()=1 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.KO1PVRlB68q-V7fDbVr03fXeqt86vxK_0 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8591778562058555806', time=2024-09-14T13:27:50.817628+0000, chain.objs.size()=1 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UANonmaib9Bhfp3cjfvV2-nM1wxqPx9_0 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11799779170402542918', time=2024-09-14T13:27:50.823135+0000, chain.objs.size()=1 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DGzVlcXRWe8T83veDdF-cJVGzNX-hAv_0 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14020000055565913602', time=2024-09-14T13:27:50.937125+0000, chain.objs.size()=1 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iMV3DYrYeHsvpA6D31KnhMNBvHnHav1_0 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6871652807617362627', time=2024-09-14T13:27:51.075047+0000, chain.objs.size()=1 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1I2ZvtEpioc-Wq_NZUS6ffKpFey0_l7_0 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8498264503766697152', time=2024-09-14T13:27:51.283506+0000, chain.objs.size()=1 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.662+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wG6T9C2tbTn1X6naAxvzxSUCQIcs9hc_0 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11166010638427241125', time=2024-09-14T13:27:51.503520+0000, chain.objs.size()=1 2024-09-14T11:37:46.663 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jnu4-7OuLglxuBCgIp0boG9H1CnaTYe_0 2024-09-14T11:37:46.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5206555225414833565', time=2024-09-14T13:27:51.594269+0000, chain.objs.size()=1 2024-09-14T11:37:46.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.s5kUNxyjTrl7fseiTcW0W4gMPQwgPkP_0 2024-09-14T11:37:46.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5508363725760184220', time=2024-09-14T13:27:51.713478+0000, chain.objs.size()=1 2024-09-14T11:37:46.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VVq0FTnIH15j0HwpEjnAUBJ6xuTHjIh_0 2024-09-14T11:37:46.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18031086947099434567', time=2024-09-14T13:27:51.760691+0000, chain.objs.size()=1 2024-09-14T11:37:46.664 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.663+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4oWY1mC986BDpfc3MjwwvH7v6ndBnL0_0 2024-09-14T11:37:46.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10541540334586406059', time=2024-09-14T13:27:51.818963+0000, chain.objs.size()=1 2024-09-14T11:37:46.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ke6GatQ2JkWgzD_Ltg2vcpvS3R3e8Hq_0 2024-09-14T11:37:46.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17249432703399631604', time=2024-09-14T13:27:51.840871+0000, chain.objs.size()=1 2024-09-14T11:37:46.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zOndxPBV9mQft45F8GNbwghUkOP9R5Q_0 2024-09-14T11:37:46.665 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.503778278684313134', time=2024-09-14T13:27:51.858638+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BgIOaoHMFq1m7kNFHdG7shl29BgSDeO_0 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13061121842311096868', time=2024-09-14T13:27:51.875082+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.F4NRQxJ6SuHJT9TWh87140JkyFbK4Xd_0 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12575051736398272856', time=2024-09-14T13:27:52.002586+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.OQEcePCz70EfCwfz2Wbh01y-63WA3b3_0 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15316719516059101536', time=2024-09-14T13:27:52.028968+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UCYNgc23RRemZ3jts5a3ltAcxfCWiO__0 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7804185171778062234', time=2024-09-14T13:27:52.091905+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.664+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gizWZABNUBCBpvpJaaIcJGZQ8pmFANd_0 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.665+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14157896533640134911', time=2024-09-14T13:27:52.123466+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.665+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.XsGVhBjOO9zJP-edRBmq8og7hQYwoMy_0 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.665+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8789696460165050778', time=2024-09-14T13:27:52.255335+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.665+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VaZhaUei-PtbfoAhUhMK4IfC1g1ELLw_0 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.65872970069486402', time=2024-09-14T13:27:52.265397+0000, chain.objs.size()=1 2024-09-14T11:37:46.666 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Fs0HpH7AyE9opGWy9H55ujIN6l3Ud-n_0 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4277841447774856197', time=2024-09-14T13:27:52.271546+0000, chain.objs.size()=1 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tKtogPimhevvY0fQh_2Ky-bTFTkgw81_0 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5099121728468427682', time=2024-09-14T13:27:52.336667+0000, chain.objs.size()=1 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.y8xvGS9Sf34a7U4VbDrhpC6SvQe-ek6_0 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16191163577817939391', time=2024-09-14T13:27:53.142347+0000, chain.objs.size()=1 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.326__shadow_.Sbj0UUNMrYk41I6dG_rsVMw6zcI8ioq_0 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13614448183465264490', time=2024-09-14T13:27:55.330456+0000, chain.objs.size()=1 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.331__shadow_.U4mRujVZriyv0k8C1q7M1FKVHrZ1l3T_0 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9519549264874547806', time=2024-09-14T13:27:55.667595+0000, chain.objs.size()=1 2024-09-14T11:37:46.667 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.666+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.332__shadow_.IYCJhzmpoqf3f7E1OKoQi-3nO3DquKQ_0 2024-09-14T11:37:46.668 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.668+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/52342 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18250466159421852532', time=2024-09-14T13:27:59.288607+0000, chain.objs.size()=1 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.340__shadow_.lJme85lwyR9R0oTRDFw2Ytp-IaY5NZr_0 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16513896774965983787', time=2024-09-14T13:28:11.448191+0000, chain.objs.size()=1 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.369__shadow_.hWPxbtMsb5XnBeOG0yQiwpnkPUM1U76_0 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13467266020806705621', time=2024-09-14T13:28:18.469378+0000, chain.objs.size()=1 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.381__shadow_.mQGa60QRLBFLfnhIiCIiUZHcWJq9rag_0 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17706482287059000696', time=2024-09-14T13:28:22.883416+0000, chain.objs.size()=1 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.390__shadow_.A-EHnn_QLl1AG47ecipKsRbdFDE5eo2_0 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18394653091528403879', time=2024-09-14T13:29:10.596549+0000, chain.objs.size()=1 2024-09-14T11:37:46.669 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_._4m8M_gsPYqbGwt6sXkVwT9IFAgsdrK_0 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6025532335494916278', time=2024-09-14T13:29:10.601550+0000, chain.objs.size()=1 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.zoel87_PKiEYmiF5MkW51_eKyo_BCsh_0 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15061766104025373497', time=2024-09-14T13:29:25.599793+0000, chain.objs.size()=1 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.515__shadow_.R3FadJo4Z0AkOs_ulCsWnddQbQ7wh5V_0 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10708593980367923484', time=2024-09-14T13:29:27.308609+0000, chain.objs.size()=1 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.518__multipart_mymultipart.2~uR6iACxNmxRlmSsHwu34nO5_caTMGSD.1 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12080111313291297315', time=2024-09-14T13:29:32.050759+0000, chain.objs.size()=3 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~z1wqRE2Py_3BCIfV2m76Fk4EvbOXvYG.1 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~z1wqRE2Py_3BCIfV2m76Fk4EvbOXvYG.2 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~z1wqRE2Py_3BCIfV2m76Fk4EvbOXvYG.3 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3618891271798618927', time=2024-09-14T13:29:44.324601+0000, chain.objs.size()=2 2024-09-14T11:37:46.670 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.670+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~G-tl2xuWrpdJL7cyBnajfeSB2V9vx9B.1 2024-09-14T11:37:46.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~G-tl2xuWrpdJL7cyBnajfeSB2V9vx9B.2 2024-09-14T11:37:46.671 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18271283751786953351', time=2024-09-14T13:29:44.965664+0000, chain.objs.size()=2 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~sV2IwSIE7oAw8qkA-QVgmwANjKb3IEQ.1 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~sV2IwSIE7oAw8qkA-QVgmwANjKb3IEQ.2 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14628624784645762231', time=2024-09-14T13:30:27.910202+0000, chain.objs.size()=1 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.552__shadow_.xRQTlssW0Swqi34Y-gG4EsEKiYR4goK_0 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8991248072920787385', time=2024-09-14T13:31:04.917087+0000, chain.objs.size()=1 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:u7glcyJnPUSTXf.ibUxlSn.bM9-kw.2_.oH8a_mvcmFpLCoA4B4j4QdShqsEo85d_0 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5881253451713968377', time=2024-09-14T13:31:08.486761+0000, chain.objs.size()=1 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:L.e0GMctXon4kkPf5kuPLcsRZwbPONL_.rPLkvMgTAXe4bWXy50VLH-7PU6i3K2c_0 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12010542754789534248', time=2024-09-14T13:31:27.385458+0000, chain.objs.size()=1 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.606__shadow_.CletFDHmQCLKmxNYx9oC0QDfO-9O4oo_0 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7627516880850332156', time=2024-09-14T13:33:55.824214+0000, chain.objs.size()=1 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.647__shadow_.WJiyPfRi46AFiHo64Wr_zDpZyRGKvvl_0 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12419225349688272010', time=2024-09-14T13:33:57.680038+0000, chain.objs.size()=1 2024-09-14T11:37:46.672 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.650__shadow_.lpkM3iWncUY5sjgot2qraFvog7xu_vZ_0 2024-09-14T11:37:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12090605709915654531', time=2024-09-14T13:34:05.253587+0000, chain.objs.size()=1 2024-09-14T11:37:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.664__shadow_.zkBBymnnsPNiJcDgxKeXCqZ4rFD1Mxm_0 2024-09-14T11:37:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16469787534421263162', time=2024-09-14T13:34:16.486836+0000, chain.objs.size()=1 2024-09-14T11:37:46.673 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.672+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.691__shadow_.sK-h4zs-nJFj3iZ8djQPBBbcCdfE_RN_0 2024-09-14T11:37:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.676+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15911758631134837686', time=2024-09-14T13:35:11.994070+0000, chain.objs.size()=1 2024-09-14T11:37:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.676+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.746__shadow_.5ZVi2EUB6hjs_0yWbaVqx91QNmhMCDB_0 2024-09-14T11:37:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.676+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1994969727991921032', time=2024-09-14T13:35:18.509123+0000, chain.objs.size()=1 2024-09-14T11:37:46.674 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.676+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.756__shadow_.ojCow62zDL3CJIGDKBHb7OeFYWf0obh_0 2024-09-14T11:37:46.675 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.677+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.677 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.679+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-14T11:37:46.678 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.680+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.679 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.681+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.682+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/45151' 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5755447605203419567', time=2024-09-14T13:24:55.314568+0000, chain.objs.size()=1 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.157__shadow:LkjRt41f1cQ4-TlLfztk.7zAqvoaGol_.aN1TKGkwWtPZFsrBG4KORsHipyxmQSH_0 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17829049129503939', time=2024-09-14T13:26:39.790040+0000, chain.objs.size()=1 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.235__shadow_.TfCJu4W2RHvzTOex454er7geYu0Vs3n_0 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7361376267071054153', time=2024-09-14T13:26:43.306200+0000, chain.objs.size()=1 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.241__shadow_.bsbbcvb9NxQ9g64QD6cdQHqragG5xMM_0 2024-09-14T11:37:46.681 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8250005406847990784', time=2024-09-14T13:26:49.704596+0000, chain.objs.size()=1 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.253__shadow_.yVDs11bXaWcC0VoU5qRVbSF8YfQK_T__0 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8947475843917156956', time=2024-09-14T13:26:50.835893+0000, chain.objs.size()=1 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.255__shadow_.QrS6-aucaIhPAwZ_6lODOYQnd-1uwBF_0 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15168103950535609268', time=2024-09-14T13:26:50.836613+0000, chain.objs.size()=1 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.255__shadow_.yMskTQe9mCq692iU1z_u9rW6W6YTkZr_0 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16303858792327103421', time=2024-09-14T13:26:51.335841+0000, chain.objs.size()=1 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.256__shadow_.t-BXVVCYUgDHIs64pbuitb2Nv-kksCC_0 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7419328993474317109', time=2024-09-14T13:26:52.270361+0000, chain.objs.size()=1 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.258__shadow_.wG8v6ftq5jPgjDGmno5GuZhNrrx3Gow_0 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5092029071346844976', time=2024-09-14T13:27:01.179119+0000, chain.objs.size()=1 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HnIRcAn0syYUongP7d2VHlRlPv-V6qR_0 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10826958538090848209', time=2024-09-14T13:27:01.254205+0000, chain.objs.size()=1 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0a6aEjaiIUazYPnhjH8Zu5RabqbjGvs_0 2024-09-14T11:37:46.682 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16657550912210112222', time=2024-09-14T13:27:01.276059+0000, chain.objs.size()=1 2024-09-14T11:37:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.22EO507NMV_88s0AtgELltJ-g6R3oFl_0 2024-09-14T11:37:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15190019491162381715', time=2024-09-14T13:27:01.465368+0000, chain.objs.size()=1 2024-09-14T11:37:46.683 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.683+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aj3ZSImg1vpzgNI2yCbxePAsmqmTYp7_0 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.684+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16230410754929256493', time=2024-09-14T13:27:01.502707+0000, chain.objs.size()=1 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.684+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.RnFCMVpE8T6XjMYup7FkKyINM4Tn1WF_0 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5946190405793441616', time=2024-09-14T13:27:01.504032+0000, chain.objs.size()=1 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OIQ_Wvu5Mm71UzSvXY2p5sftvBgcFxe_0 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5252323472337127469', time=2024-09-14T13:27:01.647634+0000, chain.objs.size()=1 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.f7yscWJBplZOWtHMO0YxR2sHXoR3bFV_0 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.142207701198928973', time=2024-09-14T13:27:01.648525+0000, chain.objs.size()=1 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NGKXeasiJxajRpOchGw7rQDMr6T1gc9_0 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15945042637577896468', time=2024-09-14T13:27:01.691937+0000, chain.objs.size()=1 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.W-bZVEowNdv61KCH1nQqQ1ZfAkygkqn_0 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17313371641003513117', time=2024-09-14T13:27:01.743088+0000, chain.objs.size()=1 2024-09-14T11:37:46.684 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kh5R0ORr5Jgiaf90K_lZttNMku5d2aE_0 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8923073287310614861', time=2024-09-14T13:27:01.911753+0000, chain.objs.size()=1 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.w-G-oEVEhd_j8qSadd2uYexEMkIiQvv_0 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14849978215609745268', time=2024-09-14T13:27:01.948929+0000, chain.objs.size()=1 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.THcKt5monD6u2PSPEf4S40hTex_-wbh_0 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7316059094028927893', time=2024-09-14T13:27:01.953893+0000, chain.objs.size()=1 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.l0KBRyVdrNCpDwg1F8qQWMDB0V8LTJx_0 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18306134220223047024', time=2024-09-14T13:27:02.029730+0000, chain.objs.size()=1 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FDT-DMdHvD_uapSHBw1aVwERZmYmSLM_0 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15668465916779057028', time=2024-09-14T13:27:02.032597+0000, chain.objs.size()=1 2024-09-14T11:37:46.685 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.685+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.dDp7WnzyJKuO5ZvX6DA1wHsE-XB3Egh_0 2024-09-14T11:37:46.686 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.686+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5612483612327422613', time=2024-09-14T13:27:02.033153+0000, chain.objs.size()=1 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.686+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5Lk0X2ODJc4seUaAg0QCeMzAFlMW3tL_0 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.686+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16114695759642906245', time=2024-09-14T13:27:02.044859+0000, chain.objs.size()=1 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.686+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.04IQCe8aCPBgxjUJkpB34353M8mqKdh_0 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8298351133206636961', time=2024-09-14T13:27:02.150191+0000, chain.objs.size()=1 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.t7Ifmcm4Kcf7j-T7vKS2-lSjhlKg_aU_0 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4682994924181432949', time=2024-09-14T13:27:02.184671+0000, chain.objs.size()=1 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._fdwlMn_VfhkbeSVK12M8umnyfB6_1M_0 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17194653703491028624', time=2024-09-14T13:27:02.362128+0000, chain.objs.size()=1 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7eWfdCWuQAOmP-Q92BjdOhtmGSzyKBv_0 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.107984491875184776', time=2024-09-14T13:27:02.369875+0000, chain.objs.size()=1 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UR9mdOs6Rbtbv8dNv9ps1SdQNYQFm_f_0 2024-09-14T11:37:46.687 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9665294962332493686', time=2024-09-14T13:27:02.376527+0000, chain.objs.size()=1 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.AOfE9_6OFAI1i5decoUIheGaIOiidIF_0 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13412249928258089629', time=2024-09-14T13:27:02.377658+0000, chain.objs.size()=1 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Tbqy_2RMLwl_jMr5tDV5pUcqBl-bZ7D_0 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15113756267503023138', time=2024-09-14T13:27:02.407556+0000, chain.objs.size()=1 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.687+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UgjxhIHf7lJFkqEZ4jiJP2vCXF79wmr_0 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10521845992333330920', time=2024-09-14T13:27:02.480767+0000, chain.objs.size()=1 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.J37pK5niPgPfAHnE2ASWVjZ6XltvsaB_0 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18318663861009359019', time=2024-09-14T13:27:02.510293+0000, chain.objs.size()=1 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.l0B-faeBkv5DENfJ8hDnvbb0KlCkaX6_0 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4122709247028805766', time=2024-09-14T13:27:02.598518+0000, chain.objs.size()=1 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.op_kSMbRn2EUxPiAiGedYrNRah0iMaD_0 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5588321861389193573', time=2024-09-14T13:27:02.682887+0000, chain.objs.size()=1 2024-09-14T11:37:46.688 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.688+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XQxkRg1sImYmXnUNtbM5pYZuz9LFXip_0 2024-09-14T11:37:46.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14048878134114304226', time=2024-09-14T13:27:02.711617+0000, chain.objs.size()=1 2024-09-14T11:37:46.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FTGg0Qx2aC7Aex8yj5v2qWU0xVO1Zv7_0 2024-09-14T11:37:46.690 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12427777607032831068', time=2024-09-14T13:27:02.729118+0000, chain.objs.size()=1 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Z0fc5mZH8EMF7rCEHBWTQe835clMk4X_0 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15284535983338247110', time=2024-09-14T13:27:02.747098+0000, chain.objs.size()=1 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qlEhUPJgwkIrXbgZvkxCRRL32w3Azc5_0 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1115302159145902065', time=2024-09-14T13:27:02.830489+0000, chain.objs.size()=1 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.689+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nxqAOORC1u6bPPisCn6nq_llCV69xFd_0 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9893108933659685267', time=2024-09-14T13:27:02.847907+0000, chain.objs.size()=1 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.cC3hwh6qheOPyR_PkvBGhzSjvslnOM2_0 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.580285617310182839', time=2024-09-14T13:27:02.887340+0000, chain.objs.size()=1 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.I0AiAgd3x_nwyLQtcX6CM7jpgTFldwC_0 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11125431089757285656', time=2024-09-14T13:27:02.892840+0000, chain.objs.size()=1 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gQsWoAAmqrInBlz7wiS_GbhUE9mLh9e_0 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2357261966562084902', time=2024-09-14T13:27:02.895438+0000, chain.objs.size()=1 2024-09-14T11:37:46.691 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MpFgVsUBOAZ4UxLxqi8r1GkF4BL_yLE_0 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11143523291444816568', time=2024-09-14T13:27:02.917140+0000, chain.objs.size()=1 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qdH7oI3HdHIEkvOTBicnkK-tWh-aysj_0 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.883457481940709557', time=2024-09-14T13:27:12.765977+0000, chain.objs.size()=1 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.283__shadow_.XDgYtJkh13bE6JpvXqKAiBb_mITuIZa_0 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8296311467341266261', time=2024-09-14T13:27:15.209653+0000, chain.objs.size()=1 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.690+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.288__shadow_.FJpgOM--8gfZdoSgG2lKPKu8GCHhcU9_0 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.691+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11206880368095925025', time=2024-09-14T13:27:18.973221+0000, chain.objs.size()=1 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.691+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.294__shadow_.6Zz2t3ItDX1KfombfXqRkKd-mqAPeTt_0 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.691+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12100000655028023019', time=2024-09-14T13:27:31.733085+0000, chain.objs.size()=1 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.691+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.319__shadow:ZX-NOfzwP5XVzjWUGpNCMJmXLxhDvjJ_.b0kNE-3mdW_SuitySrP7Xywh0ZQYyXv_0 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.691+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9639993247286230073', time=2024-09-14T13:27:40.803118+0000, chain.objs.size()=1 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.691+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9MXaayd15n6CHXbf5emDMGp6phulm2t_0 2024-09-14T11:37:46.692 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9223883118340252885', time=2024-09-14T13:27:40.866746+0000, chain.objs.size()=1 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.22Ug2s5VN3HkuHsx56oPEI6dzm31YEh_0 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11664304606831841756', time=2024-09-14T13:27:40.868756+0000, chain.objs.size()=1 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8xoe2XD9GOgymFrekz8n03u7bXN-40U_0 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2016437282844160443', time=2024-09-14T13:27:41.061661+0000, chain.objs.size()=1 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LEsS2Jx8_HlsdFM5zUTLiQpmL63WRv5_0 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18406239751980733632', time=2024-09-14T13:27:41.081595+0000, chain.objs.size()=1 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xgLKzWDXBHNCRVG9sHJpI141v9I96_B_0 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16453752352550263643', time=2024-09-14T13:27:41.142510+0000, chain.objs.size()=1 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.i2KMuC9rHLc3vyD5nt8oMy341IdITUx_0 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9372120865519047051', time=2024-09-14T13:27:41.158877+0000, chain.objs.size()=1 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1C4hm8MV8Q-TT7P3KixKmMpgQyVU6Jh_0 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6528671305441838153', time=2024-09-14T13:27:41.354020+0000, chain.objs.size()=1 2024-09-14T11:37:46.693 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uEADmzdPlf9U3WsVtMnKgwaSvFJyvCv_0 2024-09-14T11:37:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11780377631246232517', time=2024-09-14T13:27:41.394721+0000, chain.objs.size()=1 2024-09-14T11:37:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.E4OdzjTwwhcDCYp7TxKFjIlQnUbxKoJ_0 2024-09-14T11:37:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1231855609476668880', time=2024-09-14T13:27:41.433705+0000, chain.objs.size()=1 2024-09-14T11:37:46.694 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.692+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OHtTxqyop-BR_SONLZanTyYIsbKB7jB_0 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.693+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.846842955699899557', time=2024-09-14T13:27:41.445094+0000, chain.objs.size()=1 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.693+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EnPkRo6425CSAGIqbVNaSKxQU4BaSHT_0 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.693+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8503545261068454791', time=2024-09-14T13:27:41.564784+0000, chain.objs.size()=1 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.694+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BU7V3Fl_8Qtgu0qqbtwZtFTR3BOncJz_0 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.694+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13351224886774041910', time=2024-09-14T13:27:41.595808+0000, chain.objs.size()=1 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.694+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cZRevZ9-5WeselyJ-LZDdKFjOS_NflS_0 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.694+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6313279327145734230', time=2024-09-14T13:27:41.643291+0000, chain.objs.size()=1 2024-09-14T11:37:46.695 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.694+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.slHx9Y_Jx3NyX_qwLiKH1zDxgFrnI1G_0 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.694+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5231069151394885046', time=2024-09-14T13:27:41.978190+0000, chain.objs.size()=1 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.onDcqddDaKhPd_7kB72eOl7bs4ao0k-_0 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5409320573214166201', time=2024-09-14T13:27:41.979488+0000, chain.objs.size()=1 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._qtuAMYDRTu0LeavhWdhdned2hCF9jF_0 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5788356763294889940', time=2024-09-14T13:27:42.192671+0000, chain.objs.size()=1 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ARvAygXLAWwWqxYUV4GbAolLAWtQrge_0 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10403553543380633835', time=2024-09-14T13:27:42.319726+0000, chain.objs.size()=1 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4q4U2FHutNzgDDe7lUmr7KcYSvCIUWN_0 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6187410030586784276', time=2024-09-14T13:27:42.329638+0000, chain.objs.size()=1 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jFFidYCWK6AqnhBLGF_dqkLB9aetohY_0 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15687458563259080805', time=2024-09-14T13:27:42.339320+0000, chain.objs.size()=1 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jYPgO9bwgqJUGSMc69Sw98nxAvm73GR_0 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2131638134309522084', time=2024-09-14T13:27:42.353145+0000, chain.objs.size()=1 2024-09-14T11:37:46.696 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.irB-PU3eOb3KJ1H8iNFuzVnIrcqBYHG_0 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6373722578544507036', time=2024-09-14T13:27:42.446082+0000, chain.objs.size()=1 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.coPwm171CuL4xI2cbXt1lr01PHKMNXk_0 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10967364497147077999', time=2024-09-14T13:27:42.452319+0000, chain.objs.size()=1 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.695+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xBh3t4U7d7v0G7riDza6WG4CxE4r9ir_0 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.696+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12993538433228221449', time=2024-09-14T13:27:42.479074+0000, chain.objs.size()=1 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.696+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.a1uyoa_UPTp6WZJI7dASPTnDJjNB8y9_0 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.696+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2230361867638144077', time=2024-09-14T13:27:42.604630+0000, chain.objs.size()=1 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.696+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._m_8T932IReCz_UJDT8oD00ErzL-VqY_0 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.696+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18018865416793133100', time=2024-09-14T13:27:42.615934+0000, chain.objs.size()=1 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.696+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.w538pdfcnRpuzky6IdMKuxAUfNqXBRr_0 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16267113753893745993', time=2024-09-14T13:27:42.685340+0000, chain.objs.size()=1 2024-09-14T11:37:46.697 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.93qlY7EZog2_tAg7u1MwQdyrffAk4d7_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7917721248679650644', time=2024-09-14T13:27:50.489448+0000, chain.objs.size()=1 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7Z7p-9nJRoWjZN9ZG4u6MbSpBGNSC4V_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8813884891648907890', time=2024-09-14T13:27:50.527979+0000, chain.objs.size()=1 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.61tAQDCHtzyV4yHuAqHCv5w32p1lPOP_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3972601419947930663', time=2024-09-14T13:27:50.533164+0000, chain.objs.size()=1 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8q59-0-wYPXxJRvlUGDwUQAFw0QHMt3_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12842110844711367995', time=2024-09-14T13:27:50.582547+0000, chain.objs.size()=1 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0L70pmLY8Eut1pRuo42PQjmUUxbu3PR_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12252456799624410312', time=2024-09-14T13:27:50.688621+0000, chain.objs.size()=1 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3br-DKcY5iWPU1eZOc6ACw_aLlE_uQ6_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13506163041526642908', time=2024-09-14T13:27:50.771239+0000, chain.objs.size()=1 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8X_W9H-xNCj70AlpYfQKeP3K2gfknEv_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13491073900177771156', time=2024-09-14T13:27:50.772813+0000, chain.objs.size()=1 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SMGmG-dsns91yTrDq8j-En5qwCBcdKB_0 2024-09-14T11:37:46.698 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16063929967778613148', time=2024-09-14T13:27:50.807695+0000, chain.objs.size()=1 2024-09-14T11:37:46.699 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.697+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.v843R0hMZyGio2U5Gb3sFKIWOs2vKbb_0 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.698+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4097638837108851136', time=2024-09-14T13:27:50.958314+0000, chain.objs.size()=1 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.698+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EdSwB0P6loFpLEqLH-XEyJP0DHInpym_0 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13253117490370482241', time=2024-09-14T13:27:50.977525+0000, chain.objs.size()=1 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.664_rXRw_UaZ2tUTw1rGHnmzUEI6w91_0 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10141684967285263993', time=2024-09-14T13:27:50.985471+0000, chain.objs.size()=1 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.I1vBLHx2SfXENitpwW2MsYu3zbUqrMS_0 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11879617597913783886', time=2024-09-14T13:27:51.210350+0000, chain.objs.size()=1 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VUyiRYaaqHmQxkZagseE7zu2FTH1Z-3_0 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4455235419908214000', time=2024-09-14T13:27:51.229854+0000, chain.objs.size()=1 2024-09-14T11:37:46.700 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.h2Vn8IIVgCudtZ85nIvEHmQH-b6JhN9_0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12606040573814547551', time=2024-09-14T13:27:51.265464+0000, chain.objs.size()=1 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.sZG_V2fHknwmZI4rd7-UWPQYXK-E6YJ_0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1323433114137407629', time=2024-09-14T13:27:51.282018+0000, chain.objs.size()=1 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9lkLERU2wFiXrlXBsfLH0BKojrzmfQW_0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6511151625227610200', time=2024-09-14T13:27:51.310490+0000, chain.objs.size()=1 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.k8lSP7DIq-1lhrCkCnCmh3gpKinZS68_0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8837260288051210596', time=2024-09-14T13:27:51.325422+0000, chain.objs.size()=1 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZIsh9POMRMru_qj9lUMcX4dFYB81_8o_0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6621574936729881139', time=2024-09-14T13:27:51.332749+0000, chain.objs.size()=1 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4n9s8UTJ3R6i-ZI02DoyIwDngpPIfPf_0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5416350063757424365', time=2024-09-14T13:27:51.337080+0000, chain.objs.size()=1 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.z7mdmOCIkIes5DY0CZDY46m64J2pbkY_0 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3443954686581280731', time=2024-09-14T13:27:51.459825+0000, chain.objs.size()=1 2024-09-14T11:37:46.701 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.699+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hvDpA8ojqDSAiPwpqcV9N9uL_tPhd-E_0 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.701+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2557419707641210128', time=2024-09-14T13:27:51.597005+0000, chain.objs.size()=1 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.701+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.z3dV4kC6CeSar_I1eTKKGW5fn-0Qe-L_0 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.701+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5438793219475527088', time=2024-09-14T13:27:51.727755+0000, chain.objs.size()=1 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.701+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xhKMg57TJhcHcJxRdywy83yF1505sL0_0 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.702+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.386382125553250524', time=2024-09-14T13:27:51.765105+0000, chain.objs.size()=1 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.702+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pkUGHtFYXqna1Q0rCYNBZKdE7rqCtck_0 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.702+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11390985229752817559', time=2024-09-14T13:27:51.837918+0000, chain.objs.size()=1 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.702+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.H4VBR24kbdViaYwQrKY--WTprDD0eUf_0 2024-09-14T11:37:46.702 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.703+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/45151 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=21, truncated=0, next_marker='' 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5973635021346869351', time=2024-09-14T13:27:51.855490+0000, chain.objs.size()=1 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pi1-wlaIqM8r3KkjIZ-rqhXetG7hQ2N_0 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1613368668597505036', time=2024-09-14T13:27:51.959188+0000, chain.objs.size()=1 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.c6Cr2Gvti6D3q_z3D4gtbC-tj9GZCcO_0 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4969918357998476795', time=2024-09-14T13:27:51.994194+0000, chain.objs.size()=1 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._xTz0PP9fOpO3BbWqyJFnkqamyZmr_3_0 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12550828240527019160', time=2024-09-14T13:27:51.999166+0000, chain.objs.size()=1 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.b88rNstGFoN580nxcxDCWXdvEJEoSgR_0 2024-09-14T11:37:46.704 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6318759853529648547', time=2024-09-14T13:27:52.076777+0000, chain.objs.size()=1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rAddAHqTva2Q5tYR7Ij-KdTHzXfJExZ_0 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8646099122160420546', time=2024-09-14T13:27:52.218739+0000, chain.objs.size()=1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CFNJfcnXdKR9qz6KMLtG1hOGpiwI6Hz_0 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5781890781165533494', time=2024-09-14T13:27:52.238258+0000, chain.objs.size()=1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6Z_g-u9yXF4K9nJ9EtXw_sK9AkwPYuC_0 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9588069052875012945', time=2024-09-14T13:27:52.287404+0000, chain.objs.size()=1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qeXOSTrV-HX1BZSGTxq_Q2-u2lkrl9C_0 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12520547788347723728', time=2024-09-14T13:27:52.295622+0000, chain.objs.size()=1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qoejXYYpXmCPTO2m-KGrDXl_qEpbXlK_0 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13932988716693644059', time=2024-09-14T13:28:18.316719+0000, chain.objs.size()=1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.381__shadow_.BMPYoaYWd3Dm5DvF7uIGnp35SJIZUNb_0 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5656468896998495625', time=2024-09-14T13:28:47.093326+0000, chain.objs.size()=1 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.436__shadow_.ns-WDMx0MTgBCCds_kyvxoCYxDvlT0v_0 2024-09-14T11:37:46.705 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7699459260582970435', time=2024-09-14T13:29:03.921005+0000, chain.objs.size()=1 2024-09-14T11:37:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.705+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.464__shadow_.xO2pn0OFhPd3FczJf-EwdeanxyVxbAo_0 2024-09-14T11:37:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4159431433909842821', time=2024-09-14T13:30:44.403947+0000, chain.objs.size()=1 2024-09-14T11:37:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:d1hph38-TLw0aJM.UVKsfxncNTcd-KA_.kGbAyWwiKwO4J4UmQgUQlOIpAW11i1-_0 2024-09-14T11:37:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4669591025223168777', time=2024-09-14T13:30:46.454967+0000, chain.objs.size()=1 2024-09-14T11:37:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:Xho1Nxymug8cL4WeFQd--1lUw21qyTV_.IeBwxy7Wq-_ZO-TqWIUBqkPlxEg-tMq_0 2024-09-14T11:37:46.706 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9290982184465942784', time=2024-09-14T13:30:50.949611+0000, chain.objs.size()=1 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow_.wxR_pGR03qgy4_iEc3gqwkb9FpmEJm-_0 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14058551554200431842', time=2024-09-14T13:33:53.021095+0000, chain.objs.size()=1 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.642__shadow_._8QOGgGqKqTlL1wGwoF0XMpOCxM9Lmh_0 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14280655931712872149', time=2024-09-14T13:34:03.762697+0000, chain.objs.size()=6 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.660__multipart_bar.2~h0IfOERVOtUYkJq60w_BUISFUQ3hSR_.1 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.707+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.660__multipart_bar.2~h0IfOERVOtUYkJq60w_BUISFUQ3hSR_.2 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.708+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.660__multipart_bar.2~h0IfOERVOtUYkJq60w_BUISFUQ3hSR_.3 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.708+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.660__multipart_bar.2~h0IfOERVOtUYkJq60w_BUISFUQ3hSR_.4 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.708+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.660__multipart_bar.2~h0IfOERVOtUYkJq60w_BUISFUQ3hSR_.5 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.708+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.660__multipart_bar.2~h0IfOERVOtUYkJq60w_BUISFUQ3hSR_.6 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.708+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2278707338444236347', time=2024-09-14T13:34:18.281016+0000, chain.objs.size()=1 2024-09-14T11:37:46.707 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.708+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.695__shadow_.wDI927FApZB8trOG86AmNhMNJONJq3O_0 2024-09-14T11:37:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.709+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2531805174793943011', time=2024-09-14T13:34:25.788954+0000, chain.objs.size()=1 2024-09-14T11:37:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.709+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.712__shadow:cj8jcAU5lb6P2ToJaGhbwcdWrOR2EXa_.iJt4uRvZcssAzP9rwBjD8qZSNMF7Fgs_0 2024-09-14T11:37:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.709+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18173335375644437879', time=2024-09-14T13:34:59.063232+0000, chain.objs.size()=1 2024-09-14T11:37:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.709+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.741__shadow_.2zYMt_vfe3ik16epcjeQMBtGLGs_D-c_0 2024-09-14T11:37:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.709+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13667248590273862831', time=2024-09-14T13:35:27.025125+0000, chain.objs.size()=1 2024-09-14T11:37:46.708 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.709+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.765__shadow_.yjSYO2EOUtRAEBQqvNBBLaMFkRUbZCt_0 2024-09-14T11:37:46.709 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.711+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.711 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.713+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-14T11:37:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.714+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.712 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/148200' 2024-09-14T11:37:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16381377472668858911', time=2024-09-14T13:26:43.306403+0000, chain.objs.size()=1 2024-09-14T11:37:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.241__shadow_.mfrFdUA5tX7cBTXgBRRtmMoHbCgUeJr_0 2024-09-14T11:37:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18127849151366651459', time=2024-09-14T13:26:45.937230+0000, chain.objs.size()=1 2024-09-14T11:37:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.245__shadow_.78K7niQlbZ7ZLlUI50JUFWYSJ_uaWRV_0 2024-09-14T11:37:46.714 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5290737419272630153', time=2024-09-14T13:26:47.374366+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.248__shadow_.VlP4OdtUik7jTt24sZ1x-gZBZ5IUHiE_0 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13747891761367409172', time=2024-09-14T13:26:50.836558+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.255__shadow_.4UU23ts0vCvB4eOXJzWHCm3Vb-qG9Pa_0 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5018824107377789471', time=2024-09-14T13:27:01.196612+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0EkmhJ4NbI8xQkQSkYyfm_2w5H6CzB__0 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14477073124290219896', time=2024-09-14T13:27:01.218377+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QYLBxVHD3EItxgR9iLS_K_YxerAwT0C_0 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8627843525753405870', time=2024-09-14T13:27:01.290818+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qMi6k1w7S8S8Gsvlr9CbZne9nuu6Pim_0 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9698278550642164586', time=2024-09-14T13:27:01.291735+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.N_oPCmSXmZwxkIPoMjScTo7pJPih3Dn_0 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3589403487806581649', time=2024-09-14T13:27:01.311052+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.d3hN7yITM__e-q0-fbgA7e2IYHd5GnR_0 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3900534609744044658', time=2024-09-14T13:27:01.415630+0000, chain.objs.size()=1 2024-09-14T11:37:46.715 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.U1FpmC-yiaXRc6CePulOPmQ3FvibLQI_0 2024-09-14T11:37:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13968608290942025570', time=2024-09-14T13:27:01.419717+0000, chain.objs.size()=1 2024-09-14T11:37:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Luz0wR4VMsCCX1TEjOb3jFZdhBDU4GM_0 2024-09-14T11:37:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10454685331599648075', time=2024-09-14T13:27:01.451516+0000, chain.objs.size()=1 2024-09-14T11:37:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.715+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Z9RH8f184DW-BOROUBvmqq_jbJ2u9MR_0 2024-09-14T11:37:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.717+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2894883387792453034', time=2024-09-14T13:27:01.494638+0000, chain.objs.size()=1 2024-09-14T11:37:46.716 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.717+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1caTe6FYpuFfs3w0sEAUiWhYh42VTfn_0 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13709648860695487485', time=2024-09-14T13:27:01.527457+0000, chain.objs.size()=1 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.dQq7WU17xyVXmpUTiKIMP6qIw9unO3P_0 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9945484661516183787', time=2024-09-14T13:27:01.653797+0000, chain.objs.size()=1 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CwcOX2eXmD7evvwRnzshQpY9jNgz1i-_0 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9549333577876652583', time=2024-09-14T13:27:01.709296+0000, chain.objs.size()=1 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UT0W3CQdi1yPdbtZkZ2qOnVO9sHlqiE_0 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13881342211271020261', time=2024-09-14T13:27:01.743972+0000, chain.objs.size()=1 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.MEETZ0NuRZQMjEZvg6xTP50FHgVTVys_0 2024-09-14T11:37:46.717 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11286295984980460282', time=2024-09-14T13:27:01.745614+0000, chain.objs.size()=1 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hQkPr7ekOjJh-YXC-ix8LrAooXHO1di_0 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14457345452830097391', time=2024-09-14T13:27:01.764468+0000, chain.objs.size()=1 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tbMvMqpMCHbfRuNPti3qOUStxrUVSHh_0 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.564077288920159289', time=2024-09-14T13:27:01.889792+0000, chain.objs.size()=1 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.jQxYMlBYYuTRiP2wAKZ5DhW70kKhi-X_0 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7762856089614964375', time=2024-09-14T13:27:01.921469+0000, chain.objs.size()=1 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sXDM84PgipLwlye_s76hGBcAadOBIpf_0 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18432551939005216371', time=2024-09-14T13:27:01.960798+0000, chain.objs.size()=1 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.xq-f3iw4BcWYgIIXw1flvDCblsMifC7_0 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13337132359582966075', time=2024-09-14T13:27:01.971990+0000, chain.objs.size()=1 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2WENjiF6sHgXopJRhaao8reUwrlaD3r_0 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10982913673895524570', time=2024-09-14T13:27:02.176501+0000, chain.objs.size()=1 2024-09-14T11:37:46.718 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.719+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NvCj2AU_ZEvtGPabPpWFkABjDS77ym6_0 2024-09-14T11:37:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.720+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11203251287752677770', time=2024-09-14T13:27:02.223103+0000, chain.objs.size()=1 2024-09-14T11:37:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.720+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.vSX7DXRCtJj-adawJYFcHnrTiMvfAl6_0 2024-09-14T11:37:46.719 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11133226101934575601', time=2024-09-14T13:27:02.247639+0000, chain.objs.size()=1 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-3StKdQ5ZyvhqGvkYyvNn9r65i3pUcc_0 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8225783588174590881', time=2024-09-14T13:27:02.386007+0000, chain.objs.size()=1 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fE3X-6hxBv1a1pB6-HcBPaQNisHpRlh_0 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1820527091501294625', time=2024-09-14T13:27:02.427317+0000, chain.objs.size()=1 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GAENtuwCXiK1u20ucPjwuZfePUhHC_A_0 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3022176410579311975', time=2024-09-14T13:27:02.449715+0000, chain.objs.size()=1 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PU5xpifr81WEXNWcQ-_Y15Ktzk_ai0W_0 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10046928760371315667', time=2024-09-14T13:27:02.473509+0000, chain.objs.size()=1 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gbLz3c2yRzQFsOTLMPowSNGK1BWV1rz_0 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3934076326978982511', time=2024-09-14T13:27:02.477388+0000, chain.objs.size()=1 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.xlobC5nxGZWu6sTv8Tofu20uBTPV7lZ_0 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11899322896714187037', time=2024-09-14T13:27:02.732856+0000, chain.objs.size()=1 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.RtPb3b6Mzn9_auHsvVjbjHfZqZRkoma_0 2024-09-14T11:37:46.720 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.412287432109371100', time=2024-09-14T13:27:02.737897+0000, chain.objs.size()=1 2024-09-14T11:37:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kqlyW4y0zc2pO-g6VbOol_U6Z4Slmw4_0 2024-09-14T11:37:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12790435747467696149', time=2024-09-14T13:27:02.744528+0000, chain.objs.size()=1 2024-09-14T11:37:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nfdV_QPfSSXzbYQZGcm21Ne_UGqwTUs_0 2024-09-14T11:37:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2368761719824750', time=2024-09-14T13:27:02.836050+0000, chain.objs.size()=1 2024-09-14T11:37:46.721 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.721+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PH8YD2a41cc6QuN6Ym6ibscuAoC6iKj_0 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8817569175638816769', time=2024-09-14T13:27:02.873800+0000, chain.objs.size()=1 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0xvb7m9XngRCw1_SXvZ_V7-00xH4hkR_0 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15666911197318515947', time=2024-09-14T13:27:02.908639+0000, chain.objs.size()=1 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pPdWp2BxjX933z9S2vklwokrKzRA-y8_0 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6114897317683804645', time=2024-09-14T13:27:02.915652+0000, chain.objs.size()=1 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9lXEZHebKaEPMjWXke_Y4KkNoiOq9UE_0 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1834065975895566630', time=2024-09-14T13:27:02.943986+0000, chain.objs.size()=1 2024-09-14T11:37:46.722 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Aqtm-vHgyfz6_FWfd3tUGeDOM3jq4C9_0 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10567971589773522189', time=2024-09-14T13:27:02.946896+0000, chain.objs.size()=1 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.agsxRxxbLsBHMJZruSXDAGhfnXatx1Q_0 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18402615104078421369', time=2024-09-14T13:27:13.250820+0000, chain.objs.size()=1 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.284__shadow_.EDSMT5XIgQOWm6ITgFQmh_BvUx1-LPs_0 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15261283720316918518', time=2024-09-14T13:27:17.701887+0000, chain.objs.size()=1 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.PMoH8xJtYXy6b1or89M88oWZFcZQKKt_0 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4910378510647821088', time=2024-09-14T13:27:18.487244+0000, chain.objs.size()=1 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.9JSwn0RIveNNxLO5lTpOmIu-rzYBs95_0 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1859922459028888251', time=2024-09-14T13:27:24.434451+0000, chain.objs.size()=1 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.305__shadow_.kT5EMO37oOCpHDM0u9khLWxiveQzkGM_0 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16298385472954709372', time=2024-09-14T13:27:32.834119+0000, chain.objs.size()=1 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.723+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.322__shadow_.CwClIa2LspNgVtacvL8B5-iSk7YDM5P_0 2024-09-14T11:37:46.723 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.724+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14479609545665428068', time=2024-09-14T13:27:40.863171+0000, chain.objs.size()=1 2024-09-14T11:37:46.724 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.724+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bK-8ojM8ZN7ZEFvz3cCUYdBqQTFqHJ9_0 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11127434510110027428', time=2024-09-14T13:27:40.900236+0000, chain.objs.size()=1 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nUtwuxLLe2_v51kVRX9m4MKhbiG88q2_0 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.355506847960930469', time=2024-09-14T13:27:40.935905+0000, chain.objs.size()=1 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JHFN8bbffnHcabpReWBah3MGBKjJapA_0 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1377849287401941288', time=2024-09-14T13:27:40.948834+0000, chain.objs.size()=1 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kIk8aKjWBNF_OA8DsJnkK9EEdF2Ca0W_0 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1595846714180297356', time=2024-09-14T13:27:41.066604+0000, chain.objs.size()=1 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1go0QDqGkKaVBQ8m45FxZzpMxqYZTkn_0 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2646838815431515907', time=2024-09-14T13:27:41.069269+0000, chain.objs.size()=1 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.40VKW7fRjSPY5DtcT6uXFnR5Iz6j-L7_0 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1719914680916668715', time=2024-09-14T13:27:41.188476+0000, chain.objs.size()=1 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.L2UCHOF8AFEtv3C02uvS2eN8xK6tIjI_0 2024-09-14T11:37:46.725 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1174452097724292474', time=2024-09-14T13:27:41.349285+0000, chain.objs.size()=1 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.koW-GgEotRcG0WeYFqGOuQJEI5rCTN9_0 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3586405695286533698', time=2024-09-14T13:27:41.369462+0000, chain.objs.size()=1 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WiP0E0YeR8-0SSH2h-DIe_nJDZ2gcp7_0 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3182690646895983978', time=2024-09-14T13:27:41.441994+0000, chain.objs.size()=1 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.c1-T9CmFp2bNrMhszFwlZJ2uLCiclnx_0 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12412092953070806539', time=2024-09-14T13:27:41.446836+0000, chain.objs.size()=1 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tCOCTQREDjwFxxikIx2NxklwesCeDA6_0 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.725+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3545487230242569416', time=2024-09-14T13:27:41.447440+0000, chain.objs.size()=1 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.726+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dyePSSnZrzrSB3KCZ7I-nfH6NYnkESG_0 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.726+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5952434783056035280', time=2024-09-14T13:27:41.651409+0000, chain.objs.size()=1 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.726+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KcFPdj62lfObbg2h728gR1Tfa3907wt_0 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.727+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7798158523143913687', time=2024-09-14T13:27:41.724399+0000, chain.objs.size()=1 2024-09-14T11:37:46.726 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.727+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MqHusxYpQZwLqHwBl2WWRjcwTgn5d1I_0 2024-09-14T11:37:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.728+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18344355602940412845', time=2024-09-14T13:27:42.067477+0000, chain.objs.size()=1 2024-09-14T11:37:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.728+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.QHyomwYW8ZkrnsS7SAhYoqwPTQ4k3YG_0 2024-09-14T11:37:46.727 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.728+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13739214289713920237', time=2024-09-14T13:27:42.081279+0000, chain.objs.size()=1 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.728+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kaZC6FX0K0aIhffETJixUHbmNYFZLG__0 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.728+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15915748508734209371', time=2024-09-14T13:27:42.181400+0000, chain.objs.size()=1 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.728+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.P0yUreMD1fctJUymoIeC8Os_BQN8ec2_0 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6611484291665726065', time=2024-09-14T13:27:42.308064+0000, chain.objs.size()=1 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-y7VDmWGVaPVRjL5jLoXKTt4yCDgR9s_0 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13184542011240769453', time=2024-09-14T13:27:42.322823+0000, chain.objs.size()=1 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.gVD6eJvk0cOE8VhcagZMGfooqS9MbJ-_0 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7742048259786922894', time=2024-09-14T13:27:42.332742+0000, chain.objs.size()=1 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WyezdS_BvJFBETOI_4Ll4uEJxDsEIfE_0 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9075514820313919942', time=2024-09-14T13:27:42.367290+0000, chain.objs.size()=1 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JDF8wLeJBXnON8yNizAFO26cLyiPyc3_0 2024-09-14T11:37:46.728 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.330647090655428321', time=2024-09-14T13:27:42.458256+0000, chain.objs.size()=1 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IqiyXpk8kQlMTk5estrebymCWEriNNp_0 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5840128596843950818', time=2024-09-14T13:27:42.461146+0000, chain.objs.size()=1 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wlT9fE2fkJ03ul7mRUwmJ9Vs5jFKBIA_0 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14222120809629223340', time=2024-09-14T13:27:42.468122+0000, chain.objs.size()=1 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OjolYs6CcOAl8pn7YB2dmFCdYs5iCbW_0 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14580191921308718320', time=2024-09-14T13:27:42.617838+0000, chain.objs.size()=1 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sI5XiQptsdAoG4xIX9e-DAk6l11qrN6_0 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7870127050842084500', time=2024-09-14T13:27:42.666578+0000, chain.objs.size()=1 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-4JbEm6XPbtmW1VrsVymtoOVSChjBkr_0 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12130483277194981583', time=2024-09-14T13:27:42.673381+0000, chain.objs.size()=1 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1IQv89XGFFfRGQEVIwAz2ZpMZn4Up4A_0 2024-09-14T11:37:46.729 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8574968390224027229', time=2024-09-14T13:27:42.689698+0000, chain.objs.size()=1 2024-09-14T11:37:46.730 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.729+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.m5AU_I2iTIiFsiy3qHw9qs1y-0SF3OV_0 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13599601613030061353', time=2024-09-14T13:27:50.420590+0000, chain.objs.size()=1 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CQudh7QTrrgtVi9mn76TFdmP_bNYZON_0 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17047948940920724338', time=2024-09-14T13:27:50.471529+0000, chain.objs.size()=1 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.y6LF3RVgcfe4PxZRnyAyTGy2IbfTkre_0 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12991854511550392464', time=2024-09-14T13:27:50.487081+0000, chain.objs.size()=1 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pGdZLW4-zO0KG5ueqPQysm9LzKGhY9r_0 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15204602842467027030', time=2024-09-14T13:27:50.585011+0000, chain.objs.size()=1 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Yn3_E-PQ_Ec6XyrYwAc4mTgBfh7btlW_0 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2040311270869171130', time=2024-09-14T13:27:50.719773+0000, chain.objs.size()=1 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.h6h3jFuVLOqv65vYDt5CogHjXvk2yk4_0 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6681266410497538170', time=2024-09-14T13:27:50.764890+0000, chain.objs.size()=1 2024-09-14T11:37:46.731 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.skxpSFjsDiN1hMPeA3wKeA1wEcAvx-h_0 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11784052358859125546', time=2024-09-14T13:27:50.996817+0000, chain.objs.size()=1 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7NtEzuKi-08iaosQeltXEeOMl1PJxHB_0 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2076274088704974249', time=2024-09-14T13:27:51.044214+0000, chain.objs.size()=1 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.R4SSStYhpFZlIWj4e6tmsFxXc4rW2gg_0 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7125186315973988019', time=2024-09-14T13:27:51.068740+0000, chain.objs.size()=1 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.731+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UBUqCd60qYYlp-NaPE1rl8HT1rLyCfu_0 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.732+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16335868779093849558', time=2024-09-14T13:27:51.298994+0000, chain.objs.size()=1 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.732+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6LT4NwPcfRjvpbTmLkrww5wvgXSqpCv_0 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.732+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12487399190398228408', time=2024-09-14T13:27:51.508525+0000, chain.objs.size()=1 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.732+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AFE_QaAwyx0SakKdJsdo8rQhZVAy18v_0 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.732+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16767609268895381723', time=2024-09-14T13:27:51.522476+0000, chain.objs.size()=1 2024-09-14T11:37:46.732 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.732+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fPwQgpnV10bp6VHuekdY7gW_xbXdJD3_0 2024-09-14T11:37:46.733 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.733+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14330890453440080770', time=2024-09-14T13:27:51.531019+0000, chain.objs.size()=1 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.733+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GhP1hLUheLL54hksM4ar-lU8IHN5zip_0 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.733+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6926508992987247333', time=2024-09-14T13:27:51.568507+0000, chain.objs.size()=1 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.733+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TbmJ78Gs2FZXQFN5r6bVK6mgUrcntSm_0 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8540949863463476174', time=2024-09-14T13:27:51.599542+0000, chain.objs.size()=1 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EwxN8tOfHvKX4R0qz6k88jog2Gjz_vV_0 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13518141678794191004', time=2024-09-14T13:27:51.603966+0000, chain.objs.size()=1 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bukipP0sr_8xwakxG1Zvtep1bcHkc5A_0 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16533265270532823877', time=2024-09-14T13:27:51.620911+0000, chain.objs.size()=1 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JtCrBtc34WR7xY27SD8z9YQ3nEy4jjc_0 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17051716017495580920', time=2024-09-14T13:27:51.754853+0000, chain.objs.size()=1 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._mVQebcwHa6R23HY2KEvF5lm4x3bzyy_0 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10268108140718583960', time=2024-09-14T13:27:51.823550+0000, chain.objs.size()=1 2024-09-14T11:37:46.734 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RrEYJiO8r8yBf2HXhaQrF687sQ_ycbf_0 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5293548070013201872', time=2024-09-14T13:27:51.828466+0000, chain.objs.size()=1 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.y70uIwyh6S1t6afBXlun9W5GI3b7z02_0 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.739010107421719729', time=2024-09-14T13:27:51.847427+0000, chain.objs.size()=1 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9lsLK1uL_JX6yOFzP3drwZXLHBEwKqE_0 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4332857278328416923', time=2024-09-14T13:27:51.880928+0000, chain.objs.size()=1 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zRpoH__IOi0ya0yEJlZ-M8SSxNnh1n5_0 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8738572707892731664', time=2024-09-14T13:27:51.882472+0000, chain.objs.size()=1 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JvrKybVh5OzIclTSlET8qXI6GKzz_eu_0 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10102256158880633057', time=2024-09-14T13:27:51.967465+0000, chain.objs.size()=1 2024-09-14T11:37:46.735 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.734+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AVxEEXdbh7-KfeTUhtPL-nCsdtRs2Sz_0 2024-09-14T11:37:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.736+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15999000783367375', time=2024-09-14T13:27:51.978671+0000, chain.objs.size()=1 2024-09-14T11:37:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.736+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vGAi-vUaMPjojUNOa2M9PaKXNreRdCD_0 2024-09-14T11:37:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.736+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16865027985526135663', time=2024-09-14T13:27:52.063218+0000, chain.objs.size()=1 2024-09-14T11:37:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.736+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oyGrQM3JCzwt6H654WP__axcS2Mq19m_0 2024-09-14T11:37:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.736+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9584041344907644406', time=2024-09-14T13:27:52.090155+0000, chain.objs.size()=1 2024-09-14T11:37:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.736+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ciqKYs502KKVIh9mLZ_GJiuLEzETlB5_0 2024-09-14T11:37:46.736 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.738+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/148200 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=23, truncated=0, next_marker='' 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10160372937138501589', time=2024-09-14T13:27:52.239619+0000, chain.objs.size()=1 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8w5_DA0IlcdrbSR0dtPhNJ9xeH9WO2W_0 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9642019242163716975', time=2024-09-14T13:27:52.260588+0000, chain.objs.size()=1 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xkL8UlKAaEurFiPX0f3cgP-U3oMpp6v_0 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14680531238555737126', time=2024-09-14T13:27:52.297680+0000, chain.objs.size()=1 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CIScNbpbBl6Ocf37lQitAW7c5X5y77f_0 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14411138106490161771', time=2024-09-14T13:27:52.330400+0000, chain.objs.size()=1 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FOFQmJOUYBURRVPI7oyK6geL6igyExO_0 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1644217235579190677', time=2024-09-14T13:29:09.449465+0000, chain.objs.size()=1 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.481__shadow_.QbAueSUR3D2FRN99s1vsaaEhCMNrZWy_0 2024-09-14T11:37:46.739 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1713440364338054176', time=2024-09-14T13:29:12.737465+0000, chain.objs.size()=1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.487__shadow_.f9YRlNZwDc4yds7C5AuJX3x0gdXHzoO_0 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8680911328580943118', time=2024-09-14T13:29:13.285949+0000, chain.objs.size()=1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.488__shadow_.oYAxHybj3nAiTj6SQ2MS5GiYe_P2OGk_0 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15025975084078326731', time=2024-09-14T13:29:27.657192+0000, chain.objs.size()=1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.740+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.518__multipart_mymultipart.2~cFPQy0AMvCAJYToVBthvqCs6vj57-Pz.1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp', time=2024-09-14T13:29:39.951044+0000, chain.objs.size()=1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp.2 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp', time=2024-09-14T13:29:39.952643+0000, chain.objs.size()=1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~jFCPJtyEDD3Kh5jEQClH7jLApP1-Ddp.3 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~NiakIrffNM_KBktyDi5NhwMdWr2qqJy', time=2024-09-14T13:29:51.226899+0000, chain.objs.size()=1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.531__multipart_mymultipart.2~NiakIrffNM_KBktyDi5NhwMdWr2qqJy.1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1775460538204568436', time=2024-09-14T13:30:44.214249+0000, chain.objs.size()=1 2024-09-14T11:37:46.740 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.741+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:UHNztAApy4DU80YNGo6.QuciI-nFn5w_.yoBZ7iOcsAAY5RB8h_HZxl27tgFDdLv_0 2024-09-14T11:37:46.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10987556030852582569', time=2024-09-14T13:30:45.426089+0000, chain.objs.size()=1 2024-09-14T11:37:46.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:cno7mPu7UlbTmpYMqYmhqxJY.5hUfLI_.SHoeSLSaSzjmUa8N4dBIyhtiP8KOA1C_0 2024-09-14T11:37:46.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15695168485025921531', time=2024-09-14T13:30:47.290756+0000, chain.objs.size()=1 2024-09-14T11:37:46.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:vcgzbEIKM7I2AP1sw3DPUsFmlWeeXtj_.ByB3JWFpaNKEeTVR_X7c0pWgJKF46z0_0 2024-09-14T11:37:46.741 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17960179497227657825', time=2024-09-14T13:30:48.773082+0000, chain.objs.size()=1 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.571__shadow_.6K19vLO-Tdsk9xDrjFl0qpGZUj4V6Su_0 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11763816938834363468', time=2024-09-14T13:30:50.274014+0000, chain.objs.size()=1 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.573__shadow_.XOmrZg4bp2ppQUWJZ7P1OageFW6f3Do_0 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12240805971858528113', time=2024-09-14T13:30:56.105632+0000, chain.objs.size()=1 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:oavqt6icCx.rJpCjgTz8NMAedO5SfcR_.Nnrjl2VaUCbSFgXmLoA6lWf49o1fVjn_0 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9746369581299584510', time=2024-09-14T13:30:57.285339+0000, chain.objs.size()=1 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:7iR-YByhymtYeLQq55fPGOemZ1J6lnm_.3LzAKC8iF7jcYIWn8pYa2q2v3haUGC5_0 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13390955444762358394', time=2024-09-14T13:30:59.360533+0000, chain.objs.size()=1 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:PFC8amCkKszroesuYzx02yfPipk7j62_.6NiEoRChy-J7TaUAV3wv0LzVJ4pSBbc_0 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10347122499290943008', time=2024-09-14T13:31:17.973974+0000, chain.objs.size()=1 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.585__shadow:5dWXffAsJL3zY1189fd7wwGUHnfVNo5_.ZJMbW44cWBFBwOnr7hsR-4WB_NzCjxC_0 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3801115751993740677', time=2024-09-14T13:31:19.095079+0000, chain.objs.size()=1 2024-09-14T11:37:46.742 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:7MYDxk1USQYHHx3hXswSdaCFzZBCCHS_.2nyA0XN7iUpyY79IpZpdKoNMAjBQP93_0 2024-09-14T11:37:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17797394171806781224', time=2024-09-14T13:31:23.203850+0000, chain.objs.size()=1 2024-09-14T11:37:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.596__shadow_.VIXRkifEMd0UtQ_xeZxxyTIpTjd2u0H_0 2024-09-14T11:37:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5365693854546246952', time=2024-09-14T13:35:36.280003+0000, chain.objs.size()=1 2024-09-14T11:37:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.743+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.775__shadow_.T_oa7VnurFwVYTGAEh3OSx7jRi_M4Ox_0 2024-09-14T11:37:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.745+0000 7f67698de640 0 -- 172.21.15.2:0/3458714241 >> [v2:172.21.15.86:6818/1094621518,v1:172.21.15.86:6819/1094621518] conn(0x7f663408ac10 msgr2=0x7f6634097d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-14T11:37:46.743 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.746+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.745 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.748+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-14T11:37:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.749+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.747 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.749+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/44280' 2024-09-14T11:37:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16581040094633508657', time=2024-09-14T13:26:39.341404+0000, chain.objs.size()=1 2024-09-14T11:37:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.234__shadow_.Fw5z5os9SkgmAnBRnbUTYDMgX79BSrU_0 2024-09-14T11:37:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8286650277270218480', time=2024-09-14T13:26:44.627094+0000, chain.objs.size()=1 2024-09-14T11:37:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.243__shadow_.rL6R7diqcJihuMxIv0sX8Q0So5vnpIL_0 2024-09-14T11:37:46.749 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17910426889634655993', time=2024-09-14T13:26:46.897637+0000, chain.objs.size()=1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.247__shadow_.9JjbsB3kOhCJh7Pn78kiX_a6THK8AR3_0 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.386063513796008020', time=2024-09-14T13:26:53.692080+0000, chain.objs.size()=1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.261__shadow_.e7rJI4qe6wiIGLPXy6mnqHlZJaPf6M6_0 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10050082613896783581', time=2024-09-14T13:27:01.168994+0000, chain.objs.size()=1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.h42ztSifGEAM4DvTnBLxUN_Gzi7AEvt_0 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12354739559684002247', time=2024-09-14T13:27:01.190862+0000, chain.objs.size()=1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.54iK3Y5u8e3oZKLdika4JMLhAjNDA77_0 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9067011223182125411', time=2024-09-14T13:27:01.211444+0000, chain.objs.size()=1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.N5WTUK7EVOMnGk8_l5tW-aLz8QNTPg0_0 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8667073522861098972', time=2024-09-14T13:27:01.318698+0000, chain.objs.size()=1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1ziRorNtQfccWCBvs4tSdqRGCMLQkHQ_0 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11319691163226969968', time=2024-09-14T13:27:01.320181+0000, chain.objs.size()=1 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eqI2Svx-cPQvMUzZfXpOORPUP9LIrh0_0 2024-09-14T11:37:46.750 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5699510239255400257', time=2024-09-14T13:27:01.414755+0000, chain.objs.size()=1 2024-09-14T11:37:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aCSjfndGY1_s2gg6tb3Vg2dHLjw_DS3_0 2024-09-14T11:37:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5876938857013583115', time=2024-09-14T13:27:01.428506+0000, chain.objs.size()=1 2024-09-14T11:37:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5eoTHMQ6Iv25gBUsHesRiefCyq1jNMm_0 2024-09-14T11:37:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8709711120000302821', time=2024-09-14T13:27:01.479777+0000, chain.objs.size()=1 2024-09-14T11:37:46.751 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.750+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yZzGmN1nUXgrhKo9orLfd1nGTsgT6-C_0 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9328778987016229622', time=2024-09-14T13:27:01.492276+0000, chain.objs.size()=1 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qb1PD4iG4editVTUrAsY1jRCdpwlLQn_0 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9595979652116668356', time=2024-09-14T13:27:01.507260+0000, chain.objs.size()=1 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Gwj6Krux42_jqeUsflsLRjBoVa9FbGu_0 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1521466702388306617', time=2024-09-14T13:27:01.524247+0000, chain.objs.size()=1 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PeoTXrM4V-SV0USr5vq5ZMgnxTns9ZU_0 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14974695423273103011', time=2024-09-14T13:27:01.654646+0000, chain.objs.size()=1 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Xe-GN3xuZFjzuu3AA9pL1a_XwJ3tCvj_0 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17589145125765365190', time=2024-09-14T13:27:01.693392+0000, chain.objs.size()=1 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.o6YDPt6sHbHzLFC9r0xto5ucT0tCOHZ_0 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12219941190318473072', time=2024-09-14T13:27:01.736248+0000, chain.objs.size()=1 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3SVoS-Gm4ub_7w4-WVRAgxzeM2Fwxy__0 2024-09-14T11:37:46.752 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10132140253343786026', time=2024-09-14T13:27:01.801739+0000, chain.objs.size()=1 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XtTBExGe30fUxyBHgRpZiJ7C3ky3HKn_0 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7449001791072898502', time=2024-09-14T13:27:01.907205+0000, chain.objs.size()=1 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nccVPiBFweZwHb8ADjeXuH36zOijUx4_0 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.185798818604338388', time=2024-09-14T13:27:02.231668+0000, chain.objs.size()=1 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rfc5EGnkW6JDYaf5Nvh6lWKMDufoOkp_0 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9296201527549745529', time=2024-09-14T13:27:02.393081+0000, chain.objs.size()=1 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lwoSO7uZhMI1RRDCQXEz9VN8MY-W3O__0 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8054220217211509996', time=2024-09-14T13:27:02.411574+0000, chain.objs.size()=1 2024-09-14T11:37:46.753 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.753+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7V6gTpELEW6LQv402jMt6Hf2V5QFHZE_0 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8085349990787514175', time=2024-09-14T13:27:02.438161+0000, chain.objs.size()=1 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CCiNdOiYIhn3SgZuV71oanxVZowuihP_0 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18344099625181399345', time=2024-09-14T13:27:02.444611+0000, chain.objs.size()=1 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QxRHxsIAqXLISCvNu6JTEeaUYpsWQLf_0 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15190738081321496828', time=2024-09-14T13:27:02.598491+0000, chain.objs.size()=1 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.J98LvLX-LiXWDIHFDH5sjIOcnFWIPyG_0 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13429167054205162612', time=2024-09-14T13:27:02.629262+0000, chain.objs.size()=1 2024-09-14T11:37:46.754 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.WGrx95FecjC01Egm1mIXr7wUHc-QdpR_0 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15623870228726690137', time=2024-09-14T13:27:02.670122+0000, chain.objs.size()=1 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1ijTLZLhx4qdatfAX1A3D5i6hLpUWS__0 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15826681636115738717', time=2024-09-14T13:27:02.721583+0000, chain.objs.size()=1 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.jaCxR_LSeD6l4a85Vb-ozpwoq2SKex-_0 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7862262526222631398', time=2024-09-14T13:27:02.726593+0000, chain.objs.size()=1 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.filM0nzMAlKuO1I4GJeIwNDQcFLAKmL_0 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9915348313059786014', time=2024-09-14T13:27:02.753237+0000, chain.objs.size()=1 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.i-9CP2xgsyMsEOQC4GFV4fCefkVP5qp_0 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13363898276945676819', time=2024-09-14T13:27:02.905028+0000, chain.objs.size()=1 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.skDS-7nTPcxzzao8kYHGu2tnjuaaazd_0 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4775702675510656446', time=2024-09-14T13:27:02.912638+0000, chain.objs.size()=1 2024-09-14T11:37:46.755 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.K2gMSP_Sc8S1WEWWYZjnXQ50y2ESnNc_0 2024-09-14T11:37:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14798071980744816579', time=2024-09-14T13:27:02.966069+0000, chain.objs.size()=1 2024-09-14T11:37:46.756 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.755+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.z6LZBSu6bfFJ3GMUDsJxrx2zdaaqklk_0 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.756+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5989624225233153334', time=2024-09-14T13:27:04.830135+0000, chain.objs.size()=1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.756+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.266__shadow_.GbuXv01YGabzY_3CTa4Dt6kXVDvGOsp_0 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11413630080860983301', time=2024-09-14T13:27:10.895499+0000, chain.objs.size()=1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.279__shadow_.UA2G2yAkAR8ZWdo7Dz1eJcULrcJD98V_0 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6129175507026561401', time=2024-09-14T13:27:14.735066+0000, chain.objs.size()=1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.287__shadow_.s1-U-wCQM3jXYt2Knd3nH9lSREwjdGu_0 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6607648542321366643', time=2024-09-14T13:27:17.704378+0000, chain.objs.size()=1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.QKvnGXGS0mqYbuAh7EJb-htPFU0zQPB_0 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4982151695262268856', time=2024-09-14T13:27:18.496906+0000, chain.objs.size()=1 2024-09-14T11:37:46.757 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.757+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.o6kTHKylPE4maNWKh2_f5zlonpLc-NA_0 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1008235262001844618', time=2024-09-14T13:27:18.510261+0000, chain.objs.size()=1 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_._lWblRyZy1Q4rCa2usG_yK4KGWa8qg7_0 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14768660409396355818', time=2024-09-14T13:27:20.919555+0000, chain.objs.size()=1 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.298__shadow_.r0Fz-7He5t94C6WYrC-TXcgyWxOpcoz_0 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11297307660776467485', time=2024-09-14T13:27:40.782447+0000, chain.objs.size()=1 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.l7eDy8uCVi4qVHAWhAxmIOokyVW2KYT_0 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18275632036474462083', time=2024-09-14T13:27:40.815482+0000, chain.objs.size()=1 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Wa0IqT1VkjZJR0-4b1JxHHkpBgQdv9E_0 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16894730330583449883', time=2024-09-14T13:27:40.844176+0000, chain.objs.size()=1 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EueJBDCHAS6TwD4yl2LRSbDwykht5TQ_0 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5463864602213186927', time=2024-09-14T13:27:40.847240+0000, chain.objs.size()=1 2024-09-14T11:37:46.758 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zpmA5aTWGNPIUtYfz7oXK25GFxeKkil_0 2024-09-14T11:37:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12664891054192252569', time=2024-09-14T13:27:41.100249+0000, chain.objs.size()=1 2024-09-14T11:37:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.758+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.v0DPL0P64pMQFJWMJ9rV0C_4Uta_K9c_0 2024-09-14T11:37:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.759+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15504956044032791886', time=2024-09-14T13:27:41.124926+0000, chain.objs.size()=1 2024-09-14T11:37:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.759+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zkjJ1HWFDh5ycE2bn1XqcBa1N7REiD7_0 2024-09-14T11:37:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.759+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.398484924854489721', time=2024-09-14T13:27:41.157125+0000, chain.objs.size()=1 2024-09-14T11:37:46.759 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.759+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zCXHI43qinjH6LDUSxIOfoWeNDawzeG_0 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.760+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7069249173366015821', time=2024-09-14T13:27:41.157713+0000, chain.objs.size()=1 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.760+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SZJQAwJmHvNUGVWHD9iBBoGAe9pRJym_0 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.760+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1316302270162769677', time=2024-09-14T13:27:41.163274+0000, chain.objs.size()=1 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.760+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DulRp1Yvp584jPXSIMNzDhciaNbXmw5_0 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.760+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7125079615266463455', time=2024-09-14T13:27:41.312584+0000, chain.objs.size()=1 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.760+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LvZBfMTDIsgn-1_-JrwOW486AE1jdM7_0 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17200526554585234670', time=2024-09-14T13:27:41.316470+0000, chain.objs.size()=1 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SQiQeOzNj3RQBEmxbazL3VtOHqnpcQC_0 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16355078703227223322', time=2024-09-14T13:27:41.365903+0000, chain.objs.size()=1 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ad7CYtRZivf-a696UjrwqRH9y4KgA9B_0 2024-09-14T11:37:46.760 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12385032886128513414', time=2024-09-14T13:27:41.385063+0000, chain.objs.size()=1 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yDAH3LC4J0g8oLj9o6n78dPokOGcjNE_0 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11877231286820257220', time=2024-09-14T13:27:41.391886+0000, chain.objs.size()=1 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dOOMgEA2suqkaDlqc8PbcJGx5IWLUxo_0 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11731830254595032834', time=2024-09-14T13:27:41.431577+0000, chain.objs.size()=1 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.oAc5d9JMrBcxvIsK4JglcGxdAXePrdi_0 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18442294615980953237', time=2024-09-14T13:27:41.668698+0000, chain.objs.size()=1 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dER8Kt7ksZChGdkdHVZKiPy0R7p24yz_0 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5947895942063313240', time=2024-09-14T13:27:41.688616+0000, chain.objs.size()=1 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.761+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yA1FB-mKOAnqn264fcLhFve58eh-p_S_0 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.762+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13306832098859475365', time=2024-09-14T13:27:41.703129+0000, chain.objs.size()=1 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.762+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SnRqBTS913TxVZ-KkZgcXKhR8oUEdkw_0 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.762+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9618048388983273270', time=2024-09-14T13:27:41.839436+0000, chain.objs.size()=1 2024-09-14T11:37:46.761 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.762+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.d2-jTWzlGWA8tNGmFkNX63Rlr7E661C_0 2024-09-14T11:37:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10219804155326242744', time=2024-09-14T13:27:41.905239+0000, chain.objs.size()=1 2024-09-14T11:37:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.sotqe-Zs1g0qv4MLIC3FDXb2VRZbH9V_0 2024-09-14T11:37:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16165175027701742370', time=2024-09-14T13:27:41.968056+0000, chain.objs.size()=1 2024-09-14T11:37:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.R74xQw9vqwaClDT6XZdWrjrD_XlZjkB_0 2024-09-14T11:37:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12381914713323072095', time=2024-09-14T13:27:42.217266+0000, chain.objs.size()=1 2024-09-14T11:37:46.762 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0uqTR3DXy1Y1TITEi-9o4Qi2FaU-XVu_0 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17057178689560728995', time=2024-09-14T13:27:42.310755+0000, chain.objs.size()=1 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8hI6D04DJl7xmJd64Ey4XV2Cjw5RhVE_0 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11106110554318079221', time=2024-09-14T13:27:42.472608+0000, chain.objs.size()=1 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ZNtMa_4kqwqH6fO6AdljnJKVwe78flL_0 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16134164511268394640', time=2024-09-14T13:27:42.475301+0000, chain.objs.size()=1 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ikr9mH9Q6iVWAKsZCXWllxKr-XzLfw6_0 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13702581486096754754', time=2024-09-14T13:27:42.477833+0000, chain.objs.size()=1 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6ZUvIBC0TcdWt0bMXnJ-01HlfBs72sV_0 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8959175469335832674', time=2024-09-14T13:27:42.582012+0000, chain.objs.size()=1 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ScmREc9q42bolTLFD2QBSELpluFOhAT_0 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8552574360726304140', time=2024-09-14T13:27:42.639182+0000, chain.objs.size()=1 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Vcb4k5p7xbze4l9IP6pSfcNRIceGXql_0 2024-09-14T11:37:46.763 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18264772425185531810', time=2024-09-14T13:27:42.643943+0000, chain.objs.size()=1 2024-09-14T11:37:46.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.763+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Fs1FZsoO_-XazvCPR_osOpDAkt1_IZL_0 2024-09-14T11:37:46.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.764+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15526970711132991166', time=2024-09-14T13:27:42.645469+0000, chain.objs.size()=1 2024-09-14T11:37:46.764 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.764+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.HSGY5IGVf-Tum1N2D_G6XY1L0sEJLYd_0 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11152560475866701168', time=2024-09-14T13:27:42.670572+0000, chain.objs.size()=1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.B8OyarriXFtbyWW5l9aTso6F1Jpmu6-_0 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7128980910619666149', time=2024-09-14T13:27:42.692603+0000, chain.objs.size()=1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zdIYFhbVTP6kLdJ6dYXbyVaBQS6fEag_0 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15543482474894539063', time=2024-09-14T13:27:50.461656+0000, chain.objs.size()=1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.MEx9f-CnjmetFek70se8YhHz9AXr7U2_0 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18388102323933662540', time=2024-09-14T13:27:50.489394+0000, chain.objs.size()=1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YddAo5TjcykkDFjEFIXmrgY5QwQc66V_0 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9627053706645935803', time=2024-09-14T13:27:50.502731+0000, chain.objs.size()=1 2024-09-14T11:37:46.765 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cMJVKYfwGsWzpa8rgh3U7wJjZIpmrXX_0 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10528958528866607047', time=2024-09-14T13:27:50.572205+0000, chain.objs.size()=1 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lL3lP3xdLiSrmIQz0XYpAPAT7st_gP0_0 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11043152092406089330', time=2024-09-14T13:27:50.573925+0000, chain.objs.size()=1 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oMkTOQcXpqAVjQ0XLkx-omf1R0R2wTw_0 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8898222188726939209', time=2024-09-14T13:27:50.678567+0000, chain.objs.size()=1 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TS3D7qXXrwCUJ5wURUd2uzFJy9GVOhN_0 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17034783038700163891', time=2024-09-14T13:27:50.703337+0000, chain.objs.size()=1 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.JRy3QRwmnI2xEBw1rpBaxn2Bediu4P3_0 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.159410794748841601', time=2024-09-14T13:27:50.717122+0000, chain.objs.size()=1 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.zk5Y1ZpPpAbVMEkvfnc7qSAVevzkJol_0 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15212810778178937074', time=2024-09-14T13:27:50.717758+0000, chain.objs.size()=1 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.765+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.e75LjjoQm8-biJUywtDMjSK_P0YKMJK_0 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13904023909191958577', time=2024-09-14T13:27:50.728424+0000, chain.objs.size()=1 2024-09-14T11:37:46.766 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hjvCgwjLC7cMIOryqiCUN-7FFcp8C4Q_0 2024-09-14T11:37:46.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4692030474355472816', time=2024-09-14T13:27:50.837839+0000, chain.objs.size()=1 2024-09-14T11:37:46.767 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.mlRGtAoIoh4cpzPiNO_yjsC7PVvW7Di_0 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8918285978367980268', time=2024-09-14T13:27:51.012521+0000, chain.objs.size()=1 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.WVj-J75mlOgPriXVWQ1pqkCil-74zBz_0 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16102602634831207813', time=2024-09-14T13:27:51.029507+0000, chain.objs.size()=1 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.naoEJ_6n_jE56wZF2MYEWxwIe5-y8A__0 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9658913183695916176', time=2024-09-14T13:27:51.031233+0000, chain.objs.size()=1 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3aCm4XIwjvqWrUUPwSqzlcpdPC7AdgU_0 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9526565885447574335', time=2024-09-14T13:27:51.062770+0000, chain.objs.size()=1 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.767+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lWtWQ1rua9TYHoKOtiPbUZChfun-X3b_0 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.768+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10941686069718832773', time=2024-09-14T13:27:51.084468+0000, chain.objs.size()=1 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.768+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.w0JVPnlIuEO_6AiTQNRZwt2qbYrgBa__0 2024-09-14T11:37:46.768 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.768+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2276822747881577683', time=2024-09-14T13:27:51.206429+0000, chain.objs.size()=1 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.768+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ku3vBTTVEATza1SHgh7AnjQ6jD8pgVp_0 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.768+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8012906721606683205', time=2024-09-14T13:27:51.247318+0000, chain.objs.size()=1 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.768+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Wh-0Ztsn2bihXpfXBSl47kMnyR5P-5C_0 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2411704536902203643', time=2024-09-14T13:27:51.446787+0000, chain.objs.size()=1 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.A_P9NEEN_3w-2pIajmVXaoAGSP8z3S9_0 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.985407265612545677', time=2024-09-14T13:27:51.507123+0000, chain.objs.size()=1 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AMnIDxvMqHdrXclt6Zf-VhoJJJ2Q8QY_0 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16578752405350802369', time=2024-09-14T13:27:51.511974+0000, chain.objs.size()=1 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BQ-osOjqktUCbCT56t9CL_KE2io9HOe_0 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.684809233962602038', time=2024-09-14T13:27:51.527569+0000, chain.objs.size()=1 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EElvoDW11o45NSB1n-E_gpdXld2AUjA_0 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11750581625104161155', time=2024-09-14T13:27:51.565739+0000, chain.objs.size()=1 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.a8Oc_nXfuzFfZ54hP935q-c7BhgJAAS_0 2024-09-14T11:37:46.769 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2903419163071035317', time=2024-09-14T13:27:51.584599+0000, chain.objs.size()=1 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.x2mBuJWw6kBvKeZKYXz9Q8oTazah0K7_0 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18028263248146110420', time=2024-09-14T13:27:51.608368+0000, chain.objs.size()=1 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Roypz0Fa2YIDNz02qhp_aqqxp_SPQ78_0 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7547350978847479153', time=2024-09-14T13:27:51.732904+0000, chain.objs.size()=1 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.769+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZLTUdoD8EX0I8-IwneAssDOKOsfWY_N_0 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.770+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16939892093312776633', time=2024-09-14T13:27:51.833126+0000, chain.objs.size()=1 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.770+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EoLTlQz5CZaq0IH7-JvkTKbY1giGgmc_0 2024-09-14T11:37:46.770 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.772+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/44280 2024-09-14T11:37:46.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=26, truncated=0, next_marker='' 2024-09-14T11:37:46.772 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7794318191033587563', time=2024-09-14T13:27:51.835359+0000, chain.objs.size()=1 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4e-gSbPEiz0DyaeiLGYUl2utotDc3Yt_0 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10502575596734684323', time=2024-09-14T13:27:51.853726+0000, chain.objs.size()=1 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iHdCsiIHIYJCN8vHZ4kKa8B81NDVAYS_0 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12210265375769340361', time=2024-09-14T13:27:52.018920+0000, chain.objs.size()=1 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SIRbzsooRP_WS1KwgacsDHtwWJB5OR7_0 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8109664776903041707', time=2024-09-14T13:27:52.064906+0000, chain.objs.size()=1 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.WFDJlLLnHNZbys51dDv_rMYp4uK0gSi_0 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10370088588549388467', time=2024-09-14T13:27:52.065574+0000, chain.objs.size()=1 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1wSGkOF9ApvM8Q8SQ4DVWP0CeLWHRVa_0 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8489360283982860500', time=2024-09-14T13:27:52.069313+0000, chain.objs.size()=1 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-RdOmQQJqbyWdccRRstERAnOHnl3RPt_0 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.666690774787032295', time=2024-09-14T13:27:52.073490+0000, chain.objs.size()=1 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RTwPQCNLX3WSa3EJ5ESC3gP4gKNt8E-_0 2024-09-14T11:37:46.773 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5875798895053032189', time=2024-09-14T13:27:52.098424+0000, chain.objs.size()=1 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wsGr4Q2gxV_1E6sbisJP4GudcayeMB4_0 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11021929365490494637', time=2024-09-14T13:27:52.108103+0000, chain.objs.size()=1 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZWCLvkUpE93Vj5bDylrzeCvAkCscXaG_0 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13917150402631706021', time=2024-09-14T13:27:52.112425+0000, chain.objs.size()=1 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6fzziSblZtGwoNyseeTYJpN1djzUNXM_0 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9844455459748605119', time=2024-09-14T13:27:52.122041+0000, chain.objs.size()=1 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yEyl51of5mbHbz6RtJpGEdN_LQd594q_0 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8288721429787231066', time=2024-09-14T13:27:52.132292+0000, chain.objs.size()=1 2024-09-14T11:37:46.774 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.774+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DjcNS5qmDt37UuA-JpYZWXSM87fOG7d_0 2024-09-14T11:37:46.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16051390719075291237', time=2024-09-14T13:27:52.218778+0000, chain.objs.size()=1 2024-09-14T11:37:46.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rpZR-7uXo6cftGV6iRvjJMKokk6vAME_0 2024-09-14T11:37:46.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5793154433927210258', time=2024-09-14T13:27:52.315477+0000, chain.objs.size()=1 2024-09-14T11:37:46.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.buSTATEIApUrlzY-ay3ZSAh1KnNPbEu_0 2024-09-14T11:37:46.775 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15951482499659243075', time=2024-09-14T13:27:52.326974+0000, chain.objs.size()=1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wtHBePwUG2ASkkVjc6vMgWT1-v8msoR_0 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16256112106924854300', time=2024-09-14T13:27:52.343600+0000, chain.objs.size()=1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1oFfO1UFg2xnwbnHcfLVYHLMq-Kvlyo_0 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.57803640479314337', time=2024-09-14T13:29:20.019671+0000, chain.objs.size()=1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.503__shadow:mTcNqOeSoMdp1SFsn-oYFj8mNhIIfUb_.m4lffY6UOEudOA076OqtE8cz_-frwwK_0 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~muyRuEQFs1ztMw59XVUR2iqTOb-0_SH', time=2024-09-14T13:29:51.242494+0000, chain.objs.size()=1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.776+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.531__multipart_mymultipart2.2~muyRuEQFs1ztMw59XVUR2iqTOb-0_SH.1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~7G5Rsb68QfhuNqUNGcK3VOhNAGEAvRl', time=2024-09-14T13:29:53.368086+0000, chain.objs.size()=1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.535__multipart_mymultipart.2~7G5Rsb68QfhuNqUNGcK3VOhNAGEAvRl.3 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.735574295676741115', time=2024-09-14T13:31:01.595365+0000, chain.objs.size()=1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:20-HENFV3x9TsiyQ90F4vtlrNx3R542_.oijpYaMsbRUqLQuTxUQXUkeCHUzFiq7_0 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7937544408747415794', time=2024-09-14T13:33:50.347575+0000, chain.objs.size()=1 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.636__shadow_.2n1vla1Cbzu8avE_1BuMXWYtPnmpWMW_0 2024-09-14T11:37:46.776 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8339957479153255262', time=2024-09-14T13:33:51.526180+0000, chain.objs.size()=1 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.639__shadow_.lzNLxiNmRVQUbQrWuqC2yw6ntVah6vK_0 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14799409244309486880', time=2024-09-14T13:33:55.251996+0000, chain.objs.size()=1 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.777+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.646__shadow_.qfH9rtRmLLwVdjJ2W9bHZzXKEXBcIjp_0 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.778+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11958629325798088009', time=2024-09-14T13:34:22.699911+0000, chain.objs.size()=1 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.779+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.705__shadow:wRQqXjCmehmLjnWGVQ2QNr5nlUKen24_.HoGcgQVVwyZ0yLsQ0YHzPB1ctuiPmNj_0 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.779+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15627787795690808406', time=2024-09-14T13:34:24.978182+0000, chain.objs.size()=1 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.779+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.710__shadow:IMBj4.fUgcXduJ-NraYT.ufrGFiSdbL_.JgTEi3WlO7a-Z2c4BTMLJlXk2HlRoju_0 2024-09-14T11:37:46.777 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.779+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15767191870623147423', time=2024-09-14T13:35:24.961728+0000, chain.objs.size()=1 2024-09-14T11:37:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.779+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.762__shadow_.uEgzBOY4OXw87SvxCc2L54qnQdeAjyW_0 2024-09-14T11:37:46.778 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.780+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.780 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.782+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-14T11:37:46.781 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.783+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.782 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47958' 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1380833179151556970', time=2024-09-14T13:24:57.407561+0000, chain.objs.size()=2 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.HfKyFsxsPNqXu4LWDP4xjdbbcvuLxpZ_0 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.160__shadow_.HfKyFsxsPNqXu4LWDP4xjdbbcvuLxpZ_1 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11809577699570078214', time=2024-09-14T13:24:58.343412+0000, chain.objs.size()=3 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-STANDARD.2~i6XB9vtk3boTarz_i1yF_oDgMsQkPUz.1 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-STANDARD.2~i6XB9vtk3boTarz_i1yF_oDgMsQkPUz.2 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-STANDARD.2~i6XB9vtk3boTarz_i1yF_oDgMsQkPUz.3 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17951433168119643898', time=2024-09-14T13:24:59.416093+0000, chain.objs.size()=3 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-FROZEN.2~-g2Up4BmiwO-Ji7JV_GlYwEeFFlstAv.1 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.784+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-FROZEN.2~-g2Up4BmiwO-Ji7JV_GlYwEeFFlstAv.2 2024-09-14T11:37:46.783 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__multipart_foo-FROZEN.2~-g2Up4BmiwO-Ji7JV_GlYwEeFFlstAv.3 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3731516452023009721', time=2024-09-14T13:26:41.100160+0000, chain.objs.size()=1 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.237__shadow_.dwJTXwFvYmqWJBj32Sg3ZEBYbNO1LoX_0 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1492070105560504625', time=2024-09-14T13:26:46.415562+0000, chain.objs.size()=1 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.246__shadow_.4D9_JJgiu9oDS3VrXZNco4ck-MyhkNo_0 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12263091271260832165', time=2024-09-14T13:26:46.896995+0000, chain.objs.size()=1 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.247__shadow_.Ps_1yhptSw_I444pTtceXy9aDhrUsT0_0 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17913133309293224098', time=2024-09-14T13:26:48.295522+0000, chain.objs.size()=1 2024-09-14T11:37:46.784 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.785+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.250__shadow_.bA_5F8cn-P8XmMmG3FxbjLLG2zp0y9p_0 2024-09-14T11:37:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14903471996627156402', time=2024-09-14T13:26:48.774917+0000, chain.objs.size()=1 2024-09-14T11:37:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.251__shadow_.dZ110rrYESSxnNup98DE4ZrZE8ch80X_0 2024-09-14T11:37:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6912923885793224956', time=2024-09-14T13:27:01.223014+0000, chain.objs.size()=1 2024-09-14T11:37:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DtUvojNYyGmrIYyb4-ki-r9DB0pFkxa_0 2024-09-14T11:37:46.786 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.605942062923807963', time=2024-09-14T13:27:01.235889+0000, chain.objs.size()=1 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZWrku-eGH8HL82JGe_BaSVUolM1e8Q5_0 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1673581329987636514', time=2024-09-14T13:27:01.416779+0000, chain.objs.size()=1 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rgYqfQ5qOraekwyPOZ1bazIdI-LBETe_0 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12374521945160666286', time=2024-09-14T13:27:01.425971+0000, chain.objs.size()=1 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JxYe3HLgABM9HuUs_9BQ0NzdciCwc4M_0 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8054046250347296113', time=2024-09-14T13:27:01.454014+0000, chain.objs.size()=1 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hJI7BTfVvIfTO8ZWz-PLfPCh0FQesQk_0 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3360177202068871517', time=2024-09-14T13:27:01.502768+0000, chain.objs.size()=1 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7MNj8Mb4ppXtlzqm4p0sAJ0W-DWK759_0 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17456268627570375565', time=2024-09-14T13:27:01.519918+0000, chain.objs.size()=1 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.XCqMo5FuUMKjvqx8upcmKrBK9ZOxd6L_0 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5497510438860104838', time=2024-09-14T13:27:01.681150+0000, chain.objs.size()=1 2024-09-14T11:37:46.787 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aKtcLe4Mdo5_51-q5sNsTxLonSgWlhH_0 2024-09-14T11:37:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16087006578147889058', time=2024-09-14T13:27:01.732652+0000, chain.objs.size()=1 2024-09-14T11:37:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eF6PVpbS3KdC0QBuN7S5DJ4j9fOLK-L_0 2024-09-14T11:37:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12648289346669214867', time=2024-09-14T13:27:01.811000+0000, chain.objs.size()=1 2024-09-14T11:37:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.788+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.nhtKjc7_yb6Oej4CIbxfi5Lb2rAt6pg_0 2024-09-14T11:37:46.788 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.789+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.828104949086090255', time=2024-09-14T13:27:01.891213+0000, chain.objs.size()=1 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.789+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wkPSczoDA4B5o-khuMT9XQ7tr7WTdrq_0 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6698423169577676870', time=2024-09-14T13:27:01.894025+0000, chain.objs.size()=1 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ip-RNZ71dgxMyMmOvwC7u7ncL80AX0N_0 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3321007064388822143', time=2024-09-14T13:27:02.040095+0000, chain.objs.size()=1 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.x9qBxUTLvCZGTHE22qq2NrNSTkOh3-K_0 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2869756021865467132', time=2024-09-14T13:27:02.045766+0000, chain.objs.size()=1 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Wl0QCA-cNFVOzcjDuHrnlITeE5no_Im_0 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13377226807228059309', time=2024-09-14T13:27:02.170611+0000, chain.objs.size()=1 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1qTCbs845EVRAXkMD_qiyAf5wlTVwm8_0 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9229569124010028407', time=2024-09-14T13:27:02.177545+0000, chain.objs.size()=1 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hrmlqRLfCKNHp2UAfMMRP3LWj6AcWPU_0 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17183267129950922593', time=2024-09-14T13:27:02.202631+0000, chain.objs.size()=1 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BTslZaOz43bE1IA0h91m36uvnbMOU6c_0 2024-09-14T11:37:46.789 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9652857584608160736', time=2024-09-14T13:27:02.221535+0000, chain.objs.size()=1 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.jKGliLkGKVTGSRgsNSiYVIPIsyfp5OO_0 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8513471579397946305', time=2024-09-14T13:27:02.277978+0000, chain.objs.size()=1 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.twZ4sBCLq3eEUf-EigJvAEc-3F7_uZh_0 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14572535493778178630', time=2024-09-14T13:27:02.365858+0000, chain.objs.size()=1 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.9Pbt5d4y4IYXXnlZPNXjlUkzJ1eOdQI_0 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7468122568167467330', time=2024-09-14T13:27:02.491193+0000, chain.objs.size()=1 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kte8lqVfMHBwZxxxCyLKL0CJBL4sP_v_0 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9909655435388577698', time=2024-09-14T13:27:02.497222+0000, chain.objs.size()=1 2024-09-14T11:37:46.790 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.790+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iLaG9Bf43qLsMJwZfto5Bf6-bbhV9Gu_0 2024-09-14T11:37:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12591368492086185182', time=2024-09-14T13:27:02.509212+0000, chain.objs.size()=1 2024-09-14T11:37:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.si0qp_h3A45wqyYRZILbH4kTUUvE3Yh_0 2024-09-14T11:37:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7795331742527456291', time=2024-09-14T13:27:02.517428+0000, chain.objs.size()=1 2024-09-14T11:37:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ir4j7ZL9AkH9SThmOlFMtvDVjdVRo5a_0 2024-09-14T11:37:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14966923193928135749', time=2024-09-14T13:27:02.630682+0000, chain.objs.size()=1 2024-09-14T11:37:46.791 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.oz3HCnpHAUUFiR4cgi6JhK8PWMRWzQ2_0 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4291391119063886815', time=2024-09-14T13:27:02.662196+0000, chain.objs.size()=1 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.p_bL6G2K_HVQVjyu3DgXTlPaQBL2e-w_0 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10237365844944332283', time=2024-09-14T13:27:02.687851+0000, chain.objs.size()=1 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.abcSrDmDg9HwSlmLbH_EXDP2tl1fM4p_0 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14933066056121628550', time=2024-09-14T13:27:02.717114+0000, chain.objs.size()=1 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7xW9qCq6bpp3dC87py5OH_P_ZaYSCEm_0 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12946696891349456357', time=2024-09-14T13:27:02.924115+0000, chain.objs.size()=1 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.792+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lhtKf4r10rHRW6mcGQ3eD5kNzKHZd6P_0 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4602022315780860530', time=2024-09-14T13:27:02.927125+0000, chain.objs.size()=1 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ggFk7b3vlvktPBHV_dYuiyrMuHvLsee_0 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.865337233897262465', time=2024-09-14T13:27:02.938255+0000, chain.objs.size()=1 2024-09-14T11:37:46.792 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GkGgVugauJsGZlD8_RJLjoGBkCFLs4k_0 2024-09-14T11:37:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13855392215230472755', time=2024-09-14T13:27:02.959174+0000, chain.objs.size()=1 2024-09-14T11:37:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wGfkX4LfuTnD33VkL2kj2waYq1KOPOv_0 2024-09-14T11:37:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.294758316487744189', time=2024-09-14T13:27:04.385702+0000, chain.objs.size()=1 2024-09-14T11:37:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.265__shadow_.Uvy0EyP5WXTAnYrB5NBTwBGV1RhTJUo_0 2024-09-14T11:37:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10241157153914317323', time=2024-09-14T13:27:10.894767+0000, chain.objs.size()=1 2024-09-14T11:37:46.793 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.793+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.279__shadow_.AvuuOWVQ8NkJb5J7FaYifpv_iJVpM-v_0 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2031663157694391964', time=2024-09-14T13:27:11.389165+0000, chain.objs.size()=1 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.280__shadow_.2VC1BTpkIcpF67DaQ72YApjt7DgSAgu_0 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10292738710333240589', time=2024-09-14T13:27:15.209864+0000, chain.objs.size()=1 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.288__shadow_.NOV42M8zWgphL1H9LqMt6MnMYJ0qK9k_0 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1409158557655825825', time=2024-09-14T13:27:17.679454+0000, chain.objs.size()=1 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.mjnKEGmiD4VSNn4w5B0w7UegG5L3YhE_0 2024-09-14T11:37:46.794 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6906041956448610587', time=2024-09-14T13:27:18.497117+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.794+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.7bv6DT98VshBzWNMjR79JubncOVzyUA_0 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2376664010381001758', time=2024-09-14T13:27:40.830108+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.E2I3USLQEgenhXM8jts8-M5AX2iKJwf_0 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6824864302557285276', time=2024-09-14T13:27:40.849810+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hBBb1OaN2NSwOuEKMKQKDVCSSrqDLcB_0 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15011983543096053221', time=2024-09-14T13:27:41.133089+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1RbzkUqmfqo_PiDHfHoBCfFXjty4Buq_0 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2343490883681332272', time=2024-09-14T13:27:41.138357+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Sh7m0VjGCj3D7H2AjWcX33iEXQ51nRW_0 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7606475085142920425', time=2024-09-14T13:27:41.209025+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qclDToah8q1QtzwTVuVSyQedlNBqYQJ_0 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11813943750528834615', time=2024-09-14T13:27:41.291819+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EEha19cMnZjxi7TCwRfkBY3N4g-eJHk_0 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4116728488331854182', time=2024-09-14T13:27:41.319767+0000, chain.objs.size()=1 2024-09-14T11:37:46.795 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.795+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xQhAjk2XomYMKEMVrxYevsitvSs2cVp_0 2024-09-14T11:37:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13371842536109449358', time=2024-09-14T13:27:41.337179+0000, chain.objs.size()=1 2024-09-14T11:37:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5J4H6om1Akm8wWY23aIe_EbwgXi5Lvx_0 2024-09-14T11:37:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17011871712850770385', time=2024-09-14T13:27:41.418045+0000, chain.objs.size()=1 2024-09-14T11:37:46.796 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MkfCVOc67tRhCcP52cteRiVA1AfON_H_0 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15675781600412702402', time=2024-09-14T13:27:41.418901+0000, chain.objs.size()=1 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.R7mIIZ0Sk5EwrEr7fASHJqHw39HoXG-_0 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17931791937847772355', time=2024-09-14T13:27:41.473158+0000, chain.objs.size()=1 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.796+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.P2b6nQpFSMFv7tZ4DS33FdE9oDg88hE_0 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.31143167536346346', time=2024-09-14T13:27:41.569061+0000, chain.objs.size()=1 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cdKknqoJM2ZrGIwgKhBgdxSlnV0rw9g_0 2024-09-14T11:37:46.797 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3115126195947090837', time=2024-09-14T13:27:41.628846+0000, chain.objs.size()=1 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xi7KMzfVnJ7K1UCLATVK1pt2xc1gZFe_0 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6138956443870385721', time=2024-09-14T13:27:41.649802+0000, chain.objs.size()=1 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-10nFW31RSSsyp9g6sbZwrXLvaC2PsQ_0 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6515593603212382869', time=2024-09-14T13:27:41.666284+0000, chain.objs.size()=1 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.797+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.kGbqSKgx2OEZcSOprCgyl8NpZdA4few_0 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3423049542770211555', time=2024-09-14T13:27:41.690916+0000, chain.objs.size()=1 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rWg14ta-FMujkOWSnohFzLlT4xA_tCW_0 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12025911474927397970', time=2024-09-14T13:27:41.693593+0000, chain.objs.size()=1 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.btXgGTquLJ3gfMDgFfrO_mJWX4jVeKd_0 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9816701406559886902', time=2024-09-14T13:27:41.699319+0000, chain.objs.size()=1 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.v52zIx5IIOIlx5_NSBNAakjds91D14S_0 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17976439631918626353', time=2024-09-14T13:27:41.702556+0000, chain.objs.size()=1 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9YuI8GlM61ja4zRSpGn8AYI4VUZ7a8O_0 2024-09-14T11:37:46.798 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16165883580443756967', time=2024-09-14T13:27:41.806910+0000, chain.objs.size()=1 2024-09-14T11:37:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CmTXqFzddf-GHMy0gexMpvWDMOfrabW_0 2024-09-14T11:37:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10247652848859924671', time=2024-09-14T13:27:41.846285+0000, chain.objs.size()=1 2024-09-14T11:37:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6Sbo-bNCSdIZSiNvQukNJOOy1JXoWwD_0 2024-09-14T11:37:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1797520807476870365', time=2024-09-14T13:27:41.886103+0000, chain.objs.size()=1 2024-09-14T11:37:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MA9Gp5A3dPFSRrk8WxJ7TELHvpafM-X_0 2024-09-14T11:37:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10635222900796327070', time=2024-09-14T13:27:41.898319+0000, chain.objs.size()=1 2024-09-14T11:37:46.799 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.798+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._ar-0JiYm-XMWO6TmHKz8OBT_LN8Czn_0 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.799+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2418070058960351943', time=2024-09-14T13:27:41.936434+0000, chain.objs.size()=1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.799+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.k_E8OieVb-lEp9AL7dwOUe5T_KiKjhQ_0 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.799+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11260396983485652908', time=2024-09-14T13:27:42.177200+0000, chain.objs.size()=1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.799+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2f3Vuy5hRRoQmFfCipgbovK9AZB6iyV_0 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.799+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12453067914556688345', time=2024-09-14T13:27:42.179088+0000, chain.objs.size()=1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.799+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rn4v21lPVdhqRRri0NsP6K_y9B7YJxl_0 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2443151938680226046', time=2024-09-14T13:27:42.331825+0000, chain.objs.size()=1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CDg_gWp69Tiu34kg7PXbCrINI_ZiKpF_0 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11003910481615946404', time=2024-09-14T13:27:42.417711+0000, chain.objs.size()=1 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lX6PE2f1bouft_osiXHMC8f6Fzd2mGe_0 2024-09-14T11:37:46.801 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6351901656787710575', time=2024-09-14T13:27:42.421738+0000, chain.objs.size()=1 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cf6HB_zGQeYjO0ulVM_FCQIDR2aD42x_0 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.847045142867566313', time=2024-09-14T13:27:42.563593+0000, chain.objs.size()=1 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.iIfTFx9yyQiB9gNoPP3CfFuGqpxu-_7_0 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10855549113573575293', time=2024-09-14T13:27:42.585340+0000, chain.objs.size()=1 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.AEVX74sx1FtruGGDmYty_tmtYXAc08s_0 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18200979485399964308', time=2024-09-14T13:27:42.598419+0000, chain.objs.size()=1 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Dskp7ZAL5f-8q0JLsB3GdOGKfsfvwol_0 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16437565990942373830', time=2024-09-14T13:27:42.644715+0000, chain.objs.size()=1 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IYfDe1NPCAD-Ii8CkaWWwO6IP7Xvw6M_0 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12613451052413189251', time=2024-09-14T13:27:50.466395+0000, chain.objs.size()=1 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.800+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vpjH_mEGeSRDAns-6pypdAxsfhBay5G_0 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.801+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10884097089095379', time=2024-09-14T13:27:50.484817+0000, chain.objs.size()=1 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.801+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ogr1k1P65ceb6VFyuYWkKlxCgCQ1vn3_0 2024-09-14T11:37:46.802 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5231282097539821332', time=2024-09-14T13:27:50.491323+0000, chain.objs.size()=1 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tMKIxBEByVQR1H9c-XuCU6BPPZLkM1W_0 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6628825615524814203', time=2024-09-14T13:27:50.498520+0000, chain.objs.size()=1 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HsqD_pgrEfdioeP86QnuaNhN5W5UHTE_0 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15691012247008923683', time=2024-09-14T13:27:50.502810+0000, chain.objs.size()=1 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Lu14HQ27Tjbz4Z3VFyplGSIheJF5-T-_0 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8805843105899562809', time=2024-09-14T13:27:50.553200+0000, chain.objs.size()=1 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nKLOOsfOyTWHm5IaAUdn0Eiy1Wdv9Ye_0 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3239728462943685855', time=2024-09-14T13:27:50.696056+0000, chain.objs.size()=1 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.u__2SjwsysRiN5XqkVNWq1NR00jcRhk_0 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9278856812787442104', time=2024-09-14T13:27:50.709613+0000, chain.objs.size()=1 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TxkE-mG9EwCAon_9EemAxpvr9XeHx_R_0 2024-09-14T11:37:46.803 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10180959909429937932', time=2024-09-14T13:27:50.813779+0000, chain.objs.size()=1 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.802+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ktn-hcJlzCNUuOWfxmYpXlHNvrCwEAJ_0 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7594192396171217971', time=2024-09-14T13:27:50.836166+0000, chain.objs.size()=1 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AIA02rVkM10GGuI8DwSWqTZVAFCP6vc_0 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5578225557661328038', time=2024-09-14T13:27:50.845164+0000, chain.objs.size()=1 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bREJvdddzgQlNejOLlpKWzRmwqGkHfk_0 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7298304335530111842', time=2024-09-14T13:27:50.964120+0000, chain.objs.size()=1 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.N6-u6A9zZBM0o_Ki-T7geNUoSHigRbu_0 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11829018486444667643', time=2024-09-14T13:27:51.452021+0000, chain.objs.size()=1 2024-09-14T11:37:46.804 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0Ks_XH8ALxPtSy-aAFzIUcgMS5TR6VA_0 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.357169352616724879', time=2024-09-14T13:27:51.457139+0000, chain.objs.size()=1 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.uNLstROgeXk4qJasLzyrqaFXInAv14t_0 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.958350596015969198', time=2024-09-14T13:27:51.499025+0000, chain.objs.size()=1 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.803+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Yi7wKvmJ_K60T0JbyGmYwzWq3t7LEmE_0 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.804+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16611032010799422656', time=2024-09-14T13:27:51.532755+0000, chain.objs.size()=1 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.804+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Y-tW7R_Y5hBmfrB10GhB5ltefyAEOww_0 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7020353235916272902', time=2024-09-14T13:27:51.538429+0000, chain.objs.size()=1 2024-09-14T11:37:46.805 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.7OptiDRvSiMyF7VhXOhc_vdsGEMwuNS_0 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6255659590015229807', time=2024-09-14T13:27:51.543001+0000, chain.objs.size()=1 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.8rIIHI-NWjyCs66BPhl0NZF65uK_HDF_0 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11173966049560866093', time=2024-09-14T13:27:51.843958+0000, chain.objs.size()=1 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6CUB2DIGdHurof3uP7fQimVUrVz2nON_0 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17869643987704287789', time=2024-09-14T13:27:51.848807+0000, chain.objs.size()=1 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Z5MZCSmbVXoo4AQRrh12wZhx_3Mj1uT_0 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8372197295713482365', time=2024-09-14T13:27:51.871702+0000, chain.objs.size()=1 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.805+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.P2PFRytuN_L1lU1lSV2LYbytTJz3II__0 2024-09-14T11:37:46.806 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.806+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47958 2024-09-14T11:37:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:37:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12834999611710866839', time=2024-09-14T13:27:52.006327+0000, chain.objs.size()=1 2024-09-14T11:37:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AkPPk1-vjIAEx1BjmUj5fyEmIDhuhZT_0 2024-09-14T11:37:46.807 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4244898777938816759', time=2024-09-14T13:27:52.011515+0000, chain.objs.size()=1 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oB1eZAwOj8UDt9BDvHU7a3d9Zp2dQol_0 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13830700590030420076', time=2024-09-14T13:27:52.015297+0000, chain.objs.size()=1 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kQVFFYsqNiDoSQh5onn872UaMD9B96z_0 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17724036943613106660', time=2024-09-14T13:27:52.029093+0000, chain.objs.size()=1 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.elao0mNxqqBmLK2t0IYvm1dqcxW1op-_0 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6823625665098436259', time=2024-09-14T13:27:52.221857+0000, chain.objs.size()=1 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Mjj8-RzLZrEUjZFVjZe8pngJBafbEeD_0 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2961257414815150655', time=2024-09-14T13:27:57.575287+0000, chain.objs.size()=1 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.336__shadow_.VVfI6TIwWc3ENSjS_nXF8NJkJ_BzD7W_0 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9298758217034212309', time=2024-09-14T13:28:19.045165+0000, chain.objs.size()=1 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.382__shadow_.5xe3wTbqjRiqc2wag9EjadDzsk6NTKy_0 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18219725285292900741', time=2024-09-14T13:28:22.883578+0000, chain.objs.size()=1 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.390__shadow_.lJgLMfAt9K4qAUBBaN2udTVk9BvxaL7_0 2024-09-14T11:37:46.808 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11788245776551449377', time=2024-09-14T13:29:03.307849+0000, chain.objs.size()=1 2024-09-14T11:37:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.463__shadow_.P65DS_pUYY1Bp5YeCg9UhxvGFdhfx_l_0 2024-09-14T11:37:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12342569949496152961', time=2024-09-14T13:29:10.600975+0000, chain.objs.size()=1 2024-09-14T11:37:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.QJRb5G4B-PF2bOFtKvs3vCqJm0Pfzlx_0 2024-09-14T11:37:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9979491681969307668', time=2024-09-14T13:29:36.091198+0000, chain.objs.size()=6 2024-09-14T11:37:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.-GOJb08hNCiLtX8QO2Wo1nvAzSAQiQAy.1 2024-09-14T11:37:46.809 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.809+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~UR2pPLEd9kGamZzsbN6K5fFwJKUJEO1.2 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~UR2pPLEd9kGamZzsbN6K5fFwJKUJEO1.3 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~UR2pPLEd9kGamZzsbN6K5fFwJKUJEO1.4 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~UR2pPLEd9kGamZzsbN6K5fFwJKUJEO1.5 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~UR2pPLEd9kGamZzsbN6K5fFwJKUJEO1.6 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3560285041679970382', time=2024-09-14T13:29:46.922220+0000, chain.objs.size()=3 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~BWplWo6KykkgYMOZBo7ZymZmPmjV7FS.1 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~BWplWo6KykkgYMOZBo7ZymZmPmjV7FS.2 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~BWplWo6KykkgYMOZBo7ZymZmPmjV7FS.3 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY', time=2024-09-14T13:29:48.113459+0000, chain.objs.size()=10 2024-09-14T11:37:46.810 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.1 2024-09-14T11:37:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.2 2024-09-14T11:37:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.3 2024-09-14T11:37:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.811+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.4 2024-09-14T11:37:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.5 2024-09-14T11:37:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.6 2024-09-14T11:37:46.811 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.7 2024-09-14T11:37:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.8 2024-09-14T11:37:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.9 2024-09-14T11:37:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.526__multipart_mymultipart.2~U-CLMC7cUnQnO5fGh0NY8hQn2XJZTQY.10 2024-09-14T11:37:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11371492093259685349', time=2024-09-14T13:30:42.957658+0000, chain.objs.size()=1 2024-09-14T11:37:46.812 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.813+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:Vy5dhODcNY-SD..9ElI9F.5Rqqjrwnx_.k16w-OqX-bTnhhfiAvIKrCQ9aaAhJ_c_0 2024-09-14T11:37:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.648601334785083941', time=2024-09-14T13:30:44.998127+0000, chain.objs.size()=1 2024-09-14T11:37:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:AW1lDOt8jWAF0YFAZYXwT.-0qnxqRvQ_.34xE-Hbz1_ELtYEveXwPQcgTynAuvt8_0 2024-09-14T11:37:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18192595581353418185', time=2024-09-14T13:30:49.444166+0000, chain.objs.size()=1 2024-09-14T11:37:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.572__shadow:5SCugPeiyZW2Bg9azMqaPSFwIxSZdUf_.WLu3A-8TRBNDUVJh3_LnmEyz-XOiNXE_0 2024-09-14T11:37:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11326290234549400636', time=2024-09-14T13:30:58.946820+0000, chain.objs.size()=1 2024-09-14T11:37:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:cepWH9dz-AP416LJ1.ibxVMgE3xD4vW_.dYBW0_3Jm2V9ie0WDlp7YNa3CLkxMXQ_0 2024-09-14T11:37:46.813 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2983412023782352874', time=2024-09-14T13:31:00.769266+0000, chain.objs.size()=1 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:osu.cTHqt3GYetFhAEFqng6hmELAAZq_.9akGmigU6Cf0F_SF0M38i4wQE91HBBZ_0 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8321900535128161704', time=2024-09-14T13:31:08.897908+0000, chain.objs.size()=1 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:fFIPikp2jyem41zvwGTaklm2XDYGIzJ_.VnCa7rci57fBEs-1I7oVY_QFTwjWLDw_0 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4189271727953773208', time=2024-09-14T13:31:10.449525+0000, chain.objs.size()=1 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:IRf.dzQzLv2CGta3.ClpCq8sVat4fT4_.Llq3uWnRU70sKcl082DNtA2cHaCUU3l_0 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14691781226772031451', time=2024-09-14T13:31:15.357288+0000, chain.objs.size()=1 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:J1Jlm04csfePGI40.GEn38yV7ngfCj1_.g1iO0sCK7u1os0SlZZMGZVOFAv5JhHB_0 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.735269408594910540', time=2024-09-14T13:33:46.573776+0000, chain.objs.size()=1 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.628__shadow_.sY884M-xNKcyC_NwpmPw7daHT8S8QYe_0 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11799616548783222234', time=2024-09-14T13:34:04.587269+0000, chain.objs.size()=1 2024-09-14T11:37:46.814 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.815+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.663__shadow_.ip_5uw_BkmQAKIaZ75tnI3VsnrxlyEt_0 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.816+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10126241879206712881', time=2024-09-14T13:34:18.622065+0000, chain.objs.size()=1 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.816+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.696__shadow:D6BvAKuOQDONMkvoJRDDb2qWle9QpEe_.gCUqo4FvnA6HKM7i3bnAPwpRNJo2fU0_0 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.816+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11571297154634381679', time=2024-09-14T13:34:26.544616+0000, chain.objs.size()=1 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.816+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.714__shadow:jH9Ewy.qHaJLiI7kAqVcpwXPoKuLmrX_.3SXiF1eBe6MRjyomJMUEtejXb2ltXuf_0 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.817+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10906220146980379765', time=2024-09-14T13:35:12.991978+0000, chain.objs.size()=1 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.817+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.748__shadow_.HpLNF4MG9QY9QIvQa_yFb94cUrd7PSp_0 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.817+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16034430333879076216', time=2024-09-14T13:35:19.850975+0000, chain.objs.size()=1 2024-09-14T11:37:46.815 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.817+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.758__shadow_.HcKlFldTJZaC3nlZi3vgOPwIvMvwEoZ_0 2024-09-14T11:37:46.817 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.819+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.819 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.821+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.822+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.820 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.822+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43909' 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_qbahPIaAYeT7p09vdz8Cj6oSJqtkclD', time=2024-09-14T13:25:00.995893+0000, chain.objs.size()=2 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.165__shadow_.Ntu2NjRLDY4-h0tIQalnsQ9YlgcixSH_0 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.165__shadow_.Ntu2NjRLDY4-h0tIQalnsQ9YlgcixSH_1 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12714927915682732552', time=2024-09-14T13:25:02.261290+0000, chain.objs.size()=1 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.171__shadow_.KfXdPzpVmPCqwD41UaP0hk8YPZhLPYt_0 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11820129496734043667', time=2024-09-14T13:26:36.876818+0000, chain.objs.size()=1 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.228__shadow_.ZZPOnqS52xWG-DbbexCc3H3aYnbrATc_0 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7163330313512529985', time=2024-09-14T13:26:45.455512+0000, chain.objs.size()=1 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.244__shadow_.0Df4FUIrUrFFQREKq1AGdzIb2a2KbxE_0 2024-09-14T11:37:46.822 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3588100908521727751', time=2024-09-14T13:26:47.374121+0000, chain.objs.size()=1 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.248__shadow_.NbRSaGT2Z56UkHiVl1Vlhz_WiBCVq36_0 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6008431299756532022', time=2024-09-14T13:26:48.295856+0000, chain.objs.size()=1 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.250__shadow_.e_pWBFbj0Mh91LTQVTLgNgVUJ9leg_b_0 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12521377273282748114', time=2024-09-14T13:27:01.241748+0000, chain.objs.size()=1 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bXBZYLWND1aN3kalRdl_6lAvJyaaIgD_0 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1221453783006838682', time=2024-09-14T13:27:01.416678+0000, chain.objs.size()=1 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ocx8rG36KQnHL1bHvS91P3D32-_qZhb_0 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13884306816319067550', time=2024-09-14T13:27:01.430252+0000, chain.objs.size()=1 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.4fVtBTvkm81eEe_VBwWQApaOQoJ5FES_0 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13612419104777110274', time=2024-09-14T13:27:01.532196+0000, chain.objs.size()=1 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.KMdnMtbuyZKNru1cxwKI--2chGg9voH_0 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4652000683654018506', time=2024-09-14T13:27:01.549015+0000, chain.objs.size()=1 2024-09-14T11:37:46.823 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.823+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.FEws0f2l7Ig4Od_KqX_tHR5nnPJOoSJ_0 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14326086159916346594', time=2024-09-14T13:27:01.701185+0000, chain.objs.size()=1 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.rAG6YQEkcLqSOmtGXEZ3q4mFL0tThtu_0 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12692156727122916820', time=2024-09-14T13:27:01.778293+0000, chain.objs.size()=1 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.EEy1ex5hnSUuhqJS0f_Xd13BDWQGf0E_0 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3481372871916667339', time=2024-09-14T13:27:01.896689+0000, chain.objs.size()=1 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3mLRZ3g2bVF2tVhCg1yXf29AA7Np4dg_0 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3144685534654238881', time=2024-09-14T13:27:01.898416+0000, chain.objs.size()=1 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.f-IyGpPbmQa2pmxxZ72EL86uckBcJPS_0 2024-09-14T11:37:46.825 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15934748033658200913', time=2024-09-14T13:27:01.915477+0000, chain.objs.size()=1 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.DnJ8jrjmHrjSYig87WbhJFxV94tfVBa_0 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2999271791373833188', time=2024-09-14T13:27:02.002561+0000, chain.objs.size()=1 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Bw3tMm-vWqokKcLAmd11k6pbiTiAXtX_0 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15841629867074869615', time=2024-09-14T13:27:02.004506+0000, chain.objs.size()=1 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yBZ2VVwXX0b7TBuR_p4TSQcuXVeU6ub_0 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8039142221389989314', time=2024-09-14T13:27:02.012853+0000, chain.objs.size()=1 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2yTWQ8IhaCTpFbSt0MSn_ypyCOD4LcR_0 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13315286649228423829', time=2024-09-14T13:27:02.017013+0000, chain.objs.size()=1 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qVURthrvEeC__mq2ohKvSxdNmSQ1EYj_0 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10934819475674953277', time=2024-09-14T13:27:02.128239+0000, chain.objs.size()=1 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LNvbr82DSJR7qqktOJg9XX4uLgDwS8D_0 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12111726761274784680', time=2024-09-14T13:27:02.228806+0000, chain.objs.size()=1 2024-09-14T11:37:46.826 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.827+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.LDFF6AXPXU9D8uFcMTNM-b5KG3B89hH_0 2024-09-14T11:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14154405198270943982', time=2024-09-14T13:27:02.274213+0000, chain.objs.size()=1 2024-09-14T11:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-QLjadkIJixm5cEkqbA5Inh6ziWkdKd_0 2024-09-14T11:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15132874740329589091', time=2024-09-14T13:27:02.457946+0000, chain.objs.size()=1 2024-09-14T11:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.B2-9hgCm9hxASbu2GbbWZshZ5Mp7MLH_0 2024-09-14T11:37:46.827 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8034698843234904483', time=2024-09-14T13:27:02.507769+0000, chain.objs.size()=1 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ns-yLDEeRr8noQ--7jTBn4NcmMztOhE_0 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4048593081437488319', time=2024-09-14T13:27:02.600528+0000, chain.objs.size()=1 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HmNkXKqlJhBEUONV3dUL12HuzKpxNRg_0 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14476625834305850438', time=2024-09-14T13:27:02.601801+0000, chain.objs.size()=1 2024-09-14T11:37:46.828 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.828+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CDptyMD7aAX0Ui-AoOUIJMnzClNMESE_0 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10712797918664983368', time=2024-09-14T13:27:02.627486+0000, chain.objs.size()=1 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.L3PdKr65exnR5EoHSHu5262YiAj2ijI_0 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12941441118067968920', time=2024-09-14T13:27:02.657855+0000, chain.objs.size()=1 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7Ryb-3P4ay7ve4szwodhx2brl-64hC9_0 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16297904329773182016', time=2024-09-14T13:27:02.854302+0000, chain.objs.size()=1 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.H1qqBOgYtJmCyQfWHSZgKGWj2XyuXHj_0 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6608896330279645893', time=2024-09-14T13:27:02.882500+0000, chain.objs.size()=1 2024-09-14T11:37:46.829 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.w0N2L8IOkP8uns_7LLxeqe4Mwsm73Nt_0 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18202467941586527621', time=2024-09-14T13:27:02.905669+0000, chain.objs.size()=1 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eaVfuVysSNvukPWUJEq2FuSTJQjBlfP_0 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10190674033239668516', time=2024-09-14T13:27:02.920544+0000, chain.objs.size()=1 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6CkQf7bc8TYDIVeysO5uHnWjchuIlOP_0 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5662552490902156373', time=2024-09-14T13:27:02.926491+0000, chain.objs.size()=1 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZYdii29Y1ba9GT60oP-J7DLHR6t3Wrr_0 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8630845357721805914', time=2024-09-14T13:27:02.942577+0000, chain.objs.size()=1 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PjULPu-2dR5QwrFxVpxxOBIHQpjWRwp_0 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15107746169654865862', time=2024-09-14T13:27:06.650598+0000, chain.objs.size()=1 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.270__shadow_.tq42jC3yjskT7fiP65PoxxW5AciylDJ_0 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.500466951098110377', time=2024-09-14T13:27:08.530062+0000, chain.objs.size()=1 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.274__shadow_.vjJLQMf9a2IlcnX9mMnq0LAYLxfdYT6_0 2024-09-14T11:37:46.830 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16199926805607017975', time=2024-09-14T13:27:09.457562+0000, chain.objs.size()=1 2024-09-14T11:37:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.830+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.276__shadow_.YxL3sOVgUkeIjxdwRIKa0BVZCax9BtW_0 2024-09-14T11:37:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15913729826095764934', time=2024-09-14T13:27:09.990455+0000, chain.objs.size()=1 2024-09-14T11:37:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.277__shadow_.K-lsuQTy_hozjPwrPUXGpld2EKMWuix_0 2024-09-14T11:37:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6645869164823572102', time=2024-09-14T13:27:12.766242+0000, chain.objs.size()=1 2024-09-14T11:37:46.831 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.283__shadow_.XfMl0Ii9Y6KIKsJhwU7LgYD0Q5Kx40h_0 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12310628201703818158', time=2024-09-14T13:27:13.778575+0000, chain.objs.size()=1 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.285__shadow_.LfEj6r4Q1dkDIh5oiOH38O7lIq8NqRO_0 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14047011172382864239', time=2024-09-14T13:27:15.655506+0000, chain.objs.size()=1 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.832+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.289__shadow_.HWXSswiTArR04rGD9SbDoPUYabtDMkj_0 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7505975268007045305', time=2024-09-14T13:27:20.918806+0000, chain.objs.size()=1 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.298__shadow_.AGOAxl3Vb5fDpL8AuQk4qm9OcGy5ghO_0 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2897915185982174240', time=2024-09-14T13:27:31.728982+0000, chain.objs.size()=1 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.319__shadow:aVkyiVARGYYZO7hxSPmOyMPaN7rt18K_.cTuwANZeIwyxPuxBXF6chbU010GG6Z6_0 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1567716685202252905', time=2024-09-14T13:27:40.843234+0000, chain.objs.size()=1 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ETzhcBbiJBr3cTiMHmS53FAFuZaEnem_0 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15236108216019794974', time=2024-09-14T13:27:40.860979+0000, chain.objs.size()=1 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qh7phc5yCSsHGXlfMm9RCO_uPnxzIDU_0 2024-09-14T11:37:46.832 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13110713546285157222', time=2024-09-14T13:27:40.877642+0000, chain.objs.size()=1 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CSlkxKxF0KSkJNorW5vZULFe6VLNjOL_0 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18207065952659231170', time=2024-09-14T13:27:40.935575+0000, chain.objs.size()=1 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Pyuz-qcBwwOBhr6s9e3eU9RkN2nrJ5L_0 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15231470147621141616', time=2024-09-14T13:27:41.036123+0000, chain.objs.size()=1 2024-09-14T11:37:46.833 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rqFJZa1dq7qPL58i78vnkp6Ou2t7_9Q_0 2024-09-14T11:37:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.494825858252825703', time=2024-09-14T13:27:41.043838+0000, chain.objs.size()=1 2024-09-14T11:37:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.833+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uAOLnMuR3HOwICAjFQxmfqKicIq7VpY_0 2024-09-14T11:37:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.834+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17448524055883742490', time=2024-09-14T13:27:41.047520+0000, chain.objs.size()=1 2024-09-14T11:37:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.834+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3tPxS60PfaiHWQcXijrtu44KvSak4Ho_0 2024-09-14T11:37:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.834+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7056752004934053639', time=2024-09-14T13:27:41.084128+0000, chain.objs.size()=1 2024-09-14T11:37:46.834 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.834+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6eSEfu4NCHAa-QoOZ7ADfOFuJcBLCL5_0 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11354497384563730029', time=2024-09-14T13:27:41.088869+0000, chain.objs.size()=1 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.MyXb6uIvOaN0iBr2zNIgHQNyW4uAdvk_0 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7826798431007063893', time=2024-09-14T13:27:41.114664+0000, chain.objs.size()=1 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.K59brQdrYqK_gedXvEp-NvYa8vdCrcX_0 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18256201697189576499', time=2024-09-14T13:27:41.127878+0000, chain.objs.size()=1 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PDIn64MSkJ5e9bYSRvpCwsKty9xBmUE_0 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7600705754308068050', time=2024-09-14T13:27:41.302798+0000, chain.objs.size()=1 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.xeBUjO0xaAoKZRZyBGEe_uHatraexzO_0 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10422708433519881762', time=2024-09-14T13:27:41.334837+0000, chain.objs.size()=1 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.B_k_l7PDlRTsO9hUzUPvax_7km8jvIc_0 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8754847855759350309', time=2024-09-14T13:27:41.354235+0000, chain.objs.size()=1 2024-09-14T11:37:46.835 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ctpiRNlZWu5vpwEGaaj7Q3D-qhXmTfq_0 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11759448650180135041', time=2024-09-14T13:27:41.359383+0000, chain.objs.size()=1 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ke8ez2J8a6ssXVaNanTeZ-TLmbcl1xk_0 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9609055090880646178', time=2024-09-14T13:27:41.407415+0000, chain.objs.size()=1 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tkBJxVxxCphiTcVs-4IIyj4wVC2qrIW_0 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8775135668352664228', time=2024-09-14T13:27:41.419648+0000, chain.objs.size()=1 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.835+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EnyrGJ_orLwuKWBOQSAm1Pfd8yo6N2E_0 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.836+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10508719387223559920', time=2024-09-14T13:27:41.561578+0000, chain.objs.size()=1 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.836+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vXaOFWdpXaeuGUOP7ixWDWdh5zl9zqe_0 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.836+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3959145877898755941', time=2024-09-14T13:27:41.594634+0000, chain.objs.size()=1 2024-09-14T11:37:46.836 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.836+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4NePEHfdyUIy60U1ry-j0OisOTlzChR_0 2024-09-14T11:37:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10165392053722567973', time=2024-09-14T13:27:41.600649+0000, chain.objs.size()=1 2024-09-14T11:37:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vKpIe9MKuJ9b4evnQASlnkYu4aAbx87_0 2024-09-14T11:37:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15345345035669216642', time=2024-09-14T13:27:41.628805+0000, chain.objs.size()=1 2024-09-14T11:37:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2SumxbJkGoION_1FM2OJK8SceJiJyDH_0 2024-09-14T11:37:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1274016611840321633', time=2024-09-14T13:27:41.660374+0000, chain.objs.size()=1 2024-09-14T11:37:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7i-9kdLvugZTSFD0L84cadBU3yws2Ue_0 2024-09-14T11:37:46.837 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12919244478221883779', time=2024-09-14T13:27:41.716254+0000, chain.objs.size()=1 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.tG9fbil71PtvxBtUzC5tHr3NoxvBT4K_0 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14676491349965799171', time=2024-09-14T13:27:41.725673+0000, chain.objs.size()=1 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YmblZheApVJZbqSCyQYUye3UZmwqjC3_0 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13547126582605115660', time=2024-09-14T13:27:41.811781+0000, chain.objs.size()=1 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.d71sIGh34tQYTI7Brfp6a5ZTf7-SrRl_0 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.345888932171511091', time=2024-09-14T13:27:41.832975+0000, chain.objs.size()=1 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.54QiD1aaYXc4_prXH8rovd_x1-8SK2T_0 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13711555561922810237', time=2024-09-14T13:27:41.850826+0000, chain.objs.size()=1 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.TSszIsvMKTRAoPgl9r1DspdePSGxnh3_0 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16389148310433549435', time=2024-09-14T13:27:41.853434+0000, chain.objs.size()=1 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ib_pNgmJireePDRaP0Pcii-aSUBfKul_0 2024-09-14T11:37:46.838 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3785711617425906532', time=2024-09-14T13:27:41.893279+0000, chain.objs.size()=1 2024-09-14T11:37:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GUdMASEzfPKSQRUem8GVHBUwQiXg9Ce_0 2024-09-14T11:37:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11036681952715855876', time=2024-09-14T13:27:41.945714+0000, chain.objs.size()=1 2024-09-14T11:37:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.838+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KgU1Gjew-brsg4mtYSTKfw0qjG2AEWV_0 2024-09-14T11:37:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.839+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14447389915609442359', time=2024-09-14T13:27:42.133219+0000, chain.objs.size()=1 2024-09-14T11:37:46.839 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.839+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bMjcSqMALpo4M_3FpwhU60JNZ-Uz6RP_0 2024-09-14T11:37:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15177546546535529373', time=2024-09-14T13:27:42.140051+0000, chain.objs.size()=1 2024-09-14T11:37:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OJZNYKZPSRaVBqp3PgZ0ppLBIptMiKI_0 2024-09-14T11:37:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11048109891409704399', time=2024-09-14T13:27:42.144997+0000, chain.objs.size()=1 2024-09-14T11:37:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.S_k-iDMrRDqM4qypckBRMdfAX_xCZQC_0 2024-09-14T11:37:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11343547833808327663', time=2024-09-14T13:27:42.150789+0000, chain.objs.size()=1 2024-09-14T11:37:46.840 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.x1bAwQEsuqAUo8Wz9kQQ23l8eQStTAw_0 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12983083982259790486', time=2024-09-14T13:27:42.208367+0000, chain.objs.size()=1 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4r3bQ2B3HTrP4sVjemAQc-IExDrawo7_0 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15151498901501866698', time=2024-09-14T13:27:42.353433+0000, chain.objs.size()=1 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zQC-erjl8WftzOI7k7Bk1ZhhWFzHjwg_0 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14906491208316722575', time=2024-09-14T13:27:42.357152+0000, chain.objs.size()=1 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.A5WJ_rbD-2tDLfqqc5J6fPyFYAoJypS_0 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5337404487477074454', time=2024-09-14T13:27:42.427930+0000, chain.objs.size()=1 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IhHy--3QXzNXoo3Qx44tl80eJUhLGum_0 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7487390210670516375', time=2024-09-14T13:27:42.432330+0000, chain.objs.size()=1 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.840+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ipLh2P_06uvdc5SvC_SszIeRqv316DY_0 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13794390903626413879', time=2024-09-14T13:27:42.437960+0000, chain.objs.size()=1 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IrrDOQLxt3Beags-dZKZUTmohN6k79J_0 2024-09-14T11:37:46.841 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13855594099600558832', time=2024-09-14T13:27:42.449011+0000, chain.objs.size()=1 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zvlBmX5-vCrkl_45_FFSyMWAgHEP5Hv_0 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.841+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7630241487690219912', time=2024-09-14T13:27:42.469596+0000, chain.objs.size()=1 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.841+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nxn_KzLuMIU-AlP22haF0K9rDu58AEt_0 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.842+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6238747128439123934', time=2024-09-14T13:27:42.480040+0000, chain.objs.size()=1 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.842+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LU_vUD9v7fy5EOpbAhg8cTrWjnhvti8_0 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.842+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7246309602171498217', time=2024-09-14T13:27:42.577312+0000, chain.objs.size()=1 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.842+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Y2yo0CZOpJNbcJseP67u0AYkgbD2Faj_0 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.842+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5541757261168864167', time=2024-09-14T13:27:42.667784+0000, chain.objs.size()=1 2024-09-14T11:37:46.842 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.842+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UOtfc3JdsbdFoa-f50NgmRqh_5Qxuzt_0 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6628429182646155885', time=2024-09-14T13:27:50.476671+0000, chain.objs.size()=1 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.sHgkaDg08cT6k6U4Fc91G5PFbQtB9Dx_0 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14564984233639840062', time=2024-09-14T13:27:50.676939+0000, chain.objs.size()=1 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DdpLpKoGbxlZgcJEwt8iTfLzPmixJlG_0 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11937906610003000730', time=2024-09-14T13:27:50.693196+0000, chain.objs.size()=1 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Y4R5eooJHABOOgXjGgujhaSImBpFI9S_0 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16908714565769182287', time=2024-09-14T13:27:50.701050+0000, chain.objs.size()=1 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.843+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vuqxx4D7SUiIo_n2AFluYQoBzNzm1Hh_0 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10394703981778326939', time=2024-09-14T13:27:50.710324+0000, chain.objs.size()=1 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BUSqFSE3gDAyFJt8ZeArCZ2TDmmF6G-_0 2024-09-14T11:37:46.843 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7575384808395247822', time=2024-09-14T13:27:50.732050+0000, chain.objs.size()=1 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1X-bZYsDcaddl20Mp-x8PjPtOCrNvgY_0 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14386598833562280337', time=2024-09-14T13:27:50.759968+0000, chain.objs.size()=1 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BIB9nOWJvHjGrnoq47mCnT1z5LMdHWj_0 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2650294197348105904', time=2024-09-14T13:27:50.785324+0000, chain.objs.size()=1 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0AjvxwYdhQT2T7NgcT0l2ZcJHqcxx0w_0 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18357001339748714473', time=2024-09-14T13:27:50.818636+0000, chain.objs.size()=1 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-oVlIiXXe-dv6NfaDHd7W1btVXoeCBq_0 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14090793357198594776', time=2024-09-14T13:27:50.970473+0000, chain.objs.size()=1 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YP19pM2EBObZYX9_Srg9oGYJFLDER3Y_0 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8637253531286451247', time=2024-09-14T13:27:50.982939+0000, chain.objs.size()=1 2024-09-14T11:37:46.844 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.844+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Fspm6rD9KhdLaSc9Y1p5abZ-2_72zOt_0 2024-09-14T11:37:46.845 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.846+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/43909 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=34, truncated=0, next_marker='' 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11646863338301670998', time=2024-09-14T13:27:51.094221+0000, chain.objs.size()=1 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.n8TzvRNtCaZanp5Q8T32qMJQjyoYeiQ_0 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9984146812259060111', time=2024-09-14T13:27:51.106058+0000, chain.objs.size()=1 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.4oBiRFgZmnS3l6w-HayJ0L07PDdCm3i_0 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16809838319105888687', time=2024-09-14T13:27:51.236444+0000, chain.objs.size()=1 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xZGTp2HM9-Ed_11qmETVeVQgr2etQwM_0 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8762209169482621027', time=2024-09-14T13:27:51.331001+0000, chain.objs.size()=1 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Qr6-tTkkoVjS-hog5xkA0L0ibf9x01c_0 2024-09-14T11:37:46.847 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11916618800938694225', time=2024-09-14T13:27:51.446859+0000, chain.objs.size()=1 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bJN7FjoVHGtx_Py51cj2xkenO1-UGAt_0 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12368036893227287200', time=2024-09-14T13:27:51.458913+0000, chain.objs.size()=1 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lztahtK6XNZXEayC3UyIpVe3x1ruiQ4_0 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17885072111999699203', time=2024-09-14T13:27:51.481740+0000, chain.objs.size()=1 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1Rn6xcr2CqNCDTcuBm3083mtdkzASws_0 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17264275429809007065', time=2024-09-14T13:27:51.499118+0000, chain.objs.size()=1 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.oYYr2I9siFip1CTOkmdf9CsiJz9tsdT_0 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.65418526761091195', time=2024-09-14T13:27:51.616921+0000, chain.objs.size()=1 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0_lxcgdIOcVisEIySAK2GpzURnkSkH9_0 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4966255546865614269', time=2024-09-14T13:27:51.743944+0000, chain.objs.size()=1 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.2If0M3dXlqjZVUBAAZTyuHokCRrAL3X_0 2024-09-14T11:37:46.848 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2532733539239825329', time=2024-09-14T13:27:51.853453+0000, chain.objs.size()=1 2024-09-14T11:37:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iR8wFIwqicjBz00YDyaqB_CmizfZXlX_0 2024-09-14T11:37:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.212420606474146037', time=2024-09-14T13:27:52.072020+0000, chain.objs.size()=1 2024-09-14T11:37:46.849 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.848+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SXGsFaBVEwCBGflAKcIkaVUT-RbbUbG_0 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8116551581073684386', time=2024-09-14T13:27:52.079664+0000, chain.objs.size()=1 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.W71bAr3kRevpK4KV8tbYTxGpI9fzcrF_0 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10015596488240079047', time=2024-09-14T13:27:52.247894+0000, chain.objs.size()=1 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.N1zV09Eh-bReqY3rAtQox6eWYU0DBk0_0 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5801267286909063274', time=2024-09-14T13:27:52.255220+0000, chain.objs.size()=1 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.tP4C_JGB2riFoBrx7PNjYv9kzBSJQXB_0 2024-09-14T11:37:46.850 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9153343878896164328', time=2024-09-14T13:27:52.307860+0000, chain.objs.size()=1 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.850+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._ntq1rwmzG7tocIHdxhgk87t25Wyi8U_0 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2981052266531944359', time=2024-09-14T13:29:27.555741+0000, chain.objs.size()=1 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.517__shadow_.7fAaJzCZXR4NO2_EzWIAu4HwHGgSQOk_0 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9815564066697405895', time=2024-09-14T13:29:37.981981+0000, chain.objs.size()=6 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~eGB-ZOhEtSmmGd90d8dYspz8HQQKK7d.1 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.O0sBbOeOUsC8FCgDyTUI7WdTRth4m5P2.2 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~eGB-ZOhEtSmmGd90d8dYspz8HQQKK7d.3 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~eGB-ZOhEtSmmGd90d8dYspz8HQQKK7d.4 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~eGB-ZOhEtSmmGd90d8dYspz8HQQKK7d.5 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.851+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~eGB-ZOhEtSmmGd90d8dYspz8HQQKK7d.6 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8732143647738663647', time=2024-09-14T13:29:45.802227+0000, chain.objs.size()=1 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.525__multipart_mymultipart.2~MTnyOh-xcmo1q3zbxR3bdsTuRm09aro.1 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.852+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12179193674900586208', time=2024-09-14T13:30:28.431398+0000, chain.objs.size()=1 2024-09-14T11:37:46.851 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.852+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.553__shadow_.mz4swtiGBYKOm8BJl9VIm1sNoei1yHS_0 2024-09-14T11:37:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.853+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6064294132406312255', time=2024-09-14T13:30:39.483471+0000, chain.objs.size()=1 2024-09-14T11:37:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.853+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.565__shadow_.1X_XuSQEQ-qWv2ZNX_m4Jrs8RXMkDGu_0 2024-09-14T11:37:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.853+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6243094891284022587', time=2024-09-14T13:30:50.989033+0000, chain.objs.size()=1 2024-09-14T11:37:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.853+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow_.R_JmhRDPK2Lr-n6shbAewLchYiv569h_0 2024-09-14T11:37:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14842682084967741265', time=2024-09-14T13:30:57.994497+0000, chain.objs.size()=1 2024-09-14T11:37:46.852 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:WzjrsqXeUJiSlbnyXLyP83FdTQQelKo_.Jw48Id9xmvyLXh2pP3dL4mSaY2rKYCF_0 2024-09-14T11:37:46.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.854+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1927167823622938775', time=2024-09-14T13:31:07.341130+0000, chain.objs.size()=1 2024-09-14T11:37:46.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.854+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:HB9hJoMBs.QogJXyuDa118ORYrtCTd9_.svEFBhWPoxK9Me2dqDuZhsXhk2pJDlB_0 2024-09-14T11:37:46.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14479097452707372076', time=2024-09-14T13:33:39.513284+0000, chain.objs.size()=1 2024-09-14T11:37:46.853 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.618__shadow_.t8GWXNNRfvNUOIKEplIlw6E9D5GFzhQ_0 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11029579359109677139', time=2024-09-14T13:33:47.966282+0000, chain.objs.size()=1 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.631__shadow_.9nMhNqDtF0p1mC_kHP8UNCzuXoZnuL7_0 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15065108886050711345', time=2024-09-14T13:33:54.610393+0000, chain.objs.size()=1 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.645__shadow_.IqIV4818PS71Jg6FHWh_gWRQOs1KQ8M_0 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6297344019078319188', time=2024-09-14T13:34:00.295824+0000, chain.objs.size()=1 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.655__shadow_.mTbFceiGC2BKiA6jJvGsyRqXyWxAgdH_0 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9202350711121816520', time=2024-09-14T13:34:06.600725+0000, chain.objs.size()=1 2024-09-14T11:37:46.854 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.855+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.666__shadow_.l5OE_VGkygfAzY3mxRI7aO6ELHQyOvs_0 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14174726754538875890', time=2024-09-14T13:34:06.601463+0000, chain.objs.size()=1 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.666__shadow_.BW2kFl7p9XfiMFUJr0ypKVGwktVZVLr_0 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16152661044341250004', time=2024-09-14T13:34:19.076134+0000, chain.objs.size()=1 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.697__shadow:yYaAFdqrY8Hyg9YRuzfnmMUqqqe9RhY_.seaf5JrbirdXxgoH-QO0XlQv7Q_7Yjr_0 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8507071491172506517', time=2024-09-14T13:34:26.188170+0000, chain.objs.size()=1 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.713__shadow:.21ZLmyO5xDwNxQ2DIi62rWuheh0.XV_.WT276DRZGnqwd5GlicXR0fLmv1fcI71_0 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1631757798730187705', time=2024-09-14T13:34:47.549270+0000, chain.objs.size()=1 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.718__shadow_.Ba1MPS78hrujeZQ3D0A0By5jdYEsrt5_0 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3252893499721563743', time=2024-09-14T13:35:06.555484+0000, chain.objs.size()=1 2024-09-14T11:37:46.855 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.856+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.745__shadow_.iDct4XmFap0Y229zcC3sVeLtIF41daO_0 2024-09-14T11:37:46.856 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.858+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.858 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.860+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-14T11:37:46.859 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.862+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.860 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.862+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/48681' 2024-09-14T11:37:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_XSr4uWAqLlMNWlSal5ZVQosG_EPMhbn', time=2024-09-14T13:24:58.954531+0000, chain.objs.size()=2 2024-09-14T11:37:46.861 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.-bM2OOZc_tMmJ21182oXt6QpemxFbSs_0 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.-bM2OOZc_tMmJ21182oXt6QpemxFbSs_1 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='_Fg9v8u47CV6H7lF7dJjuwlgGy9u9t2u', time=2024-09-14T13:24:59.675710+0000, chain.objs.size()=2 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.0NI142L_dcrHq0iwjJBGLZSuLbxYauv_0 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:17edae97-cd6b-4c90-863d-862429a20cf3.4538.161__shadow_.0NI142L_dcrHq0iwjJBGLZSuLbxYauv_1 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15318061660892301506', time=2024-09-14T13:26:39.789830+0000, chain.objs.size()=1 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.235__shadow_.TNtjJLHTELyKvVeNA19_xY9LI0fh4aQ_0 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12472031486028078955', time=2024-09-14T13:26:40.267914+0000, chain.objs.size()=1 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.236__shadow_.juGUl7iuOJJhEM5v2gVeyMBKG-xtTyu_0 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16731759873443504252', time=2024-09-14T13:26:41.904152+0000, chain.objs.size()=1 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.238__shadow_._qCWZotCF3utQIYAgSgclciLwGC-CyJ_0 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9990297509109392556', time=2024-09-14T13:26:43.306310+0000, chain.objs.size()=1 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.241__shadow_.toqXG3GqwtgVqPMYe7tJ7xX_rr5Fv0-_0 2024-09-14T11:37:46.862 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.141043749510834390', time=2024-09-14T13:26:49.704329+0000, chain.objs.size()=1 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.253__shadow_.SPyI5gwwoUEq-kJ8DG_9ivvpbIQL5bC_0 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10015011380266621055', time=2024-09-14T13:27:01.297606+0000, chain.objs.size()=1 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.NOtspmNugidzK9z3d45cCxwoLepr9Qd_0 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9861557786134761628', time=2024-09-14T13:27:01.484480+0000, chain.objs.size()=1 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0LLbrLAJXngxwekcFT51Q0sP6hG9xWq_0 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13733237841050361018', time=2024-09-14T13:27:01.685789+0000, chain.objs.size()=1 2024-09-14T11:37:46.863 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.863+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6a6MvXUcgOcr8saiIdIwrjrhBD1PSTl_0 2024-09-14T11:37:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.866+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2417006451378424238', time=2024-09-14T13:27:01.791991+0000, chain.objs.size()=1 2024-09-14T11:37:46.864 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.866+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ahgIJoMAeavk9dwP5c34Vx_CiILJoKb_0 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14923669040818823370', time=2024-09-14T13:27:01.944767+0000, chain.objs.size()=1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.C0yDyeVV5mUUBRHsBuuxKR3P4eEwFFA_0 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1976499074447041577', time=2024-09-14T13:27:01.967519+0000, chain.objs.size()=1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yWAScagIF6kTJRedbKhY4Cof6sk1Cdd_0 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8998136023856671966', time=2024-09-14T13:27:01.995418+0000, chain.objs.size()=1 2024-09-14T11:37:46.865 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.va5GwA5tuoZH_JgmwGIZms20AeNYFCx_0 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13040081092436405748', time=2024-09-14T13:27:02.134307+0000, chain.objs.size()=1 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JFn1CZpxdYqQzl3Gzx_9mOwVAHj5JsS_0 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6952014647561547350', time=2024-09-14T13:27:02.163932+0000, chain.objs.size()=1 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ee-hZiIY7_DbHy0j4IiNR4y210CwO36_0 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5001365147738886899', time=2024-09-14T13:27:02.193604+0000, chain.objs.size()=1 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BFpm3eWMMjHcRne94oCFfHm9a7-HwWp_0 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2118007751363449108', time=2024-09-14T13:27:02.201510+0000, chain.objs.size()=1 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1FSn0IWwdkKYkLYWMcYk5B_15H_4rzf_0 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17017481005509363841', time=2024-09-14T13:27:02.209661+0000, chain.objs.size()=1 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Zcl-Jtm_qM1nlUtwIXQH6hcKcGTuxU0_0 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3080795731860722008', time=2024-09-14T13:27:02.266584+0000, chain.objs.size()=1 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.PYgfFW8prh4e7CIjYWK5ERwKr8WMrGn_0 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3999656094516586305', time=2024-09-14T13:27:02.436622+0000, chain.objs.size()=1 2024-09-14T11:37:46.866 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.867+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.grr1X_-5bh4fFHK3fl7t3lnjUxQIPJM_0 2024-09-14T11:37:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.868+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8872484705036219677', time=2024-09-14T13:27:02.457362+0000, chain.objs.size()=1 2024-09-14T11:37:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.868+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.x26PsgCQlYMH-Ov1raB9E7rtaGu38_6_0 2024-09-14T11:37:46.867 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10125972161739801087', time=2024-09-14T13:27:02.469664+0000, chain.objs.size()=1 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kJURUzLN-mDga4V4c7YThUnsjSK4Khm_0 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11402740247798177959', time=2024-09-14T13:27:02.481423+0000, chain.objs.size()=1 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-yFEZDEitXsLJ9GqpGGSjixdF5FkrZZ_0 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9069546487054572610', time=2024-09-14T13:27:02.492814+0000, chain.objs.size()=1 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eCF49dTUByGtKGaJ6WmWLW_b-69bwPg_0 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8644478702071003577', time=2024-09-14T13:27:02.627823+0000, chain.objs.size()=1 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OnUcQiKSDh8gIuR7q-LDtVDNosdKppq_0 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8874677960134005743', time=2024-09-14T13:27:02.695675+0000, chain.objs.size()=1 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.HVPdUkCJbgVGrEz9RwWL9JP9uvuvyzp_0 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4474725833370771806', time=2024-09-14T13:27:02.834399+0000, chain.objs.size()=1 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fP8-n8rWWfxTroaAy9E9NFLDiFIdHYL_0 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1375210546220149478', time=2024-09-14T13:27:02.866658+0000, chain.objs.size()=1 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ZWdG6wxfux6vC8YSl5a831n2iAnVEsO_0 2024-09-14T11:37:46.868 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7627054476757757678', time=2024-09-14T13:27:02.878575+0000, chain.objs.size()=1 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QaxYHDuqmY9Rh4dsM7Q_s-dCk-BRKNm_0 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15637186737301519927', time=2024-09-14T13:27:05.277280+0000, chain.objs.size()=1 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.267__shadow_.PnrbnP6BGVQApkjy2-7yYVZB9qhIy8o_0 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11350034275174499840', time=2024-09-14T13:27:05.277961+0000, chain.objs.size()=1 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.869+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.267__shadow_.NqI6uszBJxrhaLV9J4dSriT-5Wjnj73_0 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.870+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13597904329604430608', time=2024-09-14T13:27:05.710995+0000, chain.objs.size()=1 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.870+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.268__shadow_.1z8482rURWx78lBDGNI8QD_gHYt5iPU_0 2024-09-14T11:37:46.869 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9701406470952178878', time=2024-09-14T13:27:11.390755+0000, chain.objs.size()=1 2024-09-14T11:37:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.280__shadow_.Iwsh7n0Is4gruDD_5Xl-eFkdpZpT7Ji_0 2024-09-14T11:37:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.871+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10857912412052230805', time=2024-09-14T13:27:15.654841+0000, chain.objs.size()=1 2024-09-14T11:37:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.871+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.289__shadow_.Eh7vEqg-UiHCZT_OOegsHBiBMXXsuAq_0 2024-09-14T11:37:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5353438797462890055', time=2024-09-14T13:27:15.655883+0000, chain.objs.size()=1 2024-09-14T11:37:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.289__shadow_.ZZlbY3YAeSl5Wu7cL_eOAaIwvRN525z_0 2024-09-14T11:37:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4742430020754992222', time=2024-09-14T13:27:18.492763+0000, chain.objs.size()=1 2024-09-14T11:37:46.870 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.qZe4QaaZ9apt3CTbrPwVkMCvzYwy5F1_0 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12779133222800319632', time=2024-09-14T13:27:23.052286+0000, chain.objs.size()=1 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.302__shadow_.0wDC3exBiKyeA6h1t2WwwhWyJI8S_k9_0 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2492172068228683214', time=2024-09-14T13:27:40.870634+0000, chain.objs.size()=1 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SAC7okQRuovdnh5udtRYXEV17QVMxMH_0 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16477770130763122657', time=2024-09-14T13:27:40.929240+0000, chain.objs.size()=1 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bfCCq0UCwDtQBPLLbfROa2Kf8Er9TlO_0 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1660797843910260848', time=2024-09-14T13:27:41.090841+0000, chain.objs.size()=1 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VzMVZ2frn8ikJy0FbSj1pCp2CX5klu0_0 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.145837423644811675', time=2024-09-14T13:27:41.145590+0000, chain.objs.size()=1 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FML14jWzz3dTpLiQ1VeqhkK-42dSKK8_0 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16366232090430623542', time=2024-09-14T13:27:41.157661+0000, chain.objs.size()=1 2024-09-14T11:37:46.871 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3cO6s3EM-b94CO2nraqxDJr5ME4yPJl_0 2024-09-14T11:37:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16988273906269035022', time=2024-09-14T13:27:41.179136+0000, chain.objs.size()=1 2024-09-14T11:37:46.872 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.872+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vNRBkWBRztc0ClEEe6Y0p2sIszrneed_0 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.873+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15733041263994735056', time=2024-09-14T13:27:41.196454+0000, chain.objs.size()=1 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.873+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0-f8oiNT0ATZbSwYmmw6IXSN2qhXHeZ_0 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.873+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12173760412854141968', time=2024-09-14T13:27:41.204640+0000, chain.objs.size()=1 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.873+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zcgNLGFhGv_cf2EUr97Vy6G7VO-rdm__0 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.944902621758390848', time=2024-09-14T13:27:41.307596+0000, chain.objs.size()=1 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.p1pHAGyQiaOoXxiWLeSGswYdci5HgjZ_0 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16195690916798235163', time=2024-09-14T13:27:41.323683+0000, chain.objs.size()=1 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2R-gx6GrIGwPQaEzyNG7miC4PF6bvRQ_0 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17032897644972335805', time=2024-09-14T13:27:41.354303+0000, chain.objs.size()=1 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.K8iwymnNZRhpQq-wuzcrHVB0UljES-l_0 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18199010403579482812', time=2024-09-14T13:27:41.454995+0000, chain.objs.size()=1 2024-09-14T11:37:46.873 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0slPg8NcPRGgXrd1_IhXt-Avovsr4Jr_0 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17541162322688291913', time=2024-09-14T13:27:41.462169+0000, chain.objs.size()=1 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8TvM8o3CAlf7Hzb7V8tfZMVbmytWhy6_0 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16871828402196055511', time=2024-09-14T13:27:41.555930+0000, chain.objs.size()=1 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ttbw7Ug-BAbDqE-Z8hOSRbCUL8UqBmX_0 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16045506728896235480', time=2024-09-14T13:27:41.567121+0000, chain.objs.size()=1 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8cEIKNYYELdht9WtoGcEqH3mQSaYOsv_0 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13054407984941936091', time=2024-09-14T13:27:41.631138+0000, chain.objs.size()=1 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.qSwgKgdPCEYIB-w51EeFd1N37gqem-r_0 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17645326082689785096', time=2024-09-14T13:27:41.699032+0000, chain.objs.size()=1 2024-09-14T11:37:46.874 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.874+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.JxI1RoLqxWCWXqZxegZ2COVZocVthMU_0 2024-09-14T11:37:46.875 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.875+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13529534997633219908', time=2024-09-14T13:27:41.872381+0000, chain.objs.size()=1 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.875+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GP5aNh3rBihWAb7wtIQi5KZ7e08aogp_0 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7603877436382296770', time=2024-09-14T13:27:41.881101+0000, chain.objs.size()=1 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bP4GAgQZyLAXHkEj9y_lIXD2OQbFJ_R_0 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.294514824296364431', time=2024-09-14T13:27:41.968213+0000, chain.objs.size()=1 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9b9mM0dXhtYRD-u-Bg1yyLV3j68NMVi_0 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16471484710471871257', time=2024-09-14T13:27:42.060734+0000, chain.objs.size()=1 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.G8DSOJLL4aDoGzJ-JC0HqjRkeH6gSsl_0 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10883991178662475162', time=2024-09-14T13:27:42.072950+0000, chain.objs.size()=1 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Hv8Q8Cx4PxvVu7yshaPx5iP2gY-O-eC_0 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9305250312769077235', time=2024-09-14T13:27:42.112741+0000, chain.objs.size()=1 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UFTVf2nT4HRGP639z2IHuHvQy2wlawO_0 2024-09-14T11:37:46.876 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7288973677991304362', time=2024-09-14T13:27:42.131610+0000, chain.objs.size()=1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.fm5zOM7gaKO46WkirJVekofApkduYJE_0 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6835980733425406625', time=2024-09-14T13:27:42.135379+0000, chain.objs.size()=1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Z_wb5RvONxjfYrCE14fp_SR9i6EWpuS_0 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2409850404338469878', time=2024-09-14T13:27:42.146113+0000, chain.objs.size()=1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IaKtmMjN1kTxpsq2vfA0newVGe5GUf5_0 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2046048479392247531', time=2024-09-14T13:27:42.152477+0000, chain.objs.size()=1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.M8d-7PIJMUFlvquKc3hStFu7B8aJ4nv_0 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10995004112184156299', time=2024-09-14T13:27:42.154468+0000, chain.objs.size()=1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.876+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.pw9gEl1n0u8RNX1JVWF7xYL-iyXrSDe_0 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.877+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13663922945302139923', time=2024-09-14T13:27:42.201562+0000, chain.objs.size()=1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.877+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.scUT85spPtFC4KaaUvL_YY5ALMQEwm8_0 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.877+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5525158381903939872', time=2024-09-14T13:27:42.315577+0000, chain.objs.size()=1 2024-09-14T11:37:46.877 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.877+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8HdTQb7vJsXn56X6M-m6IbJ5HqlhvHf_0 2024-09-14T11:37:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6273785129499793091', time=2024-09-14T13:27:42.562896+0000, chain.objs.size()=1 2024-09-14T11:37:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CKwJj1nS6sOjYEzUTg1X7V-Ak7h6Yln_0 2024-09-14T11:37:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5560875089745311026', time=2024-09-14T13:27:42.573113+0000, chain.objs.size()=1 2024-09-14T11:37:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.2UeSYjfq5WPeFvB45aVld_Nx4porwd3_0 2024-09-14T11:37:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5616180802795037216', time=2024-09-14T13:27:42.583569+0000, chain.objs.size()=1 2024-09-14T11:37:46.879 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.gPyl1fGte_tzg-Uptr6a27RM29S06jj_0 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18234212692719807375', time=2024-09-14T13:27:42.609644+0000, chain.objs.size()=1 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uRsHherXvyg-hFqKaCAEUxxn__iTsI2_0 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3529420742109966063', time=2024-09-14T13:27:50.418006+0000, chain.objs.size()=1 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.f5iW3QRG3L2bkvEj5q5PpSYew5SEveq_0 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2316079625252440986', time=2024-09-14T13:27:50.513482+0000, chain.objs.size()=1 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.BZ0sBAFoFGYFHCJ66gLNIg-AebBdGkp_0 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6482693602062844088', time=2024-09-14T13:27:50.537702+0000, chain.objs.size()=1 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qVOPMt3PWCALQedVKgZ9xYmFRy7y83U_0 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12547407600872757797', time=2024-09-14T13:27:50.561941+0000, chain.objs.size()=1 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.NR2yNZBOo3ReXkcnm7OHyez3QwLV1gB_0 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16399536871793081452', time=2024-09-14T13:27:50.689095+0000, chain.objs.size()=1 2024-09-14T11:37:46.880 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.TvOk3GUvJAE_dpdm9nnw6i2t98PPTch_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4896207341990139587', time=2024-09-14T13:27:50.769188+0000, chain.objs.size()=1 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.878+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0xbE1Pe4JzG5bHFhSwdrpf2rIMZFsZH_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.879+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1091541017974712428', time=2024-09-14T13:27:50.784499+0000, chain.objs.size()=1 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.879+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GTLQZlsJWcEnKycnT4VTW3xRqxiv1mm_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.880+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15628953025141672524', time=2024-09-14T13:27:50.785829+0000, chain.objs.size()=1 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.880+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wEKC2FI8yFLCVXfYYT1aGyYpLuD8L6g_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18415891660554823547', time=2024-09-14T13:27:50.811153+0000, chain.objs.size()=1 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CWBGf1OzQ5seAwPZBFJs20ln5ZoqHWC_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17725567465038543337', time=2024-09-14T13:27:50.834769+0000, chain.objs.size()=1 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.hTdJSjltNdqo8nITc9HixP5zpGnsA0w_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16122639874924148433', time=2024-09-14T13:27:50.934254+0000, chain.objs.size()=1 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._TOusYpyFs_N14vjdZV4n7HeRwXO6M8_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4940003309463777478', time=2024-09-14T13:27:50.945500+0000, chain.objs.size()=1 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rw4xy6xXRNPFYEMUFps3xz3rCVbKdjQ_0 2024-09-14T11:37:46.881 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9570640334337472713', time=2024-09-14T13:27:50.976116+0000, chain.objs.size()=1 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9zcoYl4ftKtP2TdvyhAfKjDq6gkPZoa_0 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8127306220392954760', time=2024-09-14T13:27:51.002238+0000, chain.objs.size()=1 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.470MGFMd0xqoWS0ini-VvVwfx_DGXXk_0 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17843294485711933722', time=2024-09-14T13:27:51.003005+0000, chain.objs.size()=1 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.kiv9QqzteTFwtVGJ1HrirAkB9Ph1Uau_0 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15911501369170553292', time=2024-09-14T13:27:51.018953+0000, chain.objs.size()=1 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.j7N1IDIthqJ6fmXO5sAuoBnsR7Emx1v_0 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12268215048426959151', time=2024-09-14T13:27:51.050540+0000, chain.objs.size()=1 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.w3t0AxiWQVK-etjitmSOZJpnoXF1nAQ_0 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8022635203604425741', time=2024-09-14T13:27:51.104195+0000, chain.objs.size()=1 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.XAGJ95pxz9fBFRZpAxX9Xo5kcdjBUEY_0 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4486066924998800556', time=2024-09-14T13:27:51.189744+0000, chain.objs.size()=1 2024-09-14T11:37:46.882 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.881+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Z5RlfBaKdqMKyDFGJ7w8IxdvTvEAWzm_0 2024-09-14T11:37:46.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.882+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14700678827959455151', time=2024-09-14T13:27:51.191444+0000, chain.objs.size()=1 2024-09-14T11:37:46.883 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.882+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wG24KIo0P24IfLzTH-KQ_zlfNW7V1--_0 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15387256994552801826', time=2024-09-14T13:27:51.266892+0000, chain.objs.size()=1 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.edQ0cLx2Q40TQfWCXWIrC7GnC4hJFA5_0 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4296748454084314787', time=2024-09-14T13:27:51.312963+0000, chain.objs.size()=1 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SGtPgbTjms0XDFUNLTN1CSa2rXF576W_0 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3725132770701030853', time=2024-09-14T13:27:51.335090+0000, chain.objs.size()=1 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Z1HIel1Cez_18gj81IiUPnh-zkGIAf4_0 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12548957071842191746', time=2024-09-14T13:27:51.479687+0000, chain.objs.size()=1 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZFFjeA6zvTn4T2TFQx4vVfPxcUaKmC5_0 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11335970728502037240', time=2024-09-14T13:27:51.486303+0000, chain.objs.size()=1 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.883+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HJQc2iHUXmJSmz38RJmWs1mJynk8WzZ_0 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11185284585991636984', time=2024-09-14T13:27:51.488149+0000, chain.objs.size()=1 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aHXCxildi5PjNL2Ke7PAP0WLnY6xKCw_0 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4555735408844142166', time=2024-09-14T13:27:51.517705+0000, chain.objs.size()=1 2024-09-14T11:37:46.884 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yOIr3rYH4VXsI0SBPNNS5C6RmSTXWfi_0 2024-09-14T11:37:46.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.884+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13844072250711900619', time=2024-09-14T13:27:51.722980+0000, chain.objs.size()=1 2024-09-14T11:37:46.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.884+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AFhdApQrmmVfMkT2VyvF0JvR5pec8-n_0 2024-09-14T11:37:46.885 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.885+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/48681 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=39, truncated=0, next_marker='' 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11987964521292937825', time=2024-09-14T13:27:51.737832+0000, chain.objs.size()=1 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.aQLbKun7pdBM6RASPe0IAS6ameZGVVg_0 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13536841859335004358', time=2024-09-14T13:27:51.769711+0000, chain.objs.size()=1 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.u5Df86vNLBii9cfsd0DJW9pDmLB_Mfp_0 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6375795592944429179', time=2024-09-14T13:27:51.787010+0000, chain.objs.size()=1 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.MKHezdFTENxtgG2yHZhzAIzjUz9vTvZ_0 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14419745170193781842', time=2024-09-14T13:27:51.791451+0000, chain.objs.size()=1 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xd5JVnDcp95yz02QiB_N9hDodUqhbqY_0 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6468495931102088920', time=2024-09-14T13:27:51.794079+0000, chain.objs.size()=1 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Nxs_gmDG-RCd6kmmS986-ykOpEWdp4E_0 2024-09-14T11:37:46.886 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5270038252967527278', time=2024-09-14T13:27:51.831406+0000, chain.objs.size()=1 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._oxtx3Z1cbEQ-tm-9v06-Lb-2slT-mx_0 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6455402427564300462', time=2024-09-14T13:27:51.843707+0000, chain.objs.size()=1 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.e7bC1PbszbAR29vxT15DAEpBHZZiQeU_0 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11480365029694831626', time=2024-09-14T13:27:51.964773+0000, chain.objs.size()=1 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.i5XzvTsb8QQxBUmI7rB13P8PiwWOzRX_0 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10212147167298084821', time=2024-09-14T13:27:52.018326+0000, chain.objs.size()=1 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.N_U7gPjIfrg1BQK7RsTV39IBYdhMnDX_0 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9145245933862472844', time=2024-09-14T13:27:52.020239+0000, chain.objs.size()=1 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.WdoULtcJAMGR6uDKScJL6kmjD6uAPKi_0 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3150962994161311010', time=2024-09-14T13:27:52.033480+0000, chain.objs.size()=1 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.1EuL33LBsgr5syJzy1tj-TIVNC44b5N_0 2024-09-14T11:37:46.887 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13776589338207707434', time=2024-09-14T13:27:52.058155+0000, chain.objs.size()=1 2024-09-14T11:37:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.887+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-pCoOb4qtxgwx_90eQEuOYxWcus6RgN_0 2024-09-14T11:37:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.889+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.501754502174794181', time=2024-09-14T13:27:52.061740+0000, chain.objs.size()=1 2024-09-14T11:37:46.888 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.889+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Gev1E9F5B-zkIHzPLn4Vshs1XAJkh31_0 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.889+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4960332502243320254', time=2024-09-14T13:27:52.071101+0000, chain.objs.size()=1 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.889+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.lkfYxwDtFG-QizEosoMwDAxbZrwjo_V_0 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.210497055958269047', time=2024-09-14T13:27:52.088014+0000, chain.objs.size()=1 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZngFYnx_447cC5IItcdcVwlDoifTiM0_0 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3768070425193546480', time=2024-09-14T13:27:52.119807+0000, chain.objs.size()=1 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ht5fTAot4otwhu3_hZRHElBMv4ZcrLV_0 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8053550626570214178', time=2024-09-14T13:27:52.132430+0000, chain.objs.size()=1 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.INAevvCEvta5VLdlUWun0kNvTCGs4R6_0 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17238933550061770993', time=2024-09-14T13:27:52.288373+0000, chain.objs.size()=1 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6Am2bEkHeLbdhK-NAQULrYi6KW2nekN_0 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7774881697012420487', time=2024-09-14T13:27:52.312581+0000, chain.objs.size()=1 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZbJqamN1dTvrKDb0ysT19uZj54hMBTZ_0 2024-09-14T11:37:46.889 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18349864268022762821', time=2024-09-14T13:27:52.342835+0000, chain.objs.size()=1 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.5WyAv7kQMVVxI0HglitOGgd6Kqxd9ZR_0 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6366391529545120447', time=2024-09-14T13:27:56.095840+0000, chain.objs.size()=1 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.333__shadow_.-CutxtBdrMcxp2w3agpNHx3S3nqqs4s_0 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11794959062685472850', time=2024-09-14T13:27:58.031402+0000, chain.objs.size()=1 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.337__shadow_.lx6-0Oeh9i7pbpSuXW2gEjVqu7R_KeB_0 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8021650082869071086', time=2024-09-14T13:27:59.791162+0000, chain.objs.size()=1 2024-09-14T11:37:46.890 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.890+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.341__shadow_.Mnr-Zl3bktUtTywXsJGIhurIxuIQMHb_0 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.891+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6160352136914966393', time=2024-09-14T13:28:32.839269+0000, chain.objs.size()=1 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.891+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.408__shadow_.C1TLRP5d-LmQ1pVYto_8OM8aGon0vy6_0 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.891+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5235473090704133726', time=2024-09-14T13:28:43.655129+0000, chain.objs.size()=1 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.891+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.429__shadow_.FPanxpMM2IKfoPifszYIyt5ZrGpvmf__0 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1419771554287717678', time=2024-09-14T13:29:01.098234+0000, chain.objs.size()=1 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.460__shadow_.CzQmVjJulc8TrRM8odxDWNUsb3ATIGA_0 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6809201903142455186', time=2024-09-14T13:29:01.830218+0000, chain.objs.size()=1 2024-09-14T11:37:46.891 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.461__shadow_.0wJm3UAtmCRqamgkk0m9INKmuBAIuGz_0 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2968621348488957227', time=2024-09-14T13:29:04.846998+0000, chain.objs.size()=1 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.466__shadow_.oZpxck2VTd9gfizTFPmSMZ0xVC41S77_0 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4960219298904440812', time=2024-09-14T13:29:32.510247+0000, chain.objs.size()=3 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~RE6O-20tcbPc_LDwp5Ehx6gYGb2zS1A.1 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~RE6O-20tcbPc_LDwp5Ehx6gYGb2zS1A.2 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~RE6O-20tcbPc_LDwp5Ehx6gYGb2zS1A.3 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15624373132530307742', time=2024-09-14T13:30:53.116608+0000, chain.objs.size()=1 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.574__shadow:JCAzyV4nw3B2NlVnLBGsEAEX.uawLEH_.2xwk3WhM3ER60Lj4ajuh9U8j44mVBSv_0 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9121029176847640662', time=2024-09-14T13:30:56.947986+0000, chain.objs.size()=1 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:EeVaMsnRbtjdEEAYVrHQhhw8dkH.u2F_.1o7Q9RIh6Toa_M1KP4zrXlCJNbCnGi3_0 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8443512538741296989', time=2024-09-14T13:31:09.591829+0000, chain.objs.size()=1 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.892+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:A7x.lmwoMPflrNpV7LNOHR.8luO8ahI_.2uNNR7l1mLnWG_1nG7wXAtzkn_P2yRv_0 2024-09-14T11:37:46.892 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.893+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16964395180858025017', time=2024-09-14T13:31:15.356096+0000, chain.objs.size()=1 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.893+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:jeOKx-mjkQgrtZ6.9zybg6lHcPll7ZN_.zbhXmT6kqeg31mAzl5dJrw2Mj4prnsM_0 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.893+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12117043188559066649', time=2024-09-14T13:31:15.794896+0000, chain.objs.size()=1 2024-09-14T11:37:46.893 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.893+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.582__shadow:7WL5FxtZweKt.2JLpmFFUuTGKdbAAV5_.pI0k7yHX1FCc65yTsBcm1NaDGNKOlsF_0 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.893+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4678160344458826920', time=2024-09-14T13:31:19.221953+0000, chain.objs.size()=1 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.893+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:g1wptBoncfJTMRuTFOWiQlCGc18gBfW_.ofuNeb5v2mu1OKsCZBYLTPEaWvW-dJt_0 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.894+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~t4UrJdQ7EW7hJ3gwZQMmiiltWuGWZOq', time=2024-09-14T13:33:44.468631+0000, chain.objs.size()=6 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.894+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.624__multipart_multipart_enc.2~t4UrJdQ7EW7hJ3gwZQMmiiltWuGWZOq.1 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.894+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.624__multipart_multipart_enc.2~t4UrJdQ7EW7hJ3gwZQMmiiltWuGWZOq.2 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.894+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.624__multipart_multipart_enc.2~t4UrJdQ7EW7hJ3gwZQMmiiltWuGWZOq.3 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.894+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.624__multipart_multipart_enc.2~t4UrJdQ7EW7hJ3gwZQMmiiltWuGWZOq.4 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.894+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.624__multipart_multipart_enc.2~t4UrJdQ7EW7hJ3gwZQMmiiltWuGWZOq.5 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.894+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.624__multipart_multipart_enc.2~t4UrJdQ7EW7hJ3gwZQMmiiltWuGWZOq.6 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.895+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.109980690183886303', time=2024-09-14T13:33:51.422649+0000, chain.objs.size()=1 2024-09-14T11:37:46.894 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.895+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.638__shadow_._GmohM2m9UfMRjehUzmJ_fKm3hTiPf7_0 2024-09-14T11:37:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8322771554869447563', time=2024-09-14T13:33:58.178647+0000, chain.objs.size()=1 2024-09-14T11:37:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.651__shadow_.37tLPmTHekXq1dcP8azkw2zXDcwKwtE_0 2024-09-14T11:37:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.896+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7915819136660795953', time=2024-09-14T13:35:28.687504+0000, chain.objs.size()=1 2024-09-14T11:37:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.896+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.767__shadow_.AeVAhx3DjAnJxvlUjssDBax9n3RRD4L_0 2024-09-14T11:37:46.895 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.898+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.898 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.900+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-14T11:37:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.901+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.899 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.901+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/43010' 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5955774865673303707', time=2024-09-14T13:25:00.160272+0000, chain.objs.size()=1 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.162__shadow_.Kx9C2aEJpyJDI_GBE37X755s5TU92pw_0 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18289246785617237219', time=2024-09-14T13:26:38.012587+0000, chain.objs.size()=1 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.231__shadow_.1rMZuxHVnDPPBcJNGyLhU8J11JdqeR1_0 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14151151153111824547', time=2024-09-14T13:26:39.340971+0000, chain.objs.size()=1 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.234__shadow_.fNHtydLFCfRr7w2FlURRFT7zixOmm4c_0 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17790280825665834316', time=2024-09-14T13:26:41.102046+0000, chain.objs.size()=1 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.237__shadow_._p0YEoJ8BEAYwSlpHNYlrh94xUNFhgM_0 2024-09-14T11:37:46.901 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10709223045528170739', time=2024-09-14T13:26:51.788461+0000, chain.objs.size()=1 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.257__shadow_.6cU5xvgJ2B-xMj1BkK7y3zcakI5MQ-b_0 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14160067141198143639', time=2024-09-14T13:27:01.175382+0000, chain.objs.size()=1 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2iX7bd2udi7uOF64IerIIfS7mi4bv2W_0 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12081368464351551645', time=2024-09-14T13:27:01.273868+0000, chain.objs.size()=1 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gKZhWh2waur9vSPPfah2ad-78TdTtWy_0 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9623683305617255116', time=2024-09-14T13:27:01.449707+0000, chain.objs.size()=1 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.2m-hS1RHn1An89-vq45-twD5mRA-H4s_0 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5859033571617980870', time=2024-09-14T13:27:01.567796+0000, chain.objs.size()=1 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.W7t82oj171neOjm9mMSJUcYAx8InTSN_0 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2698707331598488104', time=2024-09-14T13:27:01.712105+0000, chain.objs.size()=1 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.BFrBr7Xs_AqgLkNAtF-aRJd47heQWaR_0 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1669921407242866467', time=2024-09-14T13:27:01.717155+0000, chain.objs.size()=1 2024-09-14T11:37:46.902 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.7bOjrErgCSYqMEMxKdQmIZS57ijfQjV_0 2024-09-14T11:37:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6721025768614429837', time=2024-09-14T13:27:01.799173+0000, chain.objs.size()=1 2024-09-14T11:37:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.902+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fABKviZRGMAa6rOLpJjrrrserX2tora_0 2024-09-14T11:37:46.903 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.904+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12340623203827883118', time=2024-09-14T13:27:01.917872+0000, chain.objs.size()=1 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.904+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.SuHN--XEELQ9UHbP8qHU4R_UhXHuGIo_0 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.904+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7982534691418053235', time=2024-09-14T13:27:01.943079+0000, chain.objs.size()=1 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.904+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gLpzAG-QT9knRXmXZ670wlBd_BCZZyC_0 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.904+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9546806573290947622', time=2024-09-14T13:27:01.947494+0000, chain.objs.size()=1 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5CB-m_sKhi-V_nIROe3fDKYobZS_EMQ_0 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9981884349664175214', time=2024-09-14T13:27:01.973567+0000, chain.objs.size()=1 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.hNXWm_Jdd_6kPZ9OHXml7XssfBsqNff_0 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4385323428839006267', time=2024-09-14T13:27:01.981259+0000, chain.objs.size()=1 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.SsQiEb4Cy3e9CvB87a_ruJy0E4A3xEE_0 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11200958349978864350', time=2024-09-14T13:27:01.983534+0000, chain.objs.size()=1 2024-09-14T11:37:46.904 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wqAzsttj4YHx-TBJAmX57PAS_xjXaXy_0 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14904490521732074278', time=2024-09-14T13:27:02.154094+0000, chain.objs.size()=1 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JQB6Sl2HNa001YCHcZU9ky2GxrOPqjV_0 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12598036994245761793', time=2024-09-14T13:27:02.238463+0000, chain.objs.size()=1 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QhW-emh9sWbUTBzU1Eczqk2JLQ-flLf_0 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.457435294068265581', time=2024-09-14T13:27:02.374049+0000, chain.objs.size()=1 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.H1JT5HEVTrc5_QqcqOrVBmZysQXbn0B_0 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15437420934382604890', time=2024-09-14T13:27:02.462933+0000, chain.objs.size()=1 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._1GFneNikthVfd7Cwoc6fb_EZEJTmVS_0 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5803145767832933153', time=2024-09-14T13:27:02.629039+0000, chain.objs.size()=1 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.6PQfPyi2YnLcQsbnxqSeAF2jDqNWO8S_0 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10167543795489080290', time=2024-09-14T13:27:02.702739+0000, chain.objs.size()=1 2024-09-14T11:37:46.905 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.905+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.aVAGrmCpR1x2_GEqPUDV8BJXZqE8vBe_0 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.906+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5529194351305534296', time=2024-09-14T13:27:02.887472+0000, chain.objs.size()=1 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.906+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kzfr1zxnKGpKExupNBmy2hGAvta9qB6_0 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.906+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3798466223917190254', time=2024-09-14T13:27:02.889254+0000, chain.objs.size()=1 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.906+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kcAqt29l8EnaJtjJ2UgopyfjXuTrIUu_0 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5641936780759657984', time=2024-09-14T13:27:02.935732+0000, chain.objs.size()=1 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Y4tpP6kRT58P3_tPWMEhVw-Tp1o5UPk_0 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15018780257475192097', time=2024-09-14T13:27:08.082201+0000, chain.objs.size()=1 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.273__shadow_.K0mm7Na99EAoBHIQ9I4V_XdfJ8-LkYk_0 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18093419962389457314', time=2024-09-14T13:27:09.989327+0000, chain.objs.size()=1 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.277__shadow_.vCniKLOuG09VRKp5UhLnaK3nghqYkFo_0 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10408046363438631279', time=2024-09-14T13:27:16.107661+0000, chain.objs.size()=1 2024-09-14T11:37:46.907 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.290__shadow_.ZK0ow1S4NjXeyV03A_o1EPZH-1FhgxG_0 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12343367400166919946', time=2024-09-14T13:27:17.679445+0000, chain.objs.size()=1 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.kUGAMHxFACRDxZeY4yq70eeQpawCuCO_0 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16180157206348051098', time=2024-09-14T13:27:17.683478+0000, chain.objs.size()=1 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.gnjDNC1ECckTfBf-Mpvrtjck82zMr-Z_0 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3893477684882499419', time=2024-09-14T13:27:17.688063+0000, chain.objs.size()=1 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.dwloa6ijX-j6ZdlHytS8Jm7jCOTwIj8_0 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16104625636093080039', time=2024-09-14T13:27:18.492513+0000, chain.objs.size()=1 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.HOv0rWuHZFC9kEwPEiJXZ0OcrFFJY8y_0 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7710015975522973258', time=2024-09-14T13:27:20.918209+0000, chain.objs.size()=1 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.298__shadow_.o4QRyY1ZIYZX8AdzvROIBRqywfQUyzu_0 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1924997009904886559', time=2024-09-14T13:27:22.075552+0000, chain.objs.size()=1 2024-09-14T11:37:46.908 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.907+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.300__shadow_.5PwqbTCk0UPKMM8-gQiWUCJamT1kaTG_0 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.908+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15133686098213289704', time=2024-09-14T13:27:25.811901+0000, chain.objs.size()=1 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.908+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.307__shadow:r5LR9EyGznW31cAAgjK0KHMMZQ8ZafS_.4DF3ChnHRLE3Yf6hGoSJZ7zTXuVT102_0 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7801289821472140548', time=2024-09-14T13:27:40.775902+0000, chain.objs.size()=1 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.909+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.LWLy4JgABad_x06WAasbc7y-rs-cYn3_0 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.909+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1111720435482644366', time=2024-09-14T13:27:40.877249+0000, chain.objs.size()=1 2024-09-14T11:37:46.909 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.CaXCqNFPTWjIZ0I1XACSImRcG137mMG_0 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17954296956611424649', time=2024-09-14T13:27:40.943437+0000, chain.objs.size()=1 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.TEs5TMoyAE_Ev2eL6C6BcgnbfvISDgA_0 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11816994212644992844', time=2024-09-14T13:27:41.076647+0000, chain.objs.size()=1 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.62vR7r5BI6luNMbEIUuG6jYCIxik7hi_0 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1237786490328115892', time=2024-09-14T13:27:41.135925+0000, chain.objs.size()=1 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1Ni5L56XxTz39oyx4ULYGnOcDwZTMXe_0 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15571687550423430858', time=2024-09-14T13:27:41.173144+0000, chain.objs.size()=1 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.J5PxpV7vQmSmfi4Z96nJl9k96ZoJZmi_0 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.820316181840134440', time=2024-09-14T13:27:41.192465+0000, chain.objs.size()=1 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wulWYTWk64HbOjoaaRqjHr5HIaGpgiF_0 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9331221319954073699', time=2024-09-14T13:27:41.199385+0000, chain.objs.size()=1 2024-09-14T11:37:46.910 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.b61Pvj1Y3YQw1yOLlS42-aW7KdzDLv4_0 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13015178614904392071', time=2024-09-14T13:27:41.296355+0000, chain.objs.size()=1 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.WOgOBA6XExkWYupHVC-EoOo7Qrp9Fjl_0 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13071501601066272038', time=2024-09-14T13:27:41.344393+0000, chain.objs.size()=1 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.zmRf_ERei30Lvk5YGCtUiQpdpNAXRoq_0 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10236996245083851006', time=2024-09-14T13:27:41.372024+0000, chain.objs.size()=1 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Yna41-YcnIV4pLn2UG8pFuwhMP_SP1L_0 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11657131379788263396', time=2024-09-14T13:27:41.554647+0000, chain.objs.size()=1 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.910+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.t43ftHsZ9aCL0o97xCFTUAK03HbTj8S_0 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.911+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6241292472678697515', time=2024-09-14T13:27:41.555559+0000, chain.objs.size()=1 2024-09-14T11:37:46.911 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.911+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.6fzu3S1Ga6uxTNxsyf9clcrvwYVEFjP_0 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2005081633310577612', time=2024-09-14T13:27:41.613268+0000, chain.objs.size()=1 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.8n6LZgE1_zZelOAB9U0me_cxgunbq9B_0 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7220545938302756162', time=2024-09-14T13:27:41.616287+0000, chain.objs.size()=1 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lRitHa7jALXrfYz0d8IjTe1XKnkn2Sn_0 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2636143709119803599', time=2024-09-14T13:27:41.655300+0000, chain.objs.size()=1 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.YXhw9PcaI6sxF80tbo2XM1U1fhgFikk_0 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9998188789436972779', time=2024-09-14T13:27:41.672475+0000, chain.objs.size()=1 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Ifle9Rn8Ll6VgvIEGydobDWBQXGL4ND_0 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6890464847161771845', time=2024-09-14T13:27:41.707068+0000, chain.objs.size()=1 2024-09-14T11:37:46.913 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.pACZ84Ppiwme3TF4k-BmYB85r39zVZs_0 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7246615412678523582', time=2024-09-14T13:27:41.815170+0000, chain.objs.size()=1 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.NYQfJ8N0qvUszJ1gWzzULW8Wh3YeWcV_0 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8517239027490398062', time=2024-09-14T13:27:41.815855+0000, chain.objs.size()=1 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Zga-1pKmWQdfAZg_TN_D6Eu0n1tlXZq_0 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14398133249623589506', time=2024-09-14T13:27:41.831454+0000, chain.objs.size()=1 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.rj6FirCD1JeiEv_qOj1zUqHUzZnO7ER_0 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15767563396791535041', time=2024-09-14T13:27:41.838321+0000, chain.objs.size()=1 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.1YQ-crogpT-JwLdDIVgEGD5bgvYIqi9_0 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13074346721336598054', time=2024-09-14T13:27:41.884434+0000, chain.objs.size()=1 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vqxsbNLsto138umVHpjjSo_q-7Sgcq9_0 2024-09-14T11:37:46.914 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16379991585398931784', time=2024-09-14T13:27:41.906972+0000, chain.objs.size()=1 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.912+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.vhJ63MW7jP06roYf5Rke0HL2f3wgJp6_0 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4644226545181148527', time=2024-09-14T13:27:41.941117+0000, chain.objs.size()=1 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.210emlo4o-2bGL1G2tswpuWBWrRWASZ_0 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1796074764424253802', time=2024-09-14T13:27:42.145569+0000, chain.objs.size()=1 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9AzMP9lvmE2lp5EeeemDg_jLcJrF6U2_0 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17710054228857694980', time=2024-09-14T13:27:42.163300+0000, chain.objs.size()=1 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Pv_hR399-25xB-CytQw11vwDAj_X3oj_0 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16989805434872200962', time=2024-09-14T13:27:42.177877+0000, chain.objs.size()=1 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._oqusjh1hlFKcg1IWZzoi9b51JYGoOU_0 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3055917497461322248', time=2024-09-14T13:27:42.204142+0000, chain.objs.size()=1 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.IZAwoc90MNuiaN_0cAOBCNRhjy71jqX_0 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6716560750097296931', time=2024-09-14T13:27:42.208052+0000, chain.objs.size()=1 2024-09-14T11:37:46.915 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9HVih_sa8jgF2ZM-aJKLnq8h480aS-b_0 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18431605599980525637', time=2024-09-14T13:27:42.350410+0000, chain.objs.size()=1 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.S9BF4ZCRC9rgV_joCVOA0uIGFuiGwI4_0 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2703842198456954382', time=2024-09-14T13:27:42.365969+0000, chain.objs.size()=1 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Iqsr5EEC8WnIYXnw5qP9RtGxAbptVPP_0 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11036253970908042535', time=2024-09-14T13:27:42.376693+0000, chain.objs.size()=1 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VcyKXzgbIFHVZUnJnBts6MNSX-YBbUV_0 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1676789160936990583', time=2024-09-14T13:27:42.382131+0000, chain.objs.size()=1 2024-09-14T11:37:46.916 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.914+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mtft-AE3GDgpxMPyURnLlQZdo4_mWqS_0 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.915+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15558070189920104874', time=2024-09-14T13:27:42.483424+0000, chain.objs.size()=1 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.915+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bJfkLtyPC2IF691Ll-_jiBDqfx4VP0D_0 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.916+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3041050149959236336', time=2024-09-14T13:27:42.570806+0000, chain.objs.size()=1 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.916+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KRdAgC_R06H0EIjytwc7CDP7m6n6lrD_0 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.916+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5363310771145917951', time=2024-09-14T13:27:42.571742+0000, chain.objs.size()=1 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.916+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.DAxK3mnCmkuevCeGrWj8ZR-54WyyUKC_0 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.916+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6170908465304887676', time=2024-09-14T13:27:50.438765+0000, chain.objs.size()=1 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.916+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.C7f0foGnmYYuVO-quouKgr-u4AQVAXv_0 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8039712206665257280', time=2024-09-14T13:27:50.479702+0000, chain.objs.size()=1 2024-09-14T11:37:46.918 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nZA7X34DpxVNVOVEm6oh7dWdsGiIf7e_0 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12195512185096351829', time=2024-09-14T13:27:50.510300+0000, chain.objs.size()=1 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xEDY6LxGdljmVEfEzF9pHkdpSTHq-SV_0 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7571481193741555888', time=2024-09-14T13:27:50.516977+0000, chain.objs.size()=1 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.sdmkfHGTdIWQ4NPouB-yloGXgqHaLCw_0 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13147125735033268756', time=2024-09-14T13:27:50.589749+0000, chain.objs.size()=1 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.L-CDDmGuMuFoHh033yCWC2eNgvDtuYg_0 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1255400460844733716', time=2024-09-14T13:27:50.724767+0000, chain.objs.size()=1 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.DatdZNk97ru05RFbwKGziKbgUGMCgE5_0 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.930833096444667096', time=2024-09-14T13:27:50.751321+0000, chain.objs.size()=1 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.917+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3IESsIM5H2IUKCpG-zPhrnXR1BywINr_0 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16432245668092270119', time=2024-09-14T13:27:50.762718+0000, chain.objs.size()=1 2024-09-14T11:37:46.919 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rtrXcmKAAr7ldRsVvRG5KVaf7S30adr_0 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.918+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15216049565347321138', time=2024-09-14T13:27:50.792452+0000, chain.objs.size()=1 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.918+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FKMtyVGRE3w261eQeDaLMxU4EPfOO9b_0 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6580017137178520162', time=2024-09-14T13:27:50.800274+0000, chain.objs.size()=1 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.D4HzpPF_tp917ApdoQBsP2DCjvA9AaG_0 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6681164483683537431', time=2024-09-14T13:27:50.801500+0000, chain.objs.size()=1 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.nYTMCWKQJJi9mf0YHAfoqFSMbtchjcp_0 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4447297470100772375', time=2024-09-14T13:27:50.937714+0000, chain.objs.size()=1 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6Dc0IYEfqHollG2s5ai9oevHAH7x_RO_0 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4514921239307178282', time=2024-09-14T13:27:50.998066+0000, chain.objs.size()=1 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xNkLhB3UbGZVz72tXjikKd6vw002WZT_0 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7452562282399177390', time=2024-09-14T13:27:51.029827+0000, chain.objs.size()=1 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Q1De92XkoMmleYoGmEK_UirtHFGwcF__0 2024-09-14T11:37:46.920 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17346175275217723976', time=2024-09-14T13:27:51.058510+0000, chain.objs.size()=1 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HyZiAIG1ouQJ4XGIYWe1HonNf0b0qgk_0 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9870458189810293299', time=2024-09-14T13:27:51.076877+0000, chain.objs.size()=1 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pkDlFHpDHng9uAO4r5pCCEr71gs-IB1_0 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9128204703864204185', time=2024-09-14T13:27:51.225087+0000, chain.objs.size()=1 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.OTTTMd5ikYkwNGEHpah7Nr38ARl-4al_0 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6241724457427355248', time=2024-09-14T13:27:51.252274+0000, chain.objs.size()=1 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.rmbMdUvoa8gFvKlt1nq_dkV9Zo5HU39_0 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10582833671604480539', time=2024-09-14T13:27:51.269554+0000, chain.objs.size()=1 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-euLg_sjM4rjRD6Cba-LgNps8wyFCiT_0 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2086183931410990347', time=2024-09-14T13:27:51.325809+0000, chain.objs.size()=1 2024-09-14T11:37:46.921 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.919+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.-Px2xDtIzhhcyWRZ66uFSKwJ-RsUtuI_0 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7839020904066047421', time=2024-09-14T13:27:51.354717+0000, chain.objs.size()=1 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.88jnYIhIGDf5N6tzpaN3bItFiO7F58f_0 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12697163295861836325', time=2024-09-14T13:27:51.457107+0000, chain.objs.size()=1 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ilRw2h6rUn2SX55bqsQEnGX_rv4QJ_5_0 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10685754750403754900', time=2024-09-14T13:27:51.572989+0000, chain.objs.size()=1 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.CEZLyO-kOwcu0u8P_wjb0Q72vfOjLAH_0 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15071495202355762850', time=2024-09-14T13:27:51.573699+0000, chain.objs.size()=1 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.i0hIx5yv5XkBkAqllsO1nU-T8iv2DqQ_0 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15832368520113199516', time=2024-09-14T13:27:51.807737+0000, chain.objs.size()=1 2024-09-14T11:37:46.922 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qYta0SKLP3HimlUMY6D0aNx-hw5Nusz_0 2024-09-14T11:37:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5013590670248513687', time=2024-09-14T13:27:51.808695+0000, chain.objs.size()=1 2024-09-14T11:37:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.922+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.mpzT7MYKuxBVpnud_612nrfi6ofsqwN_0 2024-09-14T11:37:46.923 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.924+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/43010 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.926+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=27, truncated=0, next_marker='' 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.926+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13366164220638812835', time=2024-09-14T13:27:51.824213+0000, chain.objs.size()=1 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.926+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ltdDGwl-2rDI7L_jH2sGKUkJnfc_L_d_0 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.926+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3730309889630909906', time=2024-09-14T13:27:51.962285+0000, chain.objs.size()=1 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.926+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.RDowQKlXs7yVC98XR_gCl6pu89Mpikw_0 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5144740992546777905', time=2024-09-14T13:27:51.978850+0000, chain.objs.size()=1 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.auoWOY8JsNOYpEFW6rbigz-718xLhm__0 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16606392645310495686', time=2024-09-14T13:27:51.996685+0000, chain.objs.size()=1 2024-09-14T11:37:46.925 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.R-rNTbK9nVal8nLk1X7J7xuQsK4Azjj_0 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1552014713796575384', time=2024-09-14T13:27:52.048267+0000, chain.objs.size()=1 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wn8oou70CAcuVkeukSda4xqd780Wbc-_0 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10418429102924435213', time=2024-09-14T13:27:52.056251+0000, chain.objs.size()=1 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.3A_4HYq-bAp0jSsIT5h7szgXsfhrDvd_0 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9885982771236034855', time=2024-09-14T13:27:52.082116+0000, chain.objs.size()=1 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.f6GPPhABj20i5e4obGHf6WMsKp0asaZ_0 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4873589611665211588', time=2024-09-14T13:27:52.116517+0000, chain.objs.size()=1 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._yLe9Ynzm_iY192VCAwCvkwEyUN0Ufy_0 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10247001969390092648', time=2024-09-14T13:27:52.119290+0000, chain.objs.size()=1 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AbScI_iAjHfg_yJChhRrBg-XiaZ6G9e_0 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4309107443747112331', time=2024-09-14T13:27:52.125322+0000, chain.objs.size()=1 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.vAr6NLzNBOHjCGBCcNvTdXsBj83vO7M_0 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15258085720624638283', time=2024-09-14T13:27:52.210532+0000, chain.objs.size()=1 2024-09-14T11:37:46.926 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.EzcQ4V0J0OV6GvFyNDGJ5MdeY1bvr5x_0 2024-09-14T11:37:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3374439905785861690', time=2024-09-14T13:27:52.257808+0000, chain.objs.size()=1 2024-09-14T11:37:46.927 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.927+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.qj_rzpwU88WQHXss9OU9Ir8de9a14Ol_0 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14473559858646402931', time=2024-09-14T13:27:54.423115+0000, chain.objs.size()=1 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.329__shadow_.o5nRRDut_5KWqtcmS0se31y7kQkZg0P_0 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12997344304398778282', time=2024-09-14T13:28:01.589423+0000, chain.objs.size()=1 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.345__shadow_.Z_kghdYd0M9d8jUHchVLLSfm-SCAXkW_0 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3229125456483918164', time=2024-09-14T13:28:26.522526+0000, chain.objs.size()=1 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.394__shadow:WxX0frLAraUIIkPqTEW1OZVqcr1V8EI_.NC7NGzYglLPDNmx58pup4SSTlPJqxzY_0 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15115708474264944960', time=2024-09-14T13:29:04.902704+0000, chain.objs.size()=1 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.466__shadow_.gmIHjFjE0nSuWdUw5tZT0nRp7wa3VKW_0 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4442648554677330914', time=2024-09-14T13:29:23.544362+0000, chain.objs.size()=1 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.511__multipart_mymultipart.2~pzh3BOXbXdS4PD6GGBhgpdhhQ2HluuG.1 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5398744185022513445', time=2024-09-14T13:29:32.883651+0000, chain.objs.size()=3 2024-09-14T11:37:46.928 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~WpAFWv-zm-E8gdiJ0gZCGrONJWTCHMz.1 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~WpAFWv-zm-E8gdiJ0gZCGrONJWTCHMz.2 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.521__multipart_mymultipart.2~WpAFWv-zm-E8gdiJ0gZCGrONJWTCHMz.3 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~dKGDC6_FVB4tkDS1fmxUU_l-lvJ6-1b', time=2024-09-14T13:29:37.974900+0000, chain.objs.size()=1 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.522__multipart_mymultipart.2~dKGDC6_FVB4tkDS1fmxUU_l-lvJ6-1b.3 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7431642327277483873', time=2024-09-14T13:30:27.764377+0000, chain.objs.size()=1 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.552__shadow_.ozLtig7V31f3nMfe71NS7W5NM9HwdRM_0 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4219614728231279524', time=2024-09-14T13:30:30.497405+0000, chain.objs.size()=1 2024-09-14T11:37:46.929 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.929+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.556__shadow_.exsNe9yTKoQQXbm54pwxJeoDvG4kuwl_0 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.930+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16183943266826929006', time=2024-09-14T13:31:05.374580+0000, chain.objs.size()=1 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.930+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:k3jvt1HsNkEquqRnyuncKZoiYUoml8A_.HNIsxZmKM0kPCYOE-lsUvkF_RPQYoKr_0 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5313218755401286763', time=2024-09-14T13:31:26.103044+0000, chain.objs.size()=1 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.603__shadow_.kp0-yPlTeFzov_GK6khwz8iy72VrA5i_0 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8602582883800806335', time=2024-09-14T13:33:59.165230+0000, chain.objs.size()=1 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.653__shadow_.hlAAlfrcd_ZwskRNNyKy95TYQyMz8MJ_0 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14837227859021874839', time=2024-09-14T13:34:17.008961+0000, chain.objs.size()=1 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.692__shadow:s9C.EMHTtWDdoNu8UbaXFijmsyw2mE-_.dHzVNk9vDMmvFAZPCFeSKG_LGD0Nfuo_0 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11165452896052055712', time=2024-09-14T13:35:23.876483+0000, chain.objs.size()=1 2024-09-14T11:37:46.930 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.761__shadow_.rkVsexf7VCqWyHLui93RIDmOZQVrPy__0 2024-09-14T11:37:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6549624853913117949', time=2024-09-14T13:35:31.761174+0000, chain.objs.size()=1 2024-09-14T11:37:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.931+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.771__shadow_.VTe2Fw5ywFZmWk_4Ulo_M6Pf4s72CSN_0 2024-09-14T11:37:46.931 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.933+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.933 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.935+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-14T11:37:46.934 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.936+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.935 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.937+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/71588' 2024-09-14T11:37:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13823937587113392394', time=2024-09-14T13:24:56.904188+0000, chain.objs.size()=3 2024-09-14T11:37:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-FROZEN.2~bskPdLJvuOK1AvyVa_U8uQ2nGSzjPoS.1 2024-09-14T11:37:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-FROZEN.2~bskPdLJvuOK1AvyVa_U8uQ2nGSzjPoS.2 2024-09-14T11:37:46.936 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:17edae97-cd6b-4c90-863d-862429a20cf3.4538.159__multipart_mymultipart-FROZEN.2~bskPdLJvuOK1AvyVa_U8uQ2nGSzjPoS.3 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7404184996373873925', time=2024-09-14T13:26:38.898026+0000, chain.objs.size()=1 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.233__shadow_.fnEx4To0wvDbj14h7vt5jKZivmfHHdi_0 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1697921714308547000', time=2024-09-14T13:26:51.334433+0000, chain.objs.size()=1 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.256__shadow_.a3g5bBHDVRzaxCnZGiNzUUp0lR1Ldux_0 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4852026359897768785', time=2024-09-14T13:27:01.198839+0000, chain.objs.size()=1 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yywr_AlxxsJ5UoNrBPZj-7f6cVE8lI__0 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4805694540136576379', time=2024-09-14T13:27:01.210737+0000, chain.objs.size()=1 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.34Z7w8PnFt8luw6AGtnV2MCBkblyyOG_0 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.948907282750897791', time=2024-09-14T13:27:01.320505+0000, chain.objs.size()=1 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UcupGETWtuNR-A_jX32ZWMI1M5TDddG_0 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3371564160011575441', time=2024-09-14T13:27:01.440727+0000, chain.objs.size()=1 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.CmW4oXka4b4stjwMukZCXLyFHA2E5-4_0 2024-09-14T11:37:46.937 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4466449819747001209', time=2024-09-14T13:27:01.455395+0000, chain.objs.size()=1 2024-09-14T11:37:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.kg_xIT0wtBzLHfnv0exzkaQLTM37UE9_0 2024-09-14T11:37:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13426611953871031052', time=2024-09-14T13:27:01.456065+0000, chain.objs.size()=1 2024-09-14T11:37:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JKRTI8knZSNtA3kQM9MsNzcudUZUmMP_0 2024-09-14T11:37:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4893608144881706125', time=2024-09-14T13:27:01.483083+0000, chain.objs.size()=1 2024-09-14T11:37:46.938 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.938+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.iyJoJmh6c3xA-UIiBU0VPgVoWNSl4Ob_0 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1874215652957310118', time=2024-09-14T13:27:01.501480+0000, chain.objs.size()=1 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.wa-u1UgtyrKjcwuACOLGNneCwtp9hHH_0 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4681890224178337089', time=2024-09-14T13:27:01.515262+0000, chain.objs.size()=1 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Z2gb0xjr8CiX_iVS61VGBltAvywwboe_0 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1136777356952253703', time=2024-09-14T13:27:01.683098+0000, chain.objs.size()=1 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.g65-iDlvoOZs6jIuCMy_1wMB15iwxmw_0 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11009281558491756317', time=2024-09-14T13:27:01.728067+0000, chain.objs.size()=1 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.R5UPR53JSB62ZX-b9oFh6Txg8LgAJs6_0 2024-09-14T11:37:46.939 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6851316770753876140', time=2024-09-14T13:27:01.752387+0000, chain.objs.size()=1 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Ssy1vlWM1KP5SgdrU4q4hflNve3a-R5_0 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10492259792690516752', time=2024-09-14T13:27:01.765803+0000, chain.objs.size()=1 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.B1ekBzq9lNdM1X5F247bJopJSXAmx2B_0 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13630036515589453804', time=2024-09-14T13:27:01.894265+0000, chain.objs.size()=1 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fyryBzXyUZCBc2Sbjg5uPtv1EBFQCqb_0 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.553384912081522744', time=2024-09-14T13:27:01.956392+0000, chain.objs.size()=1 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GCnf4KcIx_tvYdHDCSQMwD0vmj8PKMH_0 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.164434294381332558', time=2024-09-14T13:27:01.964090+0000, chain.objs.size()=1 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.940+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OsvVTNkVsvwV8tujgDuqz6DP43CQMUV_0 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.941+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18180060814483541685', time=2024-09-14T13:27:02.027450+0000, chain.objs.size()=1 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.941+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GB2LCsVREYc5C2mEladxnrD3OSA4Zn0_0 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.941+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16078294254709548386', time=2024-09-14T13:27:02.155219+0000, chain.objs.size()=1 2024-09-14T11:37:46.940 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.941+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.fg0mevtpHjk3m2OJ0y5nqnKqWTfWMi4_0 2024-09-14T11:37:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7728199095937182831', time=2024-09-14T13:27:02.172982+0000, chain.objs.size()=1 2024-09-14T11:37:46.941 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.gDljAcTbu0no3lJ7tTKLPN1RfFDelo9_0 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10867615652329665585', time=2024-09-14T13:27:02.210914+0000, chain.objs.size()=1 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.10aofAESTavzXlYf3AkXws-vsl_c8D8_0 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6331777496613917974', time=2024-09-14T13:27:02.268649+0000, chain.objs.size()=1 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GpwQEks0BrFjMTtjnNVY2deNeueKeqW_0 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1787233148573639812', time=2024-09-14T13:27:02.364255+0000, chain.objs.size()=1 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.sHH_15UDputZ2as1wT5wboXKjpcZGv3_0 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12634851296011229830', time=2024-09-14T13:27:02.377965+0000, chain.objs.size()=1 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qpUkcbKunKDfJUoDYUNtC6BRltPPMm__0 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4276844240906935252', time=2024-09-14T13:27:02.459305+0000, chain.objs.size()=1 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.942+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.tI3hHSy6WbMFVbxt3Ko6vBXUMkmyj9X_0 2024-09-14T11:37:46.942 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9732728501653755141', time=2024-09-14T13:27:02.521893+0000, chain.objs.size()=1 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ojDr8d3M20dDf261Vy_wD1ozGWig3jH_0 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9234766261939147132', time=2024-09-14T13:27:02.603240+0000, chain.objs.size()=1 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.OufJKqAQffL2lY0Iy8MGm-evcTET9YZ_0 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10711673401527707224', time=2024-09-14T13:27:02.662587+0000, chain.objs.size()=1 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lg9kXEgbRG3gEQ9fBkFvvbBgrU_K-St_0 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2406913214281205587', time=2024-09-14T13:27:02.691123+0000, chain.objs.size()=1 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qilAFYzwFAzBPOL1drslcjtZNOxw8pw_0 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4552040048046896713', time=2024-09-14T13:27:02.838642+0000, chain.objs.size()=1 2024-09-14T11:37:46.943 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.943+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GfEdkihX8UateClFXlIUOQJMdBNxPzY_0 2024-09-14T11:37:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2766423945839479013', time=2024-09-14T13:27:02.883653+0000, chain.objs.size()=1 2024-09-14T11:37:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ucV4QugxuxOtw-mdflSpqRcKL48Bc4Q_0 2024-09-14T11:37:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3349984039628074323', time=2024-09-14T13:27:02.940169+0000, chain.objs.size()=1 2024-09-14T11:37:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.h0b7HiBfTzUeyI7EqpnreD8Ccdp3i1r_0 2024-09-14T11:37:46.944 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8630992482977857750', time=2024-09-14T13:27:02.943009+0000, chain.objs.size()=1 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QZhIPxJz0OAWyypvVdEpM3IYUw1-fjq_0 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15636018789115082311', time=2024-09-14T13:27:11.841269+0000, chain.objs.size()=1 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.944+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.281__shadow_.85OKs0FLvu07RFZTBahJ8KppmXgYbKM_0 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.945+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5395803878942091851', time=2024-09-14T13:27:13.777757+0000, chain.objs.size()=1 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.945+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.285__shadow_.WYeMfsZn8sfOf9LRz0-MOKkpjG9J6_m_0 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16929315015773461658', time=2024-09-14T13:27:16.107200+0000, chain.objs.size()=1 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.290__shadow_.0cRzfpHQ5i-Wy4bQrUewr3Rd_yKrSOo_0 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8466358748081954629', time=2024-09-14T13:27:17.685074+0000, chain.objs.size()=1 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.3gtka_s2OPOm8sn9D64Ad6KAQNJH4U__0 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9918339877828520265', time=2024-09-14T13:27:17.706493+0000, chain.objs.size()=1 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.292__shadow_.brvrL85tVZCcX20yUrw_JsbAOD64gLn_0 2024-09-14T11:37:46.945 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10829167377599421696', time=2024-09-14T13:27:18.500910+0000, chain.objs.size()=1 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.293__shadow_.pDksJiBDG2fV-XgRVvVHE5kKz2Vdy8J_0 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11888866381997820741', time=2024-09-14T13:27:23.496870+0000, chain.objs.size()=1 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.303__shadow_.8Iguz2Q1a_tZ8dUEddD3BqfqWY6ypig_0 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6174241871343247726', time=2024-09-14T13:27:25.811606+0000, chain.objs.size()=1 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.307__shadow:3Z9-HAusecVFliylEgK-3wcTWYRBN9U_.KYhE0IKOwRvKoFC-JOGn2pwm7_r-R4Q_0 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15347844163551541210', time=2024-09-14T13:27:32.216126+0000, chain.objs.size()=1 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.321__shadow_.o5d6IDRsnXE9ryXK1_bAwkBR00Ezat8_0 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8987140430691557280', time=2024-09-14T13:27:40.778319+0000, chain.objs.size()=1 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.4bAil6MS6Ohj3bVtOIBZQcqvQWQZ3kx_0 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8777484529185774221', time=2024-09-14T13:27:40.885716+0000, chain.objs.size()=1 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UZvDBbUg95eXh4aXHEh7sNetwv-6zFS_0 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17718819546164714333', time=2024-09-14T13:27:40.891444+0000, chain.objs.size()=1 2024-09-14T11:37:46.946 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.946+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.jvYafaWBXKvfvdoFpEWHuPxzz1gW8W2_0 2024-09-14T11:37:46.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.947+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5316496650700437216', time=2024-09-14T13:27:41.047135+0000, chain.objs.size()=1 2024-09-14T11:37:46.947 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.947+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KhkBOxD5iv1HgVM6f6A3QHKYUg2RHyZ_0 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1326688924541899430', time=2024-09-14T13:27:41.060480+0000, chain.objs.size()=1 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.knSiFZrj6v5ex4I8jthuSFaNpJY3VVA_0 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7391828319569064262', time=2024-09-14T13:27:41.152011+0000, chain.objs.size()=1 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ueGnliYmowustcm9MfFBqnECOOqvgm9_0 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13351774644742543069', time=2024-09-14T13:27:41.197997+0000, chain.objs.size()=1 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VTrwLDgKWwSNY0RrVfUhF3dlGNhRZea_0 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5252235478506065794', time=2024-09-14T13:27:41.205828+0000, chain.objs.size()=1 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BD068xIPbEMc630lJNt7We2SnXOdaNJ_0 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1516120379750218435', time=2024-09-14T13:27:41.206665+0000, chain.objs.size()=1 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9tZsPb1YoQqQ0aiNyOa9MxANsnX7fVO_0 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17212913614226453377', time=2024-09-14T13:27:41.303804+0000, chain.objs.size()=1 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.FeE_mPbihHi-0gZ47XXCAygOdLDxK4f_0 2024-09-14T11:37:46.948 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16110521497654623174', time=2024-09-14T13:27:41.307069+0000, chain.objs.size()=1 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.KRRcYPPAs4HDeTw4sUt_cV0Q-cQtV_t_0 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5098765924150856477', time=2024-09-14T13:27:41.314524+0000, chain.objs.size()=1 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.VCED1DrtQGjLpOawGYxq1Y11va1a2qD_0 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5404391623731636734', time=2024-09-14T13:27:41.355012+0000, chain.objs.size()=1 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.h45ufeKUIfFTWeRMRHJNm_gn4EPK9kQ_0 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4587721871890909335', time=2024-09-14T13:27:41.359101+0000, chain.objs.size()=1 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.948+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.uJoBLDZleGZiEPJ-Ir8pA6JhnLyKsMp_0 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.949+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5576005959175485021', time=2024-09-14T13:27:41.380324+0000, chain.objs.size()=1 2024-09-14T11:37:46.949 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.949+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cGLfRVyz1lUyVN5jgKbDLLSFp8ZjrPe_0 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8981182377516878459', time=2024-09-14T13:27:41.416080+0000, chain.objs.size()=1 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UNVchj6zBOzPkoewiniGaarRNnENUlC_0 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1916257265033261530', time=2024-09-14T13:27:41.442174+0000, chain.objs.size()=1 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.5WP31SJeMHJahaugjJgZdvH-18gDM6k_0 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3413443552050807686', time=2024-09-14T13:27:41.454726+0000, chain.objs.size()=1 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.9pDHZXTHgacQ6QAwdRiK7CU3A0VgwJn_0 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12888688441604438957', time=2024-09-14T13:27:41.586993+0000, chain.objs.size()=1 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.BbgVQjhL_r4R_3xTH4aeazj_6LGIcg9_0 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13827189020911960981', time=2024-09-14T13:27:41.808772+0000, chain.objs.size()=1 2024-09-14T11:37:46.950 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.52F4q2o6kopU1MibiMn6DHY2rCzqT3x_0 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6525973069907496431', time=2024-09-14T13:27:41.817905+0000, chain.objs.size()=1 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.3wp-eV6nK-gmGKlbM4Ya3EMTDP5z6Us_0 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5728738029662593731', time=2024-09-14T13:27:41.863699+0000, chain.objs.size()=1 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yJIiInPZ_z8FEfxpSrgFGUG2krcAY53_0 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16063535098280301420', time=2024-09-14T13:27:41.918426+0000, chain.objs.size()=1 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.950+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GVtGAmvKjSV2NZSz-bB8TWdmcDSdaGY_0 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15087767700206822493', time=2024-09-14T13:27:41.929163+0000, chain.objs.size()=1 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.UGfpzp3uEaiwvTXh5hRvGnRlRk8DekZ_0 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10724081549623374391', time=2024-09-14T13:27:41.943187+0000, chain.objs.size()=1 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.SZ9GWlaanuFhywwRwhLXDOAITSXrwWM_0 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.951+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8142528805272475479', time=2024-09-14T13:27:42.060637+0000, chain.objs.size()=1 2024-09-14T11:37:46.951 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.951+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.i8R6HN4R-DZKq94Uxj50gRCtLDv4V7R_0 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7855958549379965625', time=2024-09-14T13:27:42.088083+0000, chain.objs.size()=1 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.lAUl0CeYvx7ppJOhZxroYlBkPQnNZDT_0 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5225350132200645555', time=2024-09-14T13:27:42.125797+0000, chain.objs.size()=1 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.bh196n-pd0PmEmMu7GO2h6f575M4GxO_0 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7987146884583748396', time=2024-09-14T13:27:42.205663+0000, chain.objs.size()=1 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.cXjoPJLbP67i28-KXqTY4CI2ZFp_6lz_0 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15480795472072311543', time=2024-09-14T13:27:42.345680+0000, chain.objs.size()=1 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_._TSWJUUIVfhJw13LbVl9XxaN5Ku1Nbr_0 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10703089217293896609', time=2024-09-14T13:27:42.388915+0000, chain.objs.size()=1 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.URdfvpz3qjruocEXayNL6xrhDMDyL6L_0 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15332813687620044512', time=2024-09-14T13:27:42.395674+0000, chain.objs.size()=1 2024-09-14T11:37:46.953 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.wY9XCMHliPZ7IsfqpPjtyiHTiPwcEgP_0 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9257988590951661357', time=2024-09-14T13:27:42.566185+0000, chain.objs.size()=1 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.dByoNGelY8D5zu-usctoyHtL1lUeiog_0 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16725426490877135550', time=2024-09-14T13:27:42.614306+0000, chain.objs.size()=1 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PyeBxm9fhylQ4HUq7ww_Ev0RkEyxIoK_0 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15314180399570841655', time=2024-09-14T13:27:50.541139+0000, chain.objs.size()=1 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.bx8SHrZXrCnS-CJnFZhHjS0bXSAxied_0 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11357411284978581535', time=2024-09-14T13:27:50.589910+0000, chain.objs.size()=1 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.953+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.P3WO5M12_lJndPFevligxotVwQnIUR5_0 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.954+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1825345996618111013', time=2024-09-14T13:27:50.590755+0000, chain.objs.size()=1 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.954+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.q2MGNdxzBMP5n2lbn_wA7NkT9kAfhAR_0 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.75817735427869186', time=2024-09-14T13:27:50.751264+0000, chain.objs.size()=1 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Ece6KnL2_LGiAoW-jS8V4q-vbBXLwKc_0 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.6147673569119722495', time=2024-09-14T13:27:50.781898+0000, chain.objs.size()=1 2024-09-14T11:37:46.954 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.X9g7B3WC9leAInBIGp61kfioGsFhznX_0 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18438037527047698409', time=2024-09-14T13:27:50.963469+0000, chain.objs.size()=1 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.U2880t6MOdR6vHZFnCb__cxtICzecC9_0 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5139530606687364623', time=2024-09-14T13:27:50.966472+0000, chain.objs.size()=1 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.R8ffmRhG1HglCjfchReZbyhTnf4DkRB_0 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16789914119141793081', time=2024-09-14T13:27:51.021523+0000, chain.objs.size()=1 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.r_CwaPFmNR9rBP70o6ka_F0MtRgzmQ9_0 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16392597052278738756', time=2024-09-14T13:27:51.029841+0000, chain.objs.size()=1 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.GtkVun5X00Qmndd3wmQKGDhmoLPOEpT_0 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7911757042916173978', time=2024-09-14T13:27:51.050687+0000, chain.objs.size()=1 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.9f-k1Z90zuUIY_ypqTKuLWq2weAV6VW_0 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1521526269755888737', time=2024-09-14T13:27:51.099911+0000, chain.objs.size()=1 2024-09-14T11:37:46.956 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.a9HRGAT6bucWGI2ZigkKNVWrTga0hbP_0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18398967155796177250', time=2024-09-14T13:27:51.108160+0000, chain.objs.size()=1 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Hdfv_AzfU7VEmhFt3jColfQ0k4ihfNj_0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15935193541217194381', time=2024-09-14T13:27:51.108850+0000, chain.objs.size()=1 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.955+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.fdyF-trlq0blF6HBZyqtzn9som8Vh_7_0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.956+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3629979508133292839', time=2024-09-14T13:27:51.209609+0000, chain.objs.size()=1 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.956+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.sQSxWUwB-kSlVdqnmx9d5hJiTBC6Umx_0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.956+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.180643133876463922', time=2024-09-14T13:27:51.235031+0000, chain.objs.size()=1 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.956+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FVUjuRZvVsCT2zkbK-f53R-aGO5lt0O_0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1549311534716190856', time=2024-09-14T13:27:51.327726+0000, chain.objs.size()=1 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.e6ZByRwIwFwVtxzOO3ouSkMgUfs_nhD_0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15661246915763322973', time=2024-09-14T13:27:51.360591+0000, chain.objs.size()=1 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.YIM6b_B7PyFT5PGzUkA9okaMMw5ZYuw_0 2024-09-14T11:37:46.957 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.957+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4602156487314179870', time=2024-09-14T13:27:51.369723+0000, chain.objs.size()=1 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.957+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.HmWD4WHVOKEdVErnxkLgkdXJSK0KVPn_0 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1340950051993557101', time=2024-09-14T13:27:51.480112+0000, chain.objs.size()=1 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.FWhDqKmMmh5FanWFTsABKGQRwiz-jbl_0 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15566973020271131629', time=2024-09-14T13:27:51.482611+0000, chain.objs.size()=1 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iPOcEObWykMgqYR1zZojXHP-E7cI0CN_0 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1813013182838335086', time=2024-09-14T13:27:51.497382+0000, chain.objs.size()=1 2024-09-14T11:37:46.958 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.k7j5N9yFhKN_-RiCLsH8A0PBjMwZlpt_0 2024-09-14T11:37:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.262311807303883130', time=2024-09-14T13:27:51.628236+0000, chain.objs.size()=1 2024-09-14T11:37:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.958+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.I_S0PQxLGwr0x5kIIIvz_Pw_3Hsuuq__0 2024-09-14T11:37:46.959 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.960+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/71588 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=24, truncated=0, next_marker='' 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2515865013375487383', time=2024-09-14T13:27:51.717240+0000, chain.objs.size()=1 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.pb7iUcks0DJvmCJp_R2_CNZJzuG3fmm_0 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13462269878182502237', time=2024-09-14T13:27:51.981811+0000, chain.objs.size()=1 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Q0gcm3VEk5l3ZvVEIbwKB1wbIuBlh9k_0 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5054209516029258603', time=2024-09-14T13:27:52.096928+0000, chain.objs.size()=1 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Zwi7XW31tdP4Z7stNdPQPmFfssUfRBe_0 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7160785611375591851', time=2024-09-14T13:27:52.112207+0000, chain.objs.size()=1 2024-09-14T11:37:46.960 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.l9jzZhecoxRYvBx4LE3A82aiFZzJbWw_0 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4769012685461547117', time=2024-09-14T13:27:52.127772+0000, chain.objs.size()=1 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.d1fLyAfa0M-OWpA-KgoTpSYQGvttMFm_0 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1012057372570827037', time=2024-09-14T13:27:52.313173+0000, chain.objs.size()=1 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.ZwMmnVCvcmNDP9YGliWjB2becFZa0aj_0 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16320467827121669953', time=2024-09-14T13:28:02.089196+0000, chain.objs.size()=1 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.346__shadow_.K5H30Hgq0AsFpfYXThHxh5Nczlup8mk_0 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4398042835650348060', time=2024-09-14T13:28:11.919232+0000, chain.objs.size()=1 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.370__shadow_.OFc2W6P2S_z1b3jAcSJBt80G7oDB1RS_0 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12999309671043476088', time=2024-09-14T13:28:16.327554+0000, chain.objs.size()=1 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.377__shadow_.sVCz02HDyGG5KcDPif8FKRkbhPyk0d-_0 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4849579725516517349', time=2024-09-14T13:29:01.830311+0000, chain.objs.size()=1 2024-09-14T11:37:46.961 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.461__shadow_.MwDRrr6wi-PAVGPKBB2afZDQLyXn5KZ_0 2024-09-14T11:37:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.138940539107042614', time=2024-09-14T13:29:03.921049+0000, chain.objs.size()=1 2024-09-14T11:37:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.464__shadow_.vPzuyYuAtj_hki3yXTcgiKesIZQkvAt_0 2024-09-14T11:37:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9040381936240735886', time=2024-09-14T13:29:10.602571+0000, chain.objs.size()=1 2024-09-14T11:37:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.962+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.483__shadow_.pN6LylJCqt601Dlqa6gv4EImq3ic9qg_0 2024-09-14T11:37:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.963+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9793734868473846766', time=2024-09-14T13:29:32.793863+0000, chain.objs.size()=3 2024-09-14T11:37:46.962 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.963+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.520__shadow:KqZfEjJuJbrZdvdhJybQZ9fiC7957SH_.-BRBQ1ESdz91N2zsCpOpgEFMicZjjOV_0 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.520__shadow:KqZfEjJuJbrZdvdhJybQZ9fiC7957SH_.-BRBQ1ESdz91N2zsCpOpgEFMicZjjOV_1 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.520__shadow:KqZfEjJuJbrZdvdhJybQZ9fiC7957SH_.-BRBQ1ESdz91N2zsCpOpgEFMicZjjOV_2 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2012558027288123694', time=2024-09-14T13:30:29.780816+0000, chain.objs.size()=1 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.555__shadow_.A7A0eYTVleKmbDEO65A9ttcvy_xjPnX_0 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.895925577511539025', time=2024-09-14T13:30:30.324845+0000, chain.objs.size()=1 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.556__shadow_.M--I9-mCbeB2kk7-BHGCs-9CwjL6rEb_0 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.41096290966492206', time=2024-09-14T13:30:46.603211+0000, chain.objs.size()=1 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:QhbPKw953Z2QN3WWUh6FKxPPS90wa75_.fSofEPIpkMqgg8zuDr8gpuv6BRAPNY__0 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12280566650688198375', time=2024-09-14T13:31:00.338496+0000, chain.objs.size()=1 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:gyKoJxgdEsW9O56eGaMxnBHuKWxkPCw_.Rxjv6VD3jDQ-s0obbEwc0fKeoPThbBd_0 2024-09-14T11:37:46.963 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13161848388249815628', time=2024-09-14T13:31:07.000737+0000, chain.objs.size()=1 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:NC-GZjcLc7rXEzU8JwSjZwN1nvzwANI_.RXu5bE_9__Pqyw-Q0nZczaQe9HVzy-b_0 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16711311099248736624', time=2024-09-14T13:31:10.301757+0000, chain.objs.size()=1 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.577__shadow:XlJqfADkNo76g8NnYf4cdlS4rv3BhL4_.dpaNkdjd-TkTQ8dv3a47IKUDaHGOx3Z_0 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14638624605473258576', time=2024-09-14T13:31:18.640445+0000, chain.objs.size()=1 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.586__shadow:Flsw4XTKapx7QwFiKgO3tvAbYSeAl4._.VMn2QMM0vP-lbMDnQYKvqGISq4OaJUF_0 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18217998467293539887', time=2024-09-14T13:32:38.770633+0000, chain.objs.size()=1 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.964+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.617__shadow_.BLJnQkm5JyGvg4XicKYQ3N-cyLBhM58_0 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.965+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11027419098208850965', time=2024-09-14T13:34:58.008181+0000, chain.objs.size()=1 2024-09-14T11:37:46.964 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.965+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.739__shadow_.HBk6VGZez1lolZgAhonpvQj3540Xx4O_0 2024-09-14T11:37:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.967+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~GKYjzwgBzxB88uAj3fkjpQVL__Sd7gS', time=2024-09-14T13:34:59.840788+0000, chain.objs.size()=1 2024-09-14T11:37:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.967+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.742__multipart_mymultipart.2~GKYjzwgBzxB88uAj3fkjpQVL__Sd7gS.1 2024-09-14T11:37:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.967+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.440885002001073605', time=2024-09-14T13:35:00.505263+0000, chain.objs.size()=3 2024-09-14T11:37:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.967+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.743__multipart_mymultipart3.2~LsRLMtwKALJ5f9ZFdbxsw2v-cDlr_2D.1 2024-09-14T11:37:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.967+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.743__multipart_mymultipart3.2~LsRLMtwKALJ5f9ZFdbxsw2v-cDlr_2D.2 2024-09-14T11:37:46.965 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.967+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.743__multipart_mymultipart3.2~LsRLMtwKALJ5f9ZFdbxsw2v-cDlr_2D.3 2024-09-14T11:37:46.967 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.969+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:46.969 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.972+0000 7f676d32e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-14T11:37:46.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.973+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-14T11:37:46.971 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.973+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=100, truncated=1, next_marker='0/47225' 2024-09-14T11:37:46.972 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10705495513026638893', time=2024-09-14T13:26:40.268692+0000, chain.objs.size()=1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.236__shadow_.E734YSfrjc2kMo8Tu63KoAW_fTsaZvE_0 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9821118106316827308', time=2024-09-14T13:26:45.936854+0000, chain.objs.size()=1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.245__shadow_.fIryyvyPN0QwcxLy85I6LvzjIrxmyIe_0 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10460577084992824621', time=2024-09-14T13:26:52.270335+0000, chain.objs.size()=1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.258__shadow_.NnolAgnUAocZl5QLZGSP7sXuaUTRkyU_0 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2655781518423453513', time=2024-09-14T13:27:01.172356+0000, chain.objs.size()=1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.O219Fcr0or06nkusl-7RpVM_xZ_8PZO_0 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2598729247550185687', time=2024-09-14T13:27:01.205743+0000, chain.objs.size()=1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.P49Eo6akrsd6ATOBwMedl_0NvR0TZ8Z_0 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17602312636463764934', time=2024-09-14T13:27:01.284510+0000, chain.objs.size()=1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-_QOLFPmtN-49cZ4YVcEgaiRl3YbYsX_0 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10457056867890058101', time=2024-09-14T13:27:01.285579+0000, chain.objs.size()=1 2024-09-14T11:37:46.973 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.-lyQq9V1OXZp6wUw6062IUrvOscnc6E_0 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14892699043424022844', time=2024-09-14T13:27:01.511801+0000, chain.objs.size()=1 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Fu86PUQao7AvpuZN3C5hWBQzNCoh-U__0 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5929293872228195644', time=2024-09-14T13:27:01.519500+0000, chain.objs.size()=1 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.JmCZUGxEnDuv-gobrf7I2-RtUWIE9ei_0 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7710788809396047504', time=2024-09-14T13:27:01.522169+0000, chain.objs.size()=1 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Sk1bPYlchcwAQs4sMqcyAMh8PPC1JPc_0 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5394524728887196989', time=2024-09-14T13:27:01.655833+0000, chain.objs.size()=1 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.1LQ2nqMp1iYH-Xl6_mBxZLdK9kRgvPp_0 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18320079338688028033', time=2024-09-14T13:27:01.667197+0000, chain.objs.size()=1 2024-09-14T11:37:46.974 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.974+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_._pKdT1pfaGxjmMEkZGIJn4gGiBd2HY3_0 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.976+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1089160292529864015', time=2024-09-14T13:27:01.674902+0000, chain.objs.size()=1 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.976+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.UVwdyexK8A-i5YuzCHW3lp4n0JytHq6_0 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17439141100266386295', time=2024-09-14T13:27:01.680929+0000, chain.objs.size()=1 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.5t22AwaxuUuWQeZfZL9t7vCas33RGkH_0 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1026040012163722862', time=2024-09-14T13:27:01.689624+0000, chain.objs.size()=1 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.0hajpuM27BTtQ2wRd4rYXbimhl5CxWb_0 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2725572648167183212', time=2024-09-14T13:27:01.774626+0000, chain.objs.size()=1 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.eUR-ePr5w1zNPsT4krurHsr75maO2q0_0 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3884125034791552766', time=2024-09-14T13:27:01.920235+0000, chain.objs.size()=1 2024-09-14T11:37:46.975 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.qpZ3O1SvIaQokwDjY28IvL4vtkWrbkL_0 2024-09-14T11:37:46.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15873265840867703560', time=2024-09-14T13:27:01.962723+0000, chain.objs.size()=1 2024-09-14T11:37:46.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3crzCvf3hUYFlzDnF8uBSnTsCYGgGEw_0 2024-09-14T11:37:46.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5798486978202408798', time=2024-09-14T13:27:02.010842+0000, chain.objs.size()=1 2024-09-14T11:37:46.976 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lE0TmHK7X_Aqa2FL0zonaAp_dwm-p9m_0 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9522919893538259705', time=2024-09-14T13:27:02.049205+0000, chain.objs.size()=1 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.bb7BhEcntD_t3DRIc0Lo7tubnJBdnhF_0 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14041687209519492693', time=2024-09-14T13:27:02.131442+0000, chain.objs.size()=1 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.3tWOY1HV9FeMCkdfB_PvqN1e4qiLPcX_0 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14113587504685753531', time=2024-09-14T13:27:02.173091+0000, chain.objs.size()=1 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pQYDMtHJUMYL7GCVL1wOyAyd2n3kqhA_0 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5668543868988864848', time=2024-09-14T13:27:02.240464+0000, chain.objs.size()=1 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yHtSWyn4IdXCO58_oZufk9k7UWhU1RJ_0 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2937286308229636690', time=2024-09-14T13:27:02.257864+0000, chain.objs.size()=1 2024-09-14T11:37:46.977 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.977+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.GMPpvCqWyVVdSQAl2q6YR5sRmlga4VI_0 2024-09-14T11:37:46.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18102997846622932319', time=2024-09-14T13:27:02.260309+0000, chain.objs.size()=1 2024-09-14T11:37:46.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.Uo4pZvnxUpiJu0U34W7V99ns2er5lJv_0 2024-09-14T11:37:46.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15293072787269546380', time=2024-09-14T13:27:02.386541+0000, chain.objs.size()=1 2024-09-14T11:37:46.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.ARfeSEdrwbiwJPC4wIJODxpv-3qOI3j_0 2024-09-14T11:37:46.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11106250298615074096', time=2024-09-14T13:27:02.397861+0000, chain.objs.size()=1 2024-09-14T11:37:46.978 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.N1a2-fv1bSt_YtvX6vKXwzKq43NNfA8_0 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16007348136944614926', time=2024-09-14T13:27:02.404125+0000, chain.objs.size()=1 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.yfYdcif4rREKBGWFBbbcP81dw7HbEeo_0 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10395628203695852226', time=2024-09-14T13:27:02.622117+0000, chain.objs.size()=1 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.lh1aZdLnoE2amMEKCIc5qGZBEVncwGb_0 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8529142568814588395', time=2024-09-14T13:27:02.681361+0000, chain.objs.size()=1 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.QodvRhRJyXjE4SUW5vx_pmxuJZeoAMI_0 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12351537310088308719', time=2024-09-14T13:27:02.734306+0000, chain.objs.size()=1 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.B_ZdSx5RNol0DPpLjQFQah7H1sFcA_q_0 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2441713626629240283', time=2024-09-14T13:27:02.744579+0000, chain.objs.size()=1 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.P3ItkQTtZNodlNnVwjWzVka2RmziiQt_0 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1587750016844369065', time=2024-09-14T13:27:02.879472+0000, chain.objs.size()=1 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.p_1ULkeTitQ6Z1-gxbSGOKBNFAlFq0-_0 2024-09-14T11:37:46.979 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3190613905652809824', time=2024-09-14T13:27:02.961417+0000, chain.objs.size()=1 2024-09-14T11:37:46.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.262__shadow_.pSCK5IxDhBIrJOxxcleyXe8Sv6XPfxq_0 2024-09-14T11:37:46.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1397515351369068129', time=2024-09-14T13:27:07.616596+0000, chain.objs.size()=1 2024-09-14T11:37:46.980 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.980+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.272__shadow_.CQ5rSYr0laOY6HAL5o2RhMo9xrhT85F_0 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4875372470836393930', time=2024-09-14T13:27:09.010351+0000, chain.objs.size()=1 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.275__shadow_.PIA3ET40UR3a5Rk_dngyg2LZ3_sk6PA_0 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8913125418814077492', time=2024-09-14T13:27:09.458771+0000, chain.objs.size()=1 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.276__shadow_.M_VF6Dtbg89rRi3C-a_1qT7pJx4pGBn_0 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16150696457239216637', time=2024-09-14T13:27:32.216350+0000, chain.objs.size()=1 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.321__shadow_.nTjyroshnncJr8B2z9QMzaSwz2tJ4BQ_0 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14934527844647566509', time=2024-09-14T13:27:40.834814+0000, chain.objs.size()=1 2024-09-14T11:37:46.981 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.nxx0E9rMbrH_CPGHw8omFD2AY2ylsQR_0 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11831321904020691703', time=2024-09-14T13:27:40.907477+0000, chain.objs.size()=1 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.j42s0YpLW7g8K6vmItLiHitET8mm5uL_0 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8510707011869612319', time=2024-09-14T13:27:40.908191+0000, chain.objs.size()=1 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.982+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PlbPdbPAxzNN1rNXk0U3zOrPBlSDLi__0 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3671332148376360108', time=2024-09-14T13:27:40.916380+0000, chain.objs.size()=1 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.p8gJU9lapIANZWj54n6wGmL0wQtVYiR_0 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16211404607113884705', time=2024-09-14T13:27:41.035116+0000, chain.objs.size()=1 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XJGjI1N-HBPALNhos77rY9rMpZR6rlb_0 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7095016260350479958', time=2024-09-14T13:27:41.096530+0000, chain.objs.size()=1 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.GuDjo1F_UtdQTqJZ4MvEGcnG3A64tr8_0 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3064368502307006003', time=2024-09-14T13:27:41.124136+0000, chain.objs.size()=1 2024-09-14T11:37:46.982 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.0cY49bCI8nJ3fqV0IuQ4ZbWnvKut7UG_0 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9956031686934159480', time=2024-09-14T13:27:41.198556+0000, chain.objs.size()=1 2024-09-14T11:37:46.983 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.yy3vBvum2ki62KzDfTboqFaMt3HroKz_0 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1771845745181834990', time=2024-09-14T13:27:41.350324+0000, chain.objs.size()=1 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.983+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.OV1sHrt08LF-uHxMHYyJgh9ICfJweuS_0 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10941780104468668737', time=2024-09-14T13:27:41.423080+0000, chain.objs.size()=1 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.EXa2FSpoGe_pKXxQcy4bvW0IaEDWcLu_0 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7060307808266843628', time=2024-09-14T13:27:41.454161+0000, chain.objs.size()=1 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Gw0qjqoEDKAdWqvA_eAQxfG00gCshjl_0 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5056441232860157899', time=2024-09-14T13:27:41.589180+0000, chain.objs.size()=1 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.65orjILn-TwezRd-LwR60uprZ_CYDHl_0 2024-09-14T11:37:46.984 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10704818313791254902', time=2024-09-14T13:27:41.616534+0000, chain.objs.size()=1 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.l2MAgapN8GA-28tbTCd7xq7CLPRhAWK_0 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12543264625818574483', time=2024-09-14T13:27:41.664608+0000, chain.objs.size()=1 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.984+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.ivITDLCDCC9Nd4Sg3IGj1X_5_PHHGbL_0 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.359728994914331340', time=2024-09-14T13:27:41.671812+0000, chain.objs.size()=1 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.XTQw457mswm25Z5sL4PwBbul2OePVup_0 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1874810242145268105', time=2024-09-14T13:27:41.681424+0000, chain.objs.size()=1 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.mHNfY7yH_u1jbroQZ8j4bgCoDOI_vkq_0 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2123312088220197493', time=2024-09-14T13:27:41.907725+0000, chain.objs.size()=1 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.hVysa8H_-6UHMpLQGEChfbFif8BbgWh_0 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4392476147253258477', time=2024-09-14T13:27:41.957989+0000, chain.objs.size()=1 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.s0ZYp5i2wA3qVc58abYxYMvNa8yRaO8_0 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12309832091073333845', time=2024-09-14T13:27:42.081259+0000, chain.objs.size()=1 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.eGcMc0-ItF--2dFmgSyUcDo4IN-t5gw_0 2024-09-14T11:37:46.985 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7686445865254580236', time=2024-09-14T13:27:42.094553+0000, chain.objs.size()=1 2024-09-14T11:37:46.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.985+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.PGuQdsTgbeK707G70JtLPCd-LRiFTIO_0 2024-09-14T11:37:46.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13222585492873091495', time=2024-09-14T13:27:42.125186+0000, chain.objs.size()=1 2024-09-14T11:37:46.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.-DhylDgKyDCUo_Qx8uzp1TQhYtRMJRw_0 2024-09-14T11:37:46.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3016017372837220078', time=2024-09-14T13:27:42.215192+0000, chain.objs.size()=1 2024-09-14T11:37:46.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.7Bb2mG0DfMyKv4FtMNUEQ9rNvr7Iem1_0 2024-09-14T11:37:46.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14163488468052549962', time=2024-09-14T13:27:42.328783+0000, chain.objs.size()=1 2024-09-14T11:37:46.986 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.oSCmlYS0Dky9UDZdTxoNN7_6q0LJ041_0 2024-09-14T11:37:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13584326240441905441', time=2024-09-14T13:27:42.373976+0000, chain.objs.size()=1 2024-09-14T11:37:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.Yof6_TvLo_xyjFbmpgjCzUcv-i3Vp4Q_0 2024-09-14T11:37:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9882462036585659162', time=2024-09-14T13:27:42.484632+0000, chain.objs.size()=1 2024-09-14T11:37:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.323__shadow_.fnhApdCmT2uwxk9hup17IZ6RZUNpeKk_0 2024-09-14T11:37:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.4307019607299063582', time=2024-09-14T13:27:50.449042+0000, chain.objs.size()=1 2024-09-14T11:37:46.987 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.986+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VtasJilTpOdT8EEaD6CV4odI2NGJVdl_0 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.987+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2424909280963457501', time=2024-09-14T13:27:50.681316+0000, chain.objs.size()=1 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.dZCLUT-TPBA1wY4ljeBwaArPF1Qj2U3_0 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13468471344091027249', time=2024-09-14T13:27:50.985091+0000, chain.objs.size()=1 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.6EedTcRWHMRWVJUBqjh4ccA9ghOaOAl_0 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7438758778704085819', time=2024-09-14T13:27:50.987337+0000, chain.objs.size()=1 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.cZu95gY77_fIrvfFpIR4nENBOTNrfHw_0 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15598300267251325035', time=2024-09-14T13:27:50.988866+0000, chain.objs.size()=1 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.wmdNyUVlnS4L-ofFulkxxGXNBGj9ojV_0 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.16538458283113572389', time=2024-09-14T13:27:51.013950+0000, chain.objs.size()=1 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.xVYnu7uMAz2ZvvJ-NA5_TorS6kbAcnb_0 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15241986163132559183', time=2024-09-14T13:27:51.057438+0000, chain.objs.size()=1 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SEBNoZEd2ddSXhK_Og4s6AR9YBqSYNR_0 2024-09-14T11:37:46.988 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14438272672370669919', time=2024-09-14T13:27:51.243961+0000, chain.objs.size()=1 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0Emt8EXSEMto4QHY5rwZHn2YTLrEL_a_0 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.8193995038769572192', time=2024-09-14T13:27:51.274963+0000, chain.objs.size()=1 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.yxu2WaLk5HX91A6FHh_UvYTvJijkqCw_0 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17028978974192984694', time=2024-09-14T13:27:51.303399+0000, chain.objs.size()=1 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.XuaVykD-65JLXaAThrAp7dyb8LpUSZY_0 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.11210573684472739222', time=2024-09-14T13:27:51.366657+0000, chain.objs.size()=1 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.988+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.jCw74OFmRk_MtgpSpdy33VM3YMXFwGH_0 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.989+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10354104809249231956', time=2024-09-14T13:27:51.498925+0000, chain.objs.size()=1 2024-09-14T11:37:46.989 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.989+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.AiF4ulq5TUSNl3-7b4Cp34hPbivIYgK_0 2024-09-14T11:37:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.989+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10865646327841632900', time=2024-09-14T13:27:51.536697+0000, chain.objs.size()=1 2024-09-14T11:37:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.989+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.0_gCAs9vL-qO481L7qzJXelrMrTIhY-_0 2024-09-14T11:37:46.990 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.832870239706597045', time=2024-09-14T13:27:51.618609+0000, chain.objs.size()=1 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.VQwJm074Dt66yoyRlNaDBRpjuPKcPTh_0 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10458735199624191121', time=2024-09-14T13:27:51.741121+0000, chain.objs.size()=1 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.l2HSRNn-QMkYJOyBSIXJtv4YzOfcgtZ_0 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12727369612030493291', time=2024-09-14T13:27:51.792670+0000, chain.objs.size()=1 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.UkVfg4Wx8KuddKeKeCkULx-o8RD7adn_0 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17501968487340726878', time=2024-09-14T13:27:51.869781+0000, chain.objs.size()=1 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.gj8yvQnfUQJ1AvW679et0xl89LgDa8V_0 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.14123555950531631546', time=2024-09-14T13:27:52.037182+0000, chain.objs.size()=1 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.Z9YzGXaWBCIuudwl1a-Lrqk2-U06lBG_0 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13697506820118470619', time=2024-09-14T13:27:52.039738+0000, chain.objs.size()=1 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.MKBWPFDqyLqgPLArDhV3Yeq0c9Q81dx_0 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5426086654716894235', time=2024-09-14T13:27:52.052558+0000, chain.objs.size()=1 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.990+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.iT9vHoIAwK00RFjzSKZSDmjh6dmYqwG_0 2024-09-14T11:37:46.991 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.991+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2422626515899289942', time=2024-09-14T13:27:52.054574+0000, chain.objs.size()=1 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.991+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_._ZADPo8PPLfMfrAglYRE0C5XRC1vWBX_0 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.991+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5689059529232758420', time=2024-09-14T13:27:52.223354+0000, chain.objs.size()=1 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.991+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.SIrukceKNGC214wQPraChG4jwkw7tKx_0 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5229542179787680372', time=2024-09-14T13:27:52.232617+0000, chain.objs.size()=1 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.obsYUXWsRhz9qzdsP2kZD-fp_OpxvH4_0 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18115704742096634934', time=2024-09-14T13:27:52.247356+0000, chain.objs.size()=1 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.324__shadow_.D3VQP69n5tWuB8rNVe4S8NET7XD2hM5_0 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5117235909823095049', time=2024-09-14T13:27:53.561238+0000, chain.objs.size()=1 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.327__shadow_.oSshKEN31IvTNc5b4UqzIWaWbm1IdG2_0 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.5181556166197429860', time=2024-09-14T13:28:49.481985+0000, chain.objs.size()=1 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.441__shadow_.TEOvUYHIaXFO81V4SWuJvQmBbmLX--L_0 2024-09-14T11:37:46.992 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.9770690122716309276', time=2024-09-14T13:28:54.863456+0000, chain.objs.size()=1 2024-09-14T11:37:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.450__shadow_.J0bzx1-5caY755w7eZcjjqk-M5cwd1R_0 2024-09-14T11:37:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.10570045222653557990', time=2024-09-14T13:29:02.587293+0000, chain.objs.size()=1 2024-09-14T11:37:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.992+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.462__shadow_.n1bxRHAZ_rWI6EfBVafQC7gmpEx-ejm_0 2024-09-14T11:37:46.993 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.15236054614408471288', time=2024-09-14T13:29:18.189822+0000, chain.objs.size()=1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.500__shadow_.M23mieO3NKCcd4Kelwcd2Aq9dAc99XP_0 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2309301465277232836', time=2024-09-14T13:29:20.021054+0000, chain.objs.size()=1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.503__shadow:mTcNqOeSoMdp1SFsn-oYFj8mNhIIfUb_.m4lffY6UOEudOA076OqtE8cz_-frwwK_0 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.2813550068035774306', time=2024-09-14T13:29:44.490815+0000, chain.objs.size()=2 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~K5i0NYzHxzdvyav7aWMDo_CnGaXs5qo.1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.523__multipart_mymultipart.2~K5i0NYzHxzdvyav7aWMDo_CnGaXs5qo.2 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7438686532493829187', time=2024-09-14T13:30:31.717611+0000, chain.objs.size()=1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.993+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.558__shadow_.EkQyD2TPmw1qaD06f8VkfOR--XtsNuX_0 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='2~Qpza-zl7j_MsllT_74uQNR1e9JPN-Nq', time=2024-09-14T13:30:33.315287+0000, chain.objs.size()=1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.561__multipart_mymultipart.2~Qpza-zl7j_MsllT_74uQNR1e9JPN-Nq.1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.7368515408987442497', time=2024-09-14T13:30:47.482252+0000, chain.objs.size()=1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.569__shadow:YFwHuq.jDf48lp5eOqt7UiwZ6mBrr1e_.2qOb4enkpbKv7W3ubHpLTZVWxynztZD_0 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.3591076216712032792', time=2024-09-14T13:30:48.210643+0000, chain.objs.size()=1 2024-09-14T11:37:46.994 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.570__shadow:3MIeE0Ggck46.MmvoTOY7L6-HfvniSz_.uC6cui8CtjwyRh5NzNiOVpKqCkJx9Bt_0 2024-09-14T11:37:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12662468918496168957', time=2024-09-14T13:30:57.139405+0000, chain.objs.size()=1 2024-09-14T11:37:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.576__shadow:C8Me5Oiwb7CJvIlA5IsjNqYhik0mljk_.Os986scJLX1dsweTZ0qxliXfO255F8f_0 2024-09-14T11:37:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1941934180621204650', time=2024-09-14T13:31:15.266276+0000, chain.objs.size()=1 2024-09-14T11:37:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.995+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.580__shadow:m2TCnfgQxTvaXjeT2VBMKN7DqU1KiIm_.Ium0zqcfQkMFtUwhhE7YeTh1wUxk_Gj_0 2024-09-14T11:37:46.995 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.996+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 0/47225 2024-09-14T11:37:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-14T11:37:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.18175889932660954830', time=2024-09-14T13:31:19.109900+0000, chain.objs.size()=1 2024-09-14T11:37:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.587__shadow:4EirXe-.M92.81CYWbqTfs5c.-3TVx8_.DCRB4UodZInLooSHr4wkitvnxMWW3rN_0 2024-09-14T11:37:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12676714087871960385', time=2024-09-14T13:33:48.396659+0000, chain.objs.size()=1 2024-09-14T11:37:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.632__shadow_.GqMzNe5_eRfnU4DkuMPTHYra-XHhp_w_0 2024-09-14T11:37:46.997 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.12496637389452532426', time=2024-09-14T13:33:52.179097+0000, chain.objs.size()=1 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.640__shadow_.whqbYSeX-S9gd7LbrFcrSwSS9r5g6Ng_0 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.1224414168216495826', time=2024-09-14T13:34:04.587522+0000, chain.objs.size()=1 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.663__shadow_.AfZIQhtjeCLWYqLpmLyPUeQ5EMI-Rsp_0 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.13806686602155860607', time=2024-09-14T13:34:05.837148+0000, chain.objs.size()=1 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.665__shadow_.D6c_9M7WzdgV5Wmd1SPq3xE9C5-nq1F_0 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 20 garbage collection: RGWGC::process iterating over entry tag='17edae97-cd6b-4c90-863d-862429a20cf3.4538.17576565970061108374', time=2024-09-14T13:35:26.452067+0000, chain.objs.size()=1 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:46.999+0000 7f676d32e800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:17edae97-cd6b-4c90-863d-862429a20cf3.4538.764__shadow_.VjpsrwaMaVvZh0ToKRb5NCKknz1_0Rn_0 2024-09-14T11:37:46.998 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.001+0000 7f676d32e800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-14T11:37:47.001 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.004+0000 7f661ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-14T11:37:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.006+0000 7f676d32e800 20 remove_watcher() i=0 2024-09-14T11:37:47.004 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.006+0000 7f676d32e800 2 removed watcher, disabling cache 2024-09-14T11:37:47.005 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.007+0000 7f676d32e800 20 remove_watcher() i=1 2024-09-14T11:37:47.006 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.008+0000 7f676d32e800 20 remove_watcher() i=2 2024-09-14T11:37:47.007 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.009+0000 7f676d32e800 20 remove_watcher() i=3 2024-09-14T11:37:47.008 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.010+0000 7f676d32e800 20 remove_watcher() i=4 2024-09-14T11:37:47.009 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.011+0000 7f676d32e800 20 remove_watcher() i=5 2024-09-14T11:37:47.010 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.012+0000 7f676d32e800 20 remove_watcher() i=6 2024-09-14T11:37:47.011 INFO:teuthology.orchestra.run.smithi002.stderr:2024-09-14T11:37:47.013+0000 7f676d32e800 20 remove_watcher() i=7 2024-09-14T11:37:47.023 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-14T11:37:47.034 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-14T11:37:47.092 DEBUG:teuthology.orchestra.run.smithi002:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:37:47.162 DEBUG:teuthology.orchestra.run.smithi002:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-14T11:37:47.232 DEBUG:teuthology.orchestra.run.smithi002:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-14T11:37:47.301 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-14T11:37:47.381 DEBUG:teuthology.orchestra.run.smithi002:> sudo update-ca-trust 2024-09-14T11:37:48.527 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-14T11:37:48.923 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-14T11:37:48.923 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:37:49.262 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:37:49.273 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:37:49.275 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1517,"stamp":"2024-09-14T11:37:47.662908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":743936910,"num_objects":4698,"num_object_clones":0,"num_object_copies":9396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4698,"num_whiteouts":0,"num_read":192072,"num_read_kb":2593426,"num_write":141703,"num_write_kb":2468304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14333,"ondisk_log_size":14333,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2779456,"kb_used_data":1512512,"kb_used_omap":12,"kb_used_meta":1266803,"kb_avail":752195264,"statfs":{"total":773094113280,"available":770247950336,"internally_reserved":0,"allocated":1548812288,"data_stored":1503929190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1297206832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005956"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879647+0000","last_change":"2024-09-14T11:22:38.554296+0000","last_active":"2024-09-14T11:35:07.879647+0000","last_peered":"2024-09-14T11:35:07.879647+0000","last_clean":"2024-09-14T11:35:07.879647+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:35:07.879647+0000","last_undegraded":"2024-09-14T11:35:07.879647+0000","last_fullsized":"2024-09-14T11:35:07.879647+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:24.257792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:32.874387+0000","last_change":"2024-09-14T11:12:00.371370+0000","last_active":"2024-09-14T11:34:32.874387+0000","last_peered":"2024-09-14T11:34:32.874387+0000","last_clean":"2024-09-14T11:34:32.874387+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:34:32.874387+0000","last_undegraded":"2024-09-14T11:34:32.874387+0000","last_fullsized":"2024-09-14T11:34:32.874387+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:10.434332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603806+0000","last_change":"2024-09-14T11:11:57.356179+0000","last_active":"2024-09-14T11:34:30.603806+0000","last_peered":"2024-09-14T11:34:30.603806+0000","last_clean":"2024-09-14T11:34:30.603806+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:34:30.603806+0000","last_undegraded":"2024-09-14T11:34:30.603806+0000","last_fullsized":"2024-09-14T11:34:30.603806+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:20.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":15360,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763760+0000","last_change":"2024-09-14T11:10:13.511537+0000","last_active":"2024-09-14T11:35:13.763760+0000","last_peered":"2024-09-14T11:35:13.763760+0000","last_clean":"2024-09-14T11:35:13.763760+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:35:13.763760+0000","last_undegraded":"2024-09-14T11:35:13.763760+0000","last_fullsized":"2024-09-14T11:35:13.763760+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.866042+0000","last_change":"2024-09-14T11:22:38.557878+0000","last_active":"2024-09-14T11:35:09.866042+0000","last_peered":"2024-09-14T11:35:09.866042+0000","last_clean":"2024-09-14T11:35:09.866042+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:35:09.866042+0000","last_undegraded":"2024-09-14T11:35:09.866042+0000","last_fullsized":"2024-09-14T11:35:09.866042+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:33.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891707+0000","last_change":"2024-09-14T11:12:00.365069+0000","last_active":"2024-09-14T11:34:29.891707+0000","last_peered":"2024-09-14T11:34:29.891707+0000","last_clean":"2024-09-14T11:34:29.891707+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:34:29.891707+0000","last_undegraded":"2024-09-14T11:34:29.891707+0000","last_fullsized":"2024-09-14T11:34:29.891707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.203248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757783+0000","last_change":"2024-09-14T11:11:57.352596+0000","last_active":"2024-09-14T11:34:28.757783+0000","last_peered":"2024-09-14T11:34:28.757783+0000","last_clean":"2024-09-14T11:34:28.757783+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:34:28.757783+0000","last_undegraded":"2024-09-14T11:34:28.757783+0000","last_fullsized":"2024-09-14T11:34:28.757783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.294796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:56.089950+0000","last_change":"2024-09-14T11:10:13.500557+0000","last_active":"2024-09-14T11:34:56.089950+0000","last_peered":"2024-09-14T11:34:56.089950+0000","last_clean":"2024-09-14T11:34:56.089950+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:34:56.089950+0000","last_undegraded":"2024-09-14T11:34:56.089950+0000","last_fullsized":"2024-09-14T11:34:56.089950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.821678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:44.893419+0000","last_change":"2024-09-14T11:22:38.555518+0000","last_active":"2024-09-14T11:34:44.893419+0000","last_peered":"2024-09-14T11:34:44.893419+0000","last_clean":"2024-09-14T11:34:44.893419+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:34:44.893419+0000","last_undegraded":"2024-09-14T11:34:44.893419+0000","last_fullsized":"2024-09-14T11:34:44.893419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:12.998285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761867+0000","last_change":"2024-09-14T11:12:00.696948+0000","last_active":"2024-09-14T11:34:58.761867+0000","last_peered":"2024-09-14T11:34:58.761867+0000","last_clean":"2024-09-14T11:34:58.761867+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:34:58.761867+0000","last_undegraded":"2024-09-14T11:34:58.761867+0000","last_fullsized":"2024-09-14T11:34:58.761867+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:04.389759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.858303+0000","last_change":"2024-09-14T11:11:57.355524+0000","last_active":"2024-09-14T11:34:04.858303+0000","last_peered":"2024-09-14T11:34:04.858303+0000","last_clean":"2024-09-14T11:34:04.858303+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:34:04.858303+0000","last_undegraded":"2024-09-14T11:34:04.858303+0000","last_fullsized":"2024-09-14T11:34:04.858303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:57.603602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5122,"num_write":12,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763690+0000","last_change":"2024-09-14T11:10:13.508809+0000","last_active":"2024-09-14T11:35:13.763690+0000","last_peered":"2024-09-14T11:35:13.763690+0000","last_clean":"2024-09-14T11:35:13.763690+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:35:13.763690+0000","last_undegraded":"2024-09-14T11:35:13.763690+0000","last_fullsized":"2024-09-14T11:35:13.763690+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:45.025002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605928+0000","last_change":"2024-09-14T11:22:38.561594+0000","last_active":"2024-09-14T11:34:45.605928+0000","last_peered":"2024-09-14T11:34:45.605928+0000","last_clean":"2024-09-14T11:34:45.605928+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:34:45.605928+0000","last_undegraded":"2024-09-14T11:34:45.605928+0000","last_fullsized":"2024-09-14T11:34:45.605928+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.203331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600584+0000","last_change":"2024-09-14T11:12:00.696088+0000","last_active":"2024-09-14T11:34:05.600584+0000","last_peered":"2024-09-14T11:34:05.600584+0000","last_clean":"2024-09-14T11:34:05.600584+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:34:05.600584+0000","last_undegraded":"2024-09-14T11:34:05.600584+0000","last_fullsized":"2024-09-14T11:34:05.600584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:28.207806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895433+0000","last_change":"2024-09-14T11:11:57.350368+0000","last_active":"2024-09-14T11:34:54.895433+0000","last_peered":"2024-09-14T11:34:54.895433+0000","last_clean":"2024-09-14T11:34:54.895433+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:34:54.895433+0000","last_undegraded":"2024-09-14T11:34:54.895433+0000","last_fullsized":"2024-09-14T11:34:54.895433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:04.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":13,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609835+0000","last_change":"2024-09-14T11:10:13.511471+0000","last_active":"2024-09-14T11:35:15.609835+0000","last_peered":"2024-09-14T11:35:15.609835+0000","last_clean":"2024-09-14T11:35:15.609835+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:35:15.609835+0000","last_undegraded":"2024-09-14T11:35:15.609835+0000","last_fullsized":"2024-09-14T11:35:15.609835+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:33.776917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:40.605265+0000","last_change":"2024-09-14T11:22:38.562233+0000","last_active":"2024-09-14T11:34:40.605265+0000","last_peered":"2024-09-14T11:34:40.605265+0000","last_clean":"2024-09-14T11:34:40.605265+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:34:40.605265+0000","last_undegraded":"2024-09-14T11:34:40.605265+0000","last_fullsized":"2024-09-14T11:34:40.605265+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:59.647783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868050+0000","last_change":"2024-09-14T11:12:00.373042+0000","last_active":"2024-09-14T11:33:47.868050+0000","last_peered":"2024-09-14T11:33:47.868050+0000","last_clean":"2024-09-14T11:33:47.868050+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:33:47.868050+0000","last_undegraded":"2024-09-14T11:33:47.868050+0000","last_fullsized":"2024-09-14T11:33:47.868050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:42.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751536+0000","last_change":"2024-09-14T11:11:57.347912+0000","last_active":"2024-09-14T11:33:43.751536+0000","last_peered":"2024-09-14T11:33:43.751536+0000","last_clean":"2024-09-14T11:33:43.751536+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:33:43.751536+0000","last_undegraded":"2024-09-14T11:33:43.751536+0000","last_fullsized":"2024-09-14T11:33:43.751536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:27.723340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609807+0000","last_change":"2024-09-14T11:10:13.510098+0000","last_active":"2024-09-14T11:35:15.609807+0000","last_peered":"2024-09-14T11:35:15.609807+0000","last_clean":"2024-09-14T11:35:15.609807+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:35:15.609807+0000","last_undegraded":"2024-09-14T11:35:15.609807+0000","last_fullsized":"2024-09-14T11:35:15.609807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:46.783877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763109+0000","last_change":"2024-09-14T11:22:38.558736+0000","last_active":"2024-09-14T11:35:08.763109+0000","last_peered":"2024-09-14T11:35:08.763109+0000","last_clean":"2024-09-14T11:35:08.763109+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:35:08.763109+0000","last_undegraded":"2024-09-14T11:35:08.763109+0000","last_fullsized":"2024-09-14T11:35:08.763109+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:58.587973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885772+0000","last_change":"2024-09-14T11:12:00.372932+0000","last_active":"2024-09-14T11:33:44.885772+0000","last_peered":"2024-09-14T11:33:44.885772+0000","last_clean":"2024-09-14T11:33:44.885772+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:33:44.885772+0000","last_undegraded":"2024-09-14T11:33:44.885772+0000","last_fullsized":"2024-09-14T11:33:44.885772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:01.464328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885933+0000","last_change":"2024-09-14T11:11:57.351572+0000","last_active":"2024-09-14T11:33:44.885933+0000","last_peered":"2024-09-14T11:33:44.885933+0000","last_clean":"2024-09-14T11:33:44.885933+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:33:44.885933+0000","last_undegraded":"2024-09-14T11:33:44.885933+0000","last_fullsized":"2024-09-14T11:33:44.885933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:43.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897732+0000","last_change":"2024-09-14T11:10:13.507035+0000","last_active":"2024-09-14T11:35:14.897732+0000","last_peered":"2024-09-14T11:35:14.897732+0000","last_clean":"2024-09-14T11:35:14.897732+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:35:14.897732+0000","last_undegraded":"2024-09-14T11:35:14.897732+0000","last_fullsized":"2024-09-14T11:35:14.897732+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.962765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897474+0000","last_change":"2024-09-14T11:22:38.558217+0000","last_active":"2024-09-14T11:35:09.897474+0000","last_peered":"2024-09-14T11:35:09.897474+0000","last_clean":"2024-09-14T11:35:09.897474+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:35:09.897474+0000","last_undegraded":"2024-09-14T11:35:09.897474+0000","last_fullsized":"2024-09-14T11:35:09.897474+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:16.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891260+0000","last_change":"2024-09-14T11:12:00.366839+0000","last_active":"2024-09-14T11:34:29.891260+0000","last_peered":"2024-09-14T11:34:29.891260+0000","last_clean":"2024-09-14T11:34:29.891260+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:34:29.891260+0000","last_undegraded":"2024-09-14T11:34:29.891260+0000","last_fullsized":"2024-09-14T11:34:29.891260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:28.093713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891654+0000","last_change":"2024-09-14T11:11:57.355185+0000","last_active":"2024-09-14T11:34:29.891654+0000","last_peered":"2024-09-14T11:34:29.891654+0000","last_clean":"2024-09-14T11:34:29.891654+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:34:29.891654+0000","last_undegraded":"2024-09-14T11:34:29.891654+0000","last_fullsized":"2024-09-14T11:34:29.891654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.881561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758163+0000","last_change":"2024-09-14T11:10:13.507975+0000","last_active":"2024-09-14T11:34:33.758163+0000","last_peered":"2024-09-14T11:34:33.758163+0000","last_clean":"2024-09-14T11:34:33.758163+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:34:33.758163+0000","last_undegraded":"2024-09-14T11:34:33.758163+0000","last_fullsized":"2024-09-14T11:34:33.758163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:21.041245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897517+0000","last_change":"2024-09-14T11:22:38.561164+0000","last_active":"2024-09-14T11:35:09.897517+0000","last_peered":"2024-09-14T11:35:09.897517+0000","last_clean":"2024-09-14T11:35:09.897517+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:35:09.897517+0000","last_undegraded":"2024-09-14T11:35:09.897517+0000","last_fullsized":"2024-09-14T11:35:09.897517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:43.901705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880477+0000","last_change":"2024-09-14T11:12:43.314131+0000","last_active":"2024-09-14T11:35:12.880477+0000","last_peered":"2024-09-14T11:35:12.880477+0000","last_clean":"2024-09-14T11:35:12.880477+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:35:12.880477+0000","last_undegraded":"2024-09-14T11:35:12.880477+0000","last_fullsized":"2024-09-14T11:35:12.880477+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:03.892987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757433+0000","last_change":"2024-09-14T11:11:57.358103+0000","last_active":"2024-09-14T11:34:28.757433+0000","last_peered":"2024-09-14T11:34:28.757433+0000","last_clean":"2024-09-14T11:34:28.757433+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:34:28.757433+0000","last_undegraded":"2024-09-14T11:34:28.757433+0000","last_fullsized":"2024-09-14T11:34:28.757433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:14.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":17,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.757100+0000","last_change":"2024-09-14T11:10:13.501269+0000","last_active":"2024-09-14T11:34:23.757100+0000","last_peered":"2024-09-14T11:34:23.757100+0000","last_clean":"2024-09-14T11:34:23.757100+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:34:23.757100+0000","last_undegraded":"2024-09-14T11:34:23.757100+0000","last_fullsized":"2024-09-14T11:34:23.757100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:36.721868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:18.756557+0000","last_change":"2024-09-14T11:22:38.559223+0000","last_active":"2024-09-14T11:34:18.756557+0000","last_peered":"2024-09-14T11:34:18.756557+0000","last_clean":"2024-09-14T11:34:18.756557+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:34:18.756557+0000","last_undegraded":"2024-09-14T11:34:18.756557+0000","last_fullsized":"2024-09-14T11:34:18.756557+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:18.099181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598125+0000","last_change":"2024-09-14T11:12:00.695830+0000","last_active":"2024-09-14T11:33:45.598125+0000","last_peered":"2024-09-14T11:33:45.598125+0000","last_clean":"2024-09-14T11:33:45.598125+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:33:45.598125+0000","last_undegraded":"2024-09-14T11:33:45.598125+0000","last_fullsized":"2024-09-14T11:33:45.598125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:08.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881154+0000","last_change":"2024-09-14T11:11:57.353227+0000","last_active":"2024-09-14T11:35:17.881154+0000","last_peered":"2024-09-14T11:35:17.881154+0000","last_clean":"2024-09-14T11:35:17.881154+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:35:17.881154+0000","last_undegraded":"2024-09-14T11:35:17.881154+0000","last_fullsized":"2024-09-14T11:35:17.881154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:08.822820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.845469+0000","last_change":"2024-09-14T11:10:13.507446+0000","last_active":"2024-09-14T11:34:59.845469+0000","last_peered":"2024-09-14T11:34:59.845469+0000","last_clean":"2024-09-14T11:34:59.845469+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:34:59.845469+0000","last_undegraded":"2024-09-14T11:34:59.845469+0000","last_fullsized":"2024-09-14T11:34:59.845469+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:37.515685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.859664+0000","last_change":"2024-09-14T11:22:38.547820+0000","last_active":"2024-09-14T11:34:19.859664+0000","last_peered":"2024-09-14T11:34:19.859664+0000","last_clean":"2024-09-14T11:34:19.859664+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:34:19.859664+0000","last_undegraded":"2024-09-14T11:34:19.859664+0000","last_fullsized":"2024-09-14T11:34:19.859664+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.390529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.611000+0000","last_change":"2024-09-14T11:12:00.697008+0000","last_active":"2024-09-14T11:35:25.611000+0000","last_peered":"2024-09-14T11:35:25.611000+0000","last_clean":"2024-09-14T11:35:25.611000+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:35:25.611000+0000","last_undegraded":"2024-09-14T11:35:25.611000+0000","last_fullsized":"2024-09-14T11:35:25.611000+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:03.052127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885350+0000","last_change":"2024-09-14T11:11:57.349579+0000","last_active":"2024-09-14T11:33:44.885350+0000","last_peered":"2024-09-14T11:33:44.885350+0000","last_clean":"2024-09-14T11:33:44.885350+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:33:44.885350+0000","last_undegraded":"2024-09-14T11:33:44.885350+0000","last_fullsized":"2024-09-14T11:33:44.885350+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:26.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":19456,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:25.603094+0000","last_change":"2024-09-14T11:10:13.510036+0000","last_active":"2024-09-14T11:34:25.603094+0000","last_peered":"2024-09-14T11:34:25.603094+0000","last_clean":"2024-09-14T11:34:25.603094+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:34:25.603094+0000","last_undegraded":"2024-09-14T11:34:25.603094+0000","last_fullsized":"2024-09-14T11:34:25.603094+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:48.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.889866+0000","last_change":"2024-09-14T11:22:38.557418+0000","last_active":"2024-09-14T11:34:19.889866+0000","last_peered":"2024-09-14T11:34:19.889866+0000","last_clean":"2024-09-14T11:34:19.889866+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:34:19.889866+0000","last_undegraded":"2024-09-14T11:34:19.889866+0000","last_fullsized":"2024-09-14T11:34:19.889866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:24.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598151+0000","last_change":"2024-09-14T11:12:00.697792+0000","last_active":"2024-09-14T11:33:45.598151+0000","last_peered":"2024-09-14T11:33:45.598151+0000","last_clean":"2024-09-14T11:33:45.598151+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:33:45.598151+0000","last_undegraded":"2024-09-14T11:33:45.598151+0000","last_fullsized":"2024-09-14T11:33:45.598151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:04.239911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.855371+0000","last_change":"2024-09-14T11:11:57.353323+0000","last_active":"2024-09-14T11:33:44.855371+0000","last_peered":"2024-09-14T11:33:44.855371+0000","last_clean":"2024-09-14T11:33:44.855371+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:33:44.855371+0000","last_undegraded":"2024-09-14T11:33:44.855371+0000","last_fullsized":"2024-09-14T11:33:44.855371+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:15.814681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.860387+0000","last_change":"2024-09-14T11:10:13.499745+0000","last_active":"2024-09-14T11:34:24.860387+0000","last_peered":"2024-09-14T11:34:24.860387+0000","last_clean":"2024-09-14T11:34:24.860387+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:34:24.860387+0000","last_undegraded":"2024-09-14T11:34:24.860387+0000","last_fullsized":"2024-09-14T11:34:24.860387+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:58.521220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:17.872355+0000","last_change":"2024-09-14T11:22:38.556244+0000","last_active":"2024-09-14T11:34:17.872355+0000","last_peered":"2024-09-14T11:34:17.872355+0000","last_clean":"2024-09-14T11:34:17.872355+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:34:17.872355+0000","last_undegraded":"2024-09-14T11:34:17.872355+0000","last_fullsized":"2024-09-14T11:34:17.872355+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:12.131431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886102+0000","last_change":"2024-09-14T11:12:00.371092+0000","last_active":"2024-09-14T11:33:44.886102+0000","last_peered":"2024-09-14T11:33:44.886102+0000","last_clean":"2024-09-14T11:33:44.886102+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:33:44.886102+0000","last_undegraded":"2024-09-14T11:33:44.886102+0000","last_fullsized":"2024-09-14T11:33:44.886102+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:07.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751653+0000","last_change":"2024-09-14T11:11:57.355672+0000","last_active":"2024-09-14T11:33:43.751653+0000","last_peered":"2024-09-14T11:33:43.751653+0000","last_clean":"2024-09-14T11:33:43.751653+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:33:43.751653+0000","last_undegraded":"2024-09-14T11:33:43.751653+0000","last_fullsized":"2024-09-14T11:33:43.751653+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:54.970745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884593+0000","last_change":"2024-09-14T11:10:13.509666+0000","last_active":"2024-09-14T11:33:39.884593+0000","last_peered":"2024-09-14T11:33:39.884593+0000","last_clean":"2024-09-14T11:33:39.884593+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:33:39.884593+0000","last_undegraded":"2024-09-14T11:33:39.884593+0000","last_fullsized":"2024-09-14T11:33:39.884593+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.839337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.606019+0000","last_change":"2024-09-14T11:22:38.560634+0000","last_active":"2024-09-14T11:34:45.606019+0000","last_peered":"2024-09-14T11:34:45.606019+0000","last_clean":"2024-09-14T11:34:45.606019+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:34:45.606019+0000","last_undegraded":"2024-09-14T11:34:45.606019+0000","last_fullsized":"2024-09-14T11:34:45.606019+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:00.155051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765049+0000","last_change":"2024-09-14T11:12:00.370168+0000","last_active":"2024-09-14T11:35:23.765049+0000","last_peered":"2024-09-14T11:35:23.765049+0000","last_clean":"2024-09-14T11:35:23.765049+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:35:23.765049+0000","last_undegraded":"2024-09-14T11:35:23.765049+0000","last_fullsized":"2024-09-14T11:35:23.765049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:48.258006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898754+0000","last_change":"2024-09-14T11:11:57.349362+0000","last_active":"2024-09-14T11:35:19.898754+0000","last_peered":"2024-09-14T11:35:19.898754+0000","last_clean":"2024-09-14T11:35:19.898754+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:35:19.898754+0000","last_undegraded":"2024-09-14T11:35:19.898754+0000","last_fullsized":"2024-09-14T11:35:19.898754+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.873771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883866+0000","last_change":"2024-09-14T11:10:13.508867+0000","last_active":"2024-09-14T11:33:34.883866+0000","last_peered":"2024-09-14T11:33:34.883866+0000","last_clean":"2024-09-14T11:33:34.883866+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:33:34.883866+0000","last_undegraded":"2024-09-14T11:33:34.883866+0000","last_fullsized":"2024-09-14T11:33:34.883866+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:25.594692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759854+0000","last_change":"2024-09-14T11:22:38.562421+0000","last_active":"2024-09-14T11:34:43.759854+0000","last_peered":"2024-09-14T11:34:43.759854+0000","last_clean":"2024-09-14T11:34:43.759854+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:34:43.759854+0000","last_undegraded":"2024-09-14T11:34:43.759854+0000","last_fullsized":"2024-09-14T11:34:43.759854+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:19.932638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765008+0000","last_change":"2024-09-14T11:12:00.366781+0000","last_active":"2024-09-14T11:35:23.765008+0000","last_peered":"2024-09-14T11:35:23.765008+0000","last_clean":"2024-09-14T11:35:23.765008+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:35:23.765008+0000","last_undegraded":"2024-09-14T11:35:23.765008+0000","last_fullsized":"2024-09-14T11:35:23.765008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.257185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610401+0000","last_change":"2024-09-14T11:11:57.355400+0000","last_active":"2024-09-14T11:35:20.610401+0000","last_peered":"2024-09-14T11:35:20.610401+0000","last_clean":"2024-09-14T11:35:20.610401+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:35:20.610401+0000","last_undegraded":"2024-09-14T11:35:20.610401+0000","last_fullsized":"2024-09-14T11:35:20.610401+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:52.064528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:21.171911+0000","last_change":"2024-09-14T11:10:13.508002+0000","last_active":"2024-09-14T11:34:21.171911+0000","last_peered":"2024-09-14T11:34:21.171911+0000","last_clean":"2024-09-14T11:34:21.171911+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:34:21.171911+0000","last_undegraded":"2024-09-14T11:34:21.171911+0000","last_fullsized":"2024-09-14T11:34:21.171911+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:32.599364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756775+0000","last_change":"2024-09-14T11:22:38.560824+0000","last_active":"2024-09-14T11:34:23.756775+0000","last_peered":"2024-09-14T11:34:23.756775+0000","last_clean":"2024-09-14T11:34:23.756775+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:34:23.756775+0000","last_undegraded":"2024-09-14T11:34:23.756775+0000","last_fullsized":"2024-09-14T11:34:23.756775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.610355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610448+0000","last_change":"2024-09-14T11:12:00.371863+0000","last_active":"2024-09-14T11:35:20.610448+0000","last_peered":"2024-09-14T11:35:20.610448+0000","last_clean":"2024-09-14T11:35:20.610448+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:35:20.610448+0000","last_undegraded":"2024-09-14T11:35:20.610448+0000","last_fullsized":"2024-09-14T11:35:20.610448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.086012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898372+0000","last_change":"2024-09-14T11:11:57.355053+0000","last_active":"2024-09-14T11:35:19.898372+0000","last_peered":"2024-09-14T11:35:19.898372+0000","last_clean":"2024-09-14T11:35:19.898372+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:35:19.898372+0000","last_undegraded":"2024-09-14T11:35:19.898372+0000","last_fullsized":"2024-09-14T11:35:19.898372+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.975373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884391+0000","last_change":"2024-09-14T11:10:13.509195+0000","last_active":"2024-09-14T11:33:34.884391+0000","last_peered":"2024-09-14T11:33:34.884391+0000","last_clean":"2024-09-14T11:33:34.884391+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:33:34.884391+0000","last_undegraded":"2024-09-14T11:33:34.884391+0000","last_fullsized":"2024-09-14T11:33:34.884391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:27.434209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605996+0000","last_change":"2024-09-14T11:22:38.549656+0000","last_active":"2024-09-14T11:34:45.605996+0000","last_peered":"2024-09-14T11:34:45.605996+0000","last_clean":"2024-09-14T11:34:45.605996+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:34:45.605996+0000","last_undegraded":"2024-09-14T11:34:45.605996+0000","last_fullsized":"2024-09-14T11:34:45.605996+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.182205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898360+0000","last_change":"2024-09-14T11:12:00.368721+0000","last_active":"2024-09-14T11:35:19.898360+0000","last_peered":"2024-09-14T11:35:19.898360+0000","last_clean":"2024-09-14T11:35:19.898360+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:35:19.898360+0000","last_undegraded":"2024-09-14T11:35:19.898360+0000","last_fullsized":"2024-09-14T11:35:19.898360+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:12.328655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881140+0000","last_change":"2024-09-14T11:11:57.355041+0000","last_active":"2024-09-14T11:35:17.881140+0000","last_peered":"2024-09-14T11:35:17.881140+0000","last_clean":"2024-09-14T11:35:17.881140+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:35:17.881140+0000","last_undegraded":"2024-09-14T11:35:17.881140+0000","last_fullsized":"2024-09-14T11:35:17.881140+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:42.390324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596445+0000","last_change":"2024-09-14T11:10:13.507056+0000","last_active":"2024-09-14T11:33:35.596445+0000","last_peered":"2024-09-14T11:33:35.596445+0000","last_clean":"2024-09-14T11:33:35.596445+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:33:35.596445+0000","last_undegraded":"2024-09-14T11:33:35.596445+0000","last_fullsized":"2024-09-14T11:33:35.596445+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:01.368348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.854245+0000","last_change":"2024-09-14T11:22:38.547683+0000","last_active":"2024-09-14T11:33:34.854245+0000","last_peered":"2024-09-14T11:33:34.854245+0000","last_clean":"2024-09-14T11:33:34.854245+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:33:34.854245+0000","last_undegraded":"2024-09-14T11:33:34.854245+0000","last_fullsized":"2024-09-14T11:33:34.854245+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:09.212310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603840+0000","last_change":"2024-09-14T11:12:00.369322+0000","last_active":"2024-09-14T11:34:30.603840+0000","last_peered":"2024-09-14T11:34:30.603840+0000","last_clean":"2024-09-14T11:34:30.603840+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:34:30.603840+0000","last_undegraded":"2024-09-14T11:34:30.603840+0000","last_fullsized":"2024-09-14T11:34:30.603840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:38.196351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891188+0000","last_change":"2024-09-14T11:11:57.357216+0000","last_active":"2024-09-14T11:34:29.891188+0000","last_peered":"2024-09-14T11:34:29.891188+0000","last_clean":"2024-09-14T11:34:29.891188+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:34:29.891188+0000","last_undegraded":"2024-09-14T11:34:29.891188+0000","last_fullsized":"2024-09-14T11:34:29.891188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:05.608393+0000","last_change":"2024-09-14T11:10:13.512001+0000","last_active":"2024-09-14T11:35:05.608393+0000","last_peered":"2024-09-14T11:35:05.608393+0000","last_clean":"2024-09-14T11:35:05.608393+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:35:05.608393+0000","last_undegraded":"2024-09-14T11:35:05.608393+0000","last_fullsized":"2024-09-14T11:35:05.608393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:22.364398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886662+0000","last_change":"2024-09-14T11:22:38.560005+0000","last_active":"2024-09-14T11:33:54.886662+0000","last_peered":"2024-09-14T11:33:54.886662+0000","last_clean":"2024-09-14T11:33:54.886662+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:33:54.886662+0000","last_undegraded":"2024-09-14T11:33:54.886662+0000","last_fullsized":"2024-09-14T11:33:54.886662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:06.734073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603797+0000","last_change":"2024-09-14T11:12:00.370638+0000","last_active":"2024-09-14T11:34:30.603797+0000","last_peered":"2024-09-14T11:34:30.603797+0000","last_clean":"2024-09-14T11:34:30.603797+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:34:30.603797+0000","last_undegraded":"2024-09-14T11:34:30.603797+0000","last_fullsized":"2024-09-14T11:34:30.603797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:40.237389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'1","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861175+0000","last_change":"2024-09-14T11:11:57.358150+0000","last_active":"2024-09-14T11:34:29.861175+0000","last_peered":"2024-09-14T11:34:29.861175+0000","last_clean":"2024-09-14T11:34:29.861175+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:34:29.861175+0000","last_undegraded":"2024-09-14T11:34:29.861175+0000","last_fullsized":"2024-09-14T11:34:29.861175+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:33.857222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":432,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.878115+0000","last_change":"2024-09-14T11:10:13.508473+0000","last_active":"2024-09-14T11:34:57.878115+0000","last_peered":"2024-09-14T11:34:57.878115+0000","last_clean":"2024-09-14T11:34:57.878115+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:34:57.878115+0000","last_undegraded":"2024-09-14T11:34:57.878115+0000","last_fullsized":"2024-09-14T11:34:57.878115+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:51.939853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883625+0000","last_change":"2024-09-14T11:22:38.555264+0000","last_active":"2024-09-14T11:33:29.883625+0000","last_peered":"2024-09-14T11:33:29.883625+0000","last_clean":"2024-09-14T11:33:29.883625+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:33:29.883625+0000","last_undegraded":"2024-09-14T11:33:29.883625+0000","last_fullsized":"2024-09-14T11:33:29.883625+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:10.041270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:38.759243+0000","last_change":"2024-09-14T11:12:00.696985+0000","last_active":"2024-09-14T11:34:38.759243+0000","last_peered":"2024-09-14T11:34:38.759243+0000","last_clean":"2024-09-14T11:34:38.759243+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:34:38.759243+0000","last_undegraded":"2024-09-14T11:34:38.759243+0000","last_fullsized":"2024-09-14T11:34:38.759243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:16.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757502+0000","last_change":"2024-09-14T11:11:57.350049+0000","last_active":"2024-09-14T11:34:28.757502+0000","last_peered":"2024-09-14T11:34:28.757502+0000","last_clean":"2024-09-14T11:34:28.757502+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:34:28.757502+0000","last_undegraded":"2024-09-14T11:34:28.757502+0000","last_fullsized":"2024-09-14T11:34:28.757502+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:36.573356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895573+0000","last_change":"2024-09-14T11:10:13.511805+0000","last_active":"2024-09-14T11:34:59.895573+0000","last_peered":"2024-09-14T11:34:59.895573+0000","last_clean":"2024-09-14T11:34:59.895573+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:34:59.895573+0000","last_undegraded":"2024-09-14T11:34:59.895573+0000","last_fullsized":"2024-09-14T11:34:59.895573+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:47.389561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883080+0000","last_change":"2024-09-14T11:22:38.552793+0000","last_active":"2024-09-14T11:33:29.883080+0000","last_peered":"2024-09-14T11:33:29.883080+0000","last_clean":"2024-09-14T11:33:29.883080+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:33:29.883080+0000","last_undegraded":"2024-09-14T11:33:29.883080+0000","last_fullsized":"2024-09-14T11:33:29.883080+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:40.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'1","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603853+0000","last_change":"2024-09-14T11:12:00.371999+0000","last_active":"2024-09-14T11:34:30.603853+0000","last_peered":"2024-09-14T11:34:30.603853+0000","last_clean":"2024-09-14T11:34:30.603853+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:34:30.603853+0000","last_undegraded":"2024-09-14T11:34:30.603853+0000","last_fullsized":"2024-09-14T11:34:30.603853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:57.798523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758551+0000","last_change":"2024-09-14T11:11:57.351527+0000","last_active":"2024-09-14T11:34:33.758551+0000","last_peered":"2024-09-14T11:34:33.758551+0000","last_clean":"2024-09-14T11:34:33.758551+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:34:33.758551+0000","last_undegraded":"2024-09-14T11:34:33.758551+0000","last_fullsized":"2024-09-14T11:34:33.758551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:16.871687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":5818,"num_write":9,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.864945+0000","last_change":"2024-09-14T11:10:13.506926+0000","last_active":"2024-09-14T11:34:59.864945+0000","last_peered":"2024-09-14T11:34:59.864945+0000","last_clean":"2024-09-14T11:34:59.864945+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:34:59.864945+0000","last_undegraded":"2024-09-14T11:34:59.864945+0000","last_fullsized":"2024-09-14T11:34:59.864945+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:19.274286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:55.599222+0000","last_change":"2024-09-14T11:22:38.560343+0000","last_active":"2024-09-14T11:33:55.599222+0000","last_peered":"2024-09-14T11:33:55.599222+0000","last_clean":"2024-09-14T11:33:55.599222+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:33:55.599222+0000","last_undegraded":"2024-09-14T11:33:55.599222+0000","last_fullsized":"2024-09-14T11:33:55.599222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:29.881634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.885153+0000","last_change":"2024-09-14T11:12:00.369339+0000","last_active":"2024-09-14T11:33:39.885153+0000","last_peered":"2024-09-14T11:33:39.885153+0000","last_clean":"2024-09-14T11:33:39.885153+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:33:39.885153+0000","last_undegraded":"2024-09-14T11:33:39.885153+0000","last_fullsized":"2024-09-14T11:33:39.885153+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:39.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750762+0000","last_change":"2024-09-14T11:11:57.357619+0000","last_active":"2024-09-14T11:33:38.750762+0000","last_peered":"2024-09-14T11:33:38.750762+0000","last_clean":"2024-09-14T11:33:38.750762+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:33:38.750762+0000","last_undegraded":"2024-09-14T11:33:38.750762+0000","last_fullsized":"2024-09-14T11:33:38.750762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:38.476508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761794+0000","last_change":"2024-09-14T11:10:13.505959+0000","last_active":"2024-09-14T11:34:58.761794+0000","last_peered":"2024-09-14T11:34:58.761794+0000","last_clean":"2024-09-14T11:34:58.761794+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:34:58.761794+0000","last_undegraded":"2024-09-14T11:34:58.761794+0000","last_fullsized":"2024-09-14T11:34:58.761794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:13.476423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886743+0000","last_change":"2024-09-14T11:22:38.558664+0000","last_active":"2024-09-14T11:33:54.886743+0000","last_peered":"2024-09-14T11:33:54.886743+0000","last_clean":"2024-09-14T11:33:54.886743+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:33:54.886743+0000","last_undegraded":"2024-09-14T11:33:54.886743+0000","last_fullsized":"2024-09-14T11:33:54.886743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:30.238036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884482+0000","last_change":"2024-09-14T11:12:00.694483+0000","last_active":"2024-09-14T11:33:39.884482+0000","last_peered":"2024-09-14T11:33:39.884482+0000","last_clean":"2024-09-14T11:33:39.884482+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:33:39.884482+0000","last_undegraded":"2024-09-14T11:33:39.884482+0000","last_fullsized":"2024-09-14T11:33:39.884482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:06.644097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.863718+0000","last_change":"2024-09-14T11:11:57.352310+0000","last_active":"2024-09-14T11:33:38.863718+0000","last_peered":"2024-09-14T11:33:38.863718+0000","last_clean":"2024-09-14T11:33:38.863718+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:33:38.863718+0000","last_undegraded":"2024-09-14T11:33:38.863718+0000","last_fullsized":"2024-09-14T11:33:38.863718+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:08.817373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:09.888479+0000","last_change":"2024-09-14T11:10:13.511603+0000","last_active":"2024-09-14T11:34:09.888479+0000","last_peered":"2024-09-14T11:34:09.888479+0000","last_clean":"2024-09-14T11:34:09.888479+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:34:09.888479+0000","last_undegraded":"2024-09-14T11:34:09.888479+0000","last_fullsized":"2024-09-14T11:34:09.888479+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.593455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886685+0000","last_change":"2024-09-14T11:22:38.557834+0000","last_active":"2024-09-14T11:33:54.886685+0000","last_peered":"2024-09-14T11:33:54.886685+0000","last_clean":"2024-09-14T11:33:54.886685+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:33:54.886685+0000","last_undegraded":"2024-09-14T11:33:54.886685+0000","last_fullsized":"2024-09-14T11:33:54.886685+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:44.232152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758487+0000","last_change":"2024-09-14T11:12:00.368877+0000","last_active":"2024-09-14T11:34:33.758487+0000","last_peered":"2024-09-14T11:34:33.758487+0000","last_clean":"2024-09-14T11:34:33.758487+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:34:33.758487+0000","last_undegraded":"2024-09-14T11:34:33.758487+0000","last_fullsized":"2024-09-14T11:34:33.758487+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:04.138036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751573+0000","last_change":"2024-09-14T11:11:57.350615+0000","last_active":"2024-09-14T11:33:43.751573+0000","last_peered":"2024-09-14T11:33:43.751573+0000","last_clean":"2024-09-14T11:33:43.751573+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:33:43.751573+0000","last_undegraded":"2024-09-14T11:33:43.751573+0000","last_fullsized":"2024-09-14T11:33:43.751573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:57.116215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600496+0000","last_change":"2024-09-14T11:10:13.505366+0000","last_active":"2024-09-14T11:34:05.600496+0000","last_peered":"2024-09-14T11:34:05.600496+0000","last_clean":"2024-09-14T11:34:05.600496+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:34:05.600496+0000","last_undegraded":"2024-09-14T11:34:05.600496+0000","last_fullsized":"2024-09-14T11:34:05.600496+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:26.758270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752949+0000","last_change":"2024-09-14T11:22:38.560810+0000","last_active":"2024-09-14T11:33:53.752949+0000","last_peered":"2024-09-14T11:33:53.752949+0000","last_clean":"2024-09-14T11:33:53.752949+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:33:53.752949+0000","last_undegraded":"2024-09-14T11:33:53.752949+0000","last_fullsized":"2024-09-14T11:33:53.752949+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:04.353747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'7","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884553+0000","last_change":"2024-09-14T11:12:00.372935+0000","last_active":"2024-09-14T11:33:39.884553+0000","last_peered":"2024-09-14T11:33:39.884553+0000","last_clean":"2024-09-14T11:33:39.884553+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:33:39.884553+0000","last_undegraded":"2024-09-14T11:33:39.884553+0000","last_fullsized":"2024-09-14T11:33:39.884553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:15.968213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":7,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891684+0000","last_change":"2024-09-14T11:11:57.352921+0000","last_active":"2024-09-14T11:34:29.891684+0000","last_peered":"2024-09-14T11:34:29.891684+0000","last_clean":"2024-09-14T11:34:29.891684+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:34:29.891684+0000","last_undegraded":"2024-09-14T11:34:29.891684+0000","last_fullsized":"2024-09-14T11:34:29.891684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:52.542794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888212+0000","last_change":"2024-09-14T11:10:13.506698+0000","last_active":"2024-09-14T11:34:04.888212+0000","last_peered":"2024-09-14T11:34:04.888212+0000","last_clean":"2024-09-14T11:34:04.888212+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:34:04.888212+0000","last_undegraded":"2024-09-14T11:34:04.888212+0000","last_fullsized":"2024-09-14T11:34:04.888212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:50.197138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897410+0000","last_change":"2024-09-14T11:22:38.557689+0000","last_active":"2024-09-14T11:35:09.897410+0000","last_peered":"2024-09-14T11:35:09.897410+0000","last_clean":"2024-09-14T11:35:09.897410+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:35:09.897410+0000","last_undegraded":"2024-09-14T11:35:09.897410+0000","last_fullsized":"2024-09-14T11:35:09.897410+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:32.821928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762555+0000","last_change":"2024-09-14T11:12:00.367857+0000","last_active":"2024-09-14T11:35:03.762555+0000","last_peered":"2024-09-14T11:35:03.762555+0000","last_clean":"2024-09-14T11:35:03.762555+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:35:03.762555+0000","last_undegraded":"2024-09-14T11:35:03.762555+0000","last_fullsized":"2024-09-14T11:35:03.762555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:30.330125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895154+0000","last_change":"2024-09-14T11:11:57.350701+0000","last_active":"2024-09-14T11:34:54.895154+0000","last_peered":"2024-09-14T11:34:54.895154+0000","last_clean":"2024-09-14T11:34:54.895154+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:34:54.895154+0000","last_undegraded":"2024-09-14T11:34:54.895154+0000","last_fullsized":"2024-09-14T11:34:54.895154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:03.947483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:03.754212+0000","last_change":"2024-09-14T11:10:13.507832+0000","last_active":"2024-09-14T11:34:03.754212+0000","last_peered":"2024-09-14T11:34:03.754212+0000","last_clean":"2024-09-14T11:34:03.754212+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:34:03.754212+0000","last_undegraded":"2024-09-14T11:34:03.754212+0000","last_fullsized":"2024-09-14T11:34:03.754212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.145883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879667+0000","last_change":"2024-09-14T11:22:38.559774+0000","last_active":"2024-09-14T11:35:07.879667+0000","last_peered":"2024-09-14T11:35:07.879667+0000","last_clean":"2024-09-14T11:35:07.879667+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:35:07.879667+0000","last_undegraded":"2024-09-14T11:35:07.879667+0000","last_fullsized":"2024-09-14T11:35:07.879667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:14.753350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761826+0000","last_change":"2024-09-14T11:12:00.695654+0000","last_active":"2024-09-14T11:34:58.761826+0000","last_peered":"2024-09-14T11:34:58.761826+0000","last_clean":"2024-09-14T11:34:58.761826+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:34:58.761826+0000","last_undegraded":"2024-09-14T11:34:58.761826+0000","last_fullsized":"2024-09-14T11:34:58.761826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:44.109481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.864972+0000","last_change":"2024-09-14T11:11:57.357243+0000","last_active":"2024-09-14T11:34:59.864972+0000","last_peered":"2024-09-14T11:34:59.864972+0000","last_clean":"2024-09-14T11:34:59.864972+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:34:59.864972+0000","last_undegraded":"2024-09-14T11:34:59.864972+0000","last_fullsized":"2024-09-14T11:34:59.864972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:58.472930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888302+0000","last_change":"2024-09-14T11:10:13.507529+0000","last_active":"2024-09-14T11:34:04.888302+0000","last_peered":"2024-09-14T11:34:04.888302+0000","last_clean":"2024-09-14T11:34:04.888302+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:34:04.888302+0000","last_undegraded":"2024-09-14T11:34:04.888302+0000","last_fullsized":"2024-09-14T11:34:04.888302+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:46.910286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T11:22:38.559360+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:07.017001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884637+0000","last_change":"2024-09-14T11:12:00.697739+0000","last_active":"2024-09-14T11:33:39.884637+0000","last_peered":"2024-09-14T11:33:39.884637+0000","last_clean":"2024-09-14T11:33:39.884637+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:33:39.884637+0000","last_undegraded":"2024-09-14T11:33:39.884637+0000","last_fullsized":"2024-09-14T11:33:39.884637+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:56.512716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'1","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:37.866403+0000","last_change":"2024-09-14T11:11:57.356515+0000","last_active":"2024-09-14T11:33:37.866403+0000","last_peered":"2024-09-14T11:33:37.866403+0000","last_clean":"2024-09-14T11:33:37.866403+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:33:37.866403+0000","last_undegraded":"2024-09-14T11:33:37.866403+0000","last_fullsized":"2024-09-14T11:33:37.866403+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.310464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898940+0000","last_change":"2024-09-14T11:10:13.510430+0000","last_active":"2024-09-14T11:35:19.898940+0000","last_peered":"2024-09-14T11:35:19.898940+0000","last_clean":"2024-09-14T11:35:19.898940+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:35:19.898940+0000","last_undegraded":"2024-09-14T11:35:19.898940+0000","last_fullsized":"2024-09-14T11:35:19.898940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:05.548094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897368+0000","last_change":"2024-09-14T11:22:38.560831+0000","last_active":"2024-09-14T11:35:09.897368+0000","last_peered":"2024-09-14T11:35:09.897368+0000","last_clean":"2024-09-14T11:35:09.897368+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:35:09.897368+0000","last_undegraded":"2024-09-14T11:35:09.897368+0000","last_fullsized":"2024-09-14T11:35:09.897368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:48.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.885392+0000","last_change":"2024-09-14T11:12:00.368324+0000","last_active":"2024-09-14T11:33:39.885392+0000","last_peered":"2024-09-14T11:33:39.885392+0000","last_clean":"2024-09-14T11:33:39.885392+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:33:39.885392+0000","last_undegraded":"2024-09-14T11:33:39.885392+0000","last_fullsized":"2024-09-14T11:33:39.885392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:52.228855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884649+0000","last_change":"2024-09-14T11:11:57.353076+0000","last_active":"2024-09-14T11:33:39.884649+0000","last_peered":"2024-09-14T11:33:39.884649+0000","last_clean":"2024-09-14T11:33:39.884649+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:33:39.884649+0000","last_undegraded":"2024-09-14T11:33:39.884649+0000","last_fullsized":"2024-09-14T11:33:39.884649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:23.953839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763621+0000","last_change":"2024-09-14T11:10:13.503079+0000","last_active":"2024-09-14T11:35:13.763621+0000","last_peered":"2024-09-14T11:35:13.763621+0000","last_clean":"2024-09-14T11:35:13.763621+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:35:13.763621+0000","last_undegraded":"2024-09-14T11:35:13.763621+0000","last_fullsized":"2024-09-14T11:35:13.763621+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.214686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.853503+0000","last_change":"2024-09-14T11:22:38.555155+0000","last_active":"2024-09-14T11:33:29.853503+0000","last_peered":"2024-09-14T11:33:29.853503+0000","last_clean":"2024-09-14T11:33:29.853503+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:33:29.853503+0000","last_undegraded":"2024-09-14T11:33:29.853503+0000","last_fullsized":"2024-09-14T11:33:29.853503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:42.625623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'7","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761696+0000","last_change":"2024-09-14T11:12:00.367897+0000","last_active":"2024-09-14T11:34:58.761696+0000","last_peered":"2024-09-14T11:34:58.761696+0000","last_clean":"2024-09-14T11:34:58.761696+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:34:58.761696+0000","last_undegraded":"2024-09-14T11:34:58.761696+0000","last_fullsized":"2024-09-14T11:34:58.761696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:42.946120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":12,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:59.887231+0000","last_change":"2024-09-14T11:11:57.345965+0000","last_active":"2024-09-14T11:33:59.887231+0000","last_peered":"2024-09-14T11:33:59.887231+0000","last_clean":"2024-09-14T11:33:59.887231+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:33:59.887231+0000","last_undegraded":"2024-09-14T11:33:59.887231+0000","last_fullsized":"2024-09-14T11:33:59.887231+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:15.657325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880495+0000","last_change":"2024-09-14T11:10:13.502736+0000","last_active":"2024-09-14T11:35:12.880495+0000","last_peered":"2024-09-14T11:35:12.880495+0000","last_clean":"2024-09-14T11:35:12.880495+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:35:12.880495+0000","last_undegraded":"2024-09-14T11:35:12.880495+0000","last_fullsized":"2024-09-14T11:35:12.880495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:59.444808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:28.749456+0000","last_change":"2024-09-14T11:22:38.559863+0000","last_active":"2024-09-14T11:33:28.749456+0000","last_peered":"2024-09-14T11:33:28.749456+0000","last_clean":"2024-09-14T11:33:28.749456+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:33:28.749456+0000","last_undegraded":"2024-09-14T11:33:28.749456+0000","last_fullsized":"2024-09-14T11:33:28.749456+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:50.541537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:02.870330+0000","last_change":"2024-09-14T11:12:00.369782+0000","last_active":"2024-09-14T11:34:02.870330+0000","last_peered":"2024-09-14T11:34:02.870330+0000","last_clean":"2024-09-14T11:34:02.870330+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:34:02.870330+0000","last_undegraded":"2024-09-14T11:34:02.870330+0000","last_fullsized":"2024-09-14T11:34:02.870330+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:02.629691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895078+0000","last_change":"2024-09-14T11:11:57.349673+0000","last_active":"2024-09-14T11:34:54.895078+0000","last_peered":"2024-09-14T11:34:54.895078+0000","last_clean":"2024-09-14T11:34:54.895078+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:34:54.895078+0000","last_undegraded":"2024-09-14T11:34:54.895078+0000","last_fullsized":"2024-09-14T11:34:54.895078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.667434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898118+0000","last_change":"2024-09-14T11:10:13.510473+0000","last_active":"2024-09-14T11:35:14.898118+0000","last_peered":"2024-09-14T11:35:14.898118+0000","last_clean":"2024-09-14T11:35:14.898118+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:35:14.898118+0000","last_undegraded":"2024-09-14T11:35:14.898118+0000","last_fullsized":"2024-09-14T11:35:14.898118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:52.505231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763071+0000","last_change":"2024-09-14T11:22:38.558952+0000","last_active":"2024-09-14T11:35:08.763071+0000","last_peered":"2024-09-14T11:35:08.763071+0000","last_clean":"2024-09-14T11:35:08.763071+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:35:08.763071+0000","last_undegraded":"2024-09-14T11:35:08.763071+0000","last_fullsized":"2024-09-14T11:35:08.763071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:33.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.894910+0000","last_change":"2024-09-14T11:12:00.373006+0000","last_active":"2024-09-14T11:34:54.894910+0000","last_peered":"2024-09-14T11:34:54.894910+0000","last_clean":"2024-09-14T11:34:54.894910+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:34:54.894910+0000","last_undegraded":"2024-09-14T11:34:54.894910+0000","last_fullsized":"2024-09-14T11:34:54.894910+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:34.796891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:53.761123+0000","last_change":"2024-09-14T11:11:57.347916+0000","last_active":"2024-09-14T11:34:53.761123+0000","last_peered":"2024-09-14T11:34:53.761123+0000","last_clean":"2024-09-14T11:34:53.761123+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:34:53.761123+0000","last_undegraded":"2024-09-14T11:34:53.761123+0000","last_fullsized":"2024-09-14T11:34:53.761123+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:00.583601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897710+0000","last_change":"2024-09-14T11:10:13.512991+0000","last_active":"2024-09-14T11:35:14.897710+0000","last_peered":"2024-09-14T11:35:14.897710+0000","last_clean":"2024-09-14T11:35:14.897710+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:35:14.897710+0000","last_undegraded":"2024-09-14T11:35:14.897710+0000","last_fullsized":"2024-09-14T11:35:14.897710+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:49.534421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897492+0000","last_change":"2024-09-14T11:22:38.555840+0000","last_active":"2024-09-14T11:35:09.897492+0000","last_peered":"2024-09-14T11:35:09.897492+0000","last_clean":"2024-09-14T11:35:09.897492+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:35:09.897492+0000","last_undegraded":"2024-09-14T11:35:09.897492+0000","last_fullsized":"2024-09-14T11:35:09.897492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895328+0000","last_change":"2024-09-14T11:12:00.368478+0000","last_active":"2024-09-14T11:34:54.895328+0000","last_peered":"2024-09-14T11:34:54.895328+0000","last_clean":"2024-09-14T11:34:54.895328+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:34:54.895328+0000","last_undegraded":"2024-09-14T11:34:54.895328+0000","last_fullsized":"2024-09-14T11:34:54.895328+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:45.204253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.894928+0000","last_change":"2024-09-14T11:11:57.351639+0000","last_active":"2024-09-14T11:34:54.894928+0000","last_peered":"2024-09-14T11:34:54.894928+0000","last_clean":"2024-09-14T11:34:54.894928+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:34:54.894928+0000","last_undegraded":"2024-09-14T11:34:54.894928+0000","last_fullsized":"2024-09-14T11:34:54.894928+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:06.738942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.851175+0000","last_change":"2024-09-14T11:10:13.508247+0000","last_active":"2024-09-14T11:34:59.851175+0000","last_peered":"2024-09-14T11:34:59.851175+0000","last_clean":"2024-09-14T11:34:59.851175+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:34:59.851175+0000","last_undegraded":"2024-09-14T11:34:59.851175+0000","last_fullsized":"2024-09-14T11:34:59.851175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:55.466796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'288","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.329620+0000","last_change":"2024-09-14T10:56:06.840563+0000","last_active":"2024-09-14T11:35:51.329620+0000","last_peered":"2024-09-14T11:35:51.329620+0000","last_clean":"2024-09-14T11:35:51.329620+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:35:51.329620+0000","last_undegraded":"2024-09-14T11:35:51.329620+0000","last_fullsized":"2024-09-14T11:35:51.329620+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:36.737226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10221383,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":647,"num_read_kb":163807,"num_write":1094,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.639109+0000","last_change":"2024-09-14T10:56:08.850638+0000","last_active":"2024-09-14T11:35:15.639109+0000","last_peered":"2024-09-14T11:35:15.639109+0000","last_clean":"2024-09-14T11:35:15.639109+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:35:15.639109+0000","last_undegraded":"2024-09-14T11:35:15.639109+0000","last_fullsized":"2024-09-14T11:35:15.639109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.142178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'282","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.413271+0000","last_change":"2024-09-14T10:56:06.829795+0000","last_active":"2024-09-14T11:35:15.413271+0000","last_peered":"2024-09-14T11:35:15.413271+0000","last_clean":"2024-09-14T11:35:15.413271+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:35:15.413271+0000","last_undegraded":"2024-09-14T11:35:15.413271+0000","last_fullsized":"2024-09-14T11:35:15.413271+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:37.943163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5531859,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":523,"num_read_kb":38007,"num_write":1033,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.643553+0000","last_change":"2024-09-14T10:56:08.847147+0000","last_active":"2024-09-14T11:34:58.643553+0000","last_peered":"2024-09-14T11:34:58.643553+0000","last_clean":"2024-09-14T11:34:58.643553+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:34:58.643553+0000","last_undegraded":"2024-09-14T11:34:58.643553+0000","last_fullsized":"2024-09-14T11:34:58.643553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:19.665261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'288","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.618185+0000","last_change":"2024-09-14T10:56:06.827878+0000","last_active":"2024-09-14T11:35:16.618185+0000","last_peered":"2024-09-14T11:35:16.618185+0000","last_clean":"2024-09-14T11:35:16.618185+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:35:16.618185+0000","last_undegraded":"2024-09-14T11:35:16.618185+0000","last_fullsized":"2024-09-14T11:35:16.618185+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.452362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15252845,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":561,"num_read_kb":108632,"num_write":1012,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.641306+0000","last_change":"2024-09-14T10:56:08.839781+0000","last_active":"2024-09-14T11:35:56.641306+0000","last_peered":"2024-09-14T11:35:56.641306+0000","last_clean":"2024-09-14T11:35:56.641306+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:35:56.641306+0000","last_undegraded":"2024-09-14T11:35:56.641306+0000","last_fullsized":"2024-09-14T11:35:56.641306+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:48.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'298","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.222961+0000","last_change":"2024-09-14T10:56:42.460337+0000","last_active":"2024-09-14T11:35:14.222961+0000","last_peered":"2024-09-14T11:35:14.222961+0000","last_clean":"2024-09-14T11:35:14.222961+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:35:14.222961+0000","last_undegraded":"2024-09-14T11:35:14.222961+0000","last_fullsized":"2024-09-14T11:35:14.222961+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:24.182625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947917,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":34002,"num_write":1162,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.932127+0000","last_change":"2024-09-14T10:56:08.834000+0000","last_active":"2024-09-14T11:35:27.932127+0000","last_peered":"2024-09-14T11:35:27.932127+0000","last_clean":"2024-09-14T11:35:27.932127+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:35:27.932127+0000","last_undegraded":"2024-09-14T11:35:27.932127+0000","last_fullsized":"2024-09-14T11:35:27.932127+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:57.023521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'301","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:22.116943+0000","last_change":"2024-09-14T10:56:06.830568+0000","last_active":"2024-09-14T11:34:22.116943+0000","last_peered":"2024-09-14T11:34:22.116943+0000","last_clean":"2024-09-14T11:34:22.116943+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:34:22.116943+0000","last_undegraded":"2024-09-14T11:34:22.116943+0000","last_fullsized":"2024-09-14T11:34:22.116943+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:40.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15730039,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":544,"num_read_kb":21029,"num_write":1077,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.859777+0000","last_change":"2024-09-14T10:56:08.841284+0000","last_active":"2024-09-14T11:34:59.859777+0000","last_peered":"2024-09-14T11:34:59.859777+0000","last_clean":"2024-09-14T11:34:59.859777+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:34:59.859777+0000","last_undegraded":"2024-09-14T11:34:59.859777+0000","last_fullsized":"2024-09-14T11:34:59.859777+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:14.311075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'330","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.017247+0000","last_change":"2024-09-14T10:56:06.834469+0000","last_active":"2024-09-14T11:35:54.017247+0000","last_peered":"2024-09-14T11:35:54.017247+0000","last_clean":"2024-09-14T11:35:54.017247+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:35:54.017247+0000","last_undegraded":"2024-09-14T11:35:54.017247+0000","last_fullsized":"2024-09-14T11:35:54.017247+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:32.517363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17993628,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":554,"num_read_kb":29480,"num_write":1122,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4187","reported_seq":4819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:12.075383+0000","last_change":"2024-09-14T10:56:08.839199+0000","last_active":"2024-09-14T11:34:12.075383+0000","last_peered":"2024-09-14T11:34:12.075383+0000","last_clean":"2024-09-14T11:34:12.075383+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:34:12.075383+0000","last_undegraded":"2024-09-14T11:34:12.075383+0000","last_fullsized":"2024-09-14T11:34:12.075383+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":3000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:42.778598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'281","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:12.894171+0000","last_change":"2024-09-14T10:56:06.833222+0000","last_active":"2024-09-14T11:37:12.894171+0000","last_peered":"2024-09-14T11:37:12.894171+0000","last_clean":"2024-09-14T11:37:12.894171+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:37:12.894171+0000","last_undegraded":"2024-09-14T11:37:12.894171+0000","last_fullsized":"2024-09-14T11:37:12.894171+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:04.180820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570621,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":525,"num_read_kb":8675,"num_write":1095,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:14.074011+0000","last_change":"2024-09-14T10:56:08.845788+0000","last_active":"2024-09-14T11:34:14.074011+0000","last_peered":"2024-09-14T11:34:14.074011+0000","last_clean":"2024-09-14T11:34:14.074011+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:34:14.074011+0000","last_undegraded":"2024-09-14T11:34:14.074011+0000","last_fullsized":"2024-09-14T11:34:14.074011+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:48.651913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'360","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.529550+0000","last_change":"2024-09-14T10:56:06.823561+0000","last_active":"2024-09-14T11:35:17.529550+0000","last_peered":"2024-09-14T11:35:17.529550+0000","last_clean":"2024-09-14T11:35:17.529550+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:35:17.529550+0000","last_undegraded":"2024-09-14T11:35:17.529550+0000","last_fullsized":"2024-09-14T11:35:17.529550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:14.493949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10794650,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":948,"num_read_kb":48878,"num_write":1251,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.701012+0000","last_change":"2024-09-14T10:56:08.837515+0000","last_active":"2024-09-14T11:34:26.701012+0000","last_peered":"2024-09-14T11:34:26.701012+0000","last_clean":"2024-09-14T11:34:26.701012+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:34:26.701012+0000","last_undegraded":"2024-09-14T11:34:26.701012+0000","last_fullsized":"2024-09-14T11:34:26.701012+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.463671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:35.029523+0000","last_change":"2024-09-14T10:56:08.839183+0000","last_active":"2024-09-14T11:35:35.029523+0000","last_peered":"2024-09-14T11:35:35.029523+0000","last_clean":"2024-09-14T11:35:35.029523+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:35:35.029523+0000","last_undegraded":"2024-09-14T11:35:35.029523+0000","last_fullsized":"2024-09-14T11:35:35.029523+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:38.313196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'286","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.988886+0000","last_change":"2024-09-14T10:56:42.661135+0000","last_active":"2024-09-14T11:35:30.988886+0000","last_peered":"2024-09-14T11:35:30.988886+0000","last_clean":"2024-09-14T11:35:30.988886+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:35:30.988886+0000","last_undegraded":"2024-09-14T11:35:30.988886+0000","last_fullsized":"2024-09-14T11:35:30.988886+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:46.958500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6709056,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":588,"num_read_kb":81454,"num_write":1091,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.663539+0000","last_change":"2024-09-14T10:56:08.846796+0000","last_active":"2024-09-14T11:35:32.663539+0000","last_peered":"2024-09-14T11:35:32.663539+0000","last_clean":"2024-09-14T11:35:32.663539+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:35:32.663539+0000","last_undegraded":"2024-09-14T11:35:32.663539+0000","last_fullsized":"2024-09-14T11:35:32.663539+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:56.632850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'308","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.883163+0000","last_change":"2024-09-14T10:56:06.835989+0000","last_active":"2024-09-14T11:35:27.883163+0000","last_peered":"2024-09-14T11:35:27.883163+0000","last_clean":"2024-09-14T11:35:27.883163+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:35:27.883163+0000","last_undegraded":"2024-09-14T11:35:27.883163+0000","last_fullsized":"2024-09-14T11:35:27.883163+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:41.887236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10496571,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":1043,"num_read_kb":13749,"num_write":1119,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.810993+0000","last_change":"2024-09-14T10:56:08.844107+0000","last_active":"2024-09-14T11:35:31.810993+0000","last_peered":"2024-09-14T11:35:31.810993+0000","last_clean":"2024-09-14T11:35:31.810993+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:35:31.810993+0000","last_undegraded":"2024-09-14T11:35:31.810993+0000","last_fullsized":"2024-09-14T11:35:31.810993+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:40.490617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'261","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:49.894327+0000","last_change":"2024-09-14T10:56:06.839571+0000","last_active":"2024-09-14T11:34:49.894327+0000","last_peered":"2024-09-14T11:34:49.894327+0000","last_clean":"2024-09-14T11:34:49.894327+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:34:49.894327+0000","last_undegraded":"2024-09-14T11:34:49.894327+0000","last_fullsized":"2024-09-14T11:34:49.894327+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:28.864250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10525942,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":568,"num_read_kb":2147,"num_write":1031,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.465427+0000","last_change":"2024-09-14T10:56:08.834013+0000","last_active":"2024-09-14T11:35:33.465427+0000","last_peered":"2024-09-14T11:35:33.465427+0000","last_clean":"2024-09-14T11:35:33.465427+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:35:33.465427+0000","last_undegraded":"2024-09-14T11:35:33.465427+0000","last_fullsized":"2024-09-14T11:35:33.465427+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.973557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'298","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:04.714334+0000","last_change":"2024-09-14T10:56:06.830891+0000","last_active":"2024-09-14T11:37:04.714334+0000","last_peered":"2024-09-14T11:37:04.714334+0000","last_clean":"2024-09-14T11:37:04.714334+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:04.714334+0000","last_undegraded":"2024-09-14T11:37:04.714334+0000","last_fullsized":"2024-09-14T11:37:04.714334+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:02.160609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22667515,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":645,"num_read_kb":45139,"num_write":1064,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:29.540321+0000","last_change":"2024-09-14T10:56:08.834901+0000","last_active":"2024-09-14T11:35:29.540321+0000","last_peered":"2024-09-14T11:35:29.540321+0000","last_clean":"2024-09-14T11:35:29.540321+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:35:29.540321+0000","last_undegraded":"2024-09-14T11:35:29.540321+0000","last_fullsized":"2024-09-14T11:35:29.540321+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:56.020076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'289","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:24.816667+0000","last_change":"2024-09-14T10:56:06.826208+0000","last_active":"2024-09-14T11:35:24.816667+0000","last_peered":"2024-09-14T11:35:24.816667+0000","last_clean":"2024-09-14T11:35:24.816667+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:35:24.816667+0000","last_undegraded":"2024-09-14T11:35:24.816667+0000","last_fullsized":"2024-09-14T11:35:24.816667+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:50.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340804,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":596,"num_read_kb":91641,"num_write":1094,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:28.738381+0000","last_change":"2024-09-14T10:56:08.846295+0000","last_active":"2024-09-14T11:35:28.738381+0000","last_peered":"2024-09-14T11:35:28.738381+0000","last_clean":"2024-09-14T11:35:28.738381+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:35:28.738381+0000","last_undegraded":"2024-09-14T11:35:28.738381+0000","last_fullsized":"2024-09-14T11:35:28.738381+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:58.178498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'268","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.330898+0000","last_change":"2024-09-14T10:56:06.828820+0000","last_active":"2024-09-14T11:35:51.330898+0000","last_peered":"2024-09-14T11:35:51.330898+0000","last_clean":"2024-09-14T11:35:51.330898+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:35:51.330898+0000","last_undegraded":"2024-09-14T11:35:51.330898+0000","last_fullsized":"2024-09-14T11:35:51.330898+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:35.203573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7377967,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":458,"num_read_kb":12785,"num_write":1018,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.632102+0000","last_change":"2024-09-14T10:56:16.877295+0000","last_active":"2024-09-14T11:37:14.632102+0000","last_peered":"2024-09-14T11:37:14.632102+0000","last_clean":"2024-09-14T11:37:14.632102+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:37:14.632102+0000","last_undegraded":"2024-09-14T11:37:14.632102+0000","last_fullsized":"2024-09-14T11:37:14.632102+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:56.149162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:06.606080+0000","last_change":"2024-09-14T10:56:08.839155+0000","last_active":"2024-09-14T11:35:06.606080+0000","last_peered":"2024-09-14T11:35:06.606080+0000","last_clean":"2024-09-14T11:35:06.606080+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:35:06.606080+0000","last_undegraded":"2024-09-14T11:35:06.606080+0000","last_fullsized":"2024-09-14T11:35:06.606080+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:37.441954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'302","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.652603+0000","last_change":"2024-09-14T10:56:06.835770+0000","last_active":"2024-09-14T11:35:37.652603+0000","last_peered":"2024-09-14T11:35:37.652603+0000","last_clean":"2024-09-14T11:35:37.652603+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:35:37.652603+0000","last_undegraded":"2024-09-14T11:35:37.652603+0000","last_fullsized":"2024-09-14T11:35:37.652603+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:18.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298264,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":776,"num_read_kb":1723,"num_write":1140,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877333+0000","last_change":"2024-09-14T10:56:10.848176+0000","last_active":"2024-09-14T11:34:52.877333+0000","last_peered":"2024-09-14T11:34:52.877333+0000","last_clean":"2024-09-14T11:34:52.877333+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:34:52.877333+0000","last_undegraded":"2024-09-14T11:34:52.877333+0000","last_fullsized":"2024-09-14T11:34:52.877333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:35.018887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'359","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.611662+0000","last_change":"2024-09-14T10:56:12.850634+0000","last_active":"2024-09-14T11:37:14.611662+0000","last_peered":"2024-09-14T11:37:14.611662+0000","last_clean":"2024-09-14T11:37:14.611662+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:37:14.611662+0000","last_undegraded":"2024-09-14T11:37:14.611662+0000","last_fullsized":"2024-09-14T11:37:14.611662+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:49.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63833,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":1145,"num_write":478,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895276+0000","last_change":"2024-09-14T10:56:14.867772+0000","last_active":"2024-09-14T11:34:54.895276+0000","last_peered":"2024-09-14T11:34:54.895276+0000","last_clean":"2024-09-14T11:34:54.895276+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:34:54.895276+0000","last_undegraded":"2024-09-14T11:34:54.895276+0000","last_fullsized":"2024-09-14T11:34:54.895276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:36.827998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2488","reported_seq":4301,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.535039+0000","last_change":"2024-09-14T10:56:16.878623+0000","last_active":"2024-09-14T11:35:54.535039+0000","last_peered":"2024-09-14T11:35:54.535039+0000","last_clean":"2024-09-14T11:35:54.535039+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:35:54.535039+0000","last_undegraded":"2024-09-14T11:35:54.535039+0000","last_fullsized":"2024-09-14T11:35:54.535039+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:03.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.011617+0000","last_change":"2024-09-14T10:56:08.849261+0000","last_active":"2024-09-14T11:35:25.011617+0000","last_peered":"2024-09-14T11:35:25.011617+0000","last_clean":"2024-09-14T11:35:25.011617+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:35:25.011617+0000","last_undegraded":"2024-09-14T11:35:25.011617+0000","last_fullsized":"2024-09-14T11:35:25.011617+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:12.169215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'248","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:08.576265+0000","last_change":"2024-09-14T10:56:06.830626+0000","last_active":"2024-09-14T11:34:08.576265+0000","last_peered":"2024-09-14T11:34:08.576265+0000","last_clean":"2024-09-14T11:34:08.576265+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:34:08.576265+0000","last_undegraded":"2024-09-14T11:34:08.576265+0000","last_fullsized":"2024-09-14T11:34:08.576265+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:21.784956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390400,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":450,"num_read_kb":41361,"num_write":930,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:40.597273+0000","last_change":"2024-09-14T10:56:10.842610+0000","last_active":"2024-09-14T11:33:40.597273+0000","last_peered":"2024-09-14T11:33:40.597273+0000","last_clean":"2024-09-14T11:33:40.597273+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:33:40.597273+0000","last_undegraded":"2024-09-14T11:33:40.597273+0000","last_fullsized":"2024-09-14T11:33:40.597273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:31.067891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'88","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.440429+0000","last_change":"2024-09-14T10:56:12.850155+0000","last_active":"2024-09-14T11:36:21.440429+0000","last_peered":"2024-09-14T11:36:21.440429+0000","last_clean":"2024-09-14T11:36:21.440429+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:36:21.440429+0000","last_undegraded":"2024-09-14T11:36:21.440429+0000","last_fullsized":"2024-09-14T11:36:21.440429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:58.551957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895419+0000","last_change":"2024-09-14T10:56:14.865727+0000","last_active":"2024-09-14T11:34:54.895419+0000","last_peered":"2024-09-14T11:34:54.895419+0000","last_clean":"2024-09-14T11:34:54.895419+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:34:54.895419+0000","last_undegraded":"2024-09-14T11:34:54.895419+0000","last_fullsized":"2024-09-14T11:34:54.895419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:33.497143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'124","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.497858+0000","last_change":"2024-09-14T10:56:16.878997+0000","last_active":"2024-09-14T11:35:26.497858+0000","last_peered":"2024-09-14T11:35:26.497858+0000","last_clean":"2024-09-14T11:35:26.497858+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:35:26.497858+0000","last_undegraded":"2024-09-14T11:35:26.497858+0000","last_fullsized":"2024-09-14T11:35:26.497858+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:40.199776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.949206+0000","last_change":"2024-09-14T10:56:08.843498+0000","last_active":"2024-09-14T11:35:12.949206+0000","last_peered":"2024-09-14T11:35:12.949206+0000","last_clean":"2024-09-14T11:35:12.949206+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:35:12.949206+0000","last_undegraded":"2024-09-14T11:35:12.949206+0000","last_fullsized":"2024-09-14T11:35:12.949206+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:05.973356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'287","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.516635+0000","last_change":"2024-09-14T10:56:06.834132+0000","last_active":"2024-09-14T11:34:26.516635+0000","last_peered":"2024-09-14T11:34:26.516635+0000","last_clean":"2024-09-14T11:34:26.516635+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:34:26.516635+0000","last_undegraded":"2024-09-14T11:34:26.516635+0000","last_fullsized":"2024-09-14T11:34:26.516635+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:22.363792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170829,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":479,"num_read_kb":14993,"num_write":1073,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607291+0000","last_change":"2024-09-14T10:56:10.847524+0000","last_active":"2024-09-14T11:34:55.607291+0000","last_peered":"2024-09-14T11:34:55.607291+0000","last_clean":"2024-09-14T11:34:55.607291+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:34:55.607291+0000","last_undegraded":"2024-09-14T11:34:55.607291+0000","last_fullsized":"2024-09-14T11:34:55.607291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.642527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'114","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.457558+0000","last_change":"2024-09-14T10:56:12.847058+0000","last_active":"2024-09-14T11:36:21.457558+0000","last_peered":"2024-09-14T11:36:21.457558+0000","last_clean":"2024-09-14T11:36:21.457558+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:36:21.457558+0000","last_undegraded":"2024-09-14T11:36:21.457558+0000","last_fullsized":"2024-09-14T11:36:21.457558+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:22.246613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'753","reported_seq":2170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.859967+0000","last_change":"2024-09-14T10:56:14.861391+0000","last_active":"2024-09-14T11:37:14.859967+0000","last_peered":"2024-09-14T11:37:14.859967+0000","last_clean":"2024-09-14T11:37:14.859967+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:37:14.859967+0000","last_undegraded":"2024-09-14T11:37:14.859967+0000","last_fullsized":"2024-09-14T11:37:14.859967+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:33.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'240","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.745307+0000","last_change":"2024-09-14T10:56:16.865049+0000","last_active":"2024-09-14T11:35:56.745307+0000","last_peered":"2024-09-14T11:35:56.745307+0000","last_clean":"2024-09-14T11:35:56.745307+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:35:56.745307+0000","last_undegraded":"2024-09-14T11:35:56.745307+0000","last_fullsized":"2024-09-14T11:35:56.745307+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:59.143467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4156","reported_seq":4751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:50.606696+0000","last_change":"2024-09-14T10:56:08.848320+0000","last_active":"2024-09-14T11:34:50.606696+0000","last_peered":"2024-09-14T11:34:50.606696+0000","last_clean":"2024-09-14T11:34:50.606696+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:34:50.606696+0000","last_undegraded":"2024-09-14T11:34:50.606696+0000","last_fullsized":"2024-09-14T11:34:50.606696+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:16.344418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'268","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.024586+0000","last_change":"2024-09-14T10:56:06.834097+0000","last_active":"2024-09-14T11:35:27.024586+0000","last_peered":"2024-09-14T11:35:27.024586+0000","last_clean":"2024-09-14T11:35:27.024586+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:35:27.024586+0000","last_undegraded":"2024-09-14T11:35:27.024586+0000","last_fullsized":"2024-09-14T11:35:27.024586+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:23.306111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5761840,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":572,"num_read_kb":30567,"num_write":957,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877363+0000","last_change":"2024-09-14T10:56:10.839414+0000","last_active":"2024-09-14T11:34:52.877363+0000","last_peered":"2024-09-14T11:34:52.877363+0000","last_clean":"2024-09-14T11:34:52.877363+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:34:52.877363+0000","last_undegraded":"2024-09-14T11:34:52.877363+0000","last_fullsized":"2024-09-14T11:34:52.877363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:56.422012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'285","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.605969+0000","last_change":"2024-09-14T10:56:13.041543+0000","last_active":"2024-09-14T11:37:14.605969+0000","last_peered":"2024-09-14T11:37:14.605969+0000","last_clean":"2024-09-14T11:37:14.605969+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:37:14.605969+0000","last_undegraded":"2024-09-14T11:37:14.605969+0000","last_fullsized":"2024-09-14T11:37:14.605969+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.191878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68307,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":1078,"num_write":418,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'791","reported_seq":2251,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.648484+0000","last_change":"2024-09-14T10:56:14.859370+0000","last_active":"2024-09-14T11:37:14.648484+0000","last_peered":"2024-09-14T11:37:14.648484+0000","last_clean":"2024-09-14T11:37:14.648484+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:37:14.648484+0000","last_undegraded":"2024-09-14T11:37:14.648484+0000","last_fullsized":"2024-09-14T11:37:14.648484+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:34.411310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880438+0000","last_change":"2024-09-14T10:56:08.849378+0000","last_active":"2024-09-14T11:35:12.880438+0000","last_peered":"2024-09-14T11:35:12.880438+0000","last_clean":"2024-09-14T11:35:12.880438+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:35:12.880438+0000","last_undegraded":"2024-09-14T11:35:12.880438+0000","last_fullsized":"2024-09-14T11:35:12.880438+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:36.824573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'272","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.427175+0000","last_change":"2024-09-14T10:56:06.836741+0000","last_active":"2024-09-14T11:37:09.427175+0000","last_peered":"2024-09-14T11:37:09.427175+0000","last_clean":"2024-09-14T11:37:09.427175+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:09.427175+0000","last_undegraded":"2024-09-14T11:37:09.427175+0000","last_fullsized":"2024-09-14T11:37:09.427175+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:18.533912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5995653,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":460,"num_read_kb":9228,"num_write":1065,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898164+0000","last_change":"2024-09-14T10:56:10.848968+0000","last_active":"2024-09-14T11:35:14.898164+0000","last_peered":"2024-09-14T11:35:14.898164+0000","last_clean":"2024-09-14T11:35:14.898164+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:35:14.898164+0000","last_undegraded":"2024-09-14T11:35:14.898164+0000","last_fullsized":"2024-09-14T11:35:14.898164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:05.693919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'355","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.616349+0000","last_change":"2024-09-14T10:56:13.041185+0000","last_active":"2024-09-14T11:37:14.616349+0000","last_peered":"2024-09-14T11:37:14.616349+0000","last_clean":"2024-09-14T11:37:14.616349+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:37:14.616349+0000","last_undegraded":"2024-09-14T11:37:14.616349+0000","last_fullsized":"2024-09-14T11:37:14.616349+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58751,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":1079,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758510+0000","last_change":"2024-09-14T10:56:14.867306+0000","last_active":"2024-09-14T11:34:33.758510+0000","last_peered":"2024-09-14T11:34:33.758510+0000","last_clean":"2024-09-14T11:34:33.758510+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:34:33.758510+0000","last_undegraded":"2024-09-14T11:34:33.758510+0000","last_fullsized":"2024-09-14T11:34:33.758510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:08.141850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'546","reported_seq":1358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.630477+0000","last_change":"2024-09-14T10:56:16.873797+0000","last_active":"2024-09-14T11:37:14.630477+0000","last_peered":"2024-09-14T11:37:14.630477+0000","last_clean":"2024-09-14T11:37:14.630477+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:37:14.630477+0000","last_undegraded":"2024-09-14T11:37:14.630477+0000","last_fullsized":"2024-09-14T11:37:14.630477+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:06.775196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.164105+0000","last_change":"2024-09-14T10:56:08.845180+0000","last_active":"2024-09-14T11:35:37.164105+0000","last_peered":"2024-09-14T11:35:37.164105+0000","last_clean":"2024-09-14T11:35:37.164105+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:35:37.164105+0000","last_undegraded":"2024-09-14T11:35:37.164105+0000","last_fullsized":"2024-09-14T11:35:37.164105+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:14.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'207","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.821317+0000","last_change":"2024-09-14T10:56:06.835215+0000","last_active":"2024-09-14T11:35:37.821317+0000","last_peered":"2024-09-14T11:35:37.821317+0000","last_clean":"2024-09-14T11:35:37.821317+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:35:37.821317+0000","last_undegraded":"2024-09-14T11:35:37.821317+0000","last_fullsized":"2024-09-14T11:35:37.821317+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:04.636480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10781877,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":459,"num_read_kb":56700,"num_write":772,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866554+0000","last_change":"2024-09-14T10:56:10.848498+0000","last_active":"2024-09-14T11:35:14.866554+0000","last_peered":"2024-09-14T11:35:14.866554+0000","last_clean":"2024-09-14T11:35:14.866554+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:35:14.866554+0000","last_undegraded":"2024-09-14T11:35:14.866554+0000","last_fullsized":"2024-09-14T11:35:14.866554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:30.715397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'264","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:45.621076+0000","last_change":"2024-09-14T10:56:12.849959+0000","last_active":"2024-09-14T11:36:45.621076+0000","last_peered":"2024-09-14T11:36:45.621076+0000","last_clean":"2024-09-14T11:36:45.621076+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:36:45.621076+0000","last_undegraded":"2024-09-14T11:36:45.621076+0000","last_fullsized":"2024-09-14T11:36:45.621076+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:51.049544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":977,"num_write":360,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610430+0000","last_change":"2024-09-14T10:56:14.859113+0000","last_active":"2024-09-14T11:35:20.610430+0000","last_peered":"2024-09-14T11:35:20.610430+0000","last_clean":"2024-09-14T11:35:20.610430+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:35:20.610430+0000","last_undegraded":"2024-09-14T11:35:20.610430+0000","last_fullsized":"2024-09-14T11:35:20.610430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:39.449429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'114","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:59.904352+0000","last_change":"2024-09-14T10:56:16.872299+0000","last_active":"2024-09-14T11:35:59.904352+0000","last_peered":"2024-09-14T11:35:59.904352+0000","last_clean":"2024-09-14T11:35:59.904352+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:35:59.904352+0000","last_undegraded":"2024-09-14T11:35:59.904352+0000","last_fullsized":"2024-09-14T11:35:59.904352+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:14.575119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.871798+0000","last_change":"2024-09-14T10:56:08.846448+0000","last_active":"2024-09-14T11:35:37.871798+0000","last_peered":"2024-09-14T11:35:37.871798+0000","last_clean":"2024-09-14T11:35:37.871798+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:35:37.871798+0000","last_undegraded":"2024-09-14T11:35:37.871798+0000","last_fullsized":"2024-09-14T11:35:37.871798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:21.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'385","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.197733+0000","last_change":"2024-09-14T10:56:06.838982+0000","last_active":"2024-09-14T11:35:13.197733+0000","last_peered":"2024-09-14T11:35:13.197733+0000","last_clean":"2024-09-14T11:35:13.197733+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:35:13.197733+0000","last_undegraded":"2024-09-14T11:35:13.197733+0000","last_fullsized":"2024-09-14T11:35:13.197733+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:14.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10872494,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":909,"num_read_kb":28710,"num_write":1610,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861135+0000","last_change":"2024-09-14T10:56:10.847743+0000","last_active":"2024-09-14T11:34:29.861135+0000","last_peered":"2024-09-14T11:34:29.861135+0000","last_clean":"2024-09-14T11:34:29.861135+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:34:29.861135+0000","last_undegraded":"2024-09-14T11:34:29.861135+0000","last_fullsized":"2024-09-14T11:34:29.861135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:13.871060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'302","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.619145+0000","last_change":"2024-09-14T10:56:12.847492+0000","last_active":"2024-09-14T11:37:14.619145+0000","last_peered":"2024-09-14T11:37:14.619145+0000","last_clean":"2024-09-14T11:37:14.619145+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:37:14.619145+0000","last_undegraded":"2024-09-14T11:37:14.619145+0000","last_fullsized":"2024-09-14T11:37:14.619145+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:45.170095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":1014,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'773","reported_seq":4218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.865371+0000","last_change":"2024-09-14T10:56:14.863301+0000","last_active":"2024-09-14T11:37:14.865371+0000","last_peered":"2024-09-14T11:37:14.865371+0000","last_clean":"2024-09-14T11:37:14.865371+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:37:14.865371+0000","last_undegraded":"2024-09-14T11:37:14.865371+0000","last_fullsized":"2024-09-14T11:37:14.865371+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":701,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:01.064582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.458613+0000","last_change":"2024-09-14T10:56:16.877915+0000","last_active":"2024-09-14T11:37:13.458613+0000","last_peered":"2024-09-14T11:37:13.458613+0000","last_clean":"2024-09-14T11:37:13.458613+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:37:13.458613+0000","last_undegraded":"2024-09-14T11:37:13.458613+0000","last_fullsized":"2024-09-14T11:37:13.458613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:25.564431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756765+0000","last_change":"2024-09-14T10:56:08.840369+0000","last_active":"2024-09-14T11:34:23.756765+0000","last_peered":"2024-09-14T11:34:23.756765+0000","last_clean":"2024-09-14T11:34:23.756765+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:34:23.756765+0000","last_undegraded":"2024-09-14T11:34:23.756765+0000","last_fullsized":"2024-09-14T11:34:23.756765+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'251","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:34.809263+0000","last_change":"2024-09-14T10:56:06.827678+0000","last_active":"2024-09-14T11:35:34.809263+0000","last_peered":"2024-09-14T11:35:34.809263+0000","last_clean":"2024-09-14T11:35:34.809263+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:35:34.809263+0000","last_undegraded":"2024-09-14T11:35:34.809263+0000","last_fullsized":"2024-09-14T11:35:34.809263+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:00.287082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8792642,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":493,"num_read_kb":39728,"num_write":895,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.867092+0000","last_change":"2024-09-14T10:56:10.851426+0000","last_active":"2024-09-14T11:35:19.867092+0000","last_peered":"2024-09-14T11:35:19.867092+0000","last_clean":"2024-09-14T11:35:19.867092+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:35:19.867092+0000","last_undegraded":"2024-09-14T11:35:19.867092+0000","last_fullsized":"2024-09-14T11:35:19.867092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.334991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'453","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.621803+0000","last_change":"2024-09-14T10:56:12.850654+0000","last_active":"2024-09-14T11:37:14.621803+0000","last_peered":"2024-09-14T11:37:14.621803+0000","last_clean":"2024-09-14T11:37:14.621803+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:37:14.621803+0000","last_undegraded":"2024-09-14T11:37:14.621803+0000","last_fullsized":"2024-09-14T11:37:14.621803+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:01.231786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106955,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":782,"num_read_kb":1698,"num_write":650,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866535+0000","last_change":"2024-09-14T10:56:14.862461+0000","last_active":"2024-09-14T11:35:14.866535+0000","last_peered":"2024-09-14T11:35:14.866535+0000","last_clean":"2024-09-14T11:35:14.866535+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:35:14.866535+0000","last_undegraded":"2024-09-14T11:35:14.866535+0000","last_fullsized":"2024-09-14T11:35:14.866535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:30.827794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'106","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764320+0000","last_change":"2024-09-14T10:56:16.874312+0000","last_active":"2024-09-14T11:35:18.764320+0000","last_peered":"2024-09-14T11:35:18.764320+0000","last_clean":"2024-09-14T11:35:18.764320+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:35:18.764320+0000","last_undegraded":"2024-09-14T11:35:18.764320+0000","last_fullsized":"2024-09-14T11:35:18.764320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:06.689124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'255","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891045+0000","last_change":"2024-09-14T10:56:08.840033+0000","last_active":"2024-09-14T11:34:24.891045+0000","last_peered":"2024-09-14T11:34:24.891045+0000","last_clean":"2024-09-14T11:34:24.891045+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:34:24.891045+0000","last_undegraded":"2024-09-14T11:34:24.891045+0000","last_fullsized":"2024-09-14T11:34:24.891045+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'270","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.847995+0000","last_change":"2024-09-14T10:56:06.831914+0000","last_active":"2024-09-14T11:35:30.847995+0000","last_peered":"2024-09-14T11:35:30.847995+0000","last_clean":"2024-09-14T11:35:30.847995+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:35:30.847995+0000","last_undegraded":"2024-09-14T11:35:30.847995+0000","last_fullsized":"2024-09-14T11:35:30.847995+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:23.908631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3711631,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":456,"num_read_kb":5559,"num_write":943,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861192+0000","last_change":"2024-09-14T10:56:10.851153+0000","last_active":"2024-09-14T11:34:29.861192+0000","last_peered":"2024-09-14T11:34:29.861192+0000","last_clean":"2024-09-14T11:34:29.861192+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:34:29.861192+0000","last_undegraded":"2024-09-14T11:34:29.861192+0000","last_fullsized":"2024-09-14T11:34:29.861192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:53.218265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'273","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:44.910823+0000","last_change":"2024-09-14T10:56:12.851527+0000","last_active":"2024-09-14T11:36:44.910823+0000","last_peered":"2024-09-14T11:36:44.910823+0000","last_clean":"2024-09-14T11:36:44.910823+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:36:44.910823+0000","last_undegraded":"2024-09-14T11:36:44.910823+0000","last_fullsized":"2024-09-14T11:36:44.910823+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:56.803494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":920,"num_write":424,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T10:56:14.862397+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:41.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'106","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:25.618639+0000","last_change":"2024-09-14T10:56:16.877499+0000","last_active":"2024-09-14T11:36:25.618639+0000","last_peered":"2024-09-14T11:36:25.618639+0000","last_clean":"2024-09-14T11:36:25.618639+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:36:25.618639+0000","last_undegraded":"2024-09-14T11:36:25.618639+0000","last_fullsized":"2024-09-14T11:36:25.618639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:22.117249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'104","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.329749+0000","last_change":"2024-09-14T10:56:08.840230+0000","last_active":"2024-09-14T11:35:36.329749+0000","last_peered":"2024-09-14T11:35:36.329749+0000","last_clean":"2024-09-14T11:35:36.329749+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:35:36.329749+0000","last_undegraded":"2024-09-14T11:35:36.329749+0000","last_fullsized":"2024-09-14T11:35:36.329749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:33.596968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'306","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:21.857104+0000","last_change":"2024-09-14T10:56:06.834028+0000","last_active":"2024-09-14T11:35:21.857104+0000","last_peered":"2024-09-14T11:35:21.857104+0000","last_clean":"2024-09-14T11:35:21.857104+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:35:21.857104+0000","last_undegraded":"2024-09-14T11:35:21.857104+0000","last_fullsized":"2024-09-14T11:35:21.857104+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:18.403230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12936231,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":560,"num_read_kb":12205,"num_write":1103,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757753+0000","last_change":"2024-09-14T10:56:10.852013+0000","last_active":"2024-09-14T11:34:28.757753+0000","last_peered":"2024-09-14T11:34:28.757753+0000","last_clean":"2024-09-14T11:34:28.757753+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:34:28.757753+0000","last_undegraded":"2024-09-14T11:34:28.757753+0000","last_fullsized":"2024-09-14T11:34:28.757753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.745857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'286","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:49.877742+0000","last_change":"2024-09-14T10:56:12.856779+0000","last_active":"2024-09-14T11:36:49.877742+0000","last_peered":"2024-09-14T11:36:49.877742+0000","last_clean":"2024-09-14T11:36:49.877742+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:36:49.877742+0000","last_undegraded":"2024-09-14T11:36:49.877742+0000","last_fullsized":"2024-09-14T11:36:49.877742+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:24.231799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56846,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":994,"num_write":404,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'722","reported_seq":2189,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.645256+0000","last_change":"2024-09-14T10:56:14.866439+0000","last_active":"2024-09-14T11:37:14.645256+0000","last_peered":"2024-09-14T11:37:14.645256+0000","last_clean":"2024-09-14T11:37:14.645256+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:37:14.645256+0000","last_undegraded":"2024-09-14T11:37:14.645256+0000","last_fullsized":"2024-09-14T11:37:14.645256+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":701,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:07.193263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'138","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.817608+0000","last_change":"2024-09-14T10:56:16.873210+0000","last_active":"2024-09-14T11:35:25.817608+0000","last_peered":"2024-09-14T11:35:25.817608+0000","last_clean":"2024-09-14T11:35:25.817608+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:35:25.817608+0000","last_undegraded":"2024-09-14T11:35:25.817608+0000","last_fullsized":"2024-09-14T11:35:25.817608+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:57.429498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'172","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.052682+0000","last_change":"2024-09-14T10:56:08.843637+0000","last_active":"2024-09-14T11:35:20.052682+0000","last_peered":"2024-09-14T11:35:20.052682+0000","last_clean":"2024-09-14T11:35:20.052682+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:35:20.052682+0000","last_undegraded":"2024-09-14T11:35:20.052682+0000","last_fullsized":"2024-09-14T11:35:20.052682+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:12.290035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'268","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897404+0000","last_change":"2024-09-14T10:56:06.830680+0000","last_active":"2024-09-14T11:35:09.897404+0000","last_peered":"2024-09-14T11:35:09.897404+0000","last_clean":"2024-09-14T11:35:09.897404+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:35:09.897404+0000","last_undegraded":"2024-09-14T11:35:09.897404+0000","last_fullsized":"2024-09-14T11:35:09.897404+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:18.827199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5602628,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":418,"num_read_kb":8775,"num_write":941,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1438,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.361038+0000","last_change":"2024-09-14T10:56:10.849165+0000","last_active":"2024-09-14T11:37:14.361038+0000","last_peered":"2024-09-14T11:37:14.361038+0000","last_clean":"2024-09-14T11:37:14.361038+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:37:14.361038+0000","last_undegraded":"2024-09-14T11:37:14.361038+0000","last_fullsized":"2024-09-14T11:37:14.361038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:00.894650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.427200+0000","last_change":"2024-09-14T10:56:13.041348+0000","last_active":"2024-09-14T11:36:21.427200+0000","last_peered":"2024-09-14T11:36:21.427200+0000","last_clean":"2024-09-14T11:36:21.427200+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:36:21.427200+0000","last_undegraded":"2024-09-14T11:36:21.427200+0000","last_fullsized":"2024-09-14T11:36:21.427200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:28.818595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'750","reported_seq":2171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.646121+0000","last_change":"2024-09-14T10:56:14.868996+0000","last_active":"2024-09-14T11:37:14.646121+0000","last_peered":"2024-09-14T11:37:14.646121+0000","last_clean":"2024-09-14T11:37:14.646121+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:37:14.646121+0000","last_undegraded":"2024-09-14T11:37:14.646121+0000","last_fullsized":"2024-09-14T11:37:14.646121+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.783931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.530654+0000","last_change":"2024-09-14T10:56:16.870911+0000","last_active":"2024-09-14T11:35:56.530654+0000","last_peered":"2024-09-14T11:35:56.530654+0000","last_clean":"2024-09-14T11:35:56.530654+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:35:56.530654+0000","last_undegraded":"2024-09-14T11:35:56.530654+0000","last_fullsized":"2024-09-14T11:35:56.530654+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.800135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'625","reported_seq":1464,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.902240+0000","last_change":"2024-09-14T10:56:08.839242+0000","last_active":"2024-09-14T11:35:19.902240+0000","last_peered":"2024-09-14T11:35:19.902240+0000","last_clean":"2024-09-14T11:35:19.902240+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:35:19.902240+0000","last_undegraded":"2024-09-14T11:35:19.902240+0000","last_fullsized":"2024-09-14T11:35:19.902240+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:35.763543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'324","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:11.993637+0000","last_change":"2024-09-14T10:56:06.823223+0000","last_active":"2024-09-14T11:35:11.993637+0000","last_peered":"2024-09-14T11:35:11.993637+0000","last_clean":"2024-09-14T11:35:11.993637+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:35:11.993637+0000","last_undegraded":"2024-09-14T11:35:11.993637+0000","last_fullsized":"2024-09-14T11:35:11.993637+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:05.387288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20990213,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":1073,"num_read_kb":48196,"num_write":1145,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891740+0000","last_change":"2024-09-14T10:56:10.850019+0000","last_active":"2024-09-14T11:34:29.891740+0000","last_peered":"2024-09-14T11:34:29.891740+0000","last_clean":"2024-09-14T11:34:29.891740+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:34:29.891740+0000","last_undegraded":"2024-09-14T11:34:29.891740+0000","last_fullsized":"2024-09-14T11:34:29.891740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:25.627310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'343","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:42.893780+0000","last_change":"2024-09-14T10:56:12.853756+0000","last_active":"2024-09-14T11:36:42.893780+0000","last_peered":"2024-09-14T11:36:42.893780+0000","last_clean":"2024-09-14T11:36:42.893780+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:36:42.893780+0000","last_undegraded":"2024-09-14T11:36:42.893780+0000","last_fullsized":"2024-09-14T11:36:42.893780+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:44.126582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54758,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1165,"num_read_kb":1631,"num_write":1692,"num_write_kb":1560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891290+0000","last_change":"2024-09-14T10:56:14.865772+0000","last_active":"2024-09-14T11:34:29.891290+0000","last_peered":"2024-09-14T11:34:29.891290+0000","last_clean":"2024-09-14T11:34:29.891290+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:34:29.891290+0000","last_undegraded":"2024-09-14T11:34:29.891290+0000","last_fullsized":"2024-09-14T11:34:29.891290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:37.189265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.162130+0000","last_change":"2024-09-14T10:56:16.875685+0000","last_active":"2024-09-14T11:35:37.162130+0000","last_peered":"2024-09-14T11:35:37.162130+0000","last_clean":"2024-09-14T11:35:37.162130+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:35:37.162130+0000","last_undegraded":"2024-09-14T11:35:37.162130+0000","last_fullsized":"2024-09-14T11:35:37.162130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:13.149449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.085890+0000","last_change":"2024-09-14T10:56:08.845279+0000","last_active":"2024-09-14T11:35:16.085890+0000","last_peered":"2024-09-14T11:35:16.085890+0000","last_clean":"2024-09-14T11:35:16.085890+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:35:16.085890+0000","last_undegraded":"2024-09-14T11:35:16.085890+0000","last_fullsized":"2024-09-14T11:35:16.085890+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:06.992049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886612+0000","last_change":"2024-09-14T10:55:50.534148+0000","last_active":"2024-09-14T11:33:54.886612+0000","last_peered":"2024-09-14T11:33:54.886612+0000","last_clean":"2024-09-14T11:33:54.886612+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:33:54.886612+0000","last_undegraded":"2024-09-14T11:33:54.886612+0000","last_fullsized":"2024-09-14T11:33:54.886612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_clean_scrub_stamp":"2024-09-14T10:55:48.742998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:03.355721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883203+0000","last_change":"2024-09-14T10:55:58.792442+0000","last_active":"2024-09-14T11:35:32.883203+0000","last_peered":"2024-09-14T11:35:32.883203+0000","last_clean":"2024-09-14T11:35:32.883203+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:35:32.883203+0000","last_undegraded":"2024-09-14T11:35:32.883203+0000","last_fullsized":"2024-09-14T11:35:32.883203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:23.936072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'256","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:28.687141+0000","last_change":"2024-09-14T10:56:06.824568+0000","last_active":"2024-09-14T11:35:28.687141+0000","last_peered":"2024-09-14T11:35:28.687141+0000","last_clean":"2024-09-14T11:35:28.687141+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:35:28.687141+0000","last_undegraded":"2024-09-14T11:35:28.687141+0000","last_fullsized":"2024-09-14T11:35:28.687141+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:35.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9233775,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":558,"num_read_kb":14625,"num_write":896,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885320+0000","last_change":"2024-09-14T10:56:10.847413+0000","last_active":"2024-09-14T11:33:44.885320+0000","last_peered":"2024-09-14T11:33:44.885320+0000","last_clean":"2024-09-14T11:33:44.885320+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:33:44.885320+0000","last_undegraded":"2024-09-14T11:33:44.885320+0000","last_fullsized":"2024-09-14T11:33:44.885320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:14.506201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'714","reported_seq":1393,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.626086+0000","last_change":"2024-09-14T10:56:12.853693+0000","last_active":"2024-09-14T11:37:14.626086+0000","last_peered":"2024-09-14T11:37:14.626086+0000","last_clean":"2024-09-14T11:37:14.626086+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:37:14.626086+0000","last_undegraded":"2024-09-14T11:37:14.626086+0000","last_fullsized":"2024-09-14T11:37:14.626086+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":700,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.618315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1373,"num_read_kb":2881,"num_write":1282,"num_write_kb":1133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764311+0000","last_change":"2024-09-14T10:56:14.867670+0000","last_active":"2024-09-14T11:35:18.764311+0000","last_peered":"2024-09-14T11:35:18.764311+0000","last_clean":"2024-09-14T11:35:18.764311+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:35:18.764311+0000","last_undegraded":"2024-09-14T11:35:18.764311+0000","last_fullsized":"2024-09-14T11:35:18.764311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:07.515289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'194","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.647341+0000","last_change":"2024-09-14T10:56:16.872059+0000","last_active":"2024-09-14T11:35:56.647341+0000","last_peered":"2024-09-14T11:35:56.647341+0000","last_clean":"2024-09-14T11:35:56.647341+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:35:56.647341+0000","last_undegraded":"2024-09-14T11:35:56.647341+0000","last_fullsized":"2024-09-14T11:35:56.647341+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.250321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'188","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763118+0000","last_change":"2024-09-14T10:56:08.839810+0000","last_active":"2024-09-14T11:35:08.763118+0000","last_peered":"2024-09-14T11:35:08.763118+0000","last_clean":"2024-09-14T11:35:08.763118+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:35:08.763118+0000","last_undegraded":"2024-09-14T11:35:08.763118+0000","last_fullsized":"2024-09-14T11:35:08.763118+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:33.165560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.887822+0000","last_change":"2024-09-14T10:55:59.204366+0000","last_active":"2024-09-14T11:34:04.887822+0000","last_peered":"2024-09-14T11:34:04.887822+0000","last_clean":"2024-09-14T11:34:04.887822+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:34:04.887822+0000","last_undegraded":"2024-09-14T11:34:04.887822+0000","last_fullsized":"2024-09-14T11:34:04.887822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:15.414745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'330","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:08.883097+0000","last_change":"2024-09-14T10:56:06.833177+0000","last_active":"2024-09-14T11:37:08.883097+0000","last_peered":"2024-09-14T11:37:08.883097+0000","last_clean":"2024-09-14T11:37:08.883097+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:08.883097+0000","last_undegraded":"2024-09-14T11:37:08.883097+0000","last_fullsized":"2024-09-14T11:37:08.883097+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:52.299621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8235302,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":734,"num_read_kb":83524,"num_write":1196,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"35'5","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.361405+0000","last_change":"2024-09-14T10:56:10.849032+0000","last_active":"2024-09-14T11:37:14.361405+0000","last_peered":"2024-09-14T11:37:14.361405+0000","last_clean":"2024-09-14T11:37:14.361405+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:37:14.361405+0000","last_undegraded":"2024-09-14T11:37:14.361405+0000","last_fullsized":"2024-09-14T11:37:14.361405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:01.123575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1218","reported_seq":2632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.640791+0000","last_change":"2024-09-14T10:56:12.856442+0000","last_active":"2024-09-14T11:37:14.640791+0000","last_peered":"2024-09-14T11:37:14.640791+0000","last_clean":"2024-09-14T11:37:14.640791+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:37:14.640791+0000","last_undegraded":"2024-09-14T11:37:14.640791+0000","last_fullsized":"2024-09-14T11:37:14.640791+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":1200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1938,"num_read_kb":3334,"num_write":1058,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:49.886081+0000","last_change":"2024-09-14T10:56:14.860734+0000","last_active":"2024-09-14T11:33:49.886081+0000","last_peered":"2024-09-14T11:33:49.886081+0000","last_clean":"2024-09-14T11:33:49.886081+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:33:49.886081+0000","last_undegraded":"2024-09-14T11:33:49.886081+0000","last_fullsized":"2024-09-14T11:33:49.886081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:40.424100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'240","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.064636+0000","last_change":"2024-09-14T10:56:16.876125+0000","last_active":"2024-09-14T11:35:54.064636+0000","last_peered":"2024-09-14T11:35:54.064636+0000","last_clean":"2024-09-14T11:35:54.064636+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:35:54.064636+0000","last_undegraded":"2024-09-14T11:35:54.064636+0000","last_fullsized":"2024-09-14T11:35:54.064636+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.302671+0000","last_change":"2024-09-14T10:56:42.662120+0000","last_active":"2024-09-14T11:34:26.302671+0000","last_peered":"2024-09-14T11:34:26.302671+0000","last_clean":"2024-09-14T11:34:26.302671+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:34:26.302671+0000","last_undegraded":"2024-09-14T11:34:26.302671+0000","last_fullsized":"2024-09-14T11:34:26.302671+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:08.405772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:34.868699+0000","last_change":"2024-09-14T10:55:59.134312+0000","last_active":"2024-09-14T11:35:34.868699+0000","last_peered":"2024-09-14T11:35:34.868699+0000","last_clean":"2024-09-14T11:35:34.868699+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:35:34.868699+0000","last_undegraded":"2024-09-14T11:35:34.868699+0000","last_fullsized":"2024-09-14T11:35:34.868699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:08.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'293","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.760784+0000","last_change":"2024-09-14T10:56:06.820891+0000","last_active":"2024-09-14T11:35:31.760784+0000","last_peered":"2024-09-14T11:35:31.760784+0000","last_clean":"2024-09-14T11:35:31.760784+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:35:31.760784+0000","last_undegraded":"2024-09-14T11:35:31.760784+0000","last_fullsized":"2024-09-14T11:35:31.760784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:17.493636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23507759,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":574,"num_read_kb":61657,"num_write":1131,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866597+0000","last_change":"2024-09-14T10:56:10.852125+0000","last_active":"2024-09-14T11:35:14.866597+0000","last_peered":"2024-09-14T11:35:14.866597+0000","last_clean":"2024-09-14T11:35:14.866597+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:35:14.866597+0000","last_undegraded":"2024-09-14T11:35:14.866597+0000","last_fullsized":"2024-09-14T11:35:14.866597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:31.365946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'215","reported_seq":1248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:10.201505+0000","last_change":"2024-09-14T10:56:13.041674+0000","last_active":"2024-09-14T11:37:10.201505+0000","last_peered":"2024-09-14T11:37:10.201505+0000","last_clean":"2024-09-14T11:37:10.201505+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:37:10.201505+0000","last_undegraded":"2024-09-14T11:37:10.201505+0000","last_fullsized":"2024-09-14T11:37:10.201505+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:35.426913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752243+0000","last_change":"2024-09-14T10:56:14.869132+0000","last_active":"2024-09-14T11:33:48.752243+0000","last_peered":"2024-09-14T11:33:48.752243+0000","last_clean":"2024-09-14T11:33:48.752243+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:33:48.752243+0000","last_undegraded":"2024-09-14T11:33:48.752243+0000","last_fullsized":"2024-09-14T11:33:48.752243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:52.698938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'258","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.791105+0000","last_change":"2024-09-14T10:56:16.878981+0000","last_active":"2024-09-14T11:35:56.791105+0000","last_peered":"2024-09-14T11:35:56.791105+0000","last_clean":"2024-09-14T11:35:56.791105+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:35:56.791105+0000","last_undegraded":"2024-09-14T11:35:56.791105+0000","last_fullsized":"2024-09-14T11:35:56.791105+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:11.858964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.233763+0000","last_change":"2024-09-14T10:56:08.845281+0000","last_active":"2024-09-14T11:35:30.233763+0000","last_peered":"2024-09-14T11:35:30.233763+0000","last_clean":"2024-09-14T11:35:30.233763+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:35:30.233763+0000","last_undegraded":"2024-09-14T11:35:30.233763+0000","last_fullsized":"2024-09-14T11:35:30.233763+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:49.926283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883164+0000","last_change":"2024-09-14T10:55:58.793099+0000","last_active":"2024-09-14T11:35:32.883164+0000","last_peered":"2024-09-14T11:35:32.883164+0000","last_clean":"2024-09-14T11:35:32.883164+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:35:32.883164+0000","last_undegraded":"2024-09-14T11:35:32.883164+0000","last_fullsized":"2024-09-14T11:35:32.883164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:04.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'361","reported_seq":1109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.875978+0000","last_change":"2024-09-14T10:56:06.833233+0000","last_active":"2024-09-14T11:35:23.875978+0000","last_peered":"2024-09-14T11:35:23.875978+0000","last_clean":"2024-09-14T11:35:23.875978+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:35:23.875978+0000","last_undegraded":"2024-09-14T11:35:23.875978+0000","last_fullsized":"2024-09-14T11:35:23.875978+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:46.083613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10658231,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":823,"num_read_kb":119862,"num_write":1247,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752967+0000","last_change":"2024-09-14T10:56:10.848955+0000","last_active":"2024-09-14T11:33:53.752967+0000","last_peered":"2024-09-14T11:33:53.752967+0000","last_clean":"2024-09-14T11:33:53.752967+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:33:53.752967+0000","last_undegraded":"2024-09-14T11:33:53.752967+0000","last_fullsized":"2024-09-14T11:33:53.752967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:51.182938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.762188+0000","last_change":"2024-09-14T10:56:12.855698+0000","last_active":"2024-09-14T11:37:14.762188+0000","last_peered":"2024-09-14T11:37:14.762188+0000","last_clean":"2024-09-14T11:37:14.762188+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:37:14.762188+0000","last_undegraded":"2024-09-14T11:37:14.762188+0000","last_fullsized":"2024-09-14T11:37:14.762188+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:26.322719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897812+0000","last_change":"2024-09-14T10:56:14.864184+0000","last_active":"2024-09-14T11:35:14.897812+0000","last_peered":"2024-09-14T11:35:14.897812+0000","last_clean":"2024-09-14T11:35:14.897812+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:35:14.897812+0000","last_undegraded":"2024-09-14T11:35:14.897812+0000","last_fullsized":"2024-09-14T11:35:14.897812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:25.882149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.040892+0000","last_change":"2024-09-14T10:56:16.875071+0000","last_active":"2024-09-14T11:35:31.040892+0000","last_peered":"2024-09-14T11:35:31.040892+0000","last_clean":"2024-09-14T11:35:31.040892+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:35:31.040892+0000","last_undegraded":"2024-09-14T11:35:31.040892+0000","last_fullsized":"2024-09-14T11:35:31.040892+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:51.001726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.112032+0000","last_change":"2024-09-14T10:56:08.846819+0000","last_active":"2024-09-14T11:34:59.112032+0000","last_peered":"2024-09-14T11:34:59.112032+0000","last_clean":"2024-09-14T11:34:59.112032+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:34:59.112032+0000","last_undegraded":"2024-09-14T11:34:59.112032+0000","last_fullsized":"2024-09-14T11:34:59.112032+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:55.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'304","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.876486+0000","last_change":"2024-09-14T10:56:06.828378+0000","last_active":"2024-09-14T11:35:26.876486+0000","last_peered":"2024-09-14T11:35:26.876486+0000","last_clean":"2024-09-14T11:35:26.876486+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:35:26.876486+0000","last_undegraded":"2024-09-14T11:35:26.876486+0000","last_fullsized":"2024-09-14T11:35:26.876486+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.040311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":791374,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":581,"num_read_kb":12538,"num_write":1088,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.766384+0000","last_change":"2024-09-14T10:55:58.795298+0000","last_active":"2024-09-14T11:35:33.766384+0000","last_peered":"2024-09-14T11:35:33.766384+0000","last_clean":"2024-09-14T11:35:33.766384+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:35:33.766384+0000","last_undegraded":"2024-09-14T11:35:33.766384+0000","last_fullsized":"2024-09-14T11:35:33.766384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:33.298341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.348989+0000","last_change":"2024-09-14T10:56:10.849045+0000","last_active":"2024-09-14T11:37:14.348989+0000","last_peered":"2024-09-14T11:37:14.348989+0000","last_clean":"2024-09-14T11:37:14.348989+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:37:14.348989+0000","last_undegraded":"2024-09-14T11:37:14.348989+0000","last_fullsized":"2024-09-14T11:37:14.348989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:24.164136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'581","reported_seq":1225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.607266+0000","last_change":"2024-09-14T10:56:12.857610+0000","last_active":"2024-09-14T11:37:14.607266+0000","last_peered":"2024-09-14T11:37:14.607266+0000","last_clean":"2024-09-14T11:37:14.607266+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:37:14.607266+0000","last_undegraded":"2024-09-14T11:37:14.607266+0000","last_fullsized":"2024-09-14T11:37:14.607266+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.734579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":966,"num_read_kb":1953,"num_write":838,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885969+0000","last_change":"2024-09-14T10:56:14.866887+0000","last_active":"2024-09-14T11:33:44.885969+0000","last_peered":"2024-09-14T11:33:44.885969+0000","last_clean":"2024-09-14T11:33:44.885969+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:33:44.885969+0000","last_undegraded":"2024-09-14T11:33:44.885969+0000","last_fullsized":"2024-09-14T11:33:44.885969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:18.571111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.463557+0000","last_change":"2024-09-14T10:56:16.874511+0000","last_active":"2024-09-14T11:35:33.463557+0000","last_peered":"2024-09-14T11:35:33.463557+0000","last_clean":"2024-09-14T11:35:33.463557+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:35:33.463557+0000","last_undegraded":"2024-09-14T11:35:33.463557+0000","last_fullsized":"2024-09-14T11:35:33.463557+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:37.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.061566+0000","last_change":"2024-09-14T10:56:08.844695+0000","last_active":"2024-09-14T11:35:54.061566+0000","last_peered":"2024-09-14T11:35:54.061566+0000","last_clean":"2024-09-14T11:35:54.061566+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:35:54.061566+0000","last_undegraded":"2024-09-14T11:35:54.061566+0000","last_fullsized":"2024-09-14T11:35:54.061566+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:48.072778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'301","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.414849+0000","last_change":"2024-09-14T10:56:06.820948+0000","last_active":"2024-09-14T11:35:33.414849+0000","last_peered":"2024-09-14T11:35:33.414849+0000","last_clean":"2024-09-14T11:35:33.414849+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:35:33.414849+0000","last_undegraded":"2024-09-14T11:35:33.414849+0000","last_fullsized":"2024-09-14T11:35:33.414849+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:42.568606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243507,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":655,"num_read_kb":48648,"num_write":1173,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901911+0000","last_change":"2024-09-14T10:55:59.204323+0000","last_active":"2024-09-14T11:35:39.901911+0000","last_peered":"2024-09-14T11:35:39.901911+0000","last_clean":"2024-09-14T11:35:39.901911+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:35:39.901911+0000","last_undegraded":"2024-09-14T11:35:39.901911+0000","last_fullsized":"2024-09-14T11:35:39.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:50.070588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885825+0000","last_change":"2024-09-14T10:56:10.846790+0000","last_active":"2024-09-14T11:33:44.885825+0000","last_peered":"2024-09-14T11:33:44.885825+0000","last_clean":"2024-09-14T11:33:44.885825+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:33:44.885825+0000","last_undegraded":"2024-09-14T11:33:44.885825+0000","last_fullsized":"2024-09-14T11:33:44.885825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:14.639629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'148","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.474378+0000","last_change":"2024-09-14T10:56:13.041311+0000","last_active":"2024-09-14T11:36:21.474378+0000","last_peered":"2024-09-14T11:36:21.474378+0000","last_clean":"2024-09-14T11:36:21.474378+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:36:21.474378+0000","last_undegraded":"2024-09-14T11:36:21.474378+0000","last_fullsized":"2024-09-14T11:36:21.474378+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:12.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'789","reported_seq":2754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.642783+0000","last_change":"2024-09-14T10:56:14.864682+0000","last_active":"2024-09-14T11:37:14.642783+0000","last_peered":"2024-09-14T11:37:14.642783+0000","last_clean":"2024-09-14T11:37:14.642783+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:37:14.642783+0000","last_undegraded":"2024-09-14T11:37:14.642783+0000","last_fullsized":"2024-09-14T11:37:14.642783+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.506777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'136","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:55.622534+0000","last_change":"2024-09-14T10:56:16.878173+0000","last_active":"2024-09-14T11:36:55.622534+0000","last_peered":"2024-09-14T11:36:55.622534+0000","last_clean":"2024-09-14T11:36:55.622534+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:36:55.622534+0000","last_undegraded":"2024-09-14T11:36:55.622534+0000","last_fullsized":"2024-09-14T11:36:55.622534+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:18.316372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.457301+0000","last_change":"2024-09-14T10:56:08.849379+0000","last_active":"2024-09-14T11:37:13.457301+0000","last_peered":"2024-09-14T11:37:13.457301+0000","last_clean":"2024-09-14T11:37:13.457301+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:37:13.457301+0000","last_undegraded":"2024-09-14T11:37:13.457301+0000","last_fullsized":"2024-09-14T11:37:13.457301+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:13.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'280","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:10.609210+0000","last_change":"2024-09-14T10:56:06.833600+0000","last_active":"2024-09-14T11:35:10.609210+0000","last_peered":"2024-09-14T11:35:10.609210+0000","last_clean":"2024-09-14T11:35:10.609210+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:35:10.609210+0000","last_undegraded":"2024-09-14T11:35:10.609210+0000","last_fullsized":"2024-09-14T11:35:10.609210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:55.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7480146,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":475,"num_read_kb":3885,"num_write":978,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761758+0000","last_change":"2024-09-14T10:55:58.795304+0000","last_active":"2024-09-14T11:34:58.761758+0000","last_peered":"2024-09-14T11:34:58.761758+0000","last_clean":"2024-09-14T11:34:58.761758+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:34:58.761758+0000","last_undegraded":"2024-09-14T11:34:58.761758+0000","last_fullsized":"2024-09-14T11:34:58.761758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:07.609351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885956+0000","last_change":"2024-09-14T10:56:10.845757+0000","last_active":"2024-09-14T11:33:44.885956+0000","last_peered":"2024-09-14T11:33:44.885956+0000","last_clean":"2024-09-14T11:33:44.885956+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:33:44.885956+0000","last_undegraded":"2024-09-14T11:33:44.885956+0000","last_fullsized":"2024-09-14T11:33:44.885956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:40.015207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'105","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.461753+0000","last_change":"2024-09-14T10:56:12.854078+0000","last_active":"2024-09-14T11:36:21.461753+0000","last_peered":"2024-09-14T11:36:21.461753+0000","last_clean":"2024-09-14T11:36:21.461753+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:36:21.461753+0000","last_undegraded":"2024-09-14T11:36:21.461753+0000","last_fullsized":"2024-09-14T11:36:21.461753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:53.954428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'791","reported_seq":2381,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.647364+0000","last_change":"2024-09-14T10:56:14.861395+0000","last_active":"2024-09-14T11:37:14.647364+0000","last_peered":"2024-09-14T11:37:14.647364+0000","last_clean":"2024-09-14T11:37:14.647364+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:37:14.647364+0000","last_undegraded":"2024-09-14T11:37:14.647364+0000","last_fullsized":"2024-09-14T11:37:14.647364+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:14.062981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'253","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.639576+0000","last_change":"2024-09-14T10:56:16.874903+0000","last_active":"2024-09-14T11:35:56.639576+0000","last_peered":"2024-09-14T11:35:56.639576+0000","last_clean":"2024-09-14T11:35:56.639576+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:35:56.639576+0000","last_undegraded":"2024-09-14T11:35:56.639576+0000","last_fullsized":"2024-09-14T11:35:56.639576+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.818843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:14.482865+0000","last_change":"2024-09-14T10:56:08.841683+0000","last_active":"2024-09-14T11:34:14.482865+0000","last_peered":"2024-09-14T11:34:14.482865+0000","last_clean":"2024-09-14T11:34:14.482865+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:34:14.482865+0000","last_undegraded":"2024-09-14T11:34:14.482865+0000","last_fullsized":"2024-09-14T11:34:14.482865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:09.542327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'292","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.361037+0000","last_change":"2024-09-14T10:56:06.831292+0000","last_active":"2024-09-14T11:37:09.361037+0000","last_peered":"2024-09-14T11:37:09.361037+0000","last_clean":"2024-09-14T11:37:09.361037+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:09.361037+0000","last_undegraded":"2024-09-14T11:37:09.361037+0000","last_fullsized":"2024-09-14T11:37:09.361037+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:53.008130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11822863,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":781,"num_read_kb":56309,"num_write":1078,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895598+0000","last_change":"2024-09-14T10:55:59.387955+0000","last_active":"2024-09-14T11:34:59.895598+0000","last_peered":"2024-09-14T11:34:59.895598+0000","last_clean":"2024-09-14T11:34:59.895598+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:34:59.895598+0000","last_undegraded":"2024-09-14T11:34:59.895598+0000","last_fullsized":"2024-09-14T11:34:59.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:35.502046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.602419+0000","last_change":"2024-09-14T10:56:10.847591+0000","last_active":"2024-09-14T11:34:20.602419+0000","last_peered":"2024-09-14T11:34:20.602419+0000","last_clean":"2024-09-14T11:34:20.602419+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:34:20.602419+0000","last_undegraded":"2024-09-14T11:34:20.602419+0000","last_fullsized":"2024-09-14T11:34:20.602419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:12.477652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'703","reported_seq":1397,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.603594+0000","last_change":"2024-09-14T10:56:13.041312+0000","last_active":"2024-09-14T11:37:14.603594+0000","last_peered":"2024-09-14T11:37:14.603594+0000","last_clean":"2024-09-14T11:37:14.603594+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:37:14.603594+0000","last_undegraded":"2024-09-14T11:37:14.603594+0000","last_fullsized":"2024-09-14T11:37:14.603594+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:15.894086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164960,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1252,"num_read_kb":2696,"num_write":1032,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598055+0000","last_change":"2024-09-14T10:56:14.856227+0000","last_active":"2024-09-14T11:33:45.598055+0000","last_peered":"2024-09-14T11:33:45.598055+0000","last_clean":"2024-09-14T11:33:45.598055+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:33:45.598055+0000","last_undegraded":"2024-09-14T11:33:45.598055+0000","last_fullsized":"2024-09-14T11:33:45.598055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:33.427287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'135","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.661856+0000","last_change":"2024-09-14T10:56:16.875970+0000","last_active":"2024-09-14T11:35:32.661856+0000","last_peered":"2024-09-14T11:35:32.661856+0000","last_clean":"2024-09-14T11:35:32.661856+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:35:32.661856+0000","last_undegraded":"2024-09-14T11:35:32.661856+0000","last_fullsized":"2024-09-14T11:35:32.661856+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.939235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'137","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.148825+0000","last_change":"2024-09-14T10:56:16.878602+0000","last_active":"2024-09-14T11:35:56.148825+0000","last_peered":"2024-09-14T11:35:56.148825+0000","last_clean":"2024-09-14T11:35:56.148825+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:35:56.148825+0000","last_undegraded":"2024-09-14T11:35:56.148825+0000","last_fullsized":"2024-09-14T11:35:56.148825+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:22.821986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'295","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.068636+0000","last_change":"2024-09-14T10:56:08.840398+0000","last_active":"2024-09-14T11:34:47.068636+0000","last_peered":"2024-09-14T11:34:47.068636+0000","last_clean":"2024-09-14T11:34:47.068636+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:34:47.068636+0000","last_undegraded":"2024-09-14T11:34:47.068636+0000","last_fullsized":"2024-09-14T11:34:47.068636+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:37.548644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'233","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.279430+0000","last_change":"2024-09-14T10:56:06.832210+0000","last_active":"2024-09-14T11:35:36.279430+0000","last_peered":"2024-09-14T11:35:36.279430+0000","last_clean":"2024-09-14T11:35:36.279430+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:35:36.279430+0000","last_undegraded":"2024-09-14T11:35:36.279430+0000","last_fullsized":"2024-09-14T11:35:36.279430+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:05.108211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325342,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":440,"num_read_kb":2273,"num_write":854,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:33.863009+0000","last_change":"2024-09-14T10:56:10.850437+0000","last_active":"2024-09-14T11:33:33.863009+0000","last_peered":"2024-09-14T11:33:33.863009+0000","last_clean":"2024-09-14T11:33:33.863009+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:33:33.863009+0000","last_undegraded":"2024-09-14T11:33:33.863009+0000","last_fullsized":"2024-09-14T11:33:33.863009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.749205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'250","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.477571+0000","last_change":"2024-09-14T10:56:12.855555+0000","last_active":"2024-09-14T11:36:21.477571+0000","last_peered":"2024-09-14T11:36:21.477571+0000","last_clean":"2024-09-14T11:36:21.477571+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:36:21.477571+0000","last_undegraded":"2024-09-14T11:36:21.477571+0000","last_fullsized":"2024-09-14T11:36:21.477571+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:39.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":804,"num_write":322,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596468+0000","last_change":"2024-09-14T10:56:14.859912+0000","last_active":"2024-09-14T11:33:35.596468+0000","last_peered":"2024-09-14T11:33:35.596468+0000","last_clean":"2024-09-14T11:33:35.596468+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:33:35.596468+0000","last_undegraded":"2024-09-14T11:33:35.596468+0000","last_fullsized":"2024-09-14T11:33:35.596468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:50.590250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'113","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.905145+0000","last_change":"2024-09-14T10:56:16.876189+0000","last_active":"2024-09-14T11:35:54.905145+0000","last_peered":"2024-09-14T11:35:54.905145+0000","last_clean":"2024-09-14T11:35:54.905145+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:35:54.905145+0000","last_undegraded":"2024-09-14T11:35:54.905145+0000","last_fullsized":"2024-09-14T11:35:54.905145+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:08.040744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.724841+0000","last_change":"2024-09-14T10:56:08.846963+0000","last_active":"2024-09-14T11:35:17.724841+0000","last_peered":"2024-09-14T11:35:17.724841+0000","last_clean":"2024-09-14T11:35:17.724841+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:35:17.724841+0000","last_undegraded":"2024-09-14T11:35:17.724841+0000","last_fullsized":"2024-09-14T11:35:17.724841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:44.520201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'253","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.307138+0000","last_change":"2024-09-14T10:56:06.832027+0000","last_active":"2024-09-14T11:35:26.307138+0000","last_peered":"2024-09-14T11:35:26.307138+0000","last_clean":"2024-09-14T11:35:26.307138+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:35:26.307138+0000","last_undegraded":"2024-09-14T11:35:26.307138+0000","last_fullsized":"2024-09-14T11:35:26.307138+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:30.367132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12492827,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":539,"num_read_kb":9274,"num_write":905,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596533+0000","last_change":"2024-09-14T10:56:10.846714+0000","last_active":"2024-09-14T11:33:35.596533+0000","last_peered":"2024-09-14T11:33:35.596533+0000","last_clean":"2024-09-14T11:33:35.596533+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:33:35.596533+0000","last_undegraded":"2024-09-14T11:33:35.596533+0000","last_fullsized":"2024-09-14T11:33:35.596533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:14.559729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'57","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.293027+0000","last_change":"2024-09-14T10:56:12.851172+0000","last_active":"2024-09-14T11:36:21.293027+0000","last_peered":"2024-09-14T11:36:21.293027+0000","last_clean":"2024-09-14T11:36:21.293027+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:36:21.293027+0000","last_undegraded":"2024-09-14T11:36:21.293027+0000","last_fullsized":"2024-09-14T11:36:21.293027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:56.828348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883833+0000","last_change":"2024-09-14T10:56:14.869388+0000","last_active":"2024-09-14T11:33:34.883833+0000","last_peered":"2024-09-14T11:33:34.883833+0000","last_clean":"2024-09-14T11:33:34.883833+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:33:34.883833+0000","last_undegraded":"2024-09-14T11:33:34.883833+0000","last_fullsized":"2024-09-14T11:33:34.883833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:37.817198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.091148+0000","last_change":"2024-09-14T10:56:16.870386+0000","last_active":"2024-09-14T11:35:56.091148+0000","last_peered":"2024-09-14T11:35:56.091148+0000","last_clean":"2024-09-14T11:35:56.091148+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:35:56.091148+0000","last_undegraded":"2024-09-14T11:35:56.091148+0000","last_fullsized":"2024-09-14T11:35:56.091148+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:47.067599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.083359+0000","last_change":"2024-09-14T10:56:08.846942+0000","last_active":"2024-09-14T11:35:56.083359+0000","last_peered":"2024-09-14T11:35:56.083359+0000","last_clean":"2024-09-14T11:35:56.083359+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:35:56.083359+0000","last_undegraded":"2024-09-14T11:35:56.083359+0000","last_fullsized":"2024-09-14T11:35:56.083359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:59.799497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'292","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.876575+0000","last_change":"2024-09-14T10:56:06.836735+0000","last_active":"2024-09-14T11:34:47.876575+0000","last_peered":"2024-09-14T11:34:47.876575+0000","last_clean":"2024-09-14T11:34:47.876575+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:34:47.876575+0000","last_undegraded":"2024-09-14T11:34:47.876575+0000","last_fullsized":"2024-09-14T11:34:47.876575+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:57.401574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381373,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":560,"num_read_kb":2982,"num_write":1103,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883799+0000","last_change":"2024-09-14T10:56:10.850036+0000","last_active":"2024-09-14T11:33:34.883799+0000","last_peered":"2024-09-14T11:33:34.883799+0000","last_clean":"2024-09-14T11:33:34.883799+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:33:34.883799+0000","last_undegraded":"2024-09-14T11:33:34.883799+0000","last_fullsized":"2024-09-14T11:33:34.883799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.348764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'303","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.449820+0000","last_change":"2024-09-14T10:56:12.856115+0000","last_active":"2024-09-14T11:36:21.449820+0000","last_peered":"2024-09-14T11:36:21.449820+0000","last_clean":"2024-09-14T11:36:21.449820+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:36:21.449820+0000","last_undegraded":"2024-09-14T11:36:21.449820+0000","last_fullsized":"2024-09-14T11:36:21.449820+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:16.373969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1003,"num_write":408,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884434+0000","last_change":"2024-09-14T10:56:14.869461+0000","last_active":"2024-09-14T11:33:34.884434+0000","last_peered":"2024-09-14T11:33:34.884434+0000","last_clean":"2024-09-14T11:33:34.884434+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:33:34.884434+0000","last_undegraded":"2024-09-14T11:33:34.884434+0000","last_fullsized":"2024-09-14T11:33:34.884434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:05.233425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'185","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.325833+0000","last_change":"2024-09-14T10:56:16.875845+0000","last_active":"2024-09-14T11:35:36.325833+0000","last_peered":"2024-09-14T11:35:36.325833+0000","last_clean":"2024-09-14T11:35:36.325833+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:35:36.325833+0000","last_undegraded":"2024-09-14T11:35:36.325833+0000","last_fullsized":"2024-09-14T11:35:36.325833+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:59.857949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:11.701560+0000","last_change":"2024-09-14T10:56:08.839406+0000","last_active":"2024-09-14T11:34:11.701560+0000","last_peered":"2024-09-14T11:34:11.701560+0000","last_clean":"2024-09-14T11:34:11.701560+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:34:11.701560+0000","last_undegraded":"2024-09-14T11:34:11.701560+0000","last_fullsized":"2024-09-14T11:34:11.701560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:41.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'253","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:48.760518+0000","last_change":"2024-09-14T10:56:06.837904+0000","last_active":"2024-09-14T11:34:48.760518+0000","last_peered":"2024-09-14T11:34:48.760518+0000","last_clean":"2024-09-14T11:34:48.760518+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:34:48.760518+0000","last_undegraded":"2024-09-14T11:34:48.760518+0000","last_fullsized":"2024-09-14T11:34:48.760518+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:12.136843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584163,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":443,"num_read_kb":4352,"num_write":887,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884386+0000","last_change":"2024-09-14T10:56:10.852317+0000","last_active":"2024-09-14T11:33:34.884386+0000","last_peered":"2024-09-14T11:33:34.884386+0000","last_clean":"2024-09-14T11:33:34.884386+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:33:34.884386+0000","last_undegraded":"2024-09-14T11:33:34.884386+0000","last_fullsized":"2024-09-14T11:33:34.884386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:16.512220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'258","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.373604+0000","last_change":"2024-09-14T10:56:12.848425+0000","last_active":"2024-09-14T11:36:21.373604+0000","last_peered":"2024-09-14T11:36:21.373604+0000","last_clean":"2024-09-14T11:36:21.373604+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:36:21.373604+0000","last_undegraded":"2024-09-14T11:36:21.373604+0000","last_fullsized":"2024-09-14T11:36:21.373604+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:32.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":874,"num_write":342,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750839+0000","last_change":"2024-09-14T10:56:14.863993+0000","last_active":"2024-09-14T11:33:38.750839+0000","last_peered":"2024-09-14T11:33:38.750839+0000","last_clean":"2024-09-14T11:33:38.750839+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:33:38.750839+0000","last_undegraded":"2024-09-14T11:33:38.750839+0000","last_fullsized":"2024-09-14T11:33:38.750839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:28.114909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.115874+0000","last_change":"2024-09-14T10:56:08.840371+0000","last_active":"2024-09-14T11:34:57.115874+0000","last_peered":"2024-09-14T11:34:57.115874+0000","last_clean":"2024-09-14T11:34:57.115874+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:34:57.115874+0000","last_undegraded":"2024-09-14T11:34:57.115874+0000","last_fullsized":"2024-09-14T11:34:57.115874+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:29.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'249","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:50.606583+0000","last_change":"2024-09-14T10:56:06.829430+0000","last_active":"2024-09-14T11:34:50.606583+0000","last_peered":"2024-09-14T11:34:50.606583+0000","last_clean":"2024-09-14T11:34:50.606583+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:34:50.606583+0000","last_undegraded":"2024-09-14T11:34:50.606583+0000","last_fullsized":"2024-09-14T11:34:50.606583+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:54.337485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12172022,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":428,"num_read_kb":11663,"num_write":905,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756814+0000","last_change":"2024-09-14T10:56:10.845758+0000","last_active":"2024-09-14T11:34:23.756814+0000","last_peered":"2024-09-14T11:34:23.756814+0000","last_clean":"2024-09-14T11:34:23.756814+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:34:23.756814+0000","last_undegraded":"2024-09-14T11:34:23.756814+0000","last_fullsized":"2024-09-14T11:34:23.756814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'469","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.600233+0000","last_change":"2024-09-14T10:56:12.857013+0000","last_active":"2024-09-14T11:37:14.600233+0000","last_peered":"2024-09-14T11:37:14.600233+0000","last_clean":"2024-09-14T11:37:14.600233+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:37:14.600233+0000","last_undegraded":"2024-09-14T11:37:14.600233+0000","last_fullsized":"2024-09-14T11:37:14.600233+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206865,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":829,"num_read_kb":1977,"num_write":726,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868166+0000","last_change":"2024-09-14T10:56:14.866608+0000","last_active":"2024-09-14T11:33:47.868166+0000","last_peered":"2024-09-14T11:33:47.868166+0000","last_clean":"2024-09-14T11:33:47.868166+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:33:47.868166+0000","last_undegraded":"2024-09-14T11:33:47.868166+0000","last_fullsized":"2024-09-14T11:33:47.868166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:07.568392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'180","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.637830+0000","last_change":"2024-09-14T10:56:16.877816+0000","last_active":"2024-09-14T11:35:56.637830+0000","last_peered":"2024-09-14T11:35:56.637830+0000","last_clean":"2024-09-14T11:35:56.637830+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:35:56.637830+0000","last_undegraded":"2024-09-14T11:35:56.637830+0000","last_fullsized":"2024-09-14T11:35:56.637830+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.287323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.254239+0000","last_change":"2024-09-14T10:56:08.843523+0000","last_active":"2024-09-14T11:34:54.254239+0000","last_peered":"2024-09-14T11:34:54.254239+0000","last_clean":"2024-09-14T11:34:54.254239+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:34:54.254239+0000","last_undegraded":"2024-09-14T11:34:54.254239+0000","last_fullsized":"2024-09-14T11:34:54.254239+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:16.988838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'263","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:08.886773+0000","last_change":"2024-09-14T10:56:06.824700+0000","last_active":"2024-09-14T11:37:08.886773+0000","last_peered":"2024-09-14T11:37:08.886773+0000","last_clean":"2024-09-14T11:37:08.886773+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:08.886773+0000","last_undegraded":"2024-09-14T11:37:08.886773+0000","last_fullsized":"2024-09-14T11:37:08.886773+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:30.572275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2748276,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":431,"num_read_kb":3066,"num_write":934,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885912+0000","last_change":"2024-09-14T10:56:10.851611+0000","last_active":"2024-09-14T11:33:44.885912+0000","last_peered":"2024-09-14T11:33:44.885912+0000","last_clean":"2024-09-14T11:33:44.885912+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:33:44.885912+0000","last_undegraded":"2024-09-14T11:33:44.885912+0000","last_fullsized":"2024-09-14T11:33:44.885912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.503933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'331","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.464520+0000","last_change":"2024-09-14T10:56:12.850684+0000","last_active":"2024-09-14T11:37:13.464520+0000","last_peered":"2024-09-14T11:37:13.464520+0000","last_clean":"2024-09-14T11:37:13.464520+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:37:13.464520+0000","last_undegraded":"2024-09-14T11:37:13.464520+0000","last_fullsized":"2024-09-14T11:37:13.464520+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.655979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":1107,"num_write":466,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.864958+0000","last_change":"2024-09-14T10:56:14.863516+0000","last_active":"2024-09-14T11:33:48.864958+0000","last_peered":"2024-09-14T11:33:48.864958+0000","last_clean":"2024-09-14T11:33:48.864958+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:33:48.864958+0000","last_undegraded":"2024-09-14T11:33:48.864958+0000","last_fullsized":"2024-09-14T11:33:48.864958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.527433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.073475+0000","last_change":"2024-09-14T10:56:16.873262+0000","last_active":"2024-09-14T11:35:27.073475+0000","last_peered":"2024-09-14T11:35:27.073475+0000","last_clean":"2024-09-14T11:35:27.073475+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:35:27.073475+0000","last_undegraded":"2024-09-14T11:35:27.073475+0000","last_fullsized":"2024-09-14T11:35:27.073475+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:21.859002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.926778+0000","last_change":"2024-09-14T10:56:08.841022+0000","last_active":"2024-09-14T11:35:23.926778+0000","last_peered":"2024-09-14T11:35:23.926778+0000","last_clean":"2024-09-14T11:35:23.926778+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:35:23.926778+0000","last_undegraded":"2024-09-14T11:35:23.926778+0000","last_fullsized":"2024-09-14T11:35:23.926778+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:11.924992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'299","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.832223+0000","last_change":"2024-09-14T10:56:06.831161+0000","last_active":"2024-09-14T11:34:23.832223+0000","last_peered":"2024-09-14T11:34:23.832223+0000","last_clean":"2024-09-14T11:34:23.832223+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:34:23.832223+0000","last_undegraded":"2024-09-14T11:34:23.832223+0000","last_fullsized":"2024-09-14T11:34:23.832223+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:43.805445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16832488,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":510,"num_read_kb":69620,"num_write":1071,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886067+0000","last_change":"2024-09-14T10:56:10.848128+0000","last_active":"2024-09-14T11:33:44.886067+0000","last_peered":"2024-09-14T11:33:44.886067+0000","last_clean":"2024-09-14T11:33:44.886067+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:33:44.886067+0000","last_undegraded":"2024-09-14T11:33:44.886067+0000","last_fullsized":"2024-09-14T11:33:44.886067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:51.970572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'265","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.480456+0000","last_change":"2024-09-14T10:56:13.041394+0000","last_active":"2024-09-14T11:36:21.480456+0000","last_peered":"2024-09-14T11:36:21.480456+0000","last_clean":"2024-09-14T11:36:21.480456+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:36:21.480456+0000","last_undegraded":"2024-09-14T11:36:21.480456+0000","last_fullsized":"2024-09-14T11:36:21.480456+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:59.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":944,"num_write":368,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757802+0000","last_change":"2024-09-14T10:56:14.862660+0000","last_active":"2024-09-14T11:34:28.757802+0000","last_peered":"2024-09-14T11:34:28.757802+0000","last_clean":"2024-09-14T11:34:28.757802+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:34:28.757802+0000","last_undegraded":"2024-09-14T11:34:28.757802+0000","last_fullsized":"2024-09-14T11:34:28.757802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:53.685139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'113","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.629869+0000","last_change":"2024-09-14T10:56:16.874807+0000","last_active":"2024-09-14T11:37:14.629869+0000","last_peered":"2024-09-14T11:37:14.629869+0000","last_clean":"2024-09-14T11:37:14.629869+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:37:14.629869+0000","last_undegraded":"2024-09-14T11:37:14.629869+0000","last_fullsized":"2024-09-14T11:37:14.629869+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:23.768244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.865069+0000","last_change":"2024-09-14T10:56:08.842580+0000","last_active":"2024-09-14T11:35:16.865069+0000","last_peered":"2024-09-14T11:35:16.865069+0000","last_clean":"2024-09-14T11:35:16.865069+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:35:16.865069+0000","last_undegraded":"2024-09-14T11:35:16.865069+0000","last_fullsized":"2024-09-14T11:35:16.865069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:35.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'288","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.365137+0000","last_change":"2024-09-14T10:56:06.834528+0000","last_active":"2024-09-14T11:35:18.365137+0000","last_peered":"2024-09-14T11:35:18.365137+0000","last_clean":"2024-09-14T11:35:18.365137+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:35:18.365137+0000","last_undegraded":"2024-09-14T11:35:18.365137+0000","last_fullsized":"2024-09-14T11:35:18.365137+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:09.265221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10898289,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":571,"num_read_kb":33947,"num_write":1095,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.864422+0000","last_change":"2024-09-14T10:56:10.849432+0000","last_active":"2024-09-14T11:33:43.864422+0000","last_peered":"2024-09-14T11:33:43.864422+0000","last_clean":"2024-09-14T11:33:43.864422+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:33:43.864422+0000","last_undegraded":"2024-09-14T11:33:43.864422+0000","last_fullsized":"2024-09-14T11:33:43.864422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:43.219622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.472266+0000","last_change":"2024-09-14T10:56:13.041708+0000","last_active":"2024-09-14T11:36:21.472266+0000","last_peered":"2024-09-14T11:36:21.472266+0000","last_clean":"2024-09-14T11:36:21.472266+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:36:21.472266+0000","last_undegraded":"2024-09-14T11:36:21.472266+0000","last_fullsized":"2024-09-14T11:36:21.472266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:44.179299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'751","reported_seq":4574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.641743+0000","last_change":"2024-09-14T10:56:14.869079+0000","last_active":"2024-09-14T11:37:14.641743+0000","last_peered":"2024-09-14T11:37:14.641743+0000","last_clean":"2024-09-14T11:37:14.641743+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:37:14.641743+0000","last_undegraded":"2024-09-14T11:37:14.641743+0000","last_fullsized":"2024-09-14T11:37:14.641743+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:27.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'126","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.897308+0000","last_change":"2024-09-14T10:56:16.877187+0000","last_active":"2024-09-14T11:35:19.897308+0000","last_peered":"2024-09-14T11:35:19.897308+0000","last_clean":"2024-09-14T11:35:19.897308+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:35:19.897308+0000","last_undegraded":"2024-09-14T11:35:19.897308+0000","last_fullsized":"2024-09-14T11:35:19.897308+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:51.016753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.586731+0000","last_change":"2024-09-14T10:56:08.839500+0000","last_active":"2024-09-14T11:34:57.586731+0000","last_peered":"2024-09-14T11:34:57.586731+0000","last_clean":"2024-09-14T11:34:57.586731+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:34:57.586731+0000","last_undegraded":"2024-09-14T11:34:57.586731+0000","last_fullsized":"2024-09-14T11:34:57.586731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:48.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'283","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.373492+0000","last_change":"2024-09-14T10:56:06.836000+0000","last_active":"2024-09-14T11:35:12.373492+0000","last_peered":"2024-09-14T11:35:12.373492+0000","last_clean":"2024-09-14T11:35:12.373492+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:35:12.373492+0000","last_undegraded":"2024-09-14T11:35:12.373492+0000","last_fullsized":"2024-09-14T11:35:12.373492+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:46.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347461,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":712,"num_read_kb":7705,"num_write":1028,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885243+0000","last_change":"2024-09-14T10:56:10.851020+0000","last_active":"2024-09-14T11:33:44.885243+0000","last_peered":"2024-09-14T11:33:44.885243+0000","last_clean":"2024-09-14T11:33:44.885243+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:33:44.885243+0000","last_undegraded":"2024-09-14T11:33:44.885243+0000","last_fullsized":"2024-09-14T11:33:44.885243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:54.621932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'316","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.591631+0000","last_change":"2024-09-14T10:56:12.853222+0000","last_active":"2024-09-14T11:37:14.591631+0000","last_peered":"2024-09-14T11:37:14.591631+0000","last_clean":"2024-09-14T11:37:14.591631+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:37:14.591631+0000","last_undegraded":"2024-09-14T11:37:14.591631+0000","last_fullsized":"2024-09-14T11:37:14.591631+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":1031,"num_write":422,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761752+0000","last_change":"2024-09-14T10:56:14.869597+0000","last_active":"2024-09-14T11:34:58.761752+0000","last_peered":"2024-09-14T11:34:58.761752+0000","last_clean":"2024-09-14T11:34:58.761752+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:34:58.761752+0000","last_undegraded":"2024-09-14T11:34:58.761752+0000","last_fullsized":"2024-09-14T11:34:58.761752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:57.846436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.460581+0000","last_change":"2024-09-14T10:56:16.872084+0000","last_active":"2024-09-14T11:37:13.460581+0000","last_peered":"2024-09-14T11:37:13.460581+0000","last_clean":"2024-09-14T11:37:13.460581+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:37:13.460581+0000","last_undegraded":"2024-09-14T11:37:13.460581+0000","last_fullsized":"2024-09-14T11:37:13.460581+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:09.391213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.819430+0000","last_change":"2024-09-14T10:56:41.920664+0000","last_active":"2024-09-14T11:35:25.819430+0000","last_peered":"2024-09-14T11:35:25.819430+0000","last_clean":"2024-09-14T11:35:25.819430+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:35:25.819430+0000","last_undegraded":"2024-09-14T11:35:25.819430+0000","last_fullsized":"2024-09-14T11:35:25.819430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.080586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'261","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.236712+0000","last_change":"2024-09-14T10:56:06.829850+0000","last_active":"2024-09-14T11:35:19.236712+0000","last_peered":"2024-09-14T11:35:19.236712+0000","last_clean":"2024-09-14T11:35:19.236712+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:35:19.236712+0000","last_undegraded":"2024-09-14T11:35:19.236712+0000","last_fullsized":"2024-09-14T11:35:19.236712+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:46.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6185618,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":419,"num_read_kb":36817,"num_write":904,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:42.867186+0000","last_change":"2024-09-14T10:56:10.846542+0000","last_active":"2024-09-14T11:33:42.867186+0000","last_peered":"2024-09-14T11:33:42.867186+0000","last_clean":"2024-09-14T11:33:42.867186+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:33:42.867186+0000","last_undegraded":"2024-09-14T11:33:42.867186+0000","last_fullsized":"2024-09-14T11:33:42.867186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.655261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'278","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.593083+0000","last_change":"2024-09-14T10:56:12.854064+0000","last_active":"2024-09-14T11:37:14.593083+0000","last_peered":"2024-09-14T11:37:14.593083+0000","last_clean":"2024-09-14T11:37:14.593083+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:37:14.593083+0000","last_undegraded":"2024-09-14T11:37:14.593083+0000","last_fullsized":"2024-09-14T11:37:14.593083+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.267552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":891,"num_write":362,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895529+0000","last_change":"2024-09-14T10:56:14.866692+0000","last_active":"2024-09-14T11:34:59.895529+0000","last_peered":"2024-09-14T11:34:59.895529+0000","last_clean":"2024-09-14T11:34:59.895529+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:34:59.895529+0000","last_undegraded":"2024-09-14T11:34:59.895529+0000","last_fullsized":"2024-09-14T11:34:59.895529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:02.219332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'151","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.062796+0000","last_change":"2024-09-14T10:56:16.877739+0000","last_active":"2024-09-14T11:35:54.062796+0000","last_peered":"2024-09-14T11:35:54.062796+0000","last_clean":"2024-09-14T11:35:54.062796+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:35:54.062796+0000","last_undegraded":"2024-09-14T11:35:54.062796+0000","last_fullsized":"2024-09-14T11:35:54.062796+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:45.768007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'125","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607195+0000","last_change":"2024-09-14T10:56:08.838852+0000","last_active":"2024-09-14T11:34:55.607195+0000","last_peered":"2024-09-14T11:34:55.607195+0000","last_clean":"2024-09-14T11:34:55.607195+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:34:55.607195+0000","last_undegraded":"2024-09-14T11:34:55.607195+0000","last_fullsized":"2024-09-14T11:34:55.607195+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:23.082263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'315","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.982622+0000","last_change":"2024-09-14T10:56:06.830822+0000","last_active":"2024-09-14T11:34:55.982622+0000","last_peered":"2024-09-14T11:34:55.982622+0000","last_clean":"2024-09-14T11:34:55.982622+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:34:55.982622+0000","last_undegraded":"2024-09-14T11:34:55.982622+0000","last_fullsized":"2024-09-14T11:34:55.982622+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:26.425490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977629,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":563,"num_read_kb":16528,"num_write":1250,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895271+0000","last_change":"2024-09-14T10:56:10.849183+0000","last_active":"2024-09-14T11:34:54.895271+0000","last_peered":"2024-09-14T11:34:54.895271+0000","last_clean":"2024-09-14T11:34:54.895271+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:34:54.895271+0000","last_undegraded":"2024-09-14T11:34:54.895271+0000","last_fullsized":"2024-09-14T11:34:54.895271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:41.598284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.426114+0000","last_change":"2024-09-14T10:56:12.853468+0000","last_active":"2024-09-14T11:37:09.426114+0000","last_peered":"2024-09-14T11:37:09.426114+0000","last_clean":"2024-09-14T11:37:09.426114+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:37:09.426114+0000","last_undegraded":"2024-09-14T11:37:09.426114+0000","last_fullsized":"2024-09-14T11:37:09.426114+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:48.351559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65752,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":996,"num_write":378,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886032+0000","last_change":"2024-09-14T10:56:14.870248+0000","last_active":"2024-09-14T11:33:44.886032+0000","last_peered":"2024-09-14T11:33:44.886032+0000","last_clean":"2024-09-14T11:33:44.886032+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:33:44.886032+0000","last_undegraded":"2024-09-14T11:33:44.886032+0000","last_fullsized":"2024-09-14T11:33:44.886032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.097159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'174","reported_seq":1634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.097709+0000","last_change":"2024-09-14T10:56:16.874279+0000","last_active":"2024-09-14T11:35:56.097709+0000","last_peered":"2024-09-14T11:35:56.097709+0000","last_clean":"2024-09-14T11:35:56.097709+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:35:56.097709+0000","last_undegraded":"2024-09-14T11:35:56.097709+0000","last_fullsized":"2024-09-14T11:35:56.097709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:13.650009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.042909+0000","last_change":"2024-09-14T10:56:08.843487+0000","last_active":"2024-09-14T11:35:31.042909+0000","last_peered":"2024-09-14T11:35:31.042909+0000","last_clean":"2024-09-14T11:35:31.042909+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:35:31.042909+0000","last_undegraded":"2024-09-14T11:35:31.042909+0000","last_fullsized":"2024-09-14T11:35:31.042909+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:16.895665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'294","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.850553+0000","last_change":"2024-09-14T10:56:41.921531+0000","last_active":"2024-09-14T11:35:19.850553+0000","last_peered":"2024-09-14T11:35:19.850553+0000","last_clean":"2024-09-14T11:35:19.850553+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:35:19.850553+0000","last_undegraded":"2024-09-14T11:35:19.850553+0000","last_fullsized":"2024-09-14T11:35:19.850553+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:51.807850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6931208,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":597,"num_read_kb":13580,"num_write":1059,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762455+0000","last_change":"2024-09-14T10:56:10.850525+0000","last_active":"2024-09-14T11:35:03.762455+0000","last_peered":"2024-09-14T11:35:03.762455+0000","last_clean":"2024-09-14T11:35:03.762455+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:35:03.762455+0000","last_undegraded":"2024-09-14T11:35:03.762455+0000","last_fullsized":"2024-09-14T11:35:03.762455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'276","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.380353+0000","last_change":"2024-09-14T10:56:12.850877+0000","last_active":"2024-09-14T11:36:21.380353+0000","last_peered":"2024-09-14T11:36:21.380353+0000","last_clean":"2024-09-14T11:36:21.380353+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:36:21.380353+0000","last_undegraded":"2024-09-14T11:36:21.380353+0000","last_fullsized":"2024-09-14T11:36:21.380353+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:39.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":464,"num_read_kb":932,"num_write":374,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752208+0000","last_change":"2024-09-14T10:56:14.864169+0000","last_active":"2024-09-14T11:33:48.752208+0000","last_peered":"2024-09-14T11:33:48.752208+0000","last_clean":"2024-09-14T11:33:48.752208+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:33:48.752208+0000","last_undegraded":"2024-09-14T11:33:48.752208+0000","last_fullsized":"2024-09-14T11:33:48.752208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:15.470147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.456829+0000","last_change":"2024-09-14T10:56:16.872566+0000","last_active":"2024-09-14T11:37:13.456829+0000","last_peered":"2024-09-14T11:37:13.456829+0000","last_clean":"2024-09-14T11:37:13.456829+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:37:13.456829+0000","last_undegraded":"2024-09-14T11:37:13.456829+0000","last_fullsized":"2024-09-14T11:37:13.456829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:34.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763120+0000","last_change":"2024-09-14T10:56:08.840955+0000","last_active":"2024-09-14T11:35:08.763120+0000","last_peered":"2024-09-14T11:35:08.763120+0000","last_clean":"2024-09-14T11:35:08.763120+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:35:08.763120+0000","last_undegraded":"2024-09-14T11:35:08.763120+0000","last_fullsized":"2024-09-14T11:35:08.763120+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.823863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'310","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.007043+0000","last_change":"2024-09-14T10:56:06.833785+0000","last_active":"2024-09-14T11:35:30.007043+0000","last_peered":"2024-09-14T11:35:30.007043+0000","last_clean":"2024-09-14T11:35:30.007043+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:35:30.007043+0000","last_undegraded":"2024-09-14T11:35:30.007043+0000","last_fullsized":"2024-09-14T11:35:30.007043+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:27.562038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6749314,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":567,"num_read_kb":8660,"num_write":1006,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763097+0000","last_change":"2024-09-14T10:56:08.850785+0000","last_active":"2024-09-14T11:35:08.763097+0000","last_peered":"2024-09-14T11:35:08.763097+0000","last_clean":"2024-09-14T11:35:08.763097+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:35:08.763097+0000","last_undegraded":"2024-09-14T11:35:08.763097+0000","last_fullsized":"2024-09-14T11:35:08.763097+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:01.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'369","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.695445+0000","last_change":"2024-09-14T10:56:06.822844+0000","last_active":"2024-09-14T11:34:20.695445+0000","last_peered":"2024-09-14T11:34:20.695445+0000","last_clean":"2024-09-14T11:34:20.695445+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:34:20.695445+0000","last_undegraded":"2024-09-14T11:34:20.695445+0000","last_fullsized":"2024-09-14T11:34:20.695445+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:18.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17418872,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":684,"num_read_kb":16318,"num_write":1423,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880525+0000","last_change":"2024-09-14T10:56:08.848489+0000","last_active":"2024-09-14T11:35:12.880525+0000","last_peered":"2024-09-14T11:35:12.880525+0000","last_clean":"2024-09-14T11:35:12.880525+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:35:12.880525+0000","last_undegraded":"2024-09-14T11:35:12.880525+0000","last_fullsized":"2024-09-14T11:35:12.880525+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:03.708119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'244","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.768716+0000","last_change":"2024-09-14T10:56:06.827629+0000","last_active":"2024-09-14T11:35:25.768716+0000","last_peered":"2024-09-14T11:35:25.768716+0000","last_clean":"2024-09-14T11:35:25.768716+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:35:25.768716+0000","last_undegraded":"2024-09-14T11:35:25.768716+0000","last_fullsized":"2024-09-14T11:35:25.768716+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:56.559924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6325029,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":488,"num_read_kb":2695,"num_write":841,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763055+0000","last_change":"2024-09-14T10:56:08.845334+0000","last_active":"2024-09-14T11:35:08.763055+0000","last_peered":"2024-09-14T11:35:08.763055+0000","last_clean":"2024-09-14T11:35:08.763055+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:35:08.763055+0000","last_undegraded":"2024-09-14T11:35:08.763055+0000","last_fullsized":"2024-09-14T11:35:08.763055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'294","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.447605+0000","last_change":"2024-09-14T10:56:41.922043+0000","last_active":"2024-09-14T11:35:38.447605+0000","last_peered":"2024-09-14T11:35:38.447605+0000","last_clean":"2024-09-14T11:35:38.447605+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:35:38.447605+0000","last_undegraded":"2024-09-14T11:35:38.447605+0000","last_fullsized":"2024-09-14T11:35:38.447605+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:53.350669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6926579,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":763,"num_read_kb":27796,"num_write":1103,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.498343+0000","last_change":"2024-09-14T10:56:08.847845+0000","last_active":"2024-09-14T11:35:38.498343+0000","last_peered":"2024-09-14T11:35:38.498343+0000","last_clean":"2024-09-14T11:35:38.498343+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:35:38.498343+0000","last_undegraded":"2024-09-14T11:35:38.498343+0000","last_fullsized":"2024-09-14T11:35:38.498343+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:22.522568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'375","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.430964+0000","last_change":"2024-09-14T10:56:06.833611+0000","last_active":"2024-09-14T11:35:14.430964+0000","last_peered":"2024-09-14T11:35:14.430964+0000","last_clean":"2024-09-14T11:35:14.430964+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:35:14.430964+0000","last_undegraded":"2024-09-14T11:35:14.430964+0000","last_fullsized":"2024-09-14T11:35:14.430964+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:09.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13190882,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1346,"num_read_kb":14785,"num_write":1204,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:22.049621+0000","last_change":"2024-09-14T10:56:08.844274+0000","last_active":"2024-09-14T11:35:22.049621+0000","last_peered":"2024-09-14T11:35:22.049621+0000","last_clean":"2024-09-14T11:35:22.049621+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:35:22.049621+0000","last_undegraded":"2024-09-14T11:35:22.049621+0000","last_fullsized":"2024-09-14T11:35:22.049621+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:07.843122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'353","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763080+0000","last_change":"2024-09-14T10:56:06.822860+0000","last_active":"2024-09-14T11:35:08.763080+0000","last_peered":"2024-09-14T11:35:08.763080+0000","last_clean":"2024-09-14T11:35:08.763080+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:35:08.763080+0000","last_undegraded":"2024-09-14T11:35:08.763080+0000","last_fullsized":"2024-09-14T11:35:08.763080+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:33.951896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056117,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":681,"num_read_kb":54729,"num_write":1184,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:59.783590+0000","last_change":"2024-09-14T10:56:08.842881+0000","last_active":"2024-09-14T11:33:59.783590+0000","last_peered":"2024-09-14T11:33:59.783590+0000","last_clean":"2024-09-14T11:33:59.783590+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:33:59.783590+0000","last_undegraded":"2024-09-14T11:33:59.783590+0000","last_fullsized":"2024-09-14T11:33:59.783590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:22.148598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'368","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.114582+0000","last_change":"2024-09-14T10:56:06.832770+0000","last_active":"2024-09-14T11:35:36.114582+0000","last_peered":"2024-09-14T11:35:36.114582+0000","last_clean":"2024-09-14T11:35:36.114582+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:35:36.114582+0000","last_undegraded":"2024-09-14T11:35:36.114582+0000","last_fullsized":"2024-09-14T11:35:36.114582+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:20.311265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5628247,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1087,"num_read_kb":46426,"num_write":1418,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'302","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.248090+0000","last_change":"2024-09-14T10:56:08.846123+0000","last_active":"2024-09-14T11:35:13.248090+0000","last_peered":"2024-09-14T11:35:13.248090+0000","last_clean":"2024-09-14T11:35:13.248090+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:35:13.248090+0000","last_undegraded":"2024-09-14T11:35:13.248090+0000","last_fullsized":"2024-09-14T11:35:13.248090+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:53.557283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'255","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:10.609228+0000","last_change":"2024-09-14T10:56:06.834641+0000","last_active":"2024-09-14T11:35:10.609228+0000","last_peered":"2024-09-14T11:35:10.609228+0000","last_clean":"2024-09-14T11:35:10.609228+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:35:10.609228+0000","last_undegraded":"2024-09-14T11:35:10.609228+0000","last_fullsized":"2024-09-14T11:35:10.609228+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.416149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5351444,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":411,"num_read_kb":5718,"num_write":921,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.559561+0000","last_change":"2024-09-14T10:56:08.835412+0000","last_active":"2024-09-14T11:35:18.559561+0000","last_peered":"2024-09-14T11:35:18.559561+0000","last_clean":"2024-09-14T11:35:18.559561+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:35:18.559561+0000","last_undegraded":"2024-09-14T11:35:18.559561+0000","last_fullsized":"2024-09-14T11:35:18.559561+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:49.723578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'292","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:06.790191+0000","last_change":"2024-09-14T10:56:06.829591+0000","last_active":"2024-09-14T11:37:06.790191+0000","last_peered":"2024-09-14T11:37:06.790191+0000","last_clean":"2024-09-14T11:37:06.790191+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:37:06.790191+0000","last_undegraded":"2024-09-14T11:37:06.790191+0000","last_fullsized":"2024-09-14T11:37:06.790191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:39.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163974,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":437,"num_read_kb":8092,"num_write":1057,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883767+0000","last_change":"2024-09-14T10:56:08.842404+0000","last_active":"2024-09-14T11:33:29.883767+0000","last_peered":"2024-09-14T11:33:29.883767+0000","last_clean":"2024-09-14T11:33:29.883767+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:33:29.883767+0000","last_undegraded":"2024-09-14T11:33:29.883767+0000","last_fullsized":"2024-09-14T11:33:29.883767+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:20.506202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'281","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.618849+0000","last_change":"2024-09-14T10:56:06.834541+0000","last_active":"2024-09-14T11:35:16.618849+0000","last_peered":"2024-09-14T11:35:16.618849+0000","last_clean":"2024-09-14T11:35:16.618849+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:35:16.618849+0000","last_undegraded":"2024-09-14T11:35:16.618849+0000","last_fullsized":"2024-09-14T11:35:16.618849+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:07.196281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19849358,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":593,"num_read_kb":52896,"num_write":1076,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861201+0000","last_change":"2024-09-14T10:56:08.841270+0000","last_active":"2024-09-14T11:34:29.861201+0000","last_peered":"2024-09-14T11:34:29.861201+0000","last_clean":"2024-09-14T11:34:29.861201+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:34:29.861201+0000","last_undegraded":"2024-09-14T11:34:29.861201+0000","last_fullsized":"2024-09-14T11:34:29.861201+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:43.163716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'301","reported_seq":1167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.434344+0000","last_change":"2024-09-14T10:56:06.835991+0000","last_active":"2024-09-14T11:35:32.434344+0000","last_peered":"2024-09-14T11:35:32.434344+0000","last_clean":"2024-09-14T11:35:32.434344+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:35:32.434344+0000","last_undegraded":"2024-09-14T11:35:32.434344+0000","last_fullsized":"2024-09-14T11:35:32.434344+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:00.421199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591910,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1246,"num_read_kb":34715,"num_write":1163,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891061+0000","last_change":"2024-09-14T10:56:08.843794+0000","last_active":"2024-09-14T11:34:24.891061+0000","last_peered":"2024-09-14T11:34:24.891061+0000","last_clean":"2024-09-14T11:34:24.891061+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:34:24.891061+0000","last_undegraded":"2024-09-14T11:34:24.891061+0000","last_fullsized":"2024-09-14T11:34:24.891061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:55.919014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'319","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.113635+0000","last_change":"2024-09-14T10:56:06.833787+0000","last_active":"2024-09-14T11:35:37.113635+0000","last_peered":"2024-09-14T11:35:37.113635+0000","last_clean":"2024-09-14T11:35:37.113635+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:35:37.113635+0000","last_undegraded":"2024-09-14T11:35:37.113635+0000","last_fullsized":"2024-09-14T11:35:37.113635+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.576376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5589024,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":581,"num_read_kb":11879,"num_write":1168,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.890453+0000","last_change":"2024-09-14T10:56:08.848886+0000","last_active":"2024-09-14T11:34:24.890453+0000","last_peered":"2024-09-14T11:34:24.890453+0000","last_clean":"2024-09-14T11:34:24.890453+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:34:24.890453+0000","last_undegraded":"2024-09-14T11:34:24.890453+0000","last_fullsized":"2024-09-14T11:34:24.890453+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:04.538771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'311","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:11.849702+0000","last_change":"2024-09-14T10:56:06.832377+0000","last_active":"2024-09-14T11:35:11.849702+0000","last_peered":"2024-09-14T11:35:11.849702+0000","last_clean":"2024-09-14T11:35:11.849702+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:35:11.849702+0000","last_undegraded":"2024-09-14T11:35:11.849702+0000","last_fullsized":"2024-09-14T11:35:11.849702+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:58.015169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486220,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":646,"num_read_kb":26247,"num_write":1120,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:51.228206+0000","last_change":"2024-09-14T10:56:08.839416+0000","last_active":"2024-09-14T11:34:51.228206+0000","last_peered":"2024-09-14T11:34:51.228206+0000","last_clean":"2024-09-14T11:34:51.228206+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:34:51.228206+0000","last_undegraded":"2024-09-14T11:34:51.228206+0000","last_fullsized":"2024-09-14T11:34:51.228206+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:07.079656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'306","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.548460+0000","last_change":"2024-09-14T10:56:06.830987+0000","last_active":"2024-09-14T11:34:47.548460+0000","last_peered":"2024-09-14T11:34:47.548460+0000","last_clean":"2024-09-14T11:34:47.548460+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:34:47.548460+0000","last_undegraded":"2024-09-14T11:34:47.548460+0000","last_fullsized":"2024-09-14T11:34:47.548460+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:29.841639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23726381,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":608,"num_read_kb":46767,"num_write":1176,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.481366+0000","last_change":"2024-09-14T10:56:08.833880+0000","last_active":"2024-09-14T11:35:14.481366+0000","last_peered":"2024-09-14T11:35:14.481366+0000","last_clean":"2024-09-14T11:35:14.481366+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:35:14.481366+0000","last_undegraded":"2024-09-14T11:35:14.481366+0000","last_fullsized":"2024-09-14T11:35:14.481366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:42.906752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'297","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.946339+0000","last_change":"2024-09-14T10:56:06.832512+0000","last_active":"2024-09-14T11:35:36.946339+0000","last_peered":"2024-09-14T11:35:36.946339+0000","last_clean":"2024-09-14T11:35:36.946339+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:35:36.946339+0000","last_undegraded":"2024-09-14T11:35:36.946339+0000","last_fullsized":"2024-09-14T11:35:36.946339+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.172444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642444,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":628,"num_read_kb":4317,"num_write":1116,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898132+0000","last_change":"2024-09-14T10:56:08.852010+0000","last_active":"2024-09-14T11:35:14.898132+0000","last_peered":"2024-09-14T11:35:14.898132+0000","last_clean":"2024-09-14T11:35:14.898132+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:35:14.898132+0000","last_undegraded":"2024-09-14T11:35:14.898132+0000","last_fullsized":"2024-09-14T11:35:14.898132+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.513514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'261","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.266714+0000","last_change":"2024-09-14T10:56:06.835010+0000","last_active":"2024-09-14T11:35:33.266714+0000","last_peered":"2024-09-14T11:35:33.266714+0000","last_clean":"2024-09-14T11:35:33.266714+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:35:33.266714+0000","last_undegraded":"2024-09-14T11:35:33.266714+0000","last_fullsized":"2024-09-14T11:35:33.266714+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:42.832634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7069395,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":556,"num_read_kb":2905,"num_write":1012,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'305","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.330258+0000","last_change":"2024-09-14T10:56:41.921185+0000","last_active":"2024-09-14T11:35:51.330258+0000","last_peered":"2024-09-14T11:35:51.330258+0000","last_clean":"2024-09-14T11:35:51.330258+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:35:51.330258+0000","last_undegraded":"2024-09-14T11:35:51.330258+0000","last_fullsized":"2024-09-14T11:35:51.330258+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:30.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056280,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":552,"num_read_kb":51615,"num_write":1157,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761881+0000","last_change":"2024-09-14T10:56:08.837369+0000","last_active":"2024-09-14T11:34:58.761881+0000","last_peered":"2024-09-14T11:34:58.761881+0000","last_clean":"2024-09-14T11:34:58.761881+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:34:58.761881+0000","last_undegraded":"2024-09-14T11:34:58.761881+0000","last_fullsized":"2024-09-14T11:34:58.761881+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:04.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'281","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.904866+0000","last_change":"2024-09-14T10:56:06.832783+0000","last_active":"2024-09-14T11:34:58.904866+0000","last_peered":"2024-09-14T11:34:58.904866+0000","last_clean":"2024-09-14T11:34:58.904866+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:34:58.904866+0000","last_undegraded":"2024-09-14T11:34:58.904866+0000","last_fullsized":"2024-09-14T11:34:58.904866+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:18.334532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7233163,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":539,"num_read_kb":18767,"num_write":1036,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877349+0000","last_change":"2024-09-14T10:56:08.841261+0000","last_active":"2024-09-14T11:34:52.877349+0000","last_peered":"2024-09-14T11:34:52.877349+0000","last_clean":"2024-09-14T11:34:52.877349+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:34:52.877349+0000","last_undegraded":"2024-09-14T11:34:52.877349+0000","last_fullsized":"2024-09-14T11:34:52.877349+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:10.975942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1684,"ondisk_log_size":1684,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":518,"ondisk_log_size":518,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1947362,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17072,"num_read_kb":32975,"num_write":14467,"num_write_kb":11632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3301376,"data_stored":2769238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1965,"ondisk_log_size":1965,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4164,"ondisk_log_size":4164,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":576369785,"num_objects":4336,"num_object_clones":0,"num_object_copies":8672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4336,"num_whiteouts":0,"num_read":39892,"num_read_kb":2045352,"num_write":68800,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1185357824,"data_stored":1152739570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4748,"ondisk_log_size":4748,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":82506366,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":123,"num_read_kb":206212,"num_write":140,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165019648,"data_stored":165012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":82506366,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":118,"num_read_kb":193226,"num_write":140,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165019648,"data_stored":165012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509949,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442036,"kb_used_data":194276,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93929804,"statfs":{"total":96636764160,"available":96184119296,"internally_reserved":0,"allocated":198938624,"data_stored":192955260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253688266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509948,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334104,"kb_used_data":118280,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94037736,"statfs":{"total":96636764160,"available":96294641664,"internally_reserved":0,"allocated":121118720,"data_stored":116532898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509947,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295300,"kb_used_data":223860,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94076540,"statfs":{"total":96636764160,"available":96334376960,"internally_reserved":0,"allocated":229232640,"data_stored":222840157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509949,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":475860,"kb_used_data":228100,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93895980,"statfs":{"total":96636764160,"available":96149483520,"internally_reserved":0,"allocated":233574400,"data_stored":227004899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509948,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247600,"kb_used_data":190048,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94124240,"statfs":{"total":96636764160,"available":96383221760,"internally_reserved":0,"allocated":194609152,"data_stored":190460100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542653,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292480,"kb_used_data":176688,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94079360,"statfs":{"total":96636764160,"available":96337264640,"internally_reserved":0,"allocated":180928512,"data_stored":176391108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542650,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":418080,"kb_used_data":206416,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93953760,"statfs":{"total":96636764160,"available":96208650240,"internally_reserved":0,"allocated":211369984,"data_stored":204957989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575355,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273996,"kb_used_data":174844,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94097844,"statfs":{"total":96636764160,"available":96356192256,"internally_reserved":0,"allocated":179040256,"data_stored":172786779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":171053056,"data_stored":166214066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":134213632,"data_stored":131201999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":140513280,"data_stored":137837728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":165445632,"data_stored":160410710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184983552,"data_stored":180046795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135929856,"data_stored":131277927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":95506432,"data_stored":92434140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":157712384,"data_stored":153316205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":344408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":380569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":133157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":477119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":83611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":675840,"data_stored":559111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":260762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":634880,"data_stored":530501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25169037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20639744,"data_stored":20637169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15732736,"data_stored":15731853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11202560,"data_stored":11199985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34607104,"data_stored":34606221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37751949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24834048,"data_stored":24831473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16445440,"data_stored":16442865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:37:49.291 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:37:49.645 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:37:49.658 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:37:49.660 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1517,"stamp":"2024-09-14T11:37:47.662908+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":743936910,"num_objects":4698,"num_object_clones":0,"num_object_copies":9396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4698,"num_whiteouts":0,"num_read":192072,"num_read_kb":2593426,"num_write":141703,"num_write_kb":2468304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14333,"ondisk_log_size":14333,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2779456,"kb_used_data":1512512,"kb_used_omap":12,"kb_used_meta":1266803,"kb_avail":752195264,"statfs":{"total":773094113280,"available":770247950336,"internally_reserved":0,"allocated":1548812288,"data_stored":1503929190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1297206832},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005956"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879647+0000","last_change":"2024-09-14T11:22:38.554296+0000","last_active":"2024-09-14T11:35:07.879647+0000","last_peered":"2024-09-14T11:35:07.879647+0000","last_clean":"2024-09-14T11:35:07.879647+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:35:07.879647+0000","last_undegraded":"2024-09-14T11:35:07.879647+0000","last_fullsized":"2024-09-14T11:35:07.879647+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:24.257792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:32.874387+0000","last_change":"2024-09-14T11:12:00.371370+0000","last_active":"2024-09-14T11:34:32.874387+0000","last_peered":"2024-09-14T11:34:32.874387+0000","last_clean":"2024-09-14T11:34:32.874387+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:34:32.874387+0000","last_undegraded":"2024-09-14T11:34:32.874387+0000","last_fullsized":"2024-09-14T11:34:32.874387+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:10.434332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603806+0000","last_change":"2024-09-14T11:11:57.356179+0000","last_active":"2024-09-14T11:34:30.603806+0000","last_peered":"2024-09-14T11:34:30.603806+0000","last_clean":"2024-09-14T11:34:30.603806+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:34:30.603806+0000","last_undegraded":"2024-09-14T11:34:30.603806+0000","last_fullsized":"2024-09-14T11:34:30.603806+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:20.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":15360,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763760+0000","last_change":"2024-09-14T11:10:13.511537+0000","last_active":"2024-09-14T11:35:13.763760+0000","last_peered":"2024-09-14T11:35:13.763760+0000","last_clean":"2024-09-14T11:35:13.763760+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:35:13.763760+0000","last_undegraded":"2024-09-14T11:35:13.763760+0000","last_fullsized":"2024-09-14T11:35:13.763760+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.866042+0000","last_change":"2024-09-14T11:22:38.557878+0000","last_active":"2024-09-14T11:35:09.866042+0000","last_peered":"2024-09-14T11:35:09.866042+0000","last_clean":"2024-09-14T11:35:09.866042+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:35:09.866042+0000","last_undegraded":"2024-09-14T11:35:09.866042+0000","last_fullsized":"2024-09-14T11:35:09.866042+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:33.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891707+0000","last_change":"2024-09-14T11:12:00.365069+0000","last_active":"2024-09-14T11:34:29.891707+0000","last_peered":"2024-09-14T11:34:29.891707+0000","last_clean":"2024-09-14T11:34:29.891707+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:34:29.891707+0000","last_undegraded":"2024-09-14T11:34:29.891707+0000","last_fullsized":"2024-09-14T11:34:29.891707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.203248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757783+0000","last_change":"2024-09-14T11:11:57.352596+0000","last_active":"2024-09-14T11:34:28.757783+0000","last_peered":"2024-09-14T11:34:28.757783+0000","last_clean":"2024-09-14T11:34:28.757783+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:34:28.757783+0000","last_undegraded":"2024-09-14T11:34:28.757783+0000","last_fullsized":"2024-09-14T11:34:28.757783+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.294796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":11264,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:56.089950+0000","last_change":"2024-09-14T11:10:13.500557+0000","last_active":"2024-09-14T11:34:56.089950+0000","last_peered":"2024-09-14T11:34:56.089950+0000","last_clean":"2024-09-14T11:34:56.089950+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:34:56.089950+0000","last_undegraded":"2024-09-14T11:34:56.089950+0000","last_fullsized":"2024-09-14T11:34:56.089950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.821678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:44.893419+0000","last_change":"2024-09-14T11:22:38.555518+0000","last_active":"2024-09-14T11:34:44.893419+0000","last_peered":"2024-09-14T11:34:44.893419+0000","last_clean":"2024-09-14T11:34:44.893419+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:34:44.893419+0000","last_undegraded":"2024-09-14T11:34:44.893419+0000","last_fullsized":"2024-09-14T11:34:44.893419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:12.998285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'4","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761867+0000","last_change":"2024-09-14T11:12:00.696948+0000","last_active":"2024-09-14T11:34:58.761867+0000","last_peered":"2024-09-14T11:34:58.761867+0000","last_clean":"2024-09-14T11:34:58.761867+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:34:58.761867+0000","last_undegraded":"2024-09-14T11:34:58.761867+0000","last_fullsized":"2024-09-14T11:34:58.761867+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:04.389759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10485760,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":20480,"num_write":14,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.858303+0000","last_change":"2024-09-14T11:11:57.355524+0000","last_active":"2024-09-14T11:34:04.858303+0000","last_peered":"2024-09-14T11:34:04.858303+0000","last_clean":"2024-09-14T11:34:04.858303+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:34:04.858303+0000","last_undegraded":"2024-09-14T11:34:04.858303+0000","last_fullsized":"2024-09-14T11:34:04.858303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:57.603602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5122,"num_write":12,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763690+0000","last_change":"2024-09-14T11:10:13.508809+0000","last_active":"2024-09-14T11:35:13.763690+0000","last_peered":"2024-09-14T11:35:13.763690+0000","last_clean":"2024-09-14T11:35:13.763690+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:35:13.763690+0000","last_undegraded":"2024-09-14T11:35:13.763690+0000","last_fullsized":"2024-09-14T11:35:13.763690+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:45.025002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605928+0000","last_change":"2024-09-14T11:22:38.561594+0000","last_active":"2024-09-14T11:34:45.605928+0000","last_peered":"2024-09-14T11:34:45.605928+0000","last_clean":"2024-09-14T11:34:45.605928+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:34:45.605928+0000","last_undegraded":"2024-09-14T11:34:45.605928+0000","last_fullsized":"2024-09-14T11:34:45.605928+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.203331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600584+0000","last_change":"2024-09-14T11:12:00.696088+0000","last_active":"2024-09-14T11:34:05.600584+0000","last_peered":"2024-09-14T11:34:05.600584+0000","last_clean":"2024-09-14T11:34:05.600584+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:34:05.600584+0000","last_undegraded":"2024-09-14T11:34:05.600584+0000","last_fullsized":"2024-09-14T11:34:05.600584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:28.207806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895433+0000","last_change":"2024-09-14T11:11:57.350368+0000","last_active":"2024-09-14T11:34:54.895433+0000","last_peered":"2024-09-14T11:34:54.895433+0000","last_clean":"2024-09-14T11:34:54.895433+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:34:54.895433+0000","last_undegraded":"2024-09-14T11:34:54.895433+0000","last_fullsized":"2024-09-14T11:34:54.895433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:04.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":13,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609835+0000","last_change":"2024-09-14T11:10:13.511471+0000","last_active":"2024-09-14T11:35:15.609835+0000","last_peered":"2024-09-14T11:35:15.609835+0000","last_clean":"2024-09-14T11:35:15.609835+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:35:15.609835+0000","last_undegraded":"2024-09-14T11:35:15.609835+0000","last_fullsized":"2024-09-14T11:35:15.609835+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:33.776917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:40.605265+0000","last_change":"2024-09-14T11:22:38.562233+0000","last_active":"2024-09-14T11:34:40.605265+0000","last_peered":"2024-09-14T11:34:40.605265+0000","last_clean":"2024-09-14T11:34:40.605265+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:34:40.605265+0000","last_undegraded":"2024-09-14T11:34:40.605265+0000","last_fullsized":"2024-09-14T11:34:40.605265+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:59.647783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868050+0000","last_change":"2024-09-14T11:12:00.373042+0000","last_active":"2024-09-14T11:33:47.868050+0000","last_peered":"2024-09-14T11:33:47.868050+0000","last_clean":"2024-09-14T11:33:47.868050+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:33:47.868050+0000","last_undegraded":"2024-09-14T11:33:47.868050+0000","last_fullsized":"2024-09-14T11:33:47.868050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:42.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751536+0000","last_change":"2024-09-14T11:11:57.347912+0000","last_active":"2024-09-14T11:33:43.751536+0000","last_peered":"2024-09-14T11:33:43.751536+0000","last_clean":"2024-09-14T11:33:43.751536+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:33:43.751536+0000","last_undegraded":"2024-09-14T11:33:43.751536+0000","last_fullsized":"2024-09-14T11:33:43.751536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:27.723340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609807+0000","last_change":"2024-09-14T11:10:13.510098+0000","last_active":"2024-09-14T11:35:15.609807+0000","last_peered":"2024-09-14T11:35:15.609807+0000","last_clean":"2024-09-14T11:35:15.609807+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:35:15.609807+0000","last_undegraded":"2024-09-14T11:35:15.609807+0000","last_fullsized":"2024-09-14T11:35:15.609807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:46.783877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763109+0000","last_change":"2024-09-14T11:22:38.558736+0000","last_active":"2024-09-14T11:35:08.763109+0000","last_peered":"2024-09-14T11:35:08.763109+0000","last_clean":"2024-09-14T11:35:08.763109+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:35:08.763109+0000","last_undegraded":"2024-09-14T11:35:08.763109+0000","last_fullsized":"2024-09-14T11:35:08.763109+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:58.587973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885772+0000","last_change":"2024-09-14T11:12:00.372932+0000","last_active":"2024-09-14T11:33:44.885772+0000","last_peered":"2024-09-14T11:33:44.885772+0000","last_clean":"2024-09-14T11:33:44.885772+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:33:44.885772+0000","last_undegraded":"2024-09-14T11:33:44.885772+0000","last_fullsized":"2024-09-14T11:33:44.885772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:01.464328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885933+0000","last_change":"2024-09-14T11:11:57.351572+0000","last_active":"2024-09-14T11:33:44.885933+0000","last_peered":"2024-09-14T11:33:44.885933+0000","last_clean":"2024-09-14T11:33:44.885933+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:33:44.885933+0000","last_undegraded":"2024-09-14T11:33:44.885933+0000","last_fullsized":"2024-09-14T11:33:44.885933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:43.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897732+0000","last_change":"2024-09-14T11:10:13.507035+0000","last_active":"2024-09-14T11:35:14.897732+0000","last_peered":"2024-09-14T11:35:14.897732+0000","last_clean":"2024-09-14T11:35:14.897732+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:35:14.897732+0000","last_undegraded":"2024-09-14T11:35:14.897732+0000","last_fullsized":"2024-09-14T11:35:14.897732+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.962765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897474+0000","last_change":"2024-09-14T11:22:38.558217+0000","last_active":"2024-09-14T11:35:09.897474+0000","last_peered":"2024-09-14T11:35:09.897474+0000","last_clean":"2024-09-14T11:35:09.897474+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:35:09.897474+0000","last_undegraded":"2024-09-14T11:35:09.897474+0000","last_fullsized":"2024-09-14T11:35:09.897474+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:16.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891260+0000","last_change":"2024-09-14T11:12:00.366839+0000","last_active":"2024-09-14T11:34:29.891260+0000","last_peered":"2024-09-14T11:34:29.891260+0000","last_clean":"2024-09-14T11:34:29.891260+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:34:29.891260+0000","last_undegraded":"2024-09-14T11:34:29.891260+0000","last_fullsized":"2024-09-14T11:34:29.891260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:28.093713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891654+0000","last_change":"2024-09-14T11:11:57.355185+0000","last_active":"2024-09-14T11:34:29.891654+0000","last_peered":"2024-09-14T11:34:29.891654+0000","last_clean":"2024-09-14T11:34:29.891654+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:34:29.891654+0000","last_undegraded":"2024-09-14T11:34:29.891654+0000","last_fullsized":"2024-09-14T11:34:29.891654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.881561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758163+0000","last_change":"2024-09-14T11:10:13.507975+0000","last_active":"2024-09-14T11:34:33.758163+0000","last_peered":"2024-09-14T11:34:33.758163+0000","last_clean":"2024-09-14T11:34:33.758163+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:34:33.758163+0000","last_undegraded":"2024-09-14T11:34:33.758163+0000","last_fullsized":"2024-09-14T11:34:33.758163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:21.041245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897517+0000","last_change":"2024-09-14T11:22:38.561164+0000","last_active":"2024-09-14T11:35:09.897517+0000","last_peered":"2024-09-14T11:35:09.897517+0000","last_clean":"2024-09-14T11:35:09.897517+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:35:09.897517+0000","last_undegraded":"2024-09-14T11:35:09.897517+0000","last_fullsized":"2024-09-14T11:35:09.897517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:43.901705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880477+0000","last_change":"2024-09-14T11:12:43.314131+0000","last_active":"2024-09-14T11:35:12.880477+0000","last_peered":"2024-09-14T11:35:12.880477+0000","last_clean":"2024-09-14T11:35:12.880477+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:35:12.880477+0000","last_undegraded":"2024-09-14T11:35:12.880477+0000","last_fullsized":"2024-09-14T11:35:12.880477+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:03.892987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757433+0000","last_change":"2024-09-14T11:11:57.358103+0000","last_active":"2024-09-14T11:34:28.757433+0000","last_peered":"2024-09-14T11:34:28.757433+0000","last_clean":"2024-09-14T11:34:28.757433+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:34:28.757433+0000","last_undegraded":"2024-09-14T11:34:28.757433+0000","last_fullsized":"2024-09-14T11:34:28.757433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:14.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11534336,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":17,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.757100+0000","last_change":"2024-09-14T11:10:13.501269+0000","last_active":"2024-09-14T11:34:23.757100+0000","last_peered":"2024-09-14T11:34:23.757100+0000","last_clean":"2024-09-14T11:34:23.757100+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:34:23.757100+0000","last_undegraded":"2024-09-14T11:34:23.757100+0000","last_fullsized":"2024-09-14T11:34:23.757100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:36.721868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:18.756557+0000","last_change":"2024-09-14T11:22:38.559223+0000","last_active":"2024-09-14T11:34:18.756557+0000","last_peered":"2024-09-14T11:34:18.756557+0000","last_clean":"2024-09-14T11:34:18.756557+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:34:18.756557+0000","last_undegraded":"2024-09-14T11:34:18.756557+0000","last_fullsized":"2024-09-14T11:34:18.756557+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:18.099181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598125+0000","last_change":"2024-09-14T11:12:00.695830+0000","last_active":"2024-09-14T11:33:45.598125+0000","last_peered":"2024-09-14T11:33:45.598125+0000","last_clean":"2024-09-14T11:33:45.598125+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:33:45.598125+0000","last_undegraded":"2024-09-14T11:33:45.598125+0000","last_fullsized":"2024-09-14T11:33:45.598125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:08.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881154+0000","last_change":"2024-09-14T11:11:57.353227+0000","last_active":"2024-09-14T11:35:17.881154+0000","last_peered":"2024-09-14T11:35:17.881154+0000","last_clean":"2024-09-14T11:35:17.881154+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:35:17.881154+0000","last_undegraded":"2024-09-14T11:35:17.881154+0000","last_fullsized":"2024-09-14T11:35:17.881154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:08.822820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.845469+0000","last_change":"2024-09-14T11:10:13.507446+0000","last_active":"2024-09-14T11:34:59.845469+0000","last_peered":"2024-09-14T11:34:59.845469+0000","last_clean":"2024-09-14T11:34:59.845469+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:34:59.845469+0000","last_undegraded":"2024-09-14T11:34:59.845469+0000","last_fullsized":"2024-09-14T11:34:59.845469+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:37.515685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.859664+0000","last_change":"2024-09-14T11:22:38.547820+0000","last_active":"2024-09-14T11:34:19.859664+0000","last_peered":"2024-09-14T11:34:19.859664+0000","last_clean":"2024-09-14T11:34:19.859664+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:34:19.859664+0000","last_undegraded":"2024-09-14T11:34:19.859664+0000","last_fullsized":"2024-09-14T11:34:19.859664+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.390529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.611000+0000","last_change":"2024-09-14T11:12:00.697008+0000","last_active":"2024-09-14T11:35:25.611000+0000","last_peered":"2024-09-14T11:35:25.611000+0000","last_clean":"2024-09-14T11:35:25.611000+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:35:25.611000+0000","last_undegraded":"2024-09-14T11:35:25.611000+0000","last_fullsized":"2024-09-14T11:35:25.611000+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:03.052127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885350+0000","last_change":"2024-09-14T11:11:57.349579+0000","last_active":"2024-09-14T11:33:44.885350+0000","last_peered":"2024-09-14T11:33:44.885350+0000","last_clean":"2024-09-14T11:33:44.885350+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:33:44.885350+0000","last_undegraded":"2024-09-14T11:33:44.885350+0000","last_fullsized":"2024-09-14T11:33:44.885350+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:26.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":19456,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:25.603094+0000","last_change":"2024-09-14T11:10:13.510036+0000","last_active":"2024-09-14T11:34:25.603094+0000","last_peered":"2024-09-14T11:34:25.603094+0000","last_clean":"2024-09-14T11:34:25.603094+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:34:25.603094+0000","last_undegraded":"2024-09-14T11:34:25.603094+0000","last_fullsized":"2024-09-14T11:34:25.603094+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:48.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.889866+0000","last_change":"2024-09-14T11:22:38.557418+0000","last_active":"2024-09-14T11:34:19.889866+0000","last_peered":"2024-09-14T11:34:19.889866+0000","last_clean":"2024-09-14T11:34:19.889866+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:34:19.889866+0000","last_undegraded":"2024-09-14T11:34:19.889866+0000","last_fullsized":"2024-09-14T11:34:19.889866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:24.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598151+0000","last_change":"2024-09-14T11:12:00.697792+0000","last_active":"2024-09-14T11:33:45.598151+0000","last_peered":"2024-09-14T11:33:45.598151+0000","last_clean":"2024-09-14T11:33:45.598151+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:33:45.598151+0000","last_undegraded":"2024-09-14T11:33:45.598151+0000","last_fullsized":"2024-09-14T11:33:45.598151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:04.239911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.855371+0000","last_change":"2024-09-14T11:11:57.353323+0000","last_active":"2024-09-14T11:33:44.855371+0000","last_peered":"2024-09-14T11:33:44.855371+0000","last_clean":"2024-09-14T11:33:44.855371+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:33:44.855371+0000","last_undegraded":"2024-09-14T11:33:44.855371+0000","last_fullsized":"2024-09-14T11:33:44.855371+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:15.814681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.860387+0000","last_change":"2024-09-14T11:10:13.499745+0000","last_active":"2024-09-14T11:34:24.860387+0000","last_peered":"2024-09-14T11:34:24.860387+0000","last_clean":"2024-09-14T11:34:24.860387+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:34:24.860387+0000","last_undegraded":"2024-09-14T11:34:24.860387+0000","last_fullsized":"2024-09-14T11:34:24.860387+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:58.521220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:17.872355+0000","last_change":"2024-09-14T11:22:38.556244+0000","last_active":"2024-09-14T11:34:17.872355+0000","last_peered":"2024-09-14T11:34:17.872355+0000","last_clean":"2024-09-14T11:34:17.872355+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:34:17.872355+0000","last_undegraded":"2024-09-14T11:34:17.872355+0000","last_fullsized":"2024-09-14T11:34:17.872355+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:12.131431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886102+0000","last_change":"2024-09-14T11:12:00.371092+0000","last_active":"2024-09-14T11:33:44.886102+0000","last_peered":"2024-09-14T11:33:44.886102+0000","last_clean":"2024-09-14T11:33:44.886102+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:33:44.886102+0000","last_undegraded":"2024-09-14T11:33:44.886102+0000","last_fullsized":"2024-09-14T11:33:44.886102+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:07.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751653+0000","last_change":"2024-09-14T11:11:57.355672+0000","last_active":"2024-09-14T11:33:43.751653+0000","last_peered":"2024-09-14T11:33:43.751653+0000","last_clean":"2024-09-14T11:33:43.751653+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:33:43.751653+0000","last_undegraded":"2024-09-14T11:33:43.751653+0000","last_fullsized":"2024-09-14T11:33:43.751653+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:54.970745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884593+0000","last_change":"2024-09-14T11:10:13.509666+0000","last_active":"2024-09-14T11:33:39.884593+0000","last_peered":"2024-09-14T11:33:39.884593+0000","last_clean":"2024-09-14T11:33:39.884593+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:33:39.884593+0000","last_undegraded":"2024-09-14T11:33:39.884593+0000","last_fullsized":"2024-09-14T11:33:39.884593+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.839337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.606019+0000","last_change":"2024-09-14T11:22:38.560634+0000","last_active":"2024-09-14T11:34:45.606019+0000","last_peered":"2024-09-14T11:34:45.606019+0000","last_clean":"2024-09-14T11:34:45.606019+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:34:45.606019+0000","last_undegraded":"2024-09-14T11:34:45.606019+0000","last_fullsized":"2024-09-14T11:34:45.606019+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:00.155051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765049+0000","last_change":"2024-09-14T11:12:00.370168+0000","last_active":"2024-09-14T11:35:23.765049+0000","last_peered":"2024-09-14T11:35:23.765049+0000","last_clean":"2024-09-14T11:35:23.765049+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:35:23.765049+0000","last_undegraded":"2024-09-14T11:35:23.765049+0000","last_fullsized":"2024-09-14T11:35:23.765049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:48.258006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898754+0000","last_change":"2024-09-14T11:11:57.349362+0000","last_active":"2024-09-14T11:35:19.898754+0000","last_peered":"2024-09-14T11:35:19.898754+0000","last_clean":"2024-09-14T11:35:19.898754+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:35:19.898754+0000","last_undegraded":"2024-09-14T11:35:19.898754+0000","last_fullsized":"2024-09-14T11:35:19.898754+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.873771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883866+0000","last_change":"2024-09-14T11:10:13.508867+0000","last_active":"2024-09-14T11:33:34.883866+0000","last_peered":"2024-09-14T11:33:34.883866+0000","last_clean":"2024-09-14T11:33:34.883866+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:33:34.883866+0000","last_undegraded":"2024-09-14T11:33:34.883866+0000","last_fullsized":"2024-09-14T11:33:34.883866+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:25.594692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759854+0000","last_change":"2024-09-14T11:22:38.562421+0000","last_active":"2024-09-14T11:34:43.759854+0000","last_peered":"2024-09-14T11:34:43.759854+0000","last_clean":"2024-09-14T11:34:43.759854+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:34:43.759854+0000","last_undegraded":"2024-09-14T11:34:43.759854+0000","last_fullsized":"2024-09-14T11:34:43.759854+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:19.932638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765008+0000","last_change":"2024-09-14T11:12:00.366781+0000","last_active":"2024-09-14T11:35:23.765008+0000","last_peered":"2024-09-14T11:35:23.765008+0000","last_clean":"2024-09-14T11:35:23.765008+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:35:23.765008+0000","last_undegraded":"2024-09-14T11:35:23.765008+0000","last_fullsized":"2024-09-14T11:35:23.765008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.257185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610401+0000","last_change":"2024-09-14T11:11:57.355400+0000","last_active":"2024-09-14T11:35:20.610401+0000","last_peered":"2024-09-14T11:35:20.610401+0000","last_clean":"2024-09-14T11:35:20.610401+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:35:20.610401+0000","last_undegraded":"2024-09-14T11:35:20.610401+0000","last_fullsized":"2024-09-14T11:35:20.610401+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:52.064528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:21.171911+0000","last_change":"2024-09-14T11:10:13.508002+0000","last_active":"2024-09-14T11:34:21.171911+0000","last_peered":"2024-09-14T11:34:21.171911+0000","last_clean":"2024-09-14T11:34:21.171911+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:34:21.171911+0000","last_undegraded":"2024-09-14T11:34:21.171911+0000","last_fullsized":"2024-09-14T11:34:21.171911+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:32.599364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756775+0000","last_change":"2024-09-14T11:22:38.560824+0000","last_active":"2024-09-14T11:34:23.756775+0000","last_peered":"2024-09-14T11:34:23.756775+0000","last_clean":"2024-09-14T11:34:23.756775+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:34:23.756775+0000","last_undegraded":"2024-09-14T11:34:23.756775+0000","last_fullsized":"2024-09-14T11:34:23.756775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.610355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610448+0000","last_change":"2024-09-14T11:12:00.371863+0000","last_active":"2024-09-14T11:35:20.610448+0000","last_peered":"2024-09-14T11:35:20.610448+0000","last_clean":"2024-09-14T11:35:20.610448+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:35:20.610448+0000","last_undegraded":"2024-09-14T11:35:20.610448+0000","last_fullsized":"2024-09-14T11:35:20.610448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.086012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898372+0000","last_change":"2024-09-14T11:11:57.355053+0000","last_active":"2024-09-14T11:35:19.898372+0000","last_peered":"2024-09-14T11:35:19.898372+0000","last_clean":"2024-09-14T11:35:19.898372+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:35:19.898372+0000","last_undegraded":"2024-09-14T11:35:19.898372+0000","last_fullsized":"2024-09-14T11:35:19.898372+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.975373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884391+0000","last_change":"2024-09-14T11:10:13.509195+0000","last_active":"2024-09-14T11:33:34.884391+0000","last_peered":"2024-09-14T11:33:34.884391+0000","last_clean":"2024-09-14T11:33:34.884391+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:33:34.884391+0000","last_undegraded":"2024-09-14T11:33:34.884391+0000","last_fullsized":"2024-09-14T11:33:34.884391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:27.434209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605996+0000","last_change":"2024-09-14T11:22:38.549656+0000","last_active":"2024-09-14T11:34:45.605996+0000","last_peered":"2024-09-14T11:34:45.605996+0000","last_clean":"2024-09-14T11:34:45.605996+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:34:45.605996+0000","last_undegraded":"2024-09-14T11:34:45.605996+0000","last_fullsized":"2024-09-14T11:34:45.605996+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.182205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898360+0000","last_change":"2024-09-14T11:12:00.368721+0000","last_active":"2024-09-14T11:35:19.898360+0000","last_peered":"2024-09-14T11:35:19.898360+0000","last_clean":"2024-09-14T11:35:19.898360+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:35:19.898360+0000","last_undegraded":"2024-09-14T11:35:19.898360+0000","last_fullsized":"2024-09-14T11:35:19.898360+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:12.328655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881140+0000","last_change":"2024-09-14T11:11:57.355041+0000","last_active":"2024-09-14T11:35:17.881140+0000","last_peered":"2024-09-14T11:35:17.881140+0000","last_clean":"2024-09-14T11:35:17.881140+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:35:17.881140+0000","last_undegraded":"2024-09-14T11:35:17.881140+0000","last_fullsized":"2024-09-14T11:35:17.881140+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:42.390324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596445+0000","last_change":"2024-09-14T11:10:13.507056+0000","last_active":"2024-09-14T11:33:35.596445+0000","last_peered":"2024-09-14T11:33:35.596445+0000","last_clean":"2024-09-14T11:33:35.596445+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:33:35.596445+0000","last_undegraded":"2024-09-14T11:33:35.596445+0000","last_fullsized":"2024-09-14T11:33:35.596445+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:01.368348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.854245+0000","last_change":"2024-09-14T11:22:38.547683+0000","last_active":"2024-09-14T11:33:34.854245+0000","last_peered":"2024-09-14T11:33:34.854245+0000","last_clean":"2024-09-14T11:33:34.854245+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:33:34.854245+0000","last_undegraded":"2024-09-14T11:33:34.854245+0000","last_fullsized":"2024-09-14T11:33:34.854245+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:09.212310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603840+0000","last_change":"2024-09-14T11:12:00.369322+0000","last_active":"2024-09-14T11:34:30.603840+0000","last_peered":"2024-09-14T11:34:30.603840+0000","last_clean":"2024-09-14T11:34:30.603840+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:34:30.603840+0000","last_undegraded":"2024-09-14T11:34:30.603840+0000","last_fullsized":"2024-09-14T11:34:30.603840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:38.196351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891188+0000","last_change":"2024-09-14T11:11:57.357216+0000","last_active":"2024-09-14T11:34:29.891188+0000","last_peered":"2024-09-14T11:34:29.891188+0000","last_clean":"2024-09-14T11:34:29.891188+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:34:29.891188+0000","last_undegraded":"2024-09-14T11:34:29.891188+0000","last_fullsized":"2024-09-14T11:34:29.891188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:05.608393+0000","last_change":"2024-09-14T11:10:13.512001+0000","last_active":"2024-09-14T11:35:05.608393+0000","last_peered":"2024-09-14T11:35:05.608393+0000","last_clean":"2024-09-14T11:35:05.608393+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:35:05.608393+0000","last_undegraded":"2024-09-14T11:35:05.608393+0000","last_fullsized":"2024-09-14T11:35:05.608393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:22.364398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886662+0000","last_change":"2024-09-14T11:22:38.560005+0000","last_active":"2024-09-14T11:33:54.886662+0000","last_peered":"2024-09-14T11:33:54.886662+0000","last_clean":"2024-09-14T11:33:54.886662+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:33:54.886662+0000","last_undegraded":"2024-09-14T11:33:54.886662+0000","last_fullsized":"2024-09-14T11:33:54.886662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:06.734073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603797+0000","last_change":"2024-09-14T11:12:00.370638+0000","last_active":"2024-09-14T11:34:30.603797+0000","last_peered":"2024-09-14T11:34:30.603797+0000","last_clean":"2024-09-14T11:34:30.603797+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:34:30.603797+0000","last_undegraded":"2024-09-14T11:34:30.603797+0000","last_fullsized":"2024-09-14T11:34:30.603797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:40.237389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'1","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861175+0000","last_change":"2024-09-14T11:11:57.358150+0000","last_active":"2024-09-14T11:34:29.861175+0000","last_peered":"2024-09-14T11:34:29.861175+0000","last_clean":"2024-09-14T11:34:29.861175+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:34:29.861175+0000","last_undegraded":"2024-09-14T11:34:29.861175+0000","last_fullsized":"2024-09-14T11:34:29.861175+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:33.857222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":432,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.878115+0000","last_change":"2024-09-14T11:10:13.508473+0000","last_active":"2024-09-14T11:34:57.878115+0000","last_peered":"2024-09-14T11:34:57.878115+0000","last_clean":"2024-09-14T11:34:57.878115+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:34:57.878115+0000","last_undegraded":"2024-09-14T11:34:57.878115+0000","last_fullsized":"2024-09-14T11:34:57.878115+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:51.939853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883625+0000","last_change":"2024-09-14T11:22:38.555264+0000","last_active":"2024-09-14T11:33:29.883625+0000","last_peered":"2024-09-14T11:33:29.883625+0000","last_clean":"2024-09-14T11:33:29.883625+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:33:29.883625+0000","last_undegraded":"2024-09-14T11:33:29.883625+0000","last_fullsized":"2024-09-14T11:33:29.883625+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:10.041270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:38.759243+0000","last_change":"2024-09-14T11:12:00.696985+0000","last_active":"2024-09-14T11:34:38.759243+0000","last_peered":"2024-09-14T11:34:38.759243+0000","last_clean":"2024-09-14T11:34:38.759243+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:34:38.759243+0000","last_undegraded":"2024-09-14T11:34:38.759243+0000","last_fullsized":"2024-09-14T11:34:38.759243+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:16.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":9216,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757502+0000","last_change":"2024-09-14T11:11:57.350049+0000","last_active":"2024-09-14T11:34:28.757502+0000","last_peered":"2024-09-14T11:34:28.757502+0000","last_clean":"2024-09-14T11:34:28.757502+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:34:28.757502+0000","last_undegraded":"2024-09-14T11:34:28.757502+0000","last_fullsized":"2024-09-14T11:34:28.757502+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:36.573356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895573+0000","last_change":"2024-09-14T11:10:13.511805+0000","last_active":"2024-09-14T11:34:59.895573+0000","last_peered":"2024-09-14T11:34:59.895573+0000","last_clean":"2024-09-14T11:34:59.895573+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:34:59.895573+0000","last_undegraded":"2024-09-14T11:34:59.895573+0000","last_fullsized":"2024-09-14T11:34:59.895573+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:47.389561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883080+0000","last_change":"2024-09-14T11:22:38.552793+0000","last_active":"2024-09-14T11:33:29.883080+0000","last_peered":"2024-09-14T11:33:29.883080+0000","last_clean":"2024-09-14T11:33:29.883080+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:33:29.883080+0000","last_undegraded":"2024-09-14T11:33:29.883080+0000","last_fullsized":"2024-09-14T11:33:29.883080+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:40.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'1","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603853+0000","last_change":"2024-09-14T11:12:00.371999+0000","last_active":"2024-09-14T11:34:30.603853+0000","last_peered":"2024-09-14T11:34:30.603853+0000","last_clean":"2024-09-14T11:34:30.603853+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:34:30.603853+0000","last_undegraded":"2024-09-14T11:34:30.603853+0000","last_fullsized":"2024-09-14T11:34:30.603853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:57.798523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'4","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758551+0000","last_change":"2024-09-14T11:11:57.351527+0000","last_active":"2024-09-14T11:34:33.758551+0000","last_peered":"2024-09-14T11:34:33.758551+0000","last_clean":"2024-09-14T11:34:33.758551+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:34:33.758551+0000","last_undegraded":"2024-09-14T11:34:33.758551+0000","last_fullsized":"2024-09-14T11:34:33.758551+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:16.871687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4908529,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":5818,"num_write":9,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.864945+0000","last_change":"2024-09-14T11:10:13.506926+0000","last_active":"2024-09-14T11:34:59.864945+0000","last_peered":"2024-09-14T11:34:59.864945+0000","last_clean":"2024-09-14T11:34:59.864945+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:34:59.864945+0000","last_undegraded":"2024-09-14T11:34:59.864945+0000","last_fullsized":"2024-09-14T11:34:59.864945+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:19.274286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:55.599222+0000","last_change":"2024-09-14T11:22:38.560343+0000","last_active":"2024-09-14T11:33:55.599222+0000","last_peered":"2024-09-14T11:33:55.599222+0000","last_clean":"2024-09-14T11:33:55.599222+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:33:55.599222+0000","last_undegraded":"2024-09-14T11:33:55.599222+0000","last_fullsized":"2024-09-14T11:33:55.599222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:29.881634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.885153+0000","last_change":"2024-09-14T11:12:00.369339+0000","last_active":"2024-09-14T11:33:39.885153+0000","last_peered":"2024-09-14T11:33:39.885153+0000","last_clean":"2024-09-14T11:33:39.885153+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:33:39.885153+0000","last_undegraded":"2024-09-14T11:33:39.885153+0000","last_fullsized":"2024-09-14T11:33:39.885153+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:39.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750762+0000","last_change":"2024-09-14T11:11:57.357619+0000","last_active":"2024-09-14T11:33:38.750762+0000","last_peered":"2024-09-14T11:33:38.750762+0000","last_clean":"2024-09-14T11:33:38.750762+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:33:38.750762+0000","last_undegraded":"2024-09-14T11:33:38.750762+0000","last_fullsized":"2024-09-14T11:33:38.750762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:38.476508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761794+0000","last_change":"2024-09-14T11:10:13.505959+0000","last_active":"2024-09-14T11:34:58.761794+0000","last_peered":"2024-09-14T11:34:58.761794+0000","last_clean":"2024-09-14T11:34:58.761794+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:34:58.761794+0000","last_undegraded":"2024-09-14T11:34:58.761794+0000","last_fullsized":"2024-09-14T11:34:58.761794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:13.476423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886743+0000","last_change":"2024-09-14T11:22:38.558664+0000","last_active":"2024-09-14T11:33:54.886743+0000","last_peered":"2024-09-14T11:33:54.886743+0000","last_clean":"2024-09-14T11:33:54.886743+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:33:54.886743+0000","last_undegraded":"2024-09-14T11:33:54.886743+0000","last_fullsized":"2024-09-14T11:33:54.886743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:30.238036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884482+0000","last_change":"2024-09-14T11:12:00.694483+0000","last_active":"2024-09-14T11:33:39.884482+0000","last_peered":"2024-09-14T11:33:39.884482+0000","last_clean":"2024-09-14T11:33:39.884482+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:33:39.884482+0000","last_undegraded":"2024-09-14T11:33:39.884482+0000","last_fullsized":"2024-09-14T11:33:39.884482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:06.644097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.863718+0000","last_change":"2024-09-14T11:11:57.352310+0000","last_active":"2024-09-14T11:33:38.863718+0000","last_peered":"2024-09-14T11:33:38.863718+0000","last_clean":"2024-09-14T11:33:38.863718+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:33:38.863718+0000","last_undegraded":"2024-09-14T11:33:38.863718+0000","last_fullsized":"2024-09-14T11:33:38.863718+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:08.817373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:09.888479+0000","last_change":"2024-09-14T11:10:13.511603+0000","last_active":"2024-09-14T11:34:09.888479+0000","last_peered":"2024-09-14T11:34:09.888479+0000","last_clean":"2024-09-14T11:34:09.888479+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:34:09.888479+0000","last_undegraded":"2024-09-14T11:34:09.888479+0000","last_fullsized":"2024-09-14T11:34:09.888479+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.593455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886685+0000","last_change":"2024-09-14T11:22:38.557834+0000","last_active":"2024-09-14T11:33:54.886685+0000","last_peered":"2024-09-14T11:33:54.886685+0000","last_clean":"2024-09-14T11:33:54.886685+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:33:54.886685+0000","last_undegraded":"2024-09-14T11:33:54.886685+0000","last_fullsized":"2024-09-14T11:33:54.886685+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:44.232152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758487+0000","last_change":"2024-09-14T11:12:00.368877+0000","last_active":"2024-09-14T11:34:33.758487+0000","last_peered":"2024-09-14T11:34:33.758487+0000","last_clean":"2024-09-14T11:34:33.758487+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:34:33.758487+0000","last_undegraded":"2024-09-14T11:34:33.758487+0000","last_fullsized":"2024-09-14T11:34:33.758487+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:04.138036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751573+0000","last_change":"2024-09-14T11:11:57.350615+0000","last_active":"2024-09-14T11:33:43.751573+0000","last_peered":"2024-09-14T11:33:43.751573+0000","last_clean":"2024-09-14T11:33:43.751573+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:33:43.751573+0000","last_undegraded":"2024-09-14T11:33:43.751573+0000","last_fullsized":"2024-09-14T11:33:43.751573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:57.116215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600496+0000","last_change":"2024-09-14T11:10:13.505366+0000","last_active":"2024-09-14T11:34:05.600496+0000","last_peered":"2024-09-14T11:34:05.600496+0000","last_clean":"2024-09-14T11:34:05.600496+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:34:05.600496+0000","last_undegraded":"2024-09-14T11:34:05.600496+0000","last_fullsized":"2024-09-14T11:34:05.600496+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:26.758270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752949+0000","last_change":"2024-09-14T11:22:38.560810+0000","last_active":"2024-09-14T11:33:53.752949+0000","last_peered":"2024-09-14T11:33:53.752949+0000","last_clean":"2024-09-14T11:33:53.752949+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:33:53.752949+0000","last_undegraded":"2024-09-14T11:33:53.752949+0000","last_fullsized":"2024-09-14T11:33:53.752949+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:04.353747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'7","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884553+0000","last_change":"2024-09-14T11:12:00.372935+0000","last_active":"2024-09-14T11:33:39.884553+0000","last_peered":"2024-09-14T11:33:39.884553+0000","last_clean":"2024-09-14T11:33:39.884553+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:33:39.884553+0000","last_undegraded":"2024-09-14T11:33:39.884553+0000","last_fullsized":"2024-09-14T11:33:39.884553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:15.968213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":7,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891684+0000","last_change":"2024-09-14T11:11:57.352921+0000","last_active":"2024-09-14T11:34:29.891684+0000","last_peered":"2024-09-14T11:34:29.891684+0000","last_clean":"2024-09-14T11:34:29.891684+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:34:29.891684+0000","last_undegraded":"2024-09-14T11:34:29.891684+0000","last_fullsized":"2024-09-14T11:34:29.891684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:52.542794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888212+0000","last_change":"2024-09-14T11:10:13.506698+0000","last_active":"2024-09-14T11:34:04.888212+0000","last_peered":"2024-09-14T11:34:04.888212+0000","last_clean":"2024-09-14T11:34:04.888212+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:34:04.888212+0000","last_undegraded":"2024-09-14T11:34:04.888212+0000","last_fullsized":"2024-09-14T11:34:04.888212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:50.197138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897410+0000","last_change":"2024-09-14T11:22:38.557689+0000","last_active":"2024-09-14T11:35:09.897410+0000","last_peered":"2024-09-14T11:35:09.897410+0000","last_clean":"2024-09-14T11:35:09.897410+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:35:09.897410+0000","last_undegraded":"2024-09-14T11:35:09.897410+0000","last_fullsized":"2024-09-14T11:35:09.897410+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:32.821928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762555+0000","last_change":"2024-09-14T11:12:00.367857+0000","last_active":"2024-09-14T11:35:03.762555+0000","last_peered":"2024-09-14T11:35:03.762555+0000","last_clean":"2024-09-14T11:35:03.762555+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:35:03.762555+0000","last_undegraded":"2024-09-14T11:35:03.762555+0000","last_fullsized":"2024-09-14T11:35:03.762555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:30.330125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895154+0000","last_change":"2024-09-14T11:11:57.350701+0000","last_active":"2024-09-14T11:34:54.895154+0000","last_peered":"2024-09-14T11:34:54.895154+0000","last_clean":"2024-09-14T11:34:54.895154+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:34:54.895154+0000","last_undegraded":"2024-09-14T11:34:54.895154+0000","last_fullsized":"2024-09-14T11:34:54.895154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:03.947483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:03.754212+0000","last_change":"2024-09-14T11:10:13.507832+0000","last_active":"2024-09-14T11:34:03.754212+0000","last_peered":"2024-09-14T11:34:03.754212+0000","last_clean":"2024-09-14T11:34:03.754212+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:34:03.754212+0000","last_undegraded":"2024-09-14T11:34:03.754212+0000","last_fullsized":"2024-09-14T11:34:03.754212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.145883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879667+0000","last_change":"2024-09-14T11:22:38.559774+0000","last_active":"2024-09-14T11:35:07.879667+0000","last_peered":"2024-09-14T11:35:07.879667+0000","last_clean":"2024-09-14T11:35:07.879667+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:35:07.879667+0000","last_undegraded":"2024-09-14T11:35:07.879667+0000","last_fullsized":"2024-09-14T11:35:07.879667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:14.753350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761826+0000","last_change":"2024-09-14T11:12:00.695654+0000","last_active":"2024-09-14T11:34:58.761826+0000","last_peered":"2024-09-14T11:34:58.761826+0000","last_clean":"2024-09-14T11:34:58.761826+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:34:58.761826+0000","last_undegraded":"2024-09-14T11:34:58.761826+0000","last_fullsized":"2024-09-14T11:34:58.761826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:44.109481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.864972+0000","last_change":"2024-09-14T11:11:57.357243+0000","last_active":"2024-09-14T11:34:59.864972+0000","last_peered":"2024-09-14T11:34:59.864972+0000","last_clean":"2024-09-14T11:34:59.864972+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:34:59.864972+0000","last_undegraded":"2024-09-14T11:34:59.864972+0000","last_fullsized":"2024-09-14T11:34:59.864972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:58.472930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888302+0000","last_change":"2024-09-14T11:10:13.507529+0000","last_active":"2024-09-14T11:34:04.888302+0000","last_peered":"2024-09-14T11:34:04.888302+0000","last_clean":"2024-09-14T11:34:04.888302+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:34:04.888302+0000","last_undegraded":"2024-09-14T11:34:04.888302+0000","last_fullsized":"2024-09-14T11:34:04.888302+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:46.910286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T11:22:38.559360+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:07.017001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884637+0000","last_change":"2024-09-14T11:12:00.697739+0000","last_active":"2024-09-14T11:33:39.884637+0000","last_peered":"2024-09-14T11:33:39.884637+0000","last_clean":"2024-09-14T11:33:39.884637+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:33:39.884637+0000","last_undegraded":"2024-09-14T11:33:39.884637+0000","last_fullsized":"2024-09-14T11:33:39.884637+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:56.512716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'1","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:37.866403+0000","last_change":"2024-09-14T11:11:57.356515+0000","last_active":"2024-09-14T11:33:37.866403+0000","last_peered":"2024-09-14T11:33:37.866403+0000","last_clean":"2024-09-14T11:33:37.866403+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:33:37.866403+0000","last_undegraded":"2024-09-14T11:33:37.866403+0000","last_fullsized":"2024-09-14T11:33:37.866403+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.310464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898940+0000","last_change":"2024-09-14T11:10:13.510430+0000","last_active":"2024-09-14T11:35:19.898940+0000","last_peered":"2024-09-14T11:35:19.898940+0000","last_clean":"2024-09-14T11:35:19.898940+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:35:19.898940+0000","last_undegraded":"2024-09-14T11:35:19.898940+0000","last_fullsized":"2024-09-14T11:35:19.898940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:05.548094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897368+0000","last_change":"2024-09-14T11:22:38.560831+0000","last_active":"2024-09-14T11:35:09.897368+0000","last_peered":"2024-09-14T11:35:09.897368+0000","last_clean":"2024-09-14T11:35:09.897368+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:35:09.897368+0000","last_undegraded":"2024-09-14T11:35:09.897368+0000","last_fullsized":"2024-09-14T11:35:09.897368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:48.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.885392+0000","last_change":"2024-09-14T11:12:00.368324+0000","last_active":"2024-09-14T11:33:39.885392+0000","last_peered":"2024-09-14T11:33:39.885392+0000","last_clean":"2024-09-14T11:33:39.885392+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:33:39.885392+0000","last_undegraded":"2024-09-14T11:33:39.885392+0000","last_fullsized":"2024-09-14T11:33:39.885392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:52.228855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884649+0000","last_change":"2024-09-14T11:11:57.353076+0000","last_active":"2024-09-14T11:33:39.884649+0000","last_peered":"2024-09-14T11:33:39.884649+0000","last_clean":"2024-09-14T11:33:39.884649+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:33:39.884649+0000","last_undegraded":"2024-09-14T11:33:39.884649+0000","last_fullsized":"2024-09-14T11:33:39.884649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:23.953839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763621+0000","last_change":"2024-09-14T11:10:13.503079+0000","last_active":"2024-09-14T11:35:13.763621+0000","last_peered":"2024-09-14T11:35:13.763621+0000","last_clean":"2024-09-14T11:35:13.763621+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:35:13.763621+0000","last_undegraded":"2024-09-14T11:35:13.763621+0000","last_fullsized":"2024-09-14T11:35:13.763621+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.214686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.853503+0000","last_change":"2024-09-14T11:22:38.555155+0000","last_active":"2024-09-14T11:33:29.853503+0000","last_peered":"2024-09-14T11:33:29.853503+0000","last_clean":"2024-09-14T11:33:29.853503+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:33:29.853503+0000","last_undegraded":"2024-09-14T11:33:29.853503+0000","last_fullsized":"2024-09-14T11:33:29.853503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:42.625623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'7","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761696+0000","last_change":"2024-09-14T11:12:00.367897+0000","last_active":"2024-09-14T11:34:58.761696+0000","last_peered":"2024-09-14T11:34:58.761696+0000","last_clean":"2024-09-14T11:34:58.761696+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:34:58.761696+0000","last_undegraded":"2024-09-14T11:34:58.761696+0000","last_fullsized":"2024-09-14T11:34:58.761696+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:42.946120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":12,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:59.887231+0000","last_change":"2024-09-14T11:11:57.345965+0000","last_active":"2024-09-14T11:33:59.887231+0000","last_peered":"2024-09-14T11:33:59.887231+0000","last_clean":"2024-09-14T11:33:59.887231+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:33:59.887231+0000","last_undegraded":"2024-09-14T11:33:59.887231+0000","last_fullsized":"2024-09-14T11:33:59.887231+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:15.657325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880495+0000","last_change":"2024-09-14T11:10:13.502736+0000","last_active":"2024-09-14T11:35:12.880495+0000","last_peered":"2024-09-14T11:35:12.880495+0000","last_clean":"2024-09-14T11:35:12.880495+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:35:12.880495+0000","last_undegraded":"2024-09-14T11:35:12.880495+0000","last_fullsized":"2024-09-14T11:35:12.880495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:59.444808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:28.749456+0000","last_change":"2024-09-14T11:22:38.559863+0000","last_active":"2024-09-14T11:33:28.749456+0000","last_peered":"2024-09-14T11:33:28.749456+0000","last_clean":"2024-09-14T11:33:28.749456+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:33:28.749456+0000","last_undegraded":"2024-09-14T11:33:28.749456+0000","last_fullsized":"2024-09-14T11:33:28.749456+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:50.541537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:02.870330+0000","last_change":"2024-09-14T11:12:00.369782+0000","last_active":"2024-09-14T11:34:02.870330+0000","last_peered":"2024-09-14T11:34:02.870330+0000","last_clean":"2024-09-14T11:34:02.870330+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:34:02.870330+0000","last_undegraded":"2024-09-14T11:34:02.870330+0000","last_fullsized":"2024-09-14T11:34:02.870330+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:02.629691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895078+0000","last_change":"2024-09-14T11:11:57.349673+0000","last_active":"2024-09-14T11:34:54.895078+0000","last_peered":"2024-09-14T11:34:54.895078+0000","last_clean":"2024-09-14T11:34:54.895078+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:34:54.895078+0000","last_undegraded":"2024-09-14T11:34:54.895078+0000","last_fullsized":"2024-09-14T11:34:54.895078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.667434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898118+0000","last_change":"2024-09-14T11:10:13.510473+0000","last_active":"2024-09-14T11:35:14.898118+0000","last_peered":"2024-09-14T11:35:14.898118+0000","last_clean":"2024-09-14T11:35:14.898118+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:35:14.898118+0000","last_undegraded":"2024-09-14T11:35:14.898118+0000","last_fullsized":"2024-09-14T11:35:14.898118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:52.505231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763071+0000","last_change":"2024-09-14T11:22:38.558952+0000","last_active":"2024-09-14T11:35:08.763071+0000","last_peered":"2024-09-14T11:35:08.763071+0000","last_clean":"2024-09-14T11:35:08.763071+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:35:08.763071+0000","last_undegraded":"2024-09-14T11:35:08.763071+0000","last_fullsized":"2024-09-14T11:35:08.763071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:33.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.894910+0000","last_change":"2024-09-14T11:12:00.373006+0000","last_active":"2024-09-14T11:34:54.894910+0000","last_peered":"2024-09-14T11:34:54.894910+0000","last_clean":"2024-09-14T11:34:54.894910+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:34:54.894910+0000","last_undegraded":"2024-09-14T11:34:54.894910+0000","last_fullsized":"2024-09-14T11:34:54.894910+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:34.796891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:53.761123+0000","last_change":"2024-09-14T11:11:57.347916+0000","last_active":"2024-09-14T11:34:53.761123+0000","last_peered":"2024-09-14T11:34:53.761123+0000","last_clean":"2024-09-14T11:34:53.761123+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:34:53.761123+0000","last_undegraded":"2024-09-14T11:34:53.761123+0000","last_fullsized":"2024-09-14T11:34:53.761123+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:00.583601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897710+0000","last_change":"2024-09-14T11:10:13.512991+0000","last_active":"2024-09-14T11:35:14.897710+0000","last_peered":"2024-09-14T11:35:14.897710+0000","last_clean":"2024-09-14T11:35:14.897710+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:35:14.897710+0000","last_undegraded":"2024-09-14T11:35:14.897710+0000","last_fullsized":"2024-09-14T11:35:14.897710+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:49.534421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897492+0000","last_change":"2024-09-14T11:22:38.555840+0000","last_active":"2024-09-14T11:35:09.897492+0000","last_peered":"2024-09-14T11:35:09.897492+0000","last_clean":"2024-09-14T11:35:09.897492+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:35:09.897492+0000","last_undegraded":"2024-09-14T11:35:09.897492+0000","last_fullsized":"2024-09-14T11:35:09.897492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895328+0000","last_change":"2024-09-14T11:12:00.368478+0000","last_active":"2024-09-14T11:34:54.895328+0000","last_peered":"2024-09-14T11:34:54.895328+0000","last_clean":"2024-09-14T11:34:54.895328+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:34:54.895328+0000","last_undegraded":"2024-09-14T11:34:54.895328+0000","last_fullsized":"2024-09-14T11:34:54.895328+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:45.204253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.894928+0000","last_change":"2024-09-14T11:11:57.351639+0000","last_active":"2024-09-14T11:34:54.894928+0000","last_peered":"2024-09-14T11:34:54.894928+0000","last_clean":"2024-09-14T11:34:54.894928+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:34:54.894928+0000","last_undegraded":"2024-09-14T11:34:54.894928+0000","last_fullsized":"2024-09-14T11:34:54.894928+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:06.738942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.851175+0000","last_change":"2024-09-14T11:10:13.508247+0000","last_active":"2024-09-14T11:34:59.851175+0000","last_peered":"2024-09-14T11:34:59.851175+0000","last_clean":"2024-09-14T11:34:59.851175+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:34:59.851175+0000","last_undegraded":"2024-09-14T11:34:59.851175+0000","last_fullsized":"2024-09-14T11:34:59.851175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:55.466796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'288","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.329620+0000","last_change":"2024-09-14T10:56:06.840563+0000","last_active":"2024-09-14T11:35:51.329620+0000","last_peered":"2024-09-14T11:35:51.329620+0000","last_clean":"2024-09-14T11:35:51.329620+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:35:51.329620+0000","last_undegraded":"2024-09-14T11:35:51.329620+0000","last_fullsized":"2024-09-14T11:35:51.329620+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:36.737226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10221383,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":647,"num_read_kb":163807,"num_write":1094,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.639109+0000","last_change":"2024-09-14T10:56:08.850638+0000","last_active":"2024-09-14T11:35:15.639109+0000","last_peered":"2024-09-14T11:35:15.639109+0000","last_clean":"2024-09-14T11:35:15.639109+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:35:15.639109+0000","last_undegraded":"2024-09-14T11:35:15.639109+0000","last_fullsized":"2024-09-14T11:35:15.639109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.142178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'282","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.413271+0000","last_change":"2024-09-14T10:56:06.829795+0000","last_active":"2024-09-14T11:35:15.413271+0000","last_peered":"2024-09-14T11:35:15.413271+0000","last_clean":"2024-09-14T11:35:15.413271+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:35:15.413271+0000","last_undegraded":"2024-09-14T11:35:15.413271+0000","last_fullsized":"2024-09-14T11:35:15.413271+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":200,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:37.943163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5531859,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":523,"num_read_kb":38007,"num_write":1033,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.643553+0000","last_change":"2024-09-14T10:56:08.847147+0000","last_active":"2024-09-14T11:34:58.643553+0000","last_peered":"2024-09-14T11:34:58.643553+0000","last_clean":"2024-09-14T11:34:58.643553+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:34:58.643553+0000","last_undegraded":"2024-09-14T11:34:58.643553+0000","last_fullsized":"2024-09-14T11:34:58.643553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:19.665261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'288","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.618185+0000","last_change":"2024-09-14T10:56:06.827878+0000","last_active":"2024-09-14T11:35:16.618185+0000","last_peered":"2024-09-14T11:35:16.618185+0000","last_clean":"2024-09-14T11:35:16.618185+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:35:16.618185+0000","last_undegraded":"2024-09-14T11:35:16.618185+0000","last_fullsized":"2024-09-14T11:35:16.618185+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.452362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15252845,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":561,"num_read_kb":108632,"num_write":1012,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.641306+0000","last_change":"2024-09-14T10:56:08.839781+0000","last_active":"2024-09-14T11:35:56.641306+0000","last_peered":"2024-09-14T11:35:56.641306+0000","last_clean":"2024-09-14T11:35:56.641306+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:35:56.641306+0000","last_undegraded":"2024-09-14T11:35:56.641306+0000","last_fullsized":"2024-09-14T11:35:56.641306+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:48.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'298","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.222961+0000","last_change":"2024-09-14T10:56:42.460337+0000","last_active":"2024-09-14T11:35:14.222961+0000","last_peered":"2024-09-14T11:35:14.222961+0000","last_clean":"2024-09-14T11:35:14.222961+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:35:14.222961+0000","last_undegraded":"2024-09-14T11:35:14.222961+0000","last_fullsized":"2024-09-14T11:35:14.222961+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:24.182625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947917,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":34002,"num_write":1162,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.932127+0000","last_change":"2024-09-14T10:56:08.834000+0000","last_active":"2024-09-14T11:35:27.932127+0000","last_peered":"2024-09-14T11:35:27.932127+0000","last_clean":"2024-09-14T11:35:27.932127+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:35:27.932127+0000","last_undegraded":"2024-09-14T11:35:27.932127+0000","last_fullsized":"2024-09-14T11:35:27.932127+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:57.023521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'301","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:22.116943+0000","last_change":"2024-09-14T10:56:06.830568+0000","last_active":"2024-09-14T11:34:22.116943+0000","last_peered":"2024-09-14T11:34:22.116943+0000","last_clean":"2024-09-14T11:34:22.116943+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:34:22.116943+0000","last_undegraded":"2024-09-14T11:34:22.116943+0000","last_fullsized":"2024-09-14T11:34:22.116943+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:40.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15730039,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":544,"num_read_kb":21029,"num_write":1077,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.859777+0000","last_change":"2024-09-14T10:56:08.841284+0000","last_active":"2024-09-14T11:34:59.859777+0000","last_peered":"2024-09-14T11:34:59.859777+0000","last_clean":"2024-09-14T11:34:59.859777+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:34:59.859777+0000","last_undegraded":"2024-09-14T11:34:59.859777+0000","last_fullsized":"2024-09-14T11:34:59.859777+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:14.311075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'330","reported_seq":958,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.017247+0000","last_change":"2024-09-14T10:56:06.834469+0000","last_active":"2024-09-14T11:35:54.017247+0000","last_peered":"2024-09-14T11:35:54.017247+0000","last_clean":"2024-09-14T11:35:54.017247+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:35:54.017247+0000","last_undegraded":"2024-09-14T11:35:54.017247+0000","last_fullsized":"2024-09-14T11:35:54.017247+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:32.517363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17993628,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":554,"num_read_kb":29480,"num_write":1122,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4187","reported_seq":4819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:12.075383+0000","last_change":"2024-09-14T10:56:08.839199+0000","last_active":"2024-09-14T11:34:12.075383+0000","last_peered":"2024-09-14T11:34:12.075383+0000","last_clean":"2024-09-14T11:34:12.075383+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:34:12.075383+0000","last_undegraded":"2024-09-14T11:34:12.075383+0000","last_fullsized":"2024-09-14T11:34:12.075383+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":3000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:42.778598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'281","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:12.894171+0000","last_change":"2024-09-14T10:56:06.833222+0000","last_active":"2024-09-14T11:37:12.894171+0000","last_peered":"2024-09-14T11:37:12.894171+0000","last_clean":"2024-09-14T11:37:12.894171+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:37:12.894171+0000","last_undegraded":"2024-09-14T11:37:12.894171+0000","last_fullsized":"2024-09-14T11:37:12.894171+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:04.180820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570621,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":525,"num_read_kb":8675,"num_write":1095,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:14.074011+0000","last_change":"2024-09-14T10:56:08.845788+0000","last_active":"2024-09-14T11:34:14.074011+0000","last_peered":"2024-09-14T11:34:14.074011+0000","last_clean":"2024-09-14T11:34:14.074011+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:34:14.074011+0000","last_undegraded":"2024-09-14T11:34:14.074011+0000","last_fullsized":"2024-09-14T11:34:14.074011+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:48.651913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'360","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.529550+0000","last_change":"2024-09-14T10:56:06.823561+0000","last_active":"2024-09-14T11:35:17.529550+0000","last_peered":"2024-09-14T11:35:17.529550+0000","last_clean":"2024-09-14T11:35:17.529550+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:35:17.529550+0000","last_undegraded":"2024-09-14T11:35:17.529550+0000","last_fullsized":"2024-09-14T11:35:17.529550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:14.493949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10794650,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":948,"num_read_kb":48878,"num_write":1251,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.701012+0000","last_change":"2024-09-14T10:56:08.837515+0000","last_active":"2024-09-14T11:34:26.701012+0000","last_peered":"2024-09-14T11:34:26.701012+0000","last_clean":"2024-09-14T11:34:26.701012+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:34:26.701012+0000","last_undegraded":"2024-09-14T11:34:26.701012+0000","last_fullsized":"2024-09-14T11:34:26.701012+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.463671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:35.029523+0000","last_change":"2024-09-14T10:56:08.839183+0000","last_active":"2024-09-14T11:35:35.029523+0000","last_peered":"2024-09-14T11:35:35.029523+0000","last_clean":"2024-09-14T11:35:35.029523+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:35:35.029523+0000","last_undegraded":"2024-09-14T11:35:35.029523+0000","last_fullsized":"2024-09-14T11:35:35.029523+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:38.313196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'286","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.988886+0000","last_change":"2024-09-14T10:56:42.661135+0000","last_active":"2024-09-14T11:35:30.988886+0000","last_peered":"2024-09-14T11:35:30.988886+0000","last_clean":"2024-09-14T11:35:30.988886+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:35:30.988886+0000","last_undegraded":"2024-09-14T11:35:30.988886+0000","last_fullsized":"2024-09-14T11:35:30.988886+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:46.958500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6709056,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":588,"num_read_kb":81454,"num_write":1091,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.663539+0000","last_change":"2024-09-14T10:56:08.846796+0000","last_active":"2024-09-14T11:35:32.663539+0000","last_peered":"2024-09-14T11:35:32.663539+0000","last_clean":"2024-09-14T11:35:32.663539+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:35:32.663539+0000","last_undegraded":"2024-09-14T11:35:32.663539+0000","last_fullsized":"2024-09-14T11:35:32.663539+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:56.632850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'308","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.883163+0000","last_change":"2024-09-14T10:56:06.835989+0000","last_active":"2024-09-14T11:35:27.883163+0000","last_peered":"2024-09-14T11:35:27.883163+0000","last_clean":"2024-09-14T11:35:27.883163+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:35:27.883163+0000","last_undegraded":"2024-09-14T11:35:27.883163+0000","last_fullsized":"2024-09-14T11:35:27.883163+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:41.887236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10496571,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":1043,"num_read_kb":13749,"num_write":1119,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.810993+0000","last_change":"2024-09-14T10:56:08.844107+0000","last_active":"2024-09-14T11:35:31.810993+0000","last_peered":"2024-09-14T11:35:31.810993+0000","last_clean":"2024-09-14T11:35:31.810993+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:35:31.810993+0000","last_undegraded":"2024-09-14T11:35:31.810993+0000","last_fullsized":"2024-09-14T11:35:31.810993+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:40.490617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'261","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:49.894327+0000","last_change":"2024-09-14T10:56:06.839571+0000","last_active":"2024-09-14T11:34:49.894327+0000","last_peered":"2024-09-14T11:34:49.894327+0000","last_clean":"2024-09-14T11:34:49.894327+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:34:49.894327+0000","last_undegraded":"2024-09-14T11:34:49.894327+0000","last_fullsized":"2024-09-14T11:34:49.894327+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:28.864250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10525942,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":568,"num_read_kb":2147,"num_write":1031,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.465427+0000","last_change":"2024-09-14T10:56:08.834013+0000","last_active":"2024-09-14T11:35:33.465427+0000","last_peered":"2024-09-14T11:35:33.465427+0000","last_clean":"2024-09-14T11:35:33.465427+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:35:33.465427+0000","last_undegraded":"2024-09-14T11:35:33.465427+0000","last_fullsized":"2024-09-14T11:35:33.465427+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.973557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'298","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:04.714334+0000","last_change":"2024-09-14T10:56:06.830891+0000","last_active":"2024-09-14T11:37:04.714334+0000","last_peered":"2024-09-14T11:37:04.714334+0000","last_clean":"2024-09-14T11:37:04.714334+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:04.714334+0000","last_undegraded":"2024-09-14T11:37:04.714334+0000","last_fullsized":"2024-09-14T11:37:04.714334+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:02.160609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22667515,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":645,"num_read_kb":45139,"num_write":1064,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:29.540321+0000","last_change":"2024-09-14T10:56:08.834901+0000","last_active":"2024-09-14T11:35:29.540321+0000","last_peered":"2024-09-14T11:35:29.540321+0000","last_clean":"2024-09-14T11:35:29.540321+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:35:29.540321+0000","last_undegraded":"2024-09-14T11:35:29.540321+0000","last_fullsized":"2024-09-14T11:35:29.540321+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:56.020076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'289","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:24.816667+0000","last_change":"2024-09-14T10:56:06.826208+0000","last_active":"2024-09-14T11:35:24.816667+0000","last_peered":"2024-09-14T11:35:24.816667+0000","last_clean":"2024-09-14T11:35:24.816667+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:35:24.816667+0000","last_undegraded":"2024-09-14T11:35:24.816667+0000","last_fullsized":"2024-09-14T11:35:24.816667+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:50.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340804,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":596,"num_read_kb":91641,"num_write":1094,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:28.738381+0000","last_change":"2024-09-14T10:56:08.846295+0000","last_active":"2024-09-14T11:35:28.738381+0000","last_peered":"2024-09-14T11:35:28.738381+0000","last_clean":"2024-09-14T11:35:28.738381+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:35:28.738381+0000","last_undegraded":"2024-09-14T11:35:28.738381+0000","last_fullsized":"2024-09-14T11:35:28.738381+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:58.178498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'268","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.330898+0000","last_change":"2024-09-14T10:56:06.828820+0000","last_active":"2024-09-14T11:35:51.330898+0000","last_peered":"2024-09-14T11:35:51.330898+0000","last_clean":"2024-09-14T11:35:51.330898+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:35:51.330898+0000","last_undegraded":"2024-09-14T11:35:51.330898+0000","last_fullsized":"2024-09-14T11:35:51.330898+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:35.203573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7377967,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":458,"num_read_kb":12785,"num_write":1018,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.632102+0000","last_change":"2024-09-14T10:56:16.877295+0000","last_active":"2024-09-14T11:37:14.632102+0000","last_peered":"2024-09-14T11:37:14.632102+0000","last_clean":"2024-09-14T11:37:14.632102+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:37:14.632102+0000","last_undegraded":"2024-09-14T11:37:14.632102+0000","last_fullsized":"2024-09-14T11:37:14.632102+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:56.149162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:06.606080+0000","last_change":"2024-09-14T10:56:08.839155+0000","last_active":"2024-09-14T11:35:06.606080+0000","last_peered":"2024-09-14T11:35:06.606080+0000","last_clean":"2024-09-14T11:35:06.606080+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:35:06.606080+0000","last_undegraded":"2024-09-14T11:35:06.606080+0000","last_fullsized":"2024-09-14T11:35:06.606080+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:37.441954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'302","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.652603+0000","last_change":"2024-09-14T10:56:06.835770+0000","last_active":"2024-09-14T11:35:37.652603+0000","last_peered":"2024-09-14T11:35:37.652603+0000","last_clean":"2024-09-14T11:35:37.652603+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:35:37.652603+0000","last_undegraded":"2024-09-14T11:35:37.652603+0000","last_fullsized":"2024-09-14T11:35:37.652603+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:18.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298264,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":776,"num_read_kb":1723,"num_write":1140,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877333+0000","last_change":"2024-09-14T10:56:10.848176+0000","last_active":"2024-09-14T11:34:52.877333+0000","last_peered":"2024-09-14T11:34:52.877333+0000","last_clean":"2024-09-14T11:34:52.877333+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:34:52.877333+0000","last_undegraded":"2024-09-14T11:34:52.877333+0000","last_fullsized":"2024-09-14T11:34:52.877333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:35.018887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'359","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.611662+0000","last_change":"2024-09-14T10:56:12.850634+0000","last_active":"2024-09-14T11:37:14.611662+0000","last_peered":"2024-09-14T11:37:14.611662+0000","last_clean":"2024-09-14T11:37:14.611662+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:37:14.611662+0000","last_undegraded":"2024-09-14T11:37:14.611662+0000","last_fullsized":"2024-09-14T11:37:14.611662+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:49.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63833,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":580,"num_read_kb":1145,"num_write":478,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895276+0000","last_change":"2024-09-14T10:56:14.867772+0000","last_active":"2024-09-14T11:34:54.895276+0000","last_peered":"2024-09-14T11:34:54.895276+0000","last_clean":"2024-09-14T11:34:54.895276+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:34:54.895276+0000","last_undegraded":"2024-09-14T11:34:54.895276+0000","last_fullsized":"2024-09-14T11:34:54.895276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:36.827998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2488","reported_seq":4301,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.535039+0000","last_change":"2024-09-14T10:56:16.878623+0000","last_active":"2024-09-14T11:35:54.535039+0000","last_peered":"2024-09-14T11:35:54.535039+0000","last_clean":"2024-09-14T11:35:54.535039+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:35:54.535039+0000","last_undegraded":"2024-09-14T11:35:54.535039+0000","last_fullsized":"2024-09-14T11:35:54.535039+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:03.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.011617+0000","last_change":"2024-09-14T10:56:08.849261+0000","last_active":"2024-09-14T11:35:25.011617+0000","last_peered":"2024-09-14T11:35:25.011617+0000","last_clean":"2024-09-14T11:35:25.011617+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:35:25.011617+0000","last_undegraded":"2024-09-14T11:35:25.011617+0000","last_fullsized":"2024-09-14T11:35:25.011617+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:12.169215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'248","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:08.576265+0000","last_change":"2024-09-14T10:56:06.830626+0000","last_active":"2024-09-14T11:34:08.576265+0000","last_peered":"2024-09-14T11:34:08.576265+0000","last_clean":"2024-09-14T11:34:08.576265+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:34:08.576265+0000","last_undegraded":"2024-09-14T11:34:08.576265+0000","last_fullsized":"2024-09-14T11:34:08.576265+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:21.784956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8390400,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":450,"num_read_kb":41361,"num_write":930,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:40.597273+0000","last_change":"2024-09-14T10:56:10.842610+0000","last_active":"2024-09-14T11:33:40.597273+0000","last_peered":"2024-09-14T11:33:40.597273+0000","last_clean":"2024-09-14T11:33:40.597273+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:33:40.597273+0000","last_undegraded":"2024-09-14T11:33:40.597273+0000","last_fullsized":"2024-09-14T11:33:40.597273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:31.067891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'88","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.440429+0000","last_change":"2024-09-14T10:56:12.850155+0000","last_active":"2024-09-14T11:36:21.440429+0000","last_peered":"2024-09-14T11:36:21.440429+0000","last_clean":"2024-09-14T11:36:21.440429+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:36:21.440429+0000","last_undegraded":"2024-09-14T11:36:21.440429+0000","last_fullsized":"2024-09-14T11:36:21.440429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:58.551957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895419+0000","last_change":"2024-09-14T10:56:14.865727+0000","last_active":"2024-09-14T11:34:54.895419+0000","last_peered":"2024-09-14T11:34:54.895419+0000","last_clean":"2024-09-14T11:34:54.895419+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:34:54.895419+0000","last_undegraded":"2024-09-14T11:34:54.895419+0000","last_fullsized":"2024-09-14T11:34:54.895419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:33.497143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'124","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.497858+0000","last_change":"2024-09-14T10:56:16.878997+0000","last_active":"2024-09-14T11:35:26.497858+0000","last_peered":"2024-09-14T11:35:26.497858+0000","last_clean":"2024-09-14T11:35:26.497858+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:35:26.497858+0000","last_undegraded":"2024-09-14T11:35:26.497858+0000","last_fullsized":"2024-09-14T11:35:26.497858+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:40.199776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.949206+0000","last_change":"2024-09-14T10:56:08.843498+0000","last_active":"2024-09-14T11:35:12.949206+0000","last_peered":"2024-09-14T11:35:12.949206+0000","last_clean":"2024-09-14T11:35:12.949206+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:35:12.949206+0000","last_undegraded":"2024-09-14T11:35:12.949206+0000","last_fullsized":"2024-09-14T11:35:12.949206+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:05.973356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'287","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.516635+0000","last_change":"2024-09-14T10:56:06.834132+0000","last_active":"2024-09-14T11:34:26.516635+0000","last_peered":"2024-09-14T11:34:26.516635+0000","last_clean":"2024-09-14T11:34:26.516635+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:34:26.516635+0000","last_undegraded":"2024-09-14T11:34:26.516635+0000","last_fullsized":"2024-09-14T11:34:26.516635+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:22.363792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170829,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":479,"num_read_kb":14993,"num_write":1073,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607291+0000","last_change":"2024-09-14T10:56:10.847524+0000","last_active":"2024-09-14T11:34:55.607291+0000","last_peered":"2024-09-14T11:34:55.607291+0000","last_clean":"2024-09-14T11:34:55.607291+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:34:55.607291+0000","last_undegraded":"2024-09-14T11:34:55.607291+0000","last_fullsized":"2024-09-14T11:34:55.607291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.642527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'114","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.457558+0000","last_change":"2024-09-14T10:56:12.847058+0000","last_active":"2024-09-14T11:36:21.457558+0000","last_peered":"2024-09-14T11:36:21.457558+0000","last_clean":"2024-09-14T11:36:21.457558+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:36:21.457558+0000","last_undegraded":"2024-09-14T11:36:21.457558+0000","last_fullsized":"2024-09-14T11:36:21.457558+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:22.246613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'753","reported_seq":2170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.859967+0000","last_change":"2024-09-14T10:56:14.861391+0000","last_active":"2024-09-14T11:37:14.859967+0000","last_peered":"2024-09-14T11:37:14.859967+0000","last_clean":"2024-09-14T11:37:14.859967+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:37:14.859967+0000","last_undegraded":"2024-09-14T11:37:14.859967+0000","last_fullsized":"2024-09-14T11:37:14.859967+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:33.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'240","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.745307+0000","last_change":"2024-09-14T10:56:16.865049+0000","last_active":"2024-09-14T11:35:56.745307+0000","last_peered":"2024-09-14T11:35:56.745307+0000","last_clean":"2024-09-14T11:35:56.745307+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:35:56.745307+0000","last_undegraded":"2024-09-14T11:35:56.745307+0000","last_fullsized":"2024-09-14T11:35:56.745307+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:59.143467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4156","reported_seq":4751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:50.606696+0000","last_change":"2024-09-14T10:56:08.848320+0000","last_active":"2024-09-14T11:34:50.606696+0000","last_peered":"2024-09-14T11:34:50.606696+0000","last_clean":"2024-09-14T11:34:50.606696+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:34:50.606696+0000","last_undegraded":"2024-09-14T11:34:50.606696+0000","last_fullsized":"2024-09-14T11:34:50.606696+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:16.344418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'268","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.024586+0000","last_change":"2024-09-14T10:56:06.834097+0000","last_active":"2024-09-14T11:35:27.024586+0000","last_peered":"2024-09-14T11:35:27.024586+0000","last_clean":"2024-09-14T11:35:27.024586+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:35:27.024586+0000","last_undegraded":"2024-09-14T11:35:27.024586+0000","last_fullsized":"2024-09-14T11:35:27.024586+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:23.306111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5761840,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":572,"num_read_kb":30567,"num_write":957,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877363+0000","last_change":"2024-09-14T10:56:10.839414+0000","last_active":"2024-09-14T11:34:52.877363+0000","last_peered":"2024-09-14T11:34:52.877363+0000","last_clean":"2024-09-14T11:34:52.877363+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:34:52.877363+0000","last_undegraded":"2024-09-14T11:34:52.877363+0000","last_fullsized":"2024-09-14T11:34:52.877363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:56.422012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'285","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.605969+0000","last_change":"2024-09-14T10:56:13.041543+0000","last_active":"2024-09-14T11:37:14.605969+0000","last_peered":"2024-09-14T11:37:14.605969+0000","last_clean":"2024-09-14T11:37:14.605969+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:37:14.605969+0000","last_undegraded":"2024-09-14T11:37:14.605969+0000","last_fullsized":"2024-09-14T11:37:14.605969+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.191878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68307,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":1078,"num_write":418,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'791","reported_seq":2251,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.648484+0000","last_change":"2024-09-14T10:56:14.859370+0000","last_active":"2024-09-14T11:37:14.648484+0000","last_peered":"2024-09-14T11:37:14.648484+0000","last_clean":"2024-09-14T11:37:14.648484+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:37:14.648484+0000","last_undegraded":"2024-09-14T11:37:14.648484+0000","last_fullsized":"2024-09-14T11:37:14.648484+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:34.411310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880438+0000","last_change":"2024-09-14T10:56:08.849378+0000","last_active":"2024-09-14T11:35:12.880438+0000","last_peered":"2024-09-14T11:35:12.880438+0000","last_clean":"2024-09-14T11:35:12.880438+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:35:12.880438+0000","last_undegraded":"2024-09-14T11:35:12.880438+0000","last_fullsized":"2024-09-14T11:35:12.880438+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:36.824573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'272","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.427175+0000","last_change":"2024-09-14T10:56:06.836741+0000","last_active":"2024-09-14T11:37:09.427175+0000","last_peered":"2024-09-14T11:37:09.427175+0000","last_clean":"2024-09-14T11:37:09.427175+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:09.427175+0000","last_undegraded":"2024-09-14T11:37:09.427175+0000","last_fullsized":"2024-09-14T11:37:09.427175+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:18.533912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5995653,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":460,"num_read_kb":9228,"num_write":1065,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898164+0000","last_change":"2024-09-14T10:56:10.848968+0000","last_active":"2024-09-14T11:35:14.898164+0000","last_peered":"2024-09-14T11:35:14.898164+0000","last_clean":"2024-09-14T11:35:14.898164+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:35:14.898164+0000","last_undegraded":"2024-09-14T11:35:14.898164+0000","last_fullsized":"2024-09-14T11:35:14.898164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:05.693919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'355","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.616349+0000","last_change":"2024-09-14T10:56:13.041185+0000","last_active":"2024-09-14T11:37:14.616349+0000","last_peered":"2024-09-14T11:37:14.616349+0000","last_clean":"2024-09-14T11:37:14.616349+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:37:14.616349+0000","last_undegraded":"2024-09-14T11:37:14.616349+0000","last_fullsized":"2024-09-14T11:37:14.616349+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58751,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":569,"num_read_kb":1079,"num_write":454,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758510+0000","last_change":"2024-09-14T10:56:14.867306+0000","last_active":"2024-09-14T11:34:33.758510+0000","last_peered":"2024-09-14T11:34:33.758510+0000","last_clean":"2024-09-14T11:34:33.758510+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:34:33.758510+0000","last_undegraded":"2024-09-14T11:34:33.758510+0000","last_fullsized":"2024-09-14T11:34:33.758510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:08.141850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'546","reported_seq":1358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.630477+0000","last_change":"2024-09-14T10:56:16.873797+0000","last_active":"2024-09-14T11:37:14.630477+0000","last_peered":"2024-09-14T11:37:14.630477+0000","last_clean":"2024-09-14T11:37:14.630477+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:37:14.630477+0000","last_undegraded":"2024-09-14T11:37:14.630477+0000","last_fullsized":"2024-09-14T11:37:14.630477+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:06.775196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.164105+0000","last_change":"2024-09-14T10:56:08.845180+0000","last_active":"2024-09-14T11:35:37.164105+0000","last_peered":"2024-09-14T11:35:37.164105+0000","last_clean":"2024-09-14T11:35:37.164105+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:35:37.164105+0000","last_undegraded":"2024-09-14T11:35:37.164105+0000","last_fullsized":"2024-09-14T11:35:37.164105+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:14.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'207","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.821317+0000","last_change":"2024-09-14T10:56:06.835215+0000","last_active":"2024-09-14T11:35:37.821317+0000","last_peered":"2024-09-14T11:35:37.821317+0000","last_clean":"2024-09-14T11:35:37.821317+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:35:37.821317+0000","last_undegraded":"2024-09-14T11:35:37.821317+0000","last_fullsized":"2024-09-14T11:35:37.821317+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:04.636480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10781877,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":459,"num_read_kb":56700,"num_write":772,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866554+0000","last_change":"2024-09-14T10:56:10.848498+0000","last_active":"2024-09-14T11:35:14.866554+0000","last_peered":"2024-09-14T11:35:14.866554+0000","last_clean":"2024-09-14T11:35:14.866554+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:35:14.866554+0000","last_undegraded":"2024-09-14T11:35:14.866554+0000","last_fullsized":"2024-09-14T11:35:14.866554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:30.715397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'264","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:45.621076+0000","last_change":"2024-09-14T10:56:12.849959+0000","last_active":"2024-09-14T11:36:45.621076+0000","last_peered":"2024-09-14T11:36:45.621076+0000","last_clean":"2024-09-14T11:36:45.621076+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:36:45.621076+0000","last_undegraded":"2024-09-14T11:36:45.621076+0000","last_fullsized":"2024-09-14T11:36:45.621076+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:51.049544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":977,"num_write":360,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610430+0000","last_change":"2024-09-14T10:56:14.859113+0000","last_active":"2024-09-14T11:35:20.610430+0000","last_peered":"2024-09-14T11:35:20.610430+0000","last_clean":"2024-09-14T11:35:20.610430+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:35:20.610430+0000","last_undegraded":"2024-09-14T11:35:20.610430+0000","last_fullsized":"2024-09-14T11:35:20.610430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:39.449429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'114","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:59.904352+0000","last_change":"2024-09-14T10:56:16.872299+0000","last_active":"2024-09-14T11:35:59.904352+0000","last_peered":"2024-09-14T11:35:59.904352+0000","last_clean":"2024-09-14T11:35:59.904352+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:35:59.904352+0000","last_undegraded":"2024-09-14T11:35:59.904352+0000","last_fullsized":"2024-09-14T11:35:59.904352+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:14.575119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.871798+0000","last_change":"2024-09-14T10:56:08.846448+0000","last_active":"2024-09-14T11:35:37.871798+0000","last_peered":"2024-09-14T11:35:37.871798+0000","last_clean":"2024-09-14T11:35:37.871798+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:35:37.871798+0000","last_undegraded":"2024-09-14T11:35:37.871798+0000","last_fullsized":"2024-09-14T11:35:37.871798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:21.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'385","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.197733+0000","last_change":"2024-09-14T10:56:06.838982+0000","last_active":"2024-09-14T11:35:13.197733+0000","last_peered":"2024-09-14T11:35:13.197733+0000","last_clean":"2024-09-14T11:35:13.197733+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:35:13.197733+0000","last_undegraded":"2024-09-14T11:35:13.197733+0000","last_fullsized":"2024-09-14T11:35:13.197733+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:14.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10872494,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":909,"num_read_kb":28710,"num_write":1610,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861135+0000","last_change":"2024-09-14T10:56:10.847743+0000","last_active":"2024-09-14T11:34:29.861135+0000","last_peered":"2024-09-14T11:34:29.861135+0000","last_clean":"2024-09-14T11:34:29.861135+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:34:29.861135+0000","last_undegraded":"2024-09-14T11:34:29.861135+0000","last_fullsized":"2024-09-14T11:34:29.861135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:13.871060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'302","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.619145+0000","last_change":"2024-09-14T10:56:12.847492+0000","last_active":"2024-09-14T11:37:14.619145+0000","last_peered":"2024-09-14T11:37:14.619145+0000","last_clean":"2024-09-14T11:37:14.619145+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:37:14.619145+0000","last_undegraded":"2024-09-14T11:37:14.619145+0000","last_fullsized":"2024-09-14T11:37:14.619145+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:45.170095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":1014,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'773","reported_seq":4218,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.865371+0000","last_change":"2024-09-14T10:56:14.863301+0000","last_active":"2024-09-14T11:37:14.865371+0000","last_peered":"2024-09-14T11:37:14.865371+0000","last_clean":"2024-09-14T11:37:14.865371+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:37:14.865371+0000","last_undegraded":"2024-09-14T11:37:14.865371+0000","last_fullsized":"2024-09-14T11:37:14.865371+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":701,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:01.064582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.458613+0000","last_change":"2024-09-14T10:56:16.877915+0000","last_active":"2024-09-14T11:37:13.458613+0000","last_peered":"2024-09-14T11:37:13.458613+0000","last_clean":"2024-09-14T11:37:13.458613+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:37:13.458613+0000","last_undegraded":"2024-09-14T11:37:13.458613+0000","last_fullsized":"2024-09-14T11:37:13.458613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:25.564431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756765+0000","last_change":"2024-09-14T10:56:08.840369+0000","last_active":"2024-09-14T11:34:23.756765+0000","last_peered":"2024-09-14T11:34:23.756765+0000","last_clean":"2024-09-14T11:34:23.756765+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:34:23.756765+0000","last_undegraded":"2024-09-14T11:34:23.756765+0000","last_fullsized":"2024-09-14T11:34:23.756765+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'251","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:34.809263+0000","last_change":"2024-09-14T10:56:06.827678+0000","last_active":"2024-09-14T11:35:34.809263+0000","last_peered":"2024-09-14T11:35:34.809263+0000","last_clean":"2024-09-14T11:35:34.809263+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:35:34.809263+0000","last_undegraded":"2024-09-14T11:35:34.809263+0000","last_fullsized":"2024-09-14T11:35:34.809263+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:00.287082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8792642,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":493,"num_read_kb":39728,"num_write":895,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.867092+0000","last_change":"2024-09-14T10:56:10.851426+0000","last_active":"2024-09-14T11:35:19.867092+0000","last_peered":"2024-09-14T11:35:19.867092+0000","last_clean":"2024-09-14T11:35:19.867092+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:35:19.867092+0000","last_undegraded":"2024-09-14T11:35:19.867092+0000","last_fullsized":"2024-09-14T11:35:19.867092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.334991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'453","reported_seq":1065,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.621803+0000","last_change":"2024-09-14T10:56:12.850654+0000","last_active":"2024-09-14T11:37:14.621803+0000","last_peered":"2024-09-14T11:37:14.621803+0000","last_clean":"2024-09-14T11:37:14.621803+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:37:14.621803+0000","last_undegraded":"2024-09-14T11:37:14.621803+0000","last_fullsized":"2024-09-14T11:37:14.621803+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":400,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:01.231786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106955,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":782,"num_read_kb":1698,"num_write":650,"num_write_kb":556,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866535+0000","last_change":"2024-09-14T10:56:14.862461+0000","last_active":"2024-09-14T11:35:14.866535+0000","last_peered":"2024-09-14T11:35:14.866535+0000","last_clean":"2024-09-14T11:35:14.866535+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:35:14.866535+0000","last_undegraded":"2024-09-14T11:35:14.866535+0000","last_fullsized":"2024-09-14T11:35:14.866535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:30.827794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'106","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764320+0000","last_change":"2024-09-14T10:56:16.874312+0000","last_active":"2024-09-14T11:35:18.764320+0000","last_peered":"2024-09-14T11:35:18.764320+0000","last_clean":"2024-09-14T11:35:18.764320+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:35:18.764320+0000","last_undegraded":"2024-09-14T11:35:18.764320+0000","last_fullsized":"2024-09-14T11:35:18.764320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:06.689124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'255","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891045+0000","last_change":"2024-09-14T10:56:08.840033+0000","last_active":"2024-09-14T11:34:24.891045+0000","last_peered":"2024-09-14T11:34:24.891045+0000","last_clean":"2024-09-14T11:34:24.891045+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:34:24.891045+0000","last_undegraded":"2024-09-14T11:34:24.891045+0000","last_fullsized":"2024-09-14T11:34:24.891045+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'270","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.847995+0000","last_change":"2024-09-14T10:56:06.831914+0000","last_active":"2024-09-14T11:35:30.847995+0000","last_peered":"2024-09-14T11:35:30.847995+0000","last_clean":"2024-09-14T11:35:30.847995+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:35:30.847995+0000","last_undegraded":"2024-09-14T11:35:30.847995+0000","last_fullsized":"2024-09-14T11:35:30.847995+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:23.908631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3711631,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":456,"num_read_kb":5559,"num_write":943,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861192+0000","last_change":"2024-09-14T10:56:10.851153+0000","last_active":"2024-09-14T11:34:29.861192+0000","last_peered":"2024-09-14T11:34:29.861192+0000","last_clean":"2024-09-14T11:34:29.861192+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:34:29.861192+0000","last_undegraded":"2024-09-14T11:34:29.861192+0000","last_fullsized":"2024-09-14T11:34:29.861192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:53.218265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'273","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:44.910823+0000","last_change":"2024-09-14T10:56:12.851527+0000","last_active":"2024-09-14T11:36:44.910823+0000","last_peered":"2024-09-14T11:36:44.910823+0000","last_clean":"2024-09-14T11:36:44.910823+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:36:44.910823+0000","last_undegraded":"2024-09-14T11:36:44.910823+0000","last_fullsized":"2024-09-14T11:36:44.910823+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:56.803494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":920,"num_write":424,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T10:56:14.862397+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:41.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'106","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:25.618639+0000","last_change":"2024-09-14T10:56:16.877499+0000","last_active":"2024-09-14T11:36:25.618639+0000","last_peered":"2024-09-14T11:36:25.618639+0000","last_clean":"2024-09-14T11:36:25.618639+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:36:25.618639+0000","last_undegraded":"2024-09-14T11:36:25.618639+0000","last_fullsized":"2024-09-14T11:36:25.618639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:22.117249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'104","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.329749+0000","last_change":"2024-09-14T10:56:08.840230+0000","last_active":"2024-09-14T11:35:36.329749+0000","last_peered":"2024-09-14T11:35:36.329749+0000","last_clean":"2024-09-14T11:35:36.329749+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:35:36.329749+0000","last_undegraded":"2024-09-14T11:35:36.329749+0000","last_fullsized":"2024-09-14T11:35:36.329749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:33.596968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'306","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:21.857104+0000","last_change":"2024-09-14T10:56:06.834028+0000","last_active":"2024-09-14T11:35:21.857104+0000","last_peered":"2024-09-14T11:35:21.857104+0000","last_clean":"2024-09-14T11:35:21.857104+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:35:21.857104+0000","last_undegraded":"2024-09-14T11:35:21.857104+0000","last_fullsized":"2024-09-14T11:35:21.857104+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:18.403230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12936231,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":560,"num_read_kb":12205,"num_write":1103,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757753+0000","last_change":"2024-09-14T10:56:10.852013+0000","last_active":"2024-09-14T11:34:28.757753+0000","last_peered":"2024-09-14T11:34:28.757753+0000","last_clean":"2024-09-14T11:34:28.757753+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:34:28.757753+0000","last_undegraded":"2024-09-14T11:34:28.757753+0000","last_fullsized":"2024-09-14T11:34:28.757753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.745857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'286","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:49.877742+0000","last_change":"2024-09-14T10:56:12.856779+0000","last_active":"2024-09-14T11:36:49.877742+0000","last_peered":"2024-09-14T11:36:49.877742+0000","last_clean":"2024-09-14T11:36:49.877742+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:36:49.877742+0000","last_undegraded":"2024-09-14T11:36:49.877742+0000","last_fullsized":"2024-09-14T11:36:49.877742+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:24.231799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56846,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":994,"num_write":404,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'722","reported_seq":2189,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.645256+0000","last_change":"2024-09-14T10:56:14.866439+0000","last_active":"2024-09-14T11:37:14.645256+0000","last_peered":"2024-09-14T11:37:14.645256+0000","last_clean":"2024-09-14T11:37:14.645256+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:37:14.645256+0000","last_undegraded":"2024-09-14T11:37:14.645256+0000","last_fullsized":"2024-09-14T11:37:14.645256+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":701,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:07.193263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'138","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.817608+0000","last_change":"2024-09-14T10:56:16.873210+0000","last_active":"2024-09-14T11:35:25.817608+0000","last_peered":"2024-09-14T11:35:25.817608+0000","last_clean":"2024-09-14T11:35:25.817608+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:35:25.817608+0000","last_undegraded":"2024-09-14T11:35:25.817608+0000","last_fullsized":"2024-09-14T11:35:25.817608+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:57.429498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'172","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.052682+0000","last_change":"2024-09-14T10:56:08.843637+0000","last_active":"2024-09-14T11:35:20.052682+0000","last_peered":"2024-09-14T11:35:20.052682+0000","last_clean":"2024-09-14T11:35:20.052682+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:35:20.052682+0000","last_undegraded":"2024-09-14T11:35:20.052682+0000","last_fullsized":"2024-09-14T11:35:20.052682+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:12.290035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'268","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897404+0000","last_change":"2024-09-14T10:56:06.830680+0000","last_active":"2024-09-14T11:35:09.897404+0000","last_peered":"2024-09-14T11:35:09.897404+0000","last_clean":"2024-09-14T11:35:09.897404+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:35:09.897404+0000","last_undegraded":"2024-09-14T11:35:09.897404+0000","last_fullsized":"2024-09-14T11:35:09.897404+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:18.827199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5602628,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":418,"num_read_kb":8775,"num_write":941,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1438,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.361038+0000","last_change":"2024-09-14T10:56:10.849165+0000","last_active":"2024-09-14T11:37:14.361038+0000","last_peered":"2024-09-14T11:37:14.361038+0000","last_clean":"2024-09-14T11:37:14.361038+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:37:14.361038+0000","last_undegraded":"2024-09-14T11:37:14.361038+0000","last_fullsized":"2024-09-14T11:37:14.361038+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:00.894650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":948,"num_read_kb":948,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.427200+0000","last_change":"2024-09-14T10:56:13.041348+0000","last_active":"2024-09-14T11:36:21.427200+0000","last_peered":"2024-09-14T11:36:21.427200+0000","last_clean":"2024-09-14T11:36:21.427200+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:36:21.427200+0000","last_undegraded":"2024-09-14T11:36:21.427200+0000","last_fullsized":"2024-09-14T11:36:21.427200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:28.818595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'750","reported_seq":2171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.646121+0000","last_change":"2024-09-14T10:56:14.868996+0000","last_active":"2024-09-14T11:37:14.646121+0000","last_peered":"2024-09-14T11:37:14.646121+0000","last_clean":"2024-09-14T11:37:14.646121+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:37:14.646121+0000","last_undegraded":"2024-09-14T11:37:14.646121+0000","last_fullsized":"2024-09-14T11:37:14.646121+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.783931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.530654+0000","last_change":"2024-09-14T10:56:16.870911+0000","last_active":"2024-09-14T11:35:56.530654+0000","last_peered":"2024-09-14T11:35:56.530654+0000","last_clean":"2024-09-14T11:35:56.530654+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:35:56.530654+0000","last_undegraded":"2024-09-14T11:35:56.530654+0000","last_fullsized":"2024-09-14T11:35:56.530654+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.800135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'625","reported_seq":1464,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.902240+0000","last_change":"2024-09-14T10:56:08.839242+0000","last_active":"2024-09-14T11:35:19.902240+0000","last_peered":"2024-09-14T11:35:19.902240+0000","last_clean":"2024-09-14T11:35:19.902240+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:35:19.902240+0000","last_undegraded":"2024-09-14T11:35:19.902240+0000","last_fullsized":"2024-09-14T11:35:19.902240+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:35.763543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'324","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:11.993637+0000","last_change":"2024-09-14T10:56:06.823223+0000","last_active":"2024-09-14T11:35:11.993637+0000","last_peered":"2024-09-14T11:35:11.993637+0000","last_clean":"2024-09-14T11:35:11.993637+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:35:11.993637+0000","last_undegraded":"2024-09-14T11:35:11.993637+0000","last_fullsized":"2024-09-14T11:35:11.993637+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:05.387288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20990213,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":1073,"num_read_kb":48196,"num_write":1145,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891740+0000","last_change":"2024-09-14T10:56:10.850019+0000","last_active":"2024-09-14T11:34:29.891740+0000","last_peered":"2024-09-14T11:34:29.891740+0000","last_clean":"2024-09-14T11:34:29.891740+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:34:29.891740+0000","last_undegraded":"2024-09-14T11:34:29.891740+0000","last_fullsized":"2024-09-14T11:34:29.891740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:25.627310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'343","reported_seq":934,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:42.893780+0000","last_change":"2024-09-14T10:56:12.853756+0000","last_active":"2024-09-14T11:36:42.893780+0000","last_peered":"2024-09-14T11:36:42.893780+0000","last_clean":"2024-09-14T11:36:42.893780+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:36:42.893780+0000","last_undegraded":"2024-09-14T11:36:42.893780+0000","last_fullsized":"2024-09-14T11:36:42.893780+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:44.126582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54758,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1165,"num_read_kb":1631,"num_write":1692,"num_write_kb":1560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891290+0000","last_change":"2024-09-14T10:56:14.865772+0000","last_active":"2024-09-14T11:34:29.891290+0000","last_peered":"2024-09-14T11:34:29.891290+0000","last_clean":"2024-09-14T11:34:29.891290+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:34:29.891290+0000","last_undegraded":"2024-09-14T11:34:29.891290+0000","last_fullsized":"2024-09-14T11:34:29.891290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:37.189265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.162130+0000","last_change":"2024-09-14T10:56:16.875685+0000","last_active":"2024-09-14T11:35:37.162130+0000","last_peered":"2024-09-14T11:35:37.162130+0000","last_clean":"2024-09-14T11:35:37.162130+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:35:37.162130+0000","last_undegraded":"2024-09-14T11:35:37.162130+0000","last_fullsized":"2024-09-14T11:35:37.162130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:13.149449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.085890+0000","last_change":"2024-09-14T10:56:08.845279+0000","last_active":"2024-09-14T11:35:16.085890+0000","last_peered":"2024-09-14T11:35:16.085890+0000","last_clean":"2024-09-14T11:35:16.085890+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:35:16.085890+0000","last_undegraded":"2024-09-14T11:35:16.085890+0000","last_fullsized":"2024-09-14T11:35:16.085890+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:06.992049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886612+0000","last_change":"2024-09-14T10:55:50.534148+0000","last_active":"2024-09-14T11:33:54.886612+0000","last_peered":"2024-09-14T11:33:54.886612+0000","last_clean":"2024-09-14T11:33:54.886612+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:33:54.886612+0000","last_undegraded":"2024-09-14T11:33:54.886612+0000","last_fullsized":"2024-09-14T11:33:54.886612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_clean_scrub_stamp":"2024-09-14T10:55:48.742998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:03.355721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883203+0000","last_change":"2024-09-14T10:55:58.792442+0000","last_active":"2024-09-14T11:35:32.883203+0000","last_peered":"2024-09-14T11:35:32.883203+0000","last_clean":"2024-09-14T11:35:32.883203+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:35:32.883203+0000","last_undegraded":"2024-09-14T11:35:32.883203+0000","last_fullsized":"2024-09-14T11:35:32.883203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:23.936072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'256","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:28.687141+0000","last_change":"2024-09-14T10:56:06.824568+0000","last_active":"2024-09-14T11:35:28.687141+0000","last_peered":"2024-09-14T11:35:28.687141+0000","last_clean":"2024-09-14T11:35:28.687141+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:35:28.687141+0000","last_undegraded":"2024-09-14T11:35:28.687141+0000","last_fullsized":"2024-09-14T11:35:28.687141+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:35.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9233775,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":558,"num_read_kb":14625,"num_write":896,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885320+0000","last_change":"2024-09-14T10:56:10.847413+0000","last_active":"2024-09-14T11:33:44.885320+0000","last_peered":"2024-09-14T11:33:44.885320+0000","last_clean":"2024-09-14T11:33:44.885320+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:33:44.885320+0000","last_undegraded":"2024-09-14T11:33:44.885320+0000","last_fullsized":"2024-09-14T11:33:44.885320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:14.506201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'714","reported_seq":1393,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.626086+0000","last_change":"2024-09-14T10:56:12.853693+0000","last_active":"2024-09-14T11:37:14.626086+0000","last_peered":"2024-09-14T11:37:14.626086+0000","last_clean":"2024-09-14T11:37:14.626086+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:37:14.626086+0000","last_undegraded":"2024-09-14T11:37:14.626086+0000","last_fullsized":"2024-09-14T11:37:14.626086+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":700,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.618315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":169174,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1373,"num_read_kb":2881,"num_write":1282,"num_write_kb":1133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764311+0000","last_change":"2024-09-14T10:56:14.867670+0000","last_active":"2024-09-14T11:35:18.764311+0000","last_peered":"2024-09-14T11:35:18.764311+0000","last_clean":"2024-09-14T11:35:18.764311+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:35:18.764311+0000","last_undegraded":"2024-09-14T11:35:18.764311+0000","last_fullsized":"2024-09-14T11:35:18.764311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:07.515289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'194","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.647341+0000","last_change":"2024-09-14T10:56:16.872059+0000","last_active":"2024-09-14T11:35:56.647341+0000","last_peered":"2024-09-14T11:35:56.647341+0000","last_clean":"2024-09-14T11:35:56.647341+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:35:56.647341+0000","last_undegraded":"2024-09-14T11:35:56.647341+0000","last_fullsized":"2024-09-14T11:35:56.647341+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.250321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'188","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763118+0000","last_change":"2024-09-14T10:56:08.839810+0000","last_active":"2024-09-14T11:35:08.763118+0000","last_peered":"2024-09-14T11:35:08.763118+0000","last_clean":"2024-09-14T11:35:08.763118+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:35:08.763118+0000","last_undegraded":"2024-09-14T11:35:08.763118+0000","last_fullsized":"2024-09-14T11:35:08.763118+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:33.165560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.887822+0000","last_change":"2024-09-14T10:55:59.204366+0000","last_active":"2024-09-14T11:34:04.887822+0000","last_peered":"2024-09-14T11:34:04.887822+0000","last_clean":"2024-09-14T11:34:04.887822+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:34:04.887822+0000","last_undegraded":"2024-09-14T11:34:04.887822+0000","last_fullsized":"2024-09-14T11:34:04.887822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:15.414745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'330","reported_seq":1021,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:08.883097+0000","last_change":"2024-09-14T10:56:06.833177+0000","last_active":"2024-09-14T11:37:08.883097+0000","last_peered":"2024-09-14T11:37:08.883097+0000","last_clean":"2024-09-14T11:37:08.883097+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:08.883097+0000","last_undegraded":"2024-09-14T11:37:08.883097+0000","last_fullsized":"2024-09-14T11:37:08.883097+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:52.299621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8235302,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":734,"num_read_kb":83524,"num_write":1196,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"35'5","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.361405+0000","last_change":"2024-09-14T10:56:10.849032+0000","last_active":"2024-09-14T11:37:14.361405+0000","last_peered":"2024-09-14T11:37:14.361405+0000","last_clean":"2024-09-14T11:37:14.361405+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:37:14.361405+0000","last_undegraded":"2024-09-14T11:37:14.361405+0000","last_fullsized":"2024-09-14T11:37:14.361405+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:01.123575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":723,"num_read_kb":1184,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1218","reported_seq":2632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.640791+0000","last_change":"2024-09-14T10:56:12.856442+0000","last_active":"2024-09-14T11:37:14.640791+0000","last_peered":"2024-09-14T11:37:14.640791+0000","last_clean":"2024-09-14T11:37:14.640791+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:37:14.640791+0000","last_undegraded":"2024-09-14T11:37:14.640791+0000","last_fullsized":"2024-09-14T11:37:14.640791+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":1200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":159731,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1938,"num_read_kb":3334,"num_write":1058,"num_write_kb":900,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:49.886081+0000","last_change":"2024-09-14T10:56:14.860734+0000","last_active":"2024-09-14T11:33:49.886081+0000","last_peered":"2024-09-14T11:33:49.886081+0000","last_clean":"2024-09-14T11:33:49.886081+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:33:49.886081+0000","last_undegraded":"2024-09-14T11:33:49.886081+0000","last_fullsized":"2024-09-14T11:33:49.886081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:40.424100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'240","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.064636+0000","last_change":"2024-09-14T10:56:16.876125+0000","last_active":"2024-09-14T11:35:54.064636+0000","last_peered":"2024-09-14T11:35:54.064636+0000","last_clean":"2024-09-14T11:35:54.064636+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:35:54.064636+0000","last_undegraded":"2024-09-14T11:35:54.064636+0000","last_fullsized":"2024-09-14T11:35:54.064636+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.302671+0000","last_change":"2024-09-14T10:56:42.662120+0000","last_active":"2024-09-14T11:34:26.302671+0000","last_peered":"2024-09-14T11:34:26.302671+0000","last_clean":"2024-09-14T11:34:26.302671+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:34:26.302671+0000","last_undegraded":"2024-09-14T11:34:26.302671+0000","last_fullsized":"2024-09-14T11:34:26.302671+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:08.405772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:34.868699+0000","last_change":"2024-09-14T10:55:59.134312+0000","last_active":"2024-09-14T11:35:34.868699+0000","last_peered":"2024-09-14T11:35:34.868699+0000","last_clean":"2024-09-14T11:35:34.868699+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:35:34.868699+0000","last_undegraded":"2024-09-14T11:35:34.868699+0000","last_fullsized":"2024-09-14T11:35:34.868699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:08.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'293","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.760784+0000","last_change":"2024-09-14T10:56:06.820891+0000","last_active":"2024-09-14T11:35:31.760784+0000","last_peered":"2024-09-14T11:35:31.760784+0000","last_clean":"2024-09-14T11:35:31.760784+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:35:31.760784+0000","last_undegraded":"2024-09-14T11:35:31.760784+0000","last_fullsized":"2024-09-14T11:35:31.760784+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:17.493636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23507759,"num_objects":71,"num_object_clones":0,"num_object_copies":142,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":0,"num_read":574,"num_read_kb":61657,"num_write":1131,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866597+0000","last_change":"2024-09-14T10:56:10.852125+0000","last_active":"2024-09-14T11:35:14.866597+0000","last_peered":"2024-09-14T11:35:14.866597+0000","last_clean":"2024-09-14T11:35:14.866597+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:35:14.866597+0000","last_undegraded":"2024-09-14T11:35:14.866597+0000","last_fullsized":"2024-09-14T11:35:14.866597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:31.365946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'215","reported_seq":1248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:10.201505+0000","last_change":"2024-09-14T10:56:13.041674+0000","last_active":"2024-09-14T11:37:10.201505+0000","last_peered":"2024-09-14T11:37:10.201505+0000","last_clean":"2024-09-14T11:37:10.201505+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:37:10.201505+0000","last_undegraded":"2024-09-14T11:37:10.201505+0000","last_fullsized":"2024-09-14T11:37:10.201505+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:35.426913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752243+0000","last_change":"2024-09-14T10:56:14.869132+0000","last_active":"2024-09-14T11:33:48.752243+0000","last_peered":"2024-09-14T11:33:48.752243+0000","last_clean":"2024-09-14T11:33:48.752243+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:33:48.752243+0000","last_undegraded":"2024-09-14T11:33:48.752243+0000","last_fullsized":"2024-09-14T11:33:48.752243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:52.698938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'258","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.791105+0000","last_change":"2024-09-14T10:56:16.878981+0000","last_active":"2024-09-14T11:35:56.791105+0000","last_peered":"2024-09-14T11:35:56.791105+0000","last_clean":"2024-09-14T11:35:56.791105+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:35:56.791105+0000","last_undegraded":"2024-09-14T11:35:56.791105+0000","last_fullsized":"2024-09-14T11:35:56.791105+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:11.858964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.233763+0000","last_change":"2024-09-14T10:56:08.845281+0000","last_active":"2024-09-14T11:35:30.233763+0000","last_peered":"2024-09-14T11:35:30.233763+0000","last_clean":"2024-09-14T11:35:30.233763+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:35:30.233763+0000","last_undegraded":"2024-09-14T11:35:30.233763+0000","last_fullsized":"2024-09-14T11:35:30.233763+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:49.926283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883164+0000","last_change":"2024-09-14T10:55:58.793099+0000","last_active":"2024-09-14T11:35:32.883164+0000","last_peered":"2024-09-14T11:35:32.883164+0000","last_clean":"2024-09-14T11:35:32.883164+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:35:32.883164+0000","last_undegraded":"2024-09-14T11:35:32.883164+0000","last_fullsized":"2024-09-14T11:35:32.883164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:04.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'361","reported_seq":1109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.875978+0000","last_change":"2024-09-14T10:56:06.833233+0000","last_active":"2024-09-14T11:35:23.875978+0000","last_peered":"2024-09-14T11:35:23.875978+0000","last_clean":"2024-09-14T11:35:23.875978+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:35:23.875978+0000","last_undegraded":"2024-09-14T11:35:23.875978+0000","last_fullsized":"2024-09-14T11:35:23.875978+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:46.083613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10658231,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":823,"num_read_kb":119862,"num_write":1247,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752967+0000","last_change":"2024-09-14T10:56:10.848955+0000","last_active":"2024-09-14T11:33:53.752967+0000","last_peered":"2024-09-14T11:33:53.752967+0000","last_clean":"2024-09-14T11:33:53.752967+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:33:53.752967+0000","last_undegraded":"2024-09-14T11:33:53.752967+0000","last_fullsized":"2024-09-14T11:33:53.752967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:51.182938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.762188+0000","last_change":"2024-09-14T10:56:12.855698+0000","last_active":"2024-09-14T11:37:14.762188+0000","last_peered":"2024-09-14T11:37:14.762188+0000","last_clean":"2024-09-14T11:37:14.762188+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:37:14.762188+0000","last_undegraded":"2024-09-14T11:37:14.762188+0000","last_fullsized":"2024-09-14T11:37:14.762188+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:26.322719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897812+0000","last_change":"2024-09-14T10:56:14.864184+0000","last_active":"2024-09-14T11:35:14.897812+0000","last_peered":"2024-09-14T11:35:14.897812+0000","last_clean":"2024-09-14T11:35:14.897812+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:35:14.897812+0000","last_undegraded":"2024-09-14T11:35:14.897812+0000","last_fullsized":"2024-09-14T11:35:14.897812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:25.882149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.040892+0000","last_change":"2024-09-14T10:56:16.875071+0000","last_active":"2024-09-14T11:35:31.040892+0000","last_peered":"2024-09-14T11:35:31.040892+0000","last_clean":"2024-09-14T11:35:31.040892+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:35:31.040892+0000","last_undegraded":"2024-09-14T11:35:31.040892+0000","last_fullsized":"2024-09-14T11:35:31.040892+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:51.001726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.112032+0000","last_change":"2024-09-14T10:56:08.846819+0000","last_active":"2024-09-14T11:34:59.112032+0000","last_peered":"2024-09-14T11:34:59.112032+0000","last_clean":"2024-09-14T11:34:59.112032+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:34:59.112032+0000","last_undegraded":"2024-09-14T11:34:59.112032+0000","last_fullsized":"2024-09-14T11:34:59.112032+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:55.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'304","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.876486+0000","last_change":"2024-09-14T10:56:06.828378+0000","last_active":"2024-09-14T11:35:26.876486+0000","last_peered":"2024-09-14T11:35:26.876486+0000","last_clean":"2024-09-14T11:35:26.876486+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:35:26.876486+0000","last_undegraded":"2024-09-14T11:35:26.876486+0000","last_fullsized":"2024-09-14T11:35:26.876486+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":200,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.040311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":791374,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":581,"num_read_kb":12538,"num_write":1088,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.766384+0000","last_change":"2024-09-14T10:55:58.795298+0000","last_active":"2024-09-14T11:35:33.766384+0000","last_peered":"2024-09-14T11:35:33.766384+0000","last_clean":"2024-09-14T11:35:33.766384+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:35:33.766384+0000","last_undegraded":"2024-09-14T11:35:33.766384+0000","last_fullsized":"2024-09-14T11:35:33.766384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:33.298341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":967,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.348989+0000","last_change":"2024-09-14T10:56:10.849045+0000","last_active":"2024-09-14T11:37:14.348989+0000","last_peered":"2024-09-14T11:37:14.348989+0000","last_clean":"2024-09-14T11:37:14.348989+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:37:14.348989+0000","last_undegraded":"2024-09-14T11:37:14.348989+0000","last_fullsized":"2024-09-14T11:37:14.348989+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:24.164136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":721,"num_read_kb":719,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'581","reported_seq":1225,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.607266+0000","last_change":"2024-09-14T10:56:12.857610+0000","last_active":"2024-09-14T11:37:14.607266+0000","last_peered":"2024-09-14T11:37:14.607266+0000","last_clean":"2024-09-14T11:37:14.607266+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:37:14.607266+0000","last_undegraded":"2024-09-14T11:37:14.607266+0000","last_fullsized":"2024-09-14T11:37:14.607266+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":500,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.734579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":116352,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":966,"num_read_kb":1953,"num_write":838,"num_write_kb":673,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885969+0000","last_change":"2024-09-14T10:56:14.866887+0000","last_active":"2024-09-14T11:33:44.885969+0000","last_peered":"2024-09-14T11:33:44.885969+0000","last_clean":"2024-09-14T11:33:44.885969+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:33:44.885969+0000","last_undegraded":"2024-09-14T11:33:44.885969+0000","last_fullsized":"2024-09-14T11:33:44.885969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:18.571111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.463557+0000","last_change":"2024-09-14T10:56:16.874511+0000","last_active":"2024-09-14T11:35:33.463557+0000","last_peered":"2024-09-14T11:35:33.463557+0000","last_clean":"2024-09-14T11:35:33.463557+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:35:33.463557+0000","last_undegraded":"2024-09-14T11:35:33.463557+0000","last_fullsized":"2024-09-14T11:35:33.463557+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:37.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.061566+0000","last_change":"2024-09-14T10:56:08.844695+0000","last_active":"2024-09-14T11:35:54.061566+0000","last_peered":"2024-09-14T11:35:54.061566+0000","last_clean":"2024-09-14T11:35:54.061566+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:35:54.061566+0000","last_undegraded":"2024-09-14T11:35:54.061566+0000","last_fullsized":"2024-09-14T11:35:54.061566+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:48.072778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'301","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.414849+0000","last_change":"2024-09-14T10:56:06.820948+0000","last_active":"2024-09-14T11:35:33.414849+0000","last_peered":"2024-09-14T11:35:33.414849+0000","last_clean":"2024-09-14T11:35:33.414849+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:35:33.414849+0000","last_undegraded":"2024-09-14T11:35:33.414849+0000","last_fullsized":"2024-09-14T11:35:33.414849+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:42.568606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5243507,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":0,"num_read":655,"num_read_kb":48648,"num_write":1173,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901911+0000","last_change":"2024-09-14T10:55:59.204323+0000","last_active":"2024-09-14T11:35:39.901911+0000","last_peered":"2024-09-14T11:35:39.901911+0000","last_clean":"2024-09-14T11:35:39.901911+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:35:39.901911+0000","last_undegraded":"2024-09-14T11:35:39.901911+0000","last_fullsized":"2024-09-14T11:35:39.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:50.070588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885825+0000","last_change":"2024-09-14T10:56:10.846790+0000","last_active":"2024-09-14T11:33:44.885825+0000","last_peered":"2024-09-14T11:33:44.885825+0000","last_clean":"2024-09-14T11:33:44.885825+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:33:44.885825+0000","last_undegraded":"2024-09-14T11:33:44.885825+0000","last_fullsized":"2024-09-14T11:33:44.885825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:14.639629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'148","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.474378+0000","last_change":"2024-09-14T10:56:13.041311+0000","last_active":"2024-09-14T11:36:21.474378+0000","last_peered":"2024-09-14T11:36:21.474378+0000","last_clean":"2024-09-14T11:36:21.474378+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:36:21.474378+0000","last_undegraded":"2024-09-14T11:36:21.474378+0000","last_fullsized":"2024-09-14T11:36:21.474378+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:12.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'789","reported_seq":2754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.642783+0000","last_change":"2024-09-14T10:56:14.864682+0000","last_active":"2024-09-14T11:37:14.642783+0000","last_peered":"2024-09-14T11:37:14.642783+0000","last_clean":"2024-09-14T11:37:14.642783+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:37:14.642783+0000","last_undegraded":"2024-09-14T11:37:14.642783+0000","last_fullsized":"2024-09-14T11:37:14.642783+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.506777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'136","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:55.622534+0000","last_change":"2024-09-14T10:56:16.878173+0000","last_active":"2024-09-14T11:36:55.622534+0000","last_peered":"2024-09-14T11:36:55.622534+0000","last_clean":"2024-09-14T11:36:55.622534+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:36:55.622534+0000","last_undegraded":"2024-09-14T11:36:55.622534+0000","last_fullsized":"2024-09-14T11:36:55.622534+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:18.316372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.457301+0000","last_change":"2024-09-14T10:56:08.849379+0000","last_active":"2024-09-14T11:37:13.457301+0000","last_peered":"2024-09-14T11:37:13.457301+0000","last_clean":"2024-09-14T11:37:13.457301+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:37:13.457301+0000","last_undegraded":"2024-09-14T11:37:13.457301+0000","last_fullsized":"2024-09-14T11:37:13.457301+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:13.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'280","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:10.609210+0000","last_change":"2024-09-14T10:56:06.833600+0000","last_active":"2024-09-14T11:35:10.609210+0000","last_peered":"2024-09-14T11:35:10.609210+0000","last_clean":"2024-09-14T11:35:10.609210+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:35:10.609210+0000","last_undegraded":"2024-09-14T11:35:10.609210+0000","last_fullsized":"2024-09-14T11:35:10.609210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:55.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7480146,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":475,"num_read_kb":3885,"num_write":978,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761758+0000","last_change":"2024-09-14T10:55:58.795304+0000","last_active":"2024-09-14T11:34:58.761758+0000","last_peered":"2024-09-14T11:34:58.761758+0000","last_clean":"2024-09-14T11:34:58.761758+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:34:58.761758+0000","last_undegraded":"2024-09-14T11:34:58.761758+0000","last_fullsized":"2024-09-14T11:34:58.761758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:07.609351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885956+0000","last_change":"2024-09-14T10:56:10.845757+0000","last_active":"2024-09-14T11:33:44.885956+0000","last_peered":"2024-09-14T11:33:44.885956+0000","last_clean":"2024-09-14T11:33:44.885956+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:33:44.885956+0000","last_undegraded":"2024-09-14T11:33:44.885956+0000","last_fullsized":"2024-09-14T11:33:44.885956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:40.015207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'105","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.461753+0000","last_change":"2024-09-14T10:56:12.854078+0000","last_active":"2024-09-14T11:36:21.461753+0000","last_peered":"2024-09-14T11:36:21.461753+0000","last_clean":"2024-09-14T11:36:21.461753+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:36:21.461753+0000","last_undegraded":"2024-09-14T11:36:21.461753+0000","last_fullsized":"2024-09-14T11:36:21.461753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:53.954428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'791","reported_seq":2381,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.647364+0000","last_change":"2024-09-14T10:56:14.861395+0000","last_active":"2024-09-14T11:37:14.647364+0000","last_peered":"2024-09-14T11:37:14.647364+0000","last_clean":"2024-09-14T11:37:14.647364+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:37:14.647364+0000","last_undegraded":"2024-09-14T11:37:14.647364+0000","last_fullsized":"2024-09-14T11:37:14.647364+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:14.062981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'253","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.639576+0000","last_change":"2024-09-14T10:56:16.874903+0000","last_active":"2024-09-14T11:35:56.639576+0000","last_peered":"2024-09-14T11:35:56.639576+0000","last_clean":"2024-09-14T11:35:56.639576+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:35:56.639576+0000","last_undegraded":"2024-09-14T11:35:56.639576+0000","last_fullsized":"2024-09-14T11:35:56.639576+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.818843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:14.482865+0000","last_change":"2024-09-14T10:56:08.841683+0000","last_active":"2024-09-14T11:34:14.482865+0000","last_peered":"2024-09-14T11:34:14.482865+0000","last_clean":"2024-09-14T11:34:14.482865+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:34:14.482865+0000","last_undegraded":"2024-09-14T11:34:14.482865+0000","last_fullsized":"2024-09-14T11:34:14.482865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:09.542327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'292","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.361037+0000","last_change":"2024-09-14T10:56:06.831292+0000","last_active":"2024-09-14T11:37:09.361037+0000","last_peered":"2024-09-14T11:37:09.361037+0000","last_clean":"2024-09-14T11:37:09.361037+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:09.361037+0000","last_undegraded":"2024-09-14T11:37:09.361037+0000","last_fullsized":"2024-09-14T11:37:09.361037+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:53.008130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11822863,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":781,"num_read_kb":56309,"num_write":1078,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895598+0000","last_change":"2024-09-14T10:55:59.387955+0000","last_active":"2024-09-14T11:34:59.895598+0000","last_peered":"2024-09-14T11:34:59.895598+0000","last_clean":"2024-09-14T11:34:59.895598+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:34:59.895598+0000","last_undegraded":"2024-09-14T11:34:59.895598+0000","last_fullsized":"2024-09-14T11:34:59.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:35.502046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.602419+0000","last_change":"2024-09-14T10:56:10.847591+0000","last_active":"2024-09-14T11:34:20.602419+0000","last_peered":"2024-09-14T11:34:20.602419+0000","last_clean":"2024-09-14T11:34:20.602419+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:34:20.602419+0000","last_undegraded":"2024-09-14T11:34:20.602419+0000","last_fullsized":"2024-09-14T11:34:20.602419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:12.477652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'703","reported_seq":1397,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.603594+0000","last_change":"2024-09-14T10:56:13.041312+0000","last_active":"2024-09-14T11:37:14.603594+0000","last_peered":"2024-09-14T11:37:14.603594+0000","last_clean":"2024-09-14T11:37:14.603594+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:37:14.603594+0000","last_undegraded":"2024-09-14T11:37:14.603594+0000","last_fullsized":"2024-09-14T11:37:14.603594+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:15.894086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164960,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1252,"num_read_kb":2696,"num_write":1032,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598055+0000","last_change":"2024-09-14T10:56:14.856227+0000","last_active":"2024-09-14T11:33:45.598055+0000","last_peered":"2024-09-14T11:33:45.598055+0000","last_clean":"2024-09-14T11:33:45.598055+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:33:45.598055+0000","last_undegraded":"2024-09-14T11:33:45.598055+0000","last_fullsized":"2024-09-14T11:33:45.598055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:33.427287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'135","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.661856+0000","last_change":"2024-09-14T10:56:16.875970+0000","last_active":"2024-09-14T11:35:32.661856+0000","last_peered":"2024-09-14T11:35:32.661856+0000","last_clean":"2024-09-14T11:35:32.661856+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:35:32.661856+0000","last_undegraded":"2024-09-14T11:35:32.661856+0000","last_fullsized":"2024-09-14T11:35:32.661856+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.939235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'137","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.148825+0000","last_change":"2024-09-14T10:56:16.878602+0000","last_active":"2024-09-14T11:35:56.148825+0000","last_peered":"2024-09-14T11:35:56.148825+0000","last_clean":"2024-09-14T11:35:56.148825+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:35:56.148825+0000","last_undegraded":"2024-09-14T11:35:56.148825+0000","last_fullsized":"2024-09-14T11:35:56.148825+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:22.821986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'295","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.068636+0000","last_change":"2024-09-14T10:56:08.840398+0000","last_active":"2024-09-14T11:34:47.068636+0000","last_peered":"2024-09-14T11:34:47.068636+0000","last_clean":"2024-09-14T11:34:47.068636+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:34:47.068636+0000","last_undegraded":"2024-09-14T11:34:47.068636+0000","last_fullsized":"2024-09-14T11:34:47.068636+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:37.548644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'233","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.279430+0000","last_change":"2024-09-14T10:56:06.832210+0000","last_active":"2024-09-14T11:35:36.279430+0000","last_peered":"2024-09-14T11:35:36.279430+0000","last_clean":"2024-09-14T11:35:36.279430+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:35:36.279430+0000","last_undegraded":"2024-09-14T11:35:36.279430+0000","last_fullsized":"2024-09-14T11:35:36.279430+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:05.108211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325342,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":440,"num_read_kb":2273,"num_write":854,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:33.863009+0000","last_change":"2024-09-14T10:56:10.850437+0000","last_active":"2024-09-14T11:33:33.863009+0000","last_peered":"2024-09-14T11:33:33.863009+0000","last_clean":"2024-09-14T11:33:33.863009+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:33:33.863009+0000","last_undegraded":"2024-09-14T11:33:33.863009+0000","last_fullsized":"2024-09-14T11:33:33.863009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.749205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'250","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.477571+0000","last_change":"2024-09-14T10:56:12.855555+0000","last_active":"2024-09-14T11:36:21.477571+0000","last_peered":"2024-09-14T11:36:21.477571+0000","last_clean":"2024-09-14T11:36:21.477571+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:36:21.477571+0000","last_undegraded":"2024-09-14T11:36:21.477571+0000","last_fullsized":"2024-09-14T11:36:21.477571+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:39.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":804,"num_write":322,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596468+0000","last_change":"2024-09-14T10:56:14.859912+0000","last_active":"2024-09-14T11:33:35.596468+0000","last_peered":"2024-09-14T11:33:35.596468+0000","last_clean":"2024-09-14T11:33:35.596468+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:33:35.596468+0000","last_undegraded":"2024-09-14T11:33:35.596468+0000","last_fullsized":"2024-09-14T11:33:35.596468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:50.590250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'113","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.905145+0000","last_change":"2024-09-14T10:56:16.876189+0000","last_active":"2024-09-14T11:35:54.905145+0000","last_peered":"2024-09-14T11:35:54.905145+0000","last_clean":"2024-09-14T11:35:54.905145+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:35:54.905145+0000","last_undegraded":"2024-09-14T11:35:54.905145+0000","last_fullsized":"2024-09-14T11:35:54.905145+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:08.040744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.724841+0000","last_change":"2024-09-14T10:56:08.846963+0000","last_active":"2024-09-14T11:35:17.724841+0000","last_peered":"2024-09-14T11:35:17.724841+0000","last_clean":"2024-09-14T11:35:17.724841+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:35:17.724841+0000","last_undegraded":"2024-09-14T11:35:17.724841+0000","last_fullsized":"2024-09-14T11:35:17.724841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:44.520201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'253","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.307138+0000","last_change":"2024-09-14T10:56:06.832027+0000","last_active":"2024-09-14T11:35:26.307138+0000","last_peered":"2024-09-14T11:35:26.307138+0000","last_clean":"2024-09-14T11:35:26.307138+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:35:26.307138+0000","last_undegraded":"2024-09-14T11:35:26.307138+0000","last_fullsized":"2024-09-14T11:35:26.307138+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:30.367132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12492827,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":539,"num_read_kb":9274,"num_write":905,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596533+0000","last_change":"2024-09-14T10:56:10.846714+0000","last_active":"2024-09-14T11:33:35.596533+0000","last_peered":"2024-09-14T11:33:35.596533+0000","last_clean":"2024-09-14T11:33:35.596533+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:33:35.596533+0000","last_undegraded":"2024-09-14T11:33:35.596533+0000","last_fullsized":"2024-09-14T11:33:35.596533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:14.559729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'57","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.293027+0000","last_change":"2024-09-14T10:56:12.851172+0000","last_active":"2024-09-14T11:36:21.293027+0000","last_peered":"2024-09-14T11:36:21.293027+0000","last_clean":"2024-09-14T11:36:21.293027+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:36:21.293027+0000","last_undegraded":"2024-09-14T11:36:21.293027+0000","last_fullsized":"2024-09-14T11:36:21.293027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:56.828348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883833+0000","last_change":"2024-09-14T10:56:14.869388+0000","last_active":"2024-09-14T11:33:34.883833+0000","last_peered":"2024-09-14T11:33:34.883833+0000","last_clean":"2024-09-14T11:33:34.883833+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:33:34.883833+0000","last_undegraded":"2024-09-14T11:33:34.883833+0000","last_fullsized":"2024-09-14T11:33:34.883833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:37.817198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.091148+0000","last_change":"2024-09-14T10:56:16.870386+0000","last_active":"2024-09-14T11:35:56.091148+0000","last_peered":"2024-09-14T11:35:56.091148+0000","last_clean":"2024-09-14T11:35:56.091148+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:35:56.091148+0000","last_undegraded":"2024-09-14T11:35:56.091148+0000","last_fullsized":"2024-09-14T11:35:56.091148+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:47.067599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.083359+0000","last_change":"2024-09-14T10:56:08.846942+0000","last_active":"2024-09-14T11:35:56.083359+0000","last_peered":"2024-09-14T11:35:56.083359+0000","last_clean":"2024-09-14T11:35:56.083359+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:35:56.083359+0000","last_undegraded":"2024-09-14T11:35:56.083359+0000","last_fullsized":"2024-09-14T11:35:56.083359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:59.799497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'292","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.876575+0000","last_change":"2024-09-14T10:56:06.836735+0000","last_active":"2024-09-14T11:34:47.876575+0000","last_peered":"2024-09-14T11:34:47.876575+0000","last_clean":"2024-09-14T11:34:47.876575+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:34:47.876575+0000","last_undegraded":"2024-09-14T11:34:47.876575+0000","last_fullsized":"2024-09-14T11:34:47.876575+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:57.401574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":381373,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":560,"num_read_kb":2982,"num_write":1103,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883799+0000","last_change":"2024-09-14T10:56:10.850036+0000","last_active":"2024-09-14T11:33:34.883799+0000","last_peered":"2024-09-14T11:33:34.883799+0000","last_clean":"2024-09-14T11:33:34.883799+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:33:34.883799+0000","last_undegraded":"2024-09-14T11:33:34.883799+0000","last_fullsized":"2024-09-14T11:33:34.883799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.348764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'303","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.449820+0000","last_change":"2024-09-14T10:56:12.856115+0000","last_active":"2024-09-14T11:36:21.449820+0000","last_peered":"2024-09-14T11:36:21.449820+0000","last_clean":"2024-09-14T11:36:21.449820+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:36:21.449820+0000","last_undegraded":"2024-09-14T11:36:21.449820+0000","last_fullsized":"2024-09-14T11:36:21.449820+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:16.373969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1003,"num_write":408,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884434+0000","last_change":"2024-09-14T10:56:14.869461+0000","last_active":"2024-09-14T11:33:34.884434+0000","last_peered":"2024-09-14T11:33:34.884434+0000","last_clean":"2024-09-14T11:33:34.884434+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:33:34.884434+0000","last_undegraded":"2024-09-14T11:33:34.884434+0000","last_fullsized":"2024-09-14T11:33:34.884434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:05.233425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'185","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.325833+0000","last_change":"2024-09-14T10:56:16.875845+0000","last_active":"2024-09-14T11:35:36.325833+0000","last_peered":"2024-09-14T11:35:36.325833+0000","last_clean":"2024-09-14T11:35:36.325833+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:35:36.325833+0000","last_undegraded":"2024-09-14T11:35:36.325833+0000","last_fullsized":"2024-09-14T11:35:36.325833+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:59.857949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:11.701560+0000","last_change":"2024-09-14T10:56:08.839406+0000","last_active":"2024-09-14T11:34:11.701560+0000","last_peered":"2024-09-14T11:34:11.701560+0000","last_clean":"2024-09-14T11:34:11.701560+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:34:11.701560+0000","last_undegraded":"2024-09-14T11:34:11.701560+0000","last_fullsized":"2024-09-14T11:34:11.701560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:41.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'253","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:48.760518+0000","last_change":"2024-09-14T10:56:06.837904+0000","last_active":"2024-09-14T11:34:48.760518+0000","last_peered":"2024-09-14T11:34:48.760518+0000","last_clean":"2024-09-14T11:34:48.760518+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:34:48.760518+0000","last_undegraded":"2024-09-14T11:34:48.760518+0000","last_fullsized":"2024-09-14T11:34:48.760518+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:12.136843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584163,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":443,"num_read_kb":4352,"num_write":887,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884386+0000","last_change":"2024-09-14T10:56:10.852317+0000","last_active":"2024-09-14T11:33:34.884386+0000","last_peered":"2024-09-14T11:33:34.884386+0000","last_clean":"2024-09-14T11:33:34.884386+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:33:34.884386+0000","last_undegraded":"2024-09-14T11:33:34.884386+0000","last_fullsized":"2024-09-14T11:33:34.884386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:16.512220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'258","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.373604+0000","last_change":"2024-09-14T10:56:12.848425+0000","last_active":"2024-09-14T11:36:21.373604+0000","last_peered":"2024-09-14T11:36:21.373604+0000","last_clean":"2024-09-14T11:36:21.373604+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:36:21.373604+0000","last_undegraded":"2024-09-14T11:36:21.373604+0000","last_fullsized":"2024-09-14T11:36:21.373604+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:32.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":874,"num_write":342,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750839+0000","last_change":"2024-09-14T10:56:14.863993+0000","last_active":"2024-09-14T11:33:38.750839+0000","last_peered":"2024-09-14T11:33:38.750839+0000","last_clean":"2024-09-14T11:33:38.750839+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:33:38.750839+0000","last_undegraded":"2024-09-14T11:33:38.750839+0000","last_fullsized":"2024-09-14T11:33:38.750839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:28.114909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.115874+0000","last_change":"2024-09-14T10:56:08.840371+0000","last_active":"2024-09-14T11:34:57.115874+0000","last_peered":"2024-09-14T11:34:57.115874+0000","last_clean":"2024-09-14T11:34:57.115874+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:34:57.115874+0000","last_undegraded":"2024-09-14T11:34:57.115874+0000","last_fullsized":"2024-09-14T11:34:57.115874+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:29.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'249","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:50.606583+0000","last_change":"2024-09-14T10:56:06.829430+0000","last_active":"2024-09-14T11:34:50.606583+0000","last_peered":"2024-09-14T11:34:50.606583+0000","last_clean":"2024-09-14T11:34:50.606583+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:34:50.606583+0000","last_undegraded":"2024-09-14T11:34:50.606583+0000","last_fullsized":"2024-09-14T11:34:50.606583+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:54.337485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12172022,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":428,"num_read_kb":11663,"num_write":905,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756814+0000","last_change":"2024-09-14T10:56:10.845758+0000","last_active":"2024-09-14T11:34:23.756814+0000","last_peered":"2024-09-14T11:34:23.756814+0000","last_clean":"2024-09-14T11:34:23.756814+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:34:23.756814+0000","last_undegraded":"2024-09-14T11:34:23.756814+0000","last_fullsized":"2024-09-14T11:34:23.756814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'469","reported_seq":1082,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.600233+0000","last_change":"2024-09-14T10:56:12.857013+0000","last_active":"2024-09-14T11:37:14.600233+0000","last_peered":"2024-09-14T11:37:14.600233+0000","last_clean":"2024-09-14T11:37:14.600233+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:37:14.600233+0000","last_undegraded":"2024-09-14T11:37:14.600233+0000","last_fullsized":"2024-09-14T11:37:14.600233+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":206865,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":829,"num_read_kb":1977,"num_write":726,"num_write_kb":745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868166+0000","last_change":"2024-09-14T10:56:14.866608+0000","last_active":"2024-09-14T11:33:47.868166+0000","last_peered":"2024-09-14T11:33:47.868166+0000","last_clean":"2024-09-14T11:33:47.868166+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:33:47.868166+0000","last_undegraded":"2024-09-14T11:33:47.868166+0000","last_fullsized":"2024-09-14T11:33:47.868166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:07.568392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'180","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.637830+0000","last_change":"2024-09-14T10:56:16.877816+0000","last_active":"2024-09-14T11:35:56.637830+0000","last_peered":"2024-09-14T11:35:56.637830+0000","last_clean":"2024-09-14T11:35:56.637830+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:35:56.637830+0000","last_undegraded":"2024-09-14T11:35:56.637830+0000","last_fullsized":"2024-09-14T11:35:56.637830+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.287323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.254239+0000","last_change":"2024-09-14T10:56:08.843523+0000","last_active":"2024-09-14T11:34:54.254239+0000","last_peered":"2024-09-14T11:34:54.254239+0000","last_clean":"2024-09-14T11:34:54.254239+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:34:54.254239+0000","last_undegraded":"2024-09-14T11:34:54.254239+0000","last_fullsized":"2024-09-14T11:34:54.254239+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:16.988838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'263","reported_seq":866,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:08.886773+0000","last_change":"2024-09-14T10:56:06.824700+0000","last_active":"2024-09-14T11:37:08.886773+0000","last_peered":"2024-09-14T11:37:08.886773+0000","last_clean":"2024-09-14T11:37:08.886773+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:08.886773+0000","last_undegraded":"2024-09-14T11:37:08.886773+0000","last_fullsized":"2024-09-14T11:37:08.886773+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:30.572275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2748276,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":431,"num_read_kb":3066,"num_write":934,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885912+0000","last_change":"2024-09-14T10:56:10.851611+0000","last_active":"2024-09-14T11:33:44.885912+0000","last_peered":"2024-09-14T11:33:44.885912+0000","last_clean":"2024-09-14T11:33:44.885912+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:33:44.885912+0000","last_undegraded":"2024-09-14T11:33:44.885912+0000","last_fullsized":"2024-09-14T11:33:44.885912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.503933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'331","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.464520+0000","last_change":"2024-09-14T10:56:12.850684+0000","last_active":"2024-09-14T11:37:13.464520+0000","last_peered":"2024-09-14T11:37:13.464520+0000","last_clean":"2024-09-14T11:37:13.464520+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:37:13.464520+0000","last_undegraded":"2024-09-14T11:37:13.464520+0000","last_fullsized":"2024-09-14T11:37:13.464520+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.655979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":1107,"num_write":466,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.864958+0000","last_change":"2024-09-14T10:56:14.863516+0000","last_active":"2024-09-14T11:33:48.864958+0000","last_peered":"2024-09-14T11:33:48.864958+0000","last_clean":"2024-09-14T11:33:48.864958+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:33:48.864958+0000","last_undegraded":"2024-09-14T11:33:48.864958+0000","last_fullsized":"2024-09-14T11:33:48.864958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.527433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.073475+0000","last_change":"2024-09-14T10:56:16.873262+0000","last_active":"2024-09-14T11:35:27.073475+0000","last_peered":"2024-09-14T11:35:27.073475+0000","last_clean":"2024-09-14T11:35:27.073475+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:35:27.073475+0000","last_undegraded":"2024-09-14T11:35:27.073475+0000","last_fullsized":"2024-09-14T11:35:27.073475+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:21.859002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.926778+0000","last_change":"2024-09-14T10:56:08.841022+0000","last_active":"2024-09-14T11:35:23.926778+0000","last_peered":"2024-09-14T11:35:23.926778+0000","last_clean":"2024-09-14T11:35:23.926778+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:35:23.926778+0000","last_undegraded":"2024-09-14T11:35:23.926778+0000","last_fullsized":"2024-09-14T11:35:23.926778+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:11.924992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'299","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.832223+0000","last_change":"2024-09-14T10:56:06.831161+0000","last_active":"2024-09-14T11:34:23.832223+0000","last_peered":"2024-09-14T11:34:23.832223+0000","last_clean":"2024-09-14T11:34:23.832223+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:34:23.832223+0000","last_undegraded":"2024-09-14T11:34:23.832223+0000","last_fullsized":"2024-09-14T11:34:23.832223+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:43.805445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16832488,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":510,"num_read_kb":69620,"num_write":1071,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886067+0000","last_change":"2024-09-14T10:56:10.848128+0000","last_active":"2024-09-14T11:33:44.886067+0000","last_peered":"2024-09-14T11:33:44.886067+0000","last_clean":"2024-09-14T11:33:44.886067+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:33:44.886067+0000","last_undegraded":"2024-09-14T11:33:44.886067+0000","last_fullsized":"2024-09-14T11:33:44.886067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:51.970572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'265","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.480456+0000","last_change":"2024-09-14T10:56:13.041394+0000","last_active":"2024-09-14T11:36:21.480456+0000","last_peered":"2024-09-14T11:36:21.480456+0000","last_clean":"2024-09-14T11:36:21.480456+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:36:21.480456+0000","last_undegraded":"2024-09-14T11:36:21.480456+0000","last_fullsized":"2024-09-14T11:36:21.480456+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:59.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":944,"num_write":368,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757802+0000","last_change":"2024-09-14T10:56:14.862660+0000","last_active":"2024-09-14T11:34:28.757802+0000","last_peered":"2024-09-14T11:34:28.757802+0000","last_clean":"2024-09-14T11:34:28.757802+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:34:28.757802+0000","last_undegraded":"2024-09-14T11:34:28.757802+0000","last_fullsized":"2024-09-14T11:34:28.757802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:53.685139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'113","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.629869+0000","last_change":"2024-09-14T10:56:16.874807+0000","last_active":"2024-09-14T11:37:14.629869+0000","last_peered":"2024-09-14T11:37:14.629869+0000","last_clean":"2024-09-14T11:37:14.629869+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:37:14.629869+0000","last_undegraded":"2024-09-14T11:37:14.629869+0000","last_fullsized":"2024-09-14T11:37:14.629869+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:23.768244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.865069+0000","last_change":"2024-09-14T10:56:08.842580+0000","last_active":"2024-09-14T11:35:16.865069+0000","last_peered":"2024-09-14T11:35:16.865069+0000","last_clean":"2024-09-14T11:35:16.865069+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:35:16.865069+0000","last_undegraded":"2024-09-14T11:35:16.865069+0000","last_fullsized":"2024-09-14T11:35:16.865069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:35.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'288","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.365137+0000","last_change":"2024-09-14T10:56:06.834528+0000","last_active":"2024-09-14T11:35:18.365137+0000","last_peered":"2024-09-14T11:35:18.365137+0000","last_clean":"2024-09-14T11:35:18.365137+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:35:18.365137+0000","last_undegraded":"2024-09-14T11:35:18.365137+0000","last_fullsized":"2024-09-14T11:35:18.365137+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:09.265221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10898289,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":571,"num_read_kb":33947,"num_write":1095,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.864422+0000","last_change":"2024-09-14T10:56:10.849432+0000","last_active":"2024-09-14T11:33:43.864422+0000","last_peered":"2024-09-14T11:33:43.864422+0000","last_clean":"2024-09-14T11:33:43.864422+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:33:43.864422+0000","last_undegraded":"2024-09-14T11:33:43.864422+0000","last_fullsized":"2024-09-14T11:33:43.864422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:43.219622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.472266+0000","last_change":"2024-09-14T10:56:13.041708+0000","last_active":"2024-09-14T11:36:21.472266+0000","last_peered":"2024-09-14T11:36:21.472266+0000","last_clean":"2024-09-14T11:36:21.472266+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:36:21.472266+0000","last_undegraded":"2024-09-14T11:36:21.472266+0000","last_fullsized":"2024-09-14T11:36:21.472266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:44.179299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'751","reported_seq":4574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.641743+0000","last_change":"2024-09-14T10:56:14.869079+0000","last_active":"2024-09-14T11:37:14.641743+0000","last_peered":"2024-09-14T11:37:14.641743+0000","last_clean":"2024-09-14T11:37:14.641743+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:37:14.641743+0000","last_undegraded":"2024-09-14T11:37:14.641743+0000","last_fullsized":"2024-09-14T11:37:14.641743+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:27.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'126","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.897308+0000","last_change":"2024-09-14T10:56:16.877187+0000","last_active":"2024-09-14T11:35:19.897308+0000","last_peered":"2024-09-14T11:35:19.897308+0000","last_clean":"2024-09-14T11:35:19.897308+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:35:19.897308+0000","last_undegraded":"2024-09-14T11:35:19.897308+0000","last_fullsized":"2024-09-14T11:35:19.897308+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:51.016753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.586731+0000","last_change":"2024-09-14T10:56:08.839500+0000","last_active":"2024-09-14T11:34:57.586731+0000","last_peered":"2024-09-14T11:34:57.586731+0000","last_clean":"2024-09-14T11:34:57.586731+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:34:57.586731+0000","last_undegraded":"2024-09-14T11:34:57.586731+0000","last_fullsized":"2024-09-14T11:34:57.586731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:48.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'283","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.373492+0000","last_change":"2024-09-14T10:56:06.836000+0000","last_active":"2024-09-14T11:35:12.373492+0000","last_peered":"2024-09-14T11:35:12.373492+0000","last_clean":"2024-09-14T11:35:12.373492+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:35:12.373492+0000","last_undegraded":"2024-09-14T11:35:12.373492+0000","last_fullsized":"2024-09-14T11:35:12.373492+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:46.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":347461,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":712,"num_read_kb":7705,"num_write":1028,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885243+0000","last_change":"2024-09-14T10:56:10.851020+0000","last_active":"2024-09-14T11:33:44.885243+0000","last_peered":"2024-09-14T11:33:44.885243+0000","last_clean":"2024-09-14T11:33:44.885243+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:33:44.885243+0000","last_undegraded":"2024-09-14T11:33:44.885243+0000","last_fullsized":"2024-09-14T11:33:44.885243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:54.621932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'316","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.591631+0000","last_change":"2024-09-14T10:56:12.853222+0000","last_active":"2024-09-14T11:37:14.591631+0000","last_peered":"2024-09-14T11:37:14.591631+0000","last_clean":"2024-09-14T11:37:14.591631+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:37:14.591631+0000","last_undegraded":"2024-09-14T11:37:14.591631+0000","last_fullsized":"2024-09-14T11:37:14.591631+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":63929,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":509,"num_read_kb":1031,"num_write":422,"num_write_kb":326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761752+0000","last_change":"2024-09-14T10:56:14.869597+0000","last_active":"2024-09-14T11:34:58.761752+0000","last_peered":"2024-09-14T11:34:58.761752+0000","last_clean":"2024-09-14T11:34:58.761752+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:34:58.761752+0000","last_undegraded":"2024-09-14T11:34:58.761752+0000","last_fullsized":"2024-09-14T11:34:58.761752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:57.846436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.460581+0000","last_change":"2024-09-14T10:56:16.872084+0000","last_active":"2024-09-14T11:37:13.460581+0000","last_peered":"2024-09-14T11:37:13.460581+0000","last_clean":"2024-09-14T11:37:13.460581+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:37:13.460581+0000","last_undegraded":"2024-09-14T11:37:13.460581+0000","last_fullsized":"2024-09-14T11:37:13.460581+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:09.391213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.819430+0000","last_change":"2024-09-14T10:56:41.920664+0000","last_active":"2024-09-14T11:35:25.819430+0000","last_peered":"2024-09-14T11:35:25.819430+0000","last_clean":"2024-09-14T11:35:25.819430+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:35:25.819430+0000","last_undegraded":"2024-09-14T11:35:25.819430+0000","last_fullsized":"2024-09-14T11:35:25.819430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.080586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'261","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.236712+0000","last_change":"2024-09-14T10:56:06.829850+0000","last_active":"2024-09-14T11:35:19.236712+0000","last_peered":"2024-09-14T11:35:19.236712+0000","last_clean":"2024-09-14T11:35:19.236712+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:35:19.236712+0000","last_undegraded":"2024-09-14T11:35:19.236712+0000","last_fullsized":"2024-09-14T11:35:19.236712+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:46.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6185618,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":419,"num_read_kb":36817,"num_write":904,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:42.867186+0000","last_change":"2024-09-14T10:56:10.846542+0000","last_active":"2024-09-14T11:33:42.867186+0000","last_peered":"2024-09-14T11:33:42.867186+0000","last_clean":"2024-09-14T11:33:42.867186+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:33:42.867186+0000","last_undegraded":"2024-09-14T11:33:42.867186+0000","last_fullsized":"2024-09-14T11:33:42.867186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.655261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'278","reported_seq":832,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.593083+0000","last_change":"2024-09-14T10:56:12.854064+0000","last_active":"2024-09-14T11:37:14.593083+0000","last_peered":"2024-09-14T11:37:14.593083+0000","last_clean":"2024-09-14T11:37:14.593083+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:37:14.593083+0000","last_undegraded":"2024-09-14T11:37:14.593083+0000","last_fullsized":"2024-09-14T11:37:14.593083+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.267552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52772,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":891,"num_write":362,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895529+0000","last_change":"2024-09-14T10:56:14.866692+0000","last_active":"2024-09-14T11:34:59.895529+0000","last_peered":"2024-09-14T11:34:59.895529+0000","last_clean":"2024-09-14T11:34:59.895529+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:34:59.895529+0000","last_undegraded":"2024-09-14T11:34:59.895529+0000","last_fullsized":"2024-09-14T11:34:59.895529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:02.219332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'151","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.062796+0000","last_change":"2024-09-14T10:56:16.877739+0000","last_active":"2024-09-14T11:35:54.062796+0000","last_peered":"2024-09-14T11:35:54.062796+0000","last_clean":"2024-09-14T11:35:54.062796+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:35:54.062796+0000","last_undegraded":"2024-09-14T11:35:54.062796+0000","last_fullsized":"2024-09-14T11:35:54.062796+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:45.768007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'125","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607195+0000","last_change":"2024-09-14T10:56:08.838852+0000","last_active":"2024-09-14T11:34:55.607195+0000","last_peered":"2024-09-14T11:34:55.607195+0000","last_clean":"2024-09-14T11:34:55.607195+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:34:55.607195+0000","last_undegraded":"2024-09-14T11:34:55.607195+0000","last_fullsized":"2024-09-14T11:34:55.607195+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:23.082263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'315","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.982622+0000","last_change":"2024-09-14T10:56:06.830822+0000","last_active":"2024-09-14T11:34:55.982622+0000","last_peered":"2024-09-14T11:34:55.982622+0000","last_clean":"2024-09-14T11:34:55.982622+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:34:55.982622+0000","last_undegraded":"2024-09-14T11:34:55.982622+0000","last_fullsized":"2024-09-14T11:34:55.982622+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:26.425490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977629,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":563,"num_read_kb":16528,"num_write":1250,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895271+0000","last_change":"2024-09-14T10:56:10.849183+0000","last_active":"2024-09-14T11:34:54.895271+0000","last_peered":"2024-09-14T11:34:54.895271+0000","last_clean":"2024-09-14T11:34:54.895271+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:34:54.895271+0000","last_undegraded":"2024-09-14T11:34:54.895271+0000","last_fullsized":"2024-09-14T11:34:54.895271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:41.598284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.426114+0000","last_change":"2024-09-14T10:56:12.853468+0000","last_active":"2024-09-14T11:37:09.426114+0000","last_peered":"2024-09-14T11:37:09.426114+0000","last_clean":"2024-09-14T11:37:09.426114+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:37:09.426114+0000","last_undegraded":"2024-09-14T11:37:09.426114+0000","last_fullsized":"2024-09-14T11:37:09.426114+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:48.351559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65752,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":996,"num_write":378,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886032+0000","last_change":"2024-09-14T10:56:14.870248+0000","last_active":"2024-09-14T11:33:44.886032+0000","last_peered":"2024-09-14T11:33:44.886032+0000","last_clean":"2024-09-14T11:33:44.886032+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:33:44.886032+0000","last_undegraded":"2024-09-14T11:33:44.886032+0000","last_fullsized":"2024-09-14T11:33:44.886032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.097159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'174","reported_seq":1634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.097709+0000","last_change":"2024-09-14T10:56:16.874279+0000","last_active":"2024-09-14T11:35:56.097709+0000","last_peered":"2024-09-14T11:35:56.097709+0000","last_clean":"2024-09-14T11:35:56.097709+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:35:56.097709+0000","last_undegraded":"2024-09-14T11:35:56.097709+0000","last_fullsized":"2024-09-14T11:35:56.097709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:13.650009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.042909+0000","last_change":"2024-09-14T10:56:08.843487+0000","last_active":"2024-09-14T11:35:31.042909+0000","last_peered":"2024-09-14T11:35:31.042909+0000","last_clean":"2024-09-14T11:35:31.042909+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:35:31.042909+0000","last_undegraded":"2024-09-14T11:35:31.042909+0000","last_fullsized":"2024-09-14T11:35:31.042909+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:16.895665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'294","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.850553+0000","last_change":"2024-09-14T10:56:41.921531+0000","last_active":"2024-09-14T11:35:19.850553+0000","last_peered":"2024-09-14T11:35:19.850553+0000","last_clean":"2024-09-14T11:35:19.850553+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:35:19.850553+0000","last_undegraded":"2024-09-14T11:35:19.850553+0000","last_fullsized":"2024-09-14T11:35:19.850553+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:51.807850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6931208,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":597,"num_read_kb":13580,"num_write":1059,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762455+0000","last_change":"2024-09-14T10:56:10.850525+0000","last_active":"2024-09-14T11:35:03.762455+0000","last_peered":"2024-09-14T11:35:03.762455+0000","last_clean":"2024-09-14T11:35:03.762455+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:35:03.762455+0000","last_undegraded":"2024-09-14T11:35:03.762455+0000","last_fullsized":"2024-09-14T11:35:03.762455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'276","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.380353+0000","last_change":"2024-09-14T10:56:12.850877+0000","last_active":"2024-09-14T11:36:21.380353+0000","last_peered":"2024-09-14T11:36:21.380353+0000","last_clean":"2024-09-14T11:36:21.380353+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:36:21.380353+0000","last_undegraded":"2024-09-14T11:36:21.380353+0000","last_fullsized":"2024-09-14T11:36:21.380353+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:39.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":464,"num_read_kb":932,"num_write":374,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752208+0000","last_change":"2024-09-14T10:56:14.864169+0000","last_active":"2024-09-14T11:33:48.752208+0000","last_peered":"2024-09-14T11:33:48.752208+0000","last_clean":"2024-09-14T11:33:48.752208+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:33:48.752208+0000","last_undegraded":"2024-09-14T11:33:48.752208+0000","last_fullsized":"2024-09-14T11:33:48.752208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:15.470147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.456829+0000","last_change":"2024-09-14T10:56:16.872566+0000","last_active":"2024-09-14T11:37:13.456829+0000","last_peered":"2024-09-14T11:37:13.456829+0000","last_clean":"2024-09-14T11:37:13.456829+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:37:13.456829+0000","last_undegraded":"2024-09-14T11:37:13.456829+0000","last_fullsized":"2024-09-14T11:37:13.456829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:34.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763120+0000","last_change":"2024-09-14T10:56:08.840955+0000","last_active":"2024-09-14T11:35:08.763120+0000","last_peered":"2024-09-14T11:35:08.763120+0000","last_clean":"2024-09-14T11:35:08.763120+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:35:08.763120+0000","last_undegraded":"2024-09-14T11:35:08.763120+0000","last_fullsized":"2024-09-14T11:35:08.763120+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.823863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'310","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.007043+0000","last_change":"2024-09-14T10:56:06.833785+0000","last_active":"2024-09-14T11:35:30.007043+0000","last_peered":"2024-09-14T11:35:30.007043+0000","last_clean":"2024-09-14T11:35:30.007043+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:35:30.007043+0000","last_undegraded":"2024-09-14T11:35:30.007043+0000","last_fullsized":"2024-09-14T11:35:30.007043+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:27.562038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6749314,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":567,"num_read_kb":8660,"num_write":1006,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763097+0000","last_change":"2024-09-14T10:56:08.850785+0000","last_active":"2024-09-14T11:35:08.763097+0000","last_peered":"2024-09-14T11:35:08.763097+0000","last_clean":"2024-09-14T11:35:08.763097+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:35:08.763097+0000","last_undegraded":"2024-09-14T11:35:08.763097+0000","last_fullsized":"2024-09-14T11:35:08.763097+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:01.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'369","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.695445+0000","last_change":"2024-09-14T10:56:06.822844+0000","last_active":"2024-09-14T11:34:20.695445+0000","last_peered":"2024-09-14T11:34:20.695445+0000","last_clean":"2024-09-14T11:34:20.695445+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:34:20.695445+0000","last_undegraded":"2024-09-14T11:34:20.695445+0000","last_fullsized":"2024-09-14T11:34:20.695445+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:18.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17418872,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":684,"num_read_kb":16318,"num_write":1423,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880525+0000","last_change":"2024-09-14T10:56:08.848489+0000","last_active":"2024-09-14T11:35:12.880525+0000","last_peered":"2024-09-14T11:35:12.880525+0000","last_clean":"2024-09-14T11:35:12.880525+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:35:12.880525+0000","last_undegraded":"2024-09-14T11:35:12.880525+0000","last_fullsized":"2024-09-14T11:35:12.880525+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:03.708119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'244","reported_seq":863,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.768716+0000","last_change":"2024-09-14T10:56:06.827629+0000","last_active":"2024-09-14T11:35:25.768716+0000","last_peered":"2024-09-14T11:35:25.768716+0000","last_clean":"2024-09-14T11:35:25.768716+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:35:25.768716+0000","last_undegraded":"2024-09-14T11:35:25.768716+0000","last_fullsized":"2024-09-14T11:35:25.768716+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:56.559924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6325029,"num_objects":58,"num_object_clones":0,"num_object_copies":116,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":488,"num_read_kb":2695,"num_write":841,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763055+0000","last_change":"2024-09-14T10:56:08.845334+0000","last_active":"2024-09-14T11:35:08.763055+0000","last_peered":"2024-09-14T11:35:08.763055+0000","last_clean":"2024-09-14T11:35:08.763055+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:35:08.763055+0000","last_undegraded":"2024-09-14T11:35:08.763055+0000","last_fullsized":"2024-09-14T11:35:08.763055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'294","reported_seq":995,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.447605+0000","last_change":"2024-09-14T10:56:41.922043+0000","last_active":"2024-09-14T11:35:38.447605+0000","last_peered":"2024-09-14T11:35:38.447605+0000","last_clean":"2024-09-14T11:35:38.447605+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:35:38.447605+0000","last_undegraded":"2024-09-14T11:35:38.447605+0000","last_fullsized":"2024-09-14T11:35:38.447605+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:53.350669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6926579,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":763,"num_read_kb":27796,"num_write":1103,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.498343+0000","last_change":"2024-09-14T10:56:08.847845+0000","last_active":"2024-09-14T11:35:38.498343+0000","last_peered":"2024-09-14T11:35:38.498343+0000","last_clean":"2024-09-14T11:35:38.498343+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:35:38.498343+0000","last_undegraded":"2024-09-14T11:35:38.498343+0000","last_fullsized":"2024-09-14T11:35:38.498343+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:22.522568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'375","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.430964+0000","last_change":"2024-09-14T10:56:06.833611+0000","last_active":"2024-09-14T11:35:14.430964+0000","last_peered":"2024-09-14T11:35:14.430964+0000","last_clean":"2024-09-14T11:35:14.430964+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:35:14.430964+0000","last_undegraded":"2024-09-14T11:35:14.430964+0000","last_fullsized":"2024-09-14T11:35:14.430964+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:09.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13190882,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1346,"num_read_kb":14785,"num_write":1204,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:22.049621+0000","last_change":"2024-09-14T10:56:08.844274+0000","last_active":"2024-09-14T11:35:22.049621+0000","last_peered":"2024-09-14T11:35:22.049621+0000","last_clean":"2024-09-14T11:35:22.049621+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:35:22.049621+0000","last_undegraded":"2024-09-14T11:35:22.049621+0000","last_fullsized":"2024-09-14T11:35:22.049621+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:07.843122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'353","reported_seq":1017,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763080+0000","last_change":"2024-09-14T10:56:06.822860+0000","last_active":"2024-09-14T11:35:08.763080+0000","last_peered":"2024-09-14T11:35:08.763080+0000","last_clean":"2024-09-14T11:35:08.763080+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:35:08.763080+0000","last_undegraded":"2024-09-14T11:35:08.763080+0000","last_fullsized":"2024-09-14T11:35:08.763080+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:33.951896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056117,"num_objects":65,"num_object_clones":0,"num_object_copies":130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":0,"num_read":681,"num_read_kb":54729,"num_write":1184,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:59.783590+0000","last_change":"2024-09-14T10:56:08.842881+0000","last_active":"2024-09-14T11:33:59.783590+0000","last_peered":"2024-09-14T11:33:59.783590+0000","last_clean":"2024-09-14T11:33:59.783590+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:33:59.783590+0000","last_undegraded":"2024-09-14T11:33:59.783590+0000","last_fullsized":"2024-09-14T11:33:59.783590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:22.148598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'368","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.114582+0000","last_change":"2024-09-14T10:56:06.832770+0000","last_active":"2024-09-14T11:35:36.114582+0000","last_peered":"2024-09-14T11:35:36.114582+0000","last_clean":"2024-09-14T11:35:36.114582+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:35:36.114582+0000","last_undegraded":"2024-09-14T11:35:36.114582+0000","last_fullsized":"2024-09-14T11:35:36.114582+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:20.311265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5628247,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1087,"num_read_kb":46426,"num_write":1418,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'302","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.248090+0000","last_change":"2024-09-14T10:56:08.846123+0000","last_active":"2024-09-14T11:35:13.248090+0000","last_peered":"2024-09-14T11:35:13.248090+0000","last_clean":"2024-09-14T11:35:13.248090+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:35:13.248090+0000","last_undegraded":"2024-09-14T11:35:13.248090+0000","last_fullsized":"2024-09-14T11:35:13.248090+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:53.557283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'255","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:10.609228+0000","last_change":"2024-09-14T10:56:06.834641+0000","last_active":"2024-09-14T11:35:10.609228+0000","last_peered":"2024-09-14T11:35:10.609228+0000","last_clean":"2024-09-14T11:35:10.609228+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:35:10.609228+0000","last_undegraded":"2024-09-14T11:35:10.609228+0000","last_fullsized":"2024-09-14T11:35:10.609228+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.416149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5351444,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":411,"num_read_kb":5718,"num_write":921,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.559561+0000","last_change":"2024-09-14T10:56:08.835412+0000","last_active":"2024-09-14T11:35:18.559561+0000","last_peered":"2024-09-14T11:35:18.559561+0000","last_clean":"2024-09-14T11:35:18.559561+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:35:18.559561+0000","last_undegraded":"2024-09-14T11:35:18.559561+0000","last_fullsized":"2024-09-14T11:35:18.559561+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:49.723578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'292","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:06.790191+0000","last_change":"2024-09-14T10:56:06.829591+0000","last_active":"2024-09-14T11:37:06.790191+0000","last_peered":"2024-09-14T11:37:06.790191+0000","last_clean":"2024-09-14T11:37:06.790191+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:37:06.790191+0000","last_undegraded":"2024-09-14T11:37:06.790191+0000","last_fullsized":"2024-09-14T11:37:06.790191+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:39.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1163974,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":437,"num_read_kb":8092,"num_write":1057,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883767+0000","last_change":"2024-09-14T10:56:08.842404+0000","last_active":"2024-09-14T11:33:29.883767+0000","last_peered":"2024-09-14T11:33:29.883767+0000","last_clean":"2024-09-14T11:33:29.883767+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:33:29.883767+0000","last_undegraded":"2024-09-14T11:33:29.883767+0000","last_fullsized":"2024-09-14T11:33:29.883767+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:20.506202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'281","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.618849+0000","last_change":"2024-09-14T10:56:06.834541+0000","last_active":"2024-09-14T11:35:16.618849+0000","last_peered":"2024-09-14T11:35:16.618849+0000","last_clean":"2024-09-14T11:35:16.618849+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:35:16.618849+0000","last_undegraded":"2024-09-14T11:35:16.618849+0000","last_fullsized":"2024-09-14T11:35:16.618849+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:07.196281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19849358,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":593,"num_read_kb":52896,"num_write":1076,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861201+0000","last_change":"2024-09-14T10:56:08.841270+0000","last_active":"2024-09-14T11:34:29.861201+0000","last_peered":"2024-09-14T11:34:29.861201+0000","last_clean":"2024-09-14T11:34:29.861201+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:34:29.861201+0000","last_undegraded":"2024-09-14T11:34:29.861201+0000","last_fullsized":"2024-09-14T11:34:29.861201+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:43.163716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'301","reported_seq":1167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.434344+0000","last_change":"2024-09-14T10:56:06.835991+0000","last_active":"2024-09-14T11:35:32.434344+0000","last_peered":"2024-09-14T11:35:32.434344+0000","last_clean":"2024-09-14T11:35:32.434344+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:35:32.434344+0000","last_undegraded":"2024-09-14T11:35:32.434344+0000","last_fullsized":"2024-09-14T11:35:32.434344+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:00.421199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5591910,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1246,"num_read_kb":34715,"num_write":1163,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891061+0000","last_change":"2024-09-14T10:56:08.843794+0000","last_active":"2024-09-14T11:34:24.891061+0000","last_peered":"2024-09-14T11:34:24.891061+0000","last_clean":"2024-09-14T11:34:24.891061+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:34:24.891061+0000","last_undegraded":"2024-09-14T11:34:24.891061+0000","last_fullsized":"2024-09-14T11:34:24.891061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:55.919014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'319","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.113635+0000","last_change":"2024-09-14T10:56:06.833787+0000","last_active":"2024-09-14T11:35:37.113635+0000","last_peered":"2024-09-14T11:35:37.113635+0000","last_clean":"2024-09-14T11:35:37.113635+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:35:37.113635+0000","last_undegraded":"2024-09-14T11:35:37.113635+0000","last_fullsized":"2024-09-14T11:35:37.113635+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.576376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5589024,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":581,"num_read_kb":11879,"num_write":1168,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.890453+0000","last_change":"2024-09-14T10:56:08.848886+0000","last_active":"2024-09-14T11:34:24.890453+0000","last_peered":"2024-09-14T11:34:24.890453+0000","last_clean":"2024-09-14T11:34:24.890453+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:34:24.890453+0000","last_undegraded":"2024-09-14T11:34:24.890453+0000","last_fullsized":"2024-09-14T11:34:24.890453+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:04.538771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'311","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:11.849702+0000","last_change":"2024-09-14T10:56:06.832377+0000","last_active":"2024-09-14T11:35:11.849702+0000","last_peered":"2024-09-14T11:35:11.849702+0000","last_clean":"2024-09-14T11:35:11.849702+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:35:11.849702+0000","last_undegraded":"2024-09-14T11:35:11.849702+0000","last_fullsized":"2024-09-14T11:35:11.849702+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:58.015169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486220,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":646,"num_read_kb":26247,"num_write":1120,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:51.228206+0000","last_change":"2024-09-14T10:56:08.839416+0000","last_active":"2024-09-14T11:34:51.228206+0000","last_peered":"2024-09-14T11:34:51.228206+0000","last_clean":"2024-09-14T11:34:51.228206+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:34:51.228206+0000","last_undegraded":"2024-09-14T11:34:51.228206+0000","last_fullsized":"2024-09-14T11:34:51.228206+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:07.079656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'306","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.548460+0000","last_change":"2024-09-14T10:56:06.830987+0000","last_active":"2024-09-14T11:34:47.548460+0000","last_peered":"2024-09-14T11:34:47.548460+0000","last_clean":"2024-09-14T11:34:47.548460+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:34:47.548460+0000","last_undegraded":"2024-09-14T11:34:47.548460+0000","last_fullsized":"2024-09-14T11:34:47.548460+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:29.841639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23726381,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":608,"num_read_kb":46767,"num_write":1176,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.481366+0000","last_change":"2024-09-14T10:56:08.833880+0000","last_active":"2024-09-14T11:35:14.481366+0000","last_peered":"2024-09-14T11:35:14.481366+0000","last_clean":"2024-09-14T11:35:14.481366+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:35:14.481366+0000","last_undegraded":"2024-09-14T11:35:14.481366+0000","last_fullsized":"2024-09-14T11:35:14.481366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:42.906752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'297","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.946339+0000","last_change":"2024-09-14T10:56:06.832512+0000","last_active":"2024-09-14T11:35:36.946339+0000","last_peered":"2024-09-14T11:35:36.946339+0000","last_clean":"2024-09-14T11:35:36.946339+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:35:36.946339+0000","last_undegraded":"2024-09-14T11:35:36.946339+0000","last_fullsized":"2024-09-14T11:35:36.946339+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.172444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642444,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":628,"num_read_kb":4317,"num_write":1116,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898132+0000","last_change":"2024-09-14T10:56:08.852010+0000","last_active":"2024-09-14T11:35:14.898132+0000","last_peered":"2024-09-14T11:35:14.898132+0000","last_clean":"2024-09-14T11:35:14.898132+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:35:14.898132+0000","last_undegraded":"2024-09-14T11:35:14.898132+0000","last_fullsized":"2024-09-14T11:35:14.898132+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.513514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'261","reported_seq":872,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.266714+0000","last_change":"2024-09-14T10:56:06.835010+0000","last_active":"2024-09-14T11:35:33.266714+0000","last_peered":"2024-09-14T11:35:33.266714+0000","last_clean":"2024-09-14T11:35:33.266714+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:35:33.266714+0000","last_undegraded":"2024-09-14T11:35:33.266714+0000","last_fullsized":"2024-09-14T11:35:33.266714+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:42.832634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7069395,"num_objects":45,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":0,"num_read":556,"num_read_kb":2905,"num_write":1012,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'305","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.330258+0000","last_change":"2024-09-14T10:56:41.921185+0000","last_active":"2024-09-14T11:35:51.330258+0000","last_peered":"2024-09-14T11:35:51.330258+0000","last_clean":"2024-09-14T11:35:51.330258+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:35:51.330258+0000","last_undegraded":"2024-09-14T11:35:51.330258+0000","last_fullsized":"2024-09-14T11:35:51.330258+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:30.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056280,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":552,"num_read_kb":51615,"num_write":1157,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761881+0000","last_change":"2024-09-14T10:56:08.837369+0000","last_active":"2024-09-14T11:34:58.761881+0000","last_peered":"2024-09-14T11:34:58.761881+0000","last_clean":"2024-09-14T11:34:58.761881+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:34:58.761881+0000","last_undegraded":"2024-09-14T11:34:58.761881+0000","last_fullsized":"2024-09-14T11:34:58.761881+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:04.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'281","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.904866+0000","last_change":"2024-09-14T10:56:06.832783+0000","last_active":"2024-09-14T11:34:58.904866+0000","last_peered":"2024-09-14T11:34:58.904866+0000","last_clean":"2024-09-14T11:34:58.904866+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:34:58.904866+0000","last_undegraded":"2024-09-14T11:34:58.904866+0000","last_fullsized":"2024-09-14T11:34:58.904866+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:18.334532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7233163,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":539,"num_read_kb":18767,"num_write":1036,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877349+0000","last_change":"2024-09-14T10:56:08.841261+0000","last_active":"2024-09-14T11:34:52.877349+0000","last_peered":"2024-09-14T11:34:52.877349+0000","last_clean":"2024-09-14T11:34:52.877349+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:34:52.877349+0000","last_undegraded":"2024-09-14T11:34:52.877349+0000","last_fullsized":"2024-09-14T11:34:52.877349+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:10.975942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1684,"ondisk_log_size":1684,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":518,"ondisk_log_size":518,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1947362,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17072,"num_read_kb":32975,"num_write":14467,"num_write_kb":11632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3301376,"data_stored":2769238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1965,"ondisk_log_size":1965,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2392,"num_read_kb":2851,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4164,"ondisk_log_size":4164,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":576369785,"num_objects":4336,"num_object_clones":0,"num_object_copies":8672,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4336,"num_whiteouts":0,"num_read":39892,"num_read_kb":2045352,"num_write":68800,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1185357824,"data_stored":1152739570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4748,"ondisk_log_size":4748,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":82506366,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":123,"num_read_kb":206212,"num_write":140,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165019648,"data_stored":165012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":82506366,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":118,"num_read_kb":193226,"num_write":140,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":165019648,"data_stored":165012732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":80,"ondisk_log_size":80,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509949,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442036,"kb_used_data":194276,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93929804,"statfs":{"total":96636764160,"available":96184119296,"internally_reserved":0,"allocated":198938624,"data_stored":192955260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253688266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509948,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334104,"kb_used_data":118280,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94037736,"statfs":{"total":96636764160,"available":96294641664,"internally_reserved":0,"allocated":121118720,"data_stored":116532898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509947,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295300,"kb_used_data":223860,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94076540,"statfs":{"total":96636764160,"available":96334376960,"internally_reserved":0,"allocated":229232640,"data_stored":222840157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509949,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":475860,"kb_used_data":228100,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93895980,"statfs":{"total":96636764160,"available":96149483520,"internally_reserved":0,"allocated":233574400,"data_stored":227004899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509948,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247600,"kb_used_data":190048,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94124240,"statfs":{"total":96636764160,"available":96383221760,"internally_reserved":0,"allocated":194609152,"data_stored":190460100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542653,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":292480,"kb_used_data":176688,"kb_used_omap":1,"kb_used_meta":115774,"kb_avail":94079360,"statfs":{"total":96636764160,"available":96337264640,"internally_reserved":0,"allocated":180928512,"data_stored":176391108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":118553029},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542650,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":418080,"kb_used_data":206416,"kb_used_omap":1,"kb_used_meta":211646,"kb_avail":93953760,"statfs":{"total":96636764160,"available":96208650240,"internally_reserved":0,"allocated":211369984,"data_stored":204957989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":216725957},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575355,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":273996,"kb_used_data":174844,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94097844,"statfs":{"total":96636764160,"available":96356192256,"internally_reserved":0,"allocated":179040256,"data_stored":172786779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":171053056,"data_stored":166214066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":134213632,"data_stored":131201999,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":140513280,"data_stored":137837728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":165445632,"data_stored":160410710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184983552,"data_stored":180046795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":135929856,"data_stored":131277927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":95506432,"data_stored":92434140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":157712384,"data_stored":153316205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":344408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":454656,"data_stored":380569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":133157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":477119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":83611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":675840,"data_stored":559111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":260762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":634880,"data_stored":530501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":25169920,"data_stored":25169037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20639744,"data_stored":20637169,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15732736,"data_stored":15731853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11202560,"data_stored":11199985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":22020096,"data_stored":22020096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34607104,"data_stored":34606221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37751949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24834048,"data_stored":24831473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8388608,"data_stored":8388608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16445440,"data_stored":16442865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:37:49.672 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-14T11:37:49.672 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:37:50.031 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:37:50.042 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:37:50.043 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1518,"stamp":"2024-09-14T11:37:49.663431+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":507517771,"num_objects":3060,"num_object_clones":0,"num_object_copies":6120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3060,"num_whiteouts":0,"num_read":193971,"num_read_kb":2595613,"num_write":143470,"num_write_kb":2468338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14097,"ondisk_log_size":14097,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2269564,"kb_used_data":992688,"kb_used_omap":12,"kb_used_meta":1276467,"kb_avail":752705156,"statfs":{"total":773094113280,"available":770770079744,"internally_reserved":0,"allocated":1016512512,"data_stored":983855488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1307102768},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-236419139,"num_objects":-1638,"num_object_clones":0,"num_object_copies":-3276,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1638,"num_whiteouts":0,"num_read":1899,"num_read_kb":2187,"num_write":1767,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005186"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879647+0000","last_change":"2024-09-14T11:22:38.554296+0000","last_active":"2024-09-14T11:35:07.879647+0000","last_peered":"2024-09-14T11:35:07.879647+0000","last_clean":"2024-09-14T11:35:07.879647+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:35:07.879647+0000","last_undegraded":"2024-09-14T11:35:07.879647+0000","last_fullsized":"2024-09-14T11:35:07.879647+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:24.257792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:32.874387+0000","last_change":"2024-09-14T11:12:00.371370+0000","last_active":"2024-09-14T11:34:32.874387+0000","last_peered":"2024-09-14T11:34:32.874387+0000","last_clean":"2024-09-14T11:34:32.874387+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:34:32.874387+0000","last_undegraded":"2024-09-14T11:34:32.874387+0000","last_fullsized":"2024-09-14T11:34:32.874387+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:10.434332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603806+0000","last_change":"2024-09-14T11:11:57.356179+0000","last_active":"2024-09-14T11:34:30.603806+0000","last_peered":"2024-09-14T11:34:30.603806+0000","last_clean":"2024-09-14T11:34:30.603806+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:34:30.603806+0000","last_undegraded":"2024-09-14T11:34:30.603806+0000","last_fullsized":"2024-09-14T11:34:30.603806+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:20.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":15360,"num_write":3,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763760+0000","last_change":"2024-09-14T11:10:13.511537+0000","last_active":"2024-09-14T11:35:13.763760+0000","last_peered":"2024-09-14T11:35:13.763760+0000","last_clean":"2024-09-14T11:35:13.763760+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:35:13.763760+0000","last_undegraded":"2024-09-14T11:35:13.763760+0000","last_fullsized":"2024-09-14T11:35:13.763760+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.866042+0000","last_change":"2024-09-14T11:22:38.557878+0000","last_active":"2024-09-14T11:35:09.866042+0000","last_peered":"2024-09-14T11:35:09.866042+0000","last_clean":"2024-09-14T11:35:09.866042+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:35:09.866042+0000","last_undegraded":"2024-09-14T11:35:09.866042+0000","last_fullsized":"2024-09-14T11:35:09.866042+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:33.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891707+0000","last_change":"2024-09-14T11:12:00.365069+0000","last_active":"2024-09-14T11:34:29.891707+0000","last_peered":"2024-09-14T11:34:29.891707+0000","last_clean":"2024-09-14T11:34:29.891707+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:34:29.891707+0000","last_undegraded":"2024-09-14T11:34:29.891707+0000","last_fullsized":"2024-09-14T11:34:29.891707+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.203248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.051192+0000","last_change":"2024-09-14T11:11:57.352596+0000","last_active":"2024-09-14T11:37:46.051192+0000","last_peered":"2024-09-14T11:37:46.051192+0000","last_clean":"2024-09-14T11:37:46.051192+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:37:46.051192+0000","last_undegraded":"2024-09-14T11:37:46.051192+0000","last_fullsized":"2024-09-14T11:37:46.051192+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.294796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:56.089950+0000","last_change":"2024-09-14T11:10:13.500557+0000","last_active":"2024-09-14T11:34:56.089950+0000","last_peered":"2024-09-14T11:34:56.089950+0000","last_clean":"2024-09-14T11:34:56.089950+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:34:56.089950+0000","last_undegraded":"2024-09-14T11:34:56.089950+0000","last_fullsized":"2024-09-14T11:34:56.089950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.821678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:44.893419+0000","last_change":"2024-09-14T11:22:38.555518+0000","last_active":"2024-09-14T11:34:44.893419+0000","last_peered":"2024-09-14T11:34:44.893419+0000","last_clean":"2024-09-14T11:34:44.893419+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:34:44.893419+0000","last_undegraded":"2024-09-14T11:34:44.893419+0000","last_fullsized":"2024-09-14T11:34:44.893419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:12.998285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.452291+0000","last_change":"2024-09-14T11:12:00.696948+0000","last_active":"2024-09-14T11:37:46.452291+0000","last_peered":"2024-09-14T11:37:46.452291+0000","last_clean":"2024-09-14T11:37:46.452291+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:37:46.452291+0000","last_undegraded":"2024-09-14T11:37:46.452291+0000","last_fullsized":"2024-09-14T11:37:46.452291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:04.389759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.858303+0000","last_change":"2024-09-14T11:11:57.355524+0000","last_active":"2024-09-14T11:34:04.858303+0000","last_peered":"2024-09-14T11:34:04.858303+0000","last_clean":"2024-09-14T11:34:04.858303+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:34:04.858303+0000","last_undegraded":"2024-09-14T11:34:04.858303+0000","last_fullsized":"2024-09-14T11:34:04.858303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:57.603602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":5122,"num_write":12,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763690+0000","last_change":"2024-09-14T11:10:13.508809+0000","last_active":"2024-09-14T11:35:13.763690+0000","last_peered":"2024-09-14T11:35:13.763690+0000","last_clean":"2024-09-14T11:35:13.763690+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:35:13.763690+0000","last_undegraded":"2024-09-14T11:35:13.763690+0000","last_fullsized":"2024-09-14T11:35:13.763690+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:45.025002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605928+0000","last_change":"2024-09-14T11:22:38.561594+0000","last_active":"2024-09-14T11:34:45.605928+0000","last_peered":"2024-09-14T11:34:45.605928+0000","last_clean":"2024-09-14T11:34:45.605928+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:34:45.605928+0000","last_undegraded":"2024-09-14T11:34:45.605928+0000","last_fullsized":"2024-09-14T11:34:45.605928+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.203331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'4","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600584+0000","last_change":"2024-09-14T11:12:00.696088+0000","last_active":"2024-09-14T11:34:05.600584+0000","last_peered":"2024-09-14T11:34:05.600584+0000","last_clean":"2024-09-14T11:34:05.600584+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:34:05.600584+0000","last_undegraded":"2024-09-14T11:34:05.600584+0000","last_fullsized":"2024-09-14T11:34:05.600584+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:28.207806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":9,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'8","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895433+0000","last_change":"2024-09-14T11:11:57.350368+0000","last_active":"2024-09-14T11:34:54.895433+0000","last_peered":"2024-09-14T11:34:54.895433+0000","last_clean":"2024-09-14T11:34:54.895433+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:34:54.895433+0000","last_undegraded":"2024-09-14T11:34:54.895433+0000","last_fullsized":"2024-09-14T11:34:54.895433+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:04.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":17408,"num_write":13,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609835+0000","last_change":"2024-09-14T11:10:13.511471+0000","last_active":"2024-09-14T11:35:15.609835+0000","last_peered":"2024-09-14T11:35:15.609835+0000","last_clean":"2024-09-14T11:35:15.609835+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:35:15.609835+0000","last_undegraded":"2024-09-14T11:35:15.609835+0000","last_fullsized":"2024-09-14T11:35:15.609835+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:33.776917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:40.605265+0000","last_change":"2024-09-14T11:22:38.562233+0000","last_active":"2024-09-14T11:34:40.605265+0000","last_peered":"2024-09-14T11:34:40.605265+0000","last_clean":"2024-09-14T11:34:40.605265+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:34:40.605265+0000","last_undegraded":"2024-09-14T11:34:40.605265+0000","last_fullsized":"2024-09-14T11:34:40.605265+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:59.647783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868050+0000","last_change":"2024-09-14T11:12:00.373042+0000","last_active":"2024-09-14T11:33:47.868050+0000","last_peered":"2024-09-14T11:33:47.868050+0000","last_clean":"2024-09-14T11:33:47.868050+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:33:47.868050+0000","last_undegraded":"2024-09-14T11:33:47.868050+0000","last_fullsized":"2024-09-14T11:33:47.868050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:42.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751536+0000","last_change":"2024-09-14T11:11:57.347912+0000","last_active":"2024-09-14T11:33:43.751536+0000","last_peered":"2024-09-14T11:33:43.751536+0000","last_clean":"2024-09-14T11:33:43.751536+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:33:43.751536+0000","last_undegraded":"2024-09-14T11:33:43.751536+0000","last_fullsized":"2024-09-14T11:33:43.751536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:27.723340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609807+0000","last_change":"2024-09-14T11:10:13.510098+0000","last_active":"2024-09-14T11:35:15.609807+0000","last_peered":"2024-09-14T11:35:15.609807+0000","last_clean":"2024-09-14T11:35:15.609807+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:35:15.609807+0000","last_undegraded":"2024-09-14T11:35:15.609807+0000","last_fullsized":"2024-09-14T11:35:15.609807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:46.783877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763109+0000","last_change":"2024-09-14T11:22:38.558736+0000","last_active":"2024-09-14T11:35:08.763109+0000","last_peered":"2024-09-14T11:35:08.763109+0000","last_clean":"2024-09-14T11:35:08.763109+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:35:08.763109+0000","last_undegraded":"2024-09-14T11:35:08.763109+0000","last_fullsized":"2024-09-14T11:35:08.763109+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:58.587973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885772+0000","last_change":"2024-09-14T11:12:00.372932+0000","last_active":"2024-09-14T11:33:44.885772+0000","last_peered":"2024-09-14T11:33:44.885772+0000","last_clean":"2024-09-14T11:33:44.885772+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:33:44.885772+0000","last_undegraded":"2024-09-14T11:33:44.885772+0000","last_fullsized":"2024-09-14T11:33:44.885772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:01.464328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885933+0000","last_change":"2024-09-14T11:11:57.351572+0000","last_active":"2024-09-14T11:33:44.885933+0000","last_peered":"2024-09-14T11:33:44.885933+0000","last_clean":"2024-09-14T11:33:44.885933+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:33:44.885933+0000","last_undegraded":"2024-09-14T11:33:44.885933+0000","last_fullsized":"2024-09-14T11:33:44.885933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:43.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897732+0000","last_change":"2024-09-14T11:10:13.507035+0000","last_active":"2024-09-14T11:35:14.897732+0000","last_peered":"2024-09-14T11:35:14.897732+0000","last_clean":"2024-09-14T11:35:14.897732+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:35:14.897732+0000","last_undegraded":"2024-09-14T11:35:14.897732+0000","last_fullsized":"2024-09-14T11:35:14.897732+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.962765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897474+0000","last_change":"2024-09-14T11:22:38.558217+0000","last_active":"2024-09-14T11:35:09.897474+0000","last_peered":"2024-09-14T11:35:09.897474+0000","last_clean":"2024-09-14T11:35:09.897474+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:35:09.897474+0000","last_undegraded":"2024-09-14T11:35:09.897474+0000","last_fullsized":"2024-09-14T11:35:09.897474+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:16.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891260+0000","last_change":"2024-09-14T11:12:00.366839+0000","last_active":"2024-09-14T11:34:29.891260+0000","last_peered":"2024-09-14T11:34:29.891260+0000","last_clean":"2024-09-14T11:34:29.891260+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:34:29.891260+0000","last_undegraded":"2024-09-14T11:34:29.891260+0000","last_fullsized":"2024-09-14T11:34:29.891260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:28.093713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891654+0000","last_change":"2024-09-14T11:11:57.355185+0000","last_active":"2024-09-14T11:34:29.891654+0000","last_peered":"2024-09-14T11:34:29.891654+0000","last_clean":"2024-09-14T11:34:29.891654+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:34:29.891654+0000","last_undegraded":"2024-09-14T11:34:29.891654+0000","last_fullsized":"2024-09-14T11:34:29.891654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.881561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758163+0000","last_change":"2024-09-14T11:10:13.507975+0000","last_active":"2024-09-14T11:34:33.758163+0000","last_peered":"2024-09-14T11:34:33.758163+0000","last_clean":"2024-09-14T11:34:33.758163+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:34:33.758163+0000","last_undegraded":"2024-09-14T11:34:33.758163+0000","last_fullsized":"2024-09-14T11:34:33.758163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:21.041245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897517+0000","last_change":"2024-09-14T11:22:38.561164+0000","last_active":"2024-09-14T11:35:09.897517+0000","last_peered":"2024-09-14T11:35:09.897517+0000","last_clean":"2024-09-14T11:35:09.897517+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:35:09.897517+0000","last_undegraded":"2024-09-14T11:35:09.897517+0000","last_fullsized":"2024-09-14T11:35:09.897517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:43.901705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880477+0000","last_change":"2024-09-14T11:12:43.314131+0000","last_active":"2024-09-14T11:35:12.880477+0000","last_peered":"2024-09-14T11:35:12.880477+0000","last_clean":"2024-09-14T11:35:12.880477+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:35:12.880477+0000","last_undegraded":"2024-09-14T11:35:12.880477+0000","last_fullsized":"2024-09-14T11:35:12.880477+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:03.892987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.339573+0000","last_change":"2024-09-14T11:11:57.358103+0000","last_active":"2024-09-14T11:37:46.339573+0000","last_peered":"2024-09-14T11:37:46.339573+0000","last_clean":"2024-09-14T11:37:46.339573+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:37:46.339573+0000","last_undegraded":"2024-09-14T11:37:46.339573+0000","last_fullsized":"2024-09-14T11:37:46.339573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:14.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.757100+0000","last_change":"2024-09-14T11:10:13.501269+0000","last_active":"2024-09-14T11:34:23.757100+0000","last_peered":"2024-09-14T11:34:23.757100+0000","last_clean":"2024-09-14T11:34:23.757100+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:34:23.757100+0000","last_undegraded":"2024-09-14T11:34:23.757100+0000","last_fullsized":"2024-09-14T11:34:23.757100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:36.721868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:18.756557+0000","last_change":"2024-09-14T11:22:38.559223+0000","last_active":"2024-09-14T11:34:18.756557+0000","last_peered":"2024-09-14T11:34:18.756557+0000","last_clean":"2024-09-14T11:34:18.756557+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:34:18.756557+0000","last_undegraded":"2024-09-14T11:34:18.756557+0000","last_fullsized":"2024-09-14T11:34:18.756557+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:18.099181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598125+0000","last_change":"2024-09-14T11:12:00.695830+0000","last_active":"2024-09-14T11:33:45.598125+0000","last_peered":"2024-09-14T11:33:45.598125+0000","last_clean":"2024-09-14T11:33:45.598125+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:33:45.598125+0000","last_undegraded":"2024-09-14T11:33:45.598125+0000","last_fullsized":"2024-09-14T11:33:45.598125+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:08.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881154+0000","last_change":"2024-09-14T11:11:57.353227+0000","last_active":"2024-09-14T11:35:17.881154+0000","last_peered":"2024-09-14T11:35:17.881154+0000","last_clean":"2024-09-14T11:35:17.881154+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:35:17.881154+0000","last_undegraded":"2024-09-14T11:35:17.881154+0000","last_fullsized":"2024-09-14T11:35:17.881154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:08.822820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.845469+0000","last_change":"2024-09-14T11:10:13.507446+0000","last_active":"2024-09-14T11:34:59.845469+0000","last_peered":"2024-09-14T11:34:59.845469+0000","last_clean":"2024-09-14T11:34:59.845469+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:34:59.845469+0000","last_undegraded":"2024-09-14T11:34:59.845469+0000","last_fullsized":"2024-09-14T11:34:59.845469+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:37.515685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.859664+0000","last_change":"2024-09-14T11:22:38.547820+0000","last_active":"2024-09-14T11:34:19.859664+0000","last_peered":"2024-09-14T11:34:19.859664+0000","last_clean":"2024-09-14T11:34:19.859664+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:34:19.859664+0000","last_undegraded":"2024-09-14T11:34:19.859664+0000","last_fullsized":"2024-09-14T11:34:19.859664+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.390529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.611000+0000","last_change":"2024-09-14T11:12:00.697008+0000","last_active":"2024-09-14T11:35:25.611000+0000","last_peered":"2024-09-14T11:35:25.611000+0000","last_clean":"2024-09-14T11:35:25.611000+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:35:25.611000+0000","last_undegraded":"2024-09-14T11:35:25.611000+0000","last_fullsized":"2024-09-14T11:35:25.611000+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:03.052127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885350+0000","last_change":"2024-09-14T11:11:57.349579+0000","last_active":"2024-09-14T11:33:44.885350+0000","last_peered":"2024-09-14T11:33:44.885350+0000","last_clean":"2024-09-14T11:33:44.885350+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:33:44.885350+0000","last_undegraded":"2024-09-14T11:33:44.885350+0000","last_fullsized":"2024-09-14T11:33:44.885350+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:26.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14680064,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":19456,"num_write":10,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:25.603094+0000","last_change":"2024-09-14T11:10:13.510036+0000","last_active":"2024-09-14T11:34:25.603094+0000","last_peered":"2024-09-14T11:34:25.603094+0000","last_clean":"2024-09-14T11:34:25.603094+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:34:25.603094+0000","last_undegraded":"2024-09-14T11:34:25.603094+0000","last_fullsized":"2024-09-14T11:34:25.603094+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:48.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.889866+0000","last_change":"2024-09-14T11:22:38.557418+0000","last_active":"2024-09-14T11:34:19.889866+0000","last_peered":"2024-09-14T11:34:19.889866+0000","last_clean":"2024-09-14T11:34:19.889866+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:34:19.889866+0000","last_undegraded":"2024-09-14T11:34:19.889866+0000","last_fullsized":"2024-09-14T11:34:19.889866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:24.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'1","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598151+0000","last_change":"2024-09-14T11:12:00.697792+0000","last_active":"2024-09-14T11:33:45.598151+0000","last_peered":"2024-09-14T11:33:45.598151+0000","last_clean":"2024-09-14T11:33:45.598151+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:33:45.598151+0000","last_undegraded":"2024-09-14T11:33:45.598151+0000","last_fullsized":"2024-09-14T11:33:45.598151+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:04.239911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.855371+0000","last_change":"2024-09-14T11:11:57.353323+0000","last_active":"2024-09-14T11:33:44.855371+0000","last_peered":"2024-09-14T11:33:44.855371+0000","last_clean":"2024-09-14T11:33:44.855371+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:33:44.855371+0000","last_undegraded":"2024-09-14T11:33:44.855371+0000","last_fullsized":"2024-09-14T11:33:44.855371+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:15.814681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.860387+0000","last_change":"2024-09-14T11:10:13.499745+0000","last_active":"2024-09-14T11:34:24.860387+0000","last_peered":"2024-09-14T11:34:24.860387+0000","last_clean":"2024-09-14T11:34:24.860387+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:34:24.860387+0000","last_undegraded":"2024-09-14T11:34:24.860387+0000","last_fullsized":"2024-09-14T11:34:24.860387+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:58.521220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:17.872355+0000","last_change":"2024-09-14T11:22:38.556244+0000","last_active":"2024-09-14T11:34:17.872355+0000","last_peered":"2024-09-14T11:34:17.872355+0000","last_clean":"2024-09-14T11:34:17.872355+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:34:17.872355+0000","last_undegraded":"2024-09-14T11:34:17.872355+0000","last_fullsized":"2024-09-14T11:34:17.872355+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:12.131431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886102+0000","last_change":"2024-09-14T11:12:00.371092+0000","last_active":"2024-09-14T11:33:44.886102+0000","last_peered":"2024-09-14T11:33:44.886102+0000","last_clean":"2024-09-14T11:33:44.886102+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:33:44.886102+0000","last_undegraded":"2024-09-14T11:33:44.886102+0000","last_fullsized":"2024-09-14T11:33:44.886102+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:07.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751653+0000","last_change":"2024-09-14T11:11:57.355672+0000","last_active":"2024-09-14T11:33:43.751653+0000","last_peered":"2024-09-14T11:33:43.751653+0000","last_clean":"2024-09-14T11:33:43.751653+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:33:43.751653+0000","last_undegraded":"2024-09-14T11:33:43.751653+0000","last_fullsized":"2024-09-14T11:33:43.751653+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:54.970745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884593+0000","last_change":"2024-09-14T11:10:13.509666+0000","last_active":"2024-09-14T11:33:39.884593+0000","last_peered":"2024-09-14T11:33:39.884593+0000","last_clean":"2024-09-14T11:33:39.884593+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:33:39.884593+0000","last_undegraded":"2024-09-14T11:33:39.884593+0000","last_fullsized":"2024-09-14T11:33:39.884593+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.839337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.606019+0000","last_change":"2024-09-14T11:22:38.560634+0000","last_active":"2024-09-14T11:34:45.606019+0000","last_peered":"2024-09-14T11:34:45.606019+0000","last_clean":"2024-09-14T11:34:45.606019+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:34:45.606019+0000","last_undegraded":"2024-09-14T11:34:45.606019+0000","last_fullsized":"2024-09-14T11:34:45.606019+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:00.155051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765049+0000","last_change":"2024-09-14T11:12:00.370168+0000","last_active":"2024-09-14T11:35:23.765049+0000","last_peered":"2024-09-14T11:35:23.765049+0000","last_clean":"2024-09-14T11:35:23.765049+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:35:23.765049+0000","last_undegraded":"2024-09-14T11:35:23.765049+0000","last_fullsized":"2024-09-14T11:35:23.765049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:48.258006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898754+0000","last_change":"2024-09-14T11:11:57.349362+0000","last_active":"2024-09-14T11:35:19.898754+0000","last_peered":"2024-09-14T11:35:19.898754+0000","last_clean":"2024-09-14T11:35:19.898754+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:35:19.898754+0000","last_undegraded":"2024-09-14T11:35:19.898754+0000","last_fullsized":"2024-09-14T11:35:19.898754+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.873771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883866+0000","last_change":"2024-09-14T11:10:13.508867+0000","last_active":"2024-09-14T11:33:34.883866+0000","last_peered":"2024-09-14T11:33:34.883866+0000","last_clean":"2024-09-14T11:33:34.883866+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:33:34.883866+0000","last_undegraded":"2024-09-14T11:33:34.883866+0000","last_fullsized":"2024-09-14T11:33:34.883866+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:25.594692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759854+0000","last_change":"2024-09-14T11:22:38.562421+0000","last_active":"2024-09-14T11:34:43.759854+0000","last_peered":"2024-09-14T11:34:43.759854+0000","last_clean":"2024-09-14T11:34:43.759854+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:34:43.759854+0000","last_undegraded":"2024-09-14T11:34:43.759854+0000","last_fullsized":"2024-09-14T11:34:43.759854+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:19.932638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765008+0000","last_change":"2024-09-14T11:12:00.366781+0000","last_active":"2024-09-14T11:35:23.765008+0000","last_peered":"2024-09-14T11:35:23.765008+0000","last_clean":"2024-09-14T11:35:23.765008+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:35:23.765008+0000","last_undegraded":"2024-09-14T11:35:23.765008+0000","last_fullsized":"2024-09-14T11:35:23.765008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.257185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610401+0000","last_change":"2024-09-14T11:11:57.355400+0000","last_active":"2024-09-14T11:35:20.610401+0000","last_peered":"2024-09-14T11:35:20.610401+0000","last_clean":"2024-09-14T11:35:20.610401+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:35:20.610401+0000","last_undegraded":"2024-09-14T11:35:20.610401+0000","last_fullsized":"2024-09-14T11:35:20.610401+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:52.064528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:21.171911+0000","last_change":"2024-09-14T11:10:13.508002+0000","last_active":"2024-09-14T11:34:21.171911+0000","last_peered":"2024-09-14T11:34:21.171911+0000","last_clean":"2024-09-14T11:34:21.171911+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:34:21.171911+0000","last_undegraded":"2024-09-14T11:34:21.171911+0000","last_fullsized":"2024-09-14T11:34:21.171911+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:32.599364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756775+0000","last_change":"2024-09-14T11:22:38.560824+0000","last_active":"2024-09-14T11:34:23.756775+0000","last_peered":"2024-09-14T11:34:23.756775+0000","last_clean":"2024-09-14T11:34:23.756775+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:34:23.756775+0000","last_undegraded":"2024-09-14T11:34:23.756775+0000","last_fullsized":"2024-09-14T11:34:23.756775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.610355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610448+0000","last_change":"2024-09-14T11:12:00.371863+0000","last_active":"2024-09-14T11:35:20.610448+0000","last_peered":"2024-09-14T11:35:20.610448+0000","last_clean":"2024-09-14T11:35:20.610448+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:35:20.610448+0000","last_undegraded":"2024-09-14T11:35:20.610448+0000","last_fullsized":"2024-09-14T11:35:20.610448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.086012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898372+0000","last_change":"2024-09-14T11:11:57.355053+0000","last_active":"2024-09-14T11:35:19.898372+0000","last_peered":"2024-09-14T11:35:19.898372+0000","last_clean":"2024-09-14T11:35:19.898372+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:35:19.898372+0000","last_undegraded":"2024-09-14T11:35:19.898372+0000","last_fullsized":"2024-09-14T11:35:19.898372+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.975373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884391+0000","last_change":"2024-09-14T11:10:13.509195+0000","last_active":"2024-09-14T11:33:34.884391+0000","last_peered":"2024-09-14T11:33:34.884391+0000","last_clean":"2024-09-14T11:33:34.884391+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:33:34.884391+0000","last_undegraded":"2024-09-14T11:33:34.884391+0000","last_fullsized":"2024-09-14T11:33:34.884391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:27.434209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605996+0000","last_change":"2024-09-14T11:22:38.549656+0000","last_active":"2024-09-14T11:34:45.605996+0000","last_peered":"2024-09-14T11:34:45.605996+0000","last_clean":"2024-09-14T11:34:45.605996+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:34:45.605996+0000","last_undegraded":"2024-09-14T11:34:45.605996+0000","last_fullsized":"2024-09-14T11:34:45.605996+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.182205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'2","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898360+0000","last_change":"2024-09-14T11:12:00.368721+0000","last_active":"2024-09-14T11:35:19.898360+0000","last_peered":"2024-09-14T11:35:19.898360+0000","last_clean":"2024-09-14T11:35:19.898360+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:35:19.898360+0000","last_undegraded":"2024-09-14T11:35:19.898360+0000","last_fullsized":"2024-09-14T11:35:19.898360+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:12.328655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:37.901303+0000","last_change":"2024-09-14T11:11:57.355041+0000","last_active":"2024-09-14T11:37:37.901303+0000","last_peered":"2024-09-14T11:37:37.901303+0000","last_clean":"2024-09-14T11:37:37.901303+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:37:37.901303+0000","last_undegraded":"2024-09-14T11:37:37.901303+0000","last_fullsized":"2024-09-14T11:37:37.901303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:42.390324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596445+0000","last_change":"2024-09-14T11:10:13.507056+0000","last_active":"2024-09-14T11:33:35.596445+0000","last_peered":"2024-09-14T11:33:35.596445+0000","last_clean":"2024-09-14T11:33:35.596445+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:33:35.596445+0000","last_undegraded":"2024-09-14T11:33:35.596445+0000","last_fullsized":"2024-09-14T11:33:35.596445+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:01.368348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.854245+0000","last_change":"2024-09-14T11:22:38.547683+0000","last_active":"2024-09-14T11:33:34.854245+0000","last_peered":"2024-09-14T11:33:34.854245+0000","last_clean":"2024-09-14T11:33:34.854245+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:33:34.854245+0000","last_undegraded":"2024-09-14T11:33:34.854245+0000","last_fullsized":"2024-09-14T11:33:34.854245+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:09.212310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603840+0000","last_change":"2024-09-14T11:12:00.369322+0000","last_active":"2024-09-14T11:34:30.603840+0000","last_peered":"2024-09-14T11:34:30.603840+0000","last_clean":"2024-09-14T11:34:30.603840+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:34:30.603840+0000","last_undegraded":"2024-09-14T11:34:30.603840+0000","last_fullsized":"2024-09-14T11:34:30.603840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:38.196351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891188+0000","last_change":"2024-09-14T11:11:57.357216+0000","last_active":"2024-09-14T11:34:29.891188+0000","last_peered":"2024-09-14T11:34:29.891188+0000","last_clean":"2024-09-14T11:34:29.891188+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:34:29.891188+0000","last_undegraded":"2024-09-14T11:34:29.891188+0000","last_fullsized":"2024-09-14T11:34:29.891188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:05.608393+0000","last_change":"2024-09-14T11:10:13.512001+0000","last_active":"2024-09-14T11:35:05.608393+0000","last_peered":"2024-09-14T11:35:05.608393+0000","last_clean":"2024-09-14T11:35:05.608393+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:35:05.608393+0000","last_undegraded":"2024-09-14T11:35:05.608393+0000","last_fullsized":"2024-09-14T11:35:05.608393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:22.364398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886662+0000","last_change":"2024-09-14T11:22:38.560005+0000","last_active":"2024-09-14T11:33:54.886662+0000","last_peered":"2024-09-14T11:33:54.886662+0000","last_clean":"2024-09-14T11:33:54.886662+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:33:54.886662+0000","last_undegraded":"2024-09-14T11:33:54.886662+0000","last_fullsized":"2024-09-14T11:33:54.886662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:06.734073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603797+0000","last_change":"2024-09-14T11:12:00.370638+0000","last_active":"2024-09-14T11:34:30.603797+0000","last_peered":"2024-09-14T11:34:30.603797+0000","last_clean":"2024-09-14T11:34:30.603797+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:34:30.603797+0000","last_undegraded":"2024-09-14T11:34:30.603797+0000","last_fullsized":"2024-09-14T11:34:30.603797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:40.237389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'1","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861175+0000","last_change":"2024-09-14T11:11:57.358150+0000","last_active":"2024-09-14T11:34:29.861175+0000","last_peered":"2024-09-14T11:34:29.861175+0000","last_clean":"2024-09-14T11:34:29.861175+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:34:29.861175+0000","last_undegraded":"2024-09-14T11:34:29.861175+0000","last_fullsized":"2024-09-14T11:34:29.861175+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:33.857222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3213,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4,"num_write":1,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":432,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.878115+0000","last_change":"2024-09-14T11:10:13.508473+0000","last_active":"2024-09-14T11:34:57.878115+0000","last_peered":"2024-09-14T11:34:57.878115+0000","last_clean":"2024-09-14T11:34:57.878115+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:34:57.878115+0000","last_undegraded":"2024-09-14T11:34:57.878115+0000","last_fullsized":"2024-09-14T11:34:57.878115+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:51.939853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883625+0000","last_change":"2024-09-14T11:22:38.555264+0000","last_active":"2024-09-14T11:33:29.883625+0000","last_peered":"2024-09-14T11:33:29.883625+0000","last_clean":"2024-09-14T11:33:29.883625+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:33:29.883625+0000","last_undegraded":"2024-09-14T11:33:29.883625+0000","last_fullsized":"2024-09-14T11:33:29.883625+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:10.041270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:53.776370+0000","last_change":"2024-09-14T11:12:00.696985+0000","last_active":"2024-09-14T11:36:53.776370+0000","last_peered":"2024-09-14T11:36:53.776370+0000","last_clean":"2024-09-14T11:36:53.776370+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:36:53.776370+0000","last_undegraded":"2024-09-14T11:36:53.776370+0000","last_fullsized":"2024-09-14T11:36:53.776370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:16.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757502+0000","last_change":"2024-09-14T11:11:57.350049+0000","last_active":"2024-09-14T11:34:28.757502+0000","last_peered":"2024-09-14T11:34:28.757502+0000","last_clean":"2024-09-14T11:34:28.757502+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:34:28.757502+0000","last_undegraded":"2024-09-14T11:34:28.757502+0000","last_fullsized":"2024-09-14T11:34:28.757502+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:36.573356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895573+0000","last_change":"2024-09-14T11:10:13.511805+0000","last_active":"2024-09-14T11:34:59.895573+0000","last_peered":"2024-09-14T11:34:59.895573+0000","last_clean":"2024-09-14T11:34:59.895573+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:34:59.895573+0000","last_undegraded":"2024-09-14T11:34:59.895573+0000","last_fullsized":"2024-09-14T11:34:59.895573+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:47.389561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883080+0000","last_change":"2024-09-14T11:22:38.552793+0000","last_active":"2024-09-14T11:33:29.883080+0000","last_peered":"2024-09-14T11:33:29.883080+0000","last_clean":"2024-09-14T11:33:29.883080+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:33:29.883080+0000","last_undegraded":"2024-09-14T11:33:29.883080+0000","last_fullsized":"2024-09-14T11:33:29.883080+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:40.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'1","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603853+0000","last_change":"2024-09-14T11:12:00.371999+0000","last_active":"2024-09-14T11:34:30.603853+0000","last_peered":"2024-09-14T11:34:30.603853+0000","last_clean":"2024-09-14T11:34:30.603853+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:34:30.603853+0000","last_undegraded":"2024-09-14T11:34:30.603853+0000","last_fullsized":"2024-09-14T11:34:30.603853+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:57.798523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":1,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.615620+0000","last_change":"2024-09-14T11:11:57.351527+0000","last_active":"2024-09-14T11:37:46.615620+0000","last_peered":"2024-09-14T11:37:46.615620+0000","last_clean":"2024-09-14T11:37:46.615620+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:37:46.615620+0000","last_undegraded":"2024-09-14T11:37:46.615620+0000","last_fullsized":"2024-09-14T11:37:46.615620+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:16.871687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5818,"num_write":12,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.864945+0000","last_change":"2024-09-14T11:10:13.506926+0000","last_active":"2024-09-14T11:34:59.864945+0000","last_peered":"2024-09-14T11:34:59.864945+0000","last_clean":"2024-09-14T11:34:59.864945+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:34:59.864945+0000","last_undegraded":"2024-09-14T11:34:59.864945+0000","last_fullsized":"2024-09-14T11:34:59.864945+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:19.274286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:55.599222+0000","last_change":"2024-09-14T11:22:38.560343+0000","last_active":"2024-09-14T11:33:55.599222+0000","last_peered":"2024-09-14T11:33:55.599222+0000","last_clean":"2024-09-14T11:33:55.599222+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:33:55.599222+0000","last_undegraded":"2024-09-14T11:33:55.599222+0000","last_fullsized":"2024-09-14T11:33:55.599222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:29.881634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'4","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.885153+0000","last_change":"2024-09-14T11:12:00.369339+0000","last_active":"2024-09-14T11:33:39.885153+0000","last_peered":"2024-09-14T11:33:39.885153+0000","last_clean":"2024-09-14T11:33:39.885153+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:33:39.885153+0000","last_undegraded":"2024-09-14T11:33:39.885153+0000","last_fullsized":"2024-09-14T11:33:39.885153+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:39.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":12288,"num_write":4,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750762+0000","last_change":"2024-09-14T11:11:57.357619+0000","last_active":"2024-09-14T11:33:38.750762+0000","last_peered":"2024-09-14T11:33:38.750762+0000","last_clean":"2024-09-14T11:33:38.750762+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:33:38.750762+0000","last_undegraded":"2024-09-14T11:33:38.750762+0000","last_fullsized":"2024-09-14T11:33:38.750762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:38.476508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761794+0000","last_change":"2024-09-14T11:10:13.505959+0000","last_active":"2024-09-14T11:34:58.761794+0000","last_peered":"2024-09-14T11:34:58.761794+0000","last_clean":"2024-09-14T11:34:58.761794+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:34:58.761794+0000","last_undegraded":"2024-09-14T11:34:58.761794+0000","last_fullsized":"2024-09-14T11:34:58.761794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:13.476423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886743+0000","last_change":"2024-09-14T11:22:38.558664+0000","last_active":"2024-09-14T11:33:54.886743+0000","last_peered":"2024-09-14T11:33:54.886743+0000","last_clean":"2024-09-14T11:33:54.886743+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:33:54.886743+0000","last_undegraded":"2024-09-14T11:33:54.886743+0000","last_fullsized":"2024-09-14T11:33:54.886743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:30.238036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'5","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884482+0000","last_change":"2024-09-14T11:12:00.694483+0000","last_active":"2024-09-14T11:33:39.884482+0000","last_peered":"2024-09-14T11:33:39.884482+0000","last_clean":"2024-09-14T11:33:39.884482+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:33:39.884482+0000","last_undegraded":"2024-09-14T11:33:39.884482+0000","last_fullsized":"2024-09-14T11:33:39.884482+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:06.644097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":10,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.863718+0000","last_change":"2024-09-14T11:11:57.352310+0000","last_active":"2024-09-14T11:33:38.863718+0000","last_peered":"2024-09-14T11:33:38.863718+0000","last_clean":"2024-09-14T11:33:38.863718+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:33:38.863718+0000","last_undegraded":"2024-09-14T11:33:38.863718+0000","last_fullsized":"2024-09-14T11:33:38.863718+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:08.817373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:09.888479+0000","last_change":"2024-09-14T11:10:13.511603+0000","last_active":"2024-09-14T11:34:09.888479+0000","last_peered":"2024-09-14T11:34:09.888479+0000","last_clean":"2024-09-14T11:34:09.888479+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:34:09.888479+0000","last_undegraded":"2024-09-14T11:34:09.888479+0000","last_fullsized":"2024-09-14T11:34:09.888479+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.593455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886685+0000","last_change":"2024-09-14T11:22:38.557834+0000","last_active":"2024-09-14T11:33:54.886685+0000","last_peered":"2024-09-14T11:33:54.886685+0000","last_clean":"2024-09-14T11:33:54.886685+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:33:54.886685+0000","last_undegraded":"2024-09-14T11:33:54.886685+0000","last_fullsized":"2024-09-14T11:33:54.886685+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:44.232152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758487+0000","last_change":"2024-09-14T11:12:00.368877+0000","last_active":"2024-09-14T11:34:33.758487+0000","last_peered":"2024-09-14T11:34:33.758487+0000","last_clean":"2024-09-14T11:34:33.758487+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:34:33.758487+0000","last_undegraded":"2024-09-14T11:34:33.758487+0000","last_fullsized":"2024-09-14T11:34:33.758487+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:04.138036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751573+0000","last_change":"2024-09-14T11:11:57.350615+0000","last_active":"2024-09-14T11:33:43.751573+0000","last_peered":"2024-09-14T11:33:43.751573+0000","last_clean":"2024-09-14T11:33:43.751573+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:33:43.751573+0000","last_undegraded":"2024-09-14T11:33:43.751573+0000","last_fullsized":"2024-09-14T11:33:43.751573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:57.116215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600496+0000","last_change":"2024-09-14T11:10:13.505366+0000","last_active":"2024-09-14T11:34:05.600496+0000","last_peered":"2024-09-14T11:34:05.600496+0000","last_clean":"2024-09-14T11:34:05.600496+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:34:05.600496+0000","last_undegraded":"2024-09-14T11:34:05.600496+0000","last_fullsized":"2024-09-14T11:34:05.600496+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:26.758270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752949+0000","last_change":"2024-09-14T11:22:38.560810+0000","last_active":"2024-09-14T11:33:53.752949+0000","last_peered":"2024-09-14T11:33:53.752949+0000","last_clean":"2024-09-14T11:33:53.752949+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:33:53.752949+0000","last_undegraded":"2024-09-14T11:33:53.752949+0000","last_fullsized":"2024-09-14T11:33:53.752949+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:04.353747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'7","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884553+0000","last_change":"2024-09-14T11:12:00.372935+0000","last_active":"2024-09-14T11:33:39.884553+0000","last_peered":"2024-09-14T11:33:39.884553+0000","last_clean":"2024-09-14T11:33:39.884553+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:33:39.884553+0000","last_undegraded":"2024-09-14T11:33:39.884553+0000","last_fullsized":"2024-09-14T11:33:39.884553+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:15.968213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3145728,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":9,"num_read_kb":14336,"num_write":7,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891684+0000","last_change":"2024-09-14T11:11:57.352921+0000","last_active":"2024-09-14T11:34:29.891684+0000","last_peered":"2024-09-14T11:34:29.891684+0000","last_clean":"2024-09-14T11:34:29.891684+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:34:29.891684+0000","last_undegraded":"2024-09-14T11:34:29.891684+0000","last_fullsized":"2024-09-14T11:34:29.891684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:52.542794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888212+0000","last_change":"2024-09-14T11:10:13.506698+0000","last_active":"2024-09-14T11:34:04.888212+0000","last_peered":"2024-09-14T11:34:04.888212+0000","last_clean":"2024-09-14T11:34:04.888212+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:34:04.888212+0000","last_undegraded":"2024-09-14T11:34:04.888212+0000","last_fullsized":"2024-09-14T11:34:04.888212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:50.197138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897410+0000","last_change":"2024-09-14T11:22:38.557689+0000","last_active":"2024-09-14T11:35:09.897410+0000","last_peered":"2024-09-14T11:35:09.897410+0000","last_clean":"2024-09-14T11:35:09.897410+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:35:09.897410+0000","last_undegraded":"2024-09-14T11:35:09.897410+0000","last_fullsized":"2024-09-14T11:35:09.897410+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:32.821928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762555+0000","last_change":"2024-09-14T11:12:00.367857+0000","last_active":"2024-09-14T11:35:03.762555+0000","last_peered":"2024-09-14T11:35:03.762555+0000","last_clean":"2024-09-14T11:35:03.762555+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:35:03.762555+0000","last_undegraded":"2024-09-14T11:35:03.762555+0000","last_fullsized":"2024-09-14T11:35:03.762555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:30.330125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895154+0000","last_change":"2024-09-14T11:11:57.350701+0000","last_active":"2024-09-14T11:34:54.895154+0000","last_peered":"2024-09-14T11:34:54.895154+0000","last_clean":"2024-09-14T11:34:54.895154+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:34:54.895154+0000","last_undegraded":"2024-09-14T11:34:54.895154+0000","last_fullsized":"2024-09-14T11:34:54.895154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:03.947483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:03.754212+0000","last_change":"2024-09-14T11:10:13.507832+0000","last_active":"2024-09-14T11:34:03.754212+0000","last_peered":"2024-09-14T11:34:03.754212+0000","last_clean":"2024-09-14T11:34:03.754212+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:34:03.754212+0000","last_undegraded":"2024-09-14T11:34:03.754212+0000","last_fullsized":"2024-09-14T11:34:03.754212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.145883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879667+0000","last_change":"2024-09-14T11:22:38.559774+0000","last_active":"2024-09-14T11:35:07.879667+0000","last_peered":"2024-09-14T11:35:07.879667+0000","last_clean":"2024-09-14T11:35:07.879667+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:35:07.879667+0000","last_undegraded":"2024-09-14T11:35:07.879667+0000","last_fullsized":"2024-09-14T11:35:07.879667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:14.753350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761826+0000","last_change":"2024-09-14T11:12:00.695654+0000","last_active":"2024-09-14T11:34:58.761826+0000","last_peered":"2024-09-14T11:34:58.761826+0000","last_clean":"2024-09-14T11:34:58.761826+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:34:58.761826+0000","last_undegraded":"2024-09-14T11:34:58.761826+0000","last_fullsized":"2024-09-14T11:34:58.761826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:44.109481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.864972+0000","last_change":"2024-09-14T11:11:57.357243+0000","last_active":"2024-09-14T11:34:59.864972+0000","last_peered":"2024-09-14T11:34:59.864972+0000","last_clean":"2024-09-14T11:34:59.864972+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:34:59.864972+0000","last_undegraded":"2024-09-14T11:34:59.864972+0000","last_fullsized":"2024-09-14T11:34:59.864972+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:58.472930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888302+0000","last_change":"2024-09-14T11:10:13.507529+0000","last_active":"2024-09-14T11:34:04.888302+0000","last_peered":"2024-09-14T11:34:04.888302+0000","last_clean":"2024-09-14T11:34:04.888302+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:34:04.888302+0000","last_undegraded":"2024-09-14T11:34:04.888302+0000","last_fullsized":"2024-09-14T11:34:04.888302+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:46.910286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T11:22:38.559360+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:07.017001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'7","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884637+0000","last_change":"2024-09-14T11:12:00.697739+0000","last_active":"2024-09-14T11:33:39.884637+0000","last_peered":"2024-09-14T11:33:39.884637+0000","last_clean":"2024-09-14T11:33:39.884637+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:33:39.884637+0000","last_undegraded":"2024-09-14T11:33:39.884637+0000","last_fullsized":"2024-09-14T11:33:39.884637+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:56.512716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":22530,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:47.885301+0000","last_change":"2024-09-14T11:11:57.356515+0000","last_active":"2024-09-14T11:35:47.885301+0000","last_peered":"2024-09-14T11:35:47.885301+0000","last_clean":"2024-09-14T11:35:47.885301+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:35:47.885301+0000","last_undegraded":"2024-09-14T11:35:47.885301+0000","last_fullsized":"2024-09-14T11:35:47.885301+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.310464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898940+0000","last_change":"2024-09-14T11:10:13.510430+0000","last_active":"2024-09-14T11:35:19.898940+0000","last_peered":"2024-09-14T11:35:19.898940+0000","last_clean":"2024-09-14T11:35:19.898940+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:35:19.898940+0000","last_undegraded":"2024-09-14T11:35:19.898940+0000","last_fullsized":"2024-09-14T11:35:19.898940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:05.548094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897368+0000","last_change":"2024-09-14T11:22:38.560831+0000","last_active":"2024-09-14T11:35:09.897368+0000","last_peered":"2024-09-14T11:35:09.897368+0000","last_clean":"2024-09-14T11:35:09.897368+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:35:09.897368+0000","last_undegraded":"2024-09-14T11:35:09.897368+0000","last_fullsized":"2024-09-14T11:35:09.897368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:48.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.885392+0000","last_change":"2024-09-14T11:12:00.368324+0000","last_active":"2024-09-14T11:33:39.885392+0000","last_peered":"2024-09-14T11:33:39.885392+0000","last_clean":"2024-09-14T11:33:39.885392+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:33:39.885392+0000","last_undegraded":"2024-09-14T11:33:39.885392+0000","last_fullsized":"2024-09-14T11:33:39.885392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:52.228855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884649+0000","last_change":"2024-09-14T11:11:57.353076+0000","last_active":"2024-09-14T11:33:39.884649+0000","last_peered":"2024-09-14T11:33:39.884649+0000","last_clean":"2024-09-14T11:33:39.884649+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:33:39.884649+0000","last_undegraded":"2024-09-14T11:33:39.884649+0000","last_fullsized":"2024-09-14T11:33:39.884649+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:23.953839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":10240,"num_write":7,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763621+0000","last_change":"2024-09-14T11:10:13.503079+0000","last_active":"2024-09-14T11:35:13.763621+0000","last_peered":"2024-09-14T11:35:13.763621+0000","last_clean":"2024-09-14T11:35:13.763621+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:35:13.763621+0000","last_undegraded":"2024-09-14T11:35:13.763621+0000","last_fullsized":"2024-09-14T11:35:13.763621+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.214686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.853503+0000","last_change":"2024-09-14T11:22:38.555155+0000","last_active":"2024-09-14T11:33:29.853503+0000","last_peered":"2024-09-14T11:33:29.853503+0000","last_clean":"2024-09-14T11:33:29.853503+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:33:29.853503+0000","last_undegraded":"2024-09-14T11:33:29.853503+0000","last_fullsized":"2024-09-14T11:33:29.853503+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:42.625623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:03.777421+0000","last_change":"2024-09-14T11:12:00.367897+0000","last_active":"2024-09-14T11:37:03.777421+0000","last_peered":"2024-09-14T11:37:03.777421+0000","last_clean":"2024-09-14T11:37:03.777421+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:37:03.777421+0000","last_undegraded":"2024-09-14T11:37:03.777421+0000","last_fullsized":"2024-09-14T11:37:03.777421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:42.946120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15360,"num_write":13,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:59.887231+0000","last_change":"2024-09-14T11:11:57.345965+0000","last_active":"2024-09-14T11:33:59.887231+0000","last_peered":"2024-09-14T11:33:59.887231+0000","last_clean":"2024-09-14T11:33:59.887231+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:33:59.887231+0000","last_undegraded":"2024-09-14T11:33:59.887231+0000","last_fullsized":"2024-09-14T11:33:59.887231+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:15.657325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880495+0000","last_change":"2024-09-14T11:10:13.502736+0000","last_active":"2024-09-14T11:35:12.880495+0000","last_peered":"2024-09-14T11:35:12.880495+0000","last_clean":"2024-09-14T11:35:12.880495+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:35:12.880495+0000","last_undegraded":"2024-09-14T11:35:12.880495+0000","last_fullsized":"2024-09-14T11:35:12.880495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:59.444808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.766824+0000","last_change":"2024-09-14T11:22:38.559863+0000","last_active":"2024-09-14T11:35:38.766824+0000","last_peered":"2024-09-14T11:35:38.766824+0000","last_clean":"2024-09-14T11:35:38.766824+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:35:38.766824+0000","last_undegraded":"2024-09-14T11:35:38.766824+0000","last_fullsized":"2024-09-14T11:35:38.766824+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:50.541537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:02.870330+0000","last_change":"2024-09-14T11:12:00.369782+0000","last_active":"2024-09-14T11:34:02.870330+0000","last_peered":"2024-09-14T11:34:02.870330+0000","last_clean":"2024-09-14T11:34:02.870330+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:34:02.870330+0000","last_undegraded":"2024-09-14T11:34:02.870330+0000","last_fullsized":"2024-09-14T11:34:02.870330+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:02.629691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895078+0000","last_change":"2024-09-14T11:11:57.349673+0000","last_active":"2024-09-14T11:34:54.895078+0000","last_peered":"2024-09-14T11:34:54.895078+0000","last_clean":"2024-09-14T11:34:54.895078+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:34:54.895078+0000","last_undegraded":"2024-09-14T11:34:54.895078+0000","last_fullsized":"2024-09-14T11:34:54.895078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.667434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898118+0000","last_change":"2024-09-14T11:10:13.510473+0000","last_active":"2024-09-14T11:35:14.898118+0000","last_peered":"2024-09-14T11:35:14.898118+0000","last_clean":"2024-09-14T11:35:14.898118+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:35:14.898118+0000","last_undegraded":"2024-09-14T11:35:14.898118+0000","last_fullsized":"2024-09-14T11:35:14.898118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:52.505231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763071+0000","last_change":"2024-09-14T11:22:38.558952+0000","last_active":"2024-09-14T11:35:08.763071+0000","last_peered":"2024-09-14T11:35:08.763071+0000","last_clean":"2024-09-14T11:35:08.763071+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:35:08.763071+0000","last_undegraded":"2024-09-14T11:35:08.763071+0000","last_fullsized":"2024-09-14T11:35:08.763071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:33.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.894910+0000","last_change":"2024-09-14T11:12:00.373006+0000","last_active":"2024-09-14T11:34:54.894910+0000","last_peered":"2024-09-14T11:34:54.894910+0000","last_clean":"2024-09-14T11:34:54.894910+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:34:54.894910+0000","last_undegraded":"2024-09-14T11:34:54.894910+0000","last_fullsized":"2024-09-14T11:34:54.894910+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:34.796891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:53.761123+0000","last_change":"2024-09-14T11:11:57.347916+0000","last_active":"2024-09-14T11:34:53.761123+0000","last_peered":"2024-09-14T11:34:53.761123+0000","last_clean":"2024-09-14T11:34:53.761123+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:34:53.761123+0000","last_undegraded":"2024-09-14T11:34:53.761123+0000","last_fullsized":"2024-09-14T11:34:53.761123+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:00.583601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897710+0000","last_change":"2024-09-14T11:10:13.512991+0000","last_active":"2024-09-14T11:35:14.897710+0000","last_peered":"2024-09-14T11:35:14.897710+0000","last_clean":"2024-09-14T11:35:14.897710+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:35:14.897710+0000","last_undegraded":"2024-09-14T11:35:14.897710+0000","last_fullsized":"2024-09-14T11:35:14.897710+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:49.534421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897492+0000","last_change":"2024-09-14T11:22:38.555840+0000","last_active":"2024-09-14T11:35:09.897492+0000","last_peered":"2024-09-14T11:35:09.897492+0000","last_clean":"2024-09-14T11:35:09.897492+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:35:09.897492+0000","last_undegraded":"2024-09-14T11:35:09.897492+0000","last_fullsized":"2024-09-14T11:35:09.897492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'1","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895328+0000","last_change":"2024-09-14T11:12:00.368478+0000","last_active":"2024-09-14T11:34:54.895328+0000","last_peered":"2024-09-14T11:34:54.895328+0000","last_clean":"2024-09-14T11:34:54.895328+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:34:54.895328+0000","last_undegraded":"2024-09-14T11:34:54.895328+0000","last_fullsized":"2024-09-14T11:34:54.895328+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:45.204253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":1396,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.894928+0000","last_change":"2024-09-14T11:11:57.351639+0000","last_active":"2024-09-14T11:34:54.894928+0000","last_peered":"2024-09-14T11:34:54.894928+0000","last_clean":"2024-09-14T11:34:54.894928+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:34:54.894928+0000","last_undegraded":"2024-09-14T11:34:54.894928+0000","last_fullsized":"2024-09-14T11:34:54.894928+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:06.738942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6291456,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":6144,"num_write":2,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.851175+0000","last_change":"2024-09-14T11:10:13.508247+0000","last_active":"2024-09-14T11:34:59.851175+0000","last_peered":"2024-09-14T11:34:59.851175+0000","last_clean":"2024-09-14T11:34:59.851175+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:34:59.851175+0000","last_undegraded":"2024-09-14T11:34:59.851175+0000","last_fullsized":"2024-09-14T11:34:59.851175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:55.466796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'288","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.329620+0000","last_change":"2024-09-14T10:56:06.840563+0000","last_active":"2024-09-14T11:35:51.329620+0000","last_peered":"2024-09-14T11:35:51.329620+0000","last_clean":"2024-09-14T11:35:51.329620+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:35:51.329620+0000","last_undegraded":"2024-09-14T11:35:51.329620+0000","last_fullsized":"2024-09-14T11:35:51.329620+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":200,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:36.737226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10221383,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":647,"num_read_kb":163807,"num_write":1094,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.639109+0000","last_change":"2024-09-14T10:56:08.850638+0000","last_active":"2024-09-14T11:35:15.639109+0000","last_peered":"2024-09-14T11:35:15.639109+0000","last_clean":"2024-09-14T11:35:15.639109+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:35:15.639109+0000","last_undegraded":"2024-09-14T11:35:15.639109+0000","last_fullsized":"2024-09-14T11:35:15.639109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.142178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'343","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.992349+0000","last_change":"2024-09-14T10:56:06.829795+0000","last_active":"2024-09-14T11:37:46.992349+0000","last_peered":"2024-09-14T11:37:46.992349+0000","last_clean":"2024-09-14T11:37:46.992349+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:37:46.992349+0000","last_undegraded":"2024-09-14T11:37:46.992349+0000","last_fullsized":"2024-09-14T11:37:46.992349+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:37.943163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":38007,"num_write":1094,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.643553+0000","last_change":"2024-09-14T10:56:08.847147+0000","last_active":"2024-09-14T11:34:58.643553+0000","last_peered":"2024-09-14T11:34:58.643553+0000","last_clean":"2024-09-14T11:34:58.643553+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:34:58.643553+0000","last_undegraded":"2024-09-14T11:34:58.643553+0000","last_fullsized":"2024-09-14T11:34:58.643553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:19.665261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'351","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990795+0000","last_change":"2024-09-14T10:56:06.827878+0000","last_active":"2024-09-14T11:37:46.990795+0000","last_peered":"2024-09-14T11:37:46.990795+0000","last_clean":"2024-09-14T11:37:46.990795+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:37:46.990795+0000","last_undegraded":"2024-09-14T11:37:46.990795+0000","last_fullsized":"2024-09-14T11:37:46.990795+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.452362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":108632,"num_write":1075,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.641306+0000","last_change":"2024-09-14T10:56:08.839781+0000","last_active":"2024-09-14T11:35:56.641306+0000","last_peered":"2024-09-14T11:35:56.641306+0000","last_clean":"2024-09-14T11:35:56.641306+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:35:56.641306+0000","last_undegraded":"2024-09-14T11:35:56.641306+0000","last_fullsized":"2024-09-14T11:35:56.641306+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:48.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'298","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.222961+0000","last_change":"2024-09-14T10:56:42.460337+0000","last_active":"2024-09-14T11:35:14.222961+0000","last_peered":"2024-09-14T11:35:14.222961+0000","last_clean":"2024-09-14T11:35:14.222961+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:35:14.222961+0000","last_undegraded":"2024-09-14T11:35:14.222961+0000","last_fullsized":"2024-09-14T11:35:14.222961+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:24.182625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7947917,"num_objects":64,"num_object_clones":0,"num_object_copies":128,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":780,"num_read_kb":34002,"num_write":1162,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.932127+0000","last_change":"2024-09-14T10:56:08.834000+0000","last_active":"2024-09-14T11:35:27.932127+0000","last_peered":"2024-09-14T11:35:27.932127+0000","last_clean":"2024-09-14T11:35:27.932127+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:35:27.932127+0000","last_undegraded":"2024-09-14T11:35:27.932127+0000","last_fullsized":"2024-09-14T11:35:27.932127+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:57.023521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'301","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:22.116943+0000","last_change":"2024-09-14T10:56:06.830568+0000","last_active":"2024-09-14T11:34:22.116943+0000","last_peered":"2024-09-14T11:34:22.116943+0000","last_clean":"2024-09-14T11:34:22.116943+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:34:22.116943+0000","last_undegraded":"2024-09-14T11:34:22.116943+0000","last_fullsized":"2024-09-14T11:34:22.116943+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:40.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15730039,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":544,"num_read_kb":21029,"num_write":1077,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.859777+0000","last_change":"2024-09-14T10:56:08.841284+0000","last_active":"2024-09-14T11:34:59.859777+0000","last_peered":"2024-09-14T11:34:59.859777+0000","last_clean":"2024-09-14T11:34:59.859777+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:34:59.859777+0000","last_undegraded":"2024-09-14T11:34:59.859777+0000","last_fullsized":"2024-09-14T11:34:59.859777+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:14.311075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'400","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.958250+0000","last_change":"2024-09-14T10:56:06.834469+0000","last_active":"2024-09-14T11:37:46.958250+0000","last_peered":"2024-09-14T11:37:46.958250+0000","last_clean":"2024-09-14T11:37:46.958250+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:37:46.958250+0000","last_undegraded":"2024-09-14T11:37:46.958250+0000","last_fullsized":"2024-09-14T11:37:46.958250+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:32.517363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":29480,"num_write":1192,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4187","reported_seq":4819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:12.075383+0000","last_change":"2024-09-14T10:56:08.839199+0000","last_active":"2024-09-14T11:34:12.075383+0000","last_peered":"2024-09-14T11:34:12.075383+0000","last_clean":"2024-09-14T11:34:12.075383+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:34:12.075383+0000","last_undegraded":"2024-09-14T11:34:12.075383+0000","last_fullsized":"2024-09-14T11:34:12.075383+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":3000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:42.778598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'281","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:12.894171+0000","last_change":"2024-09-14T10:56:06.833222+0000","last_active":"2024-09-14T11:37:12.894171+0000","last_peered":"2024-09-14T11:37:12.894171+0000","last_clean":"2024-09-14T11:37:12.894171+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:37:12.894171+0000","last_undegraded":"2024-09-14T11:37:12.894171+0000","last_fullsized":"2024-09-14T11:37:12.894171+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:04.180820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5570621,"num_objects":62,"num_object_clones":0,"num_object_copies":124,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":525,"num_read_kb":8675,"num_write":1095,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:14.074011+0000","last_change":"2024-09-14T10:56:08.845788+0000","last_active":"2024-09-14T11:34:14.074011+0000","last_peered":"2024-09-14T11:34:14.074011+0000","last_clean":"2024-09-14T11:34:14.074011+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:34:14.074011+0000","last_undegraded":"2024-09-14T11:34:14.074011+0000","last_fullsized":"2024-09-14T11:34:14.074011+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:48.651913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'360","reported_seq":1091,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.529550+0000","last_change":"2024-09-14T10:56:06.823561+0000","last_active":"2024-09-14T11:35:17.529550+0000","last_peered":"2024-09-14T11:35:17.529550+0000","last_clean":"2024-09-14T11:35:17.529550+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:35:17.529550+0000","last_undegraded":"2024-09-14T11:35:17.529550+0000","last_fullsized":"2024-09-14T11:35:17.529550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:14.493949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10794650,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":948,"num_read_kb":48878,"num_write":1251,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":804,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.701012+0000","last_change":"2024-09-14T10:56:08.837515+0000","last_active":"2024-09-14T11:34:26.701012+0000","last_peered":"2024-09-14T11:34:26.701012+0000","last_clean":"2024-09-14T11:34:26.701012+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:34:26.701012+0000","last_undegraded":"2024-09-14T11:34:26.701012+0000","last_fullsized":"2024-09-14T11:34:26.701012+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.463671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:35.029523+0000","last_change":"2024-09-14T10:56:08.839183+0000","last_active":"2024-09-14T11:35:35.029523+0000","last_peered":"2024-09-14T11:35:35.029523+0000","last_clean":"2024-09-14T11:35:35.029523+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:35:35.029523+0000","last_undegraded":"2024-09-14T11:35:35.029523+0000","last_fullsized":"2024-09-14T11:35:35.029523+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:38.313196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'286","reported_seq":920,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.988886+0000","last_change":"2024-09-14T10:56:42.661135+0000","last_active":"2024-09-14T11:35:30.988886+0000","last_peered":"2024-09-14T11:35:30.988886+0000","last_clean":"2024-09-14T11:35:30.988886+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:35:30.988886+0000","last_undegraded":"2024-09-14T11:35:30.988886+0000","last_fullsized":"2024-09-14T11:35:30.988886+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:46.958500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6709056,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":588,"num_read_kb":81454,"num_write":1091,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.663539+0000","last_change":"2024-09-14T10:56:08.846796+0000","last_active":"2024-09-14T11:35:32.663539+0000","last_peered":"2024-09-14T11:35:32.663539+0000","last_clean":"2024-09-14T11:35:32.663539+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:35:32.663539+0000","last_undegraded":"2024-09-14T11:35:32.663539+0000","last_fullsized":"2024-09-14T11:35:32.663539+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:56.632850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'308","reported_seq":1076,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.883163+0000","last_change":"2024-09-14T10:56:06.835989+0000","last_active":"2024-09-14T11:35:27.883163+0000","last_peered":"2024-09-14T11:35:27.883163+0000","last_clean":"2024-09-14T11:35:27.883163+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:35:27.883163+0000","last_undegraded":"2024-09-14T11:35:27.883163+0000","last_fullsized":"2024-09-14T11:35:27.883163+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:41.887236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10496571,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":1043,"num_read_kb":13749,"num_write":1119,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.810993+0000","last_change":"2024-09-14T10:56:08.844107+0000","last_active":"2024-09-14T11:35:31.810993+0000","last_peered":"2024-09-14T11:35:31.810993+0000","last_clean":"2024-09-14T11:35:31.810993+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:35:31.810993+0000","last_undegraded":"2024-09-14T11:35:31.810993+0000","last_fullsized":"2024-09-14T11:35:31.810993+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:40.490617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'261","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:49.894327+0000","last_change":"2024-09-14T10:56:06.839571+0000","last_active":"2024-09-14T11:34:49.894327+0000","last_peered":"2024-09-14T11:34:49.894327+0000","last_clean":"2024-09-14T11:34:49.894327+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:34:49.894327+0000","last_undegraded":"2024-09-14T11:34:49.894327+0000","last_fullsized":"2024-09-14T11:34:49.894327+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:28.864250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10525942,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":568,"num_read_kb":2147,"num_write":1031,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.465427+0000","last_change":"2024-09-14T10:56:08.834013+0000","last_active":"2024-09-14T11:35:33.465427+0000","last_peered":"2024-09-14T11:35:33.465427+0000","last_clean":"2024-09-14T11:35:33.465427+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:35:33.465427+0000","last_undegraded":"2024-09-14T11:35:33.465427+0000","last_fullsized":"2024-09-14T11:35:33.465427+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.973557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'298","reported_seq":955,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:04.714334+0000","last_change":"2024-09-14T10:56:06.830891+0000","last_active":"2024-09-14T11:37:04.714334+0000","last_peered":"2024-09-14T11:37:04.714334+0000","last_clean":"2024-09-14T11:37:04.714334+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:04.714334+0000","last_undegraded":"2024-09-14T11:37:04.714334+0000","last_fullsized":"2024-09-14T11:37:04.714334+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":200,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:02.160609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22667515,"num_objects":73,"num_object_clones":0,"num_object_copies":146,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":0,"num_read":645,"num_read_kb":45139,"num_write":1064,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:29.540321+0000","last_change":"2024-09-14T10:56:08.834901+0000","last_active":"2024-09-14T11:35:29.540321+0000","last_peered":"2024-09-14T11:35:29.540321+0000","last_clean":"2024-09-14T11:35:29.540321+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:35:29.540321+0000","last_undegraded":"2024-09-14T11:35:29.540321+0000","last_fullsized":"2024-09-14T11:35:29.540321+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:56.020076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'289","reported_seq":972,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:24.816667+0000","last_change":"2024-09-14T10:56:06.826208+0000","last_active":"2024-09-14T11:35:24.816667+0000","last_peered":"2024-09-14T11:35:24.816667+0000","last_clean":"2024-09-14T11:35:24.816667+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:35:24.816667+0000","last_undegraded":"2024-09-14T11:35:24.816667+0000","last_fullsized":"2024-09-14T11:35:24.816667+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":200,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:50.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":340804,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":596,"num_read_kb":91641,"num_write":1094,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:28.738381+0000","last_change":"2024-09-14T10:56:08.846295+0000","last_active":"2024-09-14T11:35:28.738381+0000","last_peered":"2024-09-14T11:35:28.738381+0000","last_clean":"2024-09-14T11:35:28.738381+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:35:28.738381+0000","last_undegraded":"2024-09-14T11:35:28.738381+0000","last_fullsized":"2024-09-14T11:35:28.738381+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:58.178498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'335","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.932127+0000","last_change":"2024-09-14T10:56:06.828820+0000","last_active":"2024-09-14T11:37:46.932127+0000","last_peered":"2024-09-14T11:37:46.932127+0000","last_clean":"2024-09-14T11:37:46.932127+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:37:46.932127+0000","last_undegraded":"2024-09-14T11:37:46.932127+0000","last_fullsized":"2024-09-14T11:37:46.932127+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:35.203573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":12785,"num_write":1085,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.632102+0000","last_change":"2024-09-14T10:56:16.877295+0000","last_active":"2024-09-14T11:37:14.632102+0000","last_peered":"2024-09-14T11:37:14.632102+0000","last_clean":"2024-09-14T11:37:14.632102+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:37:14.632102+0000","last_undegraded":"2024-09-14T11:37:14.632102+0000","last_fullsized":"2024-09-14T11:37:14.632102+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:56.149162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:06.606080+0000","last_change":"2024-09-14T10:56:08.839155+0000","last_active":"2024-09-14T11:35:06.606080+0000","last_peered":"2024-09-14T11:35:06.606080+0000","last_clean":"2024-09-14T11:35:06.606080+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:35:06.606080+0000","last_undegraded":"2024-09-14T11:35:06.606080+0000","last_fullsized":"2024-09-14T11:35:06.606080+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:37.441954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'302","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.652603+0000","last_change":"2024-09-14T10:56:06.835770+0000","last_active":"2024-09-14T11:35:37.652603+0000","last_peered":"2024-09-14T11:35:37.652603+0000","last_clean":"2024-09-14T11:35:37.652603+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:35:37.652603+0000","last_undegraded":"2024-09-14T11:35:37.652603+0000","last_fullsized":"2024-09-14T11:35:37.652603+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:18.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":298264,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":776,"num_read_kb":1723,"num_write":1140,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877333+0000","last_change":"2024-09-14T10:56:10.848176+0000","last_active":"2024-09-14T11:34:52.877333+0000","last_peered":"2024-09-14T11:34:52.877333+0000","last_clean":"2024-09-14T11:34:52.877333+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:34:52.877333+0000","last_undegraded":"2024-09-14T11:34:52.877333+0000","last_fullsized":"2024-09-14T11:34:52.877333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:35.018887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'364","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.332097+0000","last_change":"2024-09-14T10:56:12.850634+0000","last_active":"2024-09-14T11:37:46.332097+0000","last_peered":"2024-09-14T11:37:46.332097+0000","last_clean":"2024-09-14T11:37:46.332097+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:37:46.332097+0000","last_undegraded":"2024-09-14T11:37:46.332097+0000","last_fullsized":"2024-09-14T11:37:46.332097+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:49.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48907,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":593,"num_read_kb":1292,"num_write":484,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895276+0000","last_change":"2024-09-14T10:56:14.867772+0000","last_active":"2024-09-14T11:34:54.895276+0000","last_peered":"2024-09-14T11:34:54.895276+0000","last_clean":"2024-09-14T11:34:54.895276+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:34:54.895276+0000","last_undegraded":"2024-09-14T11:34:54.895276+0000","last_fullsized":"2024-09-14T11:34:54.895276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:36.827998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2488","reported_seq":4301,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.535039+0000","last_change":"2024-09-14T10:56:16.878623+0000","last_active":"2024-09-14T11:35:54.535039+0000","last_peered":"2024-09-14T11:35:54.535039+0000","last_clean":"2024-09-14T11:35:54.535039+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:35:54.535039+0000","last_undegraded":"2024-09-14T11:35:54.535039+0000","last_fullsized":"2024-09-14T11:35:54.535039+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:03.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.011617+0000","last_change":"2024-09-14T10:56:08.849261+0000","last_active":"2024-09-14T11:35:25.011617+0000","last_peered":"2024-09-14T11:35:25.011617+0000","last_clean":"2024-09-14T11:35:25.011617+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:35:25.011617+0000","last_undegraded":"2024-09-14T11:35:25.011617+0000","last_fullsized":"2024-09-14T11:35:25.011617+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:12.169215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'310","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.943576+0000","last_change":"2024-09-14T10:56:06.830626+0000","last_active":"2024-09-14T11:37:46.943576+0000","last_peered":"2024-09-14T11:37:46.943576+0000","last_clean":"2024-09-14T11:37:46.943576+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:37:46.943576+0000","last_undegraded":"2024-09-14T11:37:46.943576+0000","last_fullsized":"2024-09-14T11:37:46.943576+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:21.784956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":41365,"num_write":992,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:40.597273+0000","last_change":"2024-09-14T10:56:10.842610+0000","last_active":"2024-09-14T11:33:40.597273+0000","last_peered":"2024-09-14T11:33:40.597273+0000","last_clean":"2024-09-14T11:33:40.597273+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:33:40.597273+0000","last_undegraded":"2024-09-14T11:33:40.597273+0000","last_fullsized":"2024-09-14T11:33:40.597273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:31.067891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'88","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.440429+0000","last_change":"2024-09-14T10:56:12.850155+0000","last_active":"2024-09-14T11:36:21.440429+0000","last_peered":"2024-09-14T11:36:21.440429+0000","last_clean":"2024-09-14T11:36:21.440429+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:36:21.440429+0000","last_undegraded":"2024-09-14T11:36:21.440429+0000","last_fullsized":"2024-09-14T11:36:21.440429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:58.551957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895419+0000","last_change":"2024-09-14T10:56:14.865727+0000","last_active":"2024-09-14T11:34:54.895419+0000","last_peered":"2024-09-14T11:34:54.895419+0000","last_clean":"2024-09-14T11:34:54.895419+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:34:54.895419+0000","last_undegraded":"2024-09-14T11:34:54.895419+0000","last_fullsized":"2024-09-14T11:34:54.895419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:33.497143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'124","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.497858+0000","last_change":"2024-09-14T10:56:16.878997+0000","last_active":"2024-09-14T11:35:26.497858+0000","last_peered":"2024-09-14T11:35:26.497858+0000","last_clean":"2024-09-14T11:35:26.497858+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:35:26.497858+0000","last_undegraded":"2024-09-14T11:35:26.497858+0000","last_fullsized":"2024-09-14T11:35:26.497858+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:40.199776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.949206+0000","last_change":"2024-09-14T10:56:08.843498+0000","last_active":"2024-09-14T11:35:12.949206+0000","last_peered":"2024-09-14T11:35:12.949206+0000","last_clean":"2024-09-14T11:35:12.949206+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:35:12.949206+0000","last_undegraded":"2024-09-14T11:35:12.949206+0000","last_fullsized":"2024-09-14T11:35:12.949206+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:05.973356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'287","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.516635+0000","last_change":"2024-09-14T10:56:06.834132+0000","last_active":"2024-09-14T11:34:26.516635+0000","last_peered":"2024-09-14T11:34:26.516635+0000","last_clean":"2024-09-14T11:34:26.516635+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:34:26.516635+0000","last_undegraded":"2024-09-14T11:34:26.516635+0000","last_fullsized":"2024-09-14T11:34:26.516635+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:22.363792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17170829,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":479,"num_read_kb":14993,"num_write":1073,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607291+0000","last_change":"2024-09-14T10:56:10.847524+0000","last_active":"2024-09-14T11:34:55.607291+0000","last_peered":"2024-09-14T11:34:55.607291+0000","last_clean":"2024-09-14T11:34:55.607291+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:34:55.607291+0000","last_undegraded":"2024-09-14T11:34:55.607291+0000","last_fullsized":"2024-09-14T11:34:55.607291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.642527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'114","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.457558+0000","last_change":"2024-09-14T10:56:12.847058+0000","last_active":"2024-09-14T11:36:21.457558+0000","last_peered":"2024-09-14T11:36:21.457558+0000","last_clean":"2024-09-14T11:36:21.457558+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:36:21.457558+0000","last_undegraded":"2024-09-14T11:36:21.457558+0000","last_fullsized":"2024-09-14T11:36:21.457558+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:22.246613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'753","reported_seq":2170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.859967+0000","last_change":"2024-09-14T10:56:14.861391+0000","last_active":"2024-09-14T11:37:14.859967+0000","last_peered":"2024-09-14T11:37:14.859967+0000","last_clean":"2024-09-14T11:37:14.859967+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:37:14.859967+0000","last_undegraded":"2024-09-14T11:37:14.859967+0000","last_fullsized":"2024-09-14T11:37:14.859967+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:33.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'240","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.745307+0000","last_change":"2024-09-14T10:56:16.865049+0000","last_active":"2024-09-14T11:35:56.745307+0000","last_peered":"2024-09-14T11:35:56.745307+0000","last_clean":"2024-09-14T11:35:56.745307+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:35:56.745307+0000","last_undegraded":"2024-09-14T11:35:56.745307+0000","last_fullsized":"2024-09-14T11:35:56.745307+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:59.143467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4156","reported_seq":4751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:50.606696+0000","last_change":"2024-09-14T10:56:08.848320+0000","last_active":"2024-09-14T11:34:50.606696+0000","last_peered":"2024-09-14T11:34:50.606696+0000","last_clean":"2024-09-14T11:34:50.606696+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:34:50.606696+0000","last_undegraded":"2024-09-14T11:34:50.606696+0000","last_fullsized":"2024-09-14T11:34:50.606696+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:16.344418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'268","reported_seq":912,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.024586+0000","last_change":"2024-09-14T10:56:06.834097+0000","last_active":"2024-09-14T11:35:27.024586+0000","last_peered":"2024-09-14T11:35:27.024586+0000","last_clean":"2024-09-14T11:35:27.024586+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:35:27.024586+0000","last_undegraded":"2024-09-14T11:35:27.024586+0000","last_fullsized":"2024-09-14T11:35:27.024586+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:23.306111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5761840,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":572,"num_read_kb":30567,"num_write":957,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877363+0000","last_change":"2024-09-14T10:56:10.839414+0000","last_active":"2024-09-14T11:34:52.877363+0000","last_peered":"2024-09-14T11:34:52.877363+0000","last_clean":"2024-09-14T11:34:52.877363+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:34:52.877363+0000","last_undegraded":"2024-09-14T11:34:52.877363+0000","last_fullsized":"2024-09-14T11:34:52.877363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:56.422012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'285","reported_seq":839,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.605969+0000","last_change":"2024-09-14T10:56:13.041543+0000","last_active":"2024-09-14T11:37:14.605969+0000","last_peered":"2024-09-14T11:37:14.605969+0000","last_clean":"2024-09-14T11:37:14.605969+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:37:14.605969+0000","last_undegraded":"2024-09-14T11:37:14.605969+0000","last_fullsized":"2024-09-14T11:37:14.605969+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.191878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68307,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":493,"num_read_kb":1078,"num_write":418,"num_write_kb":359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'791","reported_seq":2251,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.648484+0000","last_change":"2024-09-14T10:56:14.859370+0000","last_active":"2024-09-14T11:37:14.648484+0000","last_peered":"2024-09-14T11:37:14.648484+0000","last_clean":"2024-09-14T11:37:14.648484+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:37:14.648484+0000","last_undegraded":"2024-09-14T11:37:14.648484+0000","last_fullsized":"2024-09-14T11:37:14.648484+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:34.411310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880438+0000","last_change":"2024-09-14T10:56:08.849378+0000","last_active":"2024-09-14T11:35:12.880438+0000","last_peered":"2024-09-14T11:35:12.880438+0000","last_clean":"2024-09-14T11:35:12.880438+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:35:12.880438+0000","last_undegraded":"2024-09-14T11:35:12.880438+0000","last_fullsized":"2024-09-14T11:35:12.880438+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:36.824573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'272","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.427175+0000","last_change":"2024-09-14T10:56:06.836741+0000","last_active":"2024-09-14T11:37:09.427175+0000","last_peered":"2024-09-14T11:37:09.427175+0000","last_clean":"2024-09-14T11:37:09.427175+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:09.427175+0000","last_undegraded":"2024-09-14T11:37:09.427175+0000","last_fullsized":"2024-09-14T11:37:09.427175+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:18.533912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5995653,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":460,"num_read_kb":9228,"num_write":1065,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898164+0000","last_change":"2024-09-14T10:56:10.848968+0000","last_active":"2024-09-14T11:35:14.898164+0000","last_peered":"2024-09-14T11:35:14.898164+0000","last_clean":"2024-09-14T11:35:14.898164+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:35:14.898164+0000","last_undegraded":"2024-09-14T11:35:14.898164+0000","last_fullsized":"2024-09-14T11:35:14.898164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:05.693919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'360","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.483385+0000","last_change":"2024-09-14T10:56:13.041185+0000","last_active":"2024-09-14T11:37:46.483385+0000","last_peered":"2024-09-14T11:37:46.483385+0000","last_clean":"2024-09-14T11:37:46.483385+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:37:46.483385+0000","last_undegraded":"2024-09-14T11:37:46.483385+0000","last_fullsized":"2024-09-14T11:37:46.483385+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":1214,"num_write":460,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758510+0000","last_change":"2024-09-14T10:56:14.867306+0000","last_active":"2024-09-14T11:34:33.758510+0000","last_peered":"2024-09-14T11:34:33.758510+0000","last_clean":"2024-09-14T11:34:33.758510+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:34:33.758510+0000","last_undegraded":"2024-09-14T11:34:33.758510+0000","last_fullsized":"2024-09-14T11:34:33.758510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:08.141850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'546","reported_seq":1358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.630477+0000","last_change":"2024-09-14T10:56:16.873797+0000","last_active":"2024-09-14T11:37:14.630477+0000","last_peered":"2024-09-14T11:37:14.630477+0000","last_clean":"2024-09-14T11:37:14.630477+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:37:14.630477+0000","last_undegraded":"2024-09-14T11:37:14.630477+0000","last_fullsized":"2024-09-14T11:37:14.630477+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:06.775196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.164105+0000","last_change":"2024-09-14T10:56:08.845180+0000","last_active":"2024-09-14T11:35:37.164105+0000","last_peered":"2024-09-14T11:35:37.164105+0000","last_clean":"2024-09-14T11:35:37.164105+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:35:37.164105+0000","last_undegraded":"2024-09-14T11:35:37.164105+0000","last_fullsized":"2024-09-14T11:35:37.164105+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:14.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'207","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.821317+0000","last_change":"2024-09-14T10:56:06.835215+0000","last_active":"2024-09-14T11:35:37.821317+0000","last_peered":"2024-09-14T11:35:37.821317+0000","last_clean":"2024-09-14T11:35:37.821317+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:35:37.821317+0000","last_undegraded":"2024-09-14T11:35:37.821317+0000","last_fullsized":"2024-09-14T11:35:37.821317+0000","mapping_epoch":23,"log_start":"264'100","ondisk_log_start":"264'100","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:04.636480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10781877,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":459,"num_read_kb":56700,"num_write":772,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866554+0000","last_change":"2024-09-14T10:56:10.848498+0000","last_active":"2024-09-14T11:35:14.866554+0000","last_peered":"2024-09-14T11:35:14.866554+0000","last_clean":"2024-09-14T11:35:14.866554+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:35:14.866554+0000","last_undegraded":"2024-09-14T11:35:14.866554+0000","last_fullsized":"2024-09-14T11:35:14.866554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:30.715397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'264","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:45.621076+0000","last_change":"2024-09-14T10:56:12.849959+0000","last_active":"2024-09-14T11:36:45.621076+0000","last_peered":"2024-09-14T11:36:45.621076+0000","last_clean":"2024-09-14T11:36:45.621076+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:36:45.621076+0000","last_undegraded":"2024-09-14T11:36:45.621076+0000","last_fullsized":"2024-09-14T11:36:45.621076+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:51.049544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":81105,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":435,"num_read_kb":977,"num_write":360,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610430+0000","last_change":"2024-09-14T10:56:14.859113+0000","last_active":"2024-09-14T11:35:20.610430+0000","last_peered":"2024-09-14T11:35:20.610430+0000","last_clean":"2024-09-14T11:35:20.610430+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:35:20.610430+0000","last_undegraded":"2024-09-14T11:35:20.610430+0000","last_fullsized":"2024-09-14T11:35:20.610430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:39.449429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'114","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:59.904352+0000","last_change":"2024-09-14T10:56:16.872299+0000","last_active":"2024-09-14T11:35:59.904352+0000","last_peered":"2024-09-14T11:35:59.904352+0000","last_clean":"2024-09-14T11:35:59.904352+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:35:59.904352+0000","last_undegraded":"2024-09-14T11:35:59.904352+0000","last_fullsized":"2024-09-14T11:35:59.904352+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:14.575119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.871798+0000","last_change":"2024-09-14T10:56:08.846448+0000","last_active":"2024-09-14T11:35:37.871798+0000","last_peered":"2024-09-14T11:35:37.871798+0000","last_clean":"2024-09-14T11:35:37.871798+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:35:37.871798+0000","last_undegraded":"2024-09-14T11:35:37.871798+0000","last_fullsized":"2024-09-14T11:35:37.871798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:21.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'385","reported_seq":1089,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.197733+0000","last_change":"2024-09-14T10:56:06.838982+0000","last_active":"2024-09-14T11:35:13.197733+0000","last_peered":"2024-09-14T11:35:13.197733+0000","last_clean":"2024-09-14T11:35:13.197733+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:35:13.197733+0000","last_undegraded":"2024-09-14T11:35:13.197733+0000","last_fullsized":"2024-09-14T11:35:13.197733+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":300,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:14.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10872494,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":909,"num_read_kb":28710,"num_write":1610,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861135+0000","last_change":"2024-09-14T10:56:10.847743+0000","last_active":"2024-09-14T11:34:29.861135+0000","last_peered":"2024-09-14T11:34:29.861135+0000","last_clean":"2024-09-14T11:34:29.861135+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:34:29.861135+0000","last_undegraded":"2024-09-14T11:34:29.861135+0000","last_fullsized":"2024-09-14T11:34:29.861135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:13.871060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'302","reported_seq":874,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.619145+0000","last_change":"2024-09-14T10:56:12.847492+0000","last_active":"2024-09-14T11:37:14.619145+0000","last_peered":"2024-09-14T11:37:14.619145+0000","last_clean":"2024-09-14T11:37:14.619145+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:37:14.619145+0000","last_undegraded":"2024-09-14T11:37:14.619145+0000","last_fullsized":"2024-09-14T11:37:14.619145+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:45.170095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65295,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":501,"num_read_kb":1014,"num_write":414,"num_write_kb":320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'778","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.858940+0000","last_change":"2024-09-14T10:56:14.863301+0000","last_active":"2024-09-14T11:37:46.858940+0000","last_peered":"2024-09-14T11:37:46.858940+0000","last_clean":"2024-09-14T11:37:46.858940+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:37:46.858940+0000","last_undegraded":"2024-09-14T11:37:46.858940+0000","last_fullsized":"2024-09-14T11:37:46.858940+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":701,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:01.064582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.458613+0000","last_change":"2024-09-14T10:56:16.877915+0000","last_active":"2024-09-14T11:37:13.458613+0000","last_peered":"2024-09-14T11:37:13.458613+0000","last_clean":"2024-09-14T11:37:13.458613+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:37:13.458613+0000","last_undegraded":"2024-09-14T11:37:13.458613+0000","last_fullsized":"2024-09-14T11:37:13.458613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:25.564431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756765+0000","last_change":"2024-09-14T10:56:08.840369+0000","last_active":"2024-09-14T11:34:23.756765+0000","last_peered":"2024-09-14T11:34:23.756765+0000","last_clean":"2024-09-14T11:34:23.756765+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:34:23.756765+0000","last_undegraded":"2024-09-14T11:34:23.756765+0000","last_fullsized":"2024-09-14T11:34:23.756765+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'316","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.987614+0000","last_change":"2024-09-14T10:56:06.827678+0000","last_active":"2024-09-14T11:37:46.987614+0000","last_peered":"2024-09-14T11:37:46.987614+0000","last_clean":"2024-09-14T11:37:46.987614+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:37:46.987614+0000","last_undegraded":"2024-09-14T11:37:46.987614+0000","last_fullsized":"2024-09-14T11:37:46.987614+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:00.287082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":39728,"num_write":960,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.867092+0000","last_change":"2024-09-14T10:56:10.851426+0000","last_active":"2024-09-14T11:35:19.867092+0000","last_peered":"2024-09-14T11:35:19.867092+0000","last_clean":"2024-09-14T11:35:19.867092+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:35:19.867092+0000","last_undegraded":"2024-09-14T11:35:19.867092+0000","last_fullsized":"2024-09-14T11:35:19.867092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.334991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'463","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.643327+0000","last_change":"2024-09-14T10:56:12.850654+0000","last_active":"2024-09-14T11:37:46.643327+0000","last_peered":"2024-09-14T11:37:46.643327+0000","last_clean":"2024-09-14T11:37:46.643327+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:37:46.643327+0000","last_undegraded":"2024-09-14T11:37:46.643327+0000","last_fullsized":"2024-09-14T11:37:46.643327+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:01.231786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91900,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":1934,"num_write":662,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866535+0000","last_change":"2024-09-14T10:56:14.862461+0000","last_active":"2024-09-14T11:35:14.866535+0000","last_peered":"2024-09-14T11:35:14.866535+0000","last_clean":"2024-09-14T11:35:14.866535+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:35:14.866535+0000","last_undegraded":"2024-09-14T11:35:14.866535+0000","last_fullsized":"2024-09-14T11:35:14.866535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:30.827794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'106","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764320+0000","last_change":"2024-09-14T10:56:16.874312+0000","last_active":"2024-09-14T11:35:18.764320+0000","last_peered":"2024-09-14T11:35:18.764320+0000","last_clean":"2024-09-14T11:35:18.764320+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:35:18.764320+0000","last_undegraded":"2024-09-14T11:35:18.764320+0000","last_fullsized":"2024-09-14T11:35:18.764320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:06.689124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'255","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891045+0000","last_change":"2024-09-14T10:56:08.840033+0000","last_active":"2024-09-14T11:34:24.891045+0000","last_peered":"2024-09-14T11:34:24.891045+0000","last_clean":"2024-09-14T11:34:24.891045+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:34:24.891045+0000","last_undegraded":"2024-09-14T11:34:24.891045+0000","last_fullsized":"2024-09-14T11:34:24.891045+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'270","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.847995+0000","last_change":"2024-09-14T10:56:06.831914+0000","last_active":"2024-09-14T11:35:30.847995+0000","last_peered":"2024-09-14T11:35:30.847995+0000","last_clean":"2024-09-14T11:35:30.847995+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:35:30.847995+0000","last_undegraded":"2024-09-14T11:35:30.847995+0000","last_fullsized":"2024-09-14T11:35:30.847995+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:23.908631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3711631,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":456,"num_read_kb":5559,"num_write":943,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861192+0000","last_change":"2024-09-14T10:56:10.851153+0000","last_active":"2024-09-14T11:34:29.861192+0000","last_peered":"2024-09-14T11:34:29.861192+0000","last_clean":"2024-09-14T11:34:29.861192+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:34:29.861192+0000","last_undegraded":"2024-09-14T11:34:29.861192+0000","last_fullsized":"2024-09-14T11:34:29.861192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:53.218265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'273","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:44.910823+0000","last_change":"2024-09-14T10:56:12.851527+0000","last_active":"2024-09-14T11:36:44.910823+0000","last_peered":"2024-09-14T11:36:44.910823+0000","last_clean":"2024-09-14T11:36:44.910823+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:36:44.910823+0000","last_undegraded":"2024-09-14T11:36:44.910823+0000","last_fullsized":"2024-09-14T11:36:44.910823+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:56.803494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52141,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":468,"num_read_kb":920,"num_write":424,"num_write_kb":349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T10:56:14.862397+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:41.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'106","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:25.618639+0000","last_change":"2024-09-14T10:56:16.877499+0000","last_active":"2024-09-14T11:36:25.618639+0000","last_peered":"2024-09-14T11:36:25.618639+0000","last_clean":"2024-09-14T11:36:25.618639+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:36:25.618639+0000","last_undegraded":"2024-09-14T11:36:25.618639+0000","last_fullsized":"2024-09-14T11:36:25.618639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:22.117249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'104","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.329749+0000","last_change":"2024-09-14T10:56:08.840230+0000","last_active":"2024-09-14T11:35:36.329749+0000","last_peered":"2024-09-14T11:35:36.329749+0000","last_clean":"2024-09-14T11:35:36.329749+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:35:36.329749+0000","last_undegraded":"2024-09-14T11:35:36.329749+0000","last_fullsized":"2024-09-14T11:35:36.329749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:33.596968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'306","reported_seq":947,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:21.857104+0000","last_change":"2024-09-14T10:56:06.834028+0000","last_active":"2024-09-14T11:35:21.857104+0000","last_peered":"2024-09-14T11:35:21.857104+0000","last_clean":"2024-09-14T11:35:21.857104+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:35:21.857104+0000","last_undegraded":"2024-09-14T11:35:21.857104+0000","last_fullsized":"2024-09-14T11:35:21.857104+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:18.403230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12936231,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":560,"num_read_kb":12205,"num_write":1103,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757753+0000","last_change":"2024-09-14T10:56:10.852013+0000","last_active":"2024-09-14T11:34:28.757753+0000","last_peered":"2024-09-14T11:34:28.757753+0000","last_clean":"2024-09-14T11:34:28.757753+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:34:28.757753+0000","last_undegraded":"2024-09-14T11:34:28.757753+0000","last_fullsized":"2024-09-14T11:34:28.757753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.745857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'286","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:49.877742+0000","last_change":"2024-09-14T10:56:12.856779+0000","last_active":"2024-09-14T11:36:49.877742+0000","last_peered":"2024-09-14T11:36:49.877742+0000","last_clean":"2024-09-14T11:36:49.877742+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:36:49.877742+0000","last_undegraded":"2024-09-14T11:36:49.877742+0000","last_fullsized":"2024-09-14T11:36:49.877742+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:24.231799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56846,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":994,"num_write":404,"num_write_kb":311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'722","reported_seq":2189,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.645256+0000","last_change":"2024-09-14T10:56:14.866439+0000","last_active":"2024-09-14T11:37:14.645256+0000","last_peered":"2024-09-14T11:37:14.645256+0000","last_clean":"2024-09-14T11:37:14.645256+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:37:14.645256+0000","last_undegraded":"2024-09-14T11:37:14.645256+0000","last_fullsized":"2024-09-14T11:37:14.645256+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":701,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:07.193263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'138","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.817608+0000","last_change":"2024-09-14T10:56:16.873210+0000","last_active":"2024-09-14T11:35:25.817608+0000","last_peered":"2024-09-14T11:35:25.817608+0000","last_clean":"2024-09-14T11:35:25.817608+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:35:25.817608+0000","last_undegraded":"2024-09-14T11:35:25.817608+0000","last_fullsized":"2024-09-14T11:35:25.817608+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:57.429498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'172","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.052682+0000","last_change":"2024-09-14T10:56:08.843637+0000","last_active":"2024-09-14T11:35:20.052682+0000","last_peered":"2024-09-14T11:35:20.052682+0000","last_clean":"2024-09-14T11:35:20.052682+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:35:20.052682+0000","last_undegraded":"2024-09-14T11:35:20.052682+0000","last_fullsized":"2024-09-14T11:35:20.052682+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:12.290035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'268","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897404+0000","last_change":"2024-09-14T10:56:06.830680+0000","last_active":"2024-09-14T11:35:09.897404+0000","last_peered":"2024-09-14T11:35:09.897404+0000","last_clean":"2024-09-14T11:35:09.897404+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:35:09.897404+0000","last_undegraded":"2024-09-14T11:35:09.897404+0000","last_fullsized":"2024-09-14T11:35:09.897404+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":200,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:18.827199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5602628,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":418,"num_read_kb":8775,"num_write":941,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.571412+0000","last_change":"2024-09-14T10:56:10.849165+0000","last_active":"2024-09-14T11:37:45.571412+0000","last_peered":"2024-09-14T11:37:45.571412+0000","last_clean":"2024-09-14T11:37:45.571412+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:37:45.571412+0000","last_undegraded":"2024-09-14T11:37:45.571412+0000","last_fullsized":"2024-09-14T11:37:45.571412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:00.894650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.427200+0000","last_change":"2024-09-14T10:56:13.041348+0000","last_active":"2024-09-14T11:36:21.427200+0000","last_peered":"2024-09-14T11:36:21.427200+0000","last_clean":"2024-09-14T11:36:21.427200+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:36:21.427200+0000","last_undegraded":"2024-09-14T11:36:21.427200+0000","last_fullsized":"2024-09-14T11:36:21.427200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:28.818595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'750","reported_seq":2171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.646121+0000","last_change":"2024-09-14T10:56:14.868996+0000","last_active":"2024-09-14T11:37:14.646121+0000","last_peered":"2024-09-14T11:37:14.646121+0000","last_clean":"2024-09-14T11:37:14.646121+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:37:14.646121+0000","last_undegraded":"2024-09-14T11:37:14.646121+0000","last_fullsized":"2024-09-14T11:37:14.646121+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":700,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.783931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.530654+0000","last_change":"2024-09-14T10:56:16.870911+0000","last_active":"2024-09-14T11:35:56.530654+0000","last_peered":"2024-09-14T11:35:56.530654+0000","last_clean":"2024-09-14T11:35:56.530654+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:35:56.530654+0000","last_undegraded":"2024-09-14T11:35:56.530654+0000","last_fullsized":"2024-09-14T11:35:56.530654+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.800135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'625","reported_seq":1464,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.902240+0000","last_change":"2024-09-14T10:56:08.839242+0000","last_active":"2024-09-14T11:35:19.902240+0000","last_peered":"2024-09-14T11:35:19.902240+0000","last_clean":"2024-09-14T11:35:19.902240+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:35:19.902240+0000","last_undegraded":"2024-09-14T11:35:19.902240+0000","last_fullsized":"2024-09-14T11:35:19.902240+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:35.763543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'324","reported_seq":1090,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:11.993637+0000","last_change":"2024-09-14T10:56:06.823223+0000","last_active":"2024-09-14T11:35:11.993637+0000","last_peered":"2024-09-14T11:35:11.993637+0000","last_clean":"2024-09-14T11:35:11.993637+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:35:11.993637+0000","last_undegraded":"2024-09-14T11:35:11.993637+0000","last_fullsized":"2024-09-14T11:35:11.993637+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:05.387288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20990213,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":1073,"num_read_kb":48196,"num_write":1145,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891740+0000","last_change":"2024-09-14T10:56:10.850019+0000","last_active":"2024-09-14T11:34:29.891740+0000","last_peered":"2024-09-14T11:34:29.891740+0000","last_clean":"2024-09-14T11:34:29.891740+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:34:29.891740+0000","last_undegraded":"2024-09-14T11:34:29.891740+0000","last_fullsized":"2024-09-14T11:34:29.891740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:25.627310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'348","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.370868+0000","last_change":"2024-09-14T10:56:12.853756+0000","last_active":"2024-09-14T11:37:46.370868+0000","last_peered":"2024-09-14T11:37:46.370868+0000","last_clean":"2024-09-14T11:37:46.370868+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:37:46.370868+0000","last_undegraded":"2024-09-14T11:37:46.370868+0000","last_fullsized":"2024-09-14T11:37:46.370868+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:44.126582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46246,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1178,"num_read_kb":1754,"num_write":1698,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891290+0000","last_change":"2024-09-14T10:56:14.865772+0000","last_active":"2024-09-14T11:34:29.891290+0000","last_peered":"2024-09-14T11:34:29.891290+0000","last_clean":"2024-09-14T11:34:29.891290+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:34:29.891290+0000","last_undegraded":"2024-09-14T11:34:29.891290+0000","last_fullsized":"2024-09-14T11:34:29.891290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:37.189265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.162130+0000","last_change":"2024-09-14T10:56:16.875685+0000","last_active":"2024-09-14T11:35:37.162130+0000","last_peered":"2024-09-14T11:35:37.162130+0000","last_clean":"2024-09-14T11:35:37.162130+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:35:37.162130+0000","last_undegraded":"2024-09-14T11:35:37.162130+0000","last_fullsized":"2024-09-14T11:35:37.162130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:13.149449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.085890+0000","last_change":"2024-09-14T10:56:08.845279+0000","last_active":"2024-09-14T11:35:16.085890+0000","last_peered":"2024-09-14T11:35:16.085890+0000","last_clean":"2024-09-14T11:35:16.085890+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:35:16.085890+0000","last_undegraded":"2024-09-14T11:35:16.085890+0000","last_fullsized":"2024-09-14T11:35:16.085890+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:06.992049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886612+0000","last_change":"2024-09-14T10:55:50.534148+0000","last_active":"2024-09-14T11:33:54.886612+0000","last_peered":"2024-09-14T11:33:54.886612+0000","last_clean":"2024-09-14T11:33:54.886612+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:33:54.886612+0000","last_undegraded":"2024-09-14T11:33:54.886612+0000","last_fullsized":"2024-09-14T11:33:54.886612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_clean_scrub_stamp":"2024-09-14T10:55:48.742998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:03.355721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883203+0000","last_change":"2024-09-14T10:55:58.792442+0000","last_active":"2024-09-14T11:35:32.883203+0000","last_peered":"2024-09-14T11:35:32.883203+0000","last_clean":"2024-09-14T11:35:32.883203+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:35:32.883203+0000","last_undegraded":"2024-09-14T11:35:32.883203+0000","last_fullsized":"2024-09-14T11:35:32.883203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:23.936072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'256","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:28.687141+0000","last_change":"2024-09-14T10:56:06.824568+0000","last_active":"2024-09-14T11:35:28.687141+0000","last_peered":"2024-09-14T11:35:28.687141+0000","last_clean":"2024-09-14T11:35:28.687141+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:35:28.687141+0000","last_undegraded":"2024-09-14T11:35:28.687141+0000","last_fullsized":"2024-09-14T11:35:28.687141+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:35.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9233775,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":558,"num_read_kb":14625,"num_write":896,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885320+0000","last_change":"2024-09-14T10:56:10.847413+0000","last_active":"2024-09-14T11:33:44.885320+0000","last_peered":"2024-09-14T11:33:44.885320+0000","last_clean":"2024-09-14T11:33:44.885320+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:33:44.885320+0000","last_undegraded":"2024-09-14T11:33:44.885320+0000","last_fullsized":"2024-09-14T11:33:44.885320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:14.506201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'729","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.782116+0000","last_change":"2024-09-14T10:56:12.853693+0000","last_active":"2024-09-14T11:37:46.782116+0000","last_peered":"2024-09-14T11:37:46.782116+0000","last_clean":"2024-09-14T11:37:46.782116+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:37:46.782116+0000","last_undegraded":"2024-09-14T11:37:46.782116+0000","last_fullsized":"2024-09-14T11:37:46.782116+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.618315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1412,"num_read_kb":3246,"num_write":1300,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764311+0000","last_change":"2024-09-14T10:56:14.867670+0000","last_active":"2024-09-14T11:35:18.764311+0000","last_peered":"2024-09-14T11:35:18.764311+0000","last_clean":"2024-09-14T11:35:18.764311+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:35:18.764311+0000","last_undegraded":"2024-09-14T11:35:18.764311+0000","last_fullsized":"2024-09-14T11:35:18.764311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:07.515289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'194","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.647341+0000","last_change":"2024-09-14T10:56:16.872059+0000","last_active":"2024-09-14T11:35:56.647341+0000","last_peered":"2024-09-14T11:35:56.647341+0000","last_clean":"2024-09-14T11:35:56.647341+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:35:56.647341+0000","last_undegraded":"2024-09-14T11:35:56.647341+0000","last_fullsized":"2024-09-14T11:35:56.647341+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.250321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'188","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763118+0000","last_change":"2024-09-14T10:56:08.839810+0000","last_active":"2024-09-14T11:35:08.763118+0000","last_peered":"2024-09-14T11:35:08.763118+0000","last_clean":"2024-09-14T11:35:08.763118+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:35:08.763118+0000","last_undegraded":"2024-09-14T11:35:08.763118+0000","last_fullsized":"2024-09-14T11:35:08.763118+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:33.165560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.887822+0000","last_change":"2024-09-14T10:55:59.204366+0000","last_active":"2024-09-14T11:34:04.887822+0000","last_peered":"2024-09-14T11:34:04.887822+0000","last_clean":"2024-09-14T11:34:04.887822+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:34:04.887822+0000","last_undegraded":"2024-09-14T11:34:04.887822+0000","last_fullsized":"2024-09-14T11:34:04.887822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:15.414745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'395","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990626+0000","last_change":"2024-09-14T10:56:06.833177+0000","last_active":"2024-09-14T11:37:46.990626+0000","last_peered":"2024-09-14T11:37:46.990626+0000","last_clean":"2024-09-14T11:37:46.990626+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:46.990626+0000","last_undegraded":"2024-09-14T11:37:46.990626+0000","last_fullsized":"2024-09-14T11:37:46.990626+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:52.299621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":799,"num_read_kb":83524,"num_write":1261,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"35'5","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.559396+0000","last_change":"2024-09-14T10:56:10.849032+0000","last_active":"2024-09-14T11:37:45.559396+0000","last_peered":"2024-09-14T11:37:45.559396+0000","last_clean":"2024-09-14T11:37:45.559396+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:37:45.559396+0000","last_undegraded":"2024-09-14T11:37:45.559396+0000","last_fullsized":"2024-09-14T11:37:45.559396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:01.123575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1237","reported_seq":2667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:47.003749+0000","last_change":"2024-09-14T10:56:12.856442+0000","last_active":"2024-09-14T11:37:47.003749+0000","last_peered":"2024-09-14T11:37:47.003749+0000","last_clean":"2024-09-14T11:37:47.003749+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:37:47.003749+0000","last_undegraded":"2024-09-14T11:37:47.003749+0000","last_fullsized":"2024-09-14T11:37:47.003749+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138368,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1980,"num_read_kb":3690,"num_write":1076,"num_write_kb":906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:49.886081+0000","last_change":"2024-09-14T10:56:14.860734+0000","last_active":"2024-09-14T11:33:49.886081+0000","last_peered":"2024-09-14T11:33:49.886081+0000","last_clean":"2024-09-14T11:33:49.886081+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:33:49.886081+0000","last_undegraded":"2024-09-14T11:33:49.886081+0000","last_fullsized":"2024-09-14T11:33:49.886081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:40.424100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'240","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.064636+0000","last_change":"2024-09-14T10:56:16.876125+0000","last_active":"2024-09-14T11:35:54.064636+0000","last_peered":"2024-09-14T11:35:54.064636+0000","last_clean":"2024-09-14T11:35:54.064636+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:35:54.064636+0000","last_undegraded":"2024-09-14T11:35:54.064636+0000","last_fullsized":"2024-09-14T11:35:54.064636+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.302671+0000","last_change":"2024-09-14T10:56:42.662120+0000","last_active":"2024-09-14T11:34:26.302671+0000","last_peered":"2024-09-14T11:34:26.302671+0000","last_clean":"2024-09-14T11:34:26.302671+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:34:26.302671+0000","last_undegraded":"2024-09-14T11:34:26.302671+0000","last_fullsized":"2024-09-14T11:34:26.302671+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:08.405772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:34.868699+0000","last_change":"2024-09-14T10:55:59.134312+0000","last_active":"2024-09-14T11:35:34.868699+0000","last_peered":"2024-09-14T11:35:34.868699+0000","last_clean":"2024-09-14T11:35:34.868699+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:35:34.868699+0000","last_undegraded":"2024-09-14T11:35:34.868699+0000","last_fullsized":"2024-09-14T11:35:34.868699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:08.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'361","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990542+0000","last_change":"2024-09-14T10:56:06.820891+0000","last_active":"2024-09-14T11:37:46.990542+0000","last_peered":"2024-09-14T11:37:46.990542+0000","last_clean":"2024-09-14T11:37:46.990542+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:37:46.990542+0000","last_undegraded":"2024-09-14T11:37:46.990542+0000","last_fullsized":"2024-09-14T11:37:46.990542+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:17.493636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":61657,"num_write":1199,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866597+0000","last_change":"2024-09-14T10:56:10.852125+0000","last_active":"2024-09-14T11:35:14.866597+0000","last_peered":"2024-09-14T11:35:14.866597+0000","last_clean":"2024-09-14T11:35:14.866597+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:35:14.866597+0000","last_undegraded":"2024-09-14T11:35:14.866597+0000","last_fullsized":"2024-09-14T11:35:14.866597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:31.365946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'215","reported_seq":1248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:10.201505+0000","last_change":"2024-09-14T10:56:13.041674+0000","last_active":"2024-09-14T11:37:10.201505+0000","last_peered":"2024-09-14T11:37:10.201505+0000","last_clean":"2024-09-14T11:37:10.201505+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:37:10.201505+0000","last_undegraded":"2024-09-14T11:37:10.201505+0000","last_fullsized":"2024-09-14T11:37:10.201505+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:35.426913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752243+0000","last_change":"2024-09-14T10:56:14.869132+0000","last_active":"2024-09-14T11:33:48.752243+0000","last_peered":"2024-09-14T11:33:48.752243+0000","last_clean":"2024-09-14T11:33:48.752243+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:33:48.752243+0000","last_undegraded":"2024-09-14T11:33:48.752243+0000","last_fullsized":"2024-09-14T11:33:48.752243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:52.698938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'258","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.791105+0000","last_change":"2024-09-14T10:56:16.878981+0000","last_active":"2024-09-14T11:35:56.791105+0000","last_peered":"2024-09-14T11:35:56.791105+0000","last_clean":"2024-09-14T11:35:56.791105+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:35:56.791105+0000","last_undegraded":"2024-09-14T11:35:56.791105+0000","last_fullsized":"2024-09-14T11:35:56.791105+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:11.858964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:43.767593+0000","last_change":"2024-09-14T10:56:08.845281+0000","last_active":"2024-09-14T11:35:43.767593+0000","last_peered":"2024-09-14T11:35:43.767593+0000","last_clean":"2024-09-14T11:35:43.767593+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:35:43.767593+0000","last_undegraded":"2024-09-14T11:35:43.767593+0000","last_fullsized":"2024-09-14T11:35:43.767593+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:49.926283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883164+0000","last_change":"2024-09-14T10:55:58.793099+0000","last_active":"2024-09-14T11:35:32.883164+0000","last_peered":"2024-09-14T11:35:32.883164+0000","last_clean":"2024-09-14T11:35:32.883164+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:35:32.883164+0000","last_undegraded":"2024-09-14T11:35:32.883164+0000","last_fullsized":"2024-09-14T11:35:32.883164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:04.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'361","reported_seq":1109,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.875978+0000","last_change":"2024-09-14T10:56:06.833233+0000","last_active":"2024-09-14T11:35:23.875978+0000","last_peered":"2024-09-14T11:35:23.875978+0000","last_clean":"2024-09-14T11:35:23.875978+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:35:23.875978+0000","last_undegraded":"2024-09-14T11:35:23.875978+0000","last_fullsized":"2024-09-14T11:35:23.875978+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:46.083613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10658231,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":823,"num_read_kb":119862,"num_write":1247,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752967+0000","last_change":"2024-09-14T10:56:10.848955+0000","last_active":"2024-09-14T11:33:53.752967+0000","last_peered":"2024-09-14T11:33:53.752967+0000","last_clean":"2024-09-14T11:33:53.752967+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:33:53.752967+0000","last_undegraded":"2024-09-14T11:33:53.752967+0000","last_fullsized":"2024-09-14T11:33:53.752967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:51.182938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.762188+0000","last_change":"2024-09-14T10:56:12.855698+0000","last_active":"2024-09-14T11:37:14.762188+0000","last_peered":"2024-09-14T11:37:14.762188+0000","last_clean":"2024-09-14T11:37:14.762188+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:37:14.762188+0000","last_undegraded":"2024-09-14T11:37:14.762188+0000","last_fullsized":"2024-09-14T11:37:14.762188+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:26.322719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897812+0000","last_change":"2024-09-14T10:56:14.864184+0000","last_active":"2024-09-14T11:35:14.897812+0000","last_peered":"2024-09-14T11:35:14.897812+0000","last_clean":"2024-09-14T11:35:14.897812+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:35:14.897812+0000","last_undegraded":"2024-09-14T11:35:14.897812+0000","last_fullsized":"2024-09-14T11:35:14.897812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:25.882149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.040892+0000","last_change":"2024-09-14T10:56:16.875071+0000","last_active":"2024-09-14T11:35:31.040892+0000","last_peered":"2024-09-14T11:35:31.040892+0000","last_clean":"2024-09-14T11:35:31.040892+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:35:31.040892+0000","last_undegraded":"2024-09-14T11:35:31.040892+0000","last_fullsized":"2024-09-14T11:35:31.040892+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:51.001726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:43.767562+0000","last_change":"2024-09-14T10:56:08.846819+0000","last_active":"2024-09-14T11:35:43.767562+0000","last_peered":"2024-09-14T11:35:43.767562+0000","last_clean":"2024-09-14T11:35:43.767562+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:35:43.767562+0000","last_undegraded":"2024-09-14T11:35:43.767562+0000","last_fullsized":"2024-09-14T11:35:43.767562+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:55.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'363","reported_seq":1002,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.964320+0000","last_change":"2024-09-14T10:56:06.828378+0000","last_active":"2024-09-14T11:37:46.964320+0000","last_peered":"2024-09-14T11:37:46.964320+0000","last_clean":"2024-09-14T11:37:46.964320+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:37:46.964320+0000","last_undegraded":"2024-09-14T11:37:46.964320+0000","last_fullsized":"2024-09-14T11:37:46.964320+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.040311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":12538,"num_write":1147,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.766384+0000","last_change":"2024-09-14T10:55:58.795298+0000","last_active":"2024-09-14T11:35:33.766384+0000","last_peered":"2024-09-14T11:35:33.766384+0000","last_clean":"2024-09-14T11:35:33.766384+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:35:33.766384+0000","last_undegraded":"2024-09-14T11:35:33.766384+0000","last_fullsized":"2024-09-14T11:35:33.766384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:33.298341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.560637+0000","last_change":"2024-09-14T10:56:10.849045+0000","last_active":"2024-09-14T11:37:45.560637+0000","last_peered":"2024-09-14T11:37:45.560637+0000","last_clean":"2024-09-14T11:37:45.560637+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:37:45.560637+0000","last_undegraded":"2024-09-14T11:37:45.560637+0000","last_fullsized":"2024-09-14T11:37:45.560637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:24.164136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'591","reported_seq":1245,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.821141+0000","last_change":"2024-09-14T10:56:12.857610+0000","last_active":"2024-09-14T11:37:46.821141+0000","last_peered":"2024-09-14T11:37:46.821141+0000","last_clean":"2024-09-14T11:37:46.821141+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:37:46.821141+0000","last_undegraded":"2024-09-14T11:37:46.821141+0000","last_fullsized":"2024-09-14T11:37:46.821141+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.734579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94043,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":992,"num_read_kb":2221,"num_write":850,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885969+0000","last_change":"2024-09-14T10:56:14.866887+0000","last_active":"2024-09-14T11:33:44.885969+0000","last_peered":"2024-09-14T11:33:44.885969+0000","last_clean":"2024-09-14T11:33:44.885969+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:33:44.885969+0000","last_undegraded":"2024-09-14T11:33:44.885969+0000","last_fullsized":"2024-09-14T11:33:44.885969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:18.571111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.463557+0000","last_change":"2024-09-14T10:56:16.874511+0000","last_active":"2024-09-14T11:35:33.463557+0000","last_peered":"2024-09-14T11:35:33.463557+0000","last_clean":"2024-09-14T11:35:33.463557+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:35:33.463557+0000","last_undegraded":"2024-09-14T11:35:33.463557+0000","last_fullsized":"2024-09-14T11:35:33.463557+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:37.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.066687+0000","last_change":"2024-09-14T10:56:08.844695+0000","last_active":"2024-09-14T11:35:54.066687+0000","last_peered":"2024-09-14T11:35:54.066687+0000","last_clean":"2024-09-14T11:35:54.066687+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:35:54.066687+0000","last_undegraded":"2024-09-14T11:35:54.066687+0000","last_fullsized":"2024-09-14T11:35:54.066687+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:48.072778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'348","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.993309+0000","last_change":"2024-09-14T10:56:06.820948+0000","last_active":"2024-09-14T11:37:46.993309+0000","last_peered":"2024-09-14T11:37:46.993309+0000","last_clean":"2024-09-14T11:37:46.993309+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:37:46.993309+0000","last_undegraded":"2024-09-14T11:37:46.993309+0000","last_fullsized":"2024-09-14T11:37:46.993309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:42.568606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":702,"num_read_kb":48648,"num_write":1220,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901911+0000","last_change":"2024-09-14T10:55:59.204323+0000","last_active":"2024-09-14T11:35:39.901911+0000","last_peered":"2024-09-14T11:35:39.901911+0000","last_clean":"2024-09-14T11:35:39.901911+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:35:39.901911+0000","last_undegraded":"2024-09-14T11:35:39.901911+0000","last_fullsized":"2024-09-14T11:35:39.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:50.070588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885825+0000","last_change":"2024-09-14T10:56:10.846790+0000","last_active":"2024-09-14T11:33:44.885825+0000","last_peered":"2024-09-14T11:33:44.885825+0000","last_clean":"2024-09-14T11:33:44.885825+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:33:44.885825+0000","last_undegraded":"2024-09-14T11:33:44.885825+0000","last_fullsized":"2024-09-14T11:33:44.885825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:14.639629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'148","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.474378+0000","last_change":"2024-09-14T10:56:13.041311+0000","last_active":"2024-09-14T11:36:21.474378+0000","last_peered":"2024-09-14T11:36:21.474378+0000","last_clean":"2024-09-14T11:36:21.474378+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:36:21.474378+0000","last_undegraded":"2024-09-14T11:36:21.474378+0000","last_fullsized":"2024-09-14T11:36:21.474378+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:12.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'794","reported_seq":2759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.623315+0000","last_change":"2024-09-14T10:56:14.864682+0000","last_active":"2024-09-14T11:37:46.623315+0000","last_peered":"2024-09-14T11:37:46.623315+0000","last_clean":"2024-09-14T11:37:46.623315+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:37:46.623315+0000","last_undegraded":"2024-09-14T11:37:46.623315+0000","last_fullsized":"2024-09-14T11:37:46.623315+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.506777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'136","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:55.622534+0000","last_change":"2024-09-14T10:56:16.878173+0000","last_active":"2024-09-14T11:36:55.622534+0000","last_peered":"2024-09-14T11:36:55.622534+0000","last_clean":"2024-09-14T11:36:55.622534+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:36:55.622534+0000","last_undegraded":"2024-09-14T11:36:55.622534+0000","last_fullsized":"2024-09-14T11:36:55.622534+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:18.316372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.457301+0000","last_change":"2024-09-14T10:56:08.849379+0000","last_active":"2024-09-14T11:37:13.457301+0000","last_peered":"2024-09-14T11:37:13.457301+0000","last_clean":"2024-09-14T11:37:13.457301+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:37:13.457301+0000","last_undegraded":"2024-09-14T11:37:13.457301+0000","last_fullsized":"2024-09-14T11:37:13.457301+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:13.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'280","reported_seq":893,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:10.609210+0000","last_change":"2024-09-14T10:56:06.833600+0000","last_active":"2024-09-14T11:35:10.609210+0000","last_peered":"2024-09-14T11:35:10.609210+0000","last_clean":"2024-09-14T11:35:10.609210+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:35:10.609210+0000","last_undegraded":"2024-09-14T11:35:10.609210+0000","last_fullsized":"2024-09-14T11:35:10.609210+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:55.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7480146,"num_objects":75,"num_object_clones":0,"num_object_copies":150,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":75,"num_whiteouts":0,"num_read":475,"num_read_kb":3885,"num_write":978,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761758+0000","last_change":"2024-09-14T10:55:58.795304+0000","last_active":"2024-09-14T11:34:58.761758+0000","last_peered":"2024-09-14T11:34:58.761758+0000","last_clean":"2024-09-14T11:34:58.761758+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:34:58.761758+0000","last_undegraded":"2024-09-14T11:34:58.761758+0000","last_fullsized":"2024-09-14T11:34:58.761758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:07.609351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885956+0000","last_change":"2024-09-14T10:56:10.845757+0000","last_active":"2024-09-14T11:33:44.885956+0000","last_peered":"2024-09-14T11:33:44.885956+0000","last_clean":"2024-09-14T11:33:44.885956+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:33:44.885956+0000","last_undegraded":"2024-09-14T11:33:44.885956+0000","last_fullsized":"2024-09-14T11:33:44.885956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:40.015207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'105","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.461753+0000","last_change":"2024-09-14T10:56:12.854078+0000","last_active":"2024-09-14T11:36:21.461753+0000","last_peered":"2024-09-14T11:36:21.461753+0000","last_clean":"2024-09-14T11:36:21.461753+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:36:21.461753+0000","last_undegraded":"2024-09-14T11:36:21.461753+0000","last_fullsized":"2024-09-14T11:36:21.461753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:53.954428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'791","reported_seq":2381,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.647364+0000","last_change":"2024-09-14T10:56:14.861395+0000","last_active":"2024-09-14T11:37:14.647364+0000","last_peered":"2024-09-14T11:37:14.647364+0000","last_clean":"2024-09-14T11:37:14.647364+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:37:14.647364+0000","last_undegraded":"2024-09-14T11:37:14.647364+0000","last_fullsized":"2024-09-14T11:37:14.647364+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:14.062981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'253","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.639576+0000","last_change":"2024-09-14T10:56:16.874903+0000","last_active":"2024-09-14T11:35:56.639576+0000","last_peered":"2024-09-14T11:35:56.639576+0000","last_clean":"2024-09-14T11:35:56.639576+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:35:56.639576+0000","last_undegraded":"2024-09-14T11:35:56.639576+0000","last_fullsized":"2024-09-14T11:35:56.639576+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.818843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:14.482865+0000","last_change":"2024-09-14T10:56:08.841683+0000","last_active":"2024-09-14T11:34:14.482865+0000","last_peered":"2024-09-14T11:34:14.482865+0000","last_clean":"2024-09-14T11:34:14.482865+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:34:14.482865+0000","last_undegraded":"2024-09-14T11:34:14.482865+0000","last_fullsized":"2024-09-14T11:34:14.482865+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:09.542327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'359","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.967641+0000","last_change":"2024-09-14T10:56:06.831292+0000","last_active":"2024-09-14T11:37:46.967641+0000","last_peered":"2024-09-14T11:37:46.967641+0000","last_clean":"2024-09-14T11:37:46.967641+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:46.967641+0000","last_undegraded":"2024-09-14T11:37:46.967641+0000","last_fullsized":"2024-09-14T11:37:46.967641+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:53.008130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":848,"num_read_kb":56309,"num_write":1145,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895598+0000","last_change":"2024-09-14T10:55:59.387955+0000","last_active":"2024-09-14T11:34:59.895598+0000","last_peered":"2024-09-14T11:34:59.895598+0000","last_clean":"2024-09-14T11:34:59.895598+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:34:59.895598+0000","last_undegraded":"2024-09-14T11:34:59.895598+0000","last_fullsized":"2024-09-14T11:34:59.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:35.502046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.602419+0000","last_change":"2024-09-14T10:56:10.847591+0000","last_active":"2024-09-14T11:34:20.602419+0000","last_peered":"2024-09-14T11:34:20.602419+0000","last_clean":"2024-09-14T11:34:20.602419+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:34:20.602419+0000","last_undegraded":"2024-09-14T11:34:20.602419+0000","last_fullsized":"2024-09-14T11:34:20.602419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:12.477652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'703","reported_seq":1397,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.603594+0000","last_change":"2024-09-14T10:56:13.041312+0000","last_active":"2024-09-14T11:37:14.603594+0000","last_peered":"2024-09-14T11:37:14.603594+0000","last_clean":"2024-09-14T11:37:14.603594+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:37:14.603594+0000","last_undegraded":"2024-09-14T11:37:14.603594+0000","last_fullsized":"2024-09-14T11:37:14.603594+0000","mapping_epoch":29,"log_start":"264'600","ondisk_log_start":"264'600","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:15.894086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":164960,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1252,"num_read_kb":2696,"num_write":1032,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598055+0000","last_change":"2024-09-14T10:56:14.856227+0000","last_active":"2024-09-14T11:33:45.598055+0000","last_peered":"2024-09-14T11:33:45.598055+0000","last_clean":"2024-09-14T11:33:45.598055+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:33:45.598055+0000","last_undegraded":"2024-09-14T11:33:45.598055+0000","last_fullsized":"2024-09-14T11:33:45.598055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:33.427287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'135","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.661856+0000","last_change":"2024-09-14T10:56:16.875970+0000","last_active":"2024-09-14T11:35:32.661856+0000","last_peered":"2024-09-14T11:35:32.661856+0000","last_clean":"2024-09-14T11:35:32.661856+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:35:32.661856+0000","last_undegraded":"2024-09-14T11:35:32.661856+0000","last_fullsized":"2024-09-14T11:35:32.661856+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.939235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'137","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.148825+0000","last_change":"2024-09-14T10:56:16.878602+0000","last_active":"2024-09-14T11:35:56.148825+0000","last_peered":"2024-09-14T11:35:56.148825+0000","last_clean":"2024-09-14T11:35:56.148825+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:35:56.148825+0000","last_undegraded":"2024-09-14T11:35:56.148825+0000","last_fullsized":"2024-09-14T11:35:56.148825+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:22.821986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'295","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.068636+0000","last_change":"2024-09-14T10:56:08.840398+0000","last_active":"2024-09-14T11:34:47.068636+0000","last_peered":"2024-09-14T11:34:47.068636+0000","last_clean":"2024-09-14T11:34:47.068636+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:34:47.068636+0000","last_undegraded":"2024-09-14T11:34:47.068636+0000","last_fullsized":"2024-09-14T11:34:47.068636+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:37.548644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'233","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.279430+0000","last_change":"2024-09-14T10:56:06.832210+0000","last_active":"2024-09-14T11:35:36.279430+0000","last_peered":"2024-09-14T11:35:36.279430+0000","last_clean":"2024-09-14T11:35:36.279430+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:35:36.279430+0000","last_undegraded":"2024-09-14T11:35:36.279430+0000","last_fullsized":"2024-09-14T11:35:36.279430+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":200,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:05.108211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":325342,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":440,"num_read_kb":2273,"num_write":854,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:33.863009+0000","last_change":"2024-09-14T10:56:10.850437+0000","last_active":"2024-09-14T11:33:33.863009+0000","last_peered":"2024-09-14T11:33:33.863009+0000","last_clean":"2024-09-14T11:33:33.863009+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:33:33.863009+0000","last_undegraded":"2024-09-14T11:33:33.863009+0000","last_fullsized":"2024-09-14T11:33:33.863009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.749205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'250","reported_seq":810,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.477571+0000","last_change":"2024-09-14T10:56:12.855555+0000","last_active":"2024-09-14T11:36:21.477571+0000","last_peered":"2024-09-14T11:36:21.477571+0000","last_clean":"2024-09-14T11:36:21.477571+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:36:21.477571+0000","last_undegraded":"2024-09-14T11:36:21.477571+0000","last_fullsized":"2024-09-14T11:36:21.477571+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:39.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47546,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":804,"num_write":322,"num_write_kb":247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596468+0000","last_change":"2024-09-14T10:56:14.859912+0000","last_active":"2024-09-14T11:33:35.596468+0000","last_peered":"2024-09-14T11:33:35.596468+0000","last_clean":"2024-09-14T11:33:35.596468+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:33:35.596468+0000","last_undegraded":"2024-09-14T11:33:35.596468+0000","last_fullsized":"2024-09-14T11:33:35.596468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:50.590250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'113","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.905145+0000","last_change":"2024-09-14T10:56:16.876189+0000","last_active":"2024-09-14T11:35:54.905145+0000","last_peered":"2024-09-14T11:35:54.905145+0000","last_clean":"2024-09-14T11:35:54.905145+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:35:54.905145+0000","last_undegraded":"2024-09-14T11:35:54.905145+0000","last_fullsized":"2024-09-14T11:35:54.905145+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:08.040744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.724841+0000","last_change":"2024-09-14T10:56:08.846963+0000","last_active":"2024-09-14T11:35:17.724841+0000","last_peered":"2024-09-14T11:35:17.724841+0000","last_clean":"2024-09-14T11:35:17.724841+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:35:17.724841+0000","last_undegraded":"2024-09-14T11:35:17.724841+0000","last_fullsized":"2024-09-14T11:35:17.724841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:44.520201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'253","reported_seq":904,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.307138+0000","last_change":"2024-09-14T10:56:06.832027+0000","last_active":"2024-09-14T11:35:26.307138+0000","last_peered":"2024-09-14T11:35:26.307138+0000","last_clean":"2024-09-14T11:35:26.307138+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:35:26.307138+0000","last_undegraded":"2024-09-14T11:35:26.307138+0000","last_fullsized":"2024-09-14T11:35:26.307138+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:30.367132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12492827,"num_objects":70,"num_object_clones":0,"num_object_copies":140,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":0,"num_read":539,"num_read_kb":9274,"num_write":905,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596533+0000","last_change":"2024-09-14T10:56:10.846714+0000","last_active":"2024-09-14T11:33:35.596533+0000","last_peered":"2024-09-14T11:33:35.596533+0000","last_clean":"2024-09-14T11:33:35.596533+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:33:35.596533+0000","last_undegraded":"2024-09-14T11:33:35.596533+0000","last_fullsized":"2024-09-14T11:33:35.596533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:14.559729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'57","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.293027+0000","last_change":"2024-09-14T10:56:12.851172+0000","last_active":"2024-09-14T11:36:21.293027+0000","last_peered":"2024-09-14T11:36:21.293027+0000","last_clean":"2024-09-14T11:36:21.293027+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:36:21.293027+0000","last_undegraded":"2024-09-14T11:36:21.293027+0000","last_fullsized":"2024-09-14T11:36:21.293027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:56.828348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883833+0000","last_change":"2024-09-14T10:56:14.869388+0000","last_active":"2024-09-14T11:33:34.883833+0000","last_peered":"2024-09-14T11:33:34.883833+0000","last_clean":"2024-09-14T11:33:34.883833+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:33:34.883833+0000","last_undegraded":"2024-09-14T11:33:34.883833+0000","last_fullsized":"2024-09-14T11:33:34.883833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:37.817198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.091148+0000","last_change":"2024-09-14T10:56:16.870386+0000","last_active":"2024-09-14T11:35:56.091148+0000","last_peered":"2024-09-14T11:35:56.091148+0000","last_clean":"2024-09-14T11:35:56.091148+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:35:56.091148+0000","last_undegraded":"2024-09-14T11:35:56.091148+0000","last_fullsized":"2024-09-14T11:35:56.091148+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:47.067599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.083359+0000","last_change":"2024-09-14T10:56:08.846942+0000","last_active":"2024-09-14T11:35:56.083359+0000","last_peered":"2024-09-14T11:35:56.083359+0000","last_clean":"2024-09-14T11:35:56.083359+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:35:56.083359+0000","last_undegraded":"2024-09-14T11:35:56.083359+0000","last_fullsized":"2024-09-14T11:35:56.083359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:59.799497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'358","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.976809+0000","last_change":"2024-09-14T10:56:06.836735+0000","last_active":"2024-09-14T11:37:46.976809+0000","last_peered":"2024-09-14T11:37:46.976809+0000","last_clean":"2024-09-14T11:37:46.976809+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:37:46.976809+0000","last_undegraded":"2024-09-14T11:37:46.976809+0000","last_fullsized":"2024-09-14T11:37:46.976809+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:57.401574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":2982,"num_write":1169,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883799+0000","last_change":"2024-09-14T10:56:10.850036+0000","last_active":"2024-09-14T11:33:34.883799+0000","last_peered":"2024-09-14T11:33:34.883799+0000","last_clean":"2024-09-14T11:33:34.883799+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:33:34.883799+0000","last_undegraded":"2024-09-14T11:33:34.883799+0000","last_fullsized":"2024-09-14T11:33:34.883799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.348764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'303","reported_seq":879,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.449820+0000","last_change":"2024-09-14T10:56:12.856115+0000","last_active":"2024-09-14T11:36:21.449820+0000","last_peered":"2024-09-14T11:36:21.449820+0000","last_clean":"2024-09-14T11:36:21.449820+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:36:21.449820+0000","last_undegraded":"2024-09-14T11:36:21.449820+0000","last_fullsized":"2024-09-14T11:36:21.449820+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:16.373969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55671,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":505,"num_read_kb":1003,"num_write":408,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884434+0000","last_change":"2024-09-14T10:56:14.869461+0000","last_active":"2024-09-14T11:33:34.884434+0000","last_peered":"2024-09-14T11:33:34.884434+0000","last_clean":"2024-09-14T11:33:34.884434+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:33:34.884434+0000","last_undegraded":"2024-09-14T11:33:34.884434+0000","last_fullsized":"2024-09-14T11:33:34.884434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:05.233425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'185","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.325833+0000","last_change":"2024-09-14T10:56:16.875845+0000","last_active":"2024-09-14T11:35:36.325833+0000","last_peered":"2024-09-14T11:35:36.325833+0000","last_clean":"2024-09-14T11:35:36.325833+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:35:36.325833+0000","last_undegraded":"2024-09-14T11:35:36.325833+0000","last_fullsized":"2024-09-14T11:35:36.325833+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:59.857949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:11.701560+0000","last_change":"2024-09-14T10:56:08.839406+0000","last_active":"2024-09-14T11:34:11.701560+0000","last_peered":"2024-09-14T11:34:11.701560+0000","last_clean":"2024-09-14T11:34:11.701560+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:34:11.701560+0000","last_undegraded":"2024-09-14T11:34:11.701560+0000","last_fullsized":"2024-09-14T11:34:11.701560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:41.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'322","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.953754+0000","last_change":"2024-09-14T10:56:06.837904+0000","last_active":"2024-09-14T11:37:46.953754+0000","last_peered":"2024-09-14T11:37:46.953754+0000","last_clean":"2024-09-14T11:37:46.953754+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:37:46.953754+0000","last_undegraded":"2024-09-14T11:37:46.953754+0000","last_fullsized":"2024-09-14T11:37:46.953754+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:12.136843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":4364,"num_write":956,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884386+0000","last_change":"2024-09-14T10:56:10.852317+0000","last_active":"2024-09-14T11:33:34.884386+0000","last_peered":"2024-09-14T11:33:34.884386+0000","last_clean":"2024-09-14T11:33:34.884386+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:33:34.884386+0000","last_undegraded":"2024-09-14T11:33:34.884386+0000","last_fullsized":"2024-09-14T11:33:34.884386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:16.512220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'258","reported_seq":812,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.373604+0000","last_change":"2024-09-14T10:56:12.848425+0000","last_active":"2024-09-14T11:36:21.373604+0000","last_peered":"2024-09-14T11:36:21.373604+0000","last_clean":"2024-09-14T11:36:21.373604+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:36:21.373604+0000","last_undegraded":"2024-09-14T11:36:21.373604+0000","last_fullsized":"2024-09-14T11:36:21.373604+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:32.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52402,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":416,"num_read_kb":874,"num_write":342,"num_write_kb":276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750839+0000","last_change":"2024-09-14T10:56:14.863993+0000","last_active":"2024-09-14T11:33:38.750839+0000","last_peered":"2024-09-14T11:33:38.750839+0000","last_clean":"2024-09-14T11:33:38.750839+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:33:38.750839+0000","last_undegraded":"2024-09-14T11:33:38.750839+0000","last_fullsized":"2024-09-14T11:33:38.750839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:28.114909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.115874+0000","last_change":"2024-09-14T10:56:08.840371+0000","last_active":"2024-09-14T11:34:57.115874+0000","last_peered":"2024-09-14T11:34:57.115874+0000","last_clean":"2024-09-14T11:34:57.115874+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:34:57.115874+0000","last_undegraded":"2024-09-14T11:34:57.115874+0000","last_fullsized":"2024-09-14T11:34:57.115874+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:29.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'249","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:50.606583+0000","last_change":"2024-09-14T10:56:06.829430+0000","last_active":"2024-09-14T11:34:50.606583+0000","last_peered":"2024-09-14T11:34:50.606583+0000","last_clean":"2024-09-14T11:34:50.606583+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:34:50.606583+0000","last_undegraded":"2024-09-14T11:34:50.606583+0000","last_fullsized":"2024-09-14T11:34:50.606583+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:54.337485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12172022,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":428,"num_read_kb":11663,"num_write":905,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756814+0000","last_change":"2024-09-14T10:56:10.845758+0000","last_active":"2024-09-14T11:34:23.756814+0000","last_peered":"2024-09-14T11:34:23.756814+0000","last_clean":"2024-09-14T11:34:23.756814+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:34:23.756814+0000","last_undegraded":"2024-09-14T11:34:23.756814+0000","last_fullsized":"2024-09-14T11:34:23.756814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'479","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.747954+0000","last_change":"2024-09-14T10:56:12.857013+0000","last_active":"2024-09-14T11:37:46.747954+0000","last_peered":"2024-09-14T11:37:46.747954+0000","last_clean":"2024-09-14T11:37:46.747954+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:37:46.747954+0000","last_undegraded":"2024-09-14T11:37:46.747954+0000","last_fullsized":"2024-09-14T11:37:46.747954+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192423,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":855,"num_read_kb":2213,"num_write":738,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868166+0000","last_change":"2024-09-14T10:56:14.866608+0000","last_active":"2024-09-14T11:33:47.868166+0000","last_peered":"2024-09-14T11:33:47.868166+0000","last_clean":"2024-09-14T11:33:47.868166+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:33:47.868166+0000","last_undegraded":"2024-09-14T11:33:47.868166+0000","last_fullsized":"2024-09-14T11:33:47.868166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:07.568392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'180","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.637830+0000","last_change":"2024-09-14T10:56:16.877816+0000","last_active":"2024-09-14T11:35:56.637830+0000","last_peered":"2024-09-14T11:35:56.637830+0000","last_clean":"2024-09-14T11:35:56.637830+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:35:56.637830+0000","last_undegraded":"2024-09-14T11:35:56.637830+0000","last_fullsized":"2024-09-14T11:35:56.637830+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.287323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.254239+0000","last_change":"2024-09-14T10:56:08.843523+0000","last_active":"2024-09-14T11:34:54.254239+0000","last_peered":"2024-09-14T11:34:54.254239+0000","last_clean":"2024-09-14T11:34:54.254239+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:34:54.254239+0000","last_undegraded":"2024-09-14T11:34:54.254239+0000","last_fullsized":"2024-09-14T11:34:54.254239+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:16.988838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'325","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.892563+0000","last_change":"2024-09-14T10:56:06.824700+0000","last_active":"2024-09-14T11:37:46.892563+0000","last_peered":"2024-09-14T11:37:46.892563+0000","last_clean":"2024-09-14T11:37:46.892563+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:46.892563+0000","last_undegraded":"2024-09-14T11:37:46.892563+0000","last_fullsized":"2024-09-14T11:37:46.892563+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:30.572275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":3066,"num_write":996,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885912+0000","last_change":"2024-09-14T10:56:10.851611+0000","last_active":"2024-09-14T11:33:44.885912+0000","last_peered":"2024-09-14T11:33:44.885912+0000","last_clean":"2024-09-14T11:33:44.885912+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:33:44.885912+0000","last_undegraded":"2024-09-14T11:33:44.885912+0000","last_fullsized":"2024-09-14T11:33:44.885912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.503933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'331","reported_seq":899,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.464520+0000","last_change":"2024-09-14T10:56:12.850684+0000","last_active":"2024-09-14T11:37:13.464520+0000","last_peered":"2024-09-14T11:37:13.464520+0000","last_clean":"2024-09-14T11:37:13.464520+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:37:13.464520+0000","last_undegraded":"2024-09-14T11:37:13.464520+0000","last_fullsized":"2024-09-14T11:37:13.464520+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.655979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69844,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":543,"num_read_kb":1107,"num_write":466,"num_write_kb":370,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.864958+0000","last_change":"2024-09-14T10:56:14.863516+0000","last_active":"2024-09-14T11:33:48.864958+0000","last_peered":"2024-09-14T11:33:48.864958+0000","last_clean":"2024-09-14T11:33:48.864958+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:33:48.864958+0000","last_undegraded":"2024-09-14T11:33:48.864958+0000","last_fullsized":"2024-09-14T11:33:48.864958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.527433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.073475+0000","last_change":"2024-09-14T10:56:16.873262+0000","last_active":"2024-09-14T11:35:27.073475+0000","last_peered":"2024-09-14T11:35:27.073475+0000","last_clean":"2024-09-14T11:35:27.073475+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:35:27.073475+0000","last_undegraded":"2024-09-14T11:35:27.073475+0000","last_fullsized":"2024-09-14T11:35:27.073475+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:21.859002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.926778+0000","last_change":"2024-09-14T10:56:08.841022+0000","last_active":"2024-09-14T11:35:23.926778+0000","last_peered":"2024-09-14T11:35:23.926778+0000","last_clean":"2024-09-14T11:35:23.926778+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:35:23.926778+0000","last_undegraded":"2024-09-14T11:35:23.926778+0000","last_fullsized":"2024-09-14T11:35:23.926778+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:11.924992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'299","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.832223+0000","last_change":"2024-09-14T10:56:06.831161+0000","last_active":"2024-09-14T11:34:23.832223+0000","last_peered":"2024-09-14T11:34:23.832223+0000","last_clean":"2024-09-14T11:34:23.832223+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:34:23.832223+0000","last_undegraded":"2024-09-14T11:34:23.832223+0000","last_fullsized":"2024-09-14T11:34:23.832223+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:43.805445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16832488,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":510,"num_read_kb":69620,"num_write":1071,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886067+0000","last_change":"2024-09-14T10:56:10.848128+0000","last_active":"2024-09-14T11:33:44.886067+0000","last_peered":"2024-09-14T11:33:44.886067+0000","last_clean":"2024-09-14T11:33:44.886067+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:33:44.886067+0000","last_undegraded":"2024-09-14T11:33:44.886067+0000","last_fullsized":"2024-09-14T11:33:44.886067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:51.970572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'265","reported_seq":827,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.480456+0000","last_change":"2024-09-14T10:56:13.041394+0000","last_active":"2024-09-14T11:36:21.480456+0000","last_peered":"2024-09-14T11:36:21.480456+0000","last_clean":"2024-09-14T11:36:21.480456+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:36:21.480456+0000","last_undegraded":"2024-09-14T11:36:21.480456+0000","last_fullsized":"2024-09-14T11:36:21.480456+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:59.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60641,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":448,"num_read_kb":944,"num_write":368,"num_write_kb":298,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757802+0000","last_change":"2024-09-14T10:56:14.862660+0000","last_active":"2024-09-14T11:34:28.757802+0000","last_peered":"2024-09-14T11:34:28.757802+0000","last_clean":"2024-09-14T11:34:28.757802+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:34:28.757802+0000","last_undegraded":"2024-09-14T11:34:28.757802+0000","last_fullsized":"2024-09-14T11:34:28.757802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:53.685139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'113","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.629869+0000","last_change":"2024-09-14T10:56:16.874807+0000","last_active":"2024-09-14T11:37:14.629869+0000","last_peered":"2024-09-14T11:37:14.629869+0000","last_clean":"2024-09-14T11:37:14.629869+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:37:14.629869+0000","last_undegraded":"2024-09-14T11:37:14.629869+0000","last_fullsized":"2024-09-14T11:37:14.629869+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:23.768244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.865069+0000","last_change":"2024-09-14T10:56:08.842580+0000","last_active":"2024-09-14T11:35:16.865069+0000","last_peered":"2024-09-14T11:35:16.865069+0000","last_clean":"2024-09-14T11:35:16.865069+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:35:16.865069+0000","last_undegraded":"2024-09-14T11:35:16.865069+0000","last_fullsized":"2024-09-14T11:35:16.865069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:35.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'348","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.993593+0000","last_change":"2024-09-14T10:56:06.834528+0000","last_active":"2024-09-14T11:37:46.993593+0000","last_peered":"2024-09-14T11:37:46.993593+0000","last_clean":"2024-09-14T11:37:46.993593+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:37:46.993593+0000","last_undegraded":"2024-09-14T11:37:46.993593+0000","last_fullsized":"2024-09-14T11:37:46.993593+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:09.265221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":33947,"num_write":1155,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.864422+0000","last_change":"2024-09-14T10:56:10.849432+0000","last_active":"2024-09-14T11:33:43.864422+0000","last_peered":"2024-09-14T11:33:43.864422+0000","last_clean":"2024-09-14T11:33:43.864422+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:33:43.864422+0000","last_undegraded":"2024-09-14T11:33:43.864422+0000","last_fullsized":"2024-09-14T11:33:43.864422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:43.219622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.472266+0000","last_change":"2024-09-14T10:56:13.041708+0000","last_active":"2024-09-14T11:36:21.472266+0000","last_peered":"2024-09-14T11:36:21.472266+0000","last_clean":"2024-09-14T11:36:21.472266+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:36:21.472266+0000","last_undegraded":"2024-09-14T11:36:21.472266+0000","last_fullsized":"2024-09-14T11:36:21.472266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:44.179299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'751","reported_seq":4574,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.641743+0000","last_change":"2024-09-14T10:56:14.869079+0000","last_active":"2024-09-14T11:37:14.641743+0000","last_peered":"2024-09-14T11:37:14.641743+0000","last_clean":"2024-09-14T11:37:14.641743+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:37:14.641743+0000","last_undegraded":"2024-09-14T11:37:14.641743+0000","last_fullsized":"2024-09-14T11:37:14.641743+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":700,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:27.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'126","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.897308+0000","last_change":"2024-09-14T10:56:16.877187+0000","last_active":"2024-09-14T11:35:19.897308+0000","last_peered":"2024-09-14T11:35:19.897308+0000","last_clean":"2024-09-14T11:35:19.897308+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:35:19.897308+0000","last_undegraded":"2024-09-14T11:35:19.897308+0000","last_fullsized":"2024-09-14T11:35:19.897308+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:51.016753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.586731+0000","last_change":"2024-09-14T10:56:08.839500+0000","last_active":"2024-09-14T11:34:57.586731+0000","last_peered":"2024-09-14T11:34:57.586731+0000","last_clean":"2024-09-14T11:34:57.586731+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:34:57.586731+0000","last_undegraded":"2024-09-14T11:34:57.586731+0000","last_fullsized":"2024-09-14T11:34:57.586731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:48.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'351","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.957447+0000","last_change":"2024-09-14T10:56:06.836000+0000","last_active":"2024-09-14T11:37:46.957447+0000","last_peered":"2024-09-14T11:37:46.957447+0000","last_clean":"2024-09-14T11:37:46.957447+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:37:46.957447+0000","last_undegraded":"2024-09-14T11:37:46.957447+0000","last_fullsized":"2024-09-14T11:37:46.957447+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:46.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":780,"num_read_kb":7716,"num_write":1096,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885243+0000","last_change":"2024-09-14T10:56:10.851020+0000","last_active":"2024-09-14T11:33:44.885243+0000","last_peered":"2024-09-14T11:33:44.885243+0000","last_clean":"2024-09-14T11:33:44.885243+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:33:44.885243+0000","last_undegraded":"2024-09-14T11:33:44.885243+0000","last_fullsized":"2024-09-14T11:33:44.885243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:54.621932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'321","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.899850+0000","last_change":"2024-09-14T10:56:12.853222+0000","last_active":"2024-09-14T11:37:46.899850+0000","last_peered":"2024-09-14T11:37:46.899850+0000","last_clean":"2024-09-14T11:37:46.899850+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:37:46.899850+0000","last_undegraded":"2024-09-14T11:37:46.899850+0000","last_fullsized":"2024-09-14T11:37:46.899850+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1178,"num_write":428,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761752+0000","last_change":"2024-09-14T10:56:14.869597+0000","last_active":"2024-09-14T11:34:58.761752+0000","last_peered":"2024-09-14T11:34:58.761752+0000","last_clean":"2024-09-14T11:34:58.761752+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:34:58.761752+0000","last_undegraded":"2024-09-14T11:34:58.761752+0000","last_fullsized":"2024-09-14T11:34:58.761752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:57.846436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.460581+0000","last_change":"2024-09-14T10:56:16.872084+0000","last_active":"2024-09-14T11:37:13.460581+0000","last_peered":"2024-09-14T11:37:13.460581+0000","last_clean":"2024-09-14T11:37:13.460581+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:37:13.460581+0000","last_undegraded":"2024-09-14T11:37:13.460581+0000","last_fullsized":"2024-09-14T11:37:13.460581+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:09.391213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.819430+0000","last_change":"2024-09-14T10:56:41.920664+0000","last_active":"2024-09-14T11:35:25.819430+0000","last_peered":"2024-09-14T11:35:25.819430+0000","last_clean":"2024-09-14T11:35:25.819430+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:35:25.819430+0000","last_undegraded":"2024-09-14T11:35:25.819430+0000","last_fullsized":"2024-09-14T11:35:25.819430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.080586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'330","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.960255+0000","last_change":"2024-09-14T10:56:06.829850+0000","last_active":"2024-09-14T11:37:46.960255+0000","last_peered":"2024-09-14T11:37:46.960255+0000","last_clean":"2024-09-14T11:37:46.960255+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:37:46.960255+0000","last_undegraded":"2024-09-14T11:37:46.960255+0000","last_fullsized":"2024-09-14T11:37:46.960255+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:46.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":36817,"num_write":973,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:42.867186+0000","last_change":"2024-09-14T10:56:10.846542+0000","last_active":"2024-09-14T11:33:42.867186+0000","last_peered":"2024-09-14T11:33:42.867186+0000","last_clean":"2024-09-14T11:33:42.867186+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:33:42.867186+0000","last_undegraded":"2024-09-14T11:33:42.867186+0000","last_fullsized":"2024-09-14T11:33:42.867186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.655261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'283","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.935397+0000","last_change":"2024-09-14T10:56:12.854064+0000","last_active":"2024-09-14T11:37:46.935397+0000","last_peered":"2024-09-14T11:37:46.935397+0000","last_clean":"2024-09-14T11:37:46.935397+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:37:46.935397+0000","last_undegraded":"2024-09-14T11:37:46.935397+0000","last_fullsized":"2024-09-14T11:37:46.935397+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.267552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43010,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":1018,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895529+0000","last_change":"2024-09-14T10:56:14.866692+0000","last_active":"2024-09-14T11:34:59.895529+0000","last_peered":"2024-09-14T11:34:59.895529+0000","last_clean":"2024-09-14T11:34:59.895529+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:34:59.895529+0000","last_undegraded":"2024-09-14T11:34:59.895529+0000","last_fullsized":"2024-09-14T11:34:59.895529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:02.219332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'151","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.062796+0000","last_change":"2024-09-14T10:56:16.877739+0000","last_active":"2024-09-14T11:35:54.062796+0000","last_peered":"2024-09-14T11:35:54.062796+0000","last_clean":"2024-09-14T11:35:54.062796+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:35:54.062796+0000","last_undegraded":"2024-09-14T11:35:54.062796+0000","last_fullsized":"2024-09-14T11:35:54.062796+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:45.768007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'125","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607195+0000","last_change":"2024-09-14T10:56:08.838852+0000","last_active":"2024-09-14T11:34:55.607195+0000","last_peered":"2024-09-14T11:34:55.607195+0000","last_clean":"2024-09-14T11:34:55.607195+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:34:55.607195+0000","last_undegraded":"2024-09-14T11:34:55.607195+0000","last_fullsized":"2024-09-14T11:34:55.607195+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:23.082263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'315","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.982622+0000","last_change":"2024-09-14T10:56:06.830822+0000","last_active":"2024-09-14T11:34:55.982622+0000","last_peered":"2024-09-14T11:34:55.982622+0000","last_clean":"2024-09-14T11:34:55.982622+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:34:55.982622+0000","last_undegraded":"2024-09-14T11:34:55.982622+0000","last_fullsized":"2024-09-14T11:34:55.982622+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:26.425490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":977629,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":563,"num_read_kb":16528,"num_write":1250,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895271+0000","last_change":"2024-09-14T10:56:10.849183+0000","last_active":"2024-09-14T11:34:54.895271+0000","last_peered":"2024-09-14T11:34:54.895271+0000","last_clean":"2024-09-14T11:34:54.895271+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:34:54.895271+0000","last_undegraded":"2024-09-14T11:34:54.895271+0000","last_fullsized":"2024-09-14T11:34:54.895271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:41.598284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'265","reported_seq":809,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:09.426114+0000","last_change":"2024-09-14T10:56:12.853468+0000","last_active":"2024-09-14T11:37:09.426114+0000","last_peered":"2024-09-14T11:37:09.426114+0000","last_clean":"2024-09-14T11:37:09.426114+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:37:09.426114+0000","last_undegraded":"2024-09-14T11:37:09.426114+0000","last_fullsized":"2024-09-14T11:37:09.426114+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":200,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:48.351559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65752,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":443,"num_read_kb":996,"num_write":378,"num_write_kb":338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886032+0000","last_change":"2024-09-14T10:56:14.870248+0000","last_active":"2024-09-14T11:33:44.886032+0000","last_peered":"2024-09-14T11:33:44.886032+0000","last_clean":"2024-09-14T11:33:44.886032+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:33:44.886032+0000","last_undegraded":"2024-09-14T11:33:44.886032+0000","last_fullsized":"2024-09-14T11:33:44.886032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.097159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'174","reported_seq":1634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.097709+0000","last_change":"2024-09-14T10:56:16.874279+0000","last_active":"2024-09-14T11:35:56.097709+0000","last_peered":"2024-09-14T11:35:56.097709+0000","last_clean":"2024-09-14T11:35:56.097709+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:35:56.097709+0000","last_undegraded":"2024-09-14T11:35:56.097709+0000","last_fullsized":"2024-09-14T11:35:56.097709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:13.650009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.042909+0000","last_change":"2024-09-14T10:56:08.843487+0000","last_active":"2024-09-14T11:35:31.042909+0000","last_peered":"2024-09-14T11:35:31.042909+0000","last_clean":"2024-09-14T11:35:31.042909+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:35:31.042909+0000","last_undegraded":"2024-09-14T11:35:31.042909+0000","last_fullsized":"2024-09-14T11:35:31.042909+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:16.895665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'359","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.997321+0000","last_change":"2024-09-14T10:56:41.921531+0000","last_active":"2024-09-14T11:37:46.997321+0000","last_peered":"2024-09-14T11:37:46.997321+0000","last_clean":"2024-09-14T11:37:46.997321+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:37:46.997321+0000","last_undegraded":"2024-09-14T11:37:46.997321+0000","last_fullsized":"2024-09-14T11:37:46.997321+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:51.807850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":662,"num_read_kb":13580,"num_write":1124,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762455+0000","last_change":"2024-09-14T10:56:10.850525+0000","last_active":"2024-09-14T11:35:03.762455+0000","last_peered":"2024-09-14T11:35:03.762455+0000","last_clean":"2024-09-14T11:35:03.762455+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:35:03.762455+0000","last_undegraded":"2024-09-14T11:35:03.762455+0000","last_fullsized":"2024-09-14T11:35:03.762455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'276","reported_seq":855,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.380353+0000","last_change":"2024-09-14T10:56:12.850877+0000","last_active":"2024-09-14T11:36:21.380353+0000","last_peered":"2024-09-14T11:36:21.380353+0000","last_clean":"2024-09-14T11:36:21.380353+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:36:21.380353+0000","last_undegraded":"2024-09-14T11:36:21.380353+0000","last_fullsized":"2024-09-14T11:36:21.380353+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":200,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:39.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53578,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":464,"num_read_kb":932,"num_write":374,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752208+0000","last_change":"2024-09-14T10:56:14.864169+0000","last_active":"2024-09-14T11:33:48.752208+0000","last_peered":"2024-09-14T11:33:48.752208+0000","last_clean":"2024-09-14T11:33:48.752208+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:33:48.752208+0000","last_undegraded":"2024-09-14T11:33:48.752208+0000","last_fullsized":"2024-09-14T11:33:48.752208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:15.470147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.456829+0000","last_change":"2024-09-14T10:56:16.872566+0000","last_active":"2024-09-14T11:37:13.456829+0000","last_peered":"2024-09-14T11:37:13.456829+0000","last_clean":"2024-09-14T11:37:13.456829+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:37:13.456829+0000","last_undegraded":"2024-09-14T11:37:13.456829+0000","last_fullsized":"2024-09-14T11:37:13.456829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:34.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763120+0000","last_change":"2024-09-14T10:56:08.840955+0000","last_active":"2024-09-14T11:35:08.763120+0000","last_peered":"2024-09-14T11:35:08.763120+0000","last_clean":"2024-09-14T11:35:08.763120+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:35:08.763120+0000","last_undegraded":"2024-09-14T11:35:08.763120+0000","last_fullsized":"2024-09-14T11:35:08.763120+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.823863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'310","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:30.007043+0000","last_change":"2024-09-14T10:56:06.833785+0000","last_active":"2024-09-14T11:35:30.007043+0000","last_peered":"2024-09-14T11:35:30.007043+0000","last_clean":"2024-09-14T11:35:30.007043+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:35:30.007043+0000","last_undegraded":"2024-09-14T11:35:30.007043+0000","last_fullsized":"2024-09-14T11:35:30.007043+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:27.562038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6749314,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":69,"num_whiteouts":0,"num_read":567,"num_read_kb":8660,"num_write":1006,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763097+0000","last_change":"2024-09-14T10:56:08.850785+0000","last_active":"2024-09-14T11:35:08.763097+0000","last_peered":"2024-09-14T11:35:08.763097+0000","last_clean":"2024-09-14T11:35:08.763097+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:35:08.763097+0000","last_undegraded":"2024-09-14T11:35:08.763097+0000","last_fullsized":"2024-09-14T11:35:08.763097+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:01.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'369","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.695445+0000","last_change":"2024-09-14T10:56:06.822844+0000","last_active":"2024-09-14T11:34:20.695445+0000","last_peered":"2024-09-14T11:34:20.695445+0000","last_clean":"2024-09-14T11:34:20.695445+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:34:20.695445+0000","last_undegraded":"2024-09-14T11:34:20.695445+0000","last_fullsized":"2024-09-14T11:34:20.695445+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:18.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17418872,"num_objects":78,"num_object_clones":0,"num_object_copies":156,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":78,"num_whiteouts":0,"num_read":684,"num_read_kb":16318,"num_write":1423,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880525+0000","last_change":"2024-09-14T10:56:08.848489+0000","last_active":"2024-09-14T11:35:12.880525+0000","last_peered":"2024-09-14T11:35:12.880525+0000","last_clean":"2024-09-14T11:35:12.880525+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:35:12.880525+0000","last_undegraded":"2024-09-14T11:35:12.880525+0000","last_fullsized":"2024-09-14T11:35:12.880525+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:03.708119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'301","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.942893+0000","last_change":"2024-09-14T10:56:06.827629+0000","last_active":"2024-09-14T11:37:46.942893+0000","last_peered":"2024-09-14T11:37:46.942893+0000","last_clean":"2024-09-14T11:37:46.942893+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:37:46.942893+0000","last_undegraded":"2024-09-14T11:37:46.942893+0000","last_fullsized":"2024-09-14T11:37:46.942893+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:56.559924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":2695,"num_write":898,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763055+0000","last_change":"2024-09-14T10:56:08.845334+0000","last_active":"2024-09-14T11:35:08.763055+0000","last_peered":"2024-09-14T11:35:08.763055+0000","last_clean":"2024-09-14T11:35:08.763055+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:35:08.763055+0000","last_undegraded":"2024-09-14T11:35:08.763055+0000","last_fullsized":"2024-09-14T11:35:08.763055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'351","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.951892+0000","last_change":"2024-09-14T10:56:41.922043+0000","last_active":"2024-09-14T11:37:46.951892+0000","last_peered":"2024-09-14T11:37:46.951892+0000","last_clean":"2024-09-14T11:37:46.951892+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:37:46.951892+0000","last_undegraded":"2024-09-14T11:37:46.951892+0000","last_fullsized":"2024-09-14T11:37:46.951892+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:53.350669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":27796,"num_write":1160,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.498343+0000","last_change":"2024-09-14T10:56:08.847845+0000","last_active":"2024-09-14T11:35:38.498343+0000","last_peered":"2024-09-14T11:35:38.498343+0000","last_clean":"2024-09-14T11:35:38.498343+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:35:38.498343+0000","last_undegraded":"2024-09-14T11:35:38.498343+0000","last_fullsized":"2024-09-14T11:35:38.498343+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:22.522568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'375","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.430964+0000","last_change":"2024-09-14T10:56:06.833611+0000","last_active":"2024-09-14T11:35:14.430964+0000","last_peered":"2024-09-14T11:35:14.430964+0000","last_clean":"2024-09-14T11:35:14.430964+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:35:14.430964+0000","last_undegraded":"2024-09-14T11:35:14.430964+0000","last_fullsized":"2024-09-14T11:35:14.430964+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:09.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13190882,"num_objects":67,"num_object_clones":0,"num_object_copies":134,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":1346,"num_read_kb":14785,"num_write":1204,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:22.049621+0000","last_change":"2024-09-14T10:56:08.844274+0000","last_active":"2024-09-14T11:35:22.049621+0000","last_peered":"2024-09-14T11:35:22.049621+0000","last_clean":"2024-09-14T11:35:22.049621+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:35:22.049621+0000","last_undegraded":"2024-09-14T11:35:22.049621+0000","last_fullsized":"2024-09-14T11:35:22.049621+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:07.843122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'417","reported_seq":1081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.946047+0000","last_change":"2024-09-14T10:56:06.822860+0000","last_active":"2024-09-14T11:37:46.946047+0000","last_peered":"2024-09-14T11:37:46.946047+0000","last_clean":"2024-09-14T11:37:46.946047+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:37:46.946047+0000","last_undegraded":"2024-09-14T11:37:46.946047+0000","last_fullsized":"2024-09-14T11:37:46.946047+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:33.951896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":745,"num_read_kb":54735,"num_write":1248,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:59.783590+0000","last_change":"2024-09-14T10:56:08.842881+0000","last_active":"2024-09-14T11:33:59.783590+0000","last_peered":"2024-09-14T11:33:59.783590+0000","last_clean":"2024-09-14T11:33:59.783590+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:33:59.783590+0000","last_undegraded":"2024-09-14T11:33:59.783590+0000","last_fullsized":"2024-09-14T11:33:59.783590+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:22.148598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'368","reported_seq":1143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.114582+0000","last_change":"2024-09-14T10:56:06.832770+0000","last_active":"2024-09-14T11:35:36.114582+0000","last_peered":"2024-09-14T11:35:36.114582+0000","last_clean":"2024-09-14T11:35:36.114582+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:35:36.114582+0000","last_undegraded":"2024-09-14T11:35:36.114582+0000","last_fullsized":"2024-09-14T11:35:36.114582+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:20.311265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5628247,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":1087,"num_read_kb":46426,"num_write":1418,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'302","reported_seq":932,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.248090+0000","last_change":"2024-09-14T10:56:08.846123+0000","last_active":"2024-09-14T11:35:13.248090+0000","last_peered":"2024-09-14T11:35:13.248090+0000","last_clean":"2024-09-14T11:35:13.248090+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:35:13.248090+0000","last_undegraded":"2024-09-14T11:35:13.248090+0000","last_fullsized":"2024-09-14T11:35:13.248090+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:53.557283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'255","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:10.609228+0000","last_change":"2024-09-14T10:56:06.834641+0000","last_active":"2024-09-14T11:35:10.609228+0000","last_peered":"2024-09-14T11:35:10.609228+0000","last_clean":"2024-09-14T11:35:10.609228+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:35:10.609228+0000","last_undegraded":"2024-09-14T11:35:10.609228+0000","last_fullsized":"2024-09-14T11:35:10.609228+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.416149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5351444,"num_objects":68,"num_object_clones":0,"num_object_copies":136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":0,"num_read":411,"num_read_kb":5718,"num_write":921,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.559561+0000","last_change":"2024-09-14T10:56:08.835412+0000","last_active":"2024-09-14T11:35:18.559561+0000","last_peered":"2024-09-14T11:35:18.559561+0000","last_clean":"2024-09-14T11:35:18.559561+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:35:18.559561+0000","last_undegraded":"2024-09-14T11:35:18.559561+0000","last_fullsized":"2024-09-14T11:35:18.559561+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:49.723578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'373","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.988658+0000","last_change":"2024-09-14T10:56:06.829591+0000","last_active":"2024-09-14T11:37:46.988658+0000","last_peered":"2024-09-14T11:37:46.988658+0000","last_clean":"2024-09-14T11:37:46.988658+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:37:46.988658+0000","last_undegraded":"2024-09-14T11:37:46.988658+0000","last_fullsized":"2024-09-14T11:37:46.988658+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:39.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":8094,"num_write":1138,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883767+0000","last_change":"2024-09-14T10:56:08.842404+0000","last_active":"2024-09-14T11:33:29.883767+0000","last_peered":"2024-09-14T11:33:29.883767+0000","last_clean":"2024-09-14T11:33:29.883767+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:33:29.883767+0000","last_undegraded":"2024-09-14T11:33:29.883767+0000","last_fullsized":"2024-09-14T11:33:29.883767+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:20.506202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'281","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.618849+0000","last_change":"2024-09-14T10:56:06.834541+0000","last_active":"2024-09-14T11:35:16.618849+0000","last_peered":"2024-09-14T11:35:16.618849+0000","last_clean":"2024-09-14T11:35:16.618849+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:35:16.618849+0000","last_undegraded":"2024-09-14T11:35:16.618849+0000","last_fullsized":"2024-09-14T11:35:16.618849+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:07.196281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19849358,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":593,"num_read_kb":52896,"num_write":1076,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861201+0000","last_change":"2024-09-14T10:56:08.841270+0000","last_active":"2024-09-14T11:34:29.861201+0000","last_peered":"2024-09-14T11:34:29.861201+0000","last_clean":"2024-09-14T11:34:29.861201+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:34:29.861201+0000","last_undegraded":"2024-09-14T11:34:29.861201+0000","last_fullsized":"2024-09-14T11:34:29.861201+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:43.163716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'365","reported_seq":1231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.988600+0000","last_change":"2024-09-14T10:56:06.835991+0000","last_active":"2024-09-14T11:37:46.988600+0000","last_peered":"2024-09-14T11:37:46.988600+0000","last_clean":"2024-09-14T11:37:46.988600+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:37:46.988600+0000","last_undegraded":"2024-09-14T11:37:46.988600+0000","last_fullsized":"2024-09-14T11:37:46.988600+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:00.421199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":34715,"num_write":1227,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891061+0000","last_change":"2024-09-14T10:56:08.843794+0000","last_active":"2024-09-14T11:34:24.891061+0000","last_peered":"2024-09-14T11:34:24.891061+0000","last_clean":"2024-09-14T11:34:24.891061+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:34:24.891061+0000","last_undegraded":"2024-09-14T11:34:24.891061+0000","last_fullsized":"2024-09-14T11:34:24.891061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:55.919014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'390","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.969711+0000","last_change":"2024-09-14T10:56:06.833787+0000","last_active":"2024-09-14T11:37:46.969711+0000","last_peered":"2024-09-14T11:37:46.969711+0000","last_clean":"2024-09-14T11:37:46.969711+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:37:46.969711+0000","last_undegraded":"2024-09-14T11:37:46.969711+0000","last_fullsized":"2024-09-14T11:37:46.969711+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.576376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":11879,"num_write":1239,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.890453+0000","last_change":"2024-09-14T10:56:08.848886+0000","last_active":"2024-09-14T11:34:24.890453+0000","last_peered":"2024-09-14T11:34:24.890453+0000","last_clean":"2024-09-14T11:34:24.890453+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:34:24.890453+0000","last_undegraded":"2024-09-14T11:34:24.890453+0000","last_fullsized":"2024-09-14T11:34:24.890453+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:04.538771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'311","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:11.849702+0000","last_change":"2024-09-14T10:56:06.832377+0000","last_active":"2024-09-14T11:35:11.849702+0000","last_peered":"2024-09-14T11:35:11.849702+0000","last_clean":"2024-09-14T11:35:11.849702+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:35:11.849702+0000","last_undegraded":"2024-09-14T11:35:11.849702+0000","last_fullsized":"2024-09-14T11:35:11.849702+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":300,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:58.015169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5486220,"num_objects":94,"num_object_clones":0,"num_object_copies":188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":0,"num_read":646,"num_read_kb":26247,"num_write":1120,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:51.228206+0000","last_change":"2024-09-14T10:56:08.839416+0000","last_active":"2024-09-14T11:34:51.228206+0000","last_peered":"2024-09-14T11:34:51.228206+0000","last_clean":"2024-09-14T11:34:51.228206+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:34:51.228206+0000","last_undegraded":"2024-09-14T11:34:51.228206+0000","last_fullsized":"2024-09-14T11:34:51.228206+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:07.079656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'306","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.548460+0000","last_change":"2024-09-14T10:56:06.830987+0000","last_active":"2024-09-14T11:34:47.548460+0000","last_peered":"2024-09-14T11:34:47.548460+0000","last_clean":"2024-09-14T11:34:47.548460+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:34:47.548460+0000","last_undegraded":"2024-09-14T11:34:47.548460+0000","last_fullsized":"2024-09-14T11:34:47.548460+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:29.841639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23726381,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":608,"num_read_kb":46767,"num_write":1176,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.481366+0000","last_change":"2024-09-14T10:56:08.833880+0000","last_active":"2024-09-14T11:35:14.481366+0000","last_peered":"2024-09-14T11:35:14.481366+0000","last_clean":"2024-09-14T11:35:14.481366+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:35:14.481366+0000","last_undegraded":"2024-09-14T11:35:14.481366+0000","last_fullsized":"2024-09-14T11:35:14.481366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:42.906752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'297","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.946339+0000","last_change":"2024-09-14T10:56:06.832512+0000","last_active":"2024-09-14T11:35:36.946339+0000","last_peered":"2024-09-14T11:35:36.946339+0000","last_clean":"2024-09-14T11:35:36.946339+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:35:36.946339+0000","last_undegraded":"2024-09-14T11:35:36.946339+0000","last_fullsized":"2024-09-14T11:35:36.946339+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.172444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":642444,"num_objects":66,"num_object_clones":0,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":628,"num_read_kb":4317,"num_write":1116,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898132+0000","last_change":"2024-09-14T10:56:08.852010+0000","last_active":"2024-09-14T11:35:14.898132+0000","last_peered":"2024-09-14T11:35:14.898132+0000","last_clean":"2024-09-14T11:35:14.898132+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:35:14.898132+0000","last_undegraded":"2024-09-14T11:35:14.898132+0000","last_fullsized":"2024-09-14T11:35:14.898132+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.513514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'300","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.876919+0000","last_change":"2024-09-14T10:56:06.835010+0000","last_active":"2024-09-14T11:37:46.876919+0000","last_peered":"2024-09-14T11:37:46.876919+0000","last_clean":"2024-09-14T11:37:46.876919+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:37:46.876919+0000","last_undegraded":"2024-09-14T11:37:46.876919+0000","last_fullsized":"2024-09-14T11:37:46.876919+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:42.832634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655902,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":2905,"num_write":1051,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'305","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:51.330258+0000","last_change":"2024-09-14T10:56:41.921185+0000","last_active":"2024-09-14T11:35:51.330258+0000","last_peered":"2024-09-14T11:35:51.330258+0000","last_clean":"2024-09-14T11:35:51.330258+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:35:51.330258+0000","last_undegraded":"2024-09-14T11:35:51.330258+0000","last_fullsized":"2024-09-14T11:35:51.330258+0000","mapping_epoch":36,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:30.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16056280,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":552,"num_read_kb":51615,"num_write":1157,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761881+0000","last_change":"2024-09-14T10:56:08.837369+0000","last_active":"2024-09-14T11:34:58.761881+0000","last_peered":"2024-09-14T11:34:58.761881+0000","last_clean":"2024-09-14T11:34:58.761881+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:34:58.761881+0000","last_undegraded":"2024-09-14T11:34:58.761881+0000","last_fullsized":"2024-09-14T11:34:58.761881+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:04.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'347","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.955628+0000","last_change":"2024-09-14T10:56:06.832783+0000","last_active":"2024-09-14T11:37:46.955628+0000","last_peered":"2024-09-14T11:37:46.955628+0000","last_clean":"2024-09-14T11:37:46.955628+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:37:46.955628+0000","last_undegraded":"2024-09-14T11:37:46.955628+0000","last_fullsized":"2024-09-14T11:37:46.955628+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:18.334532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":18767,"num_write":1102,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877349+0000","last_change":"2024-09-14T10:56:08.841261+0000","last_active":"2024-09-14T11:34:52.877349+0000","last_peered":"2024-09-14T11:34:52.877349+0000","last_clean":"2024-09-14T11:34:52.877349+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:34:52.877349+0000","last_undegraded":"2024-09-14T11:34:52.877349+0000","last_fullsized":"2024-09-14T11:34:52.877349+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:10.975942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1684,"ondisk_log_size":1684,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":528,"ondisk_log_size":528,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1788240,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17296,"num_read_kb":35115,"num_write":14569,"num_write_kb":11666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1896448,"data_stored":1488506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2054,"ondisk_log_size":2054,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4164,"ondisk_log_size":4164,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":394301369,"num_objects":2711,"num_object_clones":0,"num_object_copies":5422,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2711,"num_whiteouts":0,"num_read":41544,"num_read_kb":2045387,"num_write":70452,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":771575808,"data_stored":751055974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4400,"ondisk_log_size":4400,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":62583422,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":127,"num_read_kb":206212,"num_write":144,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":124125184,"data_stored":124118268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":84,"ondisk_log_size":84,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":48237709,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":127,"num_read_kb":193226,"num_write":149,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":88801280,"data_stored":88797822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":89,"ondisk_log_size":89,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509949,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":442036,"kb_used_data":194276,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93929804,"statfs":{"total":96636764160,"available":96184119296,"internally_reserved":0,"allocated":198938624,"data_stored":192955260,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":253688266},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509948,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":334104,"kb_used_data":118280,"kb_used_omap":1,"kb_used_meta":215806,"kb_avail":94037736,"statfs":{"total":96636764160,"available":96294641664,"internally_reserved":0,"allocated":121118720,"data_stored":116532898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":220985798},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509947,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":295300,"kb_used_data":223860,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94076540,"statfs":{"total":96636764160,"available":96334376960,"internally_reserved":0,"allocated":229232640,"data_stored":222840157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509949,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":475860,"kb_used_data":228100,"kb_used_omap":1,"kb_used_meta":247742,"kb_avail":93895980,"statfs":{"total":96636764160,"available":96149483520,"internally_reserved":0,"allocated":233574400,"data_stored":227004899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":253688263},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509948,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":247600,"kb_used_data":190048,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94124240,"statfs":{"total":96636764160,"available":96383221760,"internally_reserved":0,"allocated":194609152,"data_stored":190460100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542654,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110936,"kb_used_data":11744,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94260904,"statfs":{"total":96636764160,"available":96523165696,"internally_reserved":0,"allocated":12025856,"data_stored":10431815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542651,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251112,"kb_used_data":17304,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94120728,"statfs":{"total":96636764160,"available":96379625472,"internally_reserved":0,"allocated":17719296,"data_stored":15992953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575356,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112616,"kb_used_data":9076,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94259224,"statfs":{"total":96636764160,"available":96521445376,"internally_reserved":0,"allocated":9293824,"data_stored":7637406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13430784,"data_stored":13247355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8384512,"data_stored":8279522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":140513280,"data_stored":137837728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":165445632,"data_stored":160410710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":184983552,"data_stored":180046795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":5483519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":95506432,"data_stored":92434140,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":157712384,"data_stored":153316205,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":151552,"data_stored":133157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":561152,"data_stored":477119,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":83611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":315392,"data_stored":260762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":634880,"data_stored":530501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15732736,"data_stored":15731853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":11202560,"data_stored":11199985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":19922944,"data_stored":19922944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":34607104,"data_stored":34606221,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":37752832,"data_stored":37751949,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24834048,"data_stored":24831473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16445440,"data_stored":16442865,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:37:50.056 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-14T11:37:50.394 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:37:50.394 INFO:teuthology.orchestra.run.smithi002.stdout:{"epoch":264,"fsid":"28256c28-b166-4632-9431-ec178da9e31e","created":"2024-09-14T10:55:36.371959+0000","modified":"2024-09-14T11:22:39.546741+0000","last_up_change":"2024-09-14T10:55:48.742998+0000","last_in_change":"2024-09-14T10:55:39.551307+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":15,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-14T10:55:48.674884+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-14T10:55:55.435327+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":21,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-14T10:56:04.996942+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-14T10:56:07.168940+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-14T10:56:09.009330+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-14T10:56:11.115962+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-14T10:56:12.860483+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-14T10:56:14.931196+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-14T11:10:12.433107+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"253","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-14T11:11:55.375175+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"256","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-14T11:11:58.440593+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"259","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-14T11:22:37.151202+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"264","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4b53255-9400-4141-ad4a-c46e2cdfde4b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6808","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6809","nonce":4195093750}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6810","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6811","nonce":4195093750}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6814","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6815","nonce":4195093750}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6812","nonce":4195093750},{"type":"v1","addr":"172.21.15.2:6813","nonce":4195093750}]},"public_addr":"172.21.15.2:6809/4195093750","cluster_addr":"172.21.15.2:6811/4195093750","heartbeat_back_addr":"172.21.15.2:6815/4195093750","heartbeat_front_addr":"172.21.15.2:6813/4195093750","state":["exists","up"]},{"osd":1,"uuid":"991f506b-2537-4722-a275-7f50d332f55a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6800","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6801","nonce":3069717018}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6802","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6803","nonce":3069717018}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6806","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6807","nonce":3069717018}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6804","nonce":3069717018},{"type":"v1","addr":"172.21.15.2:6805","nonce":3069717018}]},"public_addr":"172.21.15.2:6801/3069717018","cluster_addr":"172.21.15.2:6803/3069717018","heartbeat_back_addr":"172.21.15.2:6807/3069717018","heartbeat_front_addr":"172.21.15.2:6805/3069717018","state":["exists","up"]},{"osd":2,"uuid":"2f68b5f2-1578-4d1d-93be-150765c259cb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6824","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6825","nonce":3479486070}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6826","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6827","nonce":3479486070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6830","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6831","nonce":3479486070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6828","nonce":3479486070},{"type":"v1","addr":"172.21.15.2:6829","nonce":3479486070}]},"public_addr":"172.21.15.2:6825/3479486070","cluster_addr":"172.21.15.2:6827/3479486070","heartbeat_back_addr":"172.21.15.2:6831/3479486070","heartbeat_front_addr":"172.21.15.2:6829/3479486070","state":["exists","up"]},{"osd":3,"uuid":"c5a3a715-2f72-4bf3-9d0b-39337ea73022","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6816","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6817","nonce":1337492648}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6818","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6819","nonce":1337492648}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6822","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6823","nonce":1337492648}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.2:6820","nonce":1337492648},{"type":"v1","addr":"172.21.15.2:6821","nonce":1337492648}]},"public_addr":"172.21.15.2:6817/1337492648","cluster_addr":"172.21.15.2:6819/1337492648","heartbeat_back_addr":"172.21.15.2:6823/1337492648","heartbeat_front_addr":"172.21.15.2:6821/1337492648","state":["exists","up"]},{"osd":4,"uuid":"c239a70d-3015-44ba-803a-14bba1258aeb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6802","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6803","nonce":1990035204}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6804","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6805","nonce":1990035204}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6808","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6809","nonce":1990035204}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6806","nonce":1990035204},{"type":"v1","addr":"172.21.15.86:6807","nonce":1990035204}]},"public_addr":"172.21.15.86:6803/1990035204","cluster_addr":"172.21.15.86:6805/1990035204","heartbeat_back_addr":"172.21.15.86:6809/1990035204","heartbeat_front_addr":"172.21.15.86:6807/1990035204","state":["exists","up"]},{"osd":5,"uuid":"377ec39e-3741-43f5-a340-8b2b8aea8920","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6810","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6811","nonce":3386010674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6812","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6813","nonce":3386010674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6816","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6817","nonce":3386010674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6814","nonce":3386010674},{"type":"v1","addr":"172.21.15.86:6815","nonce":3386010674}]},"public_addr":"172.21.15.86:6811/3386010674","cluster_addr":"172.21.15.86:6813/3386010674","heartbeat_back_addr":"172.21.15.86:6817/3386010674","heartbeat_front_addr":"172.21.15.86:6815/3386010674","state":["exists","up"]},{"osd":6,"uuid":"2f1131b6-5c32-4ba0-8e35-657c0e00cb40","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6826","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6827","nonce":3650976683}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6828","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6829","nonce":3650976683}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6832","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6833","nonce":3650976683}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6830","nonce":3650976683},{"type":"v1","addr":"172.21.15.86:6831","nonce":3650976683}]},"public_addr":"172.21.15.86:6827/3650976683","cluster_addr":"172.21.15.86:6829/3650976683","heartbeat_back_addr":"172.21.15.86:6833/3650976683","heartbeat_front_addr":"172.21.15.86:6831/3650976683","state":["exists","up"]},{"osd":7,"uuid":"7708f30b-109d-45b7-a415-a291fab5185c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":262,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6818","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6819","nonce":1094621518}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6820","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6821","nonce":1094621518}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6824","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6825","nonce":1094621518}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.86:6822","nonce":1094621518},{"type":"v1","addr":"172.21.15.86:6823","nonce":1094621518}]},"public_addr":"172.21.15.86:6819/1094621518","cluster_addr":"172.21.15.86:6821/1094621518","heartbeat_back_addr":"172.21.15.86:6825/1094621518","heartbeat_front_addr":"172.21.15.86:6823/1094621518","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.585960+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.395897+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.114373+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.814875+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.839191+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:45.574672+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.395989+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-14T10:55:46.078476+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":2}]},{"pgid":"3.3c","mappings":[{"from":5,"to":2}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.1a","mappings":[{"from":3,"to":2}]},{"pgid":"67.1a","mappings":[{"from":3,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-14T11:37:51.409 INFO:tasks.ceph:Scrubbing osd.0 2024-09-14T11:37:51.409 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:51.566 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:51.566 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:51.566 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:51.577 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-14T11:37:51.896 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 0 to deep-scrub 2024-09-14T11:37:51.907 INFO:tasks.ceph:Scrubbing osd.1 2024-09-14T11:37:51.907 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:52.049 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:52.049 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:52.049 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:52.060 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-14T11:37:52.374 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 1 to deep-scrub 2024-09-14T11:37:52.387 INFO:tasks.ceph:Scrubbing osd.2 2024-09-14T11:37:52.387 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:52.530 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:52.530 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:52.530 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:52.541 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-14T11:37:52.858 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 2 to deep-scrub 2024-09-14T11:37:52.872 INFO:tasks.ceph:Scrubbing osd.3 2024-09-14T11:37:52.872 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:53.015 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:53.015 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:53.015 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:53.026 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-14T11:37:53.344 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 3 to deep-scrub 2024-09-14T11:37:53.357 INFO:tasks.ceph:Scrubbing osd.4 2024-09-14T11:37:53.358 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:53.501 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:53.501 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:53.501 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:53.512 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-14T11:37:53.828 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 4 to deep-scrub 2024-09-14T11:37:53.842 INFO:tasks.ceph:Scrubbing osd.5 2024-09-14T11:37:53.842 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:53.985 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:53.985 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:53.985 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:53.996 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-14T11:37:54.311 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 5 to deep-scrub 2024-09-14T11:37:54.324 INFO:tasks.ceph:Scrubbing osd.6 2024-09-14T11:37:54.325 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:54.466 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:54.466 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:54.466 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:54.477 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-14T11:37:54.791 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 6 to deep-scrub 2024-09-14T11:37:54.804 INFO:tasks.ceph:Scrubbing osd.7 2024-09-14T11:37:54.804 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-14T11:37:54.949 INFO:teuthology.orchestra.run.smithi002.stdout:{ 2024-09-14T11:37:54.949 INFO:teuthology.orchestra.run.smithi002.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-14T11:37:54.949 INFO:teuthology.orchestra.run.smithi002.stdout:} 2024-09-14T11:37:54.961 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-14T11:37:55.278 INFO:teuthology.orchestra.run.smithi002.stderr:instructed osd(s) 7 to deep-scrub 2024-09-14T11:37:55.292 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:37:55.627 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:37:55.638 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:37:55.640 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1520,"stamp":"2024-09-14T11:37:53.665510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36158020,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":196655,"num_read_kb":2597552,"num_write":146051,"num_write_kb":2468367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13189,"ondisk_log_size":13189,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1396852,"kb_used_data":96960,"kb_used_omap":12,"kb_used_meta":1298675,"kb_avail":753577868,"statfs":{"total":773094113280,"available":771663736832,"internally_reserved":0,"allocated":99287040,"data_stored":86283750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1329843760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-707778890,"num_objects":-4099,"num_object_clones":0,"num_object_copies":-8198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-4099,"num_whiteouts":0,"num_read":4583,"num_read_kb":4126,"num_write":4348,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005792"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879647+0000","last_change":"2024-09-14T11:22:38.554296+0000","last_active":"2024-09-14T11:35:07.879647+0000","last_peered":"2024-09-14T11:35:07.879647+0000","last_clean":"2024-09-14T11:35:07.879647+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:35:07.879647+0000","last_undegraded":"2024-09-14T11:35:07.879647+0000","last_fullsized":"2024-09-14T11:35:07.879647+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:24.257792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:32.874387+0000","last_change":"2024-09-14T11:12:00.371370+0000","last_active":"2024-09-14T11:34:32.874387+0000","last_peered":"2024-09-14T11:34:32.874387+0000","last_clean":"2024-09-14T11:34:32.874387+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:34:32.874387+0000","last_undegraded":"2024-09-14T11:34:32.874387+0000","last_fullsized":"2024-09-14T11:34:32.874387+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:10.434332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.943218+0000","last_change":"2024-09-14T11:11:57.356179+0000","last_active":"2024-09-14T11:37:45.943218+0000","last_peered":"2024-09-14T11:37:45.943218+0000","last_clean":"2024-09-14T11:37:45.943218+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:37:45.943218+0000","last_undegraded":"2024-09-14T11:37:45.943218+0000","last_fullsized":"2024-09-14T11:37:45.943218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:20.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763760+0000","last_change":"2024-09-14T11:10:13.511537+0000","last_active":"2024-09-14T11:35:13.763760+0000","last_peered":"2024-09-14T11:35:13.763760+0000","last_clean":"2024-09-14T11:35:13.763760+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:35:13.763760+0000","last_undegraded":"2024-09-14T11:35:13.763760+0000","last_fullsized":"2024-09-14T11:35:13.763760+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.866042+0000","last_change":"2024-09-14T11:22:38.557878+0000","last_active":"2024-09-14T11:35:09.866042+0000","last_peered":"2024-09-14T11:35:09.866042+0000","last_clean":"2024-09-14T11:35:09.866042+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:35:09.866042+0000","last_undegraded":"2024-09-14T11:35:09.866042+0000","last_fullsized":"2024-09-14T11:35:09.866042+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:33.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912661+0000","last_change":"2024-09-14T11:12:00.365069+0000","last_active":"2024-09-14T11:36:59.912661+0000","last_peered":"2024-09-14T11:36:59.912661+0000","last_clean":"2024-09-14T11:36:59.912661+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:36:59.912661+0000","last_undegraded":"2024-09-14T11:36:59.912661+0000","last_fullsized":"2024-09-14T11:36:59.912661+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.203248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.051192+0000","last_change":"2024-09-14T11:11:57.352596+0000","last_active":"2024-09-14T11:37:46.051192+0000","last_peered":"2024-09-14T11:37:46.051192+0000","last_clean":"2024-09-14T11:37:46.051192+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:37:46.051192+0000","last_undegraded":"2024-09-14T11:37:46.051192+0000","last_fullsized":"2024-09-14T11:37:46.051192+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.294796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:56.089950+0000","last_change":"2024-09-14T11:10:13.500557+0000","last_active":"2024-09-14T11:34:56.089950+0000","last_peered":"2024-09-14T11:34:56.089950+0000","last_clean":"2024-09-14T11:34:56.089950+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:34:56.089950+0000","last_undegraded":"2024-09-14T11:34:56.089950+0000","last_fullsized":"2024-09-14T11:34:56.089950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.821678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:44.893419+0000","last_change":"2024-09-14T11:22:38.555518+0000","last_active":"2024-09-14T11:34:44.893419+0000","last_peered":"2024-09-14T11:34:44.893419+0000","last_clean":"2024-09-14T11:34:44.893419+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:34:44.893419+0000","last_undegraded":"2024-09-14T11:34:44.893419+0000","last_fullsized":"2024-09-14T11:34:44.893419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:12.998285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.452291+0000","last_change":"2024-09-14T11:12:00.696948+0000","last_active":"2024-09-14T11:37:46.452291+0000","last_peered":"2024-09-14T11:37:46.452291+0000","last_clean":"2024-09-14T11:37:46.452291+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:37:46.452291+0000","last_undegraded":"2024-09-14T11:37:46.452291+0000","last_fullsized":"2024-09-14T11:37:46.452291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:04.389759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:04.872459+0000","last_change":"2024-09-14T11:11:57.355524+0000","last_active":"2024-09-14T11:36:04.872459+0000","last_peered":"2024-09-14T11:36:04.872459+0000","last_clean":"2024-09-14T11:36:04.872459+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:36:04.872459+0000","last_undegraded":"2024-09-14T11:36:04.872459+0000","last_fullsized":"2024-09-14T11:36:04.872459+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:57.603602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5122,"num_write":13,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763690+0000","last_change":"2024-09-14T11:10:13.508809+0000","last_active":"2024-09-14T11:35:13.763690+0000","last_peered":"2024-09-14T11:35:13.763690+0000","last_clean":"2024-09-14T11:35:13.763690+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:35:13.763690+0000","last_undegraded":"2024-09-14T11:35:13.763690+0000","last_fullsized":"2024-09-14T11:35:13.763690+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:45.025002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605928+0000","last_change":"2024-09-14T11:22:38.561594+0000","last_active":"2024-09-14T11:34:45.605928+0000","last_peered":"2024-09-14T11:34:45.605928+0000","last_clean":"2024-09-14T11:34:45.605928+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:34:45.605928+0000","last_undegraded":"2024-09-14T11:34:45.605928+0000","last_fullsized":"2024-09-14T11:34:45.605928+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.203331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:05.616361+0000","last_change":"2024-09-14T11:12:00.696088+0000","last_active":"2024-09-14T11:36:05.616361+0000","last_peered":"2024-09-14T11:36:05.616361+0000","last_clean":"2024-09-14T11:36:05.616361+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:36:05.616361+0000","last_undegraded":"2024-09-14T11:36:05.616361+0000","last_fullsized":"2024-09-14T11:36:05.616361+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:51:28.207806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912700+0000","last_change":"2024-09-14T11:11:57.350368+0000","last_active":"2024-09-14T11:36:59.912700+0000","last_peered":"2024-09-14T11:36:59.912700+0000","last_clean":"2024-09-14T11:36:59.912700+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:36:59.912700+0000","last_undegraded":"2024-09-14T11:36:59.912700+0000","last_fullsized":"2024-09-14T11:36:59.912700+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:04.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609835+0000","last_change":"2024-09-14T11:10:13.511471+0000","last_active":"2024-09-14T11:35:15.609835+0000","last_peered":"2024-09-14T11:35:15.609835+0000","last_clean":"2024-09-14T11:35:15.609835+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:35:15.609835+0000","last_undegraded":"2024-09-14T11:35:15.609835+0000","last_fullsized":"2024-09-14T11:35:15.609835+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:33.776917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:40.605265+0000","last_change":"2024-09-14T11:22:38.562233+0000","last_active":"2024-09-14T11:34:40.605265+0000","last_peered":"2024-09-14T11:34:40.605265+0000","last_clean":"2024-09-14T11:34:40.605265+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:34:40.605265+0000","last_undegraded":"2024-09-14T11:34:40.605265+0000","last_fullsized":"2024-09-14T11:34:40.605265+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:59.647783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868050+0000","last_change":"2024-09-14T11:12:00.373042+0000","last_active":"2024-09-14T11:33:47.868050+0000","last_peered":"2024-09-14T11:33:47.868050+0000","last_clean":"2024-09-14T11:33:47.868050+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:33:47.868050+0000","last_undegraded":"2024-09-14T11:33:47.868050+0000","last_fullsized":"2024-09-14T11:33:47.868050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:42.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751536+0000","last_change":"2024-09-14T11:11:57.347912+0000","last_active":"2024-09-14T11:33:43.751536+0000","last_peered":"2024-09-14T11:33:43.751536+0000","last_clean":"2024-09-14T11:33:43.751536+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:33:43.751536+0000","last_undegraded":"2024-09-14T11:33:43.751536+0000","last_fullsized":"2024-09-14T11:33:43.751536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:27.723340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609807+0000","last_change":"2024-09-14T11:10:13.510098+0000","last_active":"2024-09-14T11:35:15.609807+0000","last_peered":"2024-09-14T11:35:15.609807+0000","last_clean":"2024-09-14T11:35:15.609807+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:35:15.609807+0000","last_undegraded":"2024-09-14T11:35:15.609807+0000","last_fullsized":"2024-09-14T11:35:15.609807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:46.783877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763109+0000","last_change":"2024-09-14T11:22:38.558736+0000","last_active":"2024-09-14T11:35:08.763109+0000","last_peered":"2024-09-14T11:35:08.763109+0000","last_clean":"2024-09-14T11:35:08.763109+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:35:08.763109+0000","last_undegraded":"2024-09-14T11:35:08.763109+0000","last_fullsized":"2024-09-14T11:35:08.763109+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:58.587973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885772+0000","last_change":"2024-09-14T11:12:00.372932+0000","last_active":"2024-09-14T11:33:44.885772+0000","last_peered":"2024-09-14T11:33:44.885772+0000","last_clean":"2024-09-14T11:33:44.885772+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:33:44.885772+0000","last_undegraded":"2024-09-14T11:33:44.885772+0000","last_fullsized":"2024-09-14T11:33:44.885772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:01.464328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885933+0000","last_change":"2024-09-14T11:11:57.351572+0000","last_active":"2024-09-14T11:33:44.885933+0000","last_peered":"2024-09-14T11:33:44.885933+0000","last_clean":"2024-09-14T11:33:44.885933+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:33:44.885933+0000","last_undegraded":"2024-09-14T11:33:44.885933+0000","last_fullsized":"2024-09-14T11:33:44.885933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:43.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897732+0000","last_change":"2024-09-14T11:10:13.507035+0000","last_active":"2024-09-14T11:35:14.897732+0000","last_peered":"2024-09-14T11:35:14.897732+0000","last_clean":"2024-09-14T11:35:14.897732+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:35:14.897732+0000","last_undegraded":"2024-09-14T11:35:14.897732+0000","last_fullsized":"2024-09-14T11:35:14.897732+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.962765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897474+0000","last_change":"2024-09-14T11:22:38.558217+0000","last_active":"2024-09-14T11:35:09.897474+0000","last_peered":"2024-09-14T11:35:09.897474+0000","last_clean":"2024-09-14T11:35:09.897474+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:35:09.897474+0000","last_undegraded":"2024-09-14T11:35:09.897474+0000","last_fullsized":"2024-09-14T11:35:09.897474+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:16.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891260+0000","last_change":"2024-09-14T11:12:00.366839+0000","last_active":"2024-09-14T11:34:29.891260+0000","last_peered":"2024-09-14T11:34:29.891260+0000","last_clean":"2024-09-14T11:34:29.891260+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:34:29.891260+0000","last_undegraded":"2024-09-14T11:34:29.891260+0000","last_fullsized":"2024-09-14T11:34:29.891260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:28.093713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891654+0000","last_change":"2024-09-14T11:11:57.355185+0000","last_active":"2024-09-14T11:34:29.891654+0000","last_peered":"2024-09-14T11:34:29.891654+0000","last_clean":"2024-09-14T11:34:29.891654+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:34:29.891654+0000","last_undegraded":"2024-09-14T11:34:29.891654+0000","last_fullsized":"2024-09-14T11:34:29.891654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.881561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758163+0000","last_change":"2024-09-14T11:10:13.507975+0000","last_active":"2024-09-14T11:34:33.758163+0000","last_peered":"2024-09-14T11:34:33.758163+0000","last_clean":"2024-09-14T11:34:33.758163+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:34:33.758163+0000","last_undegraded":"2024-09-14T11:34:33.758163+0000","last_fullsized":"2024-09-14T11:34:33.758163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:21.041245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897517+0000","last_change":"2024-09-14T11:22:38.561164+0000","last_active":"2024-09-14T11:35:09.897517+0000","last_peered":"2024-09-14T11:35:09.897517+0000","last_clean":"2024-09-14T11:35:09.897517+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:35:09.897517+0000","last_undegraded":"2024-09-14T11:35:09.897517+0000","last_fullsized":"2024-09-14T11:35:09.897517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:43.901705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880477+0000","last_change":"2024-09-14T11:12:43.314131+0000","last_active":"2024-09-14T11:35:12.880477+0000","last_peered":"2024-09-14T11:35:12.880477+0000","last_clean":"2024-09-14T11:35:12.880477+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:35:12.880477+0000","last_undegraded":"2024-09-14T11:35:12.880477+0000","last_fullsized":"2024-09-14T11:35:12.880477+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:03.892987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.339573+0000","last_change":"2024-09-14T11:11:57.358103+0000","last_active":"2024-09-14T11:37:46.339573+0000","last_peered":"2024-09-14T11:37:46.339573+0000","last_clean":"2024-09-14T11:37:46.339573+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:37:46.339573+0000","last_undegraded":"2024-09-14T11:37:46.339573+0000","last_fullsized":"2024-09-14T11:37:46.339573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:14.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.757100+0000","last_change":"2024-09-14T11:10:13.501269+0000","last_active":"2024-09-14T11:34:23.757100+0000","last_peered":"2024-09-14T11:34:23.757100+0000","last_clean":"2024-09-14T11:34:23.757100+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:34:23.757100+0000","last_undegraded":"2024-09-14T11:34:23.757100+0000","last_fullsized":"2024-09-14T11:34:23.757100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:36.721868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:18.756557+0000","last_change":"2024-09-14T11:22:38.559223+0000","last_active":"2024-09-14T11:34:18.756557+0000","last_peered":"2024-09-14T11:34:18.756557+0000","last_clean":"2024-09-14T11:34:18.756557+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:34:18.756557+0000","last_undegraded":"2024-09-14T11:34:18.756557+0000","last_fullsized":"2024-09-14T11:34:18.756557+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:18.099181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:10.617001+0000","last_change":"2024-09-14T11:12:00.695830+0000","last_active":"2024-09-14T11:36:10.617001+0000","last_peered":"2024-09-14T11:36:10.617001+0000","last_clean":"2024-09-14T11:36:10.617001+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:36:10.617001+0000","last_undegraded":"2024-09-14T11:36:10.617001+0000","last_fullsized":"2024-09-14T11:36:10.617001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:08.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881154+0000","last_change":"2024-09-14T11:11:57.353227+0000","last_active":"2024-09-14T11:35:17.881154+0000","last_peered":"2024-09-14T11:35:17.881154+0000","last_clean":"2024-09-14T11:35:17.881154+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:35:17.881154+0000","last_undegraded":"2024-09-14T11:35:17.881154+0000","last_fullsized":"2024-09-14T11:35:17.881154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:08.822820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.845469+0000","last_change":"2024-09-14T11:10:13.507446+0000","last_active":"2024-09-14T11:34:59.845469+0000","last_peered":"2024-09-14T11:34:59.845469+0000","last_clean":"2024-09-14T11:34:59.845469+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:34:59.845469+0000","last_undegraded":"2024-09-14T11:34:59.845469+0000","last_fullsized":"2024-09-14T11:34:59.845469+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:37.515685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.859664+0000","last_change":"2024-09-14T11:22:38.547820+0000","last_active":"2024-09-14T11:34:19.859664+0000","last_peered":"2024-09-14T11:34:19.859664+0000","last_clean":"2024-09-14T11:34:19.859664+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:34:19.859664+0000","last_undegraded":"2024-09-14T11:34:19.859664+0000","last_fullsized":"2024-09-14T11:34:19.859664+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.390529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.629713+0000","last_change":"2024-09-14T11:12:00.697008+0000","last_active":"2024-09-14T11:37:45.629713+0000","last_peered":"2024-09-14T11:37:45.629713+0000","last_clean":"2024-09-14T11:37:45.629713+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:37:45.629713+0000","last_undegraded":"2024-09-14T11:37:45.629713+0000","last_fullsized":"2024-09-14T11:37:45.629713+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:03.052127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.337925+0000","last_change":"2024-09-14T11:11:57.349579+0000","last_active":"2024-09-14T11:37:46.337925+0000","last_peered":"2024-09-14T11:37:46.337925+0000","last_clean":"2024-09-14T11:37:46.337925+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:37:46.337925+0000","last_undegraded":"2024-09-14T11:37:46.337925+0000","last_fullsized":"2024-09-14T11:37:46.337925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:26.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:25.603094+0000","last_change":"2024-09-14T11:10:13.510036+0000","last_active":"2024-09-14T11:34:25.603094+0000","last_peered":"2024-09-14T11:34:25.603094+0000","last_clean":"2024-09-14T11:34:25.603094+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:34:25.603094+0000","last_undegraded":"2024-09-14T11:34:25.603094+0000","last_fullsized":"2024-09-14T11:34:25.603094+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:48.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.889866+0000","last_change":"2024-09-14T11:22:38.557418+0000","last_active":"2024-09-14T11:34:19.889866+0000","last_peered":"2024-09-14T11:34:19.889866+0000","last_clean":"2024-09-14T11:34:19.889866+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:34:19.889866+0000","last_undegraded":"2024-09-14T11:34:19.889866+0000","last_fullsized":"2024-09-14T11:34:19.889866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:24.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:10.617054+0000","last_change":"2024-09-14T11:12:00.697792+0000","last_active":"2024-09-14T11:36:10.617054+0000","last_peered":"2024-09-14T11:36:10.617054+0000","last_clean":"2024-09-14T11:36:10.617054+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:36:10.617054+0000","last_undegraded":"2024-09-14T11:36:10.617054+0000","last_fullsized":"2024-09-14T11:36:10.617054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:04.239911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.855371+0000","last_change":"2024-09-14T11:11:57.353323+0000","last_active":"2024-09-14T11:33:44.855371+0000","last_peered":"2024-09-14T11:33:44.855371+0000","last_clean":"2024-09-14T11:33:44.855371+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:33:44.855371+0000","last_undegraded":"2024-09-14T11:33:44.855371+0000","last_fullsized":"2024-09-14T11:33:44.855371+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:15.814681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.860387+0000","last_change":"2024-09-14T11:10:13.499745+0000","last_active":"2024-09-14T11:34:24.860387+0000","last_peered":"2024-09-14T11:34:24.860387+0000","last_clean":"2024-09-14T11:34:24.860387+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:34:24.860387+0000","last_undegraded":"2024-09-14T11:34:24.860387+0000","last_fullsized":"2024-09-14T11:34:24.860387+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:58.521220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:17.872355+0000","last_change":"2024-09-14T11:22:38.556244+0000","last_active":"2024-09-14T11:34:17.872355+0000","last_peered":"2024-09-14T11:34:17.872355+0000","last_clean":"2024-09-14T11:34:17.872355+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:34:17.872355+0000","last_undegraded":"2024-09-14T11:34:17.872355+0000","last_fullsized":"2024-09-14T11:34:17.872355+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:12.131431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:09.906261+0000","last_change":"2024-09-14T11:12:00.371092+0000","last_active":"2024-09-14T11:36:09.906261+0000","last_peered":"2024-09-14T11:36:09.906261+0000","last_clean":"2024-09-14T11:36:09.906261+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:36:09.906261+0000","last_undegraded":"2024-09-14T11:36:09.906261+0000","last_fullsized":"2024-09-14T11:36:09.906261+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:07.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751653+0000","last_change":"2024-09-14T11:11:57.355672+0000","last_active":"2024-09-14T11:33:43.751653+0000","last_peered":"2024-09-14T11:33:43.751653+0000","last_clean":"2024-09-14T11:33:43.751653+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:33:43.751653+0000","last_undegraded":"2024-09-14T11:33:43.751653+0000","last_fullsized":"2024-09-14T11:33:43.751653+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:54.970745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884593+0000","last_change":"2024-09-14T11:10:13.509666+0000","last_active":"2024-09-14T11:33:39.884593+0000","last_peered":"2024-09-14T11:33:39.884593+0000","last_clean":"2024-09-14T11:33:39.884593+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:33:39.884593+0000","last_undegraded":"2024-09-14T11:33:39.884593+0000","last_fullsized":"2024-09-14T11:33:39.884593+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.839337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.606019+0000","last_change":"2024-09-14T11:22:38.560634+0000","last_active":"2024-09-14T11:34:45.606019+0000","last_peered":"2024-09-14T11:34:45.606019+0000","last_clean":"2024-09-14T11:34:45.606019+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:34:45.606019+0000","last_undegraded":"2024-09-14T11:34:45.606019+0000","last_fullsized":"2024-09-14T11:34:45.606019+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:00.155051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765049+0000","last_change":"2024-09-14T11:12:00.370168+0000","last_active":"2024-09-14T11:35:23.765049+0000","last_peered":"2024-09-14T11:35:23.765049+0000","last_clean":"2024-09-14T11:35:23.765049+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:35:23.765049+0000","last_undegraded":"2024-09-14T11:35:23.765049+0000","last_fullsized":"2024-09-14T11:35:23.765049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:48.258006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898754+0000","last_change":"2024-09-14T11:11:57.349362+0000","last_active":"2024-09-14T11:35:19.898754+0000","last_peered":"2024-09-14T11:35:19.898754+0000","last_clean":"2024-09-14T11:35:19.898754+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:35:19.898754+0000","last_undegraded":"2024-09-14T11:35:19.898754+0000","last_fullsized":"2024-09-14T11:35:19.898754+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.873771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":88,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883866+0000","last_change":"2024-09-14T11:10:13.508867+0000","last_active":"2024-09-14T11:33:34.883866+0000","last_peered":"2024-09-14T11:33:34.883866+0000","last_clean":"2024-09-14T11:33:34.883866+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:33:34.883866+0000","last_undegraded":"2024-09-14T11:33:34.883866+0000","last_fullsized":"2024-09-14T11:33:34.883866+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:25.594692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759854+0000","last_change":"2024-09-14T11:22:38.562421+0000","last_active":"2024-09-14T11:34:43.759854+0000","last_peered":"2024-09-14T11:34:43.759854+0000","last_clean":"2024-09-14T11:34:43.759854+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:34:43.759854+0000","last_undegraded":"2024-09-14T11:34:43.759854+0000","last_fullsized":"2024-09-14T11:34:43.759854+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:19.932638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765008+0000","last_change":"2024-09-14T11:12:00.366781+0000","last_active":"2024-09-14T11:35:23.765008+0000","last_peered":"2024-09-14T11:35:23.765008+0000","last_clean":"2024-09-14T11:35:23.765008+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:35:23.765008+0000","last_undegraded":"2024-09-14T11:35:23.765008+0000","last_fullsized":"2024-09-14T11:35:23.765008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.257185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610401+0000","last_change":"2024-09-14T11:11:57.355400+0000","last_active":"2024-09-14T11:35:20.610401+0000","last_peered":"2024-09-14T11:35:20.610401+0000","last_clean":"2024-09-14T11:35:20.610401+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:35:20.610401+0000","last_undegraded":"2024-09-14T11:35:20.610401+0000","last_fullsized":"2024-09-14T11:35:20.610401+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:52.064528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":129,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:21.171911+0000","last_change":"2024-09-14T11:10:13.508002+0000","last_active":"2024-09-14T11:34:21.171911+0000","last_peered":"2024-09-14T11:34:21.171911+0000","last_clean":"2024-09-14T11:34:21.171911+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:34:21.171911+0000","last_undegraded":"2024-09-14T11:34:21.171911+0000","last_fullsized":"2024-09-14T11:34:21.171911+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:32.599364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756775+0000","last_change":"2024-09-14T11:22:38.560824+0000","last_active":"2024-09-14T11:34:23.756775+0000","last_peered":"2024-09-14T11:34:23.756775+0000","last_clean":"2024-09-14T11:34:23.756775+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:34:23.756775+0000","last_undegraded":"2024-09-14T11:34:23.756775+0000","last_fullsized":"2024-09-14T11:34:23.756775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.610355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610448+0000","last_change":"2024-09-14T11:12:00.371863+0000","last_active":"2024-09-14T11:35:20.610448+0000","last_peered":"2024-09-14T11:35:20.610448+0000","last_clean":"2024-09-14T11:35:20.610448+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:35:20.610448+0000","last_undegraded":"2024-09-14T11:35:20.610448+0000","last_fullsized":"2024-09-14T11:35:20.610448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.086012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898372+0000","last_change":"2024-09-14T11:11:57.355053+0000","last_active":"2024-09-14T11:35:19.898372+0000","last_peered":"2024-09-14T11:35:19.898372+0000","last_clean":"2024-09-14T11:35:19.898372+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:35:19.898372+0000","last_undegraded":"2024-09-14T11:35:19.898372+0000","last_fullsized":"2024-09-14T11:35:19.898372+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.975373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":103,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884391+0000","last_change":"2024-09-14T11:10:13.509195+0000","last_active":"2024-09-14T11:33:34.884391+0000","last_peered":"2024-09-14T11:33:34.884391+0000","last_clean":"2024-09-14T11:33:34.884391+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:33:34.884391+0000","last_undegraded":"2024-09-14T11:33:34.884391+0000","last_fullsized":"2024-09-14T11:33:34.884391+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:27.434209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605996+0000","last_change":"2024-09-14T11:22:38.549656+0000","last_active":"2024-09-14T11:34:45.605996+0000","last_peered":"2024-09-14T11:34:45.605996+0000","last_clean":"2024-09-14T11:34:45.605996+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:34:45.605996+0000","last_undegraded":"2024-09-14T11:34:45.605996+0000","last_fullsized":"2024-09-14T11:34:45.605996+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.182205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:39.917769+0000","last_change":"2024-09-14T11:12:00.368721+0000","last_active":"2024-09-14T11:37:39.917769+0000","last_peered":"2024-09-14T11:37:39.917769+0000","last_clean":"2024-09-14T11:37:39.917769+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:37:39.917769+0000","last_undegraded":"2024-09-14T11:37:39.917769+0000","last_fullsized":"2024-09-14T11:37:39.917769+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:12.328655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:37.901303+0000","last_change":"2024-09-14T11:11:57.355041+0000","last_active":"2024-09-14T11:37:37.901303+0000","last_peered":"2024-09-14T11:37:37.901303+0000","last_clean":"2024-09-14T11:37:37.901303+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:37:37.901303+0000","last_undegraded":"2024-09-14T11:37:37.901303+0000","last_fullsized":"2024-09-14T11:37:37.901303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:42.390324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596445+0000","last_change":"2024-09-14T11:10:13.507056+0000","last_active":"2024-09-14T11:33:35.596445+0000","last_peered":"2024-09-14T11:33:35.596445+0000","last_clean":"2024-09-14T11:33:35.596445+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:33:35.596445+0000","last_undegraded":"2024-09-14T11:33:35.596445+0000","last_fullsized":"2024-09-14T11:33:35.596445+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:39:01.368348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.854245+0000","last_change":"2024-09-14T11:22:38.547683+0000","last_active":"2024-09-14T11:33:34.854245+0000","last_peered":"2024-09-14T11:33:34.854245+0000","last_clean":"2024-09-14T11:33:34.854245+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:33:34.854245+0000","last_undegraded":"2024-09-14T11:33:34.854245+0000","last_fullsized":"2024-09-14T11:33:34.854245+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:20:09.212310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603840+0000","last_change":"2024-09-14T11:12:00.369322+0000","last_active":"2024-09-14T11:34:30.603840+0000","last_peered":"2024-09-14T11:34:30.603840+0000","last_clean":"2024-09-14T11:34:30.603840+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:34:30.603840+0000","last_undegraded":"2024-09-14T11:34:30.603840+0000","last_fullsized":"2024-09-14T11:34:30.603840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:38.196351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891188+0000","last_change":"2024-09-14T11:11:57.357216+0000","last_active":"2024-09-14T11:34:29.891188+0000","last_peered":"2024-09-14T11:34:29.891188+0000","last_clean":"2024-09-14T11:34:29.891188+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:34:29.891188+0000","last_undegraded":"2024-09-14T11:34:29.891188+0000","last_fullsized":"2024-09-14T11:34:29.891188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:05.608393+0000","last_change":"2024-09-14T11:10:13.512001+0000","last_active":"2024-09-14T11:35:05.608393+0000","last_peered":"2024-09-14T11:35:05.608393+0000","last_clean":"2024-09-14T11:35:05.608393+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:35:05.608393+0000","last_undegraded":"2024-09-14T11:35:05.608393+0000","last_fullsized":"2024-09-14T11:35:05.608393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:22.364398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886662+0000","last_change":"2024-09-14T11:22:38.560005+0000","last_active":"2024-09-14T11:33:54.886662+0000","last_peered":"2024-09-14T11:33:54.886662+0000","last_clean":"2024-09-14T11:33:54.886662+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:33:54.886662+0000","last_undegraded":"2024-09-14T11:33:54.886662+0000","last_fullsized":"2024-09-14T11:33:54.886662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:06.734073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603797+0000","last_change":"2024-09-14T11:12:00.370638+0000","last_active":"2024-09-14T11:34:30.603797+0000","last_peered":"2024-09-14T11:34:30.603797+0000","last_clean":"2024-09-14T11:34:30.603797+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:34:30.603797+0000","last_undegraded":"2024-09-14T11:34:30.603797+0000","last_fullsized":"2024-09-14T11:34:30.603797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:40.237389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:44.877001+0000","last_change":"2024-09-14T11:11:57.358150+0000","last_active":"2024-09-14T11:36:44.877001+0000","last_peered":"2024-09-14T11:36:44.877001+0000","last_clean":"2024-09-14T11:36:44.877001+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:36:44.877001+0000","last_undegraded":"2024-09-14T11:36:44.877001+0000","last_fullsized":"2024-09-14T11:36:44.877001+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:33.857222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":432,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.878115+0000","last_change":"2024-09-14T11:10:13.508473+0000","last_active":"2024-09-14T11:34:57.878115+0000","last_peered":"2024-09-14T11:34:57.878115+0000","last_clean":"2024-09-14T11:34:57.878115+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:34:57.878115+0000","last_undegraded":"2024-09-14T11:34:57.878115+0000","last_fullsized":"2024-09-14T11:34:57.878115+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:51.939853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901306+0000","last_change":"2024-09-14T11:22:38.555264+0000","last_active":"2024-09-14T11:35:39.901306+0000","last_peered":"2024-09-14T11:35:39.901306+0000","last_clean":"2024-09-14T11:35:39.901306+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:35:39.901306+0000","last_undegraded":"2024-09-14T11:35:39.901306+0000","last_fullsized":"2024-09-14T11:35:39.901306+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:10.041270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:53.776370+0000","last_change":"2024-09-14T11:12:00.696985+0000","last_active":"2024-09-14T11:36:53.776370+0000","last_peered":"2024-09-14T11:36:53.776370+0000","last_clean":"2024-09-14T11:36:53.776370+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:36:53.776370+0000","last_undegraded":"2024-09-14T11:36:53.776370+0000","last_fullsized":"2024-09-14T11:36:53.776370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:16.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757502+0000","last_change":"2024-09-14T11:11:57.350049+0000","last_active":"2024-09-14T11:34:28.757502+0000","last_peered":"2024-09-14T11:34:28.757502+0000","last_clean":"2024-09-14T11:34:28.757502+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:34:28.757502+0000","last_undegraded":"2024-09-14T11:34:28.757502+0000","last_fullsized":"2024-09-14T11:34:28.757502+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:36.573356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895573+0000","last_change":"2024-09-14T11:10:13.511805+0000","last_active":"2024-09-14T11:34:59.895573+0000","last_peered":"2024-09-14T11:34:59.895573+0000","last_clean":"2024-09-14T11:34:59.895573+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:34:59.895573+0000","last_undegraded":"2024-09-14T11:34:59.895573+0000","last_fullsized":"2024-09-14T11:34:59.895573+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:47.389561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901829+0000","last_change":"2024-09-14T11:22:38.552793+0000","last_active":"2024-09-14T11:35:39.901829+0000","last_peered":"2024-09-14T11:35:39.901829+0000","last_clean":"2024-09-14T11:35:39.901829+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:35:39.901829+0000","last_undegraded":"2024-09-14T11:35:39.901829+0000","last_fullsized":"2024-09-14T11:35:39.901829+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:40.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:45.621178+0000","last_change":"2024-09-14T11:12:00.371999+0000","last_active":"2024-09-14T11:36:45.621178+0000","last_peered":"2024-09-14T11:36:45.621178+0000","last_clean":"2024-09-14T11:36:45.621178+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:36:45.621178+0000","last_undegraded":"2024-09-14T11:36:45.621178+0000","last_fullsized":"2024-09-14T11:36:45.621178+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:57.798523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.615620+0000","last_change":"2024-09-14T11:11:57.351527+0000","last_active":"2024-09-14T11:37:46.615620+0000","last_peered":"2024-09-14T11:37:46.615620+0000","last_clean":"2024-09-14T11:37:46.615620+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:37:46.615620+0000","last_undegraded":"2024-09-14T11:37:46.615620+0000","last_fullsized":"2024-09-14T11:37:46.615620+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:16.871687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5818,"num_write":12,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.864945+0000","last_change":"2024-09-14T11:10:13.506926+0000","last_active":"2024-09-14T11:34:59.864945+0000","last_peered":"2024-09-14T11:34:59.864945+0000","last_clean":"2024-09-14T11:34:59.864945+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:34:59.864945+0000","last_undegraded":"2024-09-14T11:34:59.864945+0000","last_fullsized":"2024-09-14T11:34:59.864945+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:19.274286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:55.599222+0000","last_change":"2024-09-14T11:22:38.560343+0000","last_active":"2024-09-14T11:33:55.599222+0000","last_peered":"2024-09-14T11:33:55.599222+0000","last_clean":"2024-09-14T11:33:55.599222+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:33:55.599222+0000","last_undegraded":"2024-09-14T11:33:55.599222+0000","last_fullsized":"2024-09-14T11:33:55.599222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:29.881634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'6","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.943639+0000","last_change":"2024-09-14T11:12:00.369339+0000","last_active":"2024-09-14T11:37:45.943639+0000","last_peered":"2024-09-14T11:37:45.943639+0000","last_clean":"2024-09-14T11:37:45.943639+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:37:45.943639+0000","last_undegraded":"2024-09-14T11:37:45.943639+0000","last_fullsized":"2024-09-14T11:37:45.943639+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:17:39.447487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750762+0000","last_change":"2024-09-14T11:11:57.357619+0000","last_active":"2024-09-14T11:33:38.750762+0000","last_peered":"2024-09-14T11:33:38.750762+0000","last_clean":"2024-09-14T11:33:38.750762+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:33:38.750762+0000","last_undegraded":"2024-09-14T11:33:38.750762+0000","last_fullsized":"2024-09-14T11:33:38.750762+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:38.476508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761794+0000","last_change":"2024-09-14T11:10:13.505959+0000","last_active":"2024-09-14T11:34:58.761794+0000","last_peered":"2024-09-14T11:34:58.761794+0000","last_clean":"2024-09-14T11:34:58.761794+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:34:58.761794+0000","last_undegraded":"2024-09-14T11:34:58.761794+0000","last_fullsized":"2024-09-14T11:34:58.761794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:13.476423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886743+0000","last_change":"2024-09-14T11:22:38.558664+0000","last_active":"2024-09-14T11:33:54.886743+0000","last_peered":"2024-09-14T11:33:54.886743+0000","last_clean":"2024-09-14T11:33:54.886743+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:33:54.886743+0000","last_undegraded":"2024-09-14T11:33:54.886743+0000","last_fullsized":"2024-09-14T11:33:54.886743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:30.238036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903203+0000","last_change":"2024-09-14T11:12:00.694483+0000","last_active":"2024-09-14T11:35:49.903203+0000","last_peered":"2024-09-14T11:35:49.903203+0000","last_clean":"2024-09-14T11:35:49.903203+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:35:49.903203+0000","last_undegraded":"2024-09-14T11:35:49.903203+0000","last_fullsized":"2024-09-14T11:35:49.903203+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:43:06.644097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.863718+0000","last_change":"2024-09-14T11:11:57.352310+0000","last_active":"2024-09-14T11:33:38.863718+0000","last_peered":"2024-09-14T11:33:38.863718+0000","last_clean":"2024-09-14T11:33:38.863718+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:33:38.863718+0000","last_undegraded":"2024-09-14T11:33:38.863718+0000","last_fullsized":"2024-09-14T11:33:38.863718+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:08.817373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:09.888479+0000","last_change":"2024-09-14T11:10:13.511603+0000","last_active":"2024-09-14T11:34:09.888479+0000","last_peered":"2024-09-14T11:34:09.888479+0000","last_clean":"2024-09-14T11:34:09.888479+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:34:09.888479+0000","last_undegraded":"2024-09-14T11:34:09.888479+0000","last_fullsized":"2024-09-14T11:34:09.888479+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.593455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886685+0000","last_change":"2024-09-14T11:22:38.557834+0000","last_active":"2024-09-14T11:33:54.886685+0000","last_peered":"2024-09-14T11:33:54.886685+0000","last_clean":"2024-09-14T11:33:54.886685+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:33:54.886685+0000","last_undegraded":"2024-09-14T11:33:54.886685+0000","last_fullsized":"2024-09-14T11:33:54.886685+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:44.232152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758487+0000","last_change":"2024-09-14T11:12:00.368877+0000","last_active":"2024-09-14T11:34:33.758487+0000","last_peered":"2024-09-14T11:34:33.758487+0000","last_clean":"2024-09-14T11:34:33.758487+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:34:33.758487+0000","last_undegraded":"2024-09-14T11:34:33.758487+0000","last_fullsized":"2024-09-14T11:34:33.758487+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:04.138036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751573+0000","last_change":"2024-09-14T11:11:57.350615+0000","last_active":"2024-09-14T11:33:43.751573+0000","last_peered":"2024-09-14T11:33:43.751573+0000","last_clean":"2024-09-14T11:33:43.751573+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:33:43.751573+0000","last_undegraded":"2024-09-14T11:33:43.751573+0000","last_fullsized":"2024-09-14T11:33:43.751573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:57.116215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600496+0000","last_change":"2024-09-14T11:10:13.505366+0000","last_active":"2024-09-14T11:34:05.600496+0000","last_peered":"2024-09-14T11:34:05.600496+0000","last_clean":"2024-09-14T11:34:05.600496+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:34:05.600496+0000","last_undegraded":"2024-09-14T11:34:05.600496+0000","last_fullsized":"2024-09-14T11:34:05.600496+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:26.758270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752949+0000","last_change":"2024-09-14T11:22:38.560810+0000","last_active":"2024-09-14T11:33:53.752949+0000","last_peered":"2024-09-14T11:33:53.752949+0000","last_clean":"2024-09-14T11:33:53.752949+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:33:53.752949+0000","last_undegraded":"2024-09-14T11:33:53.752949+0000","last_fullsized":"2024-09-14T11:33:53.752949+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:04.353747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'8","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903276+0000","last_change":"2024-09-14T11:12:00.372935+0000","last_active":"2024-09-14T11:35:49.903276+0000","last_peered":"2024-09-14T11:35:49.903276+0000","last_clean":"2024-09-14T11:35:49.903276+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:35:49.903276+0000","last_undegraded":"2024-09-14T11:35:49.903276+0000","last_fullsized":"2024-09-14T11:35:49.903276+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:40:15.968213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891684+0000","last_change":"2024-09-14T11:11:57.352921+0000","last_active":"2024-09-14T11:34:29.891684+0000","last_peered":"2024-09-14T11:34:29.891684+0000","last_clean":"2024-09-14T11:34:29.891684+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:34:29.891684+0000","last_undegraded":"2024-09-14T11:34:29.891684+0000","last_fullsized":"2024-09-14T11:34:29.891684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:52.542794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888212+0000","last_change":"2024-09-14T11:10:13.506698+0000","last_active":"2024-09-14T11:34:04.888212+0000","last_peered":"2024-09-14T11:34:04.888212+0000","last_clean":"2024-09-14T11:34:04.888212+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:34:04.888212+0000","last_undegraded":"2024-09-14T11:34:04.888212+0000","last_fullsized":"2024-09-14T11:34:04.888212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:50.197138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897410+0000","last_change":"2024-09-14T11:22:38.557689+0000","last_active":"2024-09-14T11:35:09.897410+0000","last_peered":"2024-09-14T11:35:09.897410+0000","last_clean":"2024-09-14T11:35:09.897410+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:35:09.897410+0000","last_undegraded":"2024-09-14T11:35:09.897410+0000","last_fullsized":"2024-09-14T11:35:09.897410+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:32.821928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762555+0000","last_change":"2024-09-14T11:12:00.367857+0000","last_active":"2024-09-14T11:35:03.762555+0000","last_peered":"2024-09-14T11:35:03.762555+0000","last_clean":"2024-09-14T11:35:03.762555+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:35:03.762555+0000","last_undegraded":"2024-09-14T11:35:03.762555+0000","last_fullsized":"2024-09-14T11:35:03.762555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:30.330125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895154+0000","last_change":"2024-09-14T11:11:57.350701+0000","last_active":"2024-09-14T11:34:54.895154+0000","last_peered":"2024-09-14T11:34:54.895154+0000","last_clean":"2024-09-14T11:34:54.895154+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:34:54.895154+0000","last_undegraded":"2024-09-14T11:34:54.895154+0000","last_fullsized":"2024-09-14T11:34:54.895154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:03.947483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:03.754212+0000","last_change":"2024-09-14T11:10:13.507832+0000","last_active":"2024-09-14T11:34:03.754212+0000","last_peered":"2024-09-14T11:34:03.754212+0000","last_clean":"2024-09-14T11:34:03.754212+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:34:03.754212+0000","last_undegraded":"2024-09-14T11:34:03.754212+0000","last_fullsized":"2024-09-14T11:34:03.754212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.145883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879667+0000","last_change":"2024-09-14T11:22:38.559774+0000","last_active":"2024-09-14T11:35:07.879667+0000","last_peered":"2024-09-14T11:35:07.879667+0000","last_clean":"2024-09-14T11:35:07.879667+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:35:07.879667+0000","last_undegraded":"2024-09-14T11:35:07.879667+0000","last_fullsized":"2024-09-14T11:35:07.879667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:14.753350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761826+0000","last_change":"2024-09-14T11:12:00.695654+0000","last_active":"2024-09-14T11:34:58.761826+0000","last_peered":"2024-09-14T11:34:58.761826+0000","last_clean":"2024-09-14T11:34:58.761826+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:34:58.761826+0000","last_undegraded":"2024-09-14T11:34:58.761826+0000","last_fullsized":"2024-09-14T11:34:58.761826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:44.109481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:04.879303+0000","last_change":"2024-09-14T11:11:57.357243+0000","last_active":"2024-09-14T11:37:04.879303+0000","last_peered":"2024-09-14T11:37:04.879303+0000","last_clean":"2024-09-14T11:37:04.879303+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:37:04.879303+0000","last_undegraded":"2024-09-14T11:37:04.879303+0000","last_fullsized":"2024-09-14T11:37:04.879303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:58.472930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888302+0000","last_change":"2024-09-14T11:10:13.507529+0000","last_active":"2024-09-14T11:34:04.888302+0000","last_peered":"2024-09-14T11:34:04.888302+0000","last_clean":"2024-09-14T11:34:04.888302+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:34:04.888302+0000","last_undegraded":"2024-09-14T11:34:04.888302+0000","last_fullsized":"2024-09-14T11:34:04.888302+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:46.910286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T11:22:38.559360+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:07.017001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903386+0000","last_change":"2024-09-14T11:12:00.697739+0000","last_active":"2024-09-14T11:35:49.903386+0000","last_peered":"2024-09-14T11:35:49.903386+0000","last_clean":"2024-09-14T11:35:49.903386+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:35:49.903386+0000","last_undegraded":"2024-09-14T11:35:49.903386+0000","last_fullsized":"2024-09-14T11:35:49.903386+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:56.512716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:47.885301+0000","last_change":"2024-09-14T11:11:57.356515+0000","last_active":"2024-09-14T11:35:47.885301+0000","last_peered":"2024-09-14T11:35:47.885301+0000","last_clean":"2024-09-14T11:35:47.885301+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:35:47.885301+0000","last_undegraded":"2024-09-14T11:35:47.885301+0000","last_fullsized":"2024-09-14T11:35:47.885301+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:52.310464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898940+0000","last_change":"2024-09-14T11:10:13.510430+0000","last_active":"2024-09-14T11:35:19.898940+0000","last_peered":"2024-09-14T11:35:19.898940+0000","last_clean":"2024-09-14T11:35:19.898940+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:35:19.898940+0000","last_undegraded":"2024-09-14T11:35:19.898940+0000","last_fullsized":"2024-09-14T11:35:19.898940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:05.548094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897368+0000","last_change":"2024-09-14T11:22:38.560831+0000","last_active":"2024-09-14T11:35:09.897368+0000","last_peered":"2024-09-14T11:35:09.897368+0000","last_clean":"2024-09-14T11:35:09.897368+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:35:09.897368+0000","last_undegraded":"2024-09-14T11:35:09.897368+0000","last_fullsized":"2024-09-14T11:35:09.897368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:48.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.885392+0000","last_change":"2024-09-14T11:12:00.368324+0000","last_active":"2024-09-14T11:33:39.885392+0000","last_peered":"2024-09-14T11:33:39.885392+0000","last_clean":"2024-09-14T11:33:39.885392+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:33:39.885392+0000","last_undegraded":"2024-09-14T11:33:39.885392+0000","last_fullsized":"2024-09-14T11:33:39.885392+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:00:52.228855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903397+0000","last_change":"2024-09-14T11:11:57.353076+0000","last_active":"2024-09-14T11:35:49.903397+0000","last_peered":"2024-09-14T11:35:49.903397+0000","last_clean":"2024-09-14T11:35:49.903397+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:35:49.903397+0000","last_undegraded":"2024-09-14T11:35:49.903397+0000","last_fullsized":"2024-09-14T11:35:49.903397+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:23.953839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763621+0000","last_change":"2024-09-14T11:10:13.503079+0000","last_active":"2024-09-14T11:35:13.763621+0000","last_peered":"2024-09-14T11:35:13.763621+0000","last_clean":"2024-09-14T11:35:13.763621+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:35:13.763621+0000","last_undegraded":"2024-09-14T11:35:13.763621+0000","last_fullsized":"2024-09-14T11:35:13.763621+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.214686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.869257+0000","last_change":"2024-09-14T11:22:38.555155+0000","last_active":"2024-09-14T11:35:39.869257+0000","last_peered":"2024-09-14T11:35:39.869257+0000","last_clean":"2024-09-14T11:35:39.869257+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:35:39.869257+0000","last_undegraded":"2024-09-14T11:35:39.869257+0000","last_fullsized":"2024-09-14T11:35:39.869257+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:42.625623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:03.777421+0000","last_change":"2024-09-14T11:12:00.367897+0000","last_active":"2024-09-14T11:37:03.777421+0000","last_peered":"2024-09-14T11:37:03.777421+0000","last_clean":"2024-09-14T11:37:03.777421+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:37:03.777421+0000","last_undegraded":"2024-09-14T11:37:03.777421+0000","last_fullsized":"2024-09-14T11:37:03.777421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:42.946120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15360,"num_write":13,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:59.887231+0000","last_change":"2024-09-14T11:11:57.345965+0000","last_active":"2024-09-14T11:33:59.887231+0000","last_peered":"2024-09-14T11:33:59.887231+0000","last_clean":"2024-09-14T11:33:59.887231+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:33:59.887231+0000","last_undegraded":"2024-09-14T11:33:59.887231+0000","last_fullsized":"2024-09-14T11:33:59.887231+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:15.657325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880495+0000","last_change":"2024-09-14T11:10:13.502736+0000","last_active":"2024-09-14T11:35:12.880495+0000","last_peered":"2024-09-14T11:35:12.880495+0000","last_clean":"2024-09-14T11:35:12.880495+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:35:12.880495+0000","last_undegraded":"2024-09-14T11:35:12.880495+0000","last_fullsized":"2024-09-14T11:35:12.880495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:59.444808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.766824+0000","last_change":"2024-09-14T11:22:38.559863+0000","last_active":"2024-09-14T11:35:38.766824+0000","last_peered":"2024-09-14T11:35:38.766824+0000","last_clean":"2024-09-14T11:35:38.766824+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:35:38.766824+0000","last_undegraded":"2024-09-14T11:35:38.766824+0000","last_fullsized":"2024-09-14T11:35:38.766824+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:50.541537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:02.870330+0000","last_change":"2024-09-14T11:12:00.369782+0000","last_active":"2024-09-14T11:34:02.870330+0000","last_peered":"2024-09-14T11:34:02.870330+0000","last_clean":"2024-09-14T11:34:02.870330+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:34:02.870330+0000","last_undegraded":"2024-09-14T11:34:02.870330+0000","last_fullsized":"2024-09-14T11:34:02.870330+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:24:02.629691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895078+0000","last_change":"2024-09-14T11:11:57.349673+0000","last_active":"2024-09-14T11:34:54.895078+0000","last_peered":"2024-09-14T11:34:54.895078+0000","last_clean":"2024-09-14T11:34:54.895078+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:34:54.895078+0000","last_undegraded":"2024-09-14T11:34:54.895078+0000","last_fullsized":"2024-09-14T11:34:54.895078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.667434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898118+0000","last_change":"2024-09-14T11:10:13.510473+0000","last_active":"2024-09-14T11:35:14.898118+0000","last_peered":"2024-09-14T11:35:14.898118+0000","last_clean":"2024-09-14T11:35:14.898118+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:35:14.898118+0000","last_undegraded":"2024-09-14T11:35:14.898118+0000","last_fullsized":"2024-09-14T11:35:14.898118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:52.505231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763071+0000","last_change":"2024-09-14T11:22:38.558952+0000","last_active":"2024-09-14T11:35:08.763071+0000","last_peered":"2024-09-14T11:35:08.763071+0000","last_clean":"2024-09-14T11:35:08.763071+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:35:08.763071+0000","last_undegraded":"2024-09-14T11:35:08.763071+0000","last_fullsized":"2024-09-14T11:35:08.763071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:33.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.010477+0000","last_change":"2024-09-14T11:12:00.373006+0000","last_active":"2024-09-14T11:37:46.010477+0000","last_peered":"2024-09-14T11:37:46.010477+0000","last_clean":"2024-09-14T11:37:46.010477+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:37:46.010477+0000","last_undegraded":"2024-09-14T11:37:46.010477+0000","last_fullsized":"2024-09-14T11:37:46.010477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:34.796891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:53.761123+0000","last_change":"2024-09-14T11:11:57.347916+0000","last_active":"2024-09-14T11:34:53.761123+0000","last_peered":"2024-09-14T11:34:53.761123+0000","last_clean":"2024-09-14T11:34:53.761123+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:34:53.761123+0000","last_undegraded":"2024-09-14T11:34:53.761123+0000","last_fullsized":"2024-09-14T11:34:53.761123+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:00.583601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897710+0000","last_change":"2024-09-14T11:10:13.512991+0000","last_active":"2024-09-14T11:35:14.897710+0000","last_peered":"2024-09-14T11:35:14.897710+0000","last_clean":"2024-09-14T11:35:14.897710+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:35:14.897710+0000","last_undegraded":"2024-09-14T11:35:14.897710+0000","last_fullsized":"2024-09-14T11:35:14.897710+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:49.534421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897492+0000","last_change":"2024-09-14T11:22:38.555840+0000","last_active":"2024-09-14T11:35:09.897492+0000","last_peered":"2024-09-14T11:35:09.897492+0000","last_clean":"2024-09-14T11:35:09.897492+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:35:09.897492+0000","last_undegraded":"2024-09-14T11:35:09.897492+0000","last_fullsized":"2024-09-14T11:35:09.897492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912600+0000","last_change":"2024-09-14T11:12:00.368478+0000","last_active":"2024-09-14T11:36:59.912600+0000","last_peered":"2024-09-14T11:36:59.912600+0000","last_clean":"2024-09-14T11:36:59.912600+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:36:59.912600+0000","last_undegraded":"2024-09-14T11:36:59.912600+0000","last_fullsized":"2024-09-14T11:36:59.912600+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:45.204253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912350+0000","last_change":"2024-09-14T11:11:57.351639+0000","last_active":"2024-09-14T11:36:59.912350+0000","last_peered":"2024-09-14T11:36:59.912350+0000","last_clean":"2024-09-14T11:36:59.912350+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:36:59.912350+0000","last_undegraded":"2024-09-14T11:36:59.912350+0000","last_fullsized":"2024-09-14T11:36:59.912350+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:06.738942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.851175+0000","last_change":"2024-09-14T11:10:13.508247+0000","last_active":"2024-09-14T11:34:59.851175+0000","last_peered":"2024-09-14T11:34:59.851175+0000","last_clean":"2024-09-14T11:34:59.851175+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:34:59.851175+0000","last_undegraded":"2024-09-14T11:34:59.851175+0000","last_fullsized":"2024-09-14T11:34:59.851175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:55.466796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'351","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990017+0000","last_change":"2024-09-14T10:56:06.840563+0000","last_active":"2024-09-14T11:37:46.990017+0000","last_peered":"2024-09-14T11:37:46.990017+0000","last_clean":"2024-09-14T11:37:46.990017+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:37:46.990017+0000","last_undegraded":"2024-09-14T11:37:46.990017+0000","last_fullsized":"2024-09-14T11:37:46.990017+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:31:36.737226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":710,"num_read_kb":163807,"num_write":1157,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.639109+0000","last_change":"2024-09-14T10:56:08.850638+0000","last_active":"2024-09-14T11:35:15.639109+0000","last_peered":"2024-09-14T11:35:15.639109+0000","last_clean":"2024-09-14T11:35:15.639109+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:35:15.639109+0000","last_undegraded":"2024-09-14T11:35:15.639109+0000","last_fullsized":"2024-09-14T11:35:15.639109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.142178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'343","reported_seq":977,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.992349+0000","last_change":"2024-09-14T10:56:06.829795+0000","last_active":"2024-09-14T11:37:46.992349+0000","last_peered":"2024-09-14T11:37:46.992349+0000","last_clean":"2024-09-14T11:37:46.992349+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:37:46.992349+0000","last_undegraded":"2024-09-14T11:37:46.992349+0000","last_fullsized":"2024-09-14T11:37:46.992349+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:37.943163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":38007,"num_write":1094,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":694,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.643553+0000","last_change":"2024-09-14T10:56:08.847147+0000","last_active":"2024-09-14T11:34:58.643553+0000","last_peered":"2024-09-14T11:34:58.643553+0000","last_clean":"2024-09-14T11:34:58.643553+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:34:58.643553+0000","last_undegraded":"2024-09-14T11:34:58.643553+0000","last_fullsized":"2024-09-14T11:34:58.643553+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:38:19.665261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'351","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990795+0000","last_change":"2024-09-14T10:56:06.827878+0000","last_active":"2024-09-14T11:37:46.990795+0000","last_peered":"2024-09-14T11:37:46.990795+0000","last_clean":"2024-09-14T11:37:46.990795+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:37:46.990795+0000","last_undegraded":"2024-09-14T11:37:46.990795+0000","last_fullsized":"2024-09-14T11:37:46.990795+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:48.452362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":108632,"num_write":1075,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1206,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.641306+0000","last_change":"2024-09-14T10:56:08.839781+0000","last_active":"2024-09-14T11:35:56.641306+0000","last_peered":"2024-09-14T11:35:56.641306+0000","last_clean":"2024-09-14T11:35:56.641306+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:35:56.641306+0000","last_undegraded":"2024-09-14T11:35:56.641306+0000","last_fullsized":"2024-09-14T11:35:56.641306+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:48.973644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'355","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.985242+0000","last_change":"2024-09-14T10:56:42.460337+0000","last_active":"2024-09-14T11:37:46.985242+0000","last_peered":"2024-09-14T11:37:46.985242+0000","last_clean":"2024-09-14T11:37:46.985242+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:37:46.985242+0000","last_undegraded":"2024-09-14T11:37:46.985242+0000","last_fullsized":"2024-09-14T11:37:46.985242+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:01:24.182625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":34002,"num_write":1219,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.932127+0000","last_change":"2024-09-14T10:56:08.834000+0000","last_active":"2024-09-14T11:35:27.932127+0000","last_peered":"2024-09-14T11:35:27.932127+0000","last_clean":"2024-09-14T11:35:27.932127+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:35:27.932127+0000","last_undegraded":"2024-09-14T11:35:27.932127+0000","last_fullsized":"2024-09-14T11:35:27.932127+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:57.023521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'370","reported_seq":997,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.950831+0000","last_change":"2024-09-14T10:56:06.830568+0000","last_active":"2024-09-14T11:37:46.950831+0000","last_peered":"2024-09-14T11:37:46.950831+0000","last_clean":"2024-09-14T11:37:46.950831+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:37:46.950831+0000","last_undegraded":"2024-09-14T11:37:46.950831+0000","last_fullsized":"2024-09-14T11:37:46.950831+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:40.397983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":613,"num_read_kb":21029,"num_write":1146,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":745,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.859777+0000","last_change":"2024-09-14T10:56:08.841284+0000","last_active":"2024-09-14T11:34:59.859777+0000","last_peered":"2024-09-14T11:34:59.859777+0000","last_clean":"2024-09-14T11:34:59.859777+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:34:59.859777+0000","last_undegraded":"2024-09-14T11:34:59.859777+0000","last_fullsized":"2024-09-14T11:34:59.859777+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:15:14.311075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'400","reported_seq":1028,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.958250+0000","last_change":"2024-09-14T10:56:06.834469+0000","last_active":"2024-09-14T11:37:46.958250+0000","last_peered":"2024-09-14T11:37:46.958250+0000","last_clean":"2024-09-14T11:37:46.958250+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:37:46.958250+0000","last_undegraded":"2024-09-14T11:37:46.958250+0000","last_fullsized":"2024-09-14T11:37:46.958250+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":300,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:37:32.517363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":29480,"num_write":1192,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4187","reported_seq":4820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:44.902723+0000","last_change":"2024-09-14T10:56:08.839199+0000","last_active":"2024-09-14T11:35:44.902723+0000","last_peered":"2024-09-14T11:35:44.902723+0000","last_clean":"2024-09-14T11:35:44.902723+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:35:44.902723+0000","last_undegraded":"2024-09-14T11:35:44.902723+0000","last_fullsized":"2024-09-14T11:35:44.902723+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":3000,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:42.778598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'341","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.967485+0000","last_change":"2024-09-14T10:56:06.833222+0000","last_active":"2024-09-14T11:37:46.967485+0000","last_peered":"2024-09-14T11:37:46.967485+0000","last_clean":"2024-09-14T11:37:46.967485+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:37:46.967485+0000","last_undegraded":"2024-09-14T11:37:46.967485+0000","last_fullsized":"2024-09-14T11:37:46.967485+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:04.180820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":8679,"num_write":1155,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:47.885313+0000","last_change":"2024-09-14T10:56:08.845788+0000","last_active":"2024-09-14T11:35:47.885313+0000","last_peered":"2024-09-14T11:35:47.885313+0000","last_clean":"2024-09-14T11:35:47.885313+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:35:47.885313+0000","last_undegraded":"2024-09-14T11:35:47.885313+0000","last_fullsized":"2024-09-14T11:35:47.885313+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:48.651913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'439","reported_seq":1170,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.866675+0000","last_change":"2024-09-14T10:56:06.823561+0000","last_active":"2024-09-14T11:37:46.866675+0000","last_peered":"2024-09-14T11:37:46.866675+0000","last_clean":"2024-09-14T11:37:46.866675+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:37:46.866675+0000","last_undegraded":"2024-09-14T11:37:46.866675+0000","last_fullsized":"2024-09-14T11:37:46.866675+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:14.493949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1027,"num_read_kb":48878,"num_write":1330,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":805,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:44.869774+0000","last_change":"2024-09-14T10:56:08.837515+0000","last_active":"2024-09-14T11:35:44.869774+0000","last_peered":"2024-09-14T11:35:44.869774+0000","last_clean":"2024-09-14T11:35:44.869774+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:35:44.869774+0000","last_undegraded":"2024-09-14T11:35:44.869774+0000","last_fullsized":"2024-09-14T11:35:44.869774+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:26:30.463671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:35.029523+0000","last_change":"2024-09-14T10:56:08.839183+0000","last_active":"2024-09-14T11:35:35.029523+0000","last_peered":"2024-09-14T11:35:35.029523+0000","last_clean":"2024-09-14T11:35:35.029523+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:35:35.029523+0000","last_undegraded":"2024-09-14T11:35:35.029523+0000","last_fullsized":"2024-09-14T11:35:35.029523+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:38.313196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'353","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.985496+0000","last_change":"2024-09-14T10:56:42.661135+0000","last_active":"2024-09-14T11:37:46.985496+0000","last_peered":"2024-09-14T11:37:46.985496+0000","last_clean":"2024-09-14T11:37:46.985496+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:37:46.985496+0000","last_undegraded":"2024-09-14T11:37:46.985496+0000","last_fullsized":"2024-09-14T11:37:46.985496+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":300,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:46.958500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":655,"num_read_kb":81454,"num_write":1158,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":817,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.663539+0000","last_change":"2024-09-14T10:56:08.846796+0000","last_active":"2024-09-14T11:35:32.663539+0000","last_peered":"2024-09-14T11:35:32.663539+0000","last_clean":"2024-09-14T11:35:32.663539+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:35:32.663539+0000","last_undegraded":"2024-09-14T11:35:32.663539+0000","last_fullsized":"2024-09-14T11:35:32.663539+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:56.632850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'367","reported_seq":1135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.987984+0000","last_change":"2024-09-14T10:56:06.835989+0000","last_active":"2024-09-14T11:37:46.987984+0000","last_peered":"2024-09-14T11:37:46.987984+0000","last_clean":"2024-09-14T11:37:46.987984+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:37:46.987984+0000","last_undegraded":"2024-09-14T11:37:46.987984+0000","last_fullsized":"2024-09-14T11:37:46.987984+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:13:41.887236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1102,"num_read_kb":13751,"num_write":1178,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":779,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.810993+0000","last_change":"2024-09-14T10:56:08.844107+0000","last_active":"2024-09-14T11:35:31.810993+0000","last_peered":"2024-09-14T11:35:31.810993+0000","last_clean":"2024-09-14T11:35:31.810993+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:35:31.810993+0000","last_undegraded":"2024-09-14T11:35:31.810993+0000","last_fullsized":"2024-09-14T11:35:31.810993+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:29:40.490617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'320","reported_seq":959,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.980039+0000","last_change":"2024-09-14T10:56:06.839571+0000","last_active":"2024-09-14T11:37:46.980039+0000","last_peered":"2024-09-14T11:37:46.980039+0000","last_clean":"2024-09-14T11:37:46.980039+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:37:46.980039+0000","last_undegraded":"2024-09-14T11:37:46.980039+0000","last_fullsized":"2024-09-14T11:37:46.980039+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:02:28.864250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":2147,"num_write":1090,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":873,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.465427+0000","last_change":"2024-09-14T10:56:08.834013+0000","last_active":"2024-09-14T11:35:33.465427+0000","last_peered":"2024-09-14T11:35:33.465427+0000","last_clean":"2024-09-14T11:35:33.465427+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:35:33.465427+0000","last_undegraded":"2024-09-14T11:35:33.465427+0000","last_fullsized":"2024-09-14T11:35:33.465427+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:21:50.973557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'366","reported_seq":1023,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.991441+0000","last_change":"2024-09-14T10:56:06.830891+0000","last_active":"2024-09-14T11:37:46.991441+0000","last_peered":"2024-09-14T11:37:46.991441+0000","last_clean":"2024-09-14T11:37:46.991441+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:46.991441+0000","last_undegraded":"2024-09-14T11:37:46.991441+0000","last_fullsized":"2024-09-14T11:37:46.991441+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:37:02.160609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655890,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":45139,"num_write":1131,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:29.540321+0000","last_change":"2024-09-14T10:56:08.834901+0000","last_active":"2024-09-14T11:35:29.540321+0000","last_peered":"2024-09-14T11:35:29.540321+0000","last_clean":"2024-09-14T11:35:29.540321+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:35:29.540321+0000","last_undegraded":"2024-09-14T11:35:29.540321+0000","last_fullsized":"2024-09-14T11:35:29.540321+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:56.020076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'357","reported_seq":1040,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.964238+0000","last_change":"2024-09-14T10:56:06.826208+0000","last_active":"2024-09-14T11:37:46.964238+0000","last_peered":"2024-09-14T11:37:46.964238+0000","last_clean":"2024-09-14T11:37:46.964238+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:37:46.964238+0000","last_undegraded":"2024-09-14T11:37:46.964238+0000","last_fullsized":"2024-09-14T11:37:46.964238+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:39:50.697702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":91641,"num_write":1162,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:28.738381+0000","last_change":"2024-09-14T10:56:08.846295+0000","last_active":"2024-09-14T11:35:28.738381+0000","last_peered":"2024-09-14T11:35:28.738381+0000","last_clean":"2024-09-14T11:35:28.738381+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:35:28.738381+0000","last_undegraded":"2024-09-14T11:35:28.738381+0000","last_fullsized":"2024-09-14T11:35:28.738381+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:04:58.178498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'335","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.932127+0000","last_change":"2024-09-14T10:56:06.828820+0000","last_active":"2024-09-14T11:37:46.932127+0000","last_peered":"2024-09-14T11:37:46.932127+0000","last_clean":"2024-09-14T11:37:46.932127+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:37:46.932127+0000","last_undegraded":"2024-09-14T11:37:46.932127+0000","last_fullsized":"2024-09-14T11:37:46.932127+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:35.203573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":12785,"num_write":1085,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.632102+0000","last_change":"2024-09-14T10:56:16.877295+0000","last_active":"2024-09-14T11:37:14.632102+0000","last_peered":"2024-09-14T11:37:14.632102+0000","last_clean":"2024-09-14T11:37:14.632102+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:37:14.632102+0000","last_undegraded":"2024-09-14T11:37:14.632102+0000","last_fullsized":"2024-09-14T11:37:14.632102+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:56.149162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:06.606080+0000","last_change":"2024-09-14T10:56:08.839155+0000","last_active":"2024-09-14T11:35:06.606080+0000","last_peered":"2024-09-14T11:35:06.606080+0000","last_clean":"2024-09-14T11:35:06.606080+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:35:06.606080+0000","last_undegraded":"2024-09-14T11:35:06.606080+0000","last_fullsized":"2024-09-14T11:35:06.606080+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:35:37.441954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'367","reported_seq":1062,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.952486+0000","last_change":"2024-09-14T10:56:06.835770+0000","last_active":"2024-09-14T11:37:46.952486+0000","last_peered":"2024-09-14T11:37:46.952486+0000","last_clean":"2024-09-14T11:37:46.952486+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:37:46.952486+0000","last_undegraded":"2024-09-14T11:37:46.952486+0000","last_fullsized":"2024-09-14T11:37:46.952486+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":300,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:18.469697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":841,"num_read_kb":1723,"num_write":1205,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877333+0000","last_change":"2024-09-14T10:56:10.848176+0000","last_active":"2024-09-14T11:34:52.877333+0000","last_peered":"2024-09-14T11:34:52.877333+0000","last_clean":"2024-09-14T11:34:52.877333+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:34:52.877333+0000","last_undegraded":"2024-09-14T11:34:52.877333+0000","last_fullsized":"2024-09-14T11:34:52.877333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:35.018887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'364","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.332097+0000","last_change":"2024-09-14T10:56:12.850634+0000","last_active":"2024-09-14T11:37:46.332097+0000","last_peered":"2024-09-14T11:37:46.332097+0000","last_clean":"2024-09-14T11:37:46.332097+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:37:46.332097+0000","last_undegraded":"2024-09-14T11:37:46.332097+0000","last_fullsized":"2024-09-14T11:37:46.332097+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:49.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48907,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":593,"num_read_kb":1292,"num_write":484,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895276+0000","last_change":"2024-09-14T10:56:14.867772+0000","last_active":"2024-09-14T11:34:54.895276+0000","last_peered":"2024-09-14T11:34:54.895276+0000","last_clean":"2024-09-14T11:34:54.895276+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:34:54.895276+0000","last_undegraded":"2024-09-14T11:34:54.895276+0000","last_fullsized":"2024-09-14T11:34:54.895276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:36.827998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2488","reported_seq":4301,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.535039+0000","last_change":"2024-09-14T10:56:16.878623+0000","last_active":"2024-09-14T11:35:54.535039+0000","last_peered":"2024-09-14T11:35:54.535039+0000","last_clean":"2024-09-14T11:35:54.535039+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:35:54.535039+0000","last_undegraded":"2024-09-14T11:35:54.535039+0000","last_fullsized":"2024-09-14T11:35:54.535039+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:03.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":876,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.011617+0000","last_change":"2024-09-14T10:56:08.849261+0000","last_active":"2024-09-14T11:35:25.011617+0000","last_peered":"2024-09-14T11:35:25.011617+0000","last_clean":"2024-09-14T11:35:25.011617+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:35:25.011617+0000","last_undegraded":"2024-09-14T11:35:25.011617+0000","last_fullsized":"2024-09-14T11:35:25.011617+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:12.169215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'310","reported_seq":922,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.943576+0000","last_change":"2024-09-14T10:56:06.830626+0000","last_active":"2024-09-14T11:37:46.943576+0000","last_peered":"2024-09-14T11:37:46.943576+0000","last_clean":"2024-09-14T11:37:46.943576+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:37:46.943576+0000","last_undegraded":"2024-09-14T11:37:46.943576+0000","last_fullsized":"2024-09-14T11:37:46.943576+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:21.784956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":41365,"num_write":992,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:40.597273+0000","last_change":"2024-09-14T10:56:10.842610+0000","last_active":"2024-09-14T11:33:40.597273+0000","last_peered":"2024-09-14T11:33:40.597273+0000","last_clean":"2024-09-14T11:33:40.597273+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:33:40.597273+0000","last_undegraded":"2024-09-14T11:33:40.597273+0000","last_fullsized":"2024-09-14T11:33:40.597273+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:31.067891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'88","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.440429+0000","last_change":"2024-09-14T10:56:12.850155+0000","last_active":"2024-09-14T11:36:21.440429+0000","last_peered":"2024-09-14T11:36:21.440429+0000","last_clean":"2024-09-14T11:36:21.440429+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:36:21.440429+0000","last_undegraded":"2024-09-14T11:36:21.440429+0000","last_fullsized":"2024-09-14T11:36:21.440429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:58.551957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895419+0000","last_change":"2024-09-14T10:56:14.865727+0000","last_active":"2024-09-14T11:34:54.895419+0000","last_peered":"2024-09-14T11:34:54.895419+0000","last_clean":"2024-09-14T11:34:54.895419+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:34:54.895419+0000","last_undegraded":"2024-09-14T11:34:54.895419+0000","last_fullsized":"2024-09-14T11:34:54.895419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:33.497143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'124","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.497858+0000","last_change":"2024-09-14T10:56:16.878997+0000","last_active":"2024-09-14T11:35:26.497858+0000","last_peered":"2024-09-14T11:35:26.497858+0000","last_clean":"2024-09-14T11:35:26.497858+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:35:26.497858+0000","last_undegraded":"2024-09-14T11:35:26.497858+0000","last_fullsized":"2024-09-14T11:35:26.497858+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:40.199776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.949206+0000","last_change":"2024-09-14T10:56:08.843498+0000","last_active":"2024-09-14T11:35:12.949206+0000","last_peered":"2024-09-14T11:35:12.949206+0000","last_clean":"2024-09-14T11:35:12.949206+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:35:12.949206+0000","last_undegraded":"2024-09-14T11:35:12.949206+0000","last_fullsized":"2024-09-14T11:35:12.949206+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:05.973356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'351","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.988872+0000","last_change":"2024-09-14T10:56:06.834132+0000","last_active":"2024-09-14T11:37:46.988872+0000","last_peered":"2024-09-14T11:37:46.988872+0000","last_clean":"2024-09-14T11:37:46.988872+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:37:46.988872+0000","last_undegraded":"2024-09-14T11:37:46.988872+0000","last_fullsized":"2024-09-14T11:37:46.988872+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:22.363792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":14993,"num_write":1137,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607291+0000","last_change":"2024-09-14T10:56:10.847524+0000","last_active":"2024-09-14T11:34:55.607291+0000","last_peered":"2024-09-14T11:34:55.607291+0000","last_clean":"2024-09-14T11:34:55.607291+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:34:55.607291+0000","last_undegraded":"2024-09-14T11:34:55.607291+0000","last_fullsized":"2024-09-14T11:34:55.607291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.642527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'114","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.457558+0000","last_change":"2024-09-14T10:56:12.847058+0000","last_active":"2024-09-14T11:36:21.457558+0000","last_peered":"2024-09-14T11:36:21.457558+0000","last_clean":"2024-09-14T11:36:21.457558+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:36:21.457558+0000","last_undegraded":"2024-09-14T11:36:21.457558+0000","last_fullsized":"2024-09-14T11:36:21.457558+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:03:22.246613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'760","reported_seq":2177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.747256+0000","last_change":"2024-09-14T10:56:14.861391+0000","last_active":"2024-09-14T11:37:46.747256+0000","last_peered":"2024-09-14T11:37:46.747256+0000","last_clean":"2024-09-14T11:37:46.747256+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:37:46.747256+0000","last_undegraded":"2024-09-14T11:37:46.747256+0000","last_fullsized":"2024-09-14T11:37:46.747256+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:33.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'240","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.745307+0000","last_change":"2024-09-14T10:56:16.865049+0000","last_active":"2024-09-14T11:35:56.745307+0000","last_peered":"2024-09-14T11:35:56.745307+0000","last_clean":"2024-09-14T11:35:56.745307+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:35:56.745307+0000","last_undegraded":"2024-09-14T11:35:56.745307+0000","last_fullsized":"2024-09-14T11:35:56.745307+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:59.143467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4156","reported_seq":4751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:50.606696+0000","last_change":"2024-09-14T10:56:08.848320+0000","last_active":"2024-09-14T11:34:50.606696+0000","last_peered":"2024-09-14T11:34:50.606696+0000","last_clean":"2024-09-14T11:34:50.606696+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:34:50.606696+0000","last_undegraded":"2024-09-14T11:34:50.606696+0000","last_fullsized":"2024-09-14T11:34:50.606696+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":3000,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:53:16.344418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'335","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.982262+0000","last_change":"2024-09-14T10:56:06.834097+0000","last_active":"2024-09-14T11:37:46.982262+0000","last_peered":"2024-09-14T11:37:46.982262+0000","last_clean":"2024-09-14T11:37:46.982262+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:37:46.982262+0000","last_undegraded":"2024-09-14T11:37:46.982262+0000","last_fullsized":"2024-09-14T11:37:46.982262+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:23.306111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":30569,"num_write":1024,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877363+0000","last_change":"2024-09-14T10:56:10.839414+0000","last_active":"2024-09-14T11:34:52.877363+0000","last_peered":"2024-09-14T11:34:52.877363+0000","last_clean":"2024-09-14T11:34:52.877363+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:34:52.877363+0000","last_undegraded":"2024-09-14T11:34:52.877363+0000","last_fullsized":"2024-09-14T11:34:52.877363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:56.422012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'290","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.160375+0000","last_change":"2024-09-14T10:56:13.041543+0000","last_active":"2024-09-14T11:37:46.160375+0000","last_peered":"2024-09-14T11:37:46.160375+0000","last_clean":"2024-09-14T11:37:46.160375+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:37:46.160375+0000","last_undegraded":"2024-09-14T11:37:46.160375+0000","last_fullsized":"2024-09-14T11:37:46.160375+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.191878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":1245,"num_write":424,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'794","reported_seq":2254,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.797123+0000","last_change":"2024-09-14T10:56:14.859370+0000","last_active":"2024-09-14T11:37:45.797123+0000","last_peered":"2024-09-14T11:37:45.797123+0000","last_clean":"2024-09-14T11:37:45.797123+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:37:45.797123+0000","last_undegraded":"2024-09-14T11:37:45.797123+0000","last_fullsized":"2024-09-14T11:37:45.797123+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:34.411310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":735,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880438+0000","last_change":"2024-09-14T10:56:08.849378+0000","last_active":"2024-09-14T11:35:12.880438+0000","last_peered":"2024-09-14T11:35:12.880438+0000","last_clean":"2024-09-14T11:35:12.880438+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:35:12.880438+0000","last_undegraded":"2024-09-14T11:35:12.880438+0000","last_fullsized":"2024-09-14T11:35:12.880438+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:42:36.824573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'327","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.948529+0000","last_change":"2024-09-14T10:56:06.836741+0000","last_active":"2024-09-14T11:37:46.948529+0000","last_peered":"2024-09-14T11:37:46.948529+0000","last_clean":"2024-09-14T11:37:46.948529+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:46.948529+0000","last_undegraded":"2024-09-14T11:37:46.948529+0000","last_fullsized":"2024-09-14T11:37:46.948529+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:47:18.533912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":515,"num_read_kb":9228,"num_write":1120,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898164+0000","last_change":"2024-09-14T10:56:10.848968+0000","last_active":"2024-09-14T11:35:14.898164+0000","last_peered":"2024-09-14T11:35:14.898164+0000","last_clean":"2024-09-14T11:35:14.898164+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:35:14.898164+0000","last_undegraded":"2024-09-14T11:35:14.898164+0000","last_fullsized":"2024-09-14T11:35:14.898164+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:05.693919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'360","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.483385+0000","last_change":"2024-09-14T10:56:13.041185+0000","last_active":"2024-09-14T11:37:46.483385+0000","last_peered":"2024-09-14T11:37:46.483385+0000","last_clean":"2024-09-14T11:37:46.483385+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:37:46.483385+0000","last_undegraded":"2024-09-14T11:37:46.483385+0000","last_fullsized":"2024-09-14T11:37:46.483385+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":1214,"num_write":460,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758510+0000","last_change":"2024-09-14T10:56:14.867306+0000","last_active":"2024-09-14T11:34:33.758510+0000","last_peered":"2024-09-14T11:34:33.758510+0000","last_clean":"2024-09-14T11:34:33.758510+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:34:33.758510+0000","last_undegraded":"2024-09-14T11:34:33.758510+0000","last_fullsized":"2024-09-14T11:34:33.758510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:08.141850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'546","reported_seq":1358,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.630477+0000","last_change":"2024-09-14T10:56:16.873797+0000","last_active":"2024-09-14T11:37:14.630477+0000","last_peered":"2024-09-14T11:37:14.630477+0000","last_clean":"2024-09-14T11:37:14.630477+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:37:14.630477+0000","last_undegraded":"2024-09-14T11:37:14.630477+0000","last_fullsized":"2024-09-14T11:37:14.630477+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:06.775196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":840,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.164105+0000","last_change":"2024-09-14T10:56:08.845180+0000","last_active":"2024-09-14T11:35:37.164105+0000","last_peered":"2024-09-14T11:35:37.164105+0000","last_clean":"2024-09-14T11:35:37.164105+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:35:37.164105+0000","last_undegraded":"2024-09-14T11:35:37.164105+0000","last_fullsized":"2024-09-14T11:35:37.164105+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:57:14.334791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'261","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.946630+0000","last_change":"2024-09-14T10:56:06.835215+0000","last_active":"2024-09-14T11:37:46.946630+0000","last_peered":"2024-09-14T11:37:46.946630+0000","last_clean":"2024-09-14T11:37:46.946630+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:37:46.946630+0000","last_undegraded":"2024-09-14T11:37:46.946630+0000","last_fullsized":"2024-09-14T11:37:46.946630+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:16:04.636480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":56700,"num_write":826,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866554+0000","last_change":"2024-09-14T10:56:10.848498+0000","last_active":"2024-09-14T11:35:14.866554+0000","last_peered":"2024-09-14T11:35:14.866554+0000","last_clean":"2024-09-14T11:35:14.866554+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:35:14.866554+0000","last_undegraded":"2024-09-14T11:35:14.866554+0000","last_fullsized":"2024-09-14T11:35:14.866554+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:30.715397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'269","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.971714+0000","last_change":"2024-09-14T10:56:12.849959+0000","last_active":"2024-09-14T11:37:46.971714+0000","last_peered":"2024-09-14T11:37:46.971714+0000","last_clean":"2024-09-14T11:37:46.971714+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:37:46.971714+0000","last_undegraded":"2024-09-14T11:37:46.971714+0000","last_fullsized":"2024-09-14T11:37:46.971714+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:51.049544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71588,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1104,"num_write":366,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610430+0000","last_change":"2024-09-14T10:56:14.859113+0000","last_active":"2024-09-14T11:35:20.610430+0000","last_peered":"2024-09-14T11:35:20.610430+0000","last_clean":"2024-09-14T11:35:20.610430+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:35:20.610430+0000","last_undegraded":"2024-09-14T11:35:20.610430+0000","last_fullsized":"2024-09-14T11:35:20.610430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:39.449429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'114","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:59.904352+0000","last_change":"2024-09-14T10:56:16.872299+0000","last_active":"2024-09-14T11:35:59.904352+0000","last_peered":"2024-09-14T11:35:59.904352+0000","last_clean":"2024-09-14T11:35:59.904352+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:35:59.904352+0000","last_undegraded":"2024-09-14T11:35:59.904352+0000","last_fullsized":"2024-09-14T11:35:59.904352+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:01:14.575119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":681,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.871798+0000","last_change":"2024-09-14T10:56:08.846448+0000","last_active":"2024-09-14T11:35:37.871798+0000","last_peered":"2024-09-14T11:35:37.871798+0000","last_clean":"2024-09-14T11:35:37.871798+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:35:37.871798+0000","last_undegraded":"2024-09-14T11:35:37.871798+0000","last_fullsized":"2024-09-14T11:35:37.871798+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:21.638181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'448","reported_seq":1152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.946077+0000","last_change":"2024-09-14T10:56:06.838982+0000","last_active":"2024-09-14T11:37:46.946077+0000","last_peered":"2024-09-14T11:37:46.946077+0000","last_clean":"2024-09-14T11:37:46.946077+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:37:46.946077+0000","last_undegraded":"2024-09-14T11:37:46.946077+0000","last_fullsized":"2024-09-14T11:37:46.946077+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:14.036248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":972,"num_read_kb":28710,"num_write":1673,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861135+0000","last_change":"2024-09-14T10:56:10.847743+0000","last_active":"2024-09-14T11:34:29.861135+0000","last_peered":"2024-09-14T11:34:29.861135+0000","last_clean":"2024-09-14T11:34:29.861135+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:34:29.861135+0000","last_undegraded":"2024-09-14T11:34:29.861135+0000","last_fullsized":"2024-09-14T11:34:29.861135+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:37:13.871060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'307","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.556330+0000","last_change":"2024-09-14T10:56:12.847492+0000","last_active":"2024-09-14T11:37:46.556330+0000","last_peered":"2024-09-14T11:37:46.556330+0000","last_clean":"2024-09-14T11:37:46.556330+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:37:46.556330+0000","last_undegraded":"2024-09-14T11:37:46.556330+0000","last_fullsized":"2024-09-14T11:37:46.556330+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:45.170095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50445,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":514,"num_read_kb":1159,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'778","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.858940+0000","last_change":"2024-09-14T10:56:14.863301+0000","last_active":"2024-09-14T11:37:46.858940+0000","last_peered":"2024-09-14T11:37:46.858940+0000","last_clean":"2024-09-14T11:37:46.858940+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:37:46.858940+0000","last_undegraded":"2024-09-14T11:37:46.858940+0000","last_fullsized":"2024-09-14T11:37:46.858940+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":701,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:01.064582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.458613+0000","last_change":"2024-09-14T10:56:16.877915+0000","last_active":"2024-09-14T11:37:13.458613+0000","last_peered":"2024-09-14T11:37:13.458613+0000","last_clean":"2024-09-14T11:37:13.458613+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:37:13.458613+0000","last_undegraded":"2024-09-14T11:37:13.458613+0000","last_fullsized":"2024-09-14T11:37:13.458613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:25.564431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":793,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756765+0000","last_change":"2024-09-14T10:56:08.840369+0000","last_active":"2024-09-14T11:34:23.756765+0000","last_peered":"2024-09-14T11:34:23.756765+0000","last_clean":"2024-09-14T11:34:23.756765+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:34:23.756765+0000","last_undegraded":"2024-09-14T11:34:23.756765+0000","last_fullsized":"2024-09-14T11:34:23.756765+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:58:24.990479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'316","reported_seq":939,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.987614+0000","last_change":"2024-09-14T10:56:06.827678+0000","last_active":"2024-09-14T11:37:46.987614+0000","last_peered":"2024-09-14T11:37:46.987614+0000","last_clean":"2024-09-14T11:37:46.987614+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:37:46.987614+0000","last_undegraded":"2024-09-14T11:37:46.987614+0000","last_fullsized":"2024-09-14T11:37:46.987614+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:00.287082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":39728,"num_write":960,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.867092+0000","last_change":"2024-09-14T10:56:10.851426+0000","last_active":"2024-09-14T11:35:19.867092+0000","last_peered":"2024-09-14T11:35:19.867092+0000","last_clean":"2024-09-14T11:35:19.867092+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:35:19.867092+0000","last_undegraded":"2024-09-14T11:35:19.867092+0000","last_fullsized":"2024-09-14T11:35:19.867092+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:40.334991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'463","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.643327+0000","last_change":"2024-09-14T10:56:12.850654+0000","last_active":"2024-09-14T11:37:46.643327+0000","last_peered":"2024-09-14T11:37:46.643327+0000","last_clean":"2024-09-14T11:37:46.643327+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:37:46.643327+0000","last_undegraded":"2024-09-14T11:37:46.643327+0000","last_fullsized":"2024-09-14T11:37:46.643327+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:01.231786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91900,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":1934,"num_write":662,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866535+0000","last_change":"2024-09-14T10:56:14.862461+0000","last_active":"2024-09-14T11:35:14.866535+0000","last_peered":"2024-09-14T11:35:14.866535+0000","last_clean":"2024-09-14T11:35:14.866535+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:35:14.866535+0000","last_undegraded":"2024-09-14T11:35:14.866535+0000","last_fullsized":"2024-09-14T11:35:14.866535+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:30.827794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'106","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764320+0000","last_change":"2024-09-14T10:56:16.874312+0000","last_active":"2024-09-14T11:35:18.764320+0000","last_peered":"2024-09-14T11:35:18.764320+0000","last_clean":"2024-09-14T11:35:18.764320+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:35:18.764320+0000","last_undegraded":"2024-09-14T11:35:18.764320+0000","last_fullsized":"2024-09-14T11:35:18.764320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:06.689124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'255","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891045+0000","last_change":"2024-09-14T10:56:08.840033+0000","last_active":"2024-09-14T11:34:24.891045+0000","last_peered":"2024-09-14T11:34:24.891045+0000","last_clean":"2024-09-14T11:34:24.891045+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:34:24.891045+0000","last_undegraded":"2024-09-14T11:34:24.891045+0000","last_fullsized":"2024-09-14T11:34:24.891045+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:26.628096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'331","reported_seq":937,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.923450+0000","last_change":"2024-09-14T10:56:06.831914+0000","last_active":"2024-09-14T11:37:46.923450+0000","last_peered":"2024-09-14T11:37:46.923450+0000","last_clean":"2024-09-14T11:37:46.923450+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:37:46.923450+0000","last_undegraded":"2024-09-14T11:37:46.923450+0000","last_fullsized":"2024-09-14T11:37:46.923450+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:44:23.908631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":517,"num_read_kb":5559,"num_write":1004,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861192+0000","last_change":"2024-09-14T10:56:10.851153+0000","last_active":"2024-09-14T11:34:29.861192+0000","last_peered":"2024-09-14T11:34:29.861192+0000","last_clean":"2024-09-14T11:34:29.861192+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:34:29.861192+0000","last_undegraded":"2024-09-14T11:34:29.861192+0000","last_fullsized":"2024-09-14T11:34:29.861192+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:53.218265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'278","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.936954+0000","last_change":"2024-09-14T10:56:12.851527+0000","last_active":"2024-09-14T11:37:45.936954+0000","last_peered":"2024-09-14T11:37:45.936954+0000","last_clean":"2024-09-14T11:37:45.936954+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:37:45.936954+0000","last_undegraded":"2024-09-14T11:37:45.936954+0000","last_fullsized":"2024-09-14T11:37:45.936954+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:56.803494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43790,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1041,"num_write":430,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T10:56:14.862397+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:41.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'106","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:25.618639+0000","last_change":"2024-09-14T10:56:16.877499+0000","last_active":"2024-09-14T11:36:25.618639+0000","last_peered":"2024-09-14T11:36:25.618639+0000","last_clean":"2024-09-14T11:36:25.618639+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:36:25.618639+0000","last_undegraded":"2024-09-14T11:36:25.618639+0000","last_fullsized":"2024-09-14T11:36:25.618639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:22.117249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'104","reported_seq":712,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.329749+0000","last_change":"2024-09-14T10:56:08.840230+0000","last_active":"2024-09-14T11:35:36.329749+0000","last_peered":"2024-09-14T11:35:36.329749+0000","last_clean":"2024-09-14T11:35:36.329749+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:35:36.329749+0000","last_undegraded":"2024-09-14T11:35:36.329749+0000","last_fullsized":"2024-09-14T11:35:36.329749+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:33.596968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'372","reported_seq":1013,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.984698+0000","last_change":"2024-09-14T10:56:06.834028+0000","last_active":"2024-09-14T11:37:46.984698+0000","last_peered":"2024-09-14T11:37:46.984698+0000","last_clean":"2024-09-14T11:37:46.984698+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:37:46.984698+0000","last_undegraded":"2024-09-14T11:37:46.984698+0000","last_fullsized":"2024-09-14T11:37:46.984698+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:05:18.403230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":626,"num_read_kb":12205,"num_write":1169,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757753+0000","last_change":"2024-09-14T10:56:10.852013+0000","last_active":"2024-09-14T11:34:28.757753+0000","last_peered":"2024-09-14T11:34:28.757753+0000","last_clean":"2024-09-14T11:34:28.757753+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:34:28.757753+0000","last_undegraded":"2024-09-14T11:34:28.757753+0000","last_fullsized":"2024-09-14T11:34:28.757753+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:34:20.745857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'291","reported_seq":871,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.860529+0000","last_change":"2024-09-14T10:56:12.856779+0000","last_active":"2024-09-14T11:37:46.860529+0000","last_peered":"2024-09-14T11:37:46.860529+0000","last_clean":"2024-09-14T11:37:46.860529+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:37:46.860529+0000","last_undegraded":"2024-09-14T11:37:46.860529+0000","last_fullsized":"2024-09-14T11:37:46.860529+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:24.231799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1133,"num_write":410,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'727","reported_seq":2194,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.662313+0000","last_change":"2024-09-14T10:56:14.866439+0000","last_active":"2024-09-14T11:37:46.662313+0000","last_peered":"2024-09-14T11:37:46.662313+0000","last_clean":"2024-09-14T11:37:46.662313+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:37:46.662313+0000","last_undegraded":"2024-09-14T11:37:46.662313+0000","last_fullsized":"2024-09-14T11:37:46.662313+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":701,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:58:07.193263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'138","reported_seq":632,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.817608+0000","last_change":"2024-09-14T10:56:16.873210+0000","last_active":"2024-09-14T11:35:25.817608+0000","last_peered":"2024-09-14T11:35:25.817608+0000","last_clean":"2024-09-14T11:35:25.817608+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:35:25.817608+0000","last_undegraded":"2024-09-14T11:35:25.817608+0000","last_fullsized":"2024-09-14T11:35:25.817608+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:56:57.429498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'172","reported_seq":780,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.052682+0000","last_change":"2024-09-14T10:56:08.843637+0000","last_active":"2024-09-14T11:35:20.052682+0000","last_peered":"2024-09-14T11:35:20.052682+0000","last_clean":"2024-09-14T11:35:20.052682+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:35:20.052682+0000","last_undegraded":"2024-09-14T11:35:20.052682+0000","last_fullsized":"2024-09-14T11:35:20.052682+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:16:12.290035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'328","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.922199+0000","last_change":"2024-09-14T10:56:06.830680+0000","last_active":"2024-09-14T11:37:46.922199+0000","last_peered":"2024-09-14T11:37:46.922199+0000","last_clean":"2024-09-14T11:37:46.922199+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:37:46.922199+0000","last_undegraded":"2024-09-14T11:37:46.922199+0000","last_fullsized":"2024-09-14T11:37:46.922199+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:52:18.827199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":8777,"num_write":1001,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.571412+0000","last_change":"2024-09-14T10:56:10.849165+0000","last_active":"2024-09-14T11:37:45.571412+0000","last_peered":"2024-09-14T11:37:45.571412+0000","last_clean":"2024-09-14T11:37:45.571412+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:37:45.571412+0000","last_undegraded":"2024-09-14T11:37:45.571412+0000","last_fullsized":"2024-09-14T11:37:45.571412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:00.894650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.427200+0000","last_change":"2024-09-14T10:56:13.041348+0000","last_active":"2024-09-14T11:36:21.427200+0000","last_peered":"2024-09-14T11:36:21.427200+0000","last_clean":"2024-09-14T11:36:21.427200+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:36:21.427200+0000","last_undegraded":"2024-09-14T11:36:21.427200+0000","last_fullsized":"2024-09-14T11:36:21.427200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:28.818595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2174,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.794663+0000","last_change":"2024-09-14T10:56:14.868996+0000","last_active":"2024-09-14T11:37:45.794663+0000","last_peered":"2024-09-14T11:37:45.794663+0000","last_clean":"2024-09-14T11:37:45.794663+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:37:45.794663+0000","last_undegraded":"2024-09-14T11:37:45.794663+0000","last_fullsized":"2024-09-14T11:37:45.794663+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:29.783931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.530654+0000","last_change":"2024-09-14T10:56:16.870911+0000","last_active":"2024-09-14T11:35:56.530654+0000","last_peered":"2024-09-14T11:35:56.530654+0000","last_clean":"2024-09-14T11:35:56.530654+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:35:56.530654+0000","last_undegraded":"2024-09-14T11:35:56.530654+0000","last_fullsized":"2024-09-14T11:35:56.530654+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:39.800135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'625","reported_seq":1464,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.902240+0000","last_change":"2024-09-14T10:56:08.839242+0000","last_active":"2024-09-14T11:35:19.902240+0000","last_peered":"2024-09-14T11:35:19.902240+0000","last_clean":"2024-09-14T11:35:19.902240+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:35:19.902240+0000","last_undegraded":"2024-09-14T11:35:19.902240+0000","last_fullsized":"2024-09-14T11:35:19.902240+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":600,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:35.763543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'391","reported_seq":1157,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.997487+0000","last_change":"2024-09-14T10:56:06.823223+0000","last_active":"2024-09-14T11:37:46.997487+0000","last_peered":"2024-09-14T11:37:46.997487+0000","last_clean":"2024-09-14T11:37:46.997487+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:37:46.997487+0000","last_undegraded":"2024-09-14T11:37:46.997487+0000","last_fullsized":"2024-09-14T11:37:46.997487+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:47:05.387288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1140,"num_read_kb":48198,"num_write":1212,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891740+0000","last_change":"2024-09-14T10:56:10.850019+0000","last_active":"2024-09-14T11:34:29.891740+0000","last_peered":"2024-09-14T11:34:29.891740+0000","last_clean":"2024-09-14T11:34:29.891740+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:34:29.891740+0000","last_undegraded":"2024-09-14T11:34:29.891740+0000","last_fullsized":"2024-09-14T11:34:29.891740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:25.627310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'348","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.370868+0000","last_change":"2024-09-14T10:56:12.853756+0000","last_active":"2024-09-14T11:37:46.370868+0000","last_peered":"2024-09-14T11:37:46.370868+0000","last_clean":"2024-09-14T11:37:46.370868+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:37:46.370868+0000","last_undegraded":"2024-09-14T11:37:46.370868+0000","last_fullsized":"2024-09-14T11:37:46.370868+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:44.126582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46246,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1178,"num_read_kb":1754,"num_write":1698,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891290+0000","last_change":"2024-09-14T10:56:14.865772+0000","last_active":"2024-09-14T11:34:29.891290+0000","last_peered":"2024-09-14T11:34:29.891290+0000","last_clean":"2024-09-14T11:34:29.891290+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:34:29.891290+0000","last_undegraded":"2024-09-14T11:34:29.891290+0000","last_fullsized":"2024-09-14T11:34:29.891290+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:50:37.189265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:37.162130+0000","last_change":"2024-09-14T10:56:16.875685+0000","last_active":"2024-09-14T11:35:37.162130+0000","last_peered":"2024-09-14T11:35:37.162130+0000","last_clean":"2024-09-14T11:35:37.162130+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:35:37.162130+0000","last_undegraded":"2024-09-14T11:35:37.162130+0000","last_fullsized":"2024-09-14T11:35:37.162130+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:32:13.149449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1121,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.085890+0000","last_change":"2024-09-14T10:56:08.845279+0000","last_active":"2024-09-14T11:35:16.085890+0000","last_peered":"2024-09-14T11:35:16.085890+0000","last_clean":"2024-09-14T11:35:16.085890+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:35:16.085890+0000","last_undegraded":"2024-09-14T11:35:16.085890+0000","last_fullsized":"2024-09-14T11:35:16.085890+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:40:06.992049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886612+0000","last_change":"2024-09-14T10:55:50.534148+0000","last_active":"2024-09-14T11:33:54.886612+0000","last_peered":"2024-09-14T11:33:54.886612+0000","last_clean":"2024-09-14T11:33:54.886612+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:33:54.886612+0000","last_undegraded":"2024-09-14T11:33:54.886612+0000","last_fullsized":"2024-09-14T11:33:54.886612+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:48.742998+0000","last_clean_scrub_stamp":"2024-09-14T10:55:48.742998+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:03.355721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"19'1","reported_seq":514,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883203+0000","last_change":"2024-09-14T10:55:58.792442+0000","last_active":"2024-09-14T11:35:32.883203+0000","last_peered":"2024-09-14T11:35:32.883203+0000","last_clean":"2024-09-14T11:35:32.883203+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:35:32.883203+0000","last_undegraded":"2024-09-14T11:35:32.883203+0000","last_fullsized":"2024-09-14T11:35:32.883203+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:55:23.936072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'332","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.994775+0000","last_change":"2024-09-14T10:56:06.824568+0000","last_active":"2024-09-14T11:37:46.994775+0000","last_peered":"2024-09-14T11:37:46.994775+0000","last_clean":"2024-09-14T11:37:46.994775+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:37:46.994775+0000","last_undegraded":"2024-09-14T11:37:46.994775+0000","last_fullsized":"2024-09-14T11:37:46.994775+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:35.504654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":634,"num_read_kb":14631,"num_write":972,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885320+0000","last_change":"2024-09-14T10:56:10.847413+0000","last_active":"2024-09-14T11:33:44.885320+0000","last_peered":"2024-09-14T11:33:44.885320+0000","last_clean":"2024-09-14T11:33:44.885320+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:33:44.885320+0000","last_undegraded":"2024-09-14T11:33:44.885320+0000","last_fullsized":"2024-09-14T11:33:44.885320+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:14.506201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'729","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.782116+0000","last_change":"2024-09-14T10:56:12.853693+0000","last_active":"2024-09-14T11:37:46.782116+0000","last_peered":"2024-09-14T11:37:46.782116+0000","last_clean":"2024-09-14T11:37:46.782116+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:37:46.782116+0000","last_undegraded":"2024-09-14T11:37:46.782116+0000","last_fullsized":"2024-09-14T11:37:46.782116+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.618315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1412,"num_read_kb":3246,"num_write":1300,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764311+0000","last_change":"2024-09-14T10:56:14.867670+0000","last_active":"2024-09-14T11:35:18.764311+0000","last_peered":"2024-09-14T11:35:18.764311+0000","last_clean":"2024-09-14T11:35:18.764311+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:35:18.764311+0000","last_undegraded":"2024-09-14T11:35:18.764311+0000","last_fullsized":"2024-09-14T11:35:18.764311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:07.515289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'194","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.647341+0000","last_change":"2024-09-14T10:56:16.872059+0000","last_active":"2024-09-14T11:35:56.647341+0000","last_peered":"2024-09-14T11:35:56.647341+0000","last_clean":"2024-09-14T11:35:56.647341+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:35:56.647341+0000","last_undegraded":"2024-09-14T11:35:56.647341+0000","last_fullsized":"2024-09-14T11:35:56.647341+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.250321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'188","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763118+0000","last_change":"2024-09-14T10:56:08.839810+0000","last_active":"2024-09-14T11:35:08.763118+0000","last_peered":"2024-09-14T11:35:08.763118+0000","last_clean":"2024-09-14T11:35:08.763118+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:35:08.763118+0000","last_undegraded":"2024-09-14T11:35:08.763118+0000","last_fullsized":"2024-09-14T11:35:08.763118+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:08:33.165560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.887822+0000","last_change":"2024-09-14T10:55:59.204366+0000","last_active":"2024-09-14T11:34:04.887822+0000","last_peered":"2024-09-14T11:34:04.887822+0000","last_clean":"2024-09-14T11:34:04.887822+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:34:04.887822+0000","last_undegraded":"2024-09-14T11:34:04.887822+0000","last_fullsized":"2024-09-14T11:34:04.887822+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:15.414745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'395","reported_seq":1087,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990626+0000","last_change":"2024-09-14T10:56:06.833177+0000","last_active":"2024-09-14T11:37:46.990626+0000","last_peered":"2024-09-14T11:37:46.990626+0000","last_clean":"2024-09-14T11:37:46.990626+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:46.990626+0000","last_undegraded":"2024-09-14T11:37:46.990626+0000","last_fullsized":"2024-09-14T11:37:46.990626+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:52.299621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":799,"num_read_kb":83524,"num_write":1261,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"35'5","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.559396+0000","last_change":"2024-09-14T10:56:10.849032+0000","last_active":"2024-09-14T11:37:45.559396+0000","last_peered":"2024-09-14T11:37:45.559396+0000","last_clean":"2024-09-14T11:37:45.559396+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:37:45.559396+0000","last_undegraded":"2024-09-14T11:37:45.559396+0000","last_fullsized":"2024-09-14T11:37:45.559396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:01.123575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1237","reported_seq":2667,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:47.003749+0000","last_change":"2024-09-14T10:56:12.856442+0000","last_active":"2024-09-14T11:37:47.003749+0000","last_peered":"2024-09-14T11:37:47.003749+0000","last_clean":"2024-09-14T11:37:47.003749+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:37:47.003749+0000","last_undegraded":"2024-09-14T11:37:47.003749+0000","last_fullsized":"2024-09-14T11:37:47.003749+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":1200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138368,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1980,"num_read_kb":3690,"num_write":1076,"num_write_kb":906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:49.886081+0000","last_change":"2024-09-14T10:56:14.860734+0000","last_active":"2024-09-14T11:33:49.886081+0000","last_peered":"2024-09-14T11:33:49.886081+0000","last_clean":"2024-09-14T11:33:49.886081+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:33:49.886081+0000","last_undegraded":"2024-09-14T11:33:49.886081+0000","last_fullsized":"2024-09-14T11:33:49.886081+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:40.424100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'240","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.064636+0000","last_change":"2024-09-14T10:56:16.876125+0000","last_active":"2024-09-14T11:35:54.064636+0000","last_peered":"2024-09-14T11:35:54.064636+0000","last_clean":"2024-09-14T11:35:54.064636+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:35:54.064636+0000","last_undegraded":"2024-09-14T11:35:54.064636+0000","last_fullsized":"2024-09-14T11:35:54.064636+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":948,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:26.302671+0000","last_change":"2024-09-14T10:56:42.662120+0000","last_active":"2024-09-14T11:34:26.302671+0000","last_peered":"2024-09-14T11:34:26.302671+0000","last_clean":"2024-09-14T11:34:26.302671+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:34:26.302671+0000","last_undegraded":"2024-09-14T11:34:26.302671+0000","last_fullsized":"2024-09-14T11:34:26.302671+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:59:08.405772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:34.868699+0000","last_change":"2024-09-14T10:55:59.134312+0000","last_active":"2024-09-14T11:35:34.868699+0000","last_peered":"2024-09-14T11:35:34.868699+0000","last_clean":"2024-09-14T11:35:34.868699+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:35:34.868699+0000","last_undegraded":"2024-09-14T11:35:34.868699+0000","last_fullsized":"2024-09-14T11:35:34.868699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:12:08.820293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'361","reported_seq":1035,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990542+0000","last_change":"2024-09-14T10:56:06.820891+0000","last_active":"2024-09-14T11:37:46.990542+0000","last_peered":"2024-09-14T11:37:46.990542+0000","last_clean":"2024-09-14T11:37:46.990542+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:37:46.990542+0000","last_undegraded":"2024-09-14T11:37:46.990542+0000","last_fullsized":"2024-09-14T11:37:46.990542+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:49:17.493636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":61657,"num_write":1199,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.866597+0000","last_change":"2024-09-14T10:56:10.852125+0000","last_active":"2024-09-14T11:35:14.866597+0000","last_peered":"2024-09-14T11:35:14.866597+0000","last_clean":"2024-09-14T11:35:14.866597+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:35:14.866597+0000","last_undegraded":"2024-09-14T11:35:14.866597+0000","last_fullsized":"2024-09-14T11:35:14.866597+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:44:31.365946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'215","reported_seq":1248,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:10.201505+0000","last_change":"2024-09-14T10:56:13.041674+0000","last_active":"2024-09-14T11:37:10.201505+0000","last_peered":"2024-09-14T11:37:10.201505+0000","last_clean":"2024-09-14T11:37:10.201505+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:37:10.201505+0000","last_undegraded":"2024-09-14T11:37:10.201505+0000","last_fullsized":"2024-09-14T11:37:10.201505+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:35.426913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752243+0000","last_change":"2024-09-14T10:56:14.869132+0000","last_active":"2024-09-14T11:33:48.752243+0000","last_peered":"2024-09-14T11:33:48.752243+0000","last_clean":"2024-09-14T11:33:48.752243+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:33:48.752243+0000","last_undegraded":"2024-09-14T11:33:48.752243+0000","last_fullsized":"2024-09-14T11:33:48.752243+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:00:52.698938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'258","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.791105+0000","last_change":"2024-09-14T10:56:16.878981+0000","last_active":"2024-09-14T11:35:56.791105+0000","last_peered":"2024-09-14T11:35:56.791105+0000","last_clean":"2024-09-14T11:35:56.791105+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:35:56.791105+0000","last_undegraded":"2024-09-14T11:35:56.791105+0000","last_fullsized":"2024-09-14T11:35:56.791105+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:11.858964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:43.767593+0000","last_change":"2024-09-14T10:56:08.845281+0000","last_active":"2024-09-14T11:35:43.767593+0000","last_peered":"2024-09-14T11:35:43.767593+0000","last_clean":"2024-09-14T11:35:43.767593+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:35:43.767593+0000","last_undegraded":"2024-09-14T11:35:43.767593+0000","last_fullsized":"2024-09-14T11:35:43.767593+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:22:49.926283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"21'2","reported_seq":515,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.883164+0000","last_change":"2024-09-14T10:55:58.793099+0000","last_active":"2024-09-14T11:35:32.883164+0000","last_peered":"2024-09-14T11:35:32.883164+0000","last_clean":"2024-09-14T11:35:32.883164+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:35:32.883164+0000","last_undegraded":"2024-09-14T11:35:32.883164+0000","last_fullsized":"2024-09-14T11:35:32.883164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:04.201969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'422","reported_seq":1171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.997456+0000","last_change":"2024-09-14T10:56:06.833233+0000","last_active":"2024-09-14T11:37:46.997456+0000","last_peered":"2024-09-14T11:37:46.997456+0000","last_clean":"2024-09-14T11:37:46.997456+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:37:46.997456+0000","last_undegraded":"2024-09-14T11:37:46.997456+0000","last_fullsized":"2024-09-14T11:37:46.997456+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":400,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:46.083613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":119862,"num_write":1308,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752967+0000","last_change":"2024-09-14T10:56:10.848955+0000","last_active":"2024-09-14T11:33:53.752967+0000","last_peered":"2024-09-14T11:33:53.752967+0000","last_clean":"2024-09-14T11:33:53.752967+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:33:53.752967+0000","last_undegraded":"2024-09-14T11:33:53.752967+0000","last_fullsized":"2024-09-14T11:33:53.752967+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:51.182938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.762188+0000","last_change":"2024-09-14T10:56:12.855698+0000","last_active":"2024-09-14T11:37:14.762188+0000","last_peered":"2024-09-14T11:37:14.762188+0000","last_clean":"2024-09-14T11:37:14.762188+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:37:14.762188+0000","last_undegraded":"2024-09-14T11:37:14.762188+0000","last_fullsized":"2024-09-14T11:37:14.762188+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:26.322719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897812+0000","last_change":"2024-09-14T10:56:14.864184+0000","last_active":"2024-09-14T11:35:14.897812+0000","last_peered":"2024-09-14T11:35:14.897812+0000","last_clean":"2024-09-14T11:35:14.897812+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:35:14.897812+0000","last_undegraded":"2024-09-14T11:35:14.897812+0000","last_fullsized":"2024-09-14T11:35:14.897812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:36:25.882149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.040892+0000","last_change":"2024-09-14T10:56:16.875071+0000","last_active":"2024-09-14T11:35:31.040892+0000","last_peered":"2024-09-14T11:35:31.040892+0000","last_clean":"2024-09-14T11:35:31.040892+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:35:31.040892+0000","last_undegraded":"2024-09-14T11:35:31.040892+0000","last_fullsized":"2024-09-14T11:35:31.040892+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:51.001726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:43.767562+0000","last_change":"2024-09-14T10:56:08.846819+0000","last_active":"2024-09-14T11:35:43.767562+0000","last_peered":"2024-09-14T11:35:43.767562+0000","last_clean":"2024-09-14T11:35:43.767562+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:35:43.767562+0000","last_undegraded":"2024-09-14T11:35:43.767562+0000","last_fullsized":"2024-09-14T11:35:43.767562+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:55.314508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'363","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.988184+0000","last_change":"2024-09-14T10:56:06.828378+0000","last_active":"2024-09-14T11:37:46.988184+0000","last_peered":"2024-09-14T11:37:46.988184+0000","last_clean":"2024-09-14T11:37:46.988184+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:37:46.988184+0000","last_undegraded":"2024-09-14T11:37:46.988184+0000","last_fullsized":"2024-09-14T11:37:46.988184+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:37.040311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":12538,"num_write":1147,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.766384+0000","last_change":"2024-09-14T10:55:58.795298+0000","last_active":"2024-09-14T11:35:33.766384+0000","last_peered":"2024-09-14T11:35:33.766384+0000","last_clean":"2024-09-14T11:35:33.766384+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:35:33.766384+0000","last_undegraded":"2024-09-14T11:35:33.766384+0000","last_fullsized":"2024-09-14T11:35:33.766384+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:20:33.298341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"35'3","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.560637+0000","last_change":"2024-09-14T10:56:10.849045+0000","last_active":"2024-09-14T11:37:45.560637+0000","last_peered":"2024-09-14T11:37:45.560637+0000","last_clean":"2024-09-14T11:37:45.560637+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:37:45.560637+0000","last_undegraded":"2024-09-14T11:37:45.560637+0000","last_fullsized":"2024-09-14T11:37:45.560637+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:24.164136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'591","reported_seq":1245,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.821141+0000","last_change":"2024-09-14T10:56:12.857610+0000","last_active":"2024-09-14T11:37:46.821141+0000","last_peered":"2024-09-14T11:37:46.821141+0000","last_clean":"2024-09-14T11:37:46.821141+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:37:46.821141+0000","last_undegraded":"2024-09-14T11:37:46.821141+0000","last_fullsized":"2024-09-14T11:37:46.821141+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.734579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94043,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":992,"num_read_kb":2221,"num_write":850,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885969+0000","last_change":"2024-09-14T10:56:14.866887+0000","last_active":"2024-09-14T11:33:44.885969+0000","last_peered":"2024-09-14T11:33:44.885969+0000","last_clean":"2024-09-14T11:33:44.885969+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:33:44.885969+0000","last_undegraded":"2024-09-14T11:33:44.885969+0000","last_fullsized":"2024-09-14T11:33:44.885969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:18.571111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.463557+0000","last_change":"2024-09-14T10:56:16.874511+0000","last_active":"2024-09-14T11:35:33.463557+0000","last_peered":"2024-09-14T11:35:33.463557+0000","last_clean":"2024-09-14T11:35:33.463557+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:35:33.463557+0000","last_undegraded":"2024-09-14T11:35:33.463557+0000","last_fullsized":"2024-09-14T11:35:33.463557+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:37.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.066687+0000","last_change":"2024-09-14T10:56:08.844695+0000","last_active":"2024-09-14T11:35:54.066687+0000","last_peered":"2024-09-14T11:35:54.066687+0000","last_clean":"2024-09-14T11:35:54.066687+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:35:54.066687+0000","last_undegraded":"2024-09-14T11:35:54.066687+0000","last_fullsized":"2024-09-14T11:35:54.066687+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:00:48.072778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'348","reported_seq":1000,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.993309+0000","last_change":"2024-09-14T10:56:06.820948+0000","last_active":"2024-09-14T11:37:46.993309+0000","last_peered":"2024-09-14T11:37:46.993309+0000","last_clean":"2024-09-14T11:37:46.993309+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:37:46.993309+0000","last_undegraded":"2024-09-14T11:37:46.993309+0000","last_fullsized":"2024-09-14T11:37:46.993309+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:12:42.568606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":702,"num_read_kb":48648,"num_write":1220,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":511,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901911+0000","last_change":"2024-09-14T10:55:59.204323+0000","last_active":"2024-09-14T11:35:39.901911+0000","last_peered":"2024-09-14T11:35:39.901911+0000","last_clean":"2024-09-14T11:35:39.901911+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:35:39.901911+0000","last_undegraded":"2024-09-14T11:35:39.901911+0000","last_fullsized":"2024-09-14T11:35:39.901911+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:50.070588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885825+0000","last_change":"2024-09-14T10:56:10.846790+0000","last_active":"2024-09-14T11:33:44.885825+0000","last_peered":"2024-09-14T11:33:44.885825+0000","last_clean":"2024-09-14T11:33:44.885825+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:33:44.885825+0000","last_undegraded":"2024-09-14T11:33:44.885825+0000","last_fullsized":"2024-09-14T11:33:44.885825+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:14.639629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'148","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.474378+0000","last_change":"2024-09-14T10:56:13.041311+0000","last_active":"2024-09-14T11:36:21.474378+0000","last_peered":"2024-09-14T11:36:21.474378+0000","last_clean":"2024-09-14T11:36:21.474378+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:36:21.474378+0000","last_undegraded":"2024-09-14T11:36:21.474378+0000","last_fullsized":"2024-09-14T11:36:21.474378+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:34:12.922612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'794","reported_seq":2759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.623315+0000","last_change":"2024-09-14T10:56:14.864682+0000","last_active":"2024-09-14T11:37:46.623315+0000","last_peered":"2024-09-14T11:37:46.623315+0000","last_clean":"2024-09-14T11:37:46.623315+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:37:46.623315+0000","last_undegraded":"2024-09-14T11:37:46.623315+0000","last_fullsized":"2024-09-14T11:37:46.623315+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.506777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'136","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:55.622534+0000","last_change":"2024-09-14T10:56:16.878173+0000","last_active":"2024-09-14T11:36:55.622534+0000","last_peered":"2024-09-14T11:36:55.622534+0000","last_clean":"2024-09-14T11:36:55.622534+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:36:55.622534+0000","last_undegraded":"2024-09-14T11:36:55.622534+0000","last_fullsized":"2024-09-14T11:36:55.622534+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:18.316372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'111","reported_seq":697,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.457301+0000","last_change":"2024-09-14T10:56:08.849379+0000","last_active":"2024-09-14T11:37:13.457301+0000","last_peered":"2024-09-14T11:37:13.457301+0000","last_clean":"2024-09-14T11:37:13.457301+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:37:13.457301+0000","last_undegraded":"2024-09-14T11:37:13.457301+0000","last_fullsized":"2024-09-14T11:37:13.457301+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:56:13.970269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'355","reported_seq":968,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.979945+0000","last_change":"2024-09-14T10:56:06.833600+0000","last_active":"2024-09-14T11:37:46.979945+0000","last_peered":"2024-09-14T11:37:46.979945+0000","last_clean":"2024-09-14T11:37:46.979945+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:37:46.979945+0000","last_undegraded":"2024-09-14T11:37:46.979945+0000","last_fullsized":"2024-09-14T11:37:46.979945+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:00:55.957681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":3889,"num_write":1053,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":516,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761758+0000","last_change":"2024-09-14T10:55:58.795304+0000","last_active":"2024-09-14T11:34:58.761758+0000","last_peered":"2024-09-14T11:34:58.761758+0000","last_clean":"2024-09-14T11:34:58.761758+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:34:58.761758+0000","last_undegraded":"2024-09-14T11:34:58.761758+0000","last_fullsized":"2024-09-14T11:34:58.761758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:50:07.609351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885956+0000","last_change":"2024-09-14T10:56:10.845757+0000","last_active":"2024-09-14T11:33:44.885956+0000","last_peered":"2024-09-14T11:33:44.885956+0000","last_clean":"2024-09-14T11:33:44.885956+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:33:44.885956+0000","last_undegraded":"2024-09-14T11:33:44.885956+0000","last_fullsized":"2024-09-14T11:33:44.885956+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T10:59:40.015207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'105","reported_seq":641,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.461753+0000","last_change":"2024-09-14T10:56:12.854078+0000","last_active":"2024-09-14T11:36:21.461753+0000","last_peered":"2024-09-14T11:36:21.461753+0000","last_clean":"2024-09-14T11:36:21.461753+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:36:21.461753+0000","last_undegraded":"2024-09-14T11:36:21.461753+0000","last_fullsized":"2024-09-14T11:36:21.461753+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:53:53.954428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'794","reported_seq":2384,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.796084+0000","last_change":"2024-09-14T10:56:14.861395+0000","last_active":"2024-09-14T11:37:45.796084+0000","last_peered":"2024-09-14T11:37:45.796084+0000","last_clean":"2024-09-14T11:37:45.796084+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:37:45.796084+0000","last_undegraded":"2024-09-14T11:37:45.796084+0000","last_fullsized":"2024-09-14T11:37:45.796084+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:14.062981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'253","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.639576+0000","last_change":"2024-09-14T10:56:16.874903+0000","last_active":"2024-09-14T11:35:56.639576+0000","last_peered":"2024-09-14T11:35:56.639576+0000","last_clean":"2024-09-14T11:35:56.639576+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:35:56.639576+0000","last_undegraded":"2024-09-14T11:35:56.639576+0000","last_fullsized":"2024-09-14T11:35:56.639576+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.818843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:44.902606+0000","last_change":"2024-09-14T10:56:08.841683+0000","last_active":"2024-09-14T11:35:44.902606+0000","last_peered":"2024-09-14T11:35:44.902606+0000","last_clean":"2024-09-14T11:35:44.902606+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:35:44.902606+0000","last_undegraded":"2024-09-14T11:35:44.902606+0000","last_fullsized":"2024-09-14T11:35:44.902606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:09.542327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'359","reported_seq":1067,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.967641+0000","last_change":"2024-09-14T10:56:06.831292+0000","last_active":"2024-09-14T11:37:46.967641+0000","last_peered":"2024-09-14T11:37:46.967641+0000","last_clean":"2024-09-14T11:37:46.967641+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:46.967641+0000","last_undegraded":"2024-09-14T11:37:46.967641+0000","last_fullsized":"2024-09-14T11:37:46.967641+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:46:53.008130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":848,"num_read_kb":56309,"num_write":1145,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":509,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895598+0000","last_change":"2024-09-14T10:55:59.387955+0000","last_active":"2024-09-14T11:34:59.895598+0000","last_peered":"2024-09-14T11:34:59.895598+0000","last_clean":"2024-09-14T11:34:59.895598+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:34:59.895598+0000","last_undegraded":"2024-09-14T11:34:59.895598+0000","last_fullsized":"2024-09-14T11:34:59.895598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:55:55.766899+0000","last_clean_scrub_stamp":"2024-09-14T10:55:55.766899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:35.502046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.602419+0000","last_change":"2024-09-14T10:56:10.847591+0000","last_active":"2024-09-14T11:34:20.602419+0000","last_peered":"2024-09-14T11:34:20.602419+0000","last_clean":"2024-09-14T11:34:20.602419+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:34:20.602419+0000","last_undegraded":"2024-09-14T11:34:20.602419+0000","last_fullsized":"2024-09-14T11:34:20.602419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:12.477652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'717","reported_seq":1425,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.293642+0000","last_change":"2024-09-14T10:56:13.041312+0000","last_active":"2024-09-14T11:37:46.293642+0000","last_peered":"2024-09-14T11:37:46.293642+0000","last_clean":"2024-09-14T11:37:46.293642+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:37:46.293642+0000","last_undegraded":"2024-09-14T11:37:46.293642+0000","last_fullsized":"2024-09-14T11:37:46.293642+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:15.894086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1287,"num_read_kb":3017,"num_write":1048,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:45.598055+0000","last_change":"2024-09-14T10:56:14.856227+0000","last_active":"2024-09-14T11:33:45.598055+0000","last_peered":"2024-09-14T11:33:45.598055+0000","last_clean":"2024-09-14T11:33:45.598055+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:33:45.598055+0000","last_undegraded":"2024-09-14T11:33:45.598055+0000","last_fullsized":"2024-09-14T11:33:45.598055+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:32:33.427287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'135","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.661856+0000","last_change":"2024-09-14T10:56:16.875970+0000","last_active":"2024-09-14T11:35:32.661856+0000","last_peered":"2024-09-14T11:35:32.661856+0000","last_clean":"2024-09-14T11:35:32.661856+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:35:32.661856+0000","last_undegraded":"2024-09-14T11:35:32.661856+0000","last_fullsized":"2024-09-14T11:35:32.661856+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.939235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'137","reported_seq":688,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.148825+0000","last_change":"2024-09-14T10:56:16.878602+0000","last_active":"2024-09-14T11:35:56.148825+0000","last_peered":"2024-09-14T11:35:56.148825+0000","last_clean":"2024-09-14T11:35:56.148825+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:35:56.148825+0000","last_undegraded":"2024-09-14T11:35:56.148825+0000","last_fullsized":"2024-09-14T11:35:56.148825+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:47:22.821986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'295","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:47.068636+0000","last_change":"2024-09-14T10:56:08.840398+0000","last_active":"2024-09-14T11:34:47.068636+0000","last_peered":"2024-09-14T11:34:47.068636+0000","last_clean":"2024-09-14T11:34:47.068636+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:34:47.068636+0000","last_undegraded":"2024-09-14T11:34:47.068636+0000","last_fullsized":"2024-09-14T11:34:47.068636+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":200,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:04:37.548644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'292","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.981135+0000","last_change":"2024-09-14T10:56:06.832210+0000","last_active":"2024-09-14T11:37:46.981135+0000","last_peered":"2024-09-14T11:37:46.981135+0000","last_clean":"2024-09-14T11:37:46.981135+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:37:46.981135+0000","last_undegraded":"2024-09-14T11:37:46.981135+0000","last_fullsized":"2024-09-14T11:37:46.981135+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":200,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:05.108211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":2279,"num_write":913,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:33.863009+0000","last_change":"2024-09-14T10:56:10.850437+0000","last_active":"2024-09-14T11:33:33.863009+0000","last_peered":"2024-09-14T11:33:33.863009+0000","last_clean":"2024-09-14T11:33:33.863009+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:33:33.863009+0000","last_undegraded":"2024-09-14T11:33:33.863009+0000","last_fullsized":"2024-09-14T11:33:33.863009+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:02.749205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'255","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.515378+0000","last_change":"2024-09-14T10:56:12.855555+0000","last_active":"2024-09-14T11:37:46.515378+0000","last_peered":"2024-09-14T11:37:46.515378+0000","last_clean":"2024-09-14T11:37:46.515378+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:37:46.515378+0000","last_undegraded":"2024-09-14T11:37:46.515378+0000","last_fullsized":"2024-09-14T11:37:46.515378+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:39.716588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44234,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":907,"num_write":328,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596468+0000","last_change":"2024-09-14T10:56:14.859912+0000","last_active":"2024-09-14T11:33:35.596468+0000","last_peered":"2024-09-14T11:33:35.596468+0000","last_clean":"2024-09-14T11:33:35.596468+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:33:35.596468+0000","last_undegraded":"2024-09-14T11:33:35.596468+0000","last_fullsized":"2024-09-14T11:33:35.596468+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:50.590250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'113","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.905145+0000","last_change":"2024-09-14T10:56:16.876189+0000","last_active":"2024-09-14T11:35:54.905145+0000","last_peered":"2024-09-14T11:35:54.905145+0000","last_clean":"2024-09-14T11:35:54.905145+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:35:54.905145+0000","last_undegraded":"2024-09-14T11:35:54.905145+0000","last_fullsized":"2024-09-14T11:35:54.905145+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:08.040744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.724841+0000","last_change":"2024-09-14T10:56:08.846963+0000","last_active":"2024-09-14T11:35:17.724841+0000","last_peered":"2024-09-14T11:35:17.724841+0000","last_clean":"2024-09-14T11:35:17.724841+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:35:17.724841+0000","last_undegraded":"2024-09-14T11:35:17.724841+0000","last_fullsized":"2024-09-14T11:35:17.724841+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:52:44.520201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'324","reported_seq":975,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.986262+0000","last_change":"2024-09-14T10:56:06.832027+0000","last_active":"2024-09-14T11:37:46.986262+0000","last_peered":"2024-09-14T11:37:46.986262+0000","last_clean":"2024-09-14T11:37:46.986262+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:37:46.986262+0000","last_undegraded":"2024-09-14T11:37:46.986262+0000","last_fullsized":"2024-09-14T11:37:46.986262+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:30.367132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":9277,"num_write":976,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:35.596533+0000","last_change":"2024-09-14T10:56:10.846714+0000","last_active":"2024-09-14T11:33:35.596533+0000","last_peered":"2024-09-14T11:33:35.596533+0000","last_clean":"2024-09-14T11:33:35.596533+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:33:35.596533+0000","last_undegraded":"2024-09-14T11:33:35.596533+0000","last_fullsized":"2024-09-14T11:33:35.596533+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:44:14.559729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'57","reported_seq":550,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.293027+0000","last_change":"2024-09-14T10:56:12.851172+0000","last_active":"2024-09-14T11:36:21.293027+0000","last_peered":"2024-09-14T11:36:21.293027+0000","last_clean":"2024-09-14T11:36:21.293027+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:36:21.293027+0000","last_undegraded":"2024-09-14T11:36:21.293027+0000","last_fullsized":"2024-09-14T11:36:21.293027+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:56.828348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883833+0000","last_change":"2024-09-14T10:56:14.869388+0000","last_active":"2024-09-14T11:33:34.883833+0000","last_peered":"2024-09-14T11:33:34.883833+0000","last_clean":"2024-09-14T11:33:34.883833+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:33:34.883833+0000","last_undegraded":"2024-09-14T11:33:34.883833+0000","last_fullsized":"2024-09-14T11:33:34.883833+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:37.817198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.091148+0000","last_change":"2024-09-14T10:56:16.870386+0000","last_active":"2024-09-14T11:35:56.091148+0000","last_peered":"2024-09-14T11:35:56.091148+0000","last_clean":"2024-09-14T11:35:56.091148+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:35:56.091148+0000","last_undegraded":"2024-09-14T11:35:56.091148+0000","last_fullsized":"2024-09-14T11:35:56.091148+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:47.067599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":673,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.083359+0000","last_change":"2024-09-14T10:56:08.846942+0000","last_active":"2024-09-14T11:35:56.083359+0000","last_peered":"2024-09-14T11:35:56.083359+0000","last_clean":"2024-09-14T11:35:56.083359+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:35:56.083359+0000","last_undegraded":"2024-09-14T11:35:56.083359+0000","last_fullsized":"2024-09-14T11:35:56.083359+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:59.799497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'358","reported_seq":993,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.976809+0000","last_change":"2024-09-14T10:56:06.836735+0000","last_active":"2024-09-14T11:37:46.976809+0000","last_peered":"2024-09-14T11:37:46.976809+0000","last_clean":"2024-09-14T11:37:46.976809+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:37:46.976809+0000","last_undegraded":"2024-09-14T11:37:46.976809+0000","last_fullsized":"2024-09-14T11:37:46.976809+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:57.401574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":2982,"num_write":1169,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.883799+0000","last_change":"2024-09-14T10:56:10.850036+0000","last_active":"2024-09-14T11:33:34.883799+0000","last_peered":"2024-09-14T11:33:34.883799+0000","last_clean":"2024-09-14T11:33:34.883799+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:33:34.883799+0000","last_undegraded":"2024-09-14T11:33:34.883799+0000","last_fullsized":"2024-09-14T11:33:34.883799+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:26:00.348764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'308","reported_seq":889,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.117667+0000","last_change":"2024-09-14T10:56:12.856115+0000","last_active":"2024-09-14T11:37:46.117667+0000","last_peered":"2024-09-14T11:37:46.117667+0000","last_clean":"2024-09-14T11:37:46.117667+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:37:46.117667+0000","last_undegraded":"2024-09-14T11:37:46.117667+0000","last_fullsized":"2024-09-14T11:37:46.117667+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:16.373969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1126,"num_write":414,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884434+0000","last_change":"2024-09-14T10:56:14.869461+0000","last_active":"2024-09-14T11:33:34.884434+0000","last_peered":"2024-09-14T11:33:34.884434+0000","last_clean":"2024-09-14T11:33:34.884434+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:33:34.884434+0000","last_undegraded":"2024-09-14T11:33:34.884434+0000","last_fullsized":"2024-09-14T11:33:34.884434+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:55:05.233425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'185","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.325833+0000","last_change":"2024-09-14T10:56:16.875845+0000","last_active":"2024-09-14T11:35:36.325833+0000","last_peered":"2024-09-14T11:35:36.325833+0000","last_clean":"2024-09-14T11:35:36.325833+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:35:36.325833+0000","last_undegraded":"2024-09-14T11:35:36.325833+0000","last_fullsized":"2024-09-14T11:35:36.325833+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:59.857949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":708,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:11.701560+0000","last_change":"2024-09-14T10:56:08.839406+0000","last_active":"2024-09-14T11:34:11.701560+0000","last_peered":"2024-09-14T11:34:11.701560+0000","last_clean":"2024-09-14T11:34:11.701560+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:34:11.701560+0000","last_undegraded":"2024-09-14T11:34:11.701560+0000","last_fullsized":"2024-09-14T11:34:11.701560+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:41.279866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'322","reported_seq":923,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.953754+0000","last_change":"2024-09-14T10:56:06.837904+0000","last_active":"2024-09-14T11:37:46.953754+0000","last_peered":"2024-09-14T11:37:46.953754+0000","last_clean":"2024-09-14T11:37:46.953754+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:37:46.953754+0000","last_undegraded":"2024-09-14T11:37:46.953754+0000","last_fullsized":"2024-09-14T11:37:46.953754+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:12.136843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":4364,"num_write":956,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:34.884386+0000","last_change":"2024-09-14T10:56:10.852317+0000","last_active":"2024-09-14T11:33:34.884386+0000","last_peered":"2024-09-14T11:33:34.884386+0000","last_clean":"2024-09-14T11:33:34.884386+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:33:34.884386+0000","last_undegraded":"2024-09-14T11:33:34.884386+0000","last_fullsized":"2024-09-14T11:33:34.884386+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:16.512220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'263","reported_seq":822,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.004199+0000","last_change":"2024-09-14T10:56:12.848425+0000","last_active":"2024-09-14T11:37:46.004199+0000","last_peered":"2024-09-14T11:37:46.004199+0000","last_clean":"2024-09-14T11:37:46.004199+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:37:46.004199+0000","last_undegraded":"2024-09-14T11:37:46.004199+0000","last_fullsized":"2024-09-14T11:37:46.004199+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:36:32.326263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":429,"num_read_kb":979,"num_write":348,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750839+0000","last_change":"2024-09-14T10:56:14.863993+0000","last_active":"2024-09-14T11:33:38.750839+0000","last_peered":"2024-09-14T11:33:38.750839+0000","last_clean":"2024-09-14T11:33:38.750839+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:33:38.750839+0000","last_undegraded":"2024-09-14T11:33:38.750839+0000","last_fullsized":"2024-09-14T11:33:38.750839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:28.114909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:44.902265+0000","last_change":"2024-09-14T10:56:08.840371+0000","last_active":"2024-09-14T11:35:44.902265+0000","last_peered":"2024-09-14T11:35:44.902265+0000","last_clean":"2024-09-14T11:35:44.902265+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:35:44.902265+0000","last_undegraded":"2024-09-14T11:35:44.902265+0000","last_fullsized":"2024-09-14T11:35:44.902265+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:18:29.567385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'313","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.988323+0000","last_change":"2024-09-14T10:56:06.829430+0000","last_active":"2024-09-14T11:37:46.988323+0000","last_peered":"2024-09-14T11:37:46.988323+0000","last_clean":"2024-09-14T11:37:46.988323+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:37:46.988323+0000","last_undegraded":"2024-09-14T11:37:46.988323+0000","last_fullsized":"2024-09-14T11:37:46.988323+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:54.337485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":11665,"num_write":969,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756814+0000","last_change":"2024-09-14T10:56:10.845758+0000","last_active":"2024-09-14T11:34:23.756814+0000","last_peered":"2024-09-14T11:34:23.756814+0000","last_clean":"2024-09-14T11:34:23.756814+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:34:23.756814+0000","last_undegraded":"2024-09-14T11:34:23.756814+0000","last_fullsized":"2024-09-14T11:34:23.756814+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:05:50.038546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'479","reported_seq":1102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.747954+0000","last_change":"2024-09-14T10:56:12.857013+0000","last_active":"2024-09-14T11:37:46.747954+0000","last_peered":"2024-09-14T11:37:46.747954+0000","last_clean":"2024-09-14T11:37:46.747954+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:37:46.747954+0000","last_undegraded":"2024-09-14T11:37:46.747954+0000","last_fullsized":"2024-09-14T11:37:46.747954+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":400,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192423,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":855,"num_read_kb":2213,"num_write":738,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868166+0000","last_change":"2024-09-14T10:56:14.866608+0000","last_active":"2024-09-14T11:33:47.868166+0000","last_peered":"2024-09-14T11:33:47.868166+0000","last_clean":"2024-09-14T11:33:47.868166+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:33:47.868166+0000","last_undegraded":"2024-09-14T11:33:47.868166+0000","last_fullsized":"2024-09-14T11:33:47.868166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:07.568392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'180","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.637830+0000","last_change":"2024-09-14T10:56:16.877816+0000","last_active":"2024-09-14T11:35:56.637830+0000","last_peered":"2024-09-14T11:35:56.637830+0000","last_clean":"2024-09-14T11:35:56.637830+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:35:56.637830+0000","last_undegraded":"2024-09-14T11:35:56.637830+0000","last_fullsized":"2024-09-14T11:35:56.637830+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.287323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1018,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.254239+0000","last_change":"2024-09-14T10:56:08.843523+0000","last_active":"2024-09-14T11:34:54.254239+0000","last_peered":"2024-09-14T11:34:54.254239+0000","last_clean":"2024-09-14T11:34:54.254239+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:34:54.254239+0000","last_undegraded":"2024-09-14T11:34:54.254239+0000","last_fullsized":"2024-09-14T11:34:54.254239+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:16.988838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'325","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.892563+0000","last_change":"2024-09-14T10:56:06.824700+0000","last_active":"2024-09-14T11:37:46.892563+0000","last_peered":"2024-09-14T11:37:46.892563+0000","last_clean":"2024-09-14T11:37:46.892563+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:46.892563+0000","last_undegraded":"2024-09-14T11:37:46.892563+0000","last_fullsized":"2024-09-14T11:37:46.892563+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:30.572275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":3066,"num_write":996,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885912+0000","last_change":"2024-09-14T10:56:10.851611+0000","last_active":"2024-09-14T11:33:44.885912+0000","last_peered":"2024-09-14T11:33:44.885912+0000","last_clean":"2024-09-14T11:33:44.885912+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:33:44.885912+0000","last_undegraded":"2024-09-14T11:33:44.885912+0000","last_fullsized":"2024-09-14T11:33:44.885912+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.503933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'336","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.045249+0000","last_change":"2024-09-14T10:56:12.850684+0000","last_active":"2024-09-14T11:37:46.045249+0000","last_peered":"2024-09-14T11:37:46.045249+0000","last_clean":"2024-09-14T11:37:46.045249+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:37:46.045249+0000","last_undegraded":"2024-09-14T11:37:46.045249+0000","last_fullsized":"2024-09-14T11:37:46.045249+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.655979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":556,"num_read_kb":1258,"num_write":472,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.864958+0000","last_change":"2024-09-14T10:56:14.863516+0000","last_active":"2024-09-14T11:33:48.864958+0000","last_peered":"2024-09-14T11:33:48.864958+0000","last_clean":"2024-09-14T11:33:48.864958+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:33:48.864958+0000","last_undegraded":"2024-09-14T11:33:48.864958+0000","last_fullsized":"2024-09-14T11:33:48.864958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.527433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.073475+0000","last_change":"2024-09-14T10:56:16.873262+0000","last_active":"2024-09-14T11:35:27.073475+0000","last_peered":"2024-09-14T11:35:27.073475+0000","last_clean":"2024-09-14T11:35:27.073475+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:35:27.073475+0000","last_undegraded":"2024-09-14T11:35:27.073475+0000","last_fullsized":"2024-09-14T11:35:27.073475+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:21.859002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":919,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.926778+0000","last_change":"2024-09-14T10:56:08.841022+0000","last_active":"2024-09-14T11:35:23.926778+0000","last_peered":"2024-09-14T11:35:23.926778+0000","last_clean":"2024-09-14T11:35:23.926778+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:35:23.926778+0000","last_undegraded":"2024-09-14T11:35:23.926778+0000","last_fullsized":"2024-09-14T11:35:23.926778+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:11.924992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'365","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.944864+0000","last_change":"2024-09-14T10:56:06.831161+0000","last_active":"2024-09-14T11:37:46.944864+0000","last_peered":"2024-09-14T11:37:46.944864+0000","last_clean":"2024-09-14T11:37:46.944864+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:37:46.944864+0000","last_undegraded":"2024-09-14T11:37:46.944864+0000","last_fullsized":"2024-09-14T11:37:46.944864+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:18:43.805445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":69620,"num_write":1137,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886067+0000","last_change":"2024-09-14T10:56:10.848128+0000","last_active":"2024-09-14T11:33:44.886067+0000","last_peered":"2024-09-14T11:33:44.886067+0000","last_clean":"2024-09-14T11:33:44.886067+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:33:44.886067+0000","last_undegraded":"2024-09-14T11:33:44.886067+0000","last_fullsized":"2024-09-14T11:33:44.886067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:51.970572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'270","reported_seq":837,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.679227+0000","last_change":"2024-09-14T10:56:13.041394+0000","last_active":"2024-09-14T11:37:46.679227+0000","last_peered":"2024-09-14T11:37:46.679227+0000","last_clean":"2024-09-14T11:37:46.679227+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:37:46.679227+0000","last_undegraded":"2024-09-14T11:37:46.679227+0000","last_fullsized":"2024-09-14T11:37:46.679227+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:28:59.408531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52342,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1065,"num_write":374,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757802+0000","last_change":"2024-09-14T10:56:14.862660+0000","last_active":"2024-09-14T11:34:28.757802+0000","last_peered":"2024-09-14T11:34:28.757802+0000","last_clean":"2024-09-14T11:34:28.757802+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:34:28.757802+0000","last_undegraded":"2024-09-14T11:34:28.757802+0000","last_fullsized":"2024-09-14T11:34:28.757802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:53.685139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'113","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.629869+0000","last_change":"2024-09-14T10:56:16.874807+0000","last_active":"2024-09-14T11:37:14.629869+0000","last_peered":"2024-09-14T11:37:14.629869+0000","last_clean":"2024-09-14T11:37:14.629869+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:37:14.629869+0000","last_undegraded":"2024-09-14T11:37:14.629869+0000","last_fullsized":"2024-09-14T11:37:14.629869+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:23.768244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":571,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:16.865069+0000","last_change":"2024-09-14T10:56:08.842580+0000","last_active":"2024-09-14T11:35:16.865069+0000","last_peered":"2024-09-14T11:35:16.865069+0000","last_clean":"2024-09-14T11:35:16.865069+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:35:16.865069+0000","last_undegraded":"2024-09-14T11:35:16.865069+0000","last_fullsized":"2024-09-14T11:35:16.865069+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:07:35.801906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'348","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.993593+0000","last_change":"2024-09-14T10:56:06.834528+0000","last_active":"2024-09-14T11:37:46.993593+0000","last_peered":"2024-09-14T11:37:46.993593+0000","last_clean":"2024-09-14T11:37:46.993593+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:37:46.993593+0000","last_undegraded":"2024-09-14T11:37:46.993593+0000","last_fullsized":"2024-09-14T11:37:46.993593+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:09.265221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":33947,"num_write":1155,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.864422+0000","last_change":"2024-09-14T10:56:10.849432+0000","last_active":"2024-09-14T11:33:43.864422+0000","last_peered":"2024-09-14T11:33:43.864422+0000","last_clean":"2024-09-14T11:33:43.864422+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:33:43.864422+0000","last_undegraded":"2024-09-14T11:33:43.864422+0000","last_fullsized":"2024-09-14T11:33:43.864422+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:43.219622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.472266+0000","last_change":"2024-09-14T10:56:13.041708+0000","last_active":"2024-09-14T11:36:21.472266+0000","last_peered":"2024-09-14T11:36:21.472266+0000","last_clean":"2024-09-14T11:36:21.472266+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:36:21.472266+0000","last_undegraded":"2024-09-14T11:36:21.472266+0000","last_fullsized":"2024-09-14T11:36:21.472266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:44.179299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'754","reported_seq":4577,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.789773+0000","last_change":"2024-09-14T10:56:14.869079+0000","last_active":"2024-09-14T11:37:45.789773+0000","last_peered":"2024-09-14T11:37:45.789773+0000","last_clean":"2024-09-14T11:37:45.789773+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:37:45.789773+0000","last_undegraded":"2024-09-14T11:37:45.789773+0000","last_fullsized":"2024-09-14T11:37:45.789773+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:27.442791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'126","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.897308+0000","last_change":"2024-09-14T10:56:16.877187+0000","last_active":"2024-09-14T11:35:19.897308+0000","last_peered":"2024-09-14T11:35:19.897308+0000","last_clean":"2024-09-14T11:35:19.897308+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:35:19.897308+0000","last_undegraded":"2024-09-14T11:35:19.897308+0000","last_fullsized":"2024-09-14T11:35:19.897308+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:51.016753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":640,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.586731+0000","last_change":"2024-09-14T10:56:08.839500+0000","last_active":"2024-09-14T11:34:57.586731+0000","last_peered":"2024-09-14T11:34:57.586731+0000","last_clean":"2024-09-14T11:34:57.586731+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:34:57.586731+0000","last_undegraded":"2024-09-14T11:34:57.586731+0000","last_fullsized":"2024-09-14T11:34:57.586731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:09:48.706046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'351","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.957447+0000","last_change":"2024-09-14T10:56:06.836000+0000","last_active":"2024-09-14T11:37:46.957447+0000","last_peered":"2024-09-14T11:37:46.957447+0000","last_clean":"2024-09-14T11:37:46.957447+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:37:46.957447+0000","last_undegraded":"2024-09-14T11:37:46.957447+0000","last_fullsized":"2024-09-14T11:37:46.957447+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:48:46.759478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":780,"num_read_kb":7716,"num_write":1096,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885243+0000","last_change":"2024-09-14T10:56:10.851020+0000","last_active":"2024-09-14T11:33:44.885243+0000","last_peered":"2024-09-14T11:33:44.885243+0000","last_clean":"2024-09-14T11:33:44.885243+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:33:44.885243+0000","last_undegraded":"2024-09-14T11:33:44.885243+0000","last_fullsized":"2024-09-14T11:33:44.885243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:54.621932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'321","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.899850+0000","last_change":"2024-09-14T10:56:12.853222+0000","last_active":"2024-09-14T11:37:46.899850+0000","last_peered":"2024-09-14T11:37:46.899850+0000","last_clean":"2024-09-14T11:37:46.899850+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:37:46.899850+0000","last_undegraded":"2024-09-14T11:37:46.899850+0000","last_fullsized":"2024-09-14T11:37:46.899850+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1178,"num_write":428,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761752+0000","last_change":"2024-09-14T10:56:14.869597+0000","last_active":"2024-09-14T11:34:58.761752+0000","last_peered":"2024-09-14T11:34:58.761752+0000","last_clean":"2024-09-14T11:34:58.761752+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:34:58.761752+0000","last_undegraded":"2024-09-14T11:34:58.761752+0000","last_fullsized":"2024-09-14T11:34:58.761752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:57.846436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.460581+0000","last_change":"2024-09-14T10:56:16.872084+0000","last_active":"2024-09-14T11:37:13.460581+0000","last_peered":"2024-09-14T11:37:13.460581+0000","last_clean":"2024-09-14T11:37:13.460581+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:37:13.460581+0000","last_undegraded":"2024-09-14T11:37:13.460581+0000","last_fullsized":"2024-09-14T11:37:13.460581+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:09.391213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":753,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:25.819430+0000","last_change":"2024-09-14T10:56:41.920664+0000","last_active":"2024-09-14T11:35:25.819430+0000","last_peered":"2024-09-14T11:35:25.819430+0000","last_clean":"2024-09-14T11:35:25.819430+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:35:25.819430+0000","last_undegraded":"2024-09-14T11:35:25.819430+0000","last_fullsized":"2024-09-14T11:35:25.819430+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:59:56.080586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'330","reported_seq":929,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.960255+0000","last_change":"2024-09-14T10:56:06.829850+0000","last_active":"2024-09-14T11:37:46.960255+0000","last_peered":"2024-09-14T11:37:46.960255+0000","last_clean":"2024-09-14T11:37:46.960255+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:37:46.960255+0000","last_undegraded":"2024-09-14T11:37:46.960255+0000","last_fullsized":"2024-09-14T11:37:46.960255+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:46.872929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":36817,"num_write":973,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:42.867186+0000","last_change":"2024-09-14T10:56:10.846542+0000","last_active":"2024-09-14T11:33:42.867186+0000","last_peered":"2024-09-14T11:33:42.867186+0000","last_clean":"2024-09-14T11:33:42.867186+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:33:42.867186+0000","last_undegraded":"2024-09-14T11:33:42.867186+0000","last_fullsized":"2024-09-14T11:33:42.867186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.655261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'283","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.935397+0000","last_change":"2024-09-14T10:56:12.854064+0000","last_active":"2024-09-14T11:37:46.935397+0000","last_peered":"2024-09-14T11:37:46.935397+0000","last_clean":"2024-09-14T11:37:46.935397+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:37:46.935397+0000","last_undegraded":"2024-09-14T11:37:46.935397+0000","last_fullsized":"2024-09-14T11:37:46.935397+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.267552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43010,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":1018,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895529+0000","last_change":"2024-09-14T10:56:14.866692+0000","last_active":"2024-09-14T11:34:59.895529+0000","last_peered":"2024-09-14T11:34:59.895529+0000","last_clean":"2024-09-14T11:34:59.895529+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:34:59.895529+0000","last_undegraded":"2024-09-14T11:34:59.895529+0000","last_fullsized":"2024-09-14T11:34:59.895529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:02.219332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'151","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.062796+0000","last_change":"2024-09-14T10:56:16.877739+0000","last_active":"2024-09-14T11:35:54.062796+0000","last_peered":"2024-09-14T11:35:54.062796+0000","last_clean":"2024-09-14T11:35:54.062796+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:35:54.062796+0000","last_undegraded":"2024-09-14T11:35:54.062796+0000","last_fullsized":"2024-09-14T11:35:54.062796+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:45.768007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'125","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607195+0000","last_change":"2024-09-14T10:56:08.838852+0000","last_active":"2024-09-14T11:34:55.607195+0000","last_peered":"2024-09-14T11:34:55.607195+0000","last_clean":"2024-09-14T11:34:55.607195+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:34:55.607195+0000","last_undegraded":"2024-09-14T11:34:55.607195+0000","last_fullsized":"2024-09-14T11:34:55.607195+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:02:23.082263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'370","reported_seq":992,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.912756+0000","last_change":"2024-09-14T10:56:06.830822+0000","last_active":"2024-09-14T11:37:46.912756+0000","last_peered":"2024-09-14T11:37:46.912756+0000","last_clean":"2024-09-14T11:37:46.912756+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:37:46.912756+0000","last_undegraded":"2024-09-14T11:37:46.912756+0000","last_fullsized":"2024-09-14T11:37:46.912756+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":300,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:50:26.425490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":618,"num_read_kb":16528,"num_write":1305,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895271+0000","last_change":"2024-09-14T10:56:10.849183+0000","last_active":"2024-09-14T11:34:54.895271+0000","last_peered":"2024-09-14T11:34:54.895271+0000","last_clean":"2024-09-14T11:34:54.895271+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:34:54.895271+0000","last_undegraded":"2024-09-14T11:34:54.895271+0000","last_fullsized":"2024-09-14T11:34:54.895271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:41.598284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'270","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.610692+0000","last_change":"2024-09-14T10:56:12.853468+0000","last_active":"2024-09-14T11:37:46.610692+0000","last_peered":"2024-09-14T11:37:46.610692+0000","last_clean":"2024-09-14T11:37:46.610692+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:37:46.610692+0000","last_undegraded":"2024-09-14T11:37:46.610692+0000","last_fullsized":"2024-09-14T11:37:46.610692+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:48.351559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51357,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":1141,"num_write":384,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886032+0000","last_change":"2024-09-14T10:56:14.870248+0000","last_active":"2024-09-14T11:33:44.886032+0000","last_peered":"2024-09-14T11:33:44.886032+0000","last_clean":"2024-09-14T11:33:44.886032+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:33:44.886032+0000","last_undegraded":"2024-09-14T11:33:44.886032+0000","last_fullsized":"2024-09-14T11:33:44.886032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.097159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'174","reported_seq":1634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.097709+0000","last_change":"2024-09-14T10:56:16.874279+0000","last_active":"2024-09-14T11:35:56.097709+0000","last_peered":"2024-09-14T11:35:56.097709+0000","last_clean":"2024-09-14T11:35:56.097709+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:35:56.097709+0000","last_undegraded":"2024-09-14T11:35:56.097709+0000","last_fullsized":"2024-09-14T11:35:56.097709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:13.650009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.042909+0000","last_change":"2024-09-14T10:56:08.843487+0000","last_active":"2024-09-14T11:35:31.042909+0000","last_peered":"2024-09-14T11:35:31.042909+0000","last_clean":"2024-09-14T11:35:31.042909+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:35:31.042909+0000","last_undegraded":"2024-09-14T11:35:31.042909+0000","last_fullsized":"2024-09-14T11:35:31.042909+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:22:16.895665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'359","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.997321+0000","last_change":"2024-09-14T10:56:41.921531+0000","last_active":"2024-09-14T11:37:46.997321+0000","last_peered":"2024-09-14T11:37:46.997321+0000","last_clean":"2024-09-14T11:37:46.997321+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:37:46.997321+0000","last_undegraded":"2024-09-14T11:37:46.997321+0000","last_fullsized":"2024-09-14T11:37:46.997321+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:51.807850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":662,"num_read_kb":13580,"num_write":1124,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"28'1","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762455+0000","last_change":"2024-09-14T10:56:10.850525+0000","last_active":"2024-09-14T11:35:03.762455+0000","last_peered":"2024-09-14T11:35:03.762455+0000","last_clean":"2024-09-14T11:35:03.762455+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:35:03.762455+0000","last_undegraded":"2024-09-14T11:35:03.762455+0000","last_fullsized":"2024-09-14T11:35:03.762455+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:35.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'281","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.712972+0000","last_change":"2024-09-14T10:56:12.850877+0000","last_active":"2024-09-14T11:37:46.712972+0000","last_peered":"2024-09-14T11:37:46.712972+0000","last_clean":"2024-09-14T11:37:46.712972+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:37:46.712972+0000","last_undegraded":"2024-09-14T11:37:46.712972+0000","last_fullsized":"2024-09-14T11:37:46.712972+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:39.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":1053,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752208+0000","last_change":"2024-09-14T10:56:14.864169+0000","last_active":"2024-09-14T11:33:48.752208+0000","last_peered":"2024-09-14T11:33:48.752208+0000","last_clean":"2024-09-14T11:33:48.752208+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:33:48.752208+0000","last_undegraded":"2024-09-14T11:33:48.752208+0000","last_fullsized":"2024-09-14T11:33:48.752208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:15.470147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.456829+0000","last_change":"2024-09-14T10:56:16.872566+0000","last_active":"2024-09-14T11:37:13.456829+0000","last_peered":"2024-09-14T11:37:13.456829+0000","last_clean":"2024-09-14T11:37:13.456829+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:37:13.456829+0000","last_undegraded":"2024-09-14T11:37:13.456829+0000","last_fullsized":"2024-09-14T11:37:13.456829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:34.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763120+0000","last_change":"2024-09-14T10:56:08.840955+0000","last_active":"2024-09-14T11:35:08.763120+0000","last_peered":"2024-09-14T11:35:08.763120+0000","last_clean":"2024-09-14T11:35:08.763120+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:35:08.763120+0000","last_undegraded":"2024-09-14T11:35:08.763120+0000","last_fullsized":"2024-09-14T11:35:08.763120+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:09.823863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'373","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.997436+0000","last_change":"2024-09-14T10:56:06.833785+0000","last_active":"2024-09-14T11:37:46.997436+0000","last_peered":"2024-09-14T11:37:46.997436+0000","last_clean":"2024-09-14T11:37:46.997436+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:37:46.997436+0000","last_undegraded":"2024-09-14T11:37:46.997436+0000","last_fullsized":"2024-09-14T11:37:46.997436+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:27.562038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":8663,"num_write":1069,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763097+0000","last_change":"2024-09-14T10:56:08.850785+0000","last_active":"2024-09-14T11:35:08.763097+0000","last_peered":"2024-09-14T11:35:08.763097+0000","last_clean":"2024-09-14T11:35:08.763097+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:35:08.763097+0000","last_undegraded":"2024-09-14T11:35:08.763097+0000","last_fullsized":"2024-09-14T11:35:08.763097+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:01.420868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'443","reported_seq":1107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.994779+0000","last_change":"2024-09-14T10:56:06.822844+0000","last_active":"2024-09-14T11:37:46.994779+0000","last_peered":"2024-09-14T11:37:46.994779+0000","last_clean":"2024-09-14T11:37:46.994779+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:37:46.994779+0000","last_undegraded":"2024-09-14T11:37:46.994779+0000","last_fullsized":"2024-09-14T11:37:46.994779+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":400,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:55:18.961383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":16320,"num_write":1497,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":723,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880525+0000","last_change":"2024-09-14T10:56:08.848489+0000","last_active":"2024-09-14T11:35:12.880525+0000","last_peered":"2024-09-14T11:35:12.880525+0000","last_clean":"2024-09-14T11:35:12.880525+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:35:12.880525+0000","last_undegraded":"2024-09-14T11:35:12.880525+0000","last_fullsized":"2024-09-14T11:35:12.880525+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:04:03.708119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'301","reported_seq":921,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.942893+0000","last_change":"2024-09-14T10:56:06.827629+0000","last_active":"2024-09-14T11:37:46.942893+0000","last_peered":"2024-09-14T11:37:46.942893+0000","last_clean":"2024-09-14T11:37:46.942893+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:37:46.942893+0000","last_undegraded":"2024-09-14T11:37:46.942893+0000","last_fullsized":"2024-09-14T11:37:46.942893+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:56.559924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":2695,"num_write":898,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":746,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763055+0000","last_change":"2024-09-14T10:56:08.845334+0000","last_active":"2024-09-14T11:35:08.763055+0000","last_peered":"2024-09-14T11:35:08.763055+0000","last_clean":"2024-09-14T11:35:08.763055+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:35:08.763055+0000","last_undegraded":"2024-09-14T11:35:08.763055+0000","last_fullsized":"2024-09-14T11:35:08.763055+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:15.382649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'351","reported_seq":1052,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.951892+0000","last_change":"2024-09-14T10:56:41.922043+0000","last_active":"2024-09-14T11:37:46.951892+0000","last_peered":"2024-09-14T11:37:46.951892+0000","last_clean":"2024-09-14T11:37:46.951892+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:37:46.951892+0000","last_undegraded":"2024-09-14T11:37:46.951892+0000","last_fullsized":"2024-09-14T11:37:46.951892+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":300,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:53.350669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":27796,"num_write":1160,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.498343+0000","last_change":"2024-09-14T10:56:08.847845+0000","last_active":"2024-09-14T11:35:38.498343+0000","last_peered":"2024-09-14T11:35:38.498343+0000","last_clean":"2024-09-14T11:35:38.498343+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:35:38.498343+0000","last_undegraded":"2024-09-14T11:35:38.498343+0000","last_fullsized":"2024-09-14T11:35:38.498343+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:22.522568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'438","reported_seq":1211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.984690+0000","last_change":"2024-09-14T10:56:06.833611+0000","last_active":"2024-09-14T11:37:46.984690+0000","last_peered":"2024-09-14T11:37:46.984690+0000","last_clean":"2024-09-14T11:37:46.984690+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:37:46.984690+0000","last_undegraded":"2024-09-14T11:37:46.984690+0000","last_fullsized":"2024-09-14T11:37:46.984690+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":400,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:09.355774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1409,"num_read_kb":14785,"num_write":1267,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:44.902653+0000","last_change":"2024-09-14T10:56:08.844274+0000","last_active":"2024-09-14T11:35:44.902653+0000","last_peered":"2024-09-14T11:35:44.902653+0000","last_clean":"2024-09-14T11:35:44.902653+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:35:44.902653+0000","last_undegraded":"2024-09-14T11:35:44.902653+0000","last_fullsized":"2024-09-14T11:35:44.902653+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:31:07.843122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'417","reported_seq":1081,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.946047+0000","last_change":"2024-09-14T10:56:06.822860+0000","last_active":"2024-09-14T11:37:46.946047+0000","last_peered":"2024-09-14T11:37:46.946047+0000","last_clean":"2024-09-14T11:37:46.946047+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:37:46.946047+0000","last_undegraded":"2024-09-14T11:37:46.946047+0000","last_fullsized":"2024-09-14T11:37:46.946047+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":400,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:33.951896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":745,"num_read_kb":54735,"num_write":1248,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:45.613218+0000","last_change":"2024-09-14T10:56:08.842881+0000","last_active":"2024-09-14T11:35:45.613218+0000","last_peered":"2024-09-14T11:35:45.613218+0000","last_clean":"2024-09-14T11:35:45.613218+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:35:45.613218+0000","last_undegraded":"2024-09-14T11:35:45.613218+0000","last_fullsized":"2024-09-14T11:35:45.613218+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:51:22.148598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'423","reported_seq":1198,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.931580+0000","last_change":"2024-09-14T10:56:06.832770+0000","last_active":"2024-09-14T11:37:46.931580+0000","last_peered":"2024-09-14T11:37:46.931580+0000","last_clean":"2024-09-14T11:37:46.931580+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:37:46.931580+0000","last_undegraded":"2024-09-14T11:37:46.931580+0000","last_fullsized":"2024-09-14T11:37:46.931580+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:27:20.311265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1142,"num_read_kb":46426,"num_write":1473,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'302","reported_seq":933,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:44.902197+0000","last_change":"2024-09-14T10:56:08.846123+0000","last_active":"2024-09-14T11:35:44.902197+0000","last_peered":"2024-09-14T11:35:44.902197+0000","last_clean":"2024-09-14T11:35:44.902197+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:35:44.902197+0000","last_undegraded":"2024-09-14T11:35:44.902197+0000","last_fullsized":"2024-09-14T11:35:44.902197+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:53.557283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'320","reported_seq":916,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.996087+0000","last_change":"2024-09-14T10:56:06.834641+0000","last_active":"2024-09-14T11:37:46.996087+0000","last_peered":"2024-09-14T11:37:46.996087+0000","last_clean":"2024-09-14T11:37:46.996087+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:37:46.996087+0000","last_undegraded":"2024-09-14T11:37:46.996087+0000","last_fullsized":"2024-09-14T11:37:46.996087+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":300,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:50.416149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":5718,"num_write":986,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.559561+0000","last_change":"2024-09-14T10:56:08.835412+0000","last_active":"2024-09-14T11:35:18.559561+0000","last_peered":"2024-09-14T11:35:18.559561+0000","last_clean":"2024-09-14T11:35:18.559561+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:35:18.559561+0000","last_undegraded":"2024-09-14T11:35:18.559561+0000","last_fullsized":"2024-09-14T11:35:18.559561+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:49.723578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'373","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.988658+0000","last_change":"2024-09-14T10:56:06.829591+0000","last_active":"2024-09-14T11:37:46.988658+0000","last_peered":"2024-09-14T11:37:46.988658+0000","last_clean":"2024-09-14T11:37:46.988658+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:37:46.988658+0000","last_undegraded":"2024-09-14T11:37:46.988658+0000","last_fullsized":"2024-09-14T11:37:46.988658+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":300,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:39.846865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":8094,"num_write":1138,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":811,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:29.883767+0000","last_change":"2024-09-14T10:56:08.842404+0000","last_active":"2024-09-14T11:33:29.883767+0000","last_peered":"2024-09-14T11:33:29.883767+0000","last_clean":"2024-09-14T11:33:29.883767+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:33:29.883767+0000","last_undegraded":"2024-09-14T11:33:29.883767+0000","last_fullsized":"2024-09-14T11:33:29.883767+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:20.506202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'359","reported_seq":1008,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.990404+0000","last_change":"2024-09-14T10:56:06.834541+0000","last_active":"2024-09-14T11:37:46.990404+0000","last_peered":"2024-09-14T11:37:46.990404+0000","last_clean":"2024-09-14T11:37:46.990404+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:37:46.990404+0000","last_undegraded":"2024-09-14T11:37:46.990404+0000","last_fullsized":"2024-09-14T11:37:46.990404+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:09:07.196281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1962460,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":52898,"num_write":1154,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":783,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.861201+0000","last_change":"2024-09-14T10:56:08.841270+0000","last_active":"2024-09-14T11:34:29.861201+0000","last_peered":"2024-09-14T11:34:29.861201+0000","last_clean":"2024-09-14T11:34:29.861201+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:34:29.861201+0000","last_undegraded":"2024-09-14T11:34:29.861201+0000","last_fullsized":"2024-09-14T11:34:29.861201+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:35:43.163716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'365","reported_seq":1231,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.988600+0000","last_change":"2024-09-14T10:56:06.835991+0000","last_active":"2024-09-14T11:37:46.988600+0000","last_peered":"2024-09-14T11:37:46.988600+0000","last_clean":"2024-09-14T11:37:46.988600+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:37:46.988600+0000","last_undegraded":"2024-09-14T11:37:46.988600+0000","last_fullsized":"2024-09-14T11:37:46.988600+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:41:00.421199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":34715,"num_write":1227,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.891061+0000","last_change":"2024-09-14T10:56:08.843794+0000","last_active":"2024-09-14T11:34:24.891061+0000","last_peered":"2024-09-14T11:34:24.891061+0000","last_clean":"2024-09-14T11:34:24.891061+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:34:24.891061+0000","last_undegraded":"2024-09-14T11:34:24.891061+0000","last_fullsized":"2024-09-14T11:34:24.891061+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:55.919014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'390","reported_seq":1019,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.969711+0000","last_change":"2024-09-14T10:56:06.833787+0000","last_active":"2024-09-14T11:37:46.969711+0000","last_peered":"2024-09-14T11:37:46.969711+0000","last_clean":"2024-09-14T11:37:46.969711+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:37:46.969711+0000","last_undegraded":"2024-09-14T11:37:46.969711+0000","last_fullsized":"2024-09-14T11:37:46.969711+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":300,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:39:15.576376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":11879,"num_write":1239,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":888,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.890453+0000","last_change":"2024-09-14T10:56:08.848886+0000","last_active":"2024-09-14T11:34:24.890453+0000","last_peered":"2024-09-14T11:34:24.890453+0000","last_clean":"2024-09-14T11:34:24.890453+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:34:24.890453+0000","last_undegraded":"2024-09-14T11:34:24.890453+0000","last_fullsized":"2024-09-14T11:34:24.890453+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:04.538771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'398","reported_seq":1137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.980173+0000","last_change":"2024-09-14T10:56:06.832377+0000","last_active":"2024-09-14T11:37:46.980173+0000","last_peered":"2024-09-14T11:37:46.980173+0000","last_clean":"2024-09-14T11:37:46.980173+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:37:46.980173+0000","last_undegraded":"2024-09-14T11:37:46.980173+0000","last_fullsized":"2024-09-14T11:37:46.980173+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:58.015169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":733,"num_read_kb":26249,"num_write":1207,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":752,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:51.228206+0000","last_change":"2024-09-14T10:56:08.839416+0000","last_active":"2024-09-14T11:34:51.228206+0000","last_peered":"2024-09-14T11:34:51.228206+0000","last_clean":"2024-09-14T11:34:51.228206+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:34:51.228206+0000","last_undegraded":"2024-09-14T11:34:51.228206+0000","last_fullsized":"2024-09-14T11:34:51.228206+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:07.079656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'364","reported_seq":1012,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.979744+0000","last_change":"2024-09-14T10:56:06.830987+0000","last_active":"2024-09-14T11:37:46.979744+0000","last_peered":"2024-09-14T11:37:46.979744+0000","last_clean":"2024-09-14T11:37:46.979744+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:37:46.979744+0000","last_undegraded":"2024-09-14T11:37:46.979744+0000","last_fullsized":"2024-09-14T11:37:46.979744+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:29.841639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":666,"num_read_kb":46769,"num_write":1234,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":674,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.481366+0000","last_change":"2024-09-14T10:56:08.833880+0000","last_active":"2024-09-14T11:35:14.481366+0000","last_peered":"2024-09-14T11:35:14.481366+0000","last_clean":"2024-09-14T11:35:14.481366+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:35:14.481366+0000","last_undegraded":"2024-09-14T11:35:14.481366+0000","last_fullsized":"2024-09-14T11:35:14.481366+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:08:42.906752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'365","reported_seq":1020,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.967411+0000","last_change":"2024-09-14T10:56:06.832512+0000","last_active":"2024-09-14T11:37:46.967411+0000","last_peered":"2024-09-14T11:37:46.967411+0000","last_clean":"2024-09-14T11:37:46.967411+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:37:46.967411+0000","last_undegraded":"2024-09-14T11:37:46.967411+0000","last_fullsized":"2024-09-14T11:37:46.967411+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:38:46.172444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":4323,"num_write":1184,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898132+0000","last_change":"2024-09-14T10:56:08.852010+0000","last_active":"2024-09-14T11:35:14.898132+0000","last_peered":"2024-09-14T11:35:14.898132+0000","last_clean":"2024-09-14T11:35:14.898132+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:35:14.898132+0000","last_undegraded":"2024-09-14T11:35:14.898132+0000","last_fullsized":"2024-09-14T11:35:14.898132+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:07.513514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'300","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.876919+0000","last_change":"2024-09-14T10:56:06.835010+0000","last_active":"2024-09-14T11:37:46.876919+0000","last_peered":"2024-09-14T11:37:46.876919+0000","last_clean":"2024-09-14T11:37:46.876919+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:37:46.876919+0000","last_undegraded":"2024-09-14T11:37:46.876919+0000","last_fullsized":"2024-09-14T11:37:46.876919+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":200,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:42.832634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655902,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":2905,"num_write":1051,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'363","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.954073+0000","last_change":"2024-09-14T10:56:41.921185+0000","last_active":"2024-09-14T11:37:46.954073+0000","last_peered":"2024-09-14T11:37:46.954073+0000","last_clean":"2024-09-14T11:37:46.954073+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:37:46.954073+0000","last_undegraded":"2024-09-14T11:37:46.954073+0000","last_fullsized":"2024-09-14T11:37:46.954073+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:30.911309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":610,"num_read_kb":51615,"num_write":1215,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761881+0000","last_change":"2024-09-14T10:56:08.837369+0000","last_active":"2024-09-14T11:34:58.761881+0000","last_peered":"2024-09-14T11:34:58.761881+0000","last_clean":"2024-09-14T11:34:58.761881+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:34:58.761881+0000","last_undegraded":"2024-09-14T11:34:58.761881+0000","last_fullsized":"2024-09-14T11:34:58.761881+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:01:04.841203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'347","reported_seq":973,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.955628+0000","last_change":"2024-09-14T10:56:06.832783+0000","last_active":"2024-09-14T11:37:46.955628+0000","last_peered":"2024-09-14T11:37:46.955628+0000","last_clean":"2024-09-14T11:37:46.955628+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:37:46.955628+0000","last_undegraded":"2024-09-14T11:37:46.955628+0000","last_fullsized":"2024-09-14T11:37:46.955628+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:05.801505+0000","last_clean_scrub_stamp":"2024-09-14T10:56:05.801505+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":300,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:56:18.334532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":18767,"num_write":1102,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":729,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877349+0000","last_change":"2024-09-14T10:56:08.841261+0000","last_active":"2024-09-14T11:34:52.877349+0000","last_peered":"2024-09-14T11:34:52.877349+0000","last_clean":"2024-09-14T11:34:52.877349+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:34:52.877349+0000","last_undegraded":"2024-09-14T11:34:52.877349+0000","last_fullsized":"2024-09-14T11:34:52.877349+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:10.975942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1684,"ondisk_log_size":1684,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1610275,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17487,"num_read_kb":37004,"num_write":14657,"num_write_kb":11695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2028,"ondisk_log_size":2028,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4164,"ondisk_log_size":4164,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33940714,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44010,"num_read_kb":2045437,"num_write":72918,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68894720,"data_stored":67881428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3467,"ondisk_log_size":3467,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":206212,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193226,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509950,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279280,"kb_used_data":9156,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94092560,"statfs":{"total":96636764160,"available":96350781440,"internally_reserved":0,"allocated":9375744,"data_stored":7712300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509949,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":227140,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94144700,"statfs":{"total":96636764160,"available":96404172800,"internally_reserved":0,"allocated":7041024,"data_stored":5465111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509948,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90980,"kb_used_data":15288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94280860,"statfs":{"total":96636764160,"available":96543600640,"internally_reserved":0,"allocated":15654912,"data_stored":14047867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509950,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267900,"kb_used_data":15836,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94103940,"statfs":{"total":96636764160,"available":96362434560,"internally_reserved":0,"allocated":16216064,"data_stored":14565484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509949,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56888,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94314952,"statfs":{"total":96636764160,"available":96578510848,"internally_reserved":0,"allocated":11960320,"data_stored":10430814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542654,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":110936,"kb_used_data":11744,"kb_used_omap":1,"kb_used_meta":99134,"kb_avail":94260904,"statfs":{"total":96636764160,"available":96523165696,"internally_reserved":0,"allocated":12025856,"data_stored":10431815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101513669},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542651,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":251112,"kb_used_data":17304,"kb_used_omap":1,"kb_used_meta":233790,"kb_avail":94120728,"statfs":{"total":96636764160,"available":96379625472,"internally_reserved":0,"allocated":17719296,"data_stored":15992953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":239401413},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575357,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":112616,"kb_used_data":9076,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94259224,"statfs":{"total":96636764160,"available":96521445376,"internally_reserved":0,"allocated":9293824,"data_stored":7637406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13430784,"data_stored":13247355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8384512,"data_stored":8279522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8343552,"data_stored":8279343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12570624,"data_stored":12413553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12062720,"data_stored":11898009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":5483519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3403776,"data_stored":3312046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5099520,"data_stored":4968081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:37:55.702 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.702 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.702 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.702 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.702 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.703 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.704 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.705 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.706 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.707 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.708 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.709 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.710 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.711 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.712 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.713 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.714 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.715 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.716 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.717 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.718 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.719 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.720 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.721 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.722 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.723 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.724 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-14T10:55:48.742998+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=48, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.725 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.726 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.727 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.728 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.729 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.730 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-14T10:55:55.766899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=55, tm_sec=55, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.731 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.732 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.733 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.734 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.735 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.736 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.737 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.738 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.739 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.740 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.741 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-14T10:56:05.801505+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=5, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:37:55.742 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:38:15.743 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:38:16.093 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:38:16.104 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:38:16.106 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1531,"stamp":"2024-09-14T11:38:15.675407+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36158020,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":196655,"num_read_kb":2597552,"num_write":146051,"num_write_kb":2468367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":65597,"num_omap_keys":203,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13416,"ondisk_log_size":13416,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1408256,"kb_used_data":96960,"kb_used_omap":12,"kb_used_meta":1311155,"kb_avail":753566464,"statfs":{"total":773094113280,"available":771652059136,"internally_reserved":0,"allocated":99287040,"data_stored":86283750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1342623280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":65597,"num_omap_keys":203,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005478"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879647+0000","last_change":"2024-09-14T11:22:38.554296+0000","last_active":"2024-09-14T11:35:07.879647+0000","last_peered":"2024-09-14T11:35:07.879647+0000","last_clean":"2024-09-14T11:35:07.879647+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:35:07.879647+0000","last_undegraded":"2024-09-14T11:35:07.879647+0000","last_fullsized":"2024-09-14T11:35:07.879647+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:24.257792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:32.874387+0000","last_change":"2024-09-14T11:12:00.371370+0000","last_active":"2024-09-14T11:34:32.874387+0000","last_peered":"2024-09-14T11:34:32.874387+0000","last_clean":"2024-09-14T11:34:32.874387+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:34:32.874387+0000","last_undegraded":"2024-09-14T11:34:32.874387+0000","last_fullsized":"2024-09-14T11:34:32.874387+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:10.434332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.943218+0000","last_change":"2024-09-14T11:11:57.356179+0000","last_active":"2024-09-14T11:37:45.943218+0000","last_peered":"2024-09-14T11:37:45.943218+0000","last_clean":"2024-09-14T11:37:45.943218+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:37:45.943218+0000","last_undegraded":"2024-09-14T11:37:45.943218+0000","last_fullsized":"2024-09-14T11:37:45.943218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:20.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763760+0000","last_change":"2024-09-14T11:10:13.511537+0000","last_active":"2024-09-14T11:35:13.763760+0000","last_peered":"2024-09-14T11:35:13.763760+0000","last_clean":"2024-09-14T11:35:13.763760+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:35:13.763760+0000","last_undegraded":"2024-09-14T11:35:13.763760+0000","last_fullsized":"2024-09-14T11:35:13.763760+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.866042+0000","last_change":"2024-09-14T11:22:38.557878+0000","last_active":"2024-09-14T11:35:09.866042+0000","last_peered":"2024-09-14T11:35:09.866042+0000","last_clean":"2024-09-14T11:35:09.866042+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:35:09.866042+0000","last_undegraded":"2024-09-14T11:35:09.866042+0000","last_fullsized":"2024-09-14T11:35:09.866042+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:28:33.199554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912661+0000","last_change":"2024-09-14T11:12:00.365069+0000","last_active":"2024-09-14T11:36:59.912661+0000","last_peered":"2024-09-14T11:36:59.912661+0000","last_clean":"2024-09-14T11:36:59.912661+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:36:59.912661+0000","last_undegraded":"2024-09-14T11:36:59.912661+0000","last_fullsized":"2024-09-14T11:36:59.912661+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.203248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.051192+0000","last_change":"2024-09-14T11:11:57.352596+0000","last_active":"2024-09-14T11:37:46.051192+0000","last_peered":"2024-09-14T11:37:46.051192+0000","last_clean":"2024-09-14T11:37:46.051192+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:37:46.051192+0000","last_undegraded":"2024-09-14T11:37:46.051192+0000","last_fullsized":"2024-09-14T11:37:46.051192+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.294796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":102,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:56.089950+0000","last_change":"2024-09-14T11:10:13.500557+0000","last_active":"2024-09-14T11:34:56.089950+0000","last_peered":"2024-09-14T11:34:56.089950+0000","last_clean":"2024-09-14T11:34:56.089950+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:34:56.089950+0000","last_undegraded":"2024-09-14T11:34:56.089950+0000","last_fullsized":"2024-09-14T11:34:56.089950+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:48:52.821678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:44.893419+0000","last_change":"2024-09-14T11:22:38.555518+0000","last_active":"2024-09-14T11:34:44.893419+0000","last_peered":"2024-09-14T11:34:44.893419+0000","last_clean":"2024-09-14T11:34:44.893419+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:34:44.893419+0000","last_undegraded":"2024-09-14T11:34:44.893419+0000","last_fullsized":"2024-09-14T11:34:44.893419+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:22:12.998285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.452291+0000","last_change":"2024-09-14T11:12:00.696948+0000","last_active":"2024-09-14T11:37:46.452291+0000","last_peered":"2024-09-14T11:37:46.452291+0000","last_clean":"2024-09-14T11:37:46.452291+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:37:46.452291+0000","last_undegraded":"2024-09-14T11:37:46.452291+0000","last_fullsized":"2024-09-14T11:37:46.452291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:04.389759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.941100+0000","last_change":"2024-09-14T11:11:57.355524+0000","last_active":"2024-09-14T11:37:46.941100+0000","last_peered":"2024-09-14T11:37:46.941100+0000","last_clean":"2024-09-14T11:37:46.941100+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:37:46.941100+0000","last_undegraded":"2024-09-14T11:37:46.941100+0000","last_fullsized":"2024-09-14T11:37:46.941100+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5122,"num_write":13,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763690+0000","last_change":"2024-09-14T11:10:13.508809+0000","last_active":"2024-09-14T11:35:13.763690+0000","last_peered":"2024-09-14T11:35:13.763690+0000","last_clean":"2024-09-14T11:35:13.763690+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:35:13.763690+0000","last_undegraded":"2024-09-14T11:35:13.763690+0000","last_fullsized":"2024-09-14T11:35:13.763690+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:45.025002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605928+0000","last_change":"2024-09-14T11:22:38.561594+0000","last_active":"2024-09-14T11:34:45.605928+0000","last_peered":"2024-09-14T11:34:45.605928+0000","last_clean":"2024-09-14T11:34:45.605928+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:34:45.605928+0000","last_undegraded":"2024-09-14T11:34:45.605928+0000","last_fullsized":"2024-09-14T11:34:45.605928+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.203331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.202413+0000","last_change":"2024-09-14T11:12:00.696088+0000","last_active":"2024-09-14T11:37:46.202413+0000","last_peered":"2024-09-14T11:37:46.202413+0000","last_clean":"2024-09-14T11:37:46.202413+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:37:46.202413+0000","last_undegraded":"2024-09-14T11:37:46.202413+0000","last_fullsized":"2024-09-14T11:37:46.202413+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912700+0000","last_change":"2024-09-14T11:11:57.350368+0000","last_active":"2024-09-14T11:36:59.912700+0000","last_peered":"2024-09-14T11:36:59.912700+0000","last_clean":"2024-09-14T11:36:59.912700+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:36:59.912700+0000","last_undegraded":"2024-09-14T11:36:59.912700+0000","last_fullsized":"2024-09-14T11:36:59.912700+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:04.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609835+0000","last_change":"2024-09-14T11:10:13.511471+0000","last_active":"2024-09-14T11:35:15.609835+0000","last_peered":"2024-09-14T11:35:15.609835+0000","last_clean":"2024-09-14T11:35:15.609835+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:35:15.609835+0000","last_undegraded":"2024-09-14T11:35:15.609835+0000","last_fullsized":"2024-09-14T11:35:15.609835+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:33.776917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:40.605265+0000","last_change":"2024-09-14T11:22:38.562233+0000","last_active":"2024-09-14T11:34:40.605265+0000","last_peered":"2024-09-14T11:34:40.605265+0000","last_clean":"2024-09-14T11:34:40.605265+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:34:40.605265+0000","last_undegraded":"2024-09-14T11:34:40.605265+0000","last_fullsized":"2024-09-14T11:34:40.605265+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:59.647783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868050+0000","last_change":"2024-09-14T11:12:00.373042+0000","last_active":"2024-09-14T11:33:47.868050+0000","last_peered":"2024-09-14T11:33:47.868050+0000","last_clean":"2024-09-14T11:33:47.868050+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:33:47.868050+0000","last_undegraded":"2024-09-14T11:33:47.868050+0000","last_fullsized":"2024-09-14T11:33:47.868050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:42.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751536+0000","last_change":"2024-09-14T11:11:57.347912+0000","last_active":"2024-09-14T11:33:43.751536+0000","last_peered":"2024-09-14T11:33:43.751536+0000","last_clean":"2024-09-14T11:33:43.751536+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:33:43.751536+0000","last_undegraded":"2024-09-14T11:33:43.751536+0000","last_fullsized":"2024-09-14T11:33:43.751536+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:27.723340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609807+0000","last_change":"2024-09-14T11:10:13.510098+0000","last_active":"2024-09-14T11:35:15.609807+0000","last_peered":"2024-09-14T11:35:15.609807+0000","last_clean":"2024-09-14T11:35:15.609807+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:35:15.609807+0000","last_undegraded":"2024-09-14T11:35:15.609807+0000","last_fullsized":"2024-09-14T11:35:15.609807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:46.783877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763109+0000","last_change":"2024-09-14T11:22:38.558736+0000","last_active":"2024-09-14T11:35:08.763109+0000","last_peered":"2024-09-14T11:35:08.763109+0000","last_clean":"2024-09-14T11:35:08.763109+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:35:08.763109+0000","last_undegraded":"2024-09-14T11:35:08.763109+0000","last_fullsized":"2024-09-14T11:35:08.763109+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:58.587973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885772+0000","last_change":"2024-09-14T11:12:00.372932+0000","last_active":"2024-09-14T11:33:44.885772+0000","last_peered":"2024-09-14T11:33:44.885772+0000","last_clean":"2024-09-14T11:33:44.885772+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:33:44.885772+0000","last_undegraded":"2024-09-14T11:33:44.885772+0000","last_fullsized":"2024-09-14T11:33:44.885772+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:01.464328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885933+0000","last_change":"2024-09-14T11:11:57.351572+0000","last_active":"2024-09-14T11:33:44.885933+0000","last_peered":"2024-09-14T11:33:44.885933+0000","last_clean":"2024-09-14T11:33:44.885933+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:33:44.885933+0000","last_undegraded":"2024-09-14T11:33:44.885933+0000","last_fullsized":"2024-09-14T11:33:44.885933+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:13:43.340891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":107,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897732+0000","last_change":"2024-09-14T11:10:13.507035+0000","last_active":"2024-09-14T11:35:14.897732+0000","last_peered":"2024-09-14T11:35:14.897732+0000","last_clean":"2024-09-14T11:35:14.897732+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:35:14.897732+0000","last_undegraded":"2024-09-14T11:35:14.897732+0000","last_fullsized":"2024-09-14T11:35:14.897732+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:05.962765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897474+0000","last_change":"2024-09-14T11:22:38.558217+0000","last_active":"2024-09-14T11:35:09.897474+0000","last_peered":"2024-09-14T11:35:09.897474+0000","last_clean":"2024-09-14T11:35:09.897474+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:35:09.897474+0000","last_undegraded":"2024-09-14T11:35:09.897474+0000","last_fullsized":"2024-09-14T11:35:09.897474+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:16.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891260+0000","last_change":"2024-09-14T11:12:00.366839+0000","last_active":"2024-09-14T11:34:29.891260+0000","last_peered":"2024-09-14T11:34:29.891260+0000","last_clean":"2024-09-14T11:34:29.891260+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:34:29.891260+0000","last_undegraded":"2024-09-14T11:34:29.891260+0000","last_fullsized":"2024-09-14T11:34:29.891260+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:58:28.093713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891654+0000","last_change":"2024-09-14T11:11:57.355185+0000","last_active":"2024-09-14T11:34:29.891654+0000","last_peered":"2024-09-14T11:34:29.891654+0000","last_clean":"2024-09-14T11:34:29.891654+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:34:29.891654+0000","last_undegraded":"2024-09-14T11:34:29.891654+0000","last_fullsized":"2024-09-14T11:34:29.891654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.881561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758163+0000","last_change":"2024-09-14T11:10:13.507975+0000","last_active":"2024-09-14T11:34:33.758163+0000","last_peered":"2024-09-14T11:34:33.758163+0000","last_clean":"2024-09-14T11:34:33.758163+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:34:33.758163+0000","last_undegraded":"2024-09-14T11:34:33.758163+0000","last_fullsized":"2024-09-14T11:34:33.758163+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:21.041245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897517+0000","last_change":"2024-09-14T11:22:38.561164+0000","last_active":"2024-09-14T11:35:09.897517+0000","last_peered":"2024-09-14T11:35:09.897517+0000","last_clean":"2024-09-14T11:35:09.897517+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:35:09.897517+0000","last_undegraded":"2024-09-14T11:35:09.897517+0000","last_fullsized":"2024-09-14T11:35:09.897517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:43.901705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880477+0000","last_change":"2024-09-14T11:12:43.314131+0000","last_active":"2024-09-14T11:35:12.880477+0000","last_peered":"2024-09-14T11:35:12.880477+0000","last_clean":"2024-09-14T11:35:12.880477+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:35:12.880477+0000","last_undegraded":"2024-09-14T11:35:12.880477+0000","last_fullsized":"2024-09-14T11:35:12.880477+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:03.892987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.339573+0000","last_change":"2024-09-14T11:11:57.358103+0000","last_active":"2024-09-14T11:37:46.339573+0000","last_peered":"2024-09-14T11:37:46.339573+0000","last_clean":"2024-09-14T11:37:46.339573+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:37:46.339573+0000","last_undegraded":"2024-09-14T11:37:46.339573+0000","last_fullsized":"2024-09-14T11:37:46.339573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:14.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.757100+0000","last_change":"2024-09-14T11:10:13.501269+0000","last_active":"2024-09-14T11:34:23.757100+0000","last_peered":"2024-09-14T11:34:23.757100+0000","last_clean":"2024-09-14T11:34:23.757100+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:34:23.757100+0000","last_undegraded":"2024-09-14T11:34:23.757100+0000","last_fullsized":"2024-09-14T11:34:23.757100+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:36.721868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:18.756557+0000","last_change":"2024-09-14T11:22:38.559223+0000","last_active":"2024-09-14T11:34:18.756557+0000","last_peered":"2024-09-14T11:34:18.756557+0000","last_clean":"2024-09-14T11:34:18.756557+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:34:18.756557+0000","last_undegraded":"2024-09-14T11:34:18.756557+0000","last_fullsized":"2024-09-14T11:34:18.756557+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:18.099181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:10.617001+0000","last_change":"2024-09-14T11:12:00.695830+0000","last_active":"2024-09-14T11:36:10.617001+0000","last_peered":"2024-09-14T11:36:10.617001+0000","last_clean":"2024-09-14T11:36:10.617001+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:36:10.617001+0000","last_undegraded":"2024-09-14T11:36:10.617001+0000","last_fullsized":"2024-09-14T11:36:10.617001+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:27:08.999496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881154+0000","last_change":"2024-09-14T11:11:57.353227+0000","last_active":"2024-09-14T11:35:17.881154+0000","last_peered":"2024-09-14T11:35:17.881154+0000","last_clean":"2024-09-14T11:35:17.881154+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:35:17.881154+0000","last_undegraded":"2024-09-14T11:35:17.881154+0000","last_fullsized":"2024-09-14T11:35:17.881154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:08.822820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.845469+0000","last_change":"2024-09-14T11:10:13.507446+0000","last_active":"2024-09-14T11:34:59.845469+0000","last_peered":"2024-09-14T11:34:59.845469+0000","last_clean":"2024-09-14T11:34:59.845469+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:34:59.845469+0000","last_undegraded":"2024-09-14T11:34:59.845469+0000","last_fullsized":"2024-09-14T11:34:59.845469+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:37.515685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.859664+0000","last_change":"2024-09-14T11:22:38.547820+0000","last_active":"2024-09-14T11:34:19.859664+0000","last_peered":"2024-09-14T11:34:19.859664+0000","last_clean":"2024-09-14T11:34:19.859664+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:34:19.859664+0000","last_undegraded":"2024-09-14T11:34:19.859664+0000","last_fullsized":"2024-09-14T11:34:19.859664+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:22:57.390529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.629713+0000","last_change":"2024-09-14T11:12:00.697008+0000","last_active":"2024-09-14T11:37:45.629713+0000","last_peered":"2024-09-14T11:37:45.629713+0000","last_clean":"2024-09-14T11:37:45.629713+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:37:45.629713+0000","last_undegraded":"2024-09-14T11:37:45.629713+0000","last_fullsized":"2024-09-14T11:37:45.629713+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:03.052127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.337925+0000","last_change":"2024-09-14T11:11:57.349579+0000","last_active":"2024-09-14T11:37:46.337925+0000","last_peered":"2024-09-14T11:37:46.337925+0000","last_clean":"2024-09-14T11:37:46.337925+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:37:46.337925+0000","last_undegraded":"2024-09-14T11:37:46.337925+0000","last_fullsized":"2024-09-14T11:37:46.337925+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:15:26.518454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:25.603094+0000","last_change":"2024-09-14T11:10:13.510036+0000","last_active":"2024-09-14T11:34:25.603094+0000","last_peered":"2024-09-14T11:34:25.603094+0000","last_clean":"2024-09-14T11:34:25.603094+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:34:25.603094+0000","last_undegraded":"2024-09-14T11:34:25.603094+0000","last_fullsized":"2024-09-14T11:34:25.603094+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:48.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.889866+0000","last_change":"2024-09-14T11:22:38.557418+0000","last_active":"2024-09-14T11:34:19.889866+0000","last_peered":"2024-09-14T11:34:19.889866+0000","last_clean":"2024-09-14T11:34:19.889866+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:34:19.889866+0000","last_undegraded":"2024-09-14T11:34:19.889866+0000","last_fullsized":"2024-09-14T11:34:19.889866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:24.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:10.617054+0000","last_change":"2024-09-14T11:12:00.697792+0000","last_active":"2024-09-14T11:36:10.617054+0000","last_peered":"2024-09-14T11:36:10.617054+0000","last_clean":"2024-09-14T11:36:10.617054+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:36:10.617054+0000","last_undegraded":"2024-09-14T11:36:10.617054+0000","last_fullsized":"2024-09-14T11:36:10.617054+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:01:04.239911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.855371+0000","last_change":"2024-09-14T11:11:57.353323+0000","last_active":"2024-09-14T11:33:44.855371+0000","last_peered":"2024-09-14T11:33:44.855371+0000","last_clean":"2024-09-14T11:33:44.855371+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:33:44.855371+0000","last_undegraded":"2024-09-14T11:33:44.855371+0000","last_fullsized":"2024-09-14T11:33:44.855371+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:45:15.814681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":127,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:24.860387+0000","last_change":"2024-09-14T11:10:13.499745+0000","last_active":"2024-09-14T11:34:24.860387+0000","last_peered":"2024-09-14T11:34:24.860387+0000","last_clean":"2024-09-14T11:34:24.860387+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:34:24.860387+0000","last_undegraded":"2024-09-14T11:34:24.860387+0000","last_fullsized":"2024-09-14T11:34:24.860387+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:58.521220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:17.872355+0000","last_change":"2024-09-14T11:22:38.556244+0000","last_active":"2024-09-14T11:34:17.872355+0000","last_peered":"2024-09-14T11:34:17.872355+0000","last_clean":"2024-09-14T11:34:17.872355+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:34:17.872355+0000","last_undegraded":"2024-09-14T11:34:17.872355+0000","last_fullsized":"2024-09-14T11:34:17.872355+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:12.131431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'3","reported_seq":38,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:09.906261+0000","last_change":"2024-09-14T11:12:00.371092+0000","last_active":"2024-09-14T11:36:09.906261+0000","last_peered":"2024-09-14T11:36:09.906261+0000","last_clean":"2024-09-14T11:36:09.906261+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:36:09.906261+0000","last_undegraded":"2024-09-14T11:36:09.906261+0000","last_fullsized":"2024-09-14T11:36:09.906261+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:07.488321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:43.751653+0000","last_change":"2024-09-14T11:11:57.355672+0000","last_active":"2024-09-14T11:33:43.751653+0000","last_peered":"2024-09-14T11:33:43.751653+0000","last_clean":"2024-09-14T11:33:43.751653+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:33:43.751653+0000","last_undegraded":"2024-09-14T11:33:43.751653+0000","last_fullsized":"2024-09-14T11:33:43.751653+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:54.970745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":125,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:39.884593+0000","last_change":"2024-09-14T11:10:13.509666+0000","last_active":"2024-09-14T11:33:39.884593+0000","last_peered":"2024-09-14T11:33:39.884593+0000","last_clean":"2024-09-14T11:33:39.884593+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:33:39.884593+0000","last_undegraded":"2024-09-14T11:33:39.884593+0000","last_fullsized":"2024-09-14T11:33:39.884593+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:38.839337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.606019+0000","last_change":"2024-09-14T11:22:38.560634+0000","last_active":"2024-09-14T11:34:45.606019+0000","last_peered":"2024-09-14T11:34:45.606019+0000","last_clean":"2024-09-14T11:34:45.606019+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:34:45.606019+0000","last_undegraded":"2024-09-14T11:34:45.606019+0000","last_fullsized":"2024-09-14T11:34:45.606019+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:00.155051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765049+0000","last_change":"2024-09-14T11:12:00.370168+0000","last_active":"2024-09-14T11:35:23.765049+0000","last_peered":"2024-09-14T11:35:23.765049+0000","last_clean":"2024-09-14T11:35:23.765049+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:35:23.765049+0000","last_undegraded":"2024-09-14T11:35:23.765049+0000","last_fullsized":"2024-09-14T11:35:23.765049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:48.258006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898754+0000","last_change":"2024-09-14T11:11:57.349362+0000","last_active":"2024-09-14T11:35:19.898754+0000","last_peered":"2024-09-14T11:35:19.898754+0000","last_clean":"2024-09-14T11:35:19.898754+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:35:19.898754+0000","last_undegraded":"2024-09-14T11:35:19.898754+0000","last_fullsized":"2024-09-14T11:35:19.898754+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:16.873771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.904087+0000","last_change":"2024-09-14T11:10:13.508867+0000","last_active":"2024-09-14T11:35:54.904087+0000","last_peered":"2024-09-14T11:35:54.904087+0000","last_clean":"2024-09-14T11:35:54.904087+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:35:54.904087+0000","last_undegraded":"2024-09-14T11:35:54.904087+0000","last_fullsized":"2024-09-14T11:35:54.904087+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759854+0000","last_change":"2024-09-14T11:22:38.562421+0000","last_active":"2024-09-14T11:34:43.759854+0000","last_peered":"2024-09-14T11:34:43.759854+0000","last_clean":"2024-09-14T11:34:43.759854+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:34:43.759854+0000","last_undegraded":"2024-09-14T11:34:43.759854+0000","last_fullsized":"2024-09-14T11:34:43.759854+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:19.932638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:23.765008+0000","last_change":"2024-09-14T11:12:00.366781+0000","last_active":"2024-09-14T11:35:23.765008+0000","last_peered":"2024-09-14T11:35:23.765008+0000","last_clean":"2024-09-14T11:35:23.765008+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:35:23.765008+0000","last_undegraded":"2024-09-14T11:35:23.765008+0000","last_fullsized":"2024-09-14T11:35:23.765008+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:24:26.257185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610401+0000","last_change":"2024-09-14T11:11:57.355400+0000","last_active":"2024-09-14T11:35:20.610401+0000","last_peered":"2024-09-14T11:35:20.610401+0000","last_clean":"2024-09-14T11:35:20.610401+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:35:20.610401+0000","last_undegraded":"2024-09-14T11:35:20.610401+0000","last_fullsized":"2024-09-14T11:35:20.610401+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:52.064528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:53.768525+0000","last_change":"2024-09-14T11:10:13.508002+0000","last_active":"2024-09-14T11:35:53.768525+0000","last_peered":"2024-09-14T11:35:53.768525+0000","last_clean":"2024-09-14T11:35:53.768525+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:35:53.768525+0000","last_undegraded":"2024-09-14T11:35:53.768525+0000","last_fullsized":"2024-09-14T11:35:53.768525+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756775+0000","last_change":"2024-09-14T11:22:38.560824+0000","last_active":"2024-09-14T11:34:23.756775+0000","last_peered":"2024-09-14T11:34:23.756775+0000","last_clean":"2024-09-14T11:34:23.756775+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:34:23.756775+0000","last_undegraded":"2024-09-14T11:34:23.756775+0000","last_fullsized":"2024-09-14T11:34:23.756775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.610355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610448+0000","last_change":"2024-09-14T11:12:00.371863+0000","last_active":"2024-09-14T11:35:20.610448+0000","last_peered":"2024-09-14T11:35:20.610448+0000","last_clean":"2024-09-14T11:35:20.610448+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:35:20.610448+0000","last_undegraded":"2024-09-14T11:35:20.610448+0000","last_fullsized":"2024-09-14T11:35:20.610448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.086012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898372+0000","last_change":"2024-09-14T11:11:57.355053+0000","last_active":"2024-09-14T11:35:19.898372+0000","last_peered":"2024-09-14T11:35:19.898372+0000","last_clean":"2024-09-14T11:35:19.898372+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:35:19.898372+0000","last_undegraded":"2024-09-14T11:35:19.898372+0000","last_fullsized":"2024-09-14T11:35:19.898372+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:31.975373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.904138+0000","last_change":"2024-09-14T11:10:13.509195+0000","last_active":"2024-09-14T11:35:54.904138+0000","last_peered":"2024-09-14T11:35:54.904138+0000","last_clean":"2024-09-14T11:35:54.904138+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:35:54.904138+0000","last_undegraded":"2024-09-14T11:35:54.904138+0000","last_fullsized":"2024-09-14T11:35:54.904138+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605996+0000","last_change":"2024-09-14T11:22:38.549656+0000","last_active":"2024-09-14T11:34:45.605996+0000","last_peered":"2024-09-14T11:34:45.605996+0000","last_clean":"2024-09-14T11:34:45.605996+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:34:45.605996+0000","last_undegraded":"2024-09-14T11:34:45.605996+0000","last_fullsized":"2024-09-14T11:34:45.605996+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.182205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:39.917769+0000","last_change":"2024-09-14T11:12:00.368721+0000","last_active":"2024-09-14T11:37:39.917769+0000","last_peered":"2024-09-14T11:37:39.917769+0000","last_clean":"2024-09-14T11:37:39.917769+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:37:39.917769+0000","last_undegraded":"2024-09-14T11:37:39.917769+0000","last_fullsized":"2024-09-14T11:37:39.917769+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:12.328655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:37.901303+0000","last_change":"2024-09-14T11:11:57.355041+0000","last_active":"2024-09-14T11:37:37.901303+0000","last_peered":"2024-09-14T11:37:37.901303+0000","last_clean":"2024-09-14T11:37:37.901303+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:37:37.901303+0000","last_undegraded":"2024-09-14T11:37:37.901303+0000","last_fullsized":"2024-09-14T11:37:37.901303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:42.390324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:55.614536+0000","last_change":"2024-09-14T11:10:13.507056+0000","last_active":"2024-09-14T11:35:55.614536+0000","last_peered":"2024-09-14T11:35:55.614536+0000","last_clean":"2024-09-14T11:35:55.614536+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:35:55.614536+0000","last_undegraded":"2024-09-14T11:35:55.614536+0000","last_fullsized":"2024-09-14T11:35:55.614536+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:44.869710+0000","last_change":"2024-09-14T11:22:38.547683+0000","last_active":"2024-09-14T11:35:44.869710+0000","last_peered":"2024-09-14T11:35:44.869710+0000","last_clean":"2024-09-14T11:35:44.869710+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:35:44.869710+0000","last_undegraded":"2024-09-14T11:35:44.869710+0000","last_fullsized":"2024-09-14T11:35:44.869710+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603840+0000","last_change":"2024-09-14T11:12:00.369322+0000","last_active":"2024-09-14T11:34:30.603840+0000","last_peered":"2024-09-14T11:34:30.603840+0000","last_clean":"2024-09-14T11:34:30.603840+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:34:30.603840+0000","last_undegraded":"2024-09-14T11:34:30.603840+0000","last_fullsized":"2024-09-14T11:34:30.603840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:38.196351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891188+0000","last_change":"2024-09-14T11:11:57.357216+0000","last_active":"2024-09-14T11:34:29.891188+0000","last_peered":"2024-09-14T11:34:29.891188+0000","last_clean":"2024-09-14T11:34:29.891188+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:34:29.891188+0000","last_undegraded":"2024-09-14T11:34:29.891188+0000","last_fullsized":"2024-09-14T11:34:29.891188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:05.608393+0000","last_change":"2024-09-14T11:10:13.512001+0000","last_active":"2024-09-14T11:35:05.608393+0000","last_peered":"2024-09-14T11:35:05.608393+0000","last_clean":"2024-09-14T11:35:05.608393+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:35:05.608393+0000","last_undegraded":"2024-09-14T11:35:05.608393+0000","last_fullsized":"2024-09-14T11:35:05.608393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:22.364398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886662+0000","last_change":"2024-09-14T11:22:38.560005+0000","last_active":"2024-09-14T11:33:54.886662+0000","last_peered":"2024-09-14T11:33:54.886662+0000","last_clean":"2024-09-14T11:33:54.886662+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:33:54.886662+0000","last_undegraded":"2024-09-14T11:33:54.886662+0000","last_fullsized":"2024-09-14T11:33:54.886662+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:06.734073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603797+0000","last_change":"2024-09-14T11:12:00.370638+0000","last_active":"2024-09-14T11:34:30.603797+0000","last_peered":"2024-09-14T11:34:30.603797+0000","last_clean":"2024-09-14T11:34:30.603797+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:34:30.603797+0000","last_undegraded":"2024-09-14T11:34:30.603797+0000","last_fullsized":"2024-09-14T11:34:30.603797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:40.237389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:44.877001+0000","last_change":"2024-09-14T11:11:57.358150+0000","last_active":"2024-09-14T11:36:44.877001+0000","last_peered":"2024-09-14T11:36:44.877001+0000","last_clean":"2024-09-14T11:36:44.877001+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:36:44.877001+0000","last_undegraded":"2024-09-14T11:36:44.877001+0000","last_fullsized":"2024-09-14T11:36:44.877001+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:33.857222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":432,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:57.878115+0000","last_change":"2024-09-14T11:10:13.508473+0000","last_active":"2024-09-14T11:34:57.878115+0000","last_peered":"2024-09-14T11:34:57.878115+0000","last_clean":"2024-09-14T11:34:57.878115+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:34:57.878115+0000","last_undegraded":"2024-09-14T11:34:57.878115+0000","last_fullsized":"2024-09-14T11:34:57.878115+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:51.939853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901306+0000","last_change":"2024-09-14T11:22:38.555264+0000","last_active":"2024-09-14T11:35:39.901306+0000","last_peered":"2024-09-14T11:35:39.901306+0000","last_clean":"2024-09-14T11:35:39.901306+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:35:39.901306+0000","last_undegraded":"2024-09-14T11:35:39.901306+0000","last_fullsized":"2024-09-14T11:35:39.901306+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:10.041270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:53.776370+0000","last_change":"2024-09-14T11:12:00.696985+0000","last_active":"2024-09-14T11:36:53.776370+0000","last_peered":"2024-09-14T11:36:53.776370+0000","last_clean":"2024-09-14T11:36:53.776370+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:36:53.776370+0000","last_undegraded":"2024-09-14T11:36:53.776370+0000","last_fullsized":"2024-09-14T11:36:53.776370+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:16.646477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757502+0000","last_change":"2024-09-14T11:11:57.350049+0000","last_active":"2024-09-14T11:34:28.757502+0000","last_peered":"2024-09-14T11:34:28.757502+0000","last_clean":"2024-09-14T11:34:28.757502+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:34:28.757502+0000","last_undegraded":"2024-09-14T11:34:28.757502+0000","last_fullsized":"2024-09-14T11:34:28.757502+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:36.573356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":69,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895573+0000","last_change":"2024-09-14T11:10:13.511805+0000","last_active":"2024-09-14T11:34:59.895573+0000","last_peered":"2024-09-14T11:34:59.895573+0000","last_clean":"2024-09-14T11:34:59.895573+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:34:59.895573+0000","last_undegraded":"2024-09-14T11:34:59.895573+0000","last_fullsized":"2024-09-14T11:34:59.895573+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:21:47.389561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901829+0000","last_change":"2024-09-14T11:22:38.552793+0000","last_active":"2024-09-14T11:35:39.901829+0000","last_peered":"2024-09-14T11:35:39.901829+0000","last_clean":"2024-09-14T11:35:39.901829+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:35:39.901829+0000","last_undegraded":"2024-09-14T11:35:39.901829+0000","last_fullsized":"2024-09-14T11:35:39.901829+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:40.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:45.621178+0000","last_change":"2024-09-14T11:12:00.371999+0000","last_active":"2024-09-14T11:36:45.621178+0000","last_peered":"2024-09-14T11:36:45.621178+0000","last_clean":"2024-09-14T11:36:45.621178+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:36:45.621178+0000","last_undegraded":"2024-09-14T11:36:45.621178+0000","last_fullsized":"2024-09-14T11:36:45.621178+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:57.798523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'7","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.615620+0000","last_change":"2024-09-14T11:11:57.351527+0000","last_active":"2024-09-14T11:37:46.615620+0000","last_peered":"2024-09-14T11:37:46.615620+0000","last_clean":"2024-09-14T11:37:46.615620+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:37:46.615620+0000","last_undegraded":"2024-09-14T11:37:46.615620+0000","last_fullsized":"2024-09-14T11:37:46.615620+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:40:16.871687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5818,"num_write":12,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":239,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.232644+0000","last_change":"2024-09-14T11:38:14.232644+0000","last_active":"2024-09-14T11:38:14.232644+0000","last_peered":"2024-09-14T11:38:14.232644+0000","last_clean":"2024-09-14T11:38:14.232644+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:38:14.232644+0000","last_undegraded":"2024-09-14T11:38:14.232644+0000","last_fullsized":"2024-09-14T11:38:14.232644+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.232551+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:32.602593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:55.599222+0000","last_change":"2024-09-14T11:22:38.560343+0000","last_active":"2024-09-14T11:33:55.599222+0000","last_peered":"2024-09-14T11:33:55.599222+0000","last_clean":"2024-09-14T11:33:55.599222+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:33:55.599222+0000","last_undegraded":"2024-09-14T11:33:55.599222+0000","last_fullsized":"2024-09-14T11:33:55.599222+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:06:29.881634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.867146+0000","last_change":"2024-09-14T11:12:00.369339+0000","last_active":"2024-09-14T11:37:46.867146+0000","last_peered":"2024-09-14T11:37:46.867146+0000","last_clean":"2024-09-14T11:37:46.867146+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:37:46.867146+0000","last_undegraded":"2024-09-14T11:37:46.867146+0000","last_fullsized":"2024-09-14T11:37:46.867146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:48.767875+0000","last_change":"2024-09-14T11:11:57.357619+0000","last_active":"2024-09-14T11:35:48.767875+0000","last_peered":"2024-09-14T11:35:48.767875+0000","last_clean":"2024-09-14T11:35:48.767875+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:35:48.767875+0000","last_undegraded":"2024-09-14T11:35:48.767875+0000","last_fullsized":"2024-09-14T11:35:48.767875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761794+0000","last_change":"2024-09-14T11:10:13.505959+0000","last_active":"2024-09-14T11:34:58.761794+0000","last_peered":"2024-09-14T11:34:58.761794+0000","last_clean":"2024-09-14T11:34:58.761794+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:34:58.761794+0000","last_undegraded":"2024-09-14T11:34:58.761794+0000","last_fullsized":"2024-09-14T11:34:58.761794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:13.476423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886743+0000","last_change":"2024-09-14T11:22:38.558664+0000","last_active":"2024-09-14T11:33:54.886743+0000","last_peered":"2024-09-14T11:33:54.886743+0000","last_clean":"2024-09-14T11:33:54.886743+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:33:54.886743+0000","last_undegraded":"2024-09-14T11:33:54.886743+0000","last_fullsized":"2024-09-14T11:33:54.886743+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:04:30.238036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.010903+0000","last_change":"2024-09-14T11:12:00.694483+0000","last_active":"2024-09-14T11:37:46.010903+0000","last_peered":"2024-09-14T11:37:46.010903+0000","last_clean":"2024-09-14T11:37:46.010903+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:37:46.010903+0000","last_undegraded":"2024-09-14T11:37:46.010903+0000","last_fullsized":"2024-09-14T11:37:46.010903+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:48.768074+0000","last_change":"2024-09-14T11:11:57.352310+0000","last_active":"2024-09-14T11:35:48.768074+0000","last_peered":"2024-09-14T11:35:48.768074+0000","last_clean":"2024-09-14T11:35:48.768074+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:35:48.768074+0000","last_undegraded":"2024-09-14T11:35:48.768074+0000","last_fullsized":"2024-09-14T11:35:48.768074+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":143,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:09.888479+0000","last_change":"2024-09-14T11:10:13.511603+0000","last_active":"2024-09-14T11:34:09.888479+0000","last_peered":"2024-09-14T11:34:09.888479+0000","last_clean":"2024-09-14T11:34:09.888479+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:34:09.888479+0000","last_undegraded":"2024-09-14T11:34:09.888479+0000","last_fullsized":"2024-09-14T11:34:09.888479+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:51.593455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:54.886685+0000","last_change":"2024-09-14T11:22:38.557834+0000","last_active":"2024-09-14T11:33:54.886685+0000","last_peered":"2024-09-14T11:33:54.886685+0000","last_clean":"2024-09-14T11:33:54.886685+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:33:54.886685+0000","last_undegraded":"2024-09-14T11:33:54.886685+0000","last_fullsized":"2024-09-14T11:33:54.886685+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:43:44.232152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758487+0000","last_change":"2024-09-14T11:12:00.368877+0000","last_active":"2024-09-14T11:34:33.758487+0000","last_peered":"2024-09-14T11:34:33.758487+0000","last_clean":"2024-09-14T11:34:33.758487+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:34:33.758487+0000","last_undegraded":"2024-09-14T11:34:33.758487+0000","last_fullsized":"2024-09-14T11:34:33.758487+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:04.138036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:53.768515+0000","last_change":"2024-09-14T11:11:57.350615+0000","last_active":"2024-09-14T11:35:53.768515+0000","last_peered":"2024-09-14T11:35:53.768515+0000","last_clean":"2024-09-14T11:35:53.768515+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:35:53.768515+0000","last_undegraded":"2024-09-14T11:35:53.768515+0000","last_fullsized":"2024-09-14T11:35:53.768515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":794,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:05.600496+0000","last_change":"2024-09-14T11:10:13.505366+0000","last_active":"2024-09-14T11:34:05.600496+0000","last_peered":"2024-09-14T11:34:05.600496+0000","last_clean":"2024-09-14T11:34:05.600496+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:34:05.600496+0000","last_undegraded":"2024-09-14T11:34:05.600496+0000","last_fullsized":"2024-09-14T11:34:05.600496+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:34:26.758270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:53.752949+0000","last_change":"2024-09-14T11:22:38.560810+0000","last_active":"2024-09-14T11:33:53.752949+0000","last_peered":"2024-09-14T11:33:53.752949+0000","last_clean":"2024-09-14T11:33:53.752949+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:33:53.752949+0000","last_undegraded":"2024-09-14T11:33:53.752949+0000","last_fullsized":"2024-09-14T11:33:53.752949+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:04.353747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.051788+0000","last_change":"2024-09-14T11:12:00.372935+0000","last_active":"2024-09-14T11:37:46.051788+0000","last_peered":"2024-09-14T11:37:46.051788+0000","last_clean":"2024-09-14T11:37:46.051788+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:37:46.051788+0000","last_undegraded":"2024-09-14T11:37:46.051788+0000","last_fullsized":"2024-09-14T11:37:46.051788+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891684+0000","last_change":"2024-09-14T11:11:57.352921+0000","last_active":"2024-09-14T11:34:29.891684+0000","last_peered":"2024-09-14T11:34:29.891684+0000","last_clean":"2024-09-14T11:34:29.891684+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:34:29.891684+0000","last_undegraded":"2024-09-14T11:34:29.891684+0000","last_fullsized":"2024-09-14T11:34:29.891684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:56:52.542794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":122,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888212+0000","last_change":"2024-09-14T11:10:13.506698+0000","last_active":"2024-09-14T11:34:04.888212+0000","last_peered":"2024-09-14T11:34:04.888212+0000","last_clean":"2024-09-14T11:34:04.888212+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:34:04.888212+0000","last_undegraded":"2024-09-14T11:34:04.888212+0000","last_fullsized":"2024-09-14T11:34:04.888212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:50.197138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897410+0000","last_change":"2024-09-14T11:22:38.557689+0000","last_active":"2024-09-14T11:35:09.897410+0000","last_peered":"2024-09-14T11:35:09.897410+0000","last_clean":"2024-09-14T11:35:09.897410+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:35:09.897410+0000","last_undegraded":"2024-09-14T11:35:09.897410+0000","last_fullsized":"2024-09-14T11:35:09.897410+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:32.821928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762555+0000","last_change":"2024-09-14T11:12:00.367857+0000","last_active":"2024-09-14T11:35:03.762555+0000","last_peered":"2024-09-14T11:35:03.762555+0000","last_clean":"2024-09-14T11:35:03.762555+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:35:03.762555+0000","last_undegraded":"2024-09-14T11:35:03.762555+0000","last_fullsized":"2024-09-14T11:35:03.762555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:30.330125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895154+0000","last_change":"2024-09-14T11:11:57.350701+0000","last_active":"2024-09-14T11:34:54.895154+0000","last_peered":"2024-09-14T11:34:54.895154+0000","last_clean":"2024-09-14T11:34:54.895154+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:34:54.895154+0000","last_undegraded":"2024-09-14T11:34:54.895154+0000","last_fullsized":"2024-09-14T11:34:54.895154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:03.947483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:03.754212+0000","last_change":"2024-09-14T11:10:13.507832+0000","last_active":"2024-09-14T11:34:03.754212+0000","last_peered":"2024-09-14T11:34:03.754212+0000","last_clean":"2024-09-14T11:34:03.754212+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:34:03.754212+0000","last_undegraded":"2024-09-14T11:34:03.754212+0000","last_fullsized":"2024-09-14T11:34:03.754212+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:46:07.145883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879667+0000","last_change":"2024-09-14T11:22:38.559774+0000","last_active":"2024-09-14T11:35:07.879667+0000","last_peered":"2024-09-14T11:35:07.879667+0000","last_clean":"2024-09-14T11:35:07.879667+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:35:07.879667+0000","last_undegraded":"2024-09-14T11:35:07.879667+0000","last_fullsized":"2024-09-14T11:35:07.879667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:14.753350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761826+0000","last_change":"2024-09-14T11:12:00.695654+0000","last_active":"2024-09-14T11:34:58.761826+0000","last_peered":"2024-09-14T11:34:58.761826+0000","last_clean":"2024-09-14T11:34:58.761826+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:34:58.761826+0000","last_undegraded":"2024-09-14T11:34:58.761826+0000","last_fullsized":"2024-09-14T11:34:58.761826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:44.109481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'3","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:04.879303+0000","last_change":"2024-09-14T11:11:57.357243+0000","last_active":"2024-09-14T11:37:04.879303+0000","last_peered":"2024-09-14T11:37:04.879303+0000","last_clean":"2024-09-14T11:37:04.879303+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:37:04.879303+0000","last_undegraded":"2024-09-14T11:37:04.879303+0000","last_fullsized":"2024-09-14T11:37:04.879303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:58.472930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":80,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:04.888302+0000","last_change":"2024-09-14T11:10:13.507529+0000","last_active":"2024-09-14T11:34:04.888302+0000","last_peered":"2024-09-14T11:34:04.888302+0000","last_clean":"2024-09-14T11:34:04.888302+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:34:04.888302+0000","last_undegraded":"2024-09-14T11:34:04.888302+0000","last_fullsized":"2024-09-14T11:34:04.888302+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:12:46.910286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T11:22:38.559360+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:39:07.017001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.450224+0000","last_change":"2024-09-14T11:12:00.697739+0000","last_active":"2024-09-14T11:37:46.450224+0000","last_peered":"2024-09-14T11:37:46.450224+0000","last_clean":"2024-09-14T11:37:46.450224+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:37:46.450224+0000","last_undegraded":"2024-09-14T11:37:46.450224+0000","last_fullsized":"2024-09-14T11:37:46.450224+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.377262+0000","last_change":"2024-09-14T11:11:57.356515+0000","last_active":"2024-09-14T11:37:46.377262+0000","last_peered":"2024-09-14T11:37:46.377262+0000","last_clean":"2024-09-14T11:37:46.377262+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:37:46.377262+0000","last_undegraded":"2024-09-14T11:37:46.377262+0000","last_fullsized":"2024-09-14T11:37:46.377262+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":82,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.898940+0000","last_change":"2024-09-14T11:10:13.510430+0000","last_active":"2024-09-14T11:35:19.898940+0000","last_peered":"2024-09-14T11:35:19.898940+0000","last_clean":"2024-09-14T11:35:19.898940+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:35:19.898940+0000","last_undegraded":"2024-09-14T11:35:19.898940+0000","last_fullsized":"2024-09-14T11:35:19.898940+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:32:05.548094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897368+0000","last_change":"2024-09-14T11:22:38.560831+0000","last_active":"2024-09-14T11:35:09.897368+0000","last_peered":"2024-09-14T11:35:09.897368+0000","last_clean":"2024-09-14T11:35:09.897368+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:35:09.897368+0000","last_undegraded":"2024-09-14T11:35:09.897368+0000","last_fullsized":"2024-09-14T11:35:09.897368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:48.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903536+0000","last_change":"2024-09-14T11:12:00.368324+0000","last_active":"2024-09-14T11:35:49.903536+0000","last_peered":"2024-09-14T11:35:49.903536+0000","last_clean":"2024-09-14T11:35:49.903536+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:35:49.903536+0000","last_undegraded":"2024-09-14T11:35:49.903536+0000","last_fullsized":"2024-09-14T11:35:49.903536+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.788495+0000","last_change":"2024-09-14T11:11:57.353076+0000","last_active":"2024-09-14T11:37:46.788495+0000","last_peered":"2024-09-14T11:37:46.788495+0000","last_clean":"2024-09-14T11:37:46.788495+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:37:46.788495+0000","last_undegraded":"2024-09-14T11:37:46.788495+0000","last_fullsized":"2024-09-14T11:37:46.788495+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":258,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763621+0000","last_change":"2024-09-14T11:10:13.503079+0000","last_active":"2024-09-14T11:35:13.763621+0000","last_peered":"2024-09-14T11:35:13.763621+0000","last_clean":"2024-09-14T11:35:13.763621+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:35:13.763621+0000","last_undegraded":"2024-09-14T11:35:13.763621+0000","last_fullsized":"2024-09-14T11:35:13.763621+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:19:53.214686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"263'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.869257+0000","last_change":"2024-09-14T11:22:38.555155+0000","last_active":"2024-09-14T11:35:39.869257+0000","last_peered":"2024-09-14T11:35:39.869257+0000","last_clean":"2024-09-14T11:35:39.869257+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:35:39.869257+0000","last_undegraded":"2024-09-14T11:35:39.869257+0000","last_fullsized":"2024-09-14T11:35:39.869257+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:42.625623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:03.777421+0000","last_change":"2024-09-14T11:12:00.367897+0000","last_active":"2024-09-14T11:37:03.777421+0000","last_peered":"2024-09-14T11:37:03.777421+0000","last_clean":"2024-09-14T11:37:03.777421+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:37:03.777421+0000","last_undegraded":"2024-09-14T11:37:03.777421+0000","last_fullsized":"2024-09-14T11:37:03.777421+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:42.946120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15360,"num_write":13,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:59.904769+0000","last_change":"2024-09-14T11:11:57.345965+0000","last_active":"2024-09-14T11:35:59.904769+0000","last_peered":"2024-09-14T11:35:59.904769+0000","last_clean":"2024-09-14T11:35:59.904769+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:35:59.904769+0000","last_undegraded":"2024-09-14T11:35:59.904769+0000","last_fullsized":"2024-09-14T11:35:59.904769+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":192,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880495+0000","last_change":"2024-09-14T11:10:13.502736+0000","last_active":"2024-09-14T11:35:12.880495+0000","last_peered":"2024-09-14T11:35:12.880495+0000","last_clean":"2024-09-14T11:35:12.880495+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:35:12.880495+0000","last_undegraded":"2024-09-14T11:35:12.880495+0000","last_fullsized":"2024-09-14T11:35:12.880495+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:59.444808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.766824+0000","last_change":"2024-09-14T11:22:38.559863+0000","last_active":"2024-09-14T11:35:38.766824+0000","last_peered":"2024-09-14T11:35:38.766824+0000","last_clean":"2024-09-14T11:35:38.766824+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:35:38.766824+0000","last_undegraded":"2024-09-14T11:35:38.766824+0000","last_fullsized":"2024-09-14T11:35:38.766824+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:50.541537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:02.887319+0000","last_change":"2024-09-14T11:12:00.369782+0000","last_active":"2024-09-14T11:36:02.887319+0000","last_peered":"2024-09-14T11:36:02.887319+0000","last_clean":"2024-09-14T11:36:02.887319+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:36:02.887319+0000","last_undegraded":"2024-09-14T11:36:02.887319+0000","last_fullsized":"2024-09-14T11:36:02.887319+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895078+0000","last_change":"2024-09-14T11:11:57.349673+0000","last_active":"2024-09-14T11:34:54.895078+0000","last_peered":"2024-09-14T11:34:54.895078+0000","last_clean":"2024-09-14T11:34:54.895078+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:34:54.895078+0000","last_undegraded":"2024-09-14T11:34:54.895078+0000","last_fullsized":"2024-09-14T11:34:54.895078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.667434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.898118+0000","last_change":"2024-09-14T11:10:13.510473+0000","last_active":"2024-09-14T11:35:14.898118+0000","last_peered":"2024-09-14T11:35:14.898118+0000","last_clean":"2024-09-14T11:35:14.898118+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:35:14.898118+0000","last_undegraded":"2024-09-14T11:35:14.898118+0000","last_fullsized":"2024-09-14T11:35:14.898118+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:52.505231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763071+0000","last_change":"2024-09-14T11:22:38.558952+0000","last_active":"2024-09-14T11:35:08.763071+0000","last_peered":"2024-09-14T11:35:08.763071+0000","last_clean":"2024-09-14T11:35:08.763071+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:35:08.763071+0000","last_undegraded":"2024-09-14T11:35:08.763071+0000","last_fullsized":"2024-09-14T11:35:08.763071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:33.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'5","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.010477+0000","last_change":"2024-09-14T11:12:00.373006+0000","last_active":"2024-09-14T11:37:46.010477+0000","last_peered":"2024-09-14T11:37:46.010477+0000","last_clean":"2024-09-14T11:37:46.010477+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:37:46.010477+0000","last_undegraded":"2024-09-14T11:37:46.010477+0000","last_fullsized":"2024-09-14T11:37:46.010477+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:34.796891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:53.761123+0000","last_change":"2024-09-14T11:11:57.347916+0000","last_active":"2024-09-14T11:34:53.761123+0000","last_peered":"2024-09-14T11:34:53.761123+0000","last_clean":"2024-09-14T11:34:53.761123+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:34:53.761123+0000","last_undegraded":"2024-09-14T11:34:53.761123+0000","last_fullsized":"2024-09-14T11:34:53.761123+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:00.583601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":96,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:14.897710+0000","last_change":"2024-09-14T11:10:13.512991+0000","last_active":"2024-09-14T11:35:14.897710+0000","last_peered":"2024-09-14T11:35:14.897710+0000","last_clean":"2024-09-14T11:35:14.897710+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:35:14.897710+0000","last_undegraded":"2024-09-14T11:35:14.897710+0000","last_fullsized":"2024-09-14T11:35:14.897710+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:49.534421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897492+0000","last_change":"2024-09-14T11:22:38.555840+0000","last_active":"2024-09-14T11:35:09.897492+0000","last_peered":"2024-09-14T11:35:09.897492+0000","last_clean":"2024-09-14T11:35:09.897492+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:35:09.897492+0000","last_undegraded":"2024-09-14T11:35:09.897492+0000","last_fullsized":"2024-09-14T11:35:09.897492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912600+0000","last_change":"2024-09-14T11:12:00.368478+0000","last_active":"2024-09-14T11:36:59.912600+0000","last_peered":"2024-09-14T11:36:59.912600+0000","last_clean":"2024-09-14T11:36:59.912600+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:36:59.912600+0000","last_undegraded":"2024-09-14T11:36:59.912600+0000","last_fullsized":"2024-09-14T11:36:59.912600+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:45.204253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912350+0000","last_change":"2024-09-14T11:11:57.351639+0000","last_active":"2024-09-14T11:36:59.912350+0000","last_peered":"2024-09-14T11:36:59.912350+0000","last_clean":"2024-09-14T11:36:59.912350+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:36:59.912350+0000","last_undegraded":"2024-09-14T11:36:59.912350+0000","last_fullsized":"2024-09-14T11:36:59.912350+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:40:06.738942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":162,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.851175+0000","last_change":"2024-09-14T11:10:13.508247+0000","last_active":"2024-09-14T11:34:59.851175+0000","last_peered":"2024-09-14T11:34:59.851175+0000","last_clean":"2024-09-14T11:34:59.851175+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:34:59.851175+0000","last_undegraded":"2024-09-14T11:34:59.851175+0000","last_fullsized":"2024-09-14T11:34:59.851175+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:28:55.466796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'354","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.994434+0000","last_change":"2024-09-14T11:38:03.994434+0000","last_active":"2024-09-14T11:38:03.994434+0000","last_peered":"2024-09-14T11:38:03.994434+0000","last_clean":"2024-09-14T11:38:03.994434+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:38:03.994434+0000","last_undegraded":"2024-09-14T11:38:03.994434+0000","last_fullsized":"2024-09-14T11:38:03.994434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.994337+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:32.808942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":710,"num_read_kb":163807,"num_write":1157,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":677,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.639109+0000","last_change":"2024-09-14T10:56:08.850638+0000","last_active":"2024-09-14T11:35:15.639109+0000","last_peered":"2024-09-14T11:35:15.639109+0000","last_clean":"2024-09-14T11:35:15.639109+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:35:15.639109+0000","last_undegraded":"2024-09-14T11:35:15.639109+0000","last_fullsized":"2024-09-14T11:35:15.639109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:07.811602+0000","last_clean_scrub_stamp":"2024-09-14T10:56:07.811602+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:41.142178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'345","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.525749+0000","last_change":"2024-09-14T11:38:00.525749+0000","last_active":"2024-09-14T11:38:00.525749+0000","last_peered":"2024-09-14T11:38:00.525749+0000","last_clean":"2024-09-14T11:38:00.525749+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:38:00.525749+0000","last_undegraded":"2024-09-14T11:38:00.525749+0000","last_fullsized":"2024-09-14T11:38:00.525749+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.525650+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:10.105566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":38007,"num_write":1094,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.938486+0000","last_change":"2024-09-14T11:38:12.938486+0000","last_active":"2024-09-14T11:38:12.938486+0000","last_peered":"2024-09-14T11:38:12.938486+0000","last_clean":"2024-09-14T11:38:12.938486+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:38:12.938486+0000","last_undegraded":"2024-09-14T11:38:12.938486+0000","last_fullsized":"2024-09-14T11:38:12.938486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'80","last_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_deep_scrub":"264'80","last_deep_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.938395+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:21.819088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'358","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.091285+0000","last_change":"2024-09-14T11:38:03.091285+0000","last_active":"2024-09-14T11:38:03.091285+0000","last_peered":"2024-09-14T11:38:03.091285+0000","last_clean":"2024-09-14T11:38:03.091285+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:38:03.091285+0000","last_undegraded":"2024-09-14T11:38:03.091285+0000","last_fullsized":"2024-09-14T11:38:03.091285+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.091169+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:56.915196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":108632,"num_write":1075,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.781958+0000","last_change":"2024-09-14T11:38:14.781958+0000","last_active":"2024-09-14T11:38:14.781958+0000","last_peered":"2024-09-14T11:38:14.781958+0000","last_clean":"2024-09-14T11:38:14.781958+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:38:14.781958+0000","last_undegraded":"2024-09-14T11:38:14.781958+0000","last_fullsized":"2024-09-14T11:38:14.781958+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'576","last_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_deep_scrub":"264'576","last_deep_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.781853+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:29.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'362","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.332811+0000","last_change":"2024-09-14T11:37:58.332811+0000","last_active":"2024-09-14T11:37:58.332811+0000","last_peered":"2024-09-14T11:37:58.332811+0000","last_clean":"2024-09-14T11:37:58.332811+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:37:58.332811+0000","last_undegraded":"2024-09-14T11:37:58.332811+0000","last_fullsized":"2024-09-14T11:37:58.332811+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.332673+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.730339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":34002,"num_write":1219,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.136696+0000","last_change":"2024-09-14T11:38:09.136696+0000","last_active":"2024-09-14T11:38:09.136696+0000","last_peered":"2024-09-14T11:38:09.136696+0000","last_clean":"2024-09-14T11:38:09.136696+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:38:09.136696+0000","last_undegraded":"2024-09-14T11:38:09.136696+0000","last_fullsized":"2024-09-14T11:38:09.136696+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.136612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:07.052131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'371","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.973421+0000","last_change":"2024-09-14T11:38:07.973421+0000","last_active":"2024-09-14T11:38:07.973421+0000","last_peered":"2024-09-14T11:38:07.973421+0000","last_clean":"2024-09-14T11:38:07.973421+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:38:07.973421+0000","last_undegraded":"2024-09-14T11:38:07.973421+0000","last_fullsized":"2024-09-14T11:38:07.973421+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'371","last_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_deep_scrub":"264'371","last_deep_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.973335+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.083071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":613,"num_read_kb":21029,"num_write":1146,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.191435+0000","last_change":"2024-09-14T11:38:06.191360+0000","last_active":"2024-09-14T11:38:06.191435+0000","last_peered":"2024-09-14T11:38:06.191435+0000","last_clean":"2024-09-14T11:38:06.191435+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:38:06.191435+0000","last_undegraded":"2024-09-14T11:38:06.191435+0000","last_fullsized":"2024-09-14T11:38:06.191435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.191241+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'405","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.977410+0000","last_change":"2024-09-14T11:38:07.977410+0000","last_active":"2024-09-14T11:38:07.977410+0000","last_peered":"2024-09-14T11:38:07.977410+0000","last_clean":"2024-09-14T11:38:07.977410+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:38:07.977410+0000","last_undegraded":"2024-09-14T11:38:07.977410+0000","last_fullsized":"2024-09-14T11:38:07.977410+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.977308+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.168772+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":29480,"num_write":1192,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4188","reported_seq":4829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.832213+0000","last_change":"2024-09-14T11:38:13.832213+0000","last_active":"2024-09-14T11:38:13.832213+0000","last_peered":"2024-09-14T11:38:13.832213+0000","last_clean":"2024-09-14T11:38:13.832213+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:38:13.832213+0000","last_undegraded":"2024-09-14T11:38:13.832213+0000","last_fullsized":"2024-09-14T11:38:13.832213+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4188","last_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_deep_scrub":"264'4188","last_deep_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.832127+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:18.131503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2876,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'345","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.954476+0000","last_change":"2024-09-14T11:38:02.954476+0000","last_active":"2024-09-14T11:38:02.954476+0000","last_peered":"2024-09-14T11:38:02.954476+0000","last_clean":"2024-09-14T11:38:02.954476+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:38:02.954476+0000","last_undegraded":"2024-09-14T11:38:02.954476+0000","last_fullsized":"2024-09-14T11:38:02.954476+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.954347+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:07.261862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":8679,"num_write":1155,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.013337+0000","last_change":"2024-09-14T11:38:12.013337+0000","last_active":"2024-09-14T11:38:12.013337+0000","last_peered":"2024-09-14T11:38:12.013337+0000","last_clean":"2024-09-14T11:38:12.013337+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:38:12.013337+0000","last_undegraded":"2024-09-14T11:38:12.013337+0000","last_fullsized":"2024-09-14T11:38:12.013337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.013236+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.617466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'444","reported_seq":1183,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.704052+0000","last_change":"2024-09-14T11:38:02.704052+0000","last_active":"2024-09-14T11:38:02.704052+0000","last_peered":"2024-09-14T11:38:02.704052+0000","last_clean":"2024-09-14T11:38:02.704052+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:38:02.704052+0000","last_undegraded":"2024-09-14T11:38:02.704052+0000","last_fullsized":"2024-09-14T11:38:02.704052+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'444","last_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_deep_scrub":"264'444","last_deep_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.703931+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.189735+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1027,"num_read_kb":48878,"num_write":1330,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.285228+0000","last_change":"2024-09-14T11:38:05.285228+0000","last_active":"2024-09-14T11:38:05.285228+0000","last_peered":"2024-09-14T11:38:05.285228+0000","last_clean":"2024-09-14T11:38:05.285228+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:38:05.285228+0000","last_undegraded":"2024-09-14T11:38:05.285228+0000","last_fullsized":"2024-09-14T11:38:05.285228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.285135+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:29.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.838913+0000","last_change":"2024-09-14T11:38:10.838913+0000","last_active":"2024-09-14T11:38:10.838913+0000","last_peered":"2024-09-14T11:38:10.838913+0000","last_clean":"2024-09-14T11:38:10.838913+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:38:10.838913+0000","last_undegraded":"2024-09-14T11:38:10.838913+0000","last_fullsized":"2024-09-14T11:38:10.838913+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.838796+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:42.132159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'355","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.289296+0000","last_change":"2024-09-14T11:37:57.289296+0000","last_active":"2024-09-14T11:37:57.289296+0000","last_peered":"2024-09-14T11:37:57.289296+0000","last_clean":"2024-09-14T11:37:57.289296+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:37:57.289296+0000","last_undegraded":"2024-09-14T11:37:57.289296+0000","last_fullsized":"2024-09-14T11:37:57.289296+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.289198+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:54.356710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":655,"num_read_kb":81454,"num_write":1158,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.996771+0000","last_change":"2024-09-14T11:38:10.996771+0000","last_active":"2024-09-14T11:38:10.996771+0000","last_peered":"2024-09-14T11:38:10.996771+0000","last_clean":"2024-09-14T11:38:10.996771+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:38:10.996771+0000","last_undegraded":"2024-09-14T11:38:10.996771+0000","last_fullsized":"2024-09-14T11:38:10.996771+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.996672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:38.298661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'372","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.204888+0000","last_change":"2024-09-14T11:38:02.204888+0000","last_active":"2024-09-14T11:38:02.204888+0000","last_peered":"2024-09-14T11:38:02.204888+0000","last_clean":"2024-09-14T11:38:02.204888+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:38:02.204888+0000","last_undegraded":"2024-09-14T11:38:02.204888+0000","last_fullsized":"2024-09-14T11:38:02.204888+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.204768+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:29.702067+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1102,"num_read_kb":13751,"num_write":1178,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":787,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.996296+0000","last_change":"2024-09-14T11:38:09.996296+0000","last_active":"2024-09-14T11:38:09.996296+0000","last_peered":"2024-09-14T11:38:09.996296+0000","last_clean":"2024-09-14T11:38:09.996296+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:38:09.996296+0000","last_undegraded":"2024-09-14T11:38:09.996296+0000","last_fullsized":"2024-09-14T11:38:09.996296+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.996212+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.770213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'324","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.247962+0000","last_change":"2024-09-14T11:38:01.247962+0000","last_active":"2024-09-14T11:38:01.247962+0000","last_peered":"2024-09-14T11:38:01.247962+0000","last_clean":"2024-09-14T11:38:01.247962+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:38:01.247962+0000","last_undegraded":"2024-09-14T11:38:01.247962+0000","last_fullsized":"2024-09-14T11:38:01.247962+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.247834+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:08.750152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":2147,"num_write":1090,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.263789+0000","last_change":"2024-09-14T11:38:02.263789+0000","last_active":"2024-09-14T11:38:02.263789+0000","last_peered":"2024-09-14T11:38:02.263789+0000","last_clean":"2024-09-14T11:38:02.263789+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:38:02.263789+0000","last_undegraded":"2024-09-14T11:38:02.263789+0000","last_fullsized":"2024-09-14T11:38:02.263789+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.263694+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:48.528551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'372","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.783570+0000","last_change":"2024-09-14T11:37:57.783570+0000","last_active":"2024-09-14T11:37:57.783570+0000","last_peered":"2024-09-14T11:37:57.783570+0000","last_clean":"2024-09-14T11:37:57.783570+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:57.783570+0000","last_undegraded":"2024-09-14T11:37:57.783570+0000","last_fullsized":"2024-09-14T11:37:57.783570+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.783470+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:52.425734+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655890,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":45139,"num_write":1131,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.254892+0000","last_change":"2024-09-14T11:38:03.254892+0000","last_active":"2024-09-14T11:38:03.254892+0000","last_peered":"2024-09-14T11:38:03.254892+0000","last_clean":"2024-09-14T11:38:03.254892+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:38:03.254892+0000","last_undegraded":"2024-09-14T11:38:03.254892+0000","last_fullsized":"2024-09-14T11:38:03.254892+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.254797+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:24.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'359","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.750138+0000","last_change":"2024-09-14T11:38:03.750138+0000","last_active":"2024-09-14T11:38:03.750138+0000","last_peered":"2024-09-14T11:38:03.750138+0000","last_clean":"2024-09-14T11:38:03.750138+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:38:03.750138+0000","last_undegraded":"2024-09-14T11:38:03.750138+0000","last_fullsized":"2024-09-14T11:38:03.750138+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.750052+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:22.099690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":91641,"num_write":1162,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.839755+0000","last_change":"2024-09-14T11:38:12.839755+0000","last_active":"2024-09-14T11:38:12.839755+0000","last_peered":"2024-09-14T11:38:12.839755+0000","last_clean":"2024-09-14T11:38:12.839755+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:38:12.839755+0000","last_undegraded":"2024-09-14T11:38:12.839755+0000","last_fullsized":"2024-09-14T11:38:12.839755+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.839644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:27.847410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'339","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.127943+0000","last_change":"2024-09-14T11:38:00.127943+0000","last_active":"2024-09-14T11:38:00.127943+0000","last_peered":"2024-09-14T11:38:00.127943+0000","last_clean":"2024-09-14T11:38:00.127943+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:38:00.127943+0000","last_undegraded":"2024-09-14T11:38:00.127943+0000","last_fullsized":"2024-09-14T11:38:00.127943+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.127836+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:41.934910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":12785,"num_write":1085,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'137","reported_seq":644,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.632102+0000","last_change":"2024-09-14T10:56:16.877295+0000","last_active":"2024-09-14T11:37:14.632102+0000","last_peered":"2024-09-14T11:37:14.632102+0000","last_clean":"2024-09-14T11:37:14.632102+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:37:14.632102+0000","last_undegraded":"2024-09-14T11:37:14.632102+0000","last_fullsized":"2024-09-14T11:37:14.632102+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:56.149162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.802655+0000","last_change":"2024-09-14T11:38:07.802553+0000","last_active":"2024-09-14T11:38:07.802655+0000","last_peered":"2024-09-14T11:38:07.802655+0000","last_clean":"2024-09-14T11:38:07.802655+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:38:07.802655+0000","last_undegraded":"2024-09-14T11:38:07.802655+0000","last_fullsized":"2024-09-14T11:38:07.802655+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.802440+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:22.163602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'369","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.971493+0000","last_change":"2024-09-14T11:38:01.971426+0000","last_active":"2024-09-14T11:38:01.971493+0000","last_peered":"2024-09-14T11:38:01.971493+0000","last_clean":"2024-09-14T11:38:01.971493+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:38:01.971493+0000","last_undegraded":"2024-09-14T11:38:01.971493+0000","last_fullsized":"2024-09-14T11:38:01.971493+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.971327+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:34.955599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":841,"num_read_kb":1723,"num_write":1205,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877333+0000","last_change":"2024-09-14T10:56:10.848176+0000","last_active":"2024-09-14T11:34:52.877333+0000","last_peered":"2024-09-14T11:34:52.877333+0000","last_clean":"2024-09-14T11:34:52.877333+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:34:52.877333+0000","last_undegraded":"2024-09-14T11:34:52.877333+0000","last_fullsized":"2024-09-14T11:34:52.877333+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:35.018887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'364","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.332097+0000","last_change":"2024-09-14T10:56:12.850634+0000","last_active":"2024-09-14T11:37:46.332097+0000","last_peered":"2024-09-14T11:37:46.332097+0000","last_clean":"2024-09-14T11:37:46.332097+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:37:46.332097+0000","last_undegraded":"2024-09-14T11:37:46.332097+0000","last_fullsized":"2024-09-14T11:37:46.332097+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:49.295285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48907,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":593,"num_read_kb":1292,"num_write":484,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895276+0000","last_change":"2024-09-14T10:56:14.867772+0000","last_active":"2024-09-14T11:34:54.895276+0000","last_peered":"2024-09-14T11:34:54.895276+0000","last_clean":"2024-09-14T11:34:54.895276+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:34:54.895276+0000","last_undegraded":"2024-09-14T11:34:54.895276+0000","last_fullsized":"2024-09-14T11:34:54.895276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:36.827998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2488","reported_seq":4301,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.535039+0000","last_change":"2024-09-14T10:56:16.878623+0000","last_active":"2024-09-14T11:35:54.535039+0000","last_peered":"2024-09-14T11:35:54.535039+0000","last_clean":"2024-09-14T11:35:54.535039+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:35:54.535039+0000","last_undegraded":"2024-09-14T11:35:54.535039+0000","last_fullsized":"2024-09-14T11:35:54.535039+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":2400,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:27:03.600811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.933553+0000","last_change":"2024-09-14T11:38:05.933553+0000","last_active":"2024-09-14T11:38:05.933553+0000","last_peered":"2024-09-14T11:38:05.933553+0000","last_clean":"2024-09-14T11:38:05.933553+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:38:05.933553+0000","last_undegraded":"2024-09-14T11:38:05.933553+0000","last_fullsized":"2024-09-14T11:38:05.933553+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'270","last_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_deep_scrub":"264'270","last_deep_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.933442+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:27.514791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'317","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.214481+0000","last_change":"2024-09-14T11:37:54.214379+0000","last_active":"2024-09-14T11:37:54.214481+0000","last_peered":"2024-09-14T11:37:54.214481+0000","last_clean":"2024-09-14T11:37:54.214481+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:37:54.214481+0000","last_undegraded":"2024-09-14T11:37:54.214481+0000","last_fullsized":"2024-09-14T11:37:54.214481+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.214277+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:04.066988+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":41365,"num_write":992,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.763679+0000","last_change":"2024-09-14T11:38:14.763679+0000","last_active":"2024-09-14T11:38:14.763679+0000","last_peered":"2024-09-14T11:38:14.763679+0000","last_clean":"2024-09-14T11:38:14.763679+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:38:14.763679+0000","last_undegraded":"2024-09-14T11:38:14.763679+0000","last_fullsized":"2024-09-14T11:38:14.763679+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.763569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:12.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'88","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.440429+0000","last_change":"2024-09-14T10:56:12.850155+0000","last_active":"2024-09-14T11:36:21.440429+0000","last_peered":"2024-09-14T11:36:21.440429+0000","last_clean":"2024-09-14T11:36:21.440429+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:36:21.440429+0000","last_undegraded":"2024-09-14T11:36:21.440429+0000","last_fullsized":"2024-09-14T11:36:21.440429+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":0,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:58.551957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895419+0000","last_change":"2024-09-14T10:56:14.865727+0000","last_active":"2024-09-14T11:34:54.895419+0000","last_peered":"2024-09-14T11:34:54.895419+0000","last_clean":"2024-09-14T11:34:54.895419+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:34:54.895419+0000","last_undegraded":"2024-09-14T11:34:54.895419+0000","last_fullsized":"2024-09-14T11:34:54.895419+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:54:33.497143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'124","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:26.497858+0000","last_change":"2024-09-14T10:56:16.878997+0000","last_active":"2024-09-14T11:35:26.497858+0000","last_peered":"2024-09-14T11:35:26.497858+0000","last_clean":"2024-09-14T11:35:26.497858+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:35:26.497858+0000","last_undegraded":"2024-09-14T11:35:26.497858+0000","last_fullsized":"2024-09-14T11:35:26.497858+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:15:40.199776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.169189+0000","last_change":"2024-09-14T11:38:06.169189+0000","last_active":"2024-09-14T11:38:06.169189+0000","last_peered":"2024-09-14T11:38:06.169189+0000","last_clean":"2024-09-14T11:38:06.169189+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:38:06.169189+0000","last_undegraded":"2024-09-14T11:38:06.169189+0000","last_fullsized":"2024-09-14T11:38:06.169189+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.169106+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:13.055830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'356","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.996393+0000","last_change":"2024-09-14T11:37:58.996323+0000","last_active":"2024-09-14T11:37:58.996393+0000","last_peered":"2024-09-14T11:37:58.996393+0000","last_clean":"2024-09-14T11:37:58.996393+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:37:58.996393+0000","last_undegraded":"2024-09-14T11:37:58.996393+0000","last_fullsized":"2024-09-14T11:37:58.996393+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.996219+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:49.905581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":14993,"num_write":1137,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:55.607291+0000","last_change":"2024-09-14T10:56:10.847524+0000","last_active":"2024-09-14T11:34:55.607291+0000","last_peered":"2024-09-14T11:34:55.607291+0000","last_clean":"2024-09-14T11:34:55.607291+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:34:55.607291+0000","last_undegraded":"2024-09-14T11:34:55.607291+0000","last_fullsized":"2024-09-14T11:34:55.607291+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:41:14.642527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'119","reported_seq":656,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.313797+0000","last_change":"2024-09-14T11:38:10.313797+0000","last_active":"2024-09-14T11:38:10.313797+0000","last_peered":"2024-09-14T11:38:10.313797+0000","last_clean":"2024-09-14T11:38:10.313797+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:38:10.313797+0000","last_undegraded":"2024-09-14T11:38:10.313797+0000","last_fullsized":"2024-09-14T11:38:10.313797+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.313671+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:12.772415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'760","reported_seq":2177,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.747256+0000","last_change":"2024-09-14T10:56:14.861391+0000","last_active":"2024-09-14T11:37:46.747256+0000","last_peered":"2024-09-14T11:37:46.747256+0000","last_clean":"2024-09-14T11:37:46.747256+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:37:46.747256+0000","last_undegraded":"2024-09-14T11:37:46.747256+0000","last_fullsized":"2024-09-14T11:37:46.747256+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:19:33.703884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'240","reported_seq":1108,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.745307+0000","last_change":"2024-09-14T10:56:16.865049+0000","last_active":"2024-09-14T11:35:56.745307+0000","last_peered":"2024-09-14T11:35:56.745307+0000","last_clean":"2024-09-14T11:35:56.745307+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:35:56.745307+0000","last_undegraded":"2024-09-14T11:35:56.745307+0000","last_fullsized":"2024-09-14T11:35:56.745307+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:59.143467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4157","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.796045+0000","last_change":"2024-09-14T11:38:08.796045+0000","last_active":"2024-09-14T11:38:08.796045+0000","last_peered":"2024-09-14T11:38:08.796045+0000","last_clean":"2024-09-14T11:38:08.796045+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:38:08.796045+0000","last_undegraded":"2024-09-14T11:38:08.796045+0000","last_fullsized":"2024-09-14T11:38:08.796045+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4157","last_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_deep_scrub":"264'4157","last_deep_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.795955+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":3000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:56.535050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'336","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.207574+0000","last_change":"2024-09-14T11:37:57.207516+0000","last_active":"2024-09-14T11:37:57.207574+0000","last_peered":"2024-09-14T11:37:57.207574+0000","last_clean":"2024-09-14T11:37:57.207574+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:37:57.207574+0000","last_undegraded":"2024-09-14T11:37:57.207574+0000","last_fullsized":"2024-09-14T11:37:57.207574+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.207427+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:13.344531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":30569,"num_write":1024,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:52.877363+0000","last_change":"2024-09-14T10:56:10.839414+0000","last_active":"2024-09-14T11:34:52.877363+0000","last_peered":"2024-09-14T11:34:52.877363+0000","last_clean":"2024-09-14T11:34:52.877363+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:34:52.877363+0000","last_undegraded":"2024-09-14T11:34:52.877363+0000","last_fullsized":"2024-09-14T11:34:52.877363+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:56.422012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'290","reported_seq":849,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.160375+0000","last_change":"2024-09-14T10:56:13.041543+0000","last_active":"2024-09-14T11:37:46.160375+0000","last_peered":"2024-09-14T11:37:46.160375+0000","last_clean":"2024-09-14T11:37:46.160375+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:37:46.160375+0000","last_undegraded":"2024-09-14T11:37:46.160375+0000","last_fullsized":"2024-09-14T11:37:46.160375+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":200,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:02:02.191878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":1245,"num_write":424,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'794","reported_seq":2254,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.797123+0000","last_change":"2024-09-14T10:56:14.859370+0000","last_active":"2024-09-14T11:37:45.797123+0000","last_peered":"2024-09-14T11:37:45.797123+0000","last_clean":"2024-09-14T11:37:45.797123+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:37:45.797123+0000","last_undegraded":"2024-09-14T11:37:45.797123+0000","last_fullsized":"2024-09-14T11:37:45.797123+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:44:34.411310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.901270+0000","last_change":"2024-09-14T11:38:04.901270+0000","last_active":"2024-09-14T11:38:04.901270+0000","last_peered":"2024-09-14T11:38:04.901270+0000","last_clean":"2024-09-14T11:38:04.901270+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:38:04.901270+0000","last_undegraded":"2024-09-14T11:38:04.901270+0000","last_fullsized":"2024-09-14T11:38:04.901270+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.901185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:34.668649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'335","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.980161+0000","last_change":"2024-09-14T11:37:59.980161+0000","last_active":"2024-09-14T11:37:59.980161+0000","last_peered":"2024-09-14T11:37:59.980161+0000","last_clean":"2024-09-14T11:37:59.980161+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:59.980161+0000","last_undegraded":"2024-09-14T11:37:59.980161+0000","last_fullsized":"2024-09-14T11:37:59.980161+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.980047+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:02.870696+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":515,"num_read_kb":9228,"num_write":1120,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.951810+0000","last_change":"2024-09-14T11:38:11.951810+0000","last_active":"2024-09-14T11:38:11.951810+0000","last_peered":"2024-09-14T11:38:11.951810+0000","last_clean":"2024-09-14T11:38:11.951810+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:38:11.951810+0000","last_undegraded":"2024-09-14T11:38:11.951810+0000","last_fullsized":"2024-09-14T11:38:11.951810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.951722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:21.559571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'360","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.483385+0000","last_change":"2024-09-14T10:56:13.041185+0000","last_active":"2024-09-14T11:37:46.483385+0000","last_peered":"2024-09-14T11:37:46.483385+0000","last_clean":"2024-09-14T11:37:46.483385+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:37:46.483385+0000","last_undegraded":"2024-09-14T11:37:46.483385+0000","last_fullsized":"2024-09-14T11:37:46.483385+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:05.840561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":1214,"num_write":460,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":484,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:33.758510+0000","last_change":"2024-09-14T10:56:14.867306+0000","last_active":"2024-09-14T11:34:33.758510+0000","last_peered":"2024-09-14T11:34:33.758510+0000","last_clean":"2024-09-14T11:34:33.758510+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:34:33.758510+0000","last_undegraded":"2024-09-14T11:34:33.758510+0000","last_fullsized":"2024-09-14T11:34:33.758510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:40:08.141850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'546","reported_seq":1359,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.636060+0000","last_change":"2024-09-14T10:56:16.873797+0000","last_active":"2024-09-14T11:37:14.636060+0000","last_peered":"2024-09-14T11:37:14.636060+0000","last_clean":"2024-09-14T11:37:14.636060+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:37:14.636060+0000","last_undegraded":"2024-09-14T11:37:14.636060+0000","last_fullsized":"2024-09-14T11:37:14.636060+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":500,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.778887+0000","last_change":"2024-09-14T11:38:00.778887+0000","last_active":"2024-09-14T11:38:00.778887+0000","last_peered":"2024-09-14T11:38:00.778887+0000","last_clean":"2024-09-14T11:38:00.778887+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:38:00.778887+0000","last_undegraded":"2024-09-14T11:38:00.778887+0000","last_fullsized":"2024-09-14T11:38:00.778887+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.778798+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:57.572541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'264","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.924217+0000","last_change":"2024-09-14T11:37:56.924217+0000","last_active":"2024-09-14T11:37:56.924217+0000","last_peered":"2024-09-14T11:37:56.924217+0000","last_clean":"2024-09-14T11:37:56.924217+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:37:56.924217+0000","last_undegraded":"2024-09-14T11:37:56.924217+0000","last_fullsized":"2024-09-14T11:37:56.924217+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.924115+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:59.368338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":56700,"num_write":826,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.288085+0000","last_change":"2024-09-14T11:38:11.288085+0000","last_active":"2024-09-14T11:38:11.288085+0000","last_peered":"2024-09-14T11:38:11.288085+0000","last_clean":"2024-09-14T11:38:11.288085+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:38:11.288085+0000","last_undegraded":"2024-09-14T11:38:11.288085+0000","last_fullsized":"2024-09-14T11:38:11.288085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.287976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:47.086536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'269","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.971714+0000","last_change":"2024-09-14T10:56:12.849959+0000","last_active":"2024-09-14T11:37:46.971714+0000","last_peered":"2024-09-14T11:37:46.971714+0000","last_clean":"2024-09-14T11:37:46.971714+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:37:46.971714+0000","last_undegraded":"2024-09-14T11:37:46.971714+0000","last_fullsized":"2024-09-14T11:37:46.971714+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:35:51.049544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71588,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1104,"num_write":366,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610430+0000","last_change":"2024-09-14T10:56:14.859113+0000","last_active":"2024-09-14T11:35:20.610430+0000","last_peered":"2024-09-14T11:35:20.610430+0000","last_clean":"2024-09-14T11:35:20.610430+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:35:20.610430+0000","last_undegraded":"2024-09-14T11:35:20.610430+0000","last_fullsized":"2024-09-14T11:35:20.610430+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:39.449429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'114","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:04.418600+0000","last_change":"2024-09-14T10:56:16.872299+0000","last_active":"2024-09-14T11:37:04.418600+0000","last_peered":"2024-09-14T11:37:04.418600+0000","last_clean":"2024-09-14T11:37:04.418600+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:37:04.418600+0000","last_undegraded":"2024-09-14T11:37:04.418600+0000","last_fullsized":"2024-09-14T11:37:04.418600+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.211512+0000","last_change":"2024-09-14T11:38:04.211512+0000","last_active":"2024-09-14T11:38:04.211512+0000","last_peered":"2024-09-14T11:38:04.211512+0000","last_clean":"2024-09-14T11:38:04.211512+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:38:04.211512+0000","last_undegraded":"2024-09-14T11:38:04.211512+0000","last_fullsized":"2024-09-14T11:38:04.211512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.211394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:16.244988+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'451","reported_seq":1163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.971521+0000","last_change":"2024-09-14T11:38:04.971521+0000","last_active":"2024-09-14T11:38:04.971521+0000","last_peered":"2024-09-14T11:38:04.971521+0000","last_clean":"2024-09-14T11:38:04.971521+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:38:04.971521+0000","last_undegraded":"2024-09-14T11:38:04.971521+0000","last_fullsized":"2024-09-14T11:38:04.971521+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'451","last_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_deep_scrub":"264'451","last_deep_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.971423+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:55.099273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":972,"num_read_kb":28710,"num_write":1673,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.263318+0000","last_change":"2024-09-14T11:38:06.263318+0000","last_active":"2024-09-14T11:38:06.263318+0000","last_peered":"2024-09-14T11:38:06.263318+0000","last_clean":"2024-09-14T11:38:06.263318+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:38:06.263318+0000","last_undegraded":"2024-09-14T11:38:06.263318+0000","last_fullsized":"2024-09-14T11:38:06.263318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.263219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:07.707286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'307","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.556330+0000","last_change":"2024-09-14T10:56:12.847492+0000","last_active":"2024-09-14T11:37:46.556330+0000","last_peered":"2024-09-14T11:37:46.556330+0000","last_clean":"2024-09-14T11:37:46.556330+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:37:46.556330+0000","last_undegraded":"2024-09-14T11:37:46.556330+0000","last_fullsized":"2024-09-14T11:37:46.556330+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:44:45.170095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50445,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":514,"num_read_kb":1159,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'778","reported_seq":4223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.858940+0000","last_change":"2024-09-14T10:56:14.863301+0000","last_active":"2024-09-14T11:37:46.858940+0000","last_peered":"2024-09-14T11:37:46.858940+0000","last_clean":"2024-09-14T11:37:46.858940+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:37:46.858940+0000","last_undegraded":"2024-09-14T11:37:46.858940+0000","last_fullsized":"2024-09-14T11:37:46.858940+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":701,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:36:01.064582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'98","reported_seq":593,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.458613+0000","last_change":"2024-09-14T10:56:16.877915+0000","last_active":"2024-09-14T11:37:13.458613+0000","last_peered":"2024-09-14T11:37:13.458613+0000","last_clean":"2024-09-14T11:37:13.458613+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:37:13.458613+0000","last_undegraded":"2024-09-14T11:37:13.458613+0000","last_fullsized":"2024-09-14T11:37:13.458613+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:11:25.564431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.128232+0000","last_change":"2024-09-14T11:38:04.128232+0000","last_active":"2024-09-14T11:38:04.128232+0000","last_peered":"2024-09-14T11:38:04.128232+0000","last_clean":"2024-09-14T11:38:04.128232+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:38:04.128232+0000","last_undegraded":"2024-09-14T11:38:04.128232+0000","last_fullsized":"2024-09-14T11:38:04.128232+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.128119+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:06.336903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'318","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.011358+0000","last_change":"2024-09-14T11:37:58.011358+0000","last_active":"2024-09-14T11:37:58.011358+0000","last_peered":"2024-09-14T11:37:58.011358+0000","last_clean":"2024-09-14T11:37:58.011358+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:37:58.011358+0000","last_undegraded":"2024-09-14T11:37:58.011358+0000","last_fullsized":"2024-09-14T11:37:58.011358+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.011270+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.504722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":39728,"num_write":960,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.272195+0000","last_change":"2024-09-14T11:38:07.272195+0000","last_active":"2024-09-14T11:38:07.272195+0000","last_peered":"2024-09-14T11:38:07.272195+0000","last_clean":"2024-09-14T11:38:07.272195+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:38:07.272195+0000","last_undegraded":"2024-09-14T11:38:07.272195+0000","last_fullsized":"2024-09-14T11:38:07.272195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.272107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:15.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'463","reported_seq":1085,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.643327+0000","last_change":"2024-09-14T10:56:12.850654+0000","last_active":"2024-09-14T11:37:46.643327+0000","last_peered":"2024-09-14T11:37:46.643327+0000","last_clean":"2024-09-14T11:37:46.643327+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:37:46.643327+0000","last_undegraded":"2024-09-14T11:37:46.643327+0000","last_fullsized":"2024-09-14T11:37:46.643327+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:01.231786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91900,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":1934,"num_write":662,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.264563+0000","last_change":"2024-09-14T11:38:12.264563+0000","last_active":"2024-09-14T11:38:12.264563+0000","last_peered":"2024-09-14T11:38:12.264563+0000","last_clean":"2024-09-14T11:38:12.264563+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:38:12.264563+0000","last_undegraded":"2024-09-14T11:38:12.264563+0000","last_fullsized":"2024-09-14T11:38:12.264563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.264469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:48.042054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'106","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764320+0000","last_change":"2024-09-14T10:56:16.874312+0000","last_active":"2024-09-14T11:35:18.764320+0000","last_peered":"2024-09-14T11:35:18.764320+0000","last_clean":"2024-09-14T11:35:18.764320+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:35:18.764320+0000","last_undegraded":"2024-09-14T11:35:18.764320+0000","last_fullsized":"2024-09-14T11:35:18.764320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:14:06.689124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'257","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.818689+0000","last_change":"2024-09-14T11:38:01.818689+0000","last_active":"2024-09-14T11:38:01.818689+0000","last_peered":"2024-09-14T11:38:01.818689+0000","last_clean":"2024-09-14T11:38:01.818689+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:38:01.818689+0000","last_undegraded":"2024-09-14T11:38:01.818689+0000","last_fullsized":"2024-09-14T11:38:01.818689+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.818609+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.995103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'339","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.801227+0000","last_change":"2024-09-14T11:37:56.801227+0000","last_active":"2024-09-14T11:37:56.801227+0000","last_peered":"2024-09-14T11:37:56.801227+0000","last_clean":"2024-09-14T11:37:56.801227+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:37:56.801227+0000","last_undegraded":"2024-09-14T11:37:56.801227+0000","last_fullsized":"2024-09-14T11:37:56.801227+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.801100+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:49.585646+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":517,"num_read_kb":5559,"num_write":1004,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.269139+0000","last_change":"2024-09-14T11:38:09.269139+0000","last_active":"2024-09-14T11:38:09.269139+0000","last_peered":"2024-09-14T11:38:09.269139+0000","last_clean":"2024-09-14T11:38:09.269139+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:38:09.269139+0000","last_undegraded":"2024-09-14T11:38:09.269139+0000","last_fullsized":"2024-09-14T11:38:09.269139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:19.458046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'278","reported_seq":853,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.936954+0000","last_change":"2024-09-14T10:56:12.851527+0000","last_active":"2024-09-14T11:37:45.936954+0000","last_peered":"2024-09-14T11:37:45.936954+0000","last_clean":"2024-09-14T11:37:45.936954+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:37:45.936954+0000","last_undegraded":"2024-09-14T11:37:45.936954+0000","last_fullsized":"2024-09-14T11:37:45.936954+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":200,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:56.803494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43790,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1041,"num_write":430,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759906+0000","last_change":"2024-09-14T10:56:14.862397+0000","last_active":"2024-09-14T11:34:43.759906+0000","last_peered":"2024-09-14T11:34:43.759906+0000","last_clean":"2024-09-14T11:34:43.759906+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:34:43.759906+0000","last_undegraded":"2024-09-14T11:34:43.759906+0000","last_fullsized":"2024-09-14T11:34:43.759906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:41.399153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'106","reported_seq":612,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:25.618639+0000","last_change":"2024-09-14T10:56:16.877499+0000","last_active":"2024-09-14T11:36:25.618639+0000","last_peered":"2024-09-14T11:36:25.618639+0000","last_clean":"2024-09-14T11:36:25.618639+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:36:25.618639+0000","last_undegraded":"2024-09-14T11:36:25.618639+0000","last_fullsized":"2024-09-14T11:36:25.618639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:22.117249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'105","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.801454+0000","last_change":"2024-09-14T11:38:02.801454+0000","last_active":"2024-09-14T11:38:02.801454+0000","last_peered":"2024-09-14T11:38:02.801454+0000","last_clean":"2024-09-14T11:38:02.801454+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:38:02.801454+0000","last_undegraded":"2024-09-14T11:38:02.801454+0000","last_fullsized":"2024-09-14T11:38:02.801454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.801328+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:52.213904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'384","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.201690+0000","last_change":"2024-09-14T11:37:56.201690+0000","last_active":"2024-09-14T11:37:56.201690+0000","last_peered":"2024-09-14T11:37:56.201690+0000","last_clean":"2024-09-14T11:37:56.201690+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:37:56.201690+0000","last_undegraded":"2024-09-14T11:37:56.201690+0000","last_fullsized":"2024-09-14T11:37:56.201690+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.201429+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:20.816954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":626,"num_read_kb":12205,"num_write":1169,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.514696+0000","last_change":"2024-09-14T11:38:06.514696+0000","last_active":"2024-09-14T11:38:06.514696+0000","last_peered":"2024-09-14T11:38:06.514696+0000","last_clean":"2024-09-14T11:38:06.514696+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:38:06.514696+0000","last_undegraded":"2024-09-14T11:38:06.514696+0000","last_fullsized":"2024-09-14T11:38:06.514696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.514607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.514163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'297","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.303289+0000","last_change":"2024-09-14T11:38:08.303289+0000","last_active":"2024-09-14T11:38:08.303289+0000","last_peered":"2024-09-14T11:38:08.303289+0000","last_clean":"2024-09-14T11:38:08.303289+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:38:08.303289+0000","last_undegraded":"2024-09-14T11:38:08.303289+0000","last_fullsized":"2024-09-14T11:38:08.303289+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.303187+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:25.035256+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1133,"num_write":410,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'727","reported_seq":2202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.270091+0000","last_change":"2024-09-14T11:38:13.270091+0000","last_active":"2024-09-14T11:38:13.270091+0000","last_peered":"2024-09-14T11:38:13.270091+0000","last_clean":"2024-09-14T11:38:13.270091+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:38:13.270091+0000","last_undegraded":"2024-09-14T11:38:13.270091+0000","last_fullsized":"2024-09-14T11:38:13.270091+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'727","last_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_deep_scrub":"264'727","last_deep_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.270000+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":701,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:03.387188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'138","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:53.768681+0000","last_change":"2024-09-14T10:56:16.873210+0000","last_active":"2024-09-14T11:35:53.768681+0000","last_peered":"2024-09-14T11:35:53.768681+0000","last_clean":"2024-09-14T11:35:53.768681+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:35:53.768681+0000","last_undegraded":"2024-09-14T11:35:53.768681+0000","last_fullsized":"2024-09-14T11:35:53.768681+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'173","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.828980+0000","last_change":"2024-09-14T11:38:04.828980+0000","last_active":"2024-09-14T11:38:04.828980+0000","last_peered":"2024-09-14T11:38:04.828980+0000","last_clean":"2024-09-14T11:38:04.828980+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:38:04.828980+0000","last_undegraded":"2024-09-14T11:38:04.828980+0000","last_fullsized":"2024-09-14T11:38:04.828980+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.828885+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:49.181800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'330","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.801255+0000","last_change":"2024-09-14T11:37:55.801255+0000","last_active":"2024-09-14T11:37:55.801255+0000","last_peered":"2024-09-14T11:37:55.801255+0000","last_clean":"2024-09-14T11:37:55.801255+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:37:55.801255+0000","last_undegraded":"2024-09-14T11:37:55.801255+0000","last_fullsized":"2024-09-14T11:37:55.801255+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.801142+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:31.011642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":8777,"num_write":1001,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"28'2","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.571412+0000","last_change":"2024-09-14T10:56:10.849165+0000","last_active":"2024-09-14T11:37:45.571412+0000","last_peered":"2024-09-14T11:37:45.571412+0000","last_clean":"2024-09-14T11:37:45.571412+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:37:45.571412+0000","last_undegraded":"2024-09-14T11:37:45.571412+0000","last_fullsized":"2024-09-14T11:37:45.571412+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:00.894650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'78","reported_seq":588,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.427200+0000","last_change":"2024-09-14T10:56:13.041348+0000","last_active":"2024-09-14T11:36:21.427200+0000","last_peered":"2024-09-14T11:36:21.427200+0000","last_clean":"2024-09-14T11:36:21.427200+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:36:21.427200+0000","last_undegraded":"2024-09-14T11:36:21.427200+0000","last_fullsized":"2024-09-14T11:36:21.427200+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:28.818595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.096488+0000","last_change":"2024-09-14T11:38:13.096488+0000","last_active":"2024-09-14T11:38:13.096488+0000","last_peered":"2024-09-14T11:38:13.096488+0000","last_clean":"2024-09-14T11:38:13.096488+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:38:13.096488+0000","last_undegraded":"2024-09-14T11:38:13.096488+0000","last_fullsized":"2024-09-14T11:38:13.096488+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.096403+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.180002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'149","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.697577+0000","last_change":"2024-09-14T10:56:16.870911+0000","last_active":"2024-09-14T11:35:56.697577+0000","last_peered":"2024-09-14T11:35:56.697577+0000","last_clean":"2024-09-14T11:35:56.697577+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:35:56.697577+0000","last_undegraded":"2024-09-14T11:35:56.697577+0000","last_fullsized":"2024-09-14T11:35:56.697577+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'626","reported_seq":1473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.531675+0000","last_change":"2024-09-14T11:38:02.531675+0000","last_active":"2024-09-14T11:38:02.531675+0000","last_peered":"2024-09-14T11:38:02.531675+0000","last_clean":"2024-09-14T11:38:02.531675+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:38:02.531675+0000","last_undegraded":"2024-09-14T11:38:02.531675+0000","last_fullsized":"2024-09-14T11:38:02.531675+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.531585+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:49.257771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25760,"num_omap_keys":101,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'395","reported_seq":1169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.842500+0000","last_change":"2024-09-14T11:37:54.842500+0000","last_active":"2024-09-14T11:37:54.842500+0000","last_peered":"2024-09-14T11:37:54.842500+0000","last_clean":"2024-09-14T11:37:54.842500+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:37:54.842500+0000","last_undegraded":"2024-09-14T11:37:54.842500+0000","last_fullsized":"2024-09-14T11:37:54.842500+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.842395+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:06.443569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1140,"num_read_kb":48198,"num_write":1212,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891740+0000","last_change":"2024-09-14T10:56:10.850019+0000","last_active":"2024-09-14T11:34:29.891740+0000","last_peered":"2024-09-14T11:34:29.891740+0000","last_clean":"2024-09-14T11:34:29.891740+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:34:29.891740+0000","last_undegraded":"2024-09-14T11:34:29.891740+0000","last_fullsized":"2024-09-14T11:34:29.891740+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:24:25.627310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'348","reported_seq":944,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.370868+0000","last_change":"2024-09-14T10:56:12.853756+0000","last_active":"2024-09-14T11:37:46.370868+0000","last_peered":"2024-09-14T11:37:46.370868+0000","last_clean":"2024-09-14T11:37:46.370868+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:37:46.370868+0000","last_undegraded":"2024-09-14T11:37:46.370868+0000","last_fullsized":"2024-09-14T11:37:46.370868+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:59:44.126582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46246,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1178,"num_read_kb":1754,"num_write":1698,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.096682+0000","last_change":"2024-09-14T11:38:12.096682+0000","last_active":"2024-09-14T11:38:12.096682+0000","last_peered":"2024-09-14T11:38:12.096682+0000","last_clean":"2024-09-14T11:38:12.096682+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:38:12.096682+0000","last_undegraded":"2024-09-14T11:38:12.096682+0000","last_fullsized":"2024-09-14T11:38:12.096682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.096566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:07.924703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'143","reported_seq":638,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:53.768752+0000","last_change":"2024-09-14T10:56:16.875685+0000","last_active":"2024-09-14T11:35:53.768752+0000","last_peered":"2024-09-14T11:35:53.768752+0000","last_clean":"2024-09-14T11:35:53.768752+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:35:53.768752+0000","last_undegraded":"2024-09-14T11:35:53.768752+0000","last_fullsized":"2024-09-14T11:35:53.768752+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.215568+0000","last_change":"2024-09-14T11:38:03.215568+0000","last_active":"2024-09-14T11:38:03.215568+0000","last_peered":"2024-09-14T11:38:03.215568+0000","last_clean":"2024-09-14T11:38:03.215568+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:38:03.215568+0000","last_undegraded":"2024-09-14T11:38:03.215568+0000","last_fullsized":"2024-09-14T11:38:03.215568+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'521","last_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_deep_scrub":"264'521","last_deep_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.215480+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:27.895596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.940021+0000","last_change":"2024-09-14T11:37:55.940021+0000","last_active":"2024-09-14T11:37:55.940021+0000","last_peered":"2024-09-14T11:37:55.940021+0000","last_clean":"2024-09-14T11:37:55.940021+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:37:55.940021+0000","last_undegraded":"2024-09-14T11:37:55.940021+0000","last_fullsized":"2024-09-14T11:37:55.940021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.939912+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.966314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.962629+0000","last_change":"2024-09-14T11:37:56.962629+0000","last_active":"2024-09-14T11:37:56.962629+0000","last_peered":"2024-09-14T11:37:56.962629+0000","last_clean":"2024-09-14T11:37:56.962629+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:37:56.962629+0000","last_undegraded":"2024-09-14T11:37:56.962629+0000","last_fullsized":"2024-09-14T11:37:56.962629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.962512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:33.102357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'336","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.833750+0000","last_change":"2024-09-14T11:37:53.833750+0000","last_active":"2024-09-14T11:37:53.833750+0000","last_peered":"2024-09-14T11:37:53.833750+0000","last_clean":"2024-09-14T11:37:53.833750+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:37:53.833750+0000","last_undegraded":"2024-09-14T11:37:53.833750+0000","last_fullsized":"2024-09-14T11:37:53.833750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.833659+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:56.404049+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":634,"num_read_kb":14631,"num_write":972,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.952690+0000","last_change":"2024-09-14T11:38:13.952690+0000","last_active":"2024-09-14T11:38:13.952690+0000","last_peered":"2024-09-14T11:38:13.952690+0000","last_clean":"2024-09-14T11:38:13.952690+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:38:13.952690+0000","last_undegraded":"2024-09-14T11:38:13.952690+0000","last_fullsized":"2024-09-14T11:38:13.952690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.952561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:45.651254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'729","reported_seq":1423,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.782116+0000","last_change":"2024-09-14T10:56:12.853693+0000","last_active":"2024-09-14T11:37:46.782116+0000","last_peered":"2024-09-14T11:37:46.782116+0000","last_clean":"2024-09-14T11:37:46.782116+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:37:46.782116+0000","last_undegraded":"2024-09-14T11:37:46.782116+0000","last_fullsized":"2024-09-14T11:37:46.782116+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":700,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:50:39.618315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1412,"num_read_kb":3246,"num_write":1300,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:18.764311+0000","last_change":"2024-09-14T10:56:14.867670+0000","last_active":"2024-09-14T11:35:18.764311+0000","last_peered":"2024-09-14T11:35:18.764311+0000","last_clean":"2024-09-14T11:35:18.764311+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:35:18.764311+0000","last_undegraded":"2024-09-14T11:35:18.764311+0000","last_fullsized":"2024-09-14T11:35:18.764311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:07.515289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'194","reported_seq":882,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.647341+0000","last_change":"2024-09-14T10:56:16.872059+0000","last_active":"2024-09-14T11:35:56.647341+0000","last_peered":"2024-09-14T11:35:56.647341+0000","last_clean":"2024-09-14T11:35:56.647341+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:35:56.647341+0000","last_undegraded":"2024-09-14T11:35:56.647341+0000","last_fullsized":"2024-09-14T11:35:56.647341+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:11.250321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'189","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.105067+0000","last_change":"2024-09-14T11:38:02.105067+0000","last_active":"2024-09-14T11:38:02.105067+0000","last_peered":"2024-09-14T11:38:02.105067+0000","last_clean":"2024-09-14T11:38:02.105067+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:38:02.105067+0000","last_undegraded":"2024-09-14T11:38:02.105067+0000","last_fullsized":"2024-09-14T11:38:02.105067+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.104979+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:48.803647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.930011+0000","last_change":"2024-09-14T11:38:00.929927+0000","last_active":"2024-09-14T11:38:00.930011+0000","last_peered":"2024-09-14T11:38:00.930011+0000","last_clean":"2024-09-14T11:38:00.930011+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:38:00.930011+0000","last_undegraded":"2024-09-14T11:38:00.930011+0000","last_fullsized":"2024-09-14T11:38:00.930011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.929792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:40.514471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'398","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.259139+0000","last_change":"2024-09-14T11:37:52.259139+0000","last_active":"2024-09-14T11:37:52.259139+0000","last_peered":"2024-09-14T11:37:52.259139+0000","last_clean":"2024-09-14T11:37:52.259139+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:52.259139+0000","last_undegraded":"2024-09-14T11:37:52.259139+0000","last_fullsized":"2024-09-14T11:37:52.259139+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.259071+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:58.652972+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":799,"num_read_kb":83524,"num_write":1261,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"35'5","reported_seq":969,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.559396+0000","last_change":"2024-09-14T10:56:10.849032+0000","last_active":"2024-09-14T11:37:45.559396+0000","last_peered":"2024-09-14T11:37:45.559396+0000","last_clean":"2024-09-14T11:37:45.559396+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:37:45.559396+0000","last_undegraded":"2024-09-14T11:37:45.559396+0000","last_fullsized":"2024-09-14T11:37:45.559396+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:02:01.123575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1245","reported_seq":2684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.546235+0000","last_change":"2024-09-14T11:38:12.546235+0000","last_active":"2024-09-14T11:38:12.546235+0000","last_peered":"2024-09-14T11:38:12.546235+0000","last_clean":"2024-09-14T11:38:12.546235+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:38:12.546235+0000","last_undegraded":"2024-09-14T11:38:12.546235+0000","last_fullsized":"2024-09-14T11:38:12.546235+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1245","last_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_deep_scrub":"264'1245","last_deep_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.546141+0000","objects_scrubbed":12,"log_size":45,"log_dups_size":1200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:57.448650+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138368,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1980,"num_read_kb":3690,"num_write":1076,"num_write_kb":906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.904174+0000","last_change":"2024-09-14T10:56:14.860734+0000","last_active":"2024-09-14T11:35:54.904174+0000","last_peered":"2024-09-14T11:35:54.904174+0000","last_clean":"2024-09-14T11:35:54.904174+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:35:54.904174+0000","last_undegraded":"2024-09-14T11:35:54.904174+0000","last_fullsized":"2024-09-14T11:35:54.904174+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'240","reported_seq":764,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.064636+0000","last_change":"2024-09-14T10:56:16.876125+0000","last_active":"2024-09-14T11:35:54.064636+0000","last_peered":"2024-09-14T11:35:54.064636+0000","last_clean":"2024-09-14T11:35:54.064636+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:35:54.064636+0000","last_undegraded":"2024-09-14T11:35:54.064636+0000","last_fullsized":"2024-09-14T11:35:54.064636+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:05.434832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.328415+0000","last_change":"2024-09-14T11:37:59.328415+0000","last_active":"2024-09-14T11:37:59.328415+0000","last_peered":"2024-09-14T11:37:59.328415+0000","last_clean":"2024-09-14T11:37:59.328415+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:37:59.328415+0000","last_undegraded":"2024-09-14T11:37:59.328415+0000","last_fullsized":"2024-09-14T11:37:59.328415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.328313+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:28.847997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.287608+0000","last_change":"2024-09-14T11:37:53.287608+0000","last_active":"2024-09-14T11:37:53.287608+0000","last_peered":"2024-09-14T11:37:53.287608+0000","last_clean":"2024-09-14T11:37:53.287608+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:37:53.287608+0000","last_undegraded":"2024-09-14T11:37:53.287608+0000","last_fullsized":"2024-09-14T11:37:53.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.287533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:08.352515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'364","reported_seq":1046,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.503608+0000","last_change":"2024-09-14T11:37:52.503608+0000","last_active":"2024-09-14T11:37:52.503608+0000","last_peered":"2024-09-14T11:37:52.503608+0000","last_clean":"2024-09-14T11:37:52.503608+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:37:52.503608+0000","last_undegraded":"2024-09-14T11:37:52.503608+0000","last_fullsized":"2024-09-14T11:37:52.503608+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.503516+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:31.493522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":61657,"num_write":1199,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.245866+0000","last_change":"2024-09-14T11:38:04.245866+0000","last_active":"2024-09-14T11:38:04.245866+0000","last_peered":"2024-09-14T11:38:04.245866+0000","last_clean":"2024-09-14T11:38:04.245866+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:38:04.245866+0000","last_undegraded":"2024-09-14T11:38:04.245866+0000","last_fullsized":"2024-09-14T11:38:04.245866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.245779+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.323128+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'215","reported_seq":1249,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.760473+0000","last_change":"2024-09-14T10:56:13.041674+0000","last_active":"2024-09-14T11:37:14.760473+0000","last_peered":"2024-09-14T11:37:14.760473+0000","last_clean":"2024-09-14T11:37:14.760473+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:37:14.760473+0000","last_undegraded":"2024-09-14T11:37:14.760473+0000","last_fullsized":"2024-09-14T11:37:14.760473+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:53.768569+0000","last_change":"2024-09-14T10:56:14.869132+0000","last_active":"2024-09-14T11:35:53.768569+0000","last_peered":"2024-09-14T11:35:53.768569+0000","last_clean":"2024-09-14T11:35:53.768569+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:35:53.768569+0000","last_undegraded":"2024-09-14T11:35:53.768569+0000","last_fullsized":"2024-09-14T11:35:53.768569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'258","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.791105+0000","last_change":"2024-09-14T10:56:16.878981+0000","last_active":"2024-09-14T11:35:56.791105+0000","last_peered":"2024-09-14T11:35:56.791105+0000","last_clean":"2024-09-14T11:35:56.791105+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:35:56.791105+0000","last_undegraded":"2024-09-14T11:35:56.791105+0000","last_fullsized":"2024-09-14T11:35:56.791105+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:11.858964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.489283+0000","last_change":"2024-09-14T11:38:01.489283+0000","last_active":"2024-09-14T11:38:01.489283+0000","last_peered":"2024-09-14T11:38:01.489283+0000","last_clean":"2024-09-14T11:38:01.489283+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:38:01.489283+0000","last_undegraded":"2024-09-14T11:38:01.489283+0000","last_fullsized":"2024-09-14T11:38:01.489283+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.489194+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:27.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.984029+0000","last_change":"2024-09-14T11:37:55.984029+0000","last_active":"2024-09-14T11:37:55.984029+0000","last_peered":"2024-09-14T11:37:55.984029+0000","last_clean":"2024-09-14T11:37:55.984029+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:37:55.984029+0000","last_undegraded":"2024-09-14T11:37:55.984029+0000","last_fullsized":"2024-09-14T11:37:55.984029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.983951+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:03.446110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'424","reported_seq":1181,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.799026+0000","last_change":"2024-09-14T11:37:54.799026+0000","last_active":"2024-09-14T11:37:54.799026+0000","last_peered":"2024-09-14T11:37:54.799026+0000","last_clean":"2024-09-14T11:37:54.799026+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:37:54.799026+0000","last_undegraded":"2024-09-14T11:37:54.799026+0000","last_fullsized":"2024-09-14T11:37:54.799026+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'424","last_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_deep_scrub":"264'424","last_deep_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.798918+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:41.369232+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":119862,"num_write":1308,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.097424+0000","last_change":"2024-09-14T11:38:12.097424+0000","last_active":"2024-09-14T11:38:12.097424+0000","last_peered":"2024-09-14T11:38:12.097424+0000","last_clean":"2024-09-14T11:38:12.097424+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:38:12.097424+0000","last_undegraded":"2024-09-14T11:38:12.097424+0000","last_fullsized":"2024-09-14T11:38:12.097424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.097323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:33.246260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'117","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.762188+0000","last_change":"2024-09-14T10:56:12.855698+0000","last_active":"2024-09-14T11:37:14.762188+0000","last_peered":"2024-09-14T11:37:14.762188+0000","last_clean":"2024-09-14T11:37:14.762188+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:37:14.762188+0000","last_undegraded":"2024-09-14T11:37:14.762188+0000","last_fullsized":"2024-09-14T11:37:14.762188+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:57:26.322719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.130226+0000","last_change":"2024-09-14T11:38:11.130226+0000","last_active":"2024-09-14T11:38:11.130226+0000","last_peered":"2024-09-14T11:38:11.130226+0000","last_clean":"2024-09-14T11:38:11.130226+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:38:11.130226+0000","last_undegraded":"2024-09-14T11:38:11.130226+0000","last_fullsized":"2024-09-14T11:38:11.130226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.130127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:35.749033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":652,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:31.040892+0000","last_change":"2024-09-14T10:56:16.875071+0000","last_active":"2024-09-14T11:35:31.040892+0000","last_peered":"2024-09-14T11:35:31.040892+0000","last_clean":"2024-09-14T11:35:31.040892+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:35:31.040892+0000","last_undegraded":"2024-09-14T11:35:31.040892+0000","last_fullsized":"2024-09-14T11:35:31.040892+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:13:51.001726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.536277+0000","last_change":"2024-09-14T11:37:59.536277+0000","last_active":"2024-09-14T11:37:59.536277+0000","last_peered":"2024-09-14T11:37:59.536277+0000","last_clean":"2024-09-14T11:37:59.536277+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:37:59.536277+0000","last_undegraded":"2024-09-14T11:37:59.536277+0000","last_fullsized":"2024-09-14T11:37:59.536277+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.536190+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.140324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'368","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.967810+0000","last_change":"2024-09-14T11:37:54.967810+0000","last_active":"2024-09-14T11:37:54.967810+0000","last_peered":"2024-09-14T11:37:54.967810+0000","last_clean":"2024-09-14T11:37:54.967810+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:37:54.967810+0000","last_undegraded":"2024-09-14T11:37:54.967810+0000","last_fullsized":"2024-09-14T11:37:54.967810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.967697+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:29.191346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":12538,"num_write":1147,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.521322+0000","last_change":"2024-09-14T11:37:53.521322+0000","last_active":"2024-09-14T11:37:53.521322+0000","last_peered":"2024-09-14T11:37:53.521322+0000","last_clean":"2024-09-14T11:37:53.521322+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:37:53.521322+0000","last_undegraded":"2024-09-14T11:37:53.521322+0000","last_fullsized":"2024-09-14T11:37:53.521322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.521249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:04.660477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"264'4","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.079368+0000","last_change":"2024-09-14T11:38:13.079368+0000","last_active":"2024-09-14T11:38:13.079368+0000","last_peered":"2024-09-14T11:38:13.079368+0000","last_clean":"2024-09-14T11:38:13.079368+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:38:13.079368+0000","last_undegraded":"2024-09-14T11:38:13.079368+0000","last_fullsized":"2024-09-14T11:38:13.079368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.079281+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:20.909629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'591","reported_seq":1245,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.821141+0000","last_change":"2024-09-14T10:56:12.857610+0000","last_active":"2024-09-14T11:37:46.821141+0000","last_peered":"2024-09-14T11:37:46.821141+0000","last_clean":"2024-09-14T11:37:46.821141+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:37:46.821141+0000","last_undegraded":"2024-09-14T11:37:46.821141+0000","last_fullsized":"2024-09-14T11:37:46.821141+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":500,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:47:08.734579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94043,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":992,"num_read_kb":2221,"num_write":850,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903422+0000","last_change":"2024-09-14T10:56:14.866887+0000","last_active":"2024-09-14T11:35:49.903422+0000","last_peered":"2024-09-14T11:35:49.903422+0000","last_clean":"2024-09-14T11:35:49.903422+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:35:49.903422+0000","last_undegraded":"2024-09-14T11:35:49.903422+0000","last_fullsized":"2024-09-14T11:35:49.903422+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'180","reported_seq":687,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:33.463557+0000","last_change":"2024-09-14T10:56:16.874511+0000","last_active":"2024-09-14T11:35:33.463557+0000","last_peered":"2024-09-14T11:35:33.463557+0000","last_clean":"2024-09-14T11:35:33.463557+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:35:33.463557+0000","last_undegraded":"2024-09-14T11:35:33.463557+0000","last_fullsized":"2024-09-14T11:35:33.463557+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:14:37.976436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.092950+0000","last_change":"2024-09-14T11:38:01.092950+0000","last_active":"2024-09-14T11:38:01.092950+0000","last_peered":"2024-09-14T11:38:01.092950+0000","last_clean":"2024-09-14T11:38:01.092950+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:38:01.092950+0000","last_undegraded":"2024-09-14T11:38:01.092950+0000","last_fullsized":"2024-09-14T11:38:01.092950+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.092847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:03.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'354","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.510047+0000","last_change":"2024-09-14T11:37:54.510047+0000","last_active":"2024-09-14T11:37:54.510047+0000","last_peered":"2024-09-14T11:37:54.510047+0000","last_clean":"2024-09-14T11:37:54.510047+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:37:54.510047+0000","last_undegraded":"2024-09-14T11:37:54.510047+0000","last_fullsized":"2024-09-14T11:37:54.510047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.509966+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:47.241897+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":702,"num_read_kb":48648,"num_write":1220,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.948139+0000","last_change":"2024-09-14T11:37:57.948139+0000","last_active":"2024-09-14T11:37:57.948139+0000","last_peered":"2024-09-14T11:37:57.948139+0000","last_clean":"2024-09-14T11:37:57.948139+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:37:57.948139+0000","last_undegraded":"2024-09-14T11:37:57.948139+0000","last_fullsized":"2024-09-14T11:37:57.948139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.948046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:12.046884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.171510+0000","last_change":"2024-09-14T11:38:07.171510+0000","last_active":"2024-09-14T11:38:07.171510+0000","last_peered":"2024-09-14T11:38:07.171510+0000","last_clean":"2024-09-14T11:38:07.171510+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:38:07.171510+0000","last_undegraded":"2024-09-14T11:38:07.171510+0000","last_fullsized":"2024-09-14T11:38:07.171510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.171423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:03.206894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'155","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.514380+0000","last_change":"2024-09-14T11:38:11.514380+0000","last_active":"2024-09-14T11:38:11.514380+0000","last_peered":"2024-09-14T11:38:11.514380+0000","last_clean":"2024-09-14T11:38:11.514380+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:38:11.514380+0000","last_undegraded":"2024-09-14T11:38:11.514380+0000","last_fullsized":"2024-09-14T11:38:11.514380+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.514295+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:27.234237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'794","reported_seq":2759,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.623315+0000","last_change":"2024-09-14T10:56:14.864682+0000","last_active":"2024-09-14T11:37:46.623315+0000","last_peered":"2024-09-14T11:37:46.623315+0000","last_clean":"2024-09-14T11:37:46.623315+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:37:46.623315+0000","last_undegraded":"2024-09-14T11:37:46.623315+0000","last_fullsized":"2024-09-14T11:37:46.623315+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:13:27.506777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'136","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:55.622534+0000","last_change":"2024-09-14T10:56:16.878173+0000","last_active":"2024-09-14T11:36:55.622534+0000","last_peered":"2024-09-14T11:36:55.622534+0000","last_clean":"2024-09-14T11:36:55.622534+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:36:55.622534+0000","last_undegraded":"2024-09-14T11:36:55.622534+0000","last_fullsized":"2024-09-14T11:36:55.622534+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:42:18.316372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'112","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.767548+0000","last_change":"2024-09-14T11:38:04.767492+0000","last_active":"2024-09-14T11:38:04.767548+0000","last_peered":"2024-09-14T11:38:04.767548+0000","last_clean":"2024-09-14T11:38:04.767548+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:38:04.767548+0000","last_undegraded":"2024-09-14T11:38:04.767548+0000","last_fullsized":"2024-09-14T11:38:04.767548+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.767399+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:56.368702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'357","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.826736+0000","last_change":"2024-09-14T11:37:55.826736+0000","last_active":"2024-09-14T11:37:55.826736+0000","last_peered":"2024-09-14T11:37:55.826736+0000","last_clean":"2024-09-14T11:37:55.826736+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:37:55.826736+0000","last_undegraded":"2024-09-14T11:37:55.826736+0000","last_fullsized":"2024-09-14T11:37:55.826736+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.826653+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:51.541137+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":3889,"num_write":1053,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.473533+0000","last_change":"2024-09-14T11:37:55.473533+0000","last_active":"2024-09-14T11:37:55.473533+0000","last_peered":"2024-09-14T11:37:55.473533+0000","last_clean":"2024-09-14T11:37:55.473533+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:37:55.473533+0000","last_undegraded":"2024-09-14T11:37:55.473533+0000","last_fullsized":"2024-09-14T11:37:55.473533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.473461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:32.359228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903413+0000","last_change":"2024-09-14T10:56:10.845757+0000","last_active":"2024-09-14T11:35:49.903413+0000","last_peered":"2024-09-14T11:35:49.903413+0000","last_clean":"2024-09-14T11:35:49.903413+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:35:49.903413+0000","last_undegraded":"2024-09-14T11:35:49.903413+0000","last_fullsized":"2024-09-14T11:35:49.903413+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'105","reported_seq":642,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.462719+0000","last_change":"2024-09-14T10:56:12.854078+0000","last_active":"2024-09-14T11:36:21.462719+0000","last_peered":"2024-09-14T11:36:21.462719+0000","last_clean":"2024-09-14T11:36:21.462719+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:36:21.462719+0000","last_undegraded":"2024-09-14T11:36:21.462719+0000","last_fullsized":"2024-09-14T11:36:21.462719+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'794","reported_seq":2385,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:47.011984+0000","last_change":"2024-09-14T10:56:14.861395+0000","last_active":"2024-09-14T11:37:47.011984+0000","last_peered":"2024-09-14T11:37:47.011984+0000","last_clean":"2024-09-14T11:37:47.011984+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:37:47.011984+0000","last_undegraded":"2024-09-14T11:37:47.011984+0000","last_fullsized":"2024-09-14T11:37:47.011984+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'253","reported_seq":739,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.639576+0000","last_change":"2024-09-14T10:56:16.874903+0000","last_active":"2024-09-14T11:35:56.639576+0000","last_peered":"2024-09-14T11:35:56.639576+0000","last_clean":"2024-09-14T11:35:56.639576+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:35:56.639576+0000","last_undegraded":"2024-09-14T11:35:56.639576+0000","last_fullsized":"2024-09-14T11:35:56.639576+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":200,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:39:52.818843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.782130+0000","last_change":"2024-09-14T11:37:58.782130+0000","last_active":"2024-09-14T11:37:58.782130+0000","last_peered":"2024-09-14T11:37:58.782130+0000","last_clean":"2024-09-14T11:37:58.782130+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:37:58.782130+0000","last_undegraded":"2024-09-14T11:37:58.782130+0000","last_fullsized":"2024-09-14T11:37:58.782130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.782043+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:01.595371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.229148+0000","last_change":"2024-09-14T11:37:53.229148+0000","last_active":"2024-09-14T11:37:53.229148+0000","last_peered":"2024-09-14T11:37:53.229148+0000","last_clean":"2024-09-14T11:37:53.229148+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:53.229148+0000","last_undegraded":"2024-09-14T11:37:53.229148+0000","last_fullsized":"2024-09-14T11:37:53.229148+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.229076+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:27.683273+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":848,"num_read_kb":56309,"num_write":1145,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.238426+0000","last_change":"2024-09-14T11:37:55.238426+0000","last_active":"2024-09-14T11:37:55.238426+0000","last_peered":"2024-09-14T11:37:55.238426+0000","last_clean":"2024-09-14T11:37:55.238426+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:37:55.238426+0000","last_undegraded":"2024-09-14T11:37:55.238426+0000","last_fullsized":"2024-09-14T11:37:55.238426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.238331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:34.224317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:20.602419+0000","last_change":"2024-09-14T10:56:10.847591+0000","last_active":"2024-09-14T11:34:20.602419+0000","last_peered":"2024-09-14T11:34:20.602419+0000","last_clean":"2024-09-14T11:34:20.602419+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:34:20.602419+0000","last_undegraded":"2024-09-14T11:34:20.602419+0000","last_fullsized":"2024-09-14T11:34:20.602419+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:09:12.477652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'717","reported_seq":1426,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.294538+0000","last_change":"2024-09-14T10:56:13.041312+0000","last_active":"2024-09-14T11:37:46.294538+0000","last_peered":"2024-09-14T11:37:46.294538+0000","last_clean":"2024-09-14T11:37:46.294538+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:37:46.294538+0000","last_undegraded":"2024-09-14T11:37:46.294538+0000","last_fullsized":"2024-09-14T11:37:46.294538+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":700,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:15.894086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1287,"num_read_kb":3017,"num_write":1048,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":483,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:50.613814+0000","last_change":"2024-09-14T10:56:14.856227+0000","last_active":"2024-09-14T11:35:50.613814+0000","last_peered":"2024-09-14T11:35:50.613814+0000","last_clean":"2024-09-14T11:35:50.613814+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:35:50.613814+0000","last_undegraded":"2024-09-14T11:35:50.613814+0000","last_fullsized":"2024-09-14T11:35:50.613814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'135","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:32.661856+0000","last_change":"2024-09-14T10:56:16.875970+0000","last_active":"2024-09-14T11:35:32.661856+0000","last_peered":"2024-09-14T11:35:32.661856+0000","last_clean":"2024-09-14T11:35:32.661856+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:35:32.661856+0000","last_undegraded":"2024-09-14T11:35:32.661856+0000","last_fullsized":"2024-09-14T11:35:32.661856+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:52:42.939235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'137","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.748211+0000","last_change":"2024-09-14T10:56:16.878602+0000","last_active":"2024-09-14T11:35:56.748211+0000","last_peered":"2024-09-14T11:35:56.748211+0000","last_clean":"2024-09-14T11:35:56.748211+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:35:56.748211+0000","last_undegraded":"2024-09-14T11:35:56.748211+0000","last_fullsized":"2024-09-14T11:35:56.748211+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'296","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.799272+0000","last_change":"2024-09-14T11:38:03.799205+0000","last_active":"2024-09-14T11:38:03.799272+0000","last_peered":"2024-09-14T11:38:03.799272+0000","last_clean":"2024-09-14T11:38:03.799272+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:38:03.799272+0000","last_undegraded":"2024-09-14T11:38:03.799272+0000","last_fullsized":"2024-09-14T11:38:03.799272+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.799103+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:55.138113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'297","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.751853+0000","last_change":"2024-09-14T11:37:59.751795+0000","last_active":"2024-09-14T11:37:59.751853+0000","last_peered":"2024-09-14T11:37:59.751853+0000","last_clean":"2024-09-14T11:37:59.751853+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:37:59.751853+0000","last_undegraded":"2024-09-14T11:37:59.751853+0000","last_fullsized":"2024-09-14T11:37:59.751853+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.751710+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:08.154524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":2279,"num_write":913,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.527091+0000","last_change":"2024-09-14T11:38:08.527034+0000","last_active":"2024-09-14T11:38:08.527091+0000","last_peered":"2024-09-14T11:38:08.527091+0000","last_clean":"2024-09-14T11:38:08.527091+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:38:08.527091+0000","last_undegraded":"2024-09-14T11:38:08.527091+0000","last_fullsized":"2024-09-14T11:38:08.527091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.526942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:37.177668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'255","reported_seq":821,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.516232+0000","last_change":"2024-09-14T10:56:12.855555+0000","last_active":"2024-09-14T11:37:46.516232+0000","last_peered":"2024-09-14T11:37:46.516232+0000","last_clean":"2024-09-14T11:37:46.516232+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:37:46.516232+0000","last_undegraded":"2024-09-14T11:37:46.516232+0000","last_fullsized":"2024-09-14T11:37:46.516232+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44234,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":907,"num_write":328,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":481,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:55.614562+0000","last_change":"2024-09-14T10:56:14.859912+0000","last_active":"2024-09-14T11:35:55.614562+0000","last_peered":"2024-09-14T11:35:55.614562+0000","last_clean":"2024-09-14T11:35:55.614562+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:35:55.614562+0000","last_undegraded":"2024-09-14T11:35:55.614562+0000","last_fullsized":"2024-09-14T11:35:55.614562+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'113","reported_seq":609,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.905145+0000","last_change":"2024-09-14T10:56:16.876189+0000","last_active":"2024-09-14T11:35:54.905145+0000","last_peered":"2024-09-14T11:35:54.905145+0000","last_clean":"2024-09-14T11:35:54.905145+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:35:54.905145+0000","last_undegraded":"2024-09-14T11:35:54.905145+0000","last_fullsized":"2024-09-14T11:35:54.905145+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:08.040744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.520852+0000","last_change":"2024-09-14T11:38:03.520774+0000","last_active":"2024-09-14T11:38:03.520852+0000","last_peered":"2024-09-14T11:38:03.520852+0000","last_clean":"2024-09-14T11:38:03.520852+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:38:03.520852+0000","last_undegraded":"2024-09-14T11:38:03.520852+0000","last_fullsized":"2024-09-14T11:38:03.520852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.520673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:06.183047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.979596+0000","last_change":"2024-09-14T11:38:05.979596+0000","last_active":"2024-09-14T11:38:05.979596+0000","last_peered":"2024-09-14T11:38:05.979596+0000","last_clean":"2024-09-14T11:38:05.979596+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:38:05.979596+0000","last_undegraded":"2024-09-14T11:38:05.979596+0000","last_fullsized":"2024-09-14T11:38:05.979596+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.979504+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.259987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":9277,"num_write":976,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:55.614639+0000","last_change":"2024-09-14T10:56:10.846714+0000","last_active":"2024-09-14T11:35:55.614639+0000","last_peered":"2024-09-14T11:35:55.614639+0000","last_clean":"2024-09-14T11:35:55.614639+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:35:55.614639+0000","last_undegraded":"2024-09-14T11:35:55.614639+0000","last_fullsized":"2024-09-14T11:35:55.614639+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'57","reported_seq":551,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.294336+0000","last_change":"2024-09-14T10:56:12.851172+0000","last_active":"2024-09-14T11:36:21.294336+0000","last_peered":"2024-09-14T11:36:21.294336+0000","last_clean":"2024-09-14T11:36:21.294336+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:36:21.294336+0000","last_undegraded":"2024-09-14T11:36:21.294336+0000","last_fullsized":"2024-09-14T11:36:21.294336+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":480,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.904053+0000","last_change":"2024-09-14T10:56:14.869388+0000","last_active":"2024-09-14T11:35:54.904053+0000","last_peered":"2024-09-14T11:35:54.904053+0000","last_clean":"2024-09-14T11:35:54.904053+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:35:54.904053+0000","last_undegraded":"2024-09-14T11:35:54.904053+0000","last_fullsized":"2024-09-14T11:35:54.904053+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'186","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.091148+0000","last_change":"2024-09-14T10:56:16.870386+0000","last_active":"2024-09-14T11:35:56.091148+0000","last_peered":"2024-09-14T11:35:56.091148+0000","last_clean":"2024-09-14T11:35:56.091148+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:35:56.091148+0000","last_undegraded":"2024-09-14T11:35:56.091148+0000","last_fullsized":"2024-09-14T11:35:56.091148+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:47.067599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.767373+0000","last_change":"2024-09-14T11:38:06.767276+0000","last_active":"2024-09-14T11:38:06.767373+0000","last_peered":"2024-09-14T11:38:06.767373+0000","last_clean":"2024-09-14T11:38:06.767373+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:38:06.767373+0000","last_undegraded":"2024-09-14T11:38:06.767373+0000","last_fullsized":"2024-09-14T11:38:06.767373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'91","last_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_deep_scrub":"264'91","last_deep_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.767184+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:58.705749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'360","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.987699+0000","last_change":"2024-09-14T11:37:58.987699+0000","last_active":"2024-09-14T11:37:58.987699+0000","last_peered":"2024-09-14T11:37:58.987699+0000","last_clean":"2024-09-14T11:37:58.987699+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:37:58.987699+0000","last_undegraded":"2024-09-14T11:37:58.987699+0000","last_fullsized":"2024-09-14T11:37:58.987699+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.987611+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:24.048610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":2982,"num_write":1169,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.911139+0000","last_change":"2024-09-14T11:38:14.911032+0000","last_active":"2024-09-14T11:38:14.911139+0000","last_peered":"2024-09-14T11:38:14.911139+0000","last_clean":"2024-09-14T11:38:14.911139+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:38:14.911139+0000","last_undegraded":"2024-09-14T11:38:14.911139+0000","last_fullsized":"2024-09-14T11:38:14.911139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.910937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:23.836659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'308","reported_seq":890,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.118592+0000","last_change":"2024-09-14T10:56:12.856115+0000","last_active":"2024-09-14T11:37:46.118592+0000","last_peered":"2024-09-14T11:37:46.118592+0000","last_clean":"2024-09-14T11:37:46.118592+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:37:46.118592+0000","last_undegraded":"2024-09-14T11:37:46.118592+0000","last_fullsized":"2024-09-14T11:37:46.118592+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":200,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1126,"num_write":414,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.050831+0000","last_change":"2024-09-14T11:38:14.050749+0000","last_active":"2024-09-14T11:38:14.050831+0000","last_peered":"2024-09-14T11:38:14.050831+0000","last_clean":"2024-09-14T11:38:14.050831+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:38:14.050831+0000","last_undegraded":"2024-09-14T11:38:14.050831+0000","last_fullsized":"2024-09-14T11:38:14.050831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.050668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:18.444772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'185","reported_seq":706,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:36.325833+0000","last_change":"2024-09-14T10:56:16.875845+0000","last_active":"2024-09-14T11:35:36.325833+0000","last_peered":"2024-09-14T11:35:36.325833+0000","last_clean":"2024-09-14T11:35:36.325833+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:35:36.325833+0000","last_undegraded":"2024-09-14T11:35:36.325833+0000","last_fullsized":"2024-09-14T11:35:36.325833+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:59.857949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.724247+0000","last_change":"2024-09-14T11:38:05.724174+0000","last_active":"2024-09-14T11:38:05.724247+0000","last_peered":"2024-09-14T11:38:05.724247+0000","last_clean":"2024-09-14T11:38:05.724247+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:38:05.724247+0000","last_undegraded":"2024-09-14T11:38:05.724247+0000","last_fullsized":"2024-09-14T11:38:05.724247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.724091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.241278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'326","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.186499+0000","last_change":"2024-09-14T11:37:55.186499+0000","last_active":"2024-09-14T11:37:55.186499+0000","last_peered":"2024-09-14T11:37:55.186499+0000","last_clean":"2024-09-14T11:37:55.186499+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:37:55.186499+0000","last_undegraded":"2024-09-14T11:37:55.186499+0000","last_fullsized":"2024-09-14T11:37:55.186499+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.186430+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:21.808735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":4364,"num_write":956,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.110226+0000","last_change":"2024-09-14T11:38:10.110173+0000","last_active":"2024-09-14T11:38:10.110226+0000","last_peered":"2024-09-14T11:38:10.110226+0000","last_clean":"2024-09-14T11:38:10.110226+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:38:10.110226+0000","last_undegraded":"2024-09-14T11:38:10.110226+0000","last_fullsized":"2024-09-14T11:38:10.110226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.110089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:50.692474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'263","reported_seq":823,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.005499+0000","last_change":"2024-09-14T10:56:12.848425+0000","last_active":"2024-09-14T11:37:46.005499+0000","last_peered":"2024-09-14T11:37:46.005499+0000","last_clean":"2024-09-14T11:37:46.005499+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:37:46.005499+0000","last_undegraded":"2024-09-14T11:37:46.005499+0000","last_fullsized":"2024-09-14T11:37:46.005499+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":200,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":429,"num_read_kb":979,"num_write":348,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:38.750839+0000","last_change":"2024-09-14T10:56:14.863993+0000","last_active":"2024-09-14T11:33:38.750839+0000","last_peered":"2024-09-14T11:33:38.750839+0000","last_clean":"2024-09-14T11:33:38.750839+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:33:38.750839+0000","last_undegraded":"2024-09-14T11:33:38.750839+0000","last_fullsized":"2024-09-14T11:33:38.750839+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:28.114909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.195176+0000","last_change":"2024-09-14T11:38:05.195176+0000","last_active":"2024-09-14T11:38:05.195176+0000","last_peered":"2024-09-14T11:38:05.195176+0000","last_clean":"2024-09-14T11:38:05.195176+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:38:05.195176+0000","last_undegraded":"2024-09-14T11:38:05.195176+0000","last_fullsized":"2024-09-14T11:38:05.195176+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.195090+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:58.870651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'316","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.760929+0000","last_change":"2024-09-14T11:38:00.760929+0000","last_active":"2024-09-14T11:38:00.760929+0000","last_peered":"2024-09-14T11:38:00.760929+0000","last_clean":"2024-09-14T11:38:00.760929+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:38:00.760929+0000","last_undegraded":"2024-09-14T11:38:00.760929+0000","last_fullsized":"2024-09-14T11:38:00.760929+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.760838+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.394615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":11665,"num_write":969,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.137775+0000","last_change":"2024-09-14T11:38:11.137775+0000","last_active":"2024-09-14T11:38:11.137775+0000","last_peered":"2024-09-14T11:38:11.137775+0000","last_clean":"2024-09-14T11:38:11.137775+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:38:11.137775+0000","last_undegraded":"2024-09-14T11:38:11.137775+0000","last_fullsized":"2024-09-14T11:38:11.137775+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.137678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:29.267416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'484","reported_seq":1115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.562171+0000","last_change":"2024-09-14T11:38:13.562171+0000","last_active":"2024-09-14T11:38:13.562171+0000","last_peered":"2024-09-14T11:38:13.562171+0000","last_clean":"2024-09-14T11:38:13.562171+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:38:13.562171+0000","last_undegraded":"2024-09-14T11:38:13.562171+0000","last_fullsized":"2024-09-14T11:38:13.562171+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'484","last_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_deep_scrub":"264'484","last_deep_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.562082+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.434257+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192423,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":855,"num_read_kb":2213,"num_write":738,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868166+0000","last_change":"2024-09-14T10:56:14.866608+0000","last_active":"2024-09-14T11:33:47.868166+0000","last_peered":"2024-09-14T11:33:47.868166+0000","last_clean":"2024-09-14T11:33:47.868166+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:33:47.868166+0000","last_undegraded":"2024-09-14T11:33:47.868166+0000","last_fullsized":"2024-09-14T11:33:47.868166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:05:07.568392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'180","reported_seq":670,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.637830+0000","last_change":"2024-09-14T10:56:16.877816+0000","last_active":"2024-09-14T11:35:56.637830+0000","last_peered":"2024-09-14T11:35:56.637830+0000","last_clean":"2024-09-14T11:35:56.637830+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:35:56.637830+0000","last_undegraded":"2024-09-14T11:35:56.637830+0000","last_fullsized":"2024-09-14T11:35:56.637830+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:03.287323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.178711+0000","last_change":"2024-09-14T11:38:08.178711+0000","last_active":"2024-09-14T11:38:08.178711+0000","last_peered":"2024-09-14T11:38:08.178711+0000","last_clean":"2024-09-14T11:38:08.178711+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:38:08.178711+0000","last_undegraded":"2024-09-14T11:38:08.178711+0000","last_fullsized":"2024-09-14T11:38:08.178711+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.178627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:19.038119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'332","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.496892+0000","last_change":"2024-09-14T11:37:56.496892+0000","last_active":"2024-09-14T11:37:56.496892+0000","last_peered":"2024-09-14T11:37:56.496892+0000","last_clean":"2024-09-14T11:37:56.496892+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:56.496892+0000","last_undegraded":"2024-09-14T11:37:56.496892+0000","last_fullsized":"2024-09-14T11:37:56.496892+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.496799+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.399160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":3066,"num_write":996,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.126049+0000","last_change":"2024-09-14T11:38:09.126049+0000","last_active":"2024-09-14T11:38:09.126049+0000","last_peered":"2024-09-14T11:38:09.126049+0000","last_clean":"2024-09-14T11:38:09.126049+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:38:09.126049+0000","last_undegraded":"2024-09-14T11:38:09.126049+0000","last_fullsized":"2024-09-14T11:38:09.126049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.125953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:41.468504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'336","reported_seq":909,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.045249+0000","last_change":"2024-09-14T10:56:12.850684+0000","last_active":"2024-09-14T11:37:46.045249+0000","last_peered":"2024-09-14T11:37:46.045249+0000","last_clean":"2024-09-14T11:37:46.045249+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:37:46.045249+0000","last_undegraded":"2024-09-14T11:37:46.045249+0000","last_fullsized":"2024-09-14T11:37:46.045249+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:17:36.655979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":556,"num_read_kb":1258,"num_write":472,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":482,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.864958+0000","last_change":"2024-09-14T10:56:14.863516+0000","last_active":"2024-09-14T11:33:48.864958+0000","last_peered":"2024-09-14T11:33:48.864958+0000","last_clean":"2024-09-14T11:33:48.864958+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:33:48.864958+0000","last_undegraded":"2024-09-14T11:33:48.864958+0000","last_fullsized":"2024-09-14T11:33:48.864958+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:51.527433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'167","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:27.073475+0000","last_change":"2024-09-14T10:56:16.873262+0000","last_active":"2024-09-14T11:35:27.073475+0000","last_peered":"2024-09-14T11:35:27.073475+0000","last_clean":"2024-09-14T11:35:27.073475+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:35:27.073475+0000","last_undegraded":"2024-09-14T11:35:27.073475+0000","last_fullsized":"2024-09-14T11:35:27.073475+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:25:21.859002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.796324+0000","last_change":"2024-09-14T11:38:10.796324+0000","last_active":"2024-09-14T11:38:10.796324+0000","last_peered":"2024-09-14T11:38:10.796324+0000","last_clean":"2024-09-14T11:38:10.796324+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:38:10.796324+0000","last_undegraded":"2024-09-14T11:38:10.796324+0000","last_fullsized":"2024-09-14T11:38:10.796324+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.796238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:26.034543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'368","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.770978+0000","last_change":"2024-09-14T11:37:56.770978+0000","last_active":"2024-09-14T11:37:56.770978+0000","last_peered":"2024-09-14T11:37:56.770978+0000","last_clean":"2024-09-14T11:37:56.770978+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:37:56.770978+0000","last_undegraded":"2024-09-14T11:37:56.770978+0000","last_fullsized":"2024-09-14T11:37:56.770978+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.770888+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:59.783985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":69620,"num_write":1137,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886067+0000","last_change":"2024-09-14T10:56:10.848128+0000","last_active":"2024-09-14T11:33:44.886067+0000","last_peered":"2024-09-14T11:33:44.886067+0000","last_clean":"2024-09-14T11:33:44.886067+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:33:44.886067+0000","last_undegraded":"2024-09-14T11:33:44.886067+0000","last_fullsized":"2024-09-14T11:33:44.886067+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:53:51.970572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'270","reported_seq":838,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.680140+0000","last_change":"2024-09-14T10:56:13.041394+0000","last_active":"2024-09-14T11:37:46.680140+0000","last_peered":"2024-09-14T11:37:46.680140+0000","last_clean":"2024-09-14T11:37:46.680140+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:37:46.680140+0000","last_undegraded":"2024-09-14T11:37:46.680140+0000","last_fullsized":"2024-09-14T11:37:46.680140+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52342,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1065,"num_write":374,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757802+0000","last_change":"2024-09-14T10:56:14.862660+0000","last_active":"2024-09-14T11:34:28.757802+0000","last_peered":"2024-09-14T11:34:28.757802+0000","last_clean":"2024-09-14T11:34:28.757802+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:34:28.757802+0000","last_undegraded":"2024-09-14T11:34:28.757802+0000","last_fullsized":"2024-09-14T11:34:28.757802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:40:53.685139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'113","reported_seq":590,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:14.629869+0000","last_change":"2024-09-14T10:56:16.874807+0000","last_active":"2024-09-14T11:37:14.629869+0000","last_peered":"2024-09-14T11:37:14.629869+0000","last_clean":"2024-09-14T11:37:14.629869+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:37:14.629869+0000","last_undegraded":"2024-09-14T11:37:14.629869+0000","last_fullsized":"2024-09-14T11:37:14.629869+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:23.768244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.346691+0000","last_change":"2024-09-14T11:38:00.346691+0000","last_active":"2024-09-14T11:38:00.346691+0000","last_peered":"2024-09-14T11:38:00.346691+0000","last_clean":"2024-09-14T11:38:00.346691+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:38:00.346691+0000","last_undegraded":"2024-09-14T11:38:00.346691+0000","last_fullsized":"2024-09-14T11:38:00.346691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.346611+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.401615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'352","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.200197+0000","last_change":"2024-09-14T11:37:57.200197+0000","last_active":"2024-09-14T11:37:57.200197+0000","last_peered":"2024-09-14T11:37:57.200197+0000","last_clean":"2024-09-14T11:37:57.200197+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:37:57.200197+0000","last_undegraded":"2024-09-14T11:37:57.200197+0000","last_fullsized":"2024-09-14T11:37:57.200197+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.200097+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:27.049496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":33947,"num_write":1155,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.530630+0000","last_change":"2024-09-14T11:38:10.530630+0000","last_active":"2024-09-14T11:38:10.530630+0000","last_peered":"2024-09-14T11:38:10.530630+0000","last_clean":"2024-09-14T11:38:10.530630+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:38:10.530630+0000","last_undegraded":"2024-09-14T11:38:10.530630+0000","last_fullsized":"2024-09-14T11:38:10.530630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.530538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:40.837743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'96","reported_seq":617,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:21.472266+0000","last_change":"2024-09-14T10:56:13.041708+0000","last_active":"2024-09-14T11:36:21.472266+0000","last_peered":"2024-09-14T11:36:21.472266+0000","last_clean":"2024-09-14T11:36:21.472266+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:36:21.472266+0000","last_undegraded":"2024-09-14T11:36:21.472266+0000","last_fullsized":"2024-09-14T11:36:21.472266+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":0,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:44.179299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'754","reported_seq":4578,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:47.006768+0000","last_change":"2024-09-14T10:56:14.869079+0000","last_active":"2024-09-14T11:37:47.006768+0000","last_peered":"2024-09-14T11:37:47.006768+0000","last_clean":"2024-09-14T11:37:47.006768+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:37:47.006768+0000","last_undegraded":"2024-09-14T11:37:47.006768+0000","last_fullsized":"2024-09-14T11:37:47.006768+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'126","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:19.897308+0000","last_change":"2024-09-14T10:56:16.877187+0000","last_active":"2024-09-14T11:35:19.897308+0000","last_peered":"2024-09-14T11:35:19.897308+0000","last_clean":"2024-09-14T11:35:19.897308+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:35:19.897308+0000","last_undegraded":"2024-09-14T11:35:19.897308+0000","last_fullsized":"2024-09-14T11:35:19.897308+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:56:51.016753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.896311+0000","last_change":"2024-09-14T11:38:07.896311+0000","last_active":"2024-09-14T11:38:07.896311+0000","last_peered":"2024-09-14T11:38:07.896311+0000","last_clean":"2024-09-14T11:38:07.896311+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:38:07.896311+0000","last_undegraded":"2024-09-14T11:38:07.896311+0000","last_fullsized":"2024-09-14T11:38:07.896311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.896225+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:30.027652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'357","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.971599+0000","last_change":"2024-09-14T11:37:59.971599+0000","last_active":"2024-09-14T11:37:59.971599+0000","last_peered":"2024-09-14T11:37:59.971599+0000","last_clean":"2024-09-14T11:37:59.971599+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:37:59.971599+0000","last_undegraded":"2024-09-14T11:37:59.971599+0000","last_fullsized":"2024-09-14T11:37:59.971599+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.971497+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:22.835652+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":780,"num_read_kb":7716,"num_write":1096,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.885243+0000","last_change":"2024-09-14T10:56:10.851020+0000","last_active":"2024-09-14T11:33:44.885243+0000","last_peered":"2024-09-14T11:33:44.885243+0000","last_clean":"2024-09-14T11:33:44.885243+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:33:44.885243+0000","last_undegraded":"2024-09-14T11:33:44.885243+0000","last_fullsized":"2024-09-14T11:33:44.885243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:37:54.621932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'321","reported_seq":895,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.899850+0000","last_change":"2024-09-14T10:56:12.853222+0000","last_active":"2024-09-14T11:37:46.899850+0000","last_peered":"2024-09-14T11:37:46.899850+0000","last_clean":"2024-09-14T11:37:46.899850+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:37:46.899850+0000","last_undegraded":"2024-09-14T11:37:46.899850+0000","last_fullsized":"2024-09-14T11:37:46.899850+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":300,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:03.588768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1178,"num_write":428,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":479,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761752+0000","last_change":"2024-09-14T10:56:14.869597+0000","last_active":"2024-09-14T11:34:58.761752+0000","last_peered":"2024-09-14T11:34:58.761752+0000","last_clean":"2024-09-14T11:34:58.761752+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:34:58.761752+0000","last_undegraded":"2024-09-14T11:34:58.761752+0000","last_fullsized":"2024-09-14T11:34:58.761752+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:52:57.846436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'123","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.460581+0000","last_change":"2024-09-14T10:56:16.872084+0000","last_active":"2024-09-14T11:37:13.460581+0000","last_peered":"2024-09-14T11:37:13.460581+0000","last_clean":"2024-09-14T11:37:13.460581+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:37:13.460581+0000","last_undegraded":"2024-09-14T11:37:13.460581+0000","last_fullsized":"2024-09-14T11:37:13.460581+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:22:09.391213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.879515+0000","last_change":"2024-09-14T11:38:06.879515+0000","last_active":"2024-09-14T11:38:06.879515+0000","last_peered":"2024-09-14T11:38:06.879515+0000","last_clean":"2024-09-14T11:38:06.879515+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:38:06.879515+0000","last_undegraded":"2024-09-14T11:38:06.879515+0000","last_fullsized":"2024-09-14T11:38:06.879515+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.879391+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:16.629096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'333","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.959619+0000","last_change":"2024-09-14T11:38:00.959619+0000","last_active":"2024-09-14T11:38:00.959619+0000","last_peered":"2024-09-14T11:38:00.959619+0000","last_clean":"2024-09-14T11:38:00.959619+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:38:00.959619+0000","last_undegraded":"2024-09-14T11:38:00.959619+0000","last_fullsized":"2024-09-14T11:38:00.959619+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.959518+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:02.829306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":36817,"num_write":973,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:42.867186+0000","last_change":"2024-09-14T10:56:10.846542+0000","last_active":"2024-09-14T11:33:42.867186+0000","last_peered":"2024-09-14T11:33:42.867186+0000","last_clean":"2024-09-14T11:33:42.867186+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:33:42.867186+0000","last_undegraded":"2024-09-14T11:33:42.867186+0000","last_fullsized":"2024-09-14T11:33:42.867186+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.655261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'283","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.935397+0000","last_change":"2024-09-14T10:56:12.854064+0000","last_active":"2024-09-14T11:37:46.935397+0000","last_peered":"2024-09-14T11:37:46.935397+0000","last_clean":"2024-09-14T11:37:46.935397+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:37:46.935397+0000","last_undegraded":"2024-09-14T11:37:46.935397+0000","last_fullsized":"2024-09-14T11:37:46.935397+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:56.267552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43010,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":1018,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.895529+0000","last_change":"2024-09-14T10:56:14.866692+0000","last_active":"2024-09-14T11:34:59.895529+0000","last_peered":"2024-09-14T11:34:59.895529+0000","last_clean":"2024-09-14T11:34:59.895529+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:34:59.895529+0000","last_undegraded":"2024-09-14T11:34:59.895529+0000","last_fullsized":"2024-09-14T11:34:59.895529+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:51:02.219332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'151","reported_seq":675,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:54.062796+0000","last_change":"2024-09-14T10:56:16.877739+0000","last_active":"2024-09-14T11:35:54.062796+0000","last_peered":"2024-09-14T11:35:54.062796+0000","last_clean":"2024-09-14T11:35:54.062796+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:35:54.062796+0000","last_undegraded":"2024-09-14T11:35:54.062796+0000","last_fullsized":"2024-09-14T11:35:54.062796+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:45.768007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'126","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.808000+0000","last_change":"2024-09-14T11:38:09.808000+0000","last_active":"2024-09-14T11:38:09.808000+0000","last_peered":"2024-09-14T11:38:09.808000+0000","last_clean":"2024-09-14T11:38:09.808000+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:38:09.808000+0000","last_undegraded":"2024-09-14T11:38:09.808000+0000","last_fullsized":"2024-09-14T11:38:09.808000+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.807913+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:08.263690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'378","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.769777+0000","last_change":"2024-09-14T11:37:57.769714+0000","last_active":"2024-09-14T11:37:57.769777+0000","last_peered":"2024-09-14T11:37:57.769777+0000","last_clean":"2024-09-14T11:37:57.769777+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:37:57.769777+0000","last_undegraded":"2024-09-14T11:37:57.769777+0000","last_fullsized":"2024-09-14T11:37:57.769777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.769590+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:11.879615+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":618,"num_read_kb":16528,"num_write":1305,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895271+0000","last_change":"2024-09-14T10:56:10.849183+0000","last_active":"2024-09-14T11:34:54.895271+0000","last_peered":"2024-09-14T11:34:54.895271+0000","last_clean":"2024-09-14T11:34:54.895271+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:34:54.895271+0000","last_undegraded":"2024-09-14T11:34:54.895271+0000","last_fullsized":"2024-09-14T11:34:54.895271+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:09.821899+0000","last_clean_scrub_stamp":"2024-09-14T10:56:09.821899+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:08:41.598284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'270","reported_seq":819,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.610692+0000","last_change":"2024-09-14T10:56:12.853468+0000","last_active":"2024-09-14T11:37:46.610692+0000","last_peered":"2024-09-14T11:37:46.610692+0000","last_clean":"2024-09-14T11:37:46.610692+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:37:46.610692+0000","last_undegraded":"2024-09-14T11:37:46.610692+0000","last_fullsized":"2024-09-14T11:37:46.610692+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:06:48.351559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51357,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":1141,"num_write":384,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:44.886032+0000","last_change":"2024-09-14T10:56:14.870248+0000","last_active":"2024-09-14T11:33:44.886032+0000","last_peered":"2024-09-14T11:33:44.886032+0000","last_clean":"2024-09-14T11:33:44.886032+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:33:44.886032+0000","last_undegraded":"2024-09-14T11:33:44.886032+0000","last_fullsized":"2024-09-14T11:33:44.886032+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:18.097159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'174","reported_seq":1634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:56.097709+0000","last_change":"2024-09-14T10:56:16.874279+0000","last_active":"2024-09-14T11:35:56.097709+0000","last_peered":"2024-09-14T11:35:56.097709+0000","last_clean":"2024-09-14T11:35:56.097709+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:35:56.097709+0000","last_undegraded":"2024-09-14T11:35:56.097709+0000","last_fullsized":"2024-09-14T11:35:56.097709+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:13.650009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.844285+0000","last_change":"2024-09-14T11:38:05.844285+0000","last_active":"2024-09-14T11:38:05.844285+0000","last_peered":"2024-09-14T11:38:05.844285+0000","last_clean":"2024-09-14T11:38:05.844285+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:38:05.844285+0000","last_undegraded":"2024-09-14T11:38:05.844285+0000","last_fullsized":"2024-09-14T11:38:05.844285+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.844184+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:14.327154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'362","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.193415+0000","last_change":"2024-09-14T11:37:56.193415+0000","last_active":"2024-09-14T11:37:56.193415+0000","last_peered":"2024-09-14T11:37:56.193415+0000","last_clean":"2024-09-14T11:37:56.193415+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:37:56.193415+0000","last_undegraded":"2024-09-14T11:37:56.193415+0000","last_fullsized":"2024-09-14T11:37:56.193415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.193342+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:11.215563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":662,"num_read_kb":13580,"num_write":1124,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.513158+0000","last_change":"2024-09-14T11:38:09.513158+0000","last_active":"2024-09-14T11:38:09.513158+0000","last_peered":"2024-09-14T11:38:09.513158+0000","last_clean":"2024-09-14T11:38:09.513158+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:38:09.513158+0000","last_undegraded":"2024-09-14T11:38:09.513158+0000","last_fullsized":"2024-09-14T11:38:09.513158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.513031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:35.439168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'281","reported_seq":865,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.712972+0000","last_change":"2024-09-14T10:56:12.850877+0000","last_active":"2024-09-14T11:37:46.712972+0000","last_peered":"2024-09-14T11:37:46.712972+0000","last_clean":"2024-09-14T11:37:46.712972+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:37:46.712972+0000","last_undegraded":"2024-09-14T11:37:46.712972+0000","last_fullsized":"2024-09-14T11:37:46.712972+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:11.833619+0000","last_clean_scrub_stamp":"2024-09-14T10:56:11.833619+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:39.131760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":1053,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":478,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:48.752208+0000","last_change":"2024-09-14T10:56:14.864169+0000","last_active":"2024-09-14T11:33:48.752208+0000","last_peered":"2024-09-14T11:33:48.752208+0000","last_clean":"2024-09-14T11:33:48.752208+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:33:48.752208+0000","last_undegraded":"2024-09-14T11:33:48.752208+0000","last_fullsized":"2024-09-14T11:33:48.752208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:13.842818+0000","last_clean_scrub_stamp":"2024-09-14T10:56:13.842818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:15.470147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'128","reported_seq":625,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:13.456829+0000","last_change":"2024-09-14T10:56:16.872566+0000","last_active":"2024-09-14T11:37:13.456829+0000","last_peered":"2024-09-14T11:37:13.456829+0000","last_clean":"2024-09-14T11:37:13.456829+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:37:13.456829+0000","last_undegraded":"2024-09-14T11:37:13.456829+0000","last_fullsized":"2024-09-14T11:37:13.456829+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:34.968881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.549238+0000","last_change":"2024-09-14T11:38:05.549238+0000","last_active":"2024-09-14T11:38:05.549238+0000","last_peered":"2024-09-14T11:38:05.549238+0000","last_clean":"2024-09-14T11:38:05.549238+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:38:05.549238+0000","last_undegraded":"2024-09-14T11:38:05.549238+0000","last_fullsized":"2024-09-14T11:38:05.549238+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.549130+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:53.773608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'381","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.243905+0000","last_change":"2024-09-14T11:38:00.243905+0000","last_active":"2024-09-14T11:38:00.243905+0000","last_peered":"2024-09-14T11:38:00.243905+0000","last_clean":"2024-09-14T11:38:00.243905+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:38:00.243905+0000","last_undegraded":"2024-09-14T11:38:00.243905+0000","last_fullsized":"2024-09-14T11:38:00.243905+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.243785+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:58.476866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":8663,"num_write":1069,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.481794+0000","last_change":"2024-09-14T11:38:07.481794+0000","last_active":"2024-09-14T11:38:07.481794+0000","last_peered":"2024-09-14T11:38:07.481794+0000","last_clean":"2024-09-14T11:38:07.481794+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:38:07.481794+0000","last_undegraded":"2024-09-14T11:38:07.481794+0000","last_fullsized":"2024-09-14T11:38:07.481794+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.481689+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.494813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'448","reported_seq":1120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.257837+0000","last_change":"2024-09-14T11:37:54.257837+0000","last_active":"2024-09-14T11:37:54.257837+0000","last_peered":"2024-09-14T11:37:54.257837+0000","last_clean":"2024-09-14T11:37:54.257837+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:37:54.257837+0000","last_undegraded":"2024-09-14T11:37:54.257837+0000","last_fullsized":"2024-09-14T11:37:54.257837+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'448","last_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_deep_scrub":"264'448","last_deep_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.257768+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:31.063923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":16320,"num_write":1497,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.006241+0000","last_change":"2024-09-14T11:38:09.006241+0000","last_active":"2024-09-14T11:38:09.006241+0000","last_peered":"2024-09-14T11:38:09.006241+0000","last_clean":"2024-09-14T11:38:09.006241+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:38:09.006241+0000","last_undegraded":"2024-09-14T11:38:09.006241+0000","last_fullsized":"2024-09-14T11:38:09.006241+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.006154+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'302","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.929061+0000","last_change":"2024-09-14T11:38:01.929061+0000","last_active":"2024-09-14T11:38:01.929061+0000","last_peered":"2024-09-14T11:38:01.929061+0000","last_clean":"2024-09-14T11:38:01.929061+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:38:01.929061+0000","last_undegraded":"2024-09-14T11:38:01.929061+0000","last_fullsized":"2024-09-14T11:38:01.929061+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.928975+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:06.365261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":2695,"num_write":898,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.499069+0000","last_change":"2024-09-14T11:38:04.499069+0000","last_active":"2024-09-14T11:38:04.499069+0000","last_peered":"2024-09-14T11:38:04.499069+0000","last_clean":"2024-09-14T11:38:04.499069+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:38:04.499069+0000","last_undegraded":"2024-09-14T11:38:04.499069+0000","last_fullsized":"2024-09-14T11:38:04.499069+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.498989+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.862258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'356","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.167523+0000","last_change":"2024-09-14T11:37:58.167440+0000","last_active":"2024-09-14T11:37:58.167523+0000","last_peered":"2024-09-14T11:37:58.167523+0000","last_clean":"2024-09-14T11:37:58.167523+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:37:58.167523+0000","last_undegraded":"2024-09-14T11:37:58.167523+0000","last_fullsized":"2024-09-14T11:37:58.167523+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.167277+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.933166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":27796,"num_write":1160,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.787252+0000","last_change":"2024-09-14T11:38:12.787252+0000","last_active":"2024-09-14T11:38:12.787252+0000","last_peered":"2024-09-14T11:38:12.787252+0000","last_clean":"2024-09-14T11:38:12.787252+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:38:12.787252+0000","last_undegraded":"2024-09-14T11:38:12.787252+0000","last_fullsized":"2024-09-14T11:38:12.787252+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4160","last_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_deep_scrub":"264'4160","last_deep_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.787148+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:55.106908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'442","reported_seq":1223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.746470+0000","last_change":"2024-09-14T11:37:59.746470+0000","last_active":"2024-09-14T11:37:59.746470+0000","last_peered":"2024-09-14T11:37:59.746470+0000","last_clean":"2024-09-14T11:37:59.746470+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:37:59.746470+0000","last_undegraded":"2024-09-14T11:37:59.746470+0000","last_fullsized":"2024-09-14T11:37:59.746470+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'442","last_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_deep_scrub":"264'442","last_deep_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.746338+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:48.240361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1409,"num_read_kb":14785,"num_write":1267,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.908101+0000","last_change":"2024-09-14T11:38:08.908101+0000","last_active":"2024-09-14T11:38:08.908101+0000","last_peered":"2024-09-14T11:38:08.908101+0000","last_clean":"2024-09-14T11:38:08.908101+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:38:08.908101+0000","last_undegraded":"2024-09-14T11:38:08.908101+0000","last_fullsized":"2024-09-14T11:38:08.908101+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.908006+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:32.288213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'423","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.528878+0000","last_change":"2024-09-14T11:37:57.528878+0000","last_active":"2024-09-14T11:37:57.528878+0000","last_peered":"2024-09-14T11:37:57.528878+0000","last_clean":"2024-09-14T11:37:57.528878+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:37:57.528878+0000","last_undegraded":"2024-09-14T11:37:57.528878+0000","last_fullsized":"2024-09-14T11:37:57.528878+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.528772+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:11.066498+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":745,"num_read_kb":54735,"num_write":1248,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.754421+0000","last_change":"2024-09-14T11:38:11.754421+0000","last_active":"2024-09-14T11:38:11.754421+0000","last_peered":"2024-09-14T11:38:11.754421+0000","last_clean":"2024-09-14T11:38:11.754421+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:38:11.754421+0000","last_undegraded":"2024-09-14T11:38:11.754421+0000","last_fullsized":"2024-09-14T11:38:11.754421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'75","last_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_deep_scrub":"264'75","last_deep_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.754322+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:33.771510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'428","reported_seq":1211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.248925+0000","last_change":"2024-09-14T11:37:58.248925+0000","last_active":"2024-09-14T11:37:58.248925+0000","last_peered":"2024-09-14T11:37:58.248925+0000","last_clean":"2024-09-14T11:37:58.248925+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:37:58.248925+0000","last_undegraded":"2024-09-14T11:37:58.248925+0000","last_fullsized":"2024-09-14T11:37:58.248925+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.248799+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:09.244000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1142,"num_read_kb":46426,"num_write":1473,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'303","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.161512+0000","last_change":"2024-09-14T11:38:08.161512+0000","last_active":"2024-09-14T11:38:08.161512+0000","last_peered":"2024-09-14T11:38:08.161512+0000","last_clean":"2024-09-14T11:38:08.161512+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:38:08.161512+0000","last_undegraded":"2024-09-14T11:38:08.161512+0000","last_fullsized":"2024-09-14T11:38:08.161512+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.161420+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:54.808745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'323","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.727550+0000","last_change":"2024-09-14T11:37:58.727550+0000","last_active":"2024-09-14T11:37:58.727550+0000","last_peered":"2024-09-14T11:37:58.727550+0000","last_clean":"2024-09-14T11:37:58.727550+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:37:58.727550+0000","last_undegraded":"2024-09-14T11:37:58.727550+0000","last_fullsized":"2024-09-14T11:37:58.727550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.727456+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:23.797636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":5718,"num_write":986,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.210936+0000","last_change":"2024-09-14T11:38:07.210816+0000","last_active":"2024-09-14T11:38:07.210936+0000","last_peered":"2024-09-14T11:38:07.210936+0000","last_clean":"2024-09-14T11:38:07.210936+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:38:07.210936+0000","last_undegraded":"2024-09-14T11:38:07.210936+0000","last_fullsized":"2024-09-14T11:38:07.210936+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.210704+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:06.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'377","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.911007+0000","last_change":"2024-09-14T11:38:02.911007+0000","last_active":"2024-09-14T11:38:02.911007+0000","last_peered":"2024-09-14T11:38:02.911007+0000","last_clean":"2024-09-14T11:38:02.911007+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:38:02.911007+0000","last_undegraded":"2024-09-14T11:38:02.911007+0000","last_fullsized":"2024-09-14T11:38:02.911007+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.910912+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:21.469889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":8094,"num_write":1138,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.884396+0000","last_change":"2024-09-14T11:38:09.884320+0000","last_active":"2024-09-14T11:38:09.884396+0000","last_peered":"2024-09-14T11:38:09.884396+0000","last_clean":"2024-09-14T11:38:09.884396+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:38:09.884396+0000","last_undegraded":"2024-09-14T11:38:09.884396+0000","last_fullsized":"2024-09-14T11:38:09.884396+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.884229+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:38.099864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'368","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.724263+0000","last_change":"2024-09-14T11:38:01.724263+0000","last_active":"2024-09-14T11:38:01.724263+0000","last_peered":"2024-09-14T11:38:01.724263+0000","last_clean":"2024-09-14T11:38:01.724263+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:38:01.724263+0000","last_undegraded":"2024-09-14T11:38:01.724263+0000","last_fullsized":"2024-09-14T11:38:01.724263+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.724153+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.764518+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1962460,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":52898,"num_write":1154,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.305061+0000","last_change":"2024-09-14T11:38:01.305061+0000","last_active":"2024-09-14T11:38:01.305061+0000","last_peered":"2024-09-14T11:38:01.305061+0000","last_clean":"2024-09-14T11:38:01.305061+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:38:01.305061+0000","last_undegraded":"2024-09-14T11:38:01.305061+0000","last_fullsized":"2024-09-14T11:38:01.305061+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.304953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:28.747455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'368","reported_seq":1242,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.974983+0000","last_change":"2024-09-14T11:38:06.974983+0000","last_active":"2024-09-14T11:38:06.974983+0000","last_peered":"2024-09-14T11:38:06.974983+0000","last_clean":"2024-09-14T11:38:06.974983+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:38:06.974983+0000","last_undegraded":"2024-09-14T11:38:06.974983+0000","last_fullsized":"2024-09-14T11:38:06.974983+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.974873+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:16.281919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":34715,"num_write":1227,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'92","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.842850+0000","last_change":"2024-09-14T11:38:11.842850+0000","last_active":"2024-09-14T11:38:11.842850+0000","last_peered":"2024-09-14T11:38:11.842850+0000","last_clean":"2024-09-14T11:38:11.842850+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:38:11.842850+0000","last_undegraded":"2024-09-14T11:38:11.842850+0000","last_fullsized":"2024-09-14T11:38:11.842850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.842773+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:45.306750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.126563+0000","last_change":"2024-09-14T11:37:59.126563+0000","last_active":"2024-09-14T11:37:59.126563+0000","last_peered":"2024-09-14T11:37:59.126563+0000","last_clean":"2024-09-14T11:37:59.126563+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:37:59.126563+0000","last_undegraded":"2024-09-14T11:37:59.126563+0000","last_fullsized":"2024-09-14T11:37:59.126563+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.126454+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:37.405483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":11879,"num_write":1239,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.016899+0000","last_change":"2024-09-14T11:38:10.016899+0000","last_active":"2024-09-14T11:38:10.016899+0000","last_peered":"2024-09-14T11:38:10.016899+0000","last_clean":"2024-09-14T11:38:10.016899+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:38:10.016899+0000","last_undegraded":"2024-09-14T11:38:10.016899+0000","last_fullsized":"2024-09-14T11:38:10.016899+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'280","last_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_deep_scrub":"264'280","last_deep_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.016803+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:19.537700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'406","reported_seq":1153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.277763+0000","last_change":"2024-09-14T11:37:59.277763+0000","last_active":"2024-09-14T11:37:59.277763+0000","last_peered":"2024-09-14T11:37:59.277763+0000","last_clean":"2024-09-14T11:37:59.277763+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:37:59.277763+0000","last_undegraded":"2024-09-14T11:37:59.277763+0000","last_fullsized":"2024-09-14T11:37:59.277763+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.277645+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:27.504525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":733,"num_read_kb":26249,"num_write":1207,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.135737+0000","last_change":"2024-09-14T11:38:05.135737+0000","last_active":"2024-09-14T11:38:05.135737+0000","last_peered":"2024-09-14T11:38:05.135737+0000","last_clean":"2024-09-14T11:38:05.135737+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:38:05.135737+0000","last_undegraded":"2024-09-14T11:38:05.135737+0000","last_fullsized":"2024-09-14T11:38:05.135737+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.135630+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:24.161099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'368","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.002948+0000","last_change":"2024-09-14T11:38:09.002948+0000","last_active":"2024-09-14T11:38:09.002948+0000","last_peered":"2024-09-14T11:38:09.002948+0000","last_clean":"2024-09-14T11:38:09.002948+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:38:09.002948+0000","last_undegraded":"2024-09-14T11:38:09.002948+0000","last_fullsized":"2024-09-14T11:38:09.002948+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.002842+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.692925+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":666,"num_read_kb":46769,"num_write":1234,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.797439+0000","last_change":"2024-09-14T11:38:13.797439+0000","last_active":"2024-09-14T11:38:13.797439+0000","last_peered":"2024-09-14T11:38:13.797439+0000","last_clean":"2024-09-14T11:38:13.797439+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:38:13.797439+0000","last_undegraded":"2024-09-14T11:38:13.797439+0000","last_fullsized":"2024-09-14T11:38:13.797439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.797343+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:13.340408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'368","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.257810+0000","last_change":"2024-09-14T11:37:55.257698+0000","last_active":"2024-09-14T11:37:55.257810+0000","last_peered":"2024-09-14T11:37:55.257810+0000","last_clean":"2024-09-14T11:37:55.257810+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:37:55.257810+0000","last_undegraded":"2024-09-14T11:37:55.257810+0000","last_fullsized":"2024-09-14T11:37:55.257810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.257597+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:19.080090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":4323,"num_write":1184,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.980463+0000","last_change":"2024-09-14T11:38:06.980463+0000","last_active":"2024-09-14T11:38:06.980463+0000","last_peered":"2024-09-14T11:38:06.980463+0000","last_clean":"2024-09-14T11:38:06.980463+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:38:06.980463+0000","last_undegraded":"2024-09-14T11:38:06.980463+0000","last_fullsized":"2024-09-14T11:38:06.980463+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'431","last_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_deep_scrub":"264'431","last_deep_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.980372+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:22.678230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.931945+0000","last_change":"2024-09-14T11:38:03.931886+0000","last_active":"2024-09-14T11:38:03.931945+0000","last_peered":"2024-09-14T11:38:03.931945+0000","last_clean":"2024-09-14T11:38:03.931945+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:38:03.931945+0000","last_undegraded":"2024-09-14T11:38:03.931945+0000","last_fullsized":"2024-09-14T11:38:03.931945+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.931780+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:42.380009+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655902,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":2905,"num_write":1051,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'366","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.253747+0000","last_change":"2024-09-14T11:37:56.253747+0000","last_active":"2024-09-14T11:37:56.253747+0000","last_peered":"2024-09-14T11:37:56.253747+0000","last_clean":"2024-09-14T11:37:56.253747+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:37:56.253747+0000","last_undegraded":"2024-09-14T11:37:56.253747+0000","last_fullsized":"2024-09-14T11:37:56.253747+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.253643+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:41.679508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":610,"num_read_kb":51615,"num_write":1215,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.160953+0000","last_change":"2024-09-14T11:38:10.160953+0000","last_active":"2024-09-14T11:38:10.160953+0000","last_peered":"2024-09-14T11:38:10.160953+0000","last_clean":"2024-09-14T11:38:10.160953+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:38:10.160953+0000","last_undegraded":"2024-09-14T11:38:10.160953+0000","last_fullsized":"2024-09-14T11:38:10.160953+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.160870+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:30.132911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'349","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.545383+0000","last_change":"2024-09-14T11:37:58.545303+0000","last_active":"2024-09-14T11:37:58.545383+0000","last_peered":"2024-09-14T11:37:58.545383+0000","last_clean":"2024-09-14T11:37:58.545383+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:37:58.545383+0000","last_undegraded":"2024-09-14T11:37:58.545383+0000","last_fullsized":"2024-09-14T11:37:58.545383+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.545209+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:58.985882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":18767,"num_write":1102,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.979868+0000","last_change":"2024-09-14T11:38:10.979868+0000","last_active":"2024-09-14T11:38:10.979868+0000","last_peered":"2024-09-14T11:38:10.979868+0000","last_clean":"2024-09-14T11:38:10.979868+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:38:10.979868+0000","last_undegraded":"2024-09-14T11:38:10.979868+0000","last_fullsized":"2024-09-14T11:38:10.979868+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.979770+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:08.122305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1684,"ondisk_log_size":1684,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":552,"ondisk_log_size":552,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1610275,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17487,"num_read_kb":37004,"num_write":14657,"num_write_kb":11695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":30132,"num_omap_keys":60,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2059,"ondisk_log_size":2059,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35465,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4177,"ondisk_log_size":4177,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33940714,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44010,"num_read_kb":2045437,"num_write":72918,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68894720,"data_stored":67881428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":206212,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193226,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509955,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279124,"kb_used_data":9156,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94092716,"statfs":{"total":96636764160,"available":96350941184,"internally_reserved":0,"allocated":9375744,"data_stored":7712300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509954,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226860,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94144980,"statfs":{"total":96636764160,"available":96404459520,"internally_reserved":0,"allocated":7041024,"data_stored":5465111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509953,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90888,"kb_used_data":15288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94280952,"statfs":{"total":96636764160,"available":96543694848,"internally_reserved":0,"allocated":15654912,"data_stored":14047867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509955,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267756,"kb_used_data":15836,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94104084,"statfs":{"total":96636764160,"available":96362582016,"internally_reserved":0,"allocated":16216064,"data_stored":14565484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509954,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56752,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315088,"statfs":{"total":96636764160,"available":96578650112,"internally_reserved":0,"allocated":11960320,"data_stored":10430814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542659,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115056,"kb_used_data":11744,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94256784,"statfs":{"total":96636764160,"available":96518946816,"internally_reserved":0,"allocated":12025856,"data_stored":10431815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542656,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255272,"kb_used_data":17304,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94116568,"statfs":{"total":96636764160,"available":96375365632,"internally_reserved":0,"allocated":17719296,"data_stored":15992953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575361,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116548,"kb_used_data":9076,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94255292,"statfs":{"total":96636764160,"available":96517419008,"internally_reserved":0,"allocated":9293824,"data_stored":7637406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13430784,"data_stored":13247355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8384512,"data_stored":8279522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8343552,"data_stored":8279343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12570624,"data_stored":12413553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12062720,"data_stored":11898009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":5483519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3403776,"data_stored":3312046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5099520,"data_stored":4968081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:38:16.120 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.120 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.120 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.121 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.122 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.123 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.124 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.124 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.124 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.124 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.124 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.125 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.126 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.127 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.128 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.129 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.130 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.131 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.132 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.133 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.134 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.134 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.134 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.134 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-14T10:56:07.811602+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=7, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.134 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.134 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.134 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.135 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.136 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.137 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.138 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.139 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.140 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.140 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.140 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.140 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.140 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.140 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.140 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.141 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.141 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.141 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.141 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.141 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.141 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.141 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.142 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.143 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.144 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-14T10:56:09.821899+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=9, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.145 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.146 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-14T10:56:11.833619+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=11, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.146 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-14T10:56:13.842818+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=13, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.146 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:16.146 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:38:36.147 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:38:36.498 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:38:36.510 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:38:36.511 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1541,"stamp":"2024-09-14T11:38:35.684580+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36158020,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":196655,"num_read_kb":2597552,"num_write":146051,"num_write_kb":2468367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":739346,"num_omap_keys":1779,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13468,"ondisk_log_size":13468,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1408256,"kb_used_data":96960,"kb_used_omap":12,"kb_used_meta":1311155,"kb_avail":753566464,"statfs":{"total":773094113280,"available":771652059136,"internally_reserved":0,"allocated":99287040,"data_stored":86283750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1342623280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32531,"num_omap_keys":89,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005417"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879647+0000","last_change":"2024-09-14T11:22:38.554296+0000","last_active":"2024-09-14T11:35:07.879647+0000","last_peered":"2024-09-14T11:35:07.879647+0000","last_clean":"2024-09-14T11:35:07.879647+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:35:07.879647+0000","last_undegraded":"2024-09-14T11:35:07.879647+0000","last_fullsized":"2024-09-14T11:35:07.879647+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:32:24.257792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":33,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:32.874387+0000","last_change":"2024-09-14T11:12:00.371370+0000","last_active":"2024-09-14T11:34:32.874387+0000","last_peered":"2024-09-14T11:34:32.874387+0000","last_clean":"2024-09-14T11:34:32.874387+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:34:32.874387+0000","last_undegraded":"2024-09-14T11:34:32.874387+0000","last_fullsized":"2024-09-14T11:34:32.874387+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:10.434332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.943218+0000","last_change":"2024-09-14T11:11:57.356179+0000","last_active":"2024-09-14T11:37:45.943218+0000","last_peered":"2024-09-14T11:37:45.943218+0000","last_clean":"2024-09-14T11:37:45.943218+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:37:45.943218+0000","last_undegraded":"2024-09-14T11:37:45.943218+0000","last_fullsized":"2024-09-14T11:37:45.943218+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:27:20.159773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":156,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763760+0000","last_change":"2024-09-14T11:10:13.511537+0000","last_active":"2024-09-14T11:35:13.763760+0000","last_peered":"2024-09-14T11:35:13.763760+0000","last_clean":"2024-09-14T11:35:13.763760+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:35:13.763760+0000","last_undegraded":"2024-09-14T11:35:13.763760+0000","last_fullsized":"2024-09-14T11:35:13.763760+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:14:32.720099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.169885+0000","last_change":"2024-09-14T11:38:24.169885+0000","last_active":"2024-09-14T11:38:24.169885+0000","last_peered":"2024-09-14T11:38:24.169885+0000","last_clean":"2024-09-14T11:38:24.169885+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:38:24.169885+0000","last_undegraded":"2024-09-14T11:38:24.169885+0000","last_fullsized":"2024-09-14T11:38:24.169885+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.169793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.169793+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.169793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:11.603144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912661+0000","last_change":"2024-09-14T11:12:00.365069+0000","last_active":"2024-09-14T11:36:59.912661+0000","last_peered":"2024-09-14T11:36:59.912661+0000","last_clean":"2024-09-14T11:36:59.912661+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:36:59.912661+0000","last_undegraded":"2024-09-14T11:36:59.912661+0000","last_fullsized":"2024-09-14T11:36:59.912661+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:39.203248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.621483+0000","last_change":"2024-09-14T11:38:26.621483+0000","last_active":"2024-09-14T11:38:26.621483+0000","last_peered":"2024-09-14T11:38:26.621483+0000","last_clean":"2024-09-14T11:38:26.621483+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:38:26.621483+0000","last_undegraded":"2024-09-14T11:38:26.621483+0000","last_fullsized":"2024-09-14T11:38:26.621483+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:26.621386+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:26.621386+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.621386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:01.370036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.252305+0000","last_change":"2024-09-14T11:38:15.252181+0000","last_active":"2024-09-14T11:38:15.252305+0000","last_peered":"2024-09-14T11:38:15.252305+0000","last_clean":"2024-09-14T11:38:15.252305+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:38:15.252305+0000","last_undegraded":"2024-09-14T11:38:15.252305+0000","last_fullsized":"2024-09-14T11:38:15.252305+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-09-14T11:38:15.252053+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-09-14T11:38:15.252053+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.252053+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:49.934103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.029476+0000","last_change":"2024-09-14T11:38:32.029476+0000","last_active":"2024-09-14T11:38:32.029476+0000","last_peered":"2024-09-14T11:38:32.029476+0000","last_clean":"2024-09-14T11:38:32.029476+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:38:32.029476+0000","last_undegraded":"2024-09-14T11:38:32.029476+0000","last_fullsized":"2024-09-14T11:38:32.029476+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:32.029389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:32.029389+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.029389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.188681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'6","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.452291+0000","last_change":"2024-09-14T11:12:00.696948+0000","last_active":"2024-09-14T11:37:46.452291+0000","last_peered":"2024-09-14T11:37:46.452291+0000","last_clean":"2024-09-14T11:37:46.452291+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:37:46.452291+0000","last_undegraded":"2024-09-14T11:37:46.452291+0000","last_fullsized":"2024-09-14T11:37:46.452291+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:53:04.389759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.155151+0000","last_change":"2024-09-14T11:38:20.155151+0000","last_active":"2024-09-14T11:38:20.155151+0000","last_peered":"2024-09-14T11:38:20.155151+0000","last_clean":"2024-09-14T11:38:20.155151+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:38:20.155151+0000","last_undegraded":"2024-09-14T11:38:20.155151+0000","last_fullsized":"2024-09-14T11:38:20.155151+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:20.155068+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:20.155068+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.155068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:17.930504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5122,"num_write":13,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":167,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:13.763690+0000","last_change":"2024-09-14T11:10:13.508809+0000","last_active":"2024-09-14T11:35:13.763690+0000","last_peered":"2024-09-14T11:35:13.763690+0000","last_clean":"2024-09-14T11:35:13.763690+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:35:13.763690+0000","last_undegraded":"2024-09-14T11:35:13.763690+0000","last_fullsized":"2024-09-14T11:35:13.763690+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:45.025002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605928+0000","last_change":"2024-09-14T11:22:38.561594+0000","last_active":"2024-09-14T11:34:45.605928+0000","last_peered":"2024-09-14T11:34:45.605928+0000","last_clean":"2024-09-14T11:34:45.605928+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:34:45.605928+0000","last_undegraded":"2024-09-14T11:34:45.605928+0000","last_fullsized":"2024-09-14T11:34:45.605928+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:17.203331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.202413+0000","last_change":"2024-09-14T11:12:00.696088+0000","last_active":"2024-09-14T11:37:46.202413+0000","last_peered":"2024-09-14T11:37:46.202413+0000","last_clean":"2024-09-14T11:37:46.202413+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:37:46.202413+0000","last_undegraded":"2024-09-14T11:37:46.202413+0000","last_fullsized":"2024-09-14T11:37:46.202413+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'9","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912700+0000","last_change":"2024-09-14T11:11:57.350368+0000","last_active":"2024-09-14T11:36:59.912700+0000","last_peered":"2024-09-14T11:36:59.912700+0000","last_clean":"2024-09-14T11:36:59.912700+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:36:59.912700+0000","last_undegraded":"2024-09-14T11:36:59.912700+0000","last_fullsized":"2024-09-14T11:36:59.912700+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:04.809685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609835+0000","last_change":"2024-09-14T11:10:13.511471+0000","last_active":"2024-09-14T11:35:15.609835+0000","last_peered":"2024-09-14T11:35:15.609835+0000","last_clean":"2024-09-14T11:35:15.609835+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:35:15.609835+0000","last_undegraded":"2024-09-14T11:35:15.609835+0000","last_fullsized":"2024-09-14T11:35:15.609835+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:33.776917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:40.605265+0000","last_change":"2024-09-14T11:22:38.562233+0000","last_active":"2024-09-14T11:34:40.605265+0000","last_peered":"2024-09-14T11:34:40.605265+0000","last_clean":"2024-09-14T11:34:40.605265+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:34:40.605265+0000","last_undegraded":"2024-09-14T11:34:40.605265+0000","last_fullsized":"2024-09-14T11:34:40.605265+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:59.647783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:33:47.868050+0000","last_change":"2024-09-14T11:12:00.373042+0000","last_active":"2024-09-14T11:33:47.868050+0000","last_peered":"2024-09-14T11:33:47.868050+0000","last_clean":"2024-09-14T11:33:47.868050+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:33:47.868050+0000","last_undegraded":"2024-09-14T11:33:47.868050+0000","last_fullsized":"2024-09-14T11:33:47.868050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:55:42.391631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:08.770831+0000","last_change":"2024-09-14T11:11:57.347912+0000","last_active":"2024-09-14T11:36:08.770831+0000","last_peered":"2024-09-14T11:36:08.770831+0000","last_clean":"2024-09-14T11:36:08.770831+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:36:08.770831+0000","last_undegraded":"2024-09-14T11:36:08.770831+0000","last_fullsized":"2024-09-14T11:36:08.770831+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":110,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:15.609807+0000","last_change":"2024-09-14T11:10:13.510098+0000","last_active":"2024-09-14T11:35:15.609807+0000","last_peered":"2024-09-14T11:35:15.609807+0000","last_clean":"2024-09-14T11:35:15.609807+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:35:15.609807+0000","last_undegraded":"2024-09-14T11:35:15.609807+0000","last_fullsized":"2024-09-14T11:35:15.609807+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:46.783877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.644921+0000","last_change":"2024-09-14T11:38:33.644921+0000","last_active":"2024-09-14T11:38:33.644921+0000","last_peered":"2024-09-14T11:38:33.644921+0000","last_clean":"2024-09-14T11:38:33.644921+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:38:33.644921+0000","last_undegraded":"2024-09-14T11:38:33.644921+0000","last_fullsized":"2024-09-14T11:38:33.644921+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:33.644836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:33.644836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.644836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:52.935576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.949765+0000","last_change":"2024-09-14T11:38:29.949686+0000","last_active":"2024-09-14T11:38:29.949765+0000","last_peered":"2024-09-14T11:38:29.949765+0000","last_clean":"2024-09-14T11:38:29.949765+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:38:29.949765+0000","last_undegraded":"2024-09-14T11:38:29.949765+0000","last_fullsized":"2024-09-14T11:38:29.949765+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:38:29.949588+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:38:29.949588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.949588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:13.966792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:09.906126+0000","last_change":"2024-09-14T11:11:57.351572+0000","last_active":"2024-09-14T11:36:09.906126+0000","last_peered":"2024-09-14T11:36:09.906126+0000","last_clean":"2024-09-14T11:36:09.906126+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:36:09.906126+0000","last_undegraded":"2024-09-14T11:36:09.906126+0000","last_fullsized":"2024-09-14T11:36:09.906126+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.100873+0000","last_change":"2024-09-14T11:38:24.100873+0000","last_active":"2024-09-14T11:38:24.100873+0000","last_peered":"2024-09-14T11:38:24.100873+0000","last_clean":"2024-09-14T11:38:24.100873+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:38:24.100873+0000","last_undegraded":"2024-09-14T11:38:24.100873+0000","last_fullsized":"2024-09-14T11:38:24.100873+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-14T11:38:24.100793+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-14T11:38:24.100793+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.100793+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:21.604899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897474+0000","last_change":"2024-09-14T11:22:38.558217+0000","last_active":"2024-09-14T11:35:09.897474+0000","last_peered":"2024-09-14T11:35:09.897474+0000","last_clean":"2024-09-14T11:35:09.897474+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:35:09.897474+0000","last_undegraded":"2024-09-14T11:35:09.897474+0000","last_fullsized":"2024-09-14T11:35:09.897474+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:19:16.956158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.940825+0000","last_change":"2024-09-14T11:38:28.940825+0000","last_active":"2024-09-14T11:38:28.940825+0000","last_peered":"2024-09-14T11:38:28.940825+0000","last_clean":"2024-09-14T11:38:28.940825+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:38:28.940825+0000","last_undegraded":"2024-09-14T11:38:28.940825+0000","last_fullsized":"2024-09-14T11:38:28.940825+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-14T11:38:28.940735+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-14T11:38:28.940735+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.940735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:19.251022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891654+0000","last_change":"2024-09-14T11:11:57.355185+0000","last_active":"2024-09-14T11:34:29.891654+0000","last_peered":"2024-09-14T11:34:29.891654+0000","last_clean":"2024-09-14T11:34:29.891654+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:34:29.891654+0000","last_undegraded":"2024-09-14T11:34:29.891654+0000","last_fullsized":"2024-09-14T11:34:29.891654+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:48.881561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.104154+0000","last_change":"2024-09-14T11:38:33.104154+0000","last_active":"2024-09-14T11:38:33.104154+0000","last_peered":"2024-09-14T11:38:33.104154+0000","last_clean":"2024-09-14T11:38:33.104154+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:38:33.104154+0000","last_undegraded":"2024-09-14T11:38:33.104154+0000","last_fullsized":"2024-09-14T11:38:33.104154+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:38:33.104000+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:38:33.104000+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.104000+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.817552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897517+0000","last_change":"2024-09-14T11:22:38.561164+0000","last_active":"2024-09-14T11:35:09.897517+0000","last_peered":"2024-09-14T11:35:09.897517+0000","last_clean":"2024-09-14T11:35:09.897517+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:35:09.897517+0000","last_undegraded":"2024-09-14T11:35:09.897517+0000","last_fullsized":"2024-09-14T11:35:09.897517+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:43.901705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:12.880477+0000","last_change":"2024-09-14T11:12:43.314131+0000","last_active":"2024-09-14T11:35:12.880477+0000","last_peered":"2024-09-14T11:35:12.880477+0000","last_clean":"2024-09-14T11:35:12.880477+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:35:12.880477+0000","last_undegraded":"2024-09-14T11:35:12.880477+0000","last_fullsized":"2024-09-14T11:35:12.880477+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:35:03.892987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.339573+0000","last_change":"2024-09-14T11:11:57.358103+0000","last_active":"2024-09-14T11:37:46.339573+0000","last_peered":"2024-09-14T11:37:46.339573+0000","last_clean":"2024-09-14T11:37:46.339573+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:37:46.339573+0000","last_undegraded":"2024-09-14T11:37:46.339573+0000","last_fullsized":"2024-09-14T11:37:46.339573+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:48:14.863257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.560033+0000","last_change":"2024-09-14T11:38:23.560033+0000","last_active":"2024-09-14T11:38:23.560033+0000","last_peered":"2024-09-14T11:38:23.560033+0000","last_clean":"2024-09-14T11:38:23.560033+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:38:23.560033+0000","last_undegraded":"2024-09-14T11:38:23.560033+0000","last_fullsized":"2024-09-14T11:38:23.560033+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-14T11:38:23.559943+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-14T11:38:23.559943+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.559943+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:11.949125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:18.756557+0000","last_change":"2024-09-14T11:22:38.559223+0000","last_active":"2024-09-14T11:34:18.756557+0000","last_peered":"2024-09-14T11:34:18.756557+0000","last_clean":"2024-09-14T11:34:18.756557+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:34:18.756557+0000","last_undegraded":"2024-09-14T11:34:18.756557+0000","last_fullsized":"2024-09-14T11:34:18.756557+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:38:18.099181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.052492+0000","last_change":"2024-09-14T11:12:00.695830+0000","last_active":"2024-09-14T11:37:46.052492+0000","last_peered":"2024-09-14T11:37:46.052492+0000","last_clean":"2024-09-14T11:37:46.052492+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:37:46.052492+0000","last_undegraded":"2024-09-14T11:37:46.052492+0000","last_fullsized":"2024-09-14T11:37:46.052492+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:17.881154+0000","last_change":"2024-09-14T11:11:57.353227+0000","last_active":"2024-09-14T11:35:17.881154+0000","last_peered":"2024-09-14T11:35:17.881154+0000","last_clean":"2024-09-14T11:35:17.881154+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:35:17.881154+0000","last_undegraded":"2024-09-14T11:35:17.881154+0000","last_fullsized":"2024-09-14T11:35:17.881154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:08.822820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:59.845469+0000","last_change":"2024-09-14T11:10:13.507446+0000","last_active":"2024-09-14T11:34:59.845469+0000","last_peered":"2024-09-14T11:34:59.845469+0000","last_clean":"2024-09-14T11:34:59.845469+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:34:59.845469+0000","last_undegraded":"2024-09-14T11:34:59.845469+0000","last_fullsized":"2024-09-14T11:34:59.845469+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:27:37.515685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.175779+0000","last_change":"2024-09-14T11:38:23.175779+0000","last_active":"2024-09-14T11:38:23.175779+0000","last_peered":"2024-09-14T11:38:23.175779+0000","last_clean":"2024-09-14T11:38:23.175779+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:38:23.175779+0000","last_undegraded":"2024-09-14T11:38:23.175779+0000","last_fullsized":"2024-09-14T11:38:23.175779+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:23.175677+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:23.175677+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.175677+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:09.393436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:45.629713+0000","last_change":"2024-09-14T11:12:00.697008+0000","last_active":"2024-09-14T11:37:45.629713+0000","last_peered":"2024-09-14T11:37:45.629713+0000","last_clean":"2024-09-14T11:37:45.629713+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:37:45.629713+0000","last_undegraded":"2024-09-14T11:37:45.629713+0000","last_fullsized":"2024-09-14T11:37:45.629713+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:03.052127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.788476+0000","last_change":"2024-09-14T11:11:57.349579+0000","last_active":"2024-09-14T11:37:46.788476+0000","last_peered":"2024-09-14T11:37:46.788476+0000","last_clean":"2024-09-14T11:37:46.788476+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:37:46.788476+0000","last_undegraded":"2024-09-14T11:37:46.788476+0000","last_fullsized":"2024-09-14T11:37:46.788476+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:25.603094+0000","last_change":"2024-09-14T11:10:13.510036+0000","last_active":"2024-09-14T11:34:25.603094+0000","last_peered":"2024-09-14T11:34:25.603094+0000","last_clean":"2024-09-14T11:34:25.603094+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:34:25.603094+0000","last_undegraded":"2024-09-14T11:34:25.603094+0000","last_fullsized":"2024-09-14T11:34:25.603094+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:57:48.885727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:19.889866+0000","last_change":"2024-09-14T11:22:38.557418+0000","last_active":"2024-09-14T11:34:19.889866+0000","last_peered":"2024-09-14T11:34:19.889866+0000","last_clean":"2024-09-14T11:34:19.889866+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:34:19.889866+0000","last_undegraded":"2024-09-14T11:34:19.889866+0000","last_fullsized":"2024-09-14T11:34:19.889866+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:24.551262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.376023+0000","last_change":"2024-09-14T11:12:00.697792+0000","last_active":"2024-09-14T11:37:46.376023+0000","last_peered":"2024-09-14T11:37:46.376023+0000","last_clean":"2024-09-14T11:37:46.376023+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:37:46.376023+0000","last_undegraded":"2024-09-14T11:37:46.376023+0000","last_fullsized":"2024-09-14T11:37:46.376023+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.194185+0000","last_change":"2024-09-14T11:38:19.194130+0000","last_active":"2024-09-14T11:38:19.194185+0000","last_peered":"2024-09-14T11:38:19.194185+0000","last_clean":"2024-09-14T11:38:19.194185+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:38:19.194185+0000","last_undegraded":"2024-09-14T11:38:19.194185+0000","last_fullsized":"2024-09-14T11:38:19.194185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:19.194040+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:19.194040+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.194040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:56.906130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.232395+0000","last_change":"2024-09-14T11:38:16.232395+0000","last_active":"2024-09-14T11:38:16.232395+0000","last_peered":"2024-09-14T11:38:16.232395+0000","last_clean":"2024-09-14T11:38:16.232395+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:38:16.232395+0000","last_undegraded":"2024-09-14T11:38:16.232395+0000","last_fullsized":"2024-09-14T11:38:16.232395+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:16.232320+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:16.232320+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.232320+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:12.306009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:17.872355+0000","last_change":"2024-09-14T11:22:38.556244+0000","last_active":"2024-09-14T11:34:17.872355+0000","last_peered":"2024-09-14T11:34:17.872355+0000","last_clean":"2024-09-14T11:34:17.872355+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:34:17.872355+0000","last_undegraded":"2024-09-14T11:34:17.872355+0000","last_fullsized":"2024-09-14T11:34:17.872355+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:57:12.131431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'3","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.867311+0000","last_change":"2024-09-14T11:12:00.371092+0000","last_active":"2024-09-14T11:37:46.867311+0000","last_peered":"2024-09-14T11:37:46.867311+0000","last_clean":"2024-09-14T11:37:46.867311+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:37:46.867311+0000","last_undegraded":"2024-09-14T11:37:46.867311+0000","last_fullsized":"2024-09-14T11:37:46.867311+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:08.771032+0000","last_change":"2024-09-14T11:11:57.355672+0000","last_active":"2024-09-14T11:36:08.771032+0000","last_peered":"2024-09-14T11:36:08.771032+0000","last_clean":"2024-09-14T11:36:08.771032+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:36:08.771032+0000","last_undegraded":"2024-09-14T11:36:08.771032+0000","last_fullsized":"2024-09-14T11:36:08.771032+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.897864+0000","last_change":"2024-09-14T11:38:33.897864+0000","last_active":"2024-09-14T11:38:33.897864+0000","last_peered":"2024-09-14T11:38:33.897864+0000","last_clean":"2024-09-14T11:38:33.897864+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:38:33.897864+0000","last_undegraded":"2024-09-14T11:38:33.897864+0000","last_fullsized":"2024-09-14T11:38:33.897864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:33.897774+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:33.897774+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.897774+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:30.292702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.606019+0000","last_change":"2024-09-14T11:22:38.560634+0000","last_active":"2024-09-14T11:34:45.606019+0000","last_peered":"2024-09-14T11:34:45.606019+0000","last_clean":"2024-09-14T11:34:45.606019+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:34:45.606019+0000","last_undegraded":"2024-09-14T11:34:45.606019+0000","last_fullsized":"2024-09-14T11:34:45.606019+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:00.155051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.652356+0000","last_change":"2024-09-14T11:38:30.652356+0000","last_active":"2024-09-14T11:38:30.652356+0000","last_peered":"2024-09-14T11:38:30.652356+0000","last_clean":"2024-09-14T11:38:30.652356+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:38:30.652356+0000","last_undegraded":"2024-09-14T11:38:30.652356+0000","last_fullsized":"2024-09-14T11:38:30.652356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:30.652266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:30.652266+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.652266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.712630+0000","last_change":"2024-09-14T11:38:33.712630+0000","last_active":"2024-09-14T11:38:33.712630+0000","last_peered":"2024-09-14T11:38:33.712630+0000","last_clean":"2024-09-14T11:38:33.712630+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:38:33.712630+0000","last_undegraded":"2024-09-14T11:38:33.712630+0000","last_fullsized":"2024-09-14T11:38:33.712630+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:33.712531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:33.712531+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.712531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:40.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.874688+0000","last_change":"2024-09-14T11:38:32.874688+0000","last_active":"2024-09-14T11:38:32.874688+0000","last_peered":"2024-09-14T11:38:32.874688+0000","last_clean":"2024-09-14T11:38:32.874688+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:38:32.874688+0000","last_undegraded":"2024-09-14T11:38:32.874688+0000","last_fullsized":"2024-09-14T11:38:32.874688+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'14","last_scrub_stamp":"2024-09-14T11:38:32.874597+0000","last_deep_scrub":"261'14","last_deep_scrub_stamp":"2024-09-14T11:38:32.874597+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.874597+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:31.872512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:43.759854+0000","last_change":"2024-09-14T11:22:38.562421+0000","last_active":"2024-09-14T11:34:43.759854+0000","last_peered":"2024-09-14T11:34:43.759854+0000","last_clean":"2024-09-14T11:34:43.759854+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:34:43.759854+0000","last_undegraded":"2024-09-14T11:34:43.759854+0000","last_fullsized":"2024-09-14T11:34:43.759854+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:19.932638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.700105+0000","last_change":"2024-09-14T11:38:29.700105+0000","last_active":"2024-09-14T11:38:29.700105+0000","last_peered":"2024-09-14T11:38:29.700105+0000","last_clean":"2024-09-14T11:38:29.700105+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:38:29.700105+0000","last_undegraded":"2024-09-14T11:38:29.700105+0000","last_fullsized":"2024-09-14T11:38:29.700105+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:38:29.700005+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:38:29.700005+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.700005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:00.423361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610401+0000","last_change":"2024-09-14T11:11:57.355400+0000","last_active":"2024-09-14T11:35:20.610401+0000","last_peered":"2024-09-14T11:35:20.610401+0000","last_clean":"2024-09-14T11:35:20.610401+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:35:20.610401+0000","last_undegraded":"2024-09-14T11:35:20.610401+0000","last_fullsized":"2024-09-14T11:35:20.610401+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:36:52.064528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.107301+0000","last_change":"2024-09-14T11:38:31.107301+0000","last_active":"2024-09-14T11:38:31.107301+0000","last_peered":"2024-09-14T11:38:31.107301+0000","last_clean":"2024-09-14T11:38:31.107301+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:38:31.107301+0000","last_undegraded":"2024-09-14T11:38:31.107301+0000","last_fullsized":"2024-09-14T11:38:31.107301+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-14T11:38:31.107207+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-14T11:38:31.107207+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.107207+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:38.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"263'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:23.756775+0000","last_change":"2024-09-14T11:22:38.560824+0000","last_active":"2024-09-14T11:34:23.756775+0000","last_peered":"2024-09-14T11:34:23.756775+0000","last_clean":"2024-09-14T11:34:23.756775+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:34:23.756775+0000","last_undegraded":"2024-09-14T11:34:23.756775+0000","last_fullsized":"2024-09-14T11:34:23.756775+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:21.610355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:20.610448+0000","last_change":"2024-09-14T11:12:00.371863+0000","last_active":"2024-09-14T11:35:20.610448+0000","last_peered":"2024-09-14T11:35:20.610448+0000","last_clean":"2024-09-14T11:35:20.610448+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:35:20.610448+0000","last_undegraded":"2024-09-14T11:35:20.610448+0000","last_fullsized":"2024-09-14T11:35:20.610448+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:23.086012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.052970+0000","last_change":"2024-09-14T11:38:26.052970+0000","last_active":"2024-09-14T11:38:26.052970+0000","last_peered":"2024-09-14T11:38:26.052970+0000","last_clean":"2024-09-14T11:38:26.052970+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:38:26.052970+0000","last_undegraded":"2024-09-14T11:38:26.052970+0000","last_fullsized":"2024-09-14T11:38:26.052970+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.052876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.052876+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.052876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:51.972093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.737204+0000","last_change":"2024-09-14T11:38:34.737204+0000","last_active":"2024-09-14T11:38:34.737204+0000","last_peered":"2024-09-14T11:38:34.737204+0000","last_clean":"2024-09-14T11:38:34.737204+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:38:34.737204+0000","last_undegraded":"2024-09-14T11:38:34.737204+0000","last_fullsized":"2024-09-14T11:38:34.737204+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-14T11:38:34.737118+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-14T11:38:34.737118+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.737118+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:26.158556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'1","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.605996+0000","last_change":"2024-09-14T11:22:38.549656+0000","last_active":"2024-09-14T11:34:45.605996+0000","last_peered":"2024-09-14T11:34:45.605996+0000","last_clean":"2024-09-14T11:34:45.605996+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:34:45.605996+0000","last_undegraded":"2024-09-14T11:34:45.605996+0000","last_fullsized":"2024-09-14T11:34:45.605996+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:20:23.182205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.006633+0000","last_change":"2024-09-14T11:38:27.006633+0000","last_active":"2024-09-14T11:38:27.006633+0000","last_peered":"2024-09-14T11:38:27.006633+0000","last_clean":"2024-09-14T11:38:27.006633+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:38:27.006633+0000","last_undegraded":"2024-09-14T11:38:27.006633+0000","last_fullsized":"2024-09-14T11:38:27.006633+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:27.006548+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:27.006548+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.006548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:31.802385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:37.901303+0000","last_change":"2024-09-14T11:11:57.355041+0000","last_active":"2024-09-14T11:37:37.901303+0000","last_peered":"2024-09-14T11:37:37.901303+0000","last_clean":"2024-09-14T11:37:37.901303+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:37:37.901303+0000","last_undegraded":"2024-09-14T11:37:37.901303+0000","last_fullsized":"2024-09-14T11:37:37.901303+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:41:42.390324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":128,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:55.614536+0000","last_change":"2024-09-14T11:10:13.507056+0000","last_active":"2024-09-14T11:35:55.614536+0000","last_peered":"2024-09-14T11:35:55.614536+0000","last_clean":"2024-09-14T11:35:55.614536+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:35:55.614536+0000","last_undegraded":"2024-09-14T11:35:55.614536+0000","last_fullsized":"2024-09-14T11:35:55.614536+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.183553+0000","last_change":"2024-09-14T11:38:22.183553+0000","last_active":"2024-09-14T11:38:22.183553+0000","last_peered":"2024-09-14T11:38:22.183553+0000","last_clean":"2024-09-14T11:38:22.183553+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:38:22.183553+0000","last_undegraded":"2024-09-14T11:38:22.183553+0000","last_fullsized":"2024-09-14T11:38:22.183553+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.183443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.183443+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.183443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:12.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603840+0000","last_change":"2024-09-14T11:12:00.369322+0000","last_active":"2024-09-14T11:34:30.603840+0000","last_peered":"2024-09-14T11:34:30.603840+0000","last_clean":"2024-09-14T11:34:30.603840+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:34:30.603840+0000","last_undegraded":"2024-09-14T11:34:30.603840+0000","last_fullsized":"2024-09-14T11:34:30.603840+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:30:38.196351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:29.891188+0000","last_change":"2024-09-14T11:11:57.357216+0000","last_active":"2024-09-14T11:34:29.891188+0000","last_peered":"2024-09-14T11:34:29.891188+0000","last_clean":"2024-09-14T11:34:29.891188+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:34:29.891188+0000","last_undegraded":"2024-09-14T11:34:29.891188+0000","last_fullsized":"2024-09-14T11:34:29.891188+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:03.031455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:05.608393+0000","last_change":"2024-09-14T11:10:13.512001+0000","last_active":"2024-09-14T11:35:05.608393+0000","last_peered":"2024-09-14T11:35:05.608393+0000","last_clean":"2024-09-14T11:35:05.608393+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:35:05.608393+0000","last_undegraded":"2024-09-14T11:35:05.608393+0000","last_fullsized":"2024-09-14T11:35:05.608393+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:22.364398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:09.906281+0000","last_change":"2024-09-14T11:22:38.560005+0000","last_active":"2024-09-14T11:36:09.906281+0000","last_peered":"2024-09-14T11:36:09.906281+0000","last_clean":"2024-09-14T11:36:09.906281+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:36:09.906281+0000","last_undegraded":"2024-09-14T11:36:09.906281+0000","last_fullsized":"2024-09-14T11:36:09.906281+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":34,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:30.603797+0000","last_change":"2024-09-14T11:12:00.370638+0000","last_active":"2024-09-14T11:34:30.603797+0000","last_peered":"2024-09-14T11:34:30.603797+0000","last_clean":"2024-09-14T11:34:30.603797+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:34:30.603797+0000","last_undegraded":"2024-09-14T11:34:30.603797+0000","last_fullsized":"2024-09-14T11:34:30.603797+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:40.237389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.234039+0000","last_change":"2024-09-14T11:38:18.234039+0000","last_active":"2024-09-14T11:38:18.234039+0000","last_peered":"2024-09-14T11:38:18.234039+0000","last_clean":"2024-09-14T11:38:18.234039+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:38:18.234039+0000","last_undegraded":"2024-09-14T11:38:18.234039+0000","last_fullsized":"2024-09-14T11:38:18.234039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:18.233937+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:18.233937+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.233937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:41.868662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.118317+0000","last_change":"2024-09-14T11:38:32.118317+0000","last_active":"2024-09-14T11:38:32.118317+0000","last_peered":"2024-09-14T11:38:32.118317+0000","last_clean":"2024-09-14T11:38:32.118317+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:38:32.118317+0000","last_undegraded":"2024-09-14T11:38:32.118317+0000","last_fullsized":"2024-09-14T11:38:32.118317+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-14T11:38:32.118235+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-14T11:38:32.118235+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.118235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:24.413407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.984804+0000","last_change":"2024-09-14T11:38:30.984804+0000","last_active":"2024-09-14T11:38:30.984804+0000","last_peered":"2024-09-14T11:38:30.984804+0000","last_clean":"2024-09-14T11:38:30.984804+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:38:30.984804+0000","last_undegraded":"2024-09-14T11:38:30.984804+0000","last_fullsized":"2024-09-14T11:38:30.984804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:30.984695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:30.984695+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.984695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:58.768775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.665049+0000","last_change":"2024-09-14T11:38:28.665049+0000","last_active":"2024-09-14T11:38:28.665049+0000","last_peered":"2024-09-14T11:38:28.665049+0000","last_clean":"2024-09-14T11:38:28.665049+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:38:28.665049+0000","last_undegraded":"2024-09-14T11:38:28.665049+0000","last_fullsized":"2024-09-14T11:38:28.665049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:28.664961+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:28.664961+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.664961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:38.095566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":40,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:28.757502+0000","last_change":"2024-09-14T11:11:57.350049+0000","last_active":"2024-09-14T11:34:28.757502+0000","last_peered":"2024-09-14T11:34:28.757502+0000","last_clean":"2024-09-14T11:34:28.757502+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:34:28.757502+0000","last_undegraded":"2024-09-14T11:34:28.757502+0000","last_fullsized":"2024-09-14T11:34:28.757502+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:29:36.573356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.069093+0000","last_change":"2024-09-14T11:38:22.069093+0000","last_active":"2024-09-14T11:38:22.069093+0000","last_peered":"2024-09-14T11:38:22.069093+0000","last_clean":"2024-09-14T11:38:22.069093+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:38:22.069093+0000","last_undegraded":"2024-09-14T11:38:22.069093+0000","last_fullsized":"2024-09-14T11:38:22.069093+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:22.069004+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:22.069004+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.069004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.390134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:39.901829+0000","last_change":"2024-09-14T11:22:38.552793+0000","last_active":"2024-09-14T11:35:39.901829+0000","last_peered":"2024-09-14T11:35:39.901829+0000","last_clean":"2024-09-14T11:35:39.901829+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:35:39.901829+0000","last_undegraded":"2024-09-14T11:35:39.901829+0000","last_fullsized":"2024-09-14T11:35:39.901829+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:40.112205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":37,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:45.621178+0000","last_change":"2024-09-14T11:12:00.371999+0000","last_active":"2024-09-14T11:36:45.621178+0000","last_peered":"2024-09-14T11:36:45.621178+0000","last_clean":"2024-09-14T11:36:45.621178+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:36:45.621178+0000","last_undegraded":"2024-09-14T11:36:45.621178+0000","last_fullsized":"2024-09-14T11:36:45.621178+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:13:57.798523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'7","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.597707+0000","last_change":"2024-09-14T11:38:25.597707+0000","last_active":"2024-09-14T11:38:25.597707+0000","last_peered":"2024-09-14T11:38:25.597707+0000","last_clean":"2024-09-14T11:38:25.597707+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:38:25.597707+0000","last_undegraded":"2024-09-14T11:38:25.597707+0000","last_fullsized":"2024-09-14T11:38:25.597707+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T11:38:25.597618+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T11:38:25.597618+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.597618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:56.197704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5818,"num_write":12,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":239,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.232644+0000","last_change":"2024-09-14T11:38:14.232644+0000","last_active":"2024-09-14T11:38:14.232644+0000","last_peered":"2024-09-14T11:38:14.232644+0000","last_clean":"2024-09-14T11:38:14.232644+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:38:14.232644+0000","last_undegraded":"2024-09-14T11:38:14.232644+0000","last_fullsized":"2024-09-14T11:38:14.232644+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.232551+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:32.602593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:10.617042+0000","last_change":"2024-09-14T11:22:38.560343+0000","last_active":"2024-09-14T11:36:10.617042+0000","last_peered":"2024-09-14T11:36:10.617042+0000","last_clean":"2024-09-14T11:36:10.617042+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:36:10.617042+0000","last_undegraded":"2024-09-14T11:36:10.617042+0000","last_fullsized":"2024-09-14T11:36:10.617042+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'6","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.867146+0000","last_change":"2024-09-14T11:12:00.369339+0000","last_active":"2024-09-14T11:37:46.867146+0000","last_peered":"2024-09-14T11:37:46.867146+0000","last_clean":"2024-09-14T11:37:46.867146+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:37:46.867146+0000","last_undegraded":"2024-09-14T11:37:46.867146+0000","last_fullsized":"2024-09-14T11:37:46.867146+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:48.767875+0000","last_change":"2024-09-14T11:11:57.357619+0000","last_active":"2024-09-14T11:35:48.767875+0000","last_peered":"2024-09-14T11:35:48.767875+0000","last_clean":"2024-09-14T11:35:48.767875+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:35:48.767875+0000","last_undegraded":"2024-09-14T11:35:48.767875+0000","last_fullsized":"2024-09-14T11:35:48.767875+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":137,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761794+0000","last_change":"2024-09-14T11:10:13.505959+0000","last_active":"2024-09-14T11:34:58.761794+0000","last_peered":"2024-09-14T11:34:58.761794+0000","last_clean":"2024-09-14T11:34:58.761794+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:34:58.761794+0000","last_undegraded":"2024-09-14T11:34:58.761794+0000","last_fullsized":"2024-09-14T11:34:58.761794+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:13.476423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:09.906372+0000","last_change":"2024-09-14T11:22:38.558664+0000","last_active":"2024-09-14T11:36:09.906372+0000","last_peered":"2024-09-14T11:36:09.906372+0000","last_clean":"2024-09-14T11:36:09.906372+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:36:09.906372+0000","last_undegraded":"2024-09-14T11:36:09.906372+0000","last_fullsized":"2024-09-14T11:36:09.906372+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.010903+0000","last_change":"2024-09-14T11:12:00.694483+0000","last_active":"2024-09-14T11:37:46.010903+0000","last_peered":"2024-09-14T11:37:46.010903+0000","last_clean":"2024-09-14T11:37:46.010903+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:37:46.010903+0000","last_undegraded":"2024-09-14T11:37:46.010903+0000","last_fullsized":"2024-09-14T11:37:46.010903+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.584028+0000","last_change":"2024-09-14T11:38:24.584028+0000","last_active":"2024-09-14T11:38:24.584028+0000","last_peered":"2024-09-14T11:38:24.584028+0000","last_clean":"2024-09-14T11:38:24.584028+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:38:24.584028+0000","last_undegraded":"2024-09-14T11:38:24.584028+0000","last_fullsized":"2024-09-14T11:38:24.584028+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.583945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.583945+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.583945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:05.737365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.851533+0000","last_change":"2024-09-14T11:38:31.851533+0000","last_active":"2024-09-14T11:38:31.851533+0000","last_peered":"2024-09-14T11:38:31.851533+0000","last_clean":"2024-09-14T11:38:31.851533+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:38:31.851533+0000","last_undegraded":"2024-09-14T11:38:31.851533+0000","last_fullsized":"2024-09-14T11:38:31.851533+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:38:31.851446+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:38:31.851446+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.851446+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:51.295376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'1","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:09.906312+0000","last_change":"2024-09-14T11:22:38.557834+0000","last_active":"2024-09-14T11:36:09.906312+0000","last_peered":"2024-09-14T11:36:09.906312+0000","last_clean":"2024-09-14T11:36:09.906312+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:36:09.906312+0000","last_undegraded":"2024-09-14T11:36:09.906312+0000","last_fullsized":"2024-09-14T11:36:09.906312+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.681807+0000","last_change":"2024-09-14T11:38:32.681807+0000","last_active":"2024-09-14T11:38:32.681807+0000","last_peered":"2024-09-14T11:38:32.681807+0000","last_clean":"2024-09-14T11:38:32.681807+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:38:32.681807+0000","last_undegraded":"2024-09-14T11:38:32.681807+0000","last_fullsized":"2024-09-14T11:38:32.681807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:32.681671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:32.681671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.681671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:26.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:53.768515+0000","last_change":"2024-09-14T11:11:57.350615+0000","last_active":"2024-09-14T11:35:53.768515+0000","last_peered":"2024-09-14T11:35:53.768515+0000","last_clean":"2024-09-14T11:35:53.768515+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:35:53.768515+0000","last_undegraded":"2024-09-14T11:35:53.768515+0000","last_fullsized":"2024-09-14T11:35:53.768515+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":795,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:15.617536+0000","last_change":"2024-09-14T11:10:13.505366+0000","last_active":"2024-09-14T11:36:15.617536+0000","last_peered":"2024-09-14T11:36:15.617536+0000","last_clean":"2024-09-14T11:36:15.617536+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:36:15.617536+0000","last_undegraded":"2024-09-14T11:36:15.617536+0000","last_fullsized":"2024-09-14T11:36:15.617536+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:08.770971+0000","last_change":"2024-09-14T11:22:38.560810+0000","last_active":"2024-09-14T11:36:08.770971+0000","last_peered":"2024-09-14T11:36:08.770971+0000","last_clean":"2024-09-14T11:36:08.770971+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:36:08.770971+0000","last_undegraded":"2024-09-14T11:36:08.770971+0000","last_fullsized":"2024-09-14T11:36:08.770971+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'8","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.051788+0000","last_change":"2024-09-14T11:12:00.372935+0000","last_active":"2024-09-14T11:37:46.051788+0000","last_peered":"2024-09-14T11:37:46.051788+0000","last_clean":"2024-09-14T11:37:46.051788+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:37:46.051788+0000","last_undegraded":"2024-09-14T11:37:46.051788+0000","last_fullsized":"2024-09-14T11:37:46.051788+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.719094+0000","last_change":"2024-09-14T11:38:32.719094+0000","last_active":"2024-09-14T11:38:32.719094+0000","last_peered":"2024-09-14T11:38:32.719094+0000","last_clean":"2024-09-14T11:38:32.719094+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:38:32.719094+0000","last_undegraded":"2024-09-14T11:38:32.719094+0000","last_fullsized":"2024-09-14T11:38:32.719094+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:32.718994+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:32.718994+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.718994+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:41.459421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.083052+0000","last_change":"2024-09-14T11:38:23.082992+0000","last_active":"2024-09-14T11:38:23.083052+0000","last_peered":"2024-09-14T11:38:23.083052+0000","last_clean":"2024-09-14T11:38:23.083052+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:38:23.083052+0000","last_undegraded":"2024-09-14T11:38:23.083052+0000","last_fullsized":"2024-09-14T11:38:23.083052+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-14T11:38:23.082907+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-14T11:38:23.082907+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.082907+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:32.531355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897410+0000","last_change":"2024-09-14T11:22:38.557689+0000","last_active":"2024-09-14T11:35:09.897410+0000","last_peered":"2024-09-14T11:35:09.897410+0000","last_clean":"2024-09-14T11:35:09.897410+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:35:09.897410+0000","last_undegraded":"2024-09-14T11:35:09.897410+0000","last_fullsized":"2024-09-14T11:35:09.897410+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:32.821928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:03.762555+0000","last_change":"2024-09-14T11:12:00.367857+0000","last_active":"2024-09-14T11:35:03.762555+0000","last_peered":"2024-09-14T11:35:03.762555+0000","last_clean":"2024-09-14T11:35:03.762555+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:35:03.762555+0000","last_undegraded":"2024-09-14T11:35:03.762555+0000","last_fullsized":"2024-09-14T11:35:03.762555+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:37:30.330125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895154+0000","last_change":"2024-09-14T11:11:57.350701+0000","last_active":"2024-09-14T11:34:54.895154+0000","last_peered":"2024-09-14T11:34:54.895154+0000","last_clean":"2024-09-14T11:34:54.895154+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:34:54.895154+0000","last_undegraded":"2024-09-14T11:34:54.895154+0000","last_fullsized":"2024-09-14T11:34:54.895154+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:12:03.947483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:13.771854+0000","last_change":"2024-09-14T11:10:13.507832+0000","last_active":"2024-09-14T11:36:13.771854+0000","last_peered":"2024-09-14T11:36:13.771854+0000","last_clean":"2024-09-14T11:36:13.771854+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:36:13.771854+0000","last_undegraded":"2024-09-14T11:36:13.771854+0000","last_fullsized":"2024-09-14T11:36:13.771854+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:10:12.478454+0000","last_clean_scrub_stamp":"2024-09-14T11:10:12.478454+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:07.879667+0000","last_change":"2024-09-14T11:22:38.559774+0000","last_active":"2024-09-14T11:35:07.879667+0000","last_peered":"2024-09-14T11:35:07.879667+0000","last_clean":"2024-09-14T11:35:07.879667+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:35:07.879667+0000","last_undegraded":"2024-09-14T11:35:07.879667+0000","last_fullsized":"2024-09-14T11:35:07.879667+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:53:14.753350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:58.761826+0000","last_change":"2024-09-14T11:12:00.695654+0000","last_active":"2024-09-14T11:34:58.761826+0000","last_peered":"2024-09-14T11:34:58.761826+0000","last_clean":"2024-09-14T11:34:58.761826+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:34:58.761826+0000","last_undegraded":"2024-09-14T11:34:58.761826+0000","last_fullsized":"2024-09-14T11:34:58.761826+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:10:44.109481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.256752+0000","last_change":"2024-09-14T11:38:17.256752+0000","last_active":"2024-09-14T11:38:17.256752+0000","last_peered":"2024-09-14T11:38:17.256752+0000","last_clean":"2024-09-14T11:38:17.256752+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:38:17.256752+0000","last_undegraded":"2024-09-14T11:38:17.256752+0000","last_fullsized":"2024-09-14T11:38:17.256752+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:17.256651+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:17.256651+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.256651+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:48.299275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.106318+0000","last_change":"2024-09-14T11:38:21.106250+0000","last_active":"2024-09-14T11:38:21.106318+0000","last_peered":"2024-09-14T11:38:21.106318+0000","last_clean":"2024-09-14T11:38:21.106318+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:38:21.106318+0000","last_undegraded":"2024-09-14T11:38:21.106318+0000","last_fullsized":"2024-09-14T11:38:21.106318+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:21.106166+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:21.106166+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.106166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.598437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.688664+0000","last_change":"2024-09-14T11:38:31.688664+0000","last_active":"2024-09-14T11:38:31.688664+0000","last_peered":"2024-09-14T11:38:31.688664+0000","last_clean":"2024-09-14T11:38:31.688664+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:38:31.688664+0000","last_undegraded":"2024-09-14T11:38:31.688664+0000","last_fullsized":"2024-09-14T11:38:31.688664+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.688568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.688568+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.688568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:55.762970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'8","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.450224+0000","last_change":"2024-09-14T11:12:00.697739+0000","last_active":"2024-09-14T11:37:46.450224+0000","last_peered":"2024-09-14T11:37:46.450224+0000","last_clean":"2024-09-14T11:37:46.450224+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:37:46.450224+0000","last_undegraded":"2024-09-14T11:37:46.450224+0000","last_fullsized":"2024-09-14T11:37:46.450224+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.377262+0000","last_change":"2024-09-14T11:11:57.356515+0000","last_active":"2024-09-14T11:37:46.377262+0000","last_peered":"2024-09-14T11:37:46.377262+0000","last_clean":"2024-09-14T11:37:46.377262+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:37:46.377262+0000","last_undegraded":"2024-09-14T11:37:46.377262+0000","last_fullsized":"2024-09-14T11:37:46.377262+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.876684+0000","last_change":"2024-09-14T11:38:30.876684+0000","last_active":"2024-09-14T11:38:30.876684+0000","last_peered":"2024-09-14T11:38:30.876684+0000","last_clean":"2024-09-14T11:38:30.876684+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:38:30.876684+0000","last_undegraded":"2024-09-14T11:38:30.876684+0000","last_fullsized":"2024-09-14T11:38:30.876684+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:30.876588+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:30.876588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.876588+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:46.926427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897368+0000","last_change":"2024-09-14T11:22:38.560831+0000","last_active":"2024-09-14T11:35:09.897368+0000","last_peered":"2024-09-14T11:35:09.897368+0000","last_clean":"2024-09-14T11:35:09.897368+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:35:09.897368+0000","last_undegraded":"2024-09-14T11:35:09.897368+0000","last_fullsized":"2024-09-14T11:35:09.897368+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:01:48.372514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:49.903536+0000","last_change":"2024-09-14T11:12:00.368324+0000","last_active":"2024-09-14T11:35:49.903536+0000","last_peered":"2024-09-14T11:35:49.903536+0000","last_clean":"2024-09-14T11:35:49.903536+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:35:49.903536+0000","last_undegraded":"2024-09-14T11:35:49.903536+0000","last_fullsized":"2024-09-14T11:35:49.903536+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:46.788495+0000","last_change":"2024-09-14T11:11:57.353076+0000","last_active":"2024-09-14T11:37:46.788495+0000","last_peered":"2024-09-14T11:37:46.788495+0000","last_clean":"2024-09-14T11:37:46.788495+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:37:46.788495+0000","last_undegraded":"2024-09-14T11:37:46.788495+0000","last_fullsized":"2024-09-14T11:37:46.788495+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.642390+0000","last_change":"2024-09-14T11:38:21.642390+0000","last_active":"2024-09-14T11:38:21.642390+0000","last_peered":"2024-09-14T11:38:21.642390+0000","last_clean":"2024-09-14T11:38:21.642390+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:38:21.642390+0000","last_undegraded":"2024-09-14T11:38:21.642390+0000","last_fullsized":"2024-09-14T11:38:21.642390+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-14T11:38:21.642290+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-14T11:38:21.642290+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.642290+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:06.797363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.160166+0000","last_change":"2024-09-14T11:38:21.160166+0000","last_active":"2024-09-14T11:38:21.160166+0000","last_peered":"2024-09-14T11:38:21.160166+0000","last_clean":"2024-09-14T11:38:21.160166+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:38:21.160166+0000","last_undegraded":"2024-09-14T11:38:21.160166+0000","last_fullsized":"2024-09-14T11:38:21.160166+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:21.160076+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:21.160076+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.160076+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:20.453418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.643397+0000","last_change":"2024-09-14T11:38:27.643397+0000","last_active":"2024-09-14T11:38:27.643397+0000","last_peered":"2024-09-14T11:38:27.643397+0000","last_clean":"2024-09-14T11:38:27.643397+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:38:27.643397+0000","last_undegraded":"2024-09-14T11:38:27.643397+0000","last_fullsized":"2024-09-14T11:38:27.643397+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:27.643298+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:27.643298+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.643298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:40.241405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15360,"num_write":13,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:59.904769+0000","last_change":"2024-09-14T11:11:57.345965+0000","last_active":"2024-09-14T11:35:59.904769+0000","last_peered":"2024-09-14T11:35:59.904769+0000","last_clean":"2024-09-14T11:35:59.904769+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:35:59.904769+0000","last_undegraded":"2024-09-14T11:35:59.904769+0000","last_fullsized":"2024-09-14T11:35:59.904769+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.167744+0000","last_change":"2024-09-14T11:38:31.167744+0000","last_active":"2024-09-14T11:38:31.167744+0000","last_peered":"2024-09-14T11:38:31.167744+0000","last_clean":"2024-09-14T11:38:31.167744+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:38:31.167744+0000","last_undegraded":"2024-09-14T11:38:31.167744+0000","last_fullsized":"2024-09-14T11:38:31.167744+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-14T11:38:31.167653+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-14T11:38:31.167653+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.167653+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:09.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:38.766824+0000","last_change":"2024-09-14T11:22:38.559863+0000","last_active":"2024-09-14T11:35:38.766824+0000","last_peered":"2024-09-14T11:35:38.766824+0000","last_clean":"2024-09-14T11:35:38.766824+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:35:38.766824+0000","last_undegraded":"2024-09-14T11:35:38.766824+0000","last_fullsized":"2024-09-14T11:35:38.766824+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:53:50.541537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":36,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:02.887319+0000","last_change":"2024-09-14T11:12:00.369782+0000","last_active":"2024-09-14T11:36:02.887319+0000","last_peered":"2024-09-14T11:36:02.887319+0000","last_clean":"2024-09-14T11:36:02.887319+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:36:02.887319+0000","last_undegraded":"2024-09-14T11:36:02.887319+0000","last_fullsized":"2024-09-14T11:36:02.887319+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:54.895078+0000","last_change":"2024-09-14T11:11:57.349673+0000","last_active":"2024-09-14T11:34:54.895078+0000","last_peered":"2024-09-14T11:34:54.895078+0000","last_clean":"2024-09-14T11:34:54.895078+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:34:54.895078+0000","last_undegraded":"2024-09-14T11:34:54.895078+0000","last_fullsized":"2024-09-14T11:34:54.895078+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:56.325556+0000","last_clean_scrub_stamp":"2024-09-14T11:11:56.325556+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:47:58.667434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.773313+0000","last_change":"2024-09-14T11:38:30.773313+0000","last_active":"2024-09-14T11:38:30.773313+0000","last_peered":"2024-09-14T11:38:30.773313+0000","last_clean":"2024-09-14T11:38:30.773313+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:38:30.773313+0000","last_undegraded":"2024-09-14T11:38:30.773313+0000","last_fullsized":"2024-09-14T11:38:30.773313+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-14T11:38:30.773214+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-14T11:38:30.773214+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.773214+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:47.034372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:08.763071+0000","last_change":"2024-09-14T11:22:38.558952+0000","last_active":"2024-09-14T11:35:08.763071+0000","last_peered":"2024-09-14T11:35:08.763071+0000","last_clean":"2024-09-14T11:35:08.763071+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:35:08.763071+0000","last_undegraded":"2024-09-14T11:35:08.763071+0000","last_fullsized":"2024-09-14T11:35:08.763071+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:33.315001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.960050+0000","last_change":"2024-09-14T11:38:27.960050+0000","last_active":"2024-09-14T11:38:27.960050+0000","last_peered":"2024-09-14T11:38:27.960050+0000","last_clean":"2024-09-14T11:38:27.960050+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:38:27.960050+0000","last_undegraded":"2024-09-14T11:38:27.960050+0000","last_fullsized":"2024-09-14T11:38:27.960050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:27.959939+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:27.959939+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.959939+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:05.403275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.597102+0000","last_change":"2024-09-14T11:38:22.597102+0000","last_active":"2024-09-14T11:38:22.597102+0000","last_peered":"2024-09-14T11:38:22.597102+0000","last_clean":"2024-09-14T11:38:22.597102+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:38:22.597102+0000","last_undegraded":"2024-09-14T11:38:22.597102+0000","last_fullsized":"2024-09-14T11:38:22.597102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.597007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.597007+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.597007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:05.834802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.087648+0000","last_change":"2024-09-14T11:38:20.087648+0000","last_active":"2024-09-14T11:38:20.087648+0000","last_peered":"2024-09-14T11:38:20.087648+0000","last_clean":"2024-09-14T11:38:20.087648+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:38:20.087648+0000","last_undegraded":"2024-09-14T11:38:20.087648+0000","last_fullsized":"2024-09-14T11:38:20.087648+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:38:20.087560+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:38:20.087560+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.087560+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:46.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:35:09.897492+0000","last_change":"2024-09-14T11:22:38.555840+0000","last_active":"2024-09-14T11:35:09.897492+0000","last_peered":"2024-09-14T11:35:09.897492+0000","last_clean":"2024-09-14T11:35:09.897492+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:35:09.897492+0000","last_undegraded":"2024-09-14T11:35:09.897492+0000","last_fullsized":"2024-09-14T11:35:09.897492+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:36:52.723291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":39,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:59.912600+0000","last_change":"2024-09-14T11:12:00.368478+0000","last_active":"2024-09-14T11:36:59.912600+0000","last_peered":"2024-09-14T11:36:59.912600+0000","last_clean":"2024-09-14T11:36:59.912600+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:36:59.912600+0000","last_undegraded":"2024-09-14T11:36:59.912600+0000","last_fullsized":"2024-09-14T11:36:59.912600+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:11:59.343699+0000","last_clean_scrub_stamp":"2024-09-14T11:11:59.343699+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:13:45.204253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.082979+0000","last_change":"2024-09-14T11:38:25.082979+0000","last_active":"2024-09-14T11:38:25.082979+0000","last_peered":"2024-09-14T11:38:25.082979+0000","last_clean":"2024-09-14T11:38:25.082979+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:38:25.082979+0000","last_undegraded":"2024-09-14T11:38:25.082979+0000","last_fullsized":"2024-09-14T11:38:25.082979+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:25.082876+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:25.082876+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.082876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.073078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.918172+0000","last_change":"2024-09-14T11:38:29.918172+0000","last_active":"2024-09-14T11:38:29.918172+0000","last_peered":"2024-09-14T11:38:29.918172+0000","last_clean":"2024-09-14T11:38:29.918172+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:38:29.918172+0000","last_undegraded":"2024-09-14T11:38:29.918172+0000","last_fullsized":"2024-09-14T11:38:29.918172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-14T11:38:29.918087+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-14T11:38:29.918087+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.918087+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:05.376556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'354","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.994434+0000","last_change":"2024-09-14T11:38:03.994434+0000","last_active":"2024-09-14T11:38:03.994434+0000","last_peered":"2024-09-14T11:38:03.994434+0000","last_clean":"2024-09-14T11:38:03.994434+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:38:03.994434+0000","last_undegraded":"2024-09-14T11:38:03.994434+0000","last_fullsized":"2024-09-14T11:38:03.994434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.994337+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:32.808942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":710,"num_read_kb":163807,"num_write":1157,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":685,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.995303+0000","last_change":"2024-09-14T11:38:12.995303+0000","last_active":"2024-09-14T11:38:12.995303+0000","last_peered":"2024-09-14T11:38:12.995303+0000","last_clean":"2024-09-14T11:38:12.995303+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:38:12.995303+0000","last_undegraded":"2024-09-14T11:38:12.995303+0000","last_fullsized":"2024-09-14T11:38:12.995303+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-14T11:38:12.995220+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-14T11:38:12.995220+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.995220+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:25.650124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'345","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.525749+0000","last_change":"2024-09-14T11:38:00.525749+0000","last_active":"2024-09-14T11:38:00.525749+0000","last_peered":"2024-09-14T11:38:00.525749+0000","last_clean":"2024-09-14T11:38:00.525749+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:38:00.525749+0000","last_undegraded":"2024-09-14T11:38:00.525749+0000","last_fullsized":"2024-09-14T11:38:00.525749+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.525650+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:10.105566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":38007,"num_write":1094,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":702,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.938486+0000","last_change":"2024-09-14T11:38:12.938486+0000","last_active":"2024-09-14T11:38:12.938486+0000","last_peered":"2024-09-14T11:38:12.938486+0000","last_clean":"2024-09-14T11:38:12.938486+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:38:12.938486+0000","last_undegraded":"2024-09-14T11:38:12.938486+0000","last_fullsized":"2024-09-14T11:38:12.938486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'80","last_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_deep_scrub":"264'80","last_deep_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.938395+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:21.819088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'358","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.091285+0000","last_change":"2024-09-14T11:38:03.091285+0000","last_active":"2024-09-14T11:38:03.091285+0000","last_peered":"2024-09-14T11:38:03.091285+0000","last_clean":"2024-09-14T11:38:03.091285+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:38:03.091285+0000","last_undegraded":"2024-09-14T11:38:03.091285+0000","last_fullsized":"2024-09-14T11:38:03.091285+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.091169+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:56.915196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":108632,"num_write":1075,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1214,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.781958+0000","last_change":"2024-09-14T11:38:14.781958+0000","last_active":"2024-09-14T11:38:14.781958+0000","last_peered":"2024-09-14T11:38:14.781958+0000","last_clean":"2024-09-14T11:38:14.781958+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:38:14.781958+0000","last_undegraded":"2024-09-14T11:38:14.781958+0000","last_fullsized":"2024-09-14T11:38:14.781958+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'576","last_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_deep_scrub":"264'576","last_deep_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.781853+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:29.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'362","reported_seq":1112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.332811+0000","last_change":"2024-09-14T11:37:58.332811+0000","last_active":"2024-09-14T11:37:58.332811+0000","last_peered":"2024-09-14T11:37:58.332811+0000","last_clean":"2024-09-14T11:37:58.332811+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:37:58.332811+0000","last_undegraded":"2024-09-14T11:37:58.332811+0000","last_fullsized":"2024-09-14T11:37:58.332811+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.332673+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.730339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":34002,"num_write":1219,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.136696+0000","last_change":"2024-09-14T11:38:09.136696+0000","last_active":"2024-09-14T11:38:09.136696+0000","last_peered":"2024-09-14T11:38:09.136696+0000","last_clean":"2024-09-14T11:38:09.136696+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:38:09.136696+0000","last_undegraded":"2024-09-14T11:38:09.136696+0000","last_fullsized":"2024-09-14T11:38:09.136696+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.136612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:07.052131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'371","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.973421+0000","last_change":"2024-09-14T11:38:07.973421+0000","last_active":"2024-09-14T11:38:07.973421+0000","last_peered":"2024-09-14T11:38:07.973421+0000","last_clean":"2024-09-14T11:38:07.973421+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:38:07.973421+0000","last_undegraded":"2024-09-14T11:38:07.973421+0000","last_fullsized":"2024-09-14T11:38:07.973421+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'371","last_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_deep_scrub":"264'371","last_deep_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.973335+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.083071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":613,"num_read_kb":21029,"num_write":1146,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.191435+0000","last_change":"2024-09-14T11:38:06.191360+0000","last_active":"2024-09-14T11:38:06.191435+0000","last_peered":"2024-09-14T11:38:06.191435+0000","last_clean":"2024-09-14T11:38:06.191435+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:38:06.191435+0000","last_undegraded":"2024-09-14T11:38:06.191435+0000","last_fullsized":"2024-09-14T11:38:06.191435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.191241+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'405","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.977410+0000","last_change":"2024-09-14T11:38:07.977410+0000","last_active":"2024-09-14T11:38:07.977410+0000","last_peered":"2024-09-14T11:38:07.977410+0000","last_clean":"2024-09-14T11:38:07.977410+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:38:07.977410+0000","last_undegraded":"2024-09-14T11:38:07.977410+0000","last_fullsized":"2024-09-14T11:38:07.977410+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.977308+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.168772+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":29480,"num_write":1192,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4188","reported_seq":4829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.832213+0000","last_change":"2024-09-14T11:38:13.832213+0000","last_active":"2024-09-14T11:38:13.832213+0000","last_peered":"2024-09-14T11:38:13.832213+0000","last_clean":"2024-09-14T11:38:13.832213+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:38:13.832213+0000","last_undegraded":"2024-09-14T11:38:13.832213+0000","last_fullsized":"2024-09-14T11:38:13.832213+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4188","last_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_deep_scrub":"264'4188","last_deep_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.832127+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:18.131503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2876,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'345","reported_seq":964,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.954476+0000","last_change":"2024-09-14T11:38:02.954476+0000","last_active":"2024-09-14T11:38:02.954476+0000","last_peered":"2024-09-14T11:38:02.954476+0000","last_clean":"2024-09-14T11:38:02.954476+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:38:02.954476+0000","last_undegraded":"2024-09-14T11:38:02.954476+0000","last_fullsized":"2024-09-14T11:38:02.954476+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.954347+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:07.261862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":8679,"num_write":1155,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.013337+0000","last_change":"2024-09-14T11:38:12.013337+0000","last_active":"2024-09-14T11:38:12.013337+0000","last_peered":"2024-09-14T11:38:12.013337+0000","last_clean":"2024-09-14T11:38:12.013337+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:38:12.013337+0000","last_undegraded":"2024-09-14T11:38:12.013337+0000","last_fullsized":"2024-09-14T11:38:12.013337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.013236+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.617466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'444","reported_seq":1183,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.704052+0000","last_change":"2024-09-14T11:38:02.704052+0000","last_active":"2024-09-14T11:38:02.704052+0000","last_peered":"2024-09-14T11:38:02.704052+0000","last_clean":"2024-09-14T11:38:02.704052+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:38:02.704052+0000","last_undegraded":"2024-09-14T11:38:02.704052+0000","last_fullsized":"2024-09-14T11:38:02.704052+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'444","last_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_deep_scrub":"264'444","last_deep_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.703931+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.189735+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1027,"num_read_kb":48878,"num_write":1330,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.285228+0000","last_change":"2024-09-14T11:38:05.285228+0000","last_active":"2024-09-14T11:38:05.285228+0000","last_peered":"2024-09-14T11:38:05.285228+0000","last_clean":"2024-09-14T11:38:05.285228+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:38:05.285228+0000","last_undegraded":"2024-09-14T11:38:05.285228+0000","last_fullsized":"2024-09-14T11:38:05.285228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.285135+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:29.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.838913+0000","last_change":"2024-09-14T11:38:10.838913+0000","last_active":"2024-09-14T11:38:10.838913+0000","last_peered":"2024-09-14T11:38:10.838913+0000","last_clean":"2024-09-14T11:38:10.838913+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:38:10.838913+0000","last_undegraded":"2024-09-14T11:38:10.838913+0000","last_fullsized":"2024-09-14T11:38:10.838913+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.838796+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:42.132159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'355","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.289296+0000","last_change":"2024-09-14T11:37:57.289296+0000","last_active":"2024-09-14T11:37:57.289296+0000","last_peered":"2024-09-14T11:37:57.289296+0000","last_clean":"2024-09-14T11:37:57.289296+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:37:57.289296+0000","last_undegraded":"2024-09-14T11:37:57.289296+0000","last_fullsized":"2024-09-14T11:37:57.289296+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.289198+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:54.356710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":655,"num_read_kb":81454,"num_write":1158,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.996771+0000","last_change":"2024-09-14T11:38:10.996771+0000","last_active":"2024-09-14T11:38:10.996771+0000","last_peered":"2024-09-14T11:38:10.996771+0000","last_clean":"2024-09-14T11:38:10.996771+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:38:10.996771+0000","last_undegraded":"2024-09-14T11:38:10.996771+0000","last_fullsized":"2024-09-14T11:38:10.996771+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.996672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:38.298661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'372","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.204888+0000","last_change":"2024-09-14T11:38:02.204888+0000","last_active":"2024-09-14T11:38:02.204888+0000","last_peered":"2024-09-14T11:38:02.204888+0000","last_clean":"2024-09-14T11:38:02.204888+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:38:02.204888+0000","last_undegraded":"2024-09-14T11:38:02.204888+0000","last_fullsized":"2024-09-14T11:38:02.204888+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.204768+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:29.702067+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1102,"num_read_kb":13751,"num_write":1178,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.996363+0000","last_change":"2024-09-14T11:38:09.996296+0000","last_active":"2024-09-14T11:38:09.996363+0000","last_peered":"2024-09-14T11:38:09.996363+0000","last_clean":"2024-09-14T11:38:09.996363+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:38:09.996363+0000","last_undegraded":"2024-09-14T11:38:09.996363+0000","last_fullsized":"2024-09-14T11:38:09.996363+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.996212+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.770213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'324","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.247962+0000","last_change":"2024-09-14T11:38:01.247962+0000","last_active":"2024-09-14T11:38:01.247962+0000","last_peered":"2024-09-14T11:38:01.247962+0000","last_clean":"2024-09-14T11:38:01.247962+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:38:01.247962+0000","last_undegraded":"2024-09-14T11:38:01.247962+0000","last_fullsized":"2024-09-14T11:38:01.247962+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.247834+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:08.750152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":2147,"num_write":1090,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.263789+0000","last_change":"2024-09-14T11:38:02.263789+0000","last_active":"2024-09-14T11:38:02.263789+0000","last_peered":"2024-09-14T11:38:02.263789+0000","last_clean":"2024-09-14T11:38:02.263789+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:38:02.263789+0000","last_undegraded":"2024-09-14T11:38:02.263789+0000","last_fullsized":"2024-09-14T11:38:02.263789+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.263694+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:48.528551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'372","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.783570+0000","last_change":"2024-09-14T11:37:57.783570+0000","last_active":"2024-09-14T11:37:57.783570+0000","last_peered":"2024-09-14T11:37:57.783570+0000","last_clean":"2024-09-14T11:37:57.783570+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:57.783570+0000","last_undegraded":"2024-09-14T11:37:57.783570+0000","last_fullsized":"2024-09-14T11:37:57.783570+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.783470+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:52.425734+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655890,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":45139,"num_write":1131,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.254892+0000","last_change":"2024-09-14T11:38:03.254892+0000","last_active":"2024-09-14T11:38:03.254892+0000","last_peered":"2024-09-14T11:38:03.254892+0000","last_clean":"2024-09-14T11:38:03.254892+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:38:03.254892+0000","last_undegraded":"2024-09-14T11:38:03.254892+0000","last_fullsized":"2024-09-14T11:38:03.254892+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.254797+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:24.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'359","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.750138+0000","last_change":"2024-09-14T11:38:03.750138+0000","last_active":"2024-09-14T11:38:03.750138+0000","last_peered":"2024-09-14T11:38:03.750138+0000","last_clean":"2024-09-14T11:38:03.750138+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:38:03.750138+0000","last_undegraded":"2024-09-14T11:38:03.750138+0000","last_fullsized":"2024-09-14T11:38:03.750138+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.750052+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:22.099690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":91641,"num_write":1162,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.839755+0000","last_change":"2024-09-14T11:38:12.839755+0000","last_active":"2024-09-14T11:38:12.839755+0000","last_peered":"2024-09-14T11:38:12.839755+0000","last_clean":"2024-09-14T11:38:12.839755+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:38:12.839755+0000","last_undegraded":"2024-09-14T11:38:12.839755+0000","last_fullsized":"2024-09-14T11:38:12.839755+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.839644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:27.847410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'339","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.127997+0000","last_change":"2024-09-14T11:38:00.127943+0000","last_active":"2024-09-14T11:38:00.127997+0000","last_peered":"2024-09-14T11:38:00.127997+0000","last_clean":"2024-09-14T11:38:00.127997+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:38:00.127997+0000","last_undegraded":"2024-09-14T11:38:00.127997+0000","last_fullsized":"2024-09-14T11:38:00.127997+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.127836+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:41.934910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":12785,"num_write":1085,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'138","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.786566+0000","last_change":"2024-09-14T11:38:29.786566+0000","last_active":"2024-09-14T11:38:29.786566+0000","last_peered":"2024-09-14T11:38:29.786566+0000","last_clean":"2024-09-14T11:38:29.786566+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:38:29.786566+0000","last_undegraded":"2024-09-14T11:38:29.786566+0000","last_fullsized":"2024-09-14T11:38:29.786566+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:29.786476+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:29.786476+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.786476+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:15.053081+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.802655+0000","last_change":"2024-09-14T11:38:07.802553+0000","last_active":"2024-09-14T11:38:07.802655+0000","last_peered":"2024-09-14T11:38:07.802655+0000","last_clean":"2024-09-14T11:38:07.802655+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:38:07.802655+0000","last_undegraded":"2024-09-14T11:38:07.802655+0000","last_fullsized":"2024-09-14T11:38:07.802655+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.802440+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:22.163602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'369","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.971493+0000","last_change":"2024-09-14T11:38:01.971426+0000","last_active":"2024-09-14T11:38:01.971493+0000","last_peered":"2024-09-14T11:38:01.971493+0000","last_clean":"2024-09-14T11:38:01.971493+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:38:01.971493+0000","last_undegraded":"2024-09-14T11:38:01.971493+0000","last_fullsized":"2024-09-14T11:38:01.971493+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.971327+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:34.955599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":841,"num_read_kb":1723,"num_write":1205,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.915505+0000","last_change":"2024-09-14T11:38:14.915505+0000","last_active":"2024-09-14T11:38:14.915505+0000","last_peered":"2024-09-14T11:38:14.915505+0000","last_clean":"2024-09-14T11:38:14.915505+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:38:14.915505+0000","last_undegraded":"2024-09-14T11:38:14.915505+0000","last_fullsized":"2024-09-14T11:38:14.915505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.915421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.915421+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.915421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:26.590941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'369","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.048922+0000","last_change":"2024-09-14T11:38:17.048922+0000","last_active":"2024-09-14T11:38:17.048922+0000","last_peered":"2024-09-14T11:38:17.048922+0000","last_clean":"2024-09-14T11:38:17.048922+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:38:17.048922+0000","last_undegraded":"2024-09-14T11:38:17.048922+0000","last_fullsized":"2024-09-14T11:38:17.048922+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:17.048831+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:17.048831+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.048831+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:36.197526+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48907,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":593,"num_read_kb":1292,"num_write":484,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.865065+0000","last_change":"2024-09-14T11:38:25.865065+0000","last_active":"2024-09-14T11:38:25.865065+0000","last_peered":"2024-09-14T11:38:25.865065+0000","last_clean":"2024-09-14T11:38:25.865065+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:38:25.865065+0000","last_undegraded":"2024-09-14T11:38:25.865065+0000","last_fullsized":"2024-09-14T11:38:25.865065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.864975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.864975+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.864975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:21.699201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2491","reported_seq":4312,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.073340+0000","last_change":"2024-09-14T11:38:29.073340+0000","last_active":"2024-09-14T11:38:29.073340+0000","last_peered":"2024-09-14T11:38:29.073340+0000","last_clean":"2024-09-14T11:38:29.073340+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:38:29.073340+0000","last_undegraded":"2024-09-14T11:38:29.073340+0000","last_fullsized":"2024-09-14T11:38:29.073340+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2491","last_scrub_stamp":"2024-09-14T11:38:29.073250+0000","last_deep_scrub":"264'2491","last_deep_scrub_stamp":"2024-09-14T11:38:29.073250+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.073250+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":2400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:11.514402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.933553+0000","last_change":"2024-09-14T11:38:05.933553+0000","last_active":"2024-09-14T11:38:05.933553+0000","last_peered":"2024-09-14T11:38:05.933553+0000","last_clean":"2024-09-14T11:38:05.933553+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:38:05.933553+0000","last_undegraded":"2024-09-14T11:38:05.933553+0000","last_fullsized":"2024-09-14T11:38:05.933553+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'270","last_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_deep_scrub":"264'270","last_deep_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.933442+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:27.514791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'317","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.214481+0000","last_change":"2024-09-14T11:37:54.214379+0000","last_active":"2024-09-14T11:37:54.214481+0000","last_peered":"2024-09-14T11:37:54.214481+0000","last_clean":"2024-09-14T11:37:54.214481+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:37:54.214481+0000","last_undegraded":"2024-09-14T11:37:54.214481+0000","last_fullsized":"2024-09-14T11:37:54.214481+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.214277+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:04.066988+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":41365,"num_write":992,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.763743+0000","last_change":"2024-09-14T11:38:14.763679+0000","last_active":"2024-09-14T11:38:14.763743+0000","last_peered":"2024-09-14T11:38:14.763743+0000","last_clean":"2024-09-14T11:38:14.763743+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:38:14.763743+0000","last_undegraded":"2024-09-14T11:38:14.763743+0000","last_fullsized":"2024-09-14T11:38:14.763743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.763569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:12.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'92","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.791514+0000","last_change":"2024-09-14T11:38:22.791514+0000","last_active":"2024-09-14T11:38:22.791514+0000","last_peered":"2024-09-14T11:38:22.791514+0000","last_clean":"2024-09-14T11:38:22.791514+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:38:22.791514+0000","last_undegraded":"2024-09-14T11:38:22.791514+0000","last_fullsized":"2024-09-14T11:38:22.791514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:22.791422+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:22.791422+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.791422+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.156792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.769667+0000","last_change":"2024-09-14T11:38:24.769667+0000","last_active":"2024-09-14T11:38:24.769667+0000","last_peered":"2024-09-14T11:38:24.769667+0000","last_clean":"2024-09-14T11:38:24.769667+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:38:24.769667+0000","last_undegraded":"2024-09-14T11:38:24.769667+0000","last_fullsized":"2024-09-14T11:38:24.769667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.769582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.769582+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.769582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:27.142757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'130","reported_seq":628,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.058959+0000","last_change":"2024-09-14T11:38:29.058959+0000","last_active":"2024-09-14T11:38:29.058959+0000","last_peered":"2024-09-14T11:38:29.058959+0000","last_clean":"2024-09-14T11:38:29.058959+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:38:29.058959+0000","last_undegraded":"2024-09-14T11:38:29.058959+0000","last_fullsized":"2024-09-14T11:38:29.058959+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-14T11:38:29.058858+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-14T11:38:29.058858+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.058858+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:10.343975+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.169189+0000","last_change":"2024-09-14T11:38:06.169189+0000","last_active":"2024-09-14T11:38:06.169189+0000","last_peered":"2024-09-14T11:38:06.169189+0000","last_clean":"2024-09-14T11:38:06.169189+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:38:06.169189+0000","last_undegraded":"2024-09-14T11:38:06.169189+0000","last_fullsized":"2024-09-14T11:38:06.169189+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.169106+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:13.055830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'356","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.996393+0000","last_change":"2024-09-14T11:37:58.996323+0000","last_active":"2024-09-14T11:37:58.996393+0000","last_peered":"2024-09-14T11:37:58.996393+0000","last_clean":"2024-09-14T11:37:58.996393+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:37:58.996393+0000","last_undegraded":"2024-09-14T11:37:58.996393+0000","last_fullsized":"2024-09-14T11:37:58.996393+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.996219+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:49.905581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":14993,"num_write":1137,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.757556+0000","last_change":"2024-09-14T11:38:20.757556+0000","last_active":"2024-09-14T11:38:20.757556+0000","last_peered":"2024-09-14T11:38:20.757556+0000","last_clean":"2024-09-14T11:38:20.757556+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:38:20.757556+0000","last_undegraded":"2024-09-14T11:38:20.757556+0000","last_fullsized":"2024-09-14T11:38:20.757556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:20.757467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:20.757467+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.757467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:01.473105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'119","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.313893+0000","last_change":"2024-09-14T11:38:10.313797+0000","last_active":"2024-09-14T11:38:10.313893+0000","last_peered":"2024-09-14T11:38:10.313893+0000","last_clean":"2024-09-14T11:38:10.313893+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:38:10.313893+0000","last_undegraded":"2024-09-14T11:38:10.313893+0000","last_fullsized":"2024-09-14T11:38:10.313893+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.313671+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:12.772415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'761","reported_seq":2186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.840184+0000","last_change":"2024-09-14T11:38:24.840184+0000","last_active":"2024-09-14T11:38:24.840184+0000","last_peered":"2024-09-14T11:38:24.840184+0000","last_clean":"2024-09-14T11:38:24.840184+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:38:24.840184+0000","last_undegraded":"2024-09-14T11:38:24.840184+0000","last_fullsized":"2024-09-14T11:38:24.840184+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-14T11:38:24.840088+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-14T11:38:24.840088+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.840088+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:31.800651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'243","reported_seq":1119,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.749031+0000","last_change":"2024-09-14T11:38:31.749031+0000","last_active":"2024-09-14T11:38:31.749031+0000","last_peered":"2024-09-14T11:38:31.749031+0000","last_clean":"2024-09-14T11:38:31.749031+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:38:31.749031+0000","last_undegraded":"2024-09-14T11:38:31.749031+0000","last_fullsized":"2024-09-14T11:38:31.749031+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'243","last_scrub_stamp":"2024-09-14T11:38:31.748925+0000","last_deep_scrub":"264'243","last_deep_scrub_stamp":"2024-09-14T11:38:31.748925+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.748925+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:11.249605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4157","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.796045+0000","last_change":"2024-09-14T11:38:08.796045+0000","last_active":"2024-09-14T11:38:08.796045+0000","last_peered":"2024-09-14T11:38:08.796045+0000","last_clean":"2024-09-14T11:38:08.796045+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:38:08.796045+0000","last_undegraded":"2024-09-14T11:38:08.796045+0000","last_fullsized":"2024-09-14T11:38:08.796045+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4157","last_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_deep_scrub":"264'4157","last_deep_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.795955+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":3000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:56.535050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'336","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.207574+0000","last_change":"2024-09-14T11:37:57.207516+0000","last_active":"2024-09-14T11:37:57.207574+0000","last_peered":"2024-09-14T11:37:57.207574+0000","last_clean":"2024-09-14T11:37:57.207574+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:37:57.207574+0000","last_undegraded":"2024-09-14T11:37:57.207574+0000","last_fullsized":"2024-09-14T11:37:57.207574+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.207427+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:13.344531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":30569,"num_write":1024,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.946969+0000","last_change":"2024-09-14T11:38:15.946969+0000","last_active":"2024-09-14T11:38:15.946969+0000","last_peered":"2024-09-14T11:38:15.946969+0000","last_clean":"2024-09-14T11:38:15.946969+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:38:15.946969+0000","last_undegraded":"2024-09-14T11:38:15.946969+0000","last_fullsized":"2024-09-14T11:38:15.946969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.946873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.946873+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.946873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:58.418213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'294","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.859838+0000","last_change":"2024-09-14T11:38:20.859838+0000","last_active":"2024-09-14T11:38:20.859838+0000","last_peered":"2024-09-14T11:38:20.859838+0000","last_clean":"2024-09-14T11:38:20.859838+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:38:20.859838+0000","last_undegraded":"2024-09-14T11:38:20.859838+0000","last_fullsized":"2024-09-14T11:38:20.859838+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'294","last_scrub_stamp":"2024-09-14T11:38:20.859741+0000","last_deep_scrub":"264'294","last_deep_scrub_stamp":"2024-09-14T11:38:20.859741+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.859741+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:51.310826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":1245,"num_write":424,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'795","reported_seq":2264,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.758262+0000","last_change":"2024-09-14T11:38:29.758262+0000","last_active":"2024-09-14T11:38:29.758262+0000","last_peered":"2024-09-14T11:38:29.758262+0000","last_clean":"2024-09-14T11:38:29.758262+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:38:29.758262+0000","last_undegraded":"2024-09-14T11:38:29.758262+0000","last_fullsized":"2024-09-14T11:38:29.758262+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:29.758152+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:29.758152+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.758152+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:58.242377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.901270+0000","last_change":"2024-09-14T11:38:04.901270+0000","last_active":"2024-09-14T11:38:04.901270+0000","last_peered":"2024-09-14T11:38:04.901270+0000","last_clean":"2024-09-14T11:38:04.901270+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:38:04.901270+0000","last_undegraded":"2024-09-14T11:38:04.901270+0000","last_fullsized":"2024-09-14T11:38:04.901270+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.901185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:34.668649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'335","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.980161+0000","last_change":"2024-09-14T11:37:59.980161+0000","last_active":"2024-09-14T11:37:59.980161+0000","last_peered":"2024-09-14T11:37:59.980161+0000","last_clean":"2024-09-14T11:37:59.980161+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:59.980161+0000","last_undegraded":"2024-09-14T11:37:59.980161+0000","last_fullsized":"2024-09-14T11:37:59.980161+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.980047+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:02.870696+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":515,"num_read_kb":9228,"num_write":1120,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.951810+0000","last_change":"2024-09-14T11:38:11.951810+0000","last_active":"2024-09-14T11:38:11.951810+0000","last_peered":"2024-09-14T11:38:11.951810+0000","last_clean":"2024-09-14T11:38:11.951810+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:38:11.951810+0000","last_undegraded":"2024-09-14T11:38:11.951810+0000","last_fullsized":"2024-09-14T11:38:11.951810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.951722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:21.559571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'369","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.854194+0000","last_change":"2024-09-14T11:38:19.854194+0000","last_active":"2024-09-14T11:38:19.854194+0000","last_peered":"2024-09-14T11:38:19.854194+0000","last_clean":"2024-09-14T11:38:19.854194+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:38:19.854194+0000","last_undegraded":"2024-09-14T11:38:19.854194+0000","last_fullsized":"2024-09-14T11:38:19.854194+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:19.854090+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:19.854090+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.854090+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:09.592302+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":1214,"num_write":460,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.514970+0000","last_change":"2024-09-14T11:38:14.514970+0000","last_active":"2024-09-14T11:38:14.514970+0000","last_peered":"2024-09-14T11:38:14.514970+0000","last_clean":"2024-09-14T11:38:14.514970+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:38:14.514970+0000","last_undegraded":"2024-09-14T11:38:14.514970+0000","last_fullsized":"2024-09-14T11:38:14.514970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.514871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.514871+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.514871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.063754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'550","reported_seq":1371,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.993670+0000","last_change":"2024-09-14T11:38:25.993670+0000","last_active":"2024-09-14T11:38:25.993670+0000","last_peered":"2024-09-14T11:38:25.993670+0000","last_clean":"2024-09-14T11:38:25.993670+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:38:25.993670+0000","last_undegraded":"2024-09-14T11:38:25.993670+0000","last_fullsized":"2024-09-14T11:38:25.993670+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'550","last_scrub_stamp":"2024-09-14T11:38:25.993577+0000","last_deep_scrub":"264'550","last_deep_scrub_stamp":"2024-09-14T11:38:25.993577+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.993577+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:27.501103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.778887+0000","last_change":"2024-09-14T11:38:00.778887+0000","last_active":"2024-09-14T11:38:00.778887+0000","last_peered":"2024-09-14T11:38:00.778887+0000","last_clean":"2024-09-14T11:38:00.778887+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:38:00.778887+0000","last_undegraded":"2024-09-14T11:38:00.778887+0000","last_fullsized":"2024-09-14T11:38:00.778887+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.778798+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:57.572541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'264","reported_seq":907,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.924217+0000","last_change":"2024-09-14T11:37:56.924217+0000","last_active":"2024-09-14T11:37:56.924217+0000","last_peered":"2024-09-14T11:37:56.924217+0000","last_clean":"2024-09-14T11:37:56.924217+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:37:56.924217+0000","last_undegraded":"2024-09-14T11:37:56.924217+0000","last_fullsized":"2024-09-14T11:37:56.924217+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.924115+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:59.368338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":56700,"num_write":826,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.288085+0000","last_change":"2024-09-14T11:38:11.288085+0000","last_active":"2024-09-14T11:38:11.288085+0000","last_peered":"2024-09-14T11:38:11.288085+0000","last_clean":"2024-09-14T11:38:11.288085+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:38:11.288085+0000","last_undegraded":"2024-09-14T11:38:11.288085+0000","last_fullsized":"2024-09-14T11:38:11.288085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.287976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:47.086536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'273","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.735223+0000","last_change":"2024-09-14T11:38:18.735223+0000","last_active":"2024-09-14T11:38:18.735223+0000","last_peered":"2024-09-14T11:38:18.735223+0000","last_clean":"2024-09-14T11:38:18.735223+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:38:18.735223+0000","last_undegraded":"2024-09-14T11:38:18.735223+0000","last_fullsized":"2024-09-14T11:38:18.735223+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-14T11:38:18.735129+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-14T11:38:18.735129+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.735129+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:46.477399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71588,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1104,"num_write":366,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.770446+0000","last_change":"2024-09-14T11:38:27.770446+0000","last_active":"2024-09-14T11:38:27.770446+0000","last_peered":"2024-09-14T11:38:27.770446+0000","last_clean":"2024-09-14T11:38:27.770446+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:38:27.770446+0000","last_undegraded":"2024-09-14T11:38:27.770446+0000","last_fullsized":"2024-09-14T11:38:27.770446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:27.770352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:27.770352+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.770352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:00.433642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'115","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.100737+0000","last_change":"2024-09-14T11:38:17.100737+0000","last_active":"2024-09-14T11:38:17.100737+0000","last_peered":"2024-09-14T11:38:17.100737+0000","last_clean":"2024-09-14T11:38:17.100737+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:38:17.100737+0000","last_undegraded":"2024-09-14T11:38:17.100737+0000","last_fullsized":"2024-09-14T11:38:17.100737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-14T11:38:17.100644+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-14T11:38:17.100644+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.100644+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:44.325848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.211512+0000","last_change":"2024-09-14T11:38:04.211512+0000","last_active":"2024-09-14T11:38:04.211512+0000","last_peered":"2024-09-14T11:38:04.211512+0000","last_clean":"2024-09-14T11:38:04.211512+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:38:04.211512+0000","last_undegraded":"2024-09-14T11:38:04.211512+0000","last_fullsized":"2024-09-14T11:38:04.211512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.211394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:16.244988+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'451","reported_seq":1163,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.971521+0000","last_change":"2024-09-14T11:38:04.971521+0000","last_active":"2024-09-14T11:38:04.971521+0000","last_peered":"2024-09-14T11:38:04.971521+0000","last_clean":"2024-09-14T11:38:04.971521+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:38:04.971521+0000","last_undegraded":"2024-09-14T11:38:04.971521+0000","last_fullsized":"2024-09-14T11:38:04.971521+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'451","last_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_deep_scrub":"264'451","last_deep_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.971423+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:55.099273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":972,"num_read_kb":28710,"num_write":1673,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.263318+0000","last_change":"2024-09-14T11:38:06.263318+0000","last_active":"2024-09-14T11:38:06.263318+0000","last_peered":"2024-09-14T11:38:06.263318+0000","last_clean":"2024-09-14T11:38:06.263318+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:38:06.263318+0000","last_undegraded":"2024-09-14T11:38:06.263318+0000","last_fullsized":"2024-09-14T11:38:06.263318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.263219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:07.707286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'316","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.890125+0000","last_change":"2024-09-14T11:38:19.890125+0000","last_active":"2024-09-14T11:38:19.890125+0000","last_peered":"2024-09-14T11:38:19.890125+0000","last_clean":"2024-09-14T11:38:19.890125+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:38:19.890125+0000","last_undegraded":"2024-09-14T11:38:19.890125+0000","last_fullsized":"2024-09-14T11:38:19.890125+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:38:19.890027+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:38:19.890027+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.890027+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.306299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50445,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":514,"num_read_kb":1159,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'779","reported_seq":4232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.082544+0000","last_change":"2024-09-14T11:38:21.082544+0000","last_active":"2024-09-14T11:38:21.082544+0000","last_peered":"2024-09-14T11:38:21.082544+0000","last_clean":"2024-09-14T11:38:21.082544+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:38:21.082544+0000","last_undegraded":"2024-09-14T11:38:21.082544+0000","last_fullsized":"2024-09-14T11:38:21.082544+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'779","last_scrub_stamp":"2024-09-14T11:38:21.082455+0000","last_deep_scrub":"264'779","last_deep_scrub_stamp":"2024-09-14T11:38:21.082455+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.082455+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":701,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:06.177538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'102","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.092340+0000","last_change":"2024-09-14T11:38:26.092340+0000","last_active":"2024-09-14T11:38:26.092340+0000","last_peered":"2024-09-14T11:38:26.092340+0000","last_clean":"2024-09-14T11:38:26.092340+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:38:26.092340+0000","last_undegraded":"2024-09-14T11:38:26.092340+0000","last_fullsized":"2024-09-14T11:38:26.092340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-14T11:38:26.092240+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-14T11:38:26.092240+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.092240+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:03.281542+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":801,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.128232+0000","last_change":"2024-09-14T11:38:04.128232+0000","last_active":"2024-09-14T11:38:04.128232+0000","last_peered":"2024-09-14T11:38:04.128232+0000","last_clean":"2024-09-14T11:38:04.128232+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:38:04.128232+0000","last_undegraded":"2024-09-14T11:38:04.128232+0000","last_fullsized":"2024-09-14T11:38:04.128232+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.128119+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:06.336903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'318","reported_seq":949,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.011358+0000","last_change":"2024-09-14T11:37:58.011358+0000","last_active":"2024-09-14T11:37:58.011358+0000","last_peered":"2024-09-14T11:37:58.011358+0000","last_clean":"2024-09-14T11:37:58.011358+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:37:58.011358+0000","last_undegraded":"2024-09-14T11:37:58.011358+0000","last_fullsized":"2024-09-14T11:37:58.011358+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.011270+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.504722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":39728,"num_write":960,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.272195+0000","last_change":"2024-09-14T11:38:07.272195+0000","last_active":"2024-09-14T11:38:07.272195+0000","last_peered":"2024-09-14T11:38:07.272195+0000","last_clean":"2024-09-14T11:38:07.272195+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:38:07.272195+0000","last_undegraded":"2024-09-14T11:38:07.272195+0000","last_fullsized":"2024-09-14T11:38:07.272195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.272107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:15.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'467","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.068187+0000","last_change":"2024-09-14T11:38:14.068187+0000","last_active":"2024-09-14T11:38:14.068187+0000","last_peered":"2024-09-14T11:38:14.068187+0000","last_clean":"2024-09-14T11:38:14.068187+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:38:14.068187+0000","last_undegraded":"2024-09-14T11:38:14.068187+0000","last_fullsized":"2024-09-14T11:38:14.068187+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'467","last_scrub_stamp":"2024-09-14T11:38:14.068086+0000","last_deep_scrub":"264'467","last_deep_scrub_stamp":"2024-09-14T11:38:14.068086+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.068086+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:09.633040+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91900,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":1934,"num_write":662,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.264563+0000","last_change":"2024-09-14T11:38:12.264563+0000","last_active":"2024-09-14T11:38:12.264563+0000","last_peered":"2024-09-14T11:38:12.264563+0000","last_clean":"2024-09-14T11:38:12.264563+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:38:12.264563+0000","last_undegraded":"2024-09-14T11:38:12.264563+0000","last_fullsized":"2024-09-14T11:38:12.264563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.264469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:48.042054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'107","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.622819+0000","last_change":"2024-09-14T11:38:19.622819+0000","last_active":"2024-09-14T11:38:19.622819+0000","last_peered":"2024-09-14T11:38:19.622819+0000","last_clean":"2024-09-14T11:38:19.622819+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:38:19.622819+0000","last_undegraded":"2024-09-14T11:38:19.622819+0000","last_fullsized":"2024-09-14T11:38:19.622819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-14T11:38:19.622715+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-14T11:38:19.622715+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.622715+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.552241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'257","reported_seq":900,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.818689+0000","last_change":"2024-09-14T11:38:01.818689+0000","last_active":"2024-09-14T11:38:01.818689+0000","last_peered":"2024-09-14T11:38:01.818689+0000","last_clean":"2024-09-14T11:38:01.818689+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:38:01.818689+0000","last_undegraded":"2024-09-14T11:38:01.818689+0000","last_fullsized":"2024-09-14T11:38:01.818689+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.818609+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.995103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'339","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.801227+0000","last_change":"2024-09-14T11:37:56.801227+0000","last_active":"2024-09-14T11:37:56.801227+0000","last_peered":"2024-09-14T11:37:56.801227+0000","last_clean":"2024-09-14T11:37:56.801227+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:37:56.801227+0000","last_undegraded":"2024-09-14T11:37:56.801227+0000","last_fullsized":"2024-09-14T11:37:56.801227+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.801100+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:49.585646+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":517,"num_read_kb":5559,"num_write":1004,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.269139+0000","last_change":"2024-09-14T11:38:09.269139+0000","last_active":"2024-09-14T11:38:09.269139+0000","last_peered":"2024-09-14T11:38:09.269139+0000","last_clean":"2024-09-14T11:38:09.269139+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:38:09.269139+0000","last_undegraded":"2024-09-14T11:38:09.269139+0000","last_fullsized":"2024-09-14T11:38:09.269139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:19.458046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'284","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.735737+0000","last_change":"2024-09-14T11:38:19.735737+0000","last_active":"2024-09-14T11:38:19.735737+0000","last_peered":"2024-09-14T11:38:19.735737+0000","last_clean":"2024-09-14T11:38:19.735737+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:38:19.735737+0000","last_undegraded":"2024-09-14T11:38:19.735737+0000","last_fullsized":"2024-09-14T11:38:19.735737+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:38:19.735634+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:38:19.735634+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.735634+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:56.780179+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43790,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1041,"num_write":430,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.117306+0000","last_change":"2024-09-14T11:38:22.117306+0000","last_active":"2024-09-14T11:38:22.117306+0000","last_peered":"2024-09-14T11:38:22.117306+0000","last_clean":"2024-09-14T11:38:22.117306+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:38:22.117306+0000","last_undegraded":"2024-09-14T11:38:22.117306+0000","last_fullsized":"2024-09-14T11:38:22.117306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.117215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.117215+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.117215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:53.881289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'109","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.752084+0000","last_change":"2024-09-14T11:38:31.752084+0000","last_active":"2024-09-14T11:38:31.752084+0000","last_peered":"2024-09-14T11:38:31.752084+0000","last_clean":"2024-09-14T11:38:31.752084+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:38:31.752084+0000","last_undegraded":"2024-09-14T11:38:31.752084+0000","last_fullsized":"2024-09-14T11:38:31.752084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-14T11:38:31.751994+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-14T11:38:31.751994+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.751994+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:48.273036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'105","reported_seq":721,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.801454+0000","last_change":"2024-09-14T11:38:02.801454+0000","last_active":"2024-09-14T11:38:02.801454+0000","last_peered":"2024-09-14T11:38:02.801454+0000","last_clean":"2024-09-14T11:38:02.801454+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:38:02.801454+0000","last_undegraded":"2024-09-14T11:38:02.801454+0000","last_fullsized":"2024-09-14T11:38:02.801454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.801328+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:52.213904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'384","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.201690+0000","last_change":"2024-09-14T11:37:56.201690+0000","last_active":"2024-09-14T11:37:56.201690+0000","last_peered":"2024-09-14T11:37:56.201690+0000","last_clean":"2024-09-14T11:37:56.201690+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:37:56.201690+0000","last_undegraded":"2024-09-14T11:37:56.201690+0000","last_fullsized":"2024-09-14T11:37:56.201690+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.201429+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:20.816954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":626,"num_read_kb":12205,"num_write":1169,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.514696+0000","last_change":"2024-09-14T11:38:06.514696+0000","last_active":"2024-09-14T11:38:06.514696+0000","last_peered":"2024-09-14T11:38:06.514696+0000","last_clean":"2024-09-14T11:38:06.514696+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:38:06.514696+0000","last_undegraded":"2024-09-14T11:38:06.514696+0000","last_fullsized":"2024-09-14T11:38:06.514696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.514607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.514163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'297","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.303289+0000","last_change":"2024-09-14T11:38:08.303289+0000","last_active":"2024-09-14T11:38:08.303289+0000","last_peered":"2024-09-14T11:38:08.303289+0000","last_clean":"2024-09-14T11:38:08.303289+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:38:08.303289+0000","last_undegraded":"2024-09-14T11:38:08.303289+0000","last_fullsized":"2024-09-14T11:38:08.303289+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.303187+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:25.035256+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1133,"num_write":410,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'727","reported_seq":2202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.270091+0000","last_change":"2024-09-14T11:38:13.270091+0000","last_active":"2024-09-14T11:38:13.270091+0000","last_peered":"2024-09-14T11:38:13.270091+0000","last_clean":"2024-09-14T11:38:13.270091+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:38:13.270091+0000","last_undegraded":"2024-09-14T11:38:13.270091+0000","last_fullsized":"2024-09-14T11:38:13.270091+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'727","last_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_deep_scrub":"264'727","last_deep_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.270000+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":701,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:03.387188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'142","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.555338+0000","last_change":"2024-09-14T11:38:17.555338+0000","last_active":"2024-09-14T11:38:17.555338+0000","last_peered":"2024-09-14T11:38:17.555338+0000","last_clean":"2024-09-14T11:38:17.555338+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:38:17.555338+0000","last_undegraded":"2024-09-14T11:38:17.555338+0000","last_fullsized":"2024-09-14T11:38:17.555338+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:38:17.555233+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:38:17.555233+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.555233+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:42.328664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'173","reported_seq":789,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.828980+0000","last_change":"2024-09-14T11:38:04.828980+0000","last_active":"2024-09-14T11:38:04.828980+0000","last_peered":"2024-09-14T11:38:04.828980+0000","last_clean":"2024-09-14T11:38:04.828980+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:38:04.828980+0000","last_undegraded":"2024-09-14T11:38:04.828980+0000","last_fullsized":"2024-09-14T11:38:04.828980+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.828885+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:49.181800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'330","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.801255+0000","last_change":"2024-09-14T11:37:55.801255+0000","last_active":"2024-09-14T11:37:55.801255+0000","last_peered":"2024-09-14T11:37:55.801255+0000","last_clean":"2024-09-14T11:37:55.801255+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:37:55.801255+0000","last_undegraded":"2024-09-14T11:37:55.801255+0000","last_fullsized":"2024-09-14T11:37:55.801255+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.801142+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:31.011642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":8777,"num_write":1001,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1452,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.923095+0000","last_change":"2024-09-14T11:38:16.923095+0000","last_active":"2024-09-14T11:38:16.923095+0000","last_peered":"2024-09-14T11:38:16.923095+0000","last_clean":"2024-09-14T11:38:16.923095+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:38:16.923095+0000","last_undegraded":"2024-09-14T11:38:16.923095+0000","last_fullsized":"2024-09-14T11:38:16.923095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:38:16.923004+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:38:16.923004+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.923004+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.332168+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'83","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.740937+0000","last_change":"2024-09-14T11:38:19.740937+0000","last_active":"2024-09-14T11:38:19.740937+0000","last_peered":"2024-09-14T11:38:19.740937+0000","last_clean":"2024-09-14T11:38:19.740937+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:38:19.740937+0000","last_undegraded":"2024-09-14T11:38:19.740937+0000","last_fullsized":"2024-09-14T11:38:19.740937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-14T11:38:19.740836+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-14T11:38:19.740836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.740836+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:48.023795+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.096488+0000","last_change":"2024-09-14T11:38:13.096488+0000","last_active":"2024-09-14T11:38:13.096488+0000","last_peered":"2024-09-14T11:38:13.096488+0000","last_clean":"2024-09-14T11:38:13.096488+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:38:13.096488+0000","last_undegraded":"2024-09-14T11:38:13.096488+0000","last_fullsized":"2024-09-14T11:38:13.096488+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.096403+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.180002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'150","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.765041+0000","last_change":"2024-09-14T11:38:27.765041+0000","last_active":"2024-09-14T11:38:27.765041+0000","last_peered":"2024-09-14T11:38:27.765041+0000","last_clean":"2024-09-14T11:38:27.765041+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:38:27.765041+0000","last_undegraded":"2024-09-14T11:38:27.765041+0000","last_fullsized":"2024-09-14T11:38:27.765041+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-09-14T11:38:27.764956+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-09-14T11:38:27.764956+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.764956+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:47.323277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'626","reported_seq":1473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.531675+0000","last_change":"2024-09-14T11:38:02.531675+0000","last_active":"2024-09-14T11:38:02.531675+0000","last_peered":"2024-09-14T11:38:02.531675+0000","last_clean":"2024-09-14T11:38:02.531675+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:38:02.531675+0000","last_undegraded":"2024-09-14T11:38:02.531675+0000","last_fullsized":"2024-09-14T11:38:02.531675+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.531585+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:49.257771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25760,"num_omap_keys":101,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'395","reported_seq":1169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.842500+0000","last_change":"2024-09-14T11:37:54.842500+0000","last_active":"2024-09-14T11:37:54.842500+0000","last_peered":"2024-09-14T11:37:54.842500+0000","last_clean":"2024-09-14T11:37:54.842500+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:37:54.842500+0000","last_undegraded":"2024-09-14T11:37:54.842500+0000","last_fullsized":"2024-09-14T11:37:54.842500+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.842395+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:06.443569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1140,"num_read_kb":48198,"num_write":1212,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.762326+0000","last_change":"2024-09-14T11:38:15.762326+0000","last_active":"2024-09-14T11:38:15.762326+0000","last_peered":"2024-09-14T11:38:15.762326+0000","last_clean":"2024-09-14T11:38:15.762326+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:38:15.762326+0000","last_undegraded":"2024-09-14T11:38:15.762326+0000","last_fullsized":"2024-09-14T11:38:15.762326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.762229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.762229+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.762229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:13.575149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'357","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.896677+0000","last_change":"2024-09-14T11:38:20.896677+0000","last_active":"2024-09-14T11:38:20.896677+0000","last_peered":"2024-09-14T11:38:20.896677+0000","last_clean":"2024-09-14T11:38:20.896677+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:38:20.896677+0000","last_undegraded":"2024-09-14T11:38:20.896677+0000","last_fullsized":"2024-09-14T11:38:20.896677+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:38:20.896588+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:38:20.896588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.896588+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:51.367045+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46246,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1178,"num_read_kb":1754,"num_write":1698,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.096682+0000","last_change":"2024-09-14T11:38:12.096682+0000","last_active":"2024-09-14T11:38:12.096682+0000","last_peered":"2024-09-14T11:38:12.096682+0000","last_clean":"2024-09-14T11:38:12.096682+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:38:12.096682+0000","last_undegraded":"2024-09-14T11:38:12.096682+0000","last_fullsized":"2024-09-14T11:38:12.096682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.096566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:07.924703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'145","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.595814+0000","last_change":"2024-09-14T11:38:18.595814+0000","last_active":"2024-09-14T11:38:18.595814+0000","last_peered":"2024-09-14T11:38:18.595814+0000","last_clean":"2024-09-14T11:38:18.595814+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:38:18.595814+0000","last_undegraded":"2024-09-14T11:38:18.595814+0000","last_fullsized":"2024-09-14T11:38:18.595814+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-14T11:38:18.595731+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-14T11:38:18.595731+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.595731+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:54.957071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.215568+0000","last_change":"2024-09-14T11:38:03.215568+0000","last_active":"2024-09-14T11:38:03.215568+0000","last_peered":"2024-09-14T11:38:03.215568+0000","last_clean":"2024-09-14T11:38:03.215568+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:38:03.215568+0000","last_undegraded":"2024-09-14T11:38:03.215568+0000","last_fullsized":"2024-09-14T11:38:03.215568+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'521","last_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_deep_scrub":"264'521","last_deep_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.215480+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:27.895596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.940021+0000","last_change":"2024-09-14T11:37:55.940021+0000","last_active":"2024-09-14T11:37:55.940021+0000","last_peered":"2024-09-14T11:37:55.940021+0000","last_clean":"2024-09-14T11:37:55.940021+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:37:55.940021+0000","last_undegraded":"2024-09-14T11:37:55.940021+0000","last_fullsized":"2024-09-14T11:37:55.940021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.939912+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.966314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.962629+0000","last_change":"2024-09-14T11:37:56.962629+0000","last_active":"2024-09-14T11:37:56.962629+0000","last_peered":"2024-09-14T11:37:56.962629+0000","last_clean":"2024-09-14T11:37:56.962629+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:37:56.962629+0000","last_undegraded":"2024-09-14T11:37:56.962629+0000","last_fullsized":"2024-09-14T11:37:56.962629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.962512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:33.102357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'336","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.833750+0000","last_change":"2024-09-14T11:37:53.833750+0000","last_active":"2024-09-14T11:37:53.833750+0000","last_peered":"2024-09-14T11:37:53.833750+0000","last_clean":"2024-09-14T11:37:53.833750+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:37:53.833750+0000","last_undegraded":"2024-09-14T11:37:53.833750+0000","last_fullsized":"2024-09-14T11:37:53.833750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.833659+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:56.404049+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":634,"num_read_kb":14631,"num_write":972,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.952690+0000","last_change":"2024-09-14T11:38:13.952690+0000","last_active":"2024-09-14T11:38:13.952690+0000","last_peered":"2024-09-14T11:38:13.952690+0000","last_clean":"2024-09-14T11:38:13.952690+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:38:13.952690+0000","last_undegraded":"2024-09-14T11:38:13.952690+0000","last_fullsized":"2024-09-14T11:38:13.952690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.952561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:45.651254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'735","reported_seq":1437,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.888105+0000","last_change":"2024-09-14T11:38:18.888105+0000","last_active":"2024-09-14T11:38:18.888105+0000","last_peered":"2024-09-14T11:38:18.888105+0000","last_clean":"2024-09-14T11:38:18.888105+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:38:18.888105+0000","last_undegraded":"2024-09-14T11:38:18.888105+0000","last_fullsized":"2024-09-14T11:38:18.888105+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'735","last_scrub_stamp":"2024-09-14T11:38:18.888016+0000","last_deep_scrub":"264'735","last_deep_scrub_stamp":"2024-09-14T11:38:18.888016+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.888016+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.221845+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1412,"num_read_kb":3246,"num_write":1300,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89606,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.073078+0000","last_change":"2024-09-14T11:38:20.073078+0000","last_active":"2024-09-14T11:38:20.073078+0000","last_peered":"2024-09-14T11:38:20.073078+0000","last_clean":"2024-09-14T11:38:20.073078+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:38:20.073078+0000","last_undegraded":"2024-09-14T11:38:20.073078+0000","last_fullsized":"2024-09-14T11:38:20.073078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:20.072985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:20.072985+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.072985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:47.722256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'196","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.132211+0000","last_change":"2024-09-14T11:38:19.132211+0000","last_active":"2024-09-14T11:38:19.132211+0000","last_peered":"2024-09-14T11:38:19.132211+0000","last_clean":"2024-09-14T11:38:19.132211+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:38:19.132211+0000","last_undegraded":"2024-09-14T11:38:19.132211+0000","last_fullsized":"2024-09-14T11:38:19.132211+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-14T11:38:19.132128+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-14T11:38:19.132128+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.132128+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.839740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'189","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.105067+0000","last_change":"2024-09-14T11:38:02.105067+0000","last_active":"2024-09-14T11:38:02.105067+0000","last_peered":"2024-09-14T11:38:02.105067+0000","last_clean":"2024-09-14T11:38:02.105067+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:38:02.105067+0000","last_undegraded":"2024-09-14T11:38:02.105067+0000","last_fullsized":"2024-09-14T11:38:02.105067+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.104979+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:48.803647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.930011+0000","last_change":"2024-09-14T11:38:00.929927+0000","last_active":"2024-09-14T11:38:00.930011+0000","last_peered":"2024-09-14T11:38:00.930011+0000","last_clean":"2024-09-14T11:38:00.930011+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:38:00.930011+0000","last_undegraded":"2024-09-14T11:38:00.930011+0000","last_fullsized":"2024-09-14T11:38:00.930011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.929792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:40.514471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'398","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.259139+0000","last_change":"2024-09-14T11:37:52.259139+0000","last_active":"2024-09-14T11:37:52.259139+0000","last_peered":"2024-09-14T11:37:52.259139+0000","last_clean":"2024-09-14T11:37:52.259139+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:52.259139+0000","last_undegraded":"2024-09-14T11:37:52.259139+0000","last_fullsized":"2024-09-14T11:37:52.259139+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.259071+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:58.652972+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":799,"num_read_kb":83524,"num_write":1261,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"264'6","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.954241+0000","last_change":"2024-09-14T11:38:13.954241+0000","last_active":"2024-09-14T11:38:13.954241+0000","last_peered":"2024-09-14T11:38:13.954241+0000","last_clean":"2024-09-14T11:38:13.954241+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:38:13.954241+0000","last_undegraded":"2024-09-14T11:38:13.954241+0000","last_fullsized":"2024-09-14T11:38:13.954241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:13.954162+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:13.954162+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.954162+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:46.433894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1245","reported_seq":2684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.546235+0000","last_change":"2024-09-14T11:38:12.546235+0000","last_active":"2024-09-14T11:38:12.546235+0000","last_peered":"2024-09-14T11:38:12.546235+0000","last_clean":"2024-09-14T11:38:12.546235+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:38:12.546235+0000","last_undegraded":"2024-09-14T11:38:12.546235+0000","last_fullsized":"2024-09-14T11:38:12.546235+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1245","last_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_deep_scrub":"264'1245","last_deep_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.546141+0000","objects_scrubbed":12,"log_size":45,"log_dups_size":1200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:57.448650+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138368,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1980,"num_read_kb":3690,"num_write":1076,"num_write_kb":906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.864388+0000","last_change":"2024-09-14T11:38:22.864388+0000","last_active":"2024-09-14T11:38:22.864388+0000","last_peered":"2024-09-14T11:38:22.864388+0000","last_clean":"2024-09-14T11:38:22.864388+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:38:22.864388+0000","last_undegraded":"2024-09-14T11:38:22.864388+0000","last_fullsized":"2024-09-14T11:38:22.864388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.864302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.864302+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.864302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:46.032081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'244","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.641925+0000","last_change":"2024-09-14T11:38:20.641925+0000","last_active":"2024-09-14T11:38:20.641925+0000","last_peered":"2024-09-14T11:38:20.641925+0000","last_clean":"2024-09-14T11:38:20.641925+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:38:20.641925+0000","last_undegraded":"2024-09-14T11:38:20.641925+0000","last_fullsized":"2024-09-14T11:38:20.641925+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-14T11:38:20.641827+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-14T11:38:20.641827+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.641827+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:24.991277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.328415+0000","last_change":"2024-09-14T11:37:59.328415+0000","last_active":"2024-09-14T11:37:59.328415+0000","last_peered":"2024-09-14T11:37:59.328415+0000","last_clean":"2024-09-14T11:37:59.328415+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:37:59.328415+0000","last_undegraded":"2024-09-14T11:37:59.328415+0000","last_fullsized":"2024-09-14T11:37:59.328415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.328313+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:28.847997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.287608+0000","last_change":"2024-09-14T11:37:53.287608+0000","last_active":"2024-09-14T11:37:53.287608+0000","last_peered":"2024-09-14T11:37:53.287608+0000","last_clean":"2024-09-14T11:37:53.287608+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:37:53.287608+0000","last_undegraded":"2024-09-14T11:37:53.287608+0000","last_fullsized":"2024-09-14T11:37:53.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.287533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:08.352515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'364","reported_seq":1047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.503709+0000","last_change":"2024-09-14T11:37:52.503608+0000","last_active":"2024-09-14T11:37:52.503709+0000","last_peered":"2024-09-14T11:37:52.503709+0000","last_clean":"2024-09-14T11:37:52.503709+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:37:52.503709+0000","last_undegraded":"2024-09-14T11:37:52.503709+0000","last_fullsized":"2024-09-14T11:37:52.503709+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.503516+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:31.493522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":61657,"num_write":1199,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.245866+0000","last_change":"2024-09-14T11:38:04.245866+0000","last_active":"2024-09-14T11:38:04.245866+0000","last_peered":"2024-09-14T11:38:04.245866+0000","last_clean":"2024-09-14T11:38:04.245866+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:38:04.245866+0000","last_undegraded":"2024-09-14T11:38:04.245866+0000","last_fullsized":"2024-09-14T11:38:04.245866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.245779+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.323128+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'224","reported_seq":1266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.905401+0000","last_change":"2024-09-14T11:38:17.905401+0000","last_active":"2024-09-14T11:38:17.905401+0000","last_peered":"2024-09-14T11:38:17.905401+0000","last_clean":"2024-09-14T11:38:17.905401+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:38:17.905401+0000","last_undegraded":"2024-09-14T11:38:17.905401+0000","last_fullsized":"2024-09-14T11:38:17.905401+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-14T11:38:17.905265+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-14T11:38:17.905265+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.905265+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:17.873901+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.026536+0000","last_change":"2024-09-14T11:38:19.026536+0000","last_active":"2024-09-14T11:38:19.026536+0000","last_peered":"2024-09-14T11:38:19.026536+0000","last_clean":"2024-09-14T11:38:19.026536+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:38:19.026536+0000","last_undegraded":"2024-09-14T11:38:19.026536+0000","last_fullsized":"2024-09-14T11:38:19.026536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:19.026445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:19.026445+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.026445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:34.029834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'260","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.742271+0000","last_change":"2024-09-14T11:38:30.742271+0000","last_active":"2024-09-14T11:38:30.742271+0000","last_peered":"2024-09-14T11:38:30.742271+0000","last_clean":"2024-09-14T11:38:30.742271+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:38:30.742271+0000","last_undegraded":"2024-09-14T11:38:30.742271+0000","last_fullsized":"2024-09-14T11:38:30.742271+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'260","last_scrub_stamp":"2024-09-14T11:38:30.742182+0000","last_deep_scrub":"264'260","last_deep_scrub_stamp":"2024-09-14T11:38:30.742182+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.742182+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.028319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.489283+0000","last_change":"2024-09-14T11:38:01.489283+0000","last_active":"2024-09-14T11:38:01.489283+0000","last_peered":"2024-09-14T11:38:01.489283+0000","last_clean":"2024-09-14T11:38:01.489283+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:38:01.489283+0000","last_undegraded":"2024-09-14T11:38:01.489283+0000","last_fullsized":"2024-09-14T11:38:01.489283+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.489194+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:27.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.984029+0000","last_change":"2024-09-14T11:37:55.984029+0000","last_active":"2024-09-14T11:37:55.984029+0000","last_peered":"2024-09-14T11:37:55.984029+0000","last_clean":"2024-09-14T11:37:55.984029+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:37:55.984029+0000","last_undegraded":"2024-09-14T11:37:55.984029+0000","last_fullsized":"2024-09-14T11:37:55.984029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.983951+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:03.446110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'424","reported_seq":1181,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.799026+0000","last_change":"2024-09-14T11:37:54.799026+0000","last_active":"2024-09-14T11:37:54.799026+0000","last_peered":"2024-09-14T11:37:54.799026+0000","last_clean":"2024-09-14T11:37:54.799026+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:37:54.799026+0000","last_undegraded":"2024-09-14T11:37:54.799026+0000","last_fullsized":"2024-09-14T11:37:54.799026+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'424","last_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_deep_scrub":"264'424","last_deep_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.798918+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:41.369232+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":119862,"num_write":1308,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.097424+0000","last_change":"2024-09-14T11:38:12.097424+0000","last_active":"2024-09-14T11:38:12.097424+0000","last_peered":"2024-09-14T11:38:12.097424+0000","last_clean":"2024-09-14T11:38:12.097424+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:38:12.097424+0000","last_undegraded":"2024-09-14T11:38:12.097424+0000","last_fullsized":"2024-09-14T11:38:12.097424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.097323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:33.246260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'124","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.726429+0000","last_change":"2024-09-14T11:38:16.726429+0000","last_active":"2024-09-14T11:38:16.726429+0000","last_peered":"2024-09-14T11:38:16.726429+0000","last_clean":"2024-09-14T11:38:16.726429+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:38:16.726429+0000","last_undegraded":"2024-09-14T11:38:16.726429+0000","last_fullsized":"2024-09-14T11:38:16.726429+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:38:16.726333+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:38:16.726333+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.726333+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:25.360047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.130226+0000","last_change":"2024-09-14T11:38:11.130226+0000","last_active":"2024-09-14T11:38:11.130226+0000","last_peered":"2024-09-14T11:38:11.130226+0000","last_clean":"2024-09-14T11:38:11.130226+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:38:11.130226+0000","last_undegraded":"2024-09-14T11:38:11.130226+0000","last_fullsized":"2024-09-14T11:38:11.130226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.130127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:35.749033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.951242+0000","last_change":"2024-09-14T11:38:24.951242+0000","last_active":"2024-09-14T11:38:24.951242+0000","last_peered":"2024-09-14T11:38:24.951242+0000","last_clean":"2024-09-14T11:38:24.951242+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:38:24.951242+0000","last_undegraded":"2024-09-14T11:38:24.951242+0000","last_fullsized":"2024-09-14T11:38:24.951242+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-14T11:38:24.951134+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-14T11:38:24.951134+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.951134+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:37.022238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.536277+0000","last_change":"2024-09-14T11:37:59.536277+0000","last_active":"2024-09-14T11:37:59.536277+0000","last_peered":"2024-09-14T11:37:59.536277+0000","last_clean":"2024-09-14T11:37:59.536277+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:37:59.536277+0000","last_undegraded":"2024-09-14T11:37:59.536277+0000","last_fullsized":"2024-09-14T11:37:59.536277+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.536190+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.140324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'368","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.967810+0000","last_change":"2024-09-14T11:37:54.967810+0000","last_active":"2024-09-14T11:37:54.967810+0000","last_peered":"2024-09-14T11:37:54.967810+0000","last_clean":"2024-09-14T11:37:54.967810+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:37:54.967810+0000","last_undegraded":"2024-09-14T11:37:54.967810+0000","last_fullsized":"2024-09-14T11:37:54.967810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.967697+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:29.191346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":12538,"num_write":1147,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.521322+0000","last_change":"2024-09-14T11:37:53.521322+0000","last_active":"2024-09-14T11:37:53.521322+0000","last_peered":"2024-09-14T11:37:53.521322+0000","last_clean":"2024-09-14T11:37:53.521322+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:37:53.521322+0000","last_undegraded":"2024-09-14T11:37:53.521322+0000","last_fullsized":"2024-09-14T11:37:53.521322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.521249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:04.660477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"264'4","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.079368+0000","last_change":"2024-09-14T11:38:13.079368+0000","last_active":"2024-09-14T11:38:13.079368+0000","last_peered":"2024-09-14T11:38:13.079368+0000","last_clean":"2024-09-14T11:38:13.079368+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:38:13.079368+0000","last_undegraded":"2024-09-14T11:38:13.079368+0000","last_fullsized":"2024-09-14T11:38:13.079368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.079281+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:20.909629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'598","reported_seq":1261,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.053639+0000","last_change":"2024-09-14T11:38:15.053564+0000","last_active":"2024-09-14T11:38:15.053639+0000","last_peered":"2024-09-14T11:38:15.053639+0000","last_clean":"2024-09-14T11:38:15.053639+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:38:15.053639+0000","last_undegraded":"2024-09-14T11:38:15.053639+0000","last_fullsized":"2024-09-14T11:38:15.053639+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'598","last_scrub_stamp":"2024-09-14T11:38:15.053466+0000","last_deep_scrub":"264'598","last_deep_scrub_stamp":"2024-09-14T11:38:15.053466+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.053466+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:35.467956+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94043,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":992,"num_read_kb":2221,"num_write":850,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.804759+0000","last_change":"2024-09-14T11:38:25.804759+0000","last_active":"2024-09-14T11:38:25.804759+0000","last_peered":"2024-09-14T11:38:25.804759+0000","last_clean":"2024-09-14T11:38:25.804759+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:38:25.804759+0000","last_undegraded":"2024-09-14T11:38:25.804759+0000","last_fullsized":"2024-09-14T11:38:25.804759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.804671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.804671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.804671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:11.781801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.097173+0000","last_change":"2024-09-14T11:38:28.097173+0000","last_active":"2024-09-14T11:38:28.097173+0000","last_peered":"2024-09-14T11:38:28.097173+0000","last_clean":"2024-09-14T11:38:28.097173+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:38:28.097173+0000","last_undegraded":"2024-09-14T11:38:28.097173+0000","last_fullsized":"2024-09-14T11:38:28.097173+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-14T11:38:28.097076+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-14T11:38:28.097076+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.097076+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:42.736350+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.092950+0000","last_change":"2024-09-14T11:38:01.092950+0000","last_active":"2024-09-14T11:38:01.092950+0000","last_peered":"2024-09-14T11:38:01.092950+0000","last_clean":"2024-09-14T11:38:01.092950+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:38:01.092950+0000","last_undegraded":"2024-09-14T11:38:01.092950+0000","last_fullsized":"2024-09-14T11:38:01.092950+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.092847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:03.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'354","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.510047+0000","last_change":"2024-09-14T11:37:54.510047+0000","last_active":"2024-09-14T11:37:54.510047+0000","last_peered":"2024-09-14T11:37:54.510047+0000","last_clean":"2024-09-14T11:37:54.510047+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:37:54.510047+0000","last_undegraded":"2024-09-14T11:37:54.510047+0000","last_fullsized":"2024-09-14T11:37:54.510047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.509966+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:47.241897+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":702,"num_read_kb":48648,"num_write":1220,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.948139+0000","last_change":"2024-09-14T11:37:57.948139+0000","last_active":"2024-09-14T11:37:57.948139+0000","last_peered":"2024-09-14T11:37:57.948139+0000","last_clean":"2024-09-14T11:37:57.948139+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:37:57.948139+0000","last_undegraded":"2024-09-14T11:37:57.948139+0000","last_fullsized":"2024-09-14T11:37:57.948139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.948046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:12.046884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.171510+0000","last_change":"2024-09-14T11:38:07.171510+0000","last_active":"2024-09-14T11:38:07.171510+0000","last_peered":"2024-09-14T11:38:07.171510+0000","last_clean":"2024-09-14T11:38:07.171510+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:38:07.171510+0000","last_undegraded":"2024-09-14T11:38:07.171510+0000","last_fullsized":"2024-09-14T11:38:07.171510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.171423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:03.206894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'155","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.514380+0000","last_change":"2024-09-14T11:38:11.514380+0000","last_active":"2024-09-14T11:38:11.514380+0000","last_peered":"2024-09-14T11:38:11.514380+0000","last_clean":"2024-09-14T11:38:11.514380+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:38:11.514380+0000","last_undegraded":"2024-09-14T11:38:11.514380+0000","last_fullsized":"2024-09-14T11:38:11.514380+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.514295+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:27.234237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'795","reported_seq":2769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.899220+0000","last_change":"2024-09-14T11:38:22.899166+0000","last_active":"2024-09-14T11:38:22.899220+0000","last_peered":"2024-09-14T11:38:22.899220+0000","last_clean":"2024-09-14T11:38:22.899220+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:38:22.899220+0000","last_undegraded":"2024-09-14T11:38:22.899220+0000","last_fullsized":"2024-09-14T11:38:22.899220+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:22.899077+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:22.899077+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.899077+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:13.648060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'139","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.778039+0000","last_change":"2024-09-14T11:38:32.778039+0000","last_active":"2024-09-14T11:38:32.778039+0000","last_peered":"2024-09-14T11:38:32.778039+0000","last_clean":"2024-09-14T11:38:32.778039+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:38:32.778039+0000","last_undegraded":"2024-09-14T11:38:32.778039+0000","last_fullsized":"2024-09-14T11:38:32.778039+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-14T11:38:32.777947+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-14T11:38:32.777947+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.777947+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:40.532787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'112","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.767548+0000","last_change":"2024-09-14T11:38:04.767492+0000","last_active":"2024-09-14T11:38:04.767548+0000","last_peered":"2024-09-14T11:38:04.767548+0000","last_clean":"2024-09-14T11:38:04.767548+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:38:04.767548+0000","last_undegraded":"2024-09-14T11:38:04.767548+0000","last_fullsized":"2024-09-14T11:38:04.767548+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.767399+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:56.368702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'357","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.826736+0000","last_change":"2024-09-14T11:37:55.826736+0000","last_active":"2024-09-14T11:37:55.826736+0000","last_peered":"2024-09-14T11:37:55.826736+0000","last_clean":"2024-09-14T11:37:55.826736+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:37:55.826736+0000","last_undegraded":"2024-09-14T11:37:55.826736+0000","last_fullsized":"2024-09-14T11:37:55.826736+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.826653+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:51.541137+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":3889,"num_write":1053,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.473533+0000","last_change":"2024-09-14T11:37:55.473533+0000","last_active":"2024-09-14T11:37:55.473533+0000","last_peered":"2024-09-14T11:37:55.473533+0000","last_clean":"2024-09-14T11:37:55.473533+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:37:55.473533+0000","last_undegraded":"2024-09-14T11:37:55.473533+0000","last_fullsized":"2024-09-14T11:37:55.473533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.473461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:32.359228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.713342+0000","last_change":"2024-09-14T11:38:16.713342+0000","last_active":"2024-09-14T11:38:16.713342+0000","last_peered":"2024-09-14T11:38:16.713342+0000","last_clean":"2024-09-14T11:38:16.713342+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:38:16.713342+0000","last_undegraded":"2024-09-14T11:38:16.713342+0000","last_fullsized":"2024-09-14T11:38:16.713342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:16.713247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:16.713247+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.713247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:29.483002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'110","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.704146+0000","last_change":"2024-09-14T11:38:18.704146+0000","last_active":"2024-09-14T11:38:18.704146+0000","last_peered":"2024-09-14T11:38:18.704146+0000","last_clean":"2024-09-14T11:38:18.704146+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:38:18.704146+0000","last_undegraded":"2024-09-14T11:38:18.704146+0000","last_fullsized":"2024-09-14T11:38:18.704146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-14T11:38:18.704046+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-14T11:38:18.704046+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.704046+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:21.330859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'795","reported_seq":2394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.728439+0000","last_change":"2024-09-14T11:38:25.728439+0000","last_active":"2024-09-14T11:38:25.728439+0000","last_peered":"2024-09-14T11:38:25.728439+0000","last_clean":"2024-09-14T11:38:25.728439+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:38:25.728439+0000","last_undegraded":"2024-09-14T11:38:25.728439+0000","last_fullsized":"2024-09-14T11:38:25.728439+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:25.728353+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:25.728353+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.728353+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:54.580317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'256","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.133065+0000","last_change":"2024-09-14T11:38:27.133065+0000","last_active":"2024-09-14T11:38:27.133065+0000","last_peered":"2024-09-14T11:38:27.133065+0000","last_clean":"2024-09-14T11:38:27.133065+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:38:27.133065+0000","last_undegraded":"2024-09-14T11:38:27.133065+0000","last_fullsized":"2024-09-14T11:38:27.133065+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-14T11:38:27.132972+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-14T11:38:27.132972+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.132972+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:27.250869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.782130+0000","last_change":"2024-09-14T11:37:58.782130+0000","last_active":"2024-09-14T11:37:58.782130+0000","last_peered":"2024-09-14T11:37:58.782130+0000","last_clean":"2024-09-14T11:37:58.782130+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:37:58.782130+0000","last_undegraded":"2024-09-14T11:37:58.782130+0000","last_fullsized":"2024-09-14T11:37:58.782130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.782043+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:01.595371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.229148+0000","last_change":"2024-09-14T11:37:53.229148+0000","last_active":"2024-09-14T11:37:53.229148+0000","last_peered":"2024-09-14T11:37:53.229148+0000","last_clean":"2024-09-14T11:37:53.229148+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:53.229148+0000","last_undegraded":"2024-09-14T11:37:53.229148+0000","last_fullsized":"2024-09-14T11:37:53.229148+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.229076+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:27.683273+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":848,"num_read_kb":56309,"num_write":1145,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.238426+0000","last_change":"2024-09-14T11:37:55.238426+0000","last_active":"2024-09-14T11:37:55.238426+0000","last_peered":"2024-09-14T11:37:55.238426+0000","last_clean":"2024-09-14T11:37:55.238426+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:37:55.238426+0000","last_undegraded":"2024-09-14T11:37:55.238426+0000","last_fullsized":"2024-09-14T11:37:55.238426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.238331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:34.224317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.695781+0000","last_change":"2024-09-14T11:38:17.695711+0000","last_active":"2024-09-14T11:38:17.695781+0000","last_peered":"2024-09-14T11:38:17.695781+0000","last_clean":"2024-09-14T11:38:17.695781+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:38:17.695781+0000","last_undegraded":"2024-09-14T11:38:17.695781+0000","last_fullsized":"2024-09-14T11:38:17.695781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.695622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.695622+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.695622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.947854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'725","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.954032+0000","last_change":"2024-09-14T11:38:16.954032+0000","last_active":"2024-09-14T11:38:16.954032+0000","last_peered":"2024-09-14T11:38:16.954032+0000","last_clean":"2024-09-14T11:38:16.954032+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:38:16.954032+0000","last_undegraded":"2024-09-14T11:38:16.954032+0000","last_fullsized":"2024-09-14T11:38:16.954032+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'725","last_scrub_stamp":"2024-09-14T11:38:16.953943+0000","last_deep_scrub":"264'725","last_deep_scrub_stamp":"2024-09-14T11:38:16.953943+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.953943+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:19.345828+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1287,"num_read_kb":3017,"num_write":1048,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.770245+0000","last_change":"2024-09-14T11:38:26.770245+0000","last_active":"2024-09-14T11:38:26.770245+0000","last_peered":"2024-09-14T11:38:26.770245+0000","last_clean":"2024-09-14T11:38:26.770245+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:38:26.770245+0000","last_undegraded":"2024-09-14T11:38:26.770245+0000","last_fullsized":"2024-09-14T11:38:26.770245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.770152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.770152+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.770152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:45.323231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'138","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.987126+0000","last_change":"2024-09-14T11:38:26.987126+0000","last_active":"2024-09-14T11:38:26.987126+0000","last_peered":"2024-09-14T11:38:26.987126+0000","last_clean":"2024-09-14T11:38:26.987126+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:38:26.987126+0000","last_undegraded":"2024-09-14T11:38:26.987126+0000","last_fullsized":"2024-09-14T11:38:26.987126+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:26.987044+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:26.987044+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.987044+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:43.784515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'138","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.148211+0000","last_change":"2024-09-14T11:38:32.148211+0000","last_active":"2024-09-14T11:38:32.148211+0000","last_peered":"2024-09-14T11:38:32.148211+0000","last_clean":"2024-09-14T11:38:32.148211+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:38:32.148211+0000","last_undegraded":"2024-09-14T11:38:32.148211+0000","last_fullsized":"2024-09-14T11:38:32.148211+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:32.148113+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:32.148113+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.148113+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:52.963634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'296","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.799272+0000","last_change":"2024-09-14T11:38:03.799205+0000","last_active":"2024-09-14T11:38:03.799272+0000","last_peered":"2024-09-14T11:38:03.799272+0000","last_clean":"2024-09-14T11:38:03.799272+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:38:03.799272+0000","last_undegraded":"2024-09-14T11:38:03.799272+0000","last_fullsized":"2024-09-14T11:38:03.799272+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.799103+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:55.138113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'297","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.751853+0000","last_change":"2024-09-14T11:37:59.751795+0000","last_active":"2024-09-14T11:37:59.751853+0000","last_peered":"2024-09-14T11:37:59.751853+0000","last_clean":"2024-09-14T11:37:59.751853+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:37:59.751853+0000","last_undegraded":"2024-09-14T11:37:59.751853+0000","last_fullsized":"2024-09-14T11:37:59.751853+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.751710+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:08.154524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":2279,"num_write":913,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.527091+0000","last_change":"2024-09-14T11:38:08.527034+0000","last_active":"2024-09-14T11:38:08.527091+0000","last_peered":"2024-09-14T11:38:08.527091+0000","last_clean":"2024-09-14T11:38:08.527091+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:38:08.527091+0000","last_undegraded":"2024-09-14T11:38:08.527091+0000","last_fullsized":"2024-09-14T11:38:08.527091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.526942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:37.177668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'261","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.778607+0000","last_change":"2024-09-14T11:38:22.778607+0000","last_active":"2024-09-14T11:38:22.778607+0000","last_peered":"2024-09-14T11:38:22.778607+0000","last_clean":"2024-09-14T11:38:22.778607+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:38:22.778607+0000","last_undegraded":"2024-09-14T11:38:22.778607+0000","last_fullsized":"2024-09-14T11:38:22.778607+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'261","last_scrub_stamp":"2024-09-14T11:38:22.778510+0000","last_deep_scrub":"264'261","last_deep_scrub_stamp":"2024-09-14T11:38:22.778510+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.778510+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:42.834735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44234,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":907,"num_write":328,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.748230+0000","last_change":"2024-09-14T11:38:28.748230+0000","last_active":"2024-09-14T11:38:28.748230+0000","last_peered":"2024-09-14T11:38:28.748230+0000","last_clean":"2024-09-14T11:38:28.748230+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:38:28.748230+0000","last_undegraded":"2024-09-14T11:38:28.748230+0000","last_fullsized":"2024-09-14T11:38:28.748230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:28.748135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:28.748135+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.748135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.090625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'113","reported_seq":610,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:25.618731+0000","last_change":"2024-09-14T10:56:16.876189+0000","last_active":"2024-09-14T11:36:25.618731+0000","last_peered":"2024-09-14T11:36:25.618731+0000","last_clean":"2024-09-14T11:36:25.618731+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:36:25.618731+0000","last_undegraded":"2024-09-14T11:36:25.618731+0000","last_fullsized":"2024-09-14T11:36:25.618731+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T10:56:15.854331+0000","last_clean_scrub_stamp":"2024-09-14T10:56:15.854331+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.520852+0000","last_change":"2024-09-14T11:38:03.520774+0000","last_active":"2024-09-14T11:38:03.520852+0000","last_peered":"2024-09-14T11:38:03.520852+0000","last_clean":"2024-09-14T11:38:03.520852+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:38:03.520852+0000","last_undegraded":"2024-09-14T11:38:03.520852+0000","last_fullsized":"2024-09-14T11:38:03.520852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.520673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:06.183047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.979596+0000","last_change":"2024-09-14T11:38:05.979596+0000","last_active":"2024-09-14T11:38:05.979596+0000","last_peered":"2024-09-14T11:38:05.979596+0000","last_clean":"2024-09-14T11:38:05.979596+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:38:05.979596+0000","last_undegraded":"2024-09-14T11:38:05.979596+0000","last_fullsized":"2024-09-14T11:38:05.979596+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.979504+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.259987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":9277,"num_write":976,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.739583+0000","last_change":"2024-09-14T11:38:15.739583+0000","last_active":"2024-09-14T11:38:15.739583+0000","last_peered":"2024-09-14T11:38:15.739583+0000","last_clean":"2024-09-14T11:38:15.739583+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:38:15.739583+0000","last_undegraded":"2024-09-14T11:38:15.739583+0000","last_fullsized":"2024-09-14T11:38:15.739583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.739488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.739488+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.739488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:31.954617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'60","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.018389+0000","last_change":"2024-09-14T11:38:16.018389+0000","last_active":"2024-09-14T11:38:16.018389+0000","last_peered":"2024-09-14T11:38:16.018389+0000","last_clean":"2024-09-14T11:38:16.018389+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:38:16.018389+0000","last_undegraded":"2024-09-14T11:38:16.018389+0000","last_fullsized":"2024-09-14T11:38:16.018389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'60","last_scrub_stamp":"2024-09-14T11:38:16.018327+0000","last_deep_scrub":"264'60","last_deep_scrub_stamp":"2024-09-14T11:38:16.018327+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.018327+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.609047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.873580+0000","last_change":"2024-09-14T11:38:23.873580+0000","last_active":"2024-09-14T11:38:23.873580+0000","last_peered":"2024-09-14T11:38:23.873580+0000","last_clean":"2024-09-14T11:38:23.873580+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:38:23.873580+0000","last_undegraded":"2024-09-14T11:38:23.873580+0000","last_fullsized":"2024-09-14T11:38:23.873580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.873490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.873490+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.873490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:31.278400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'187","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.077509+0000","last_change":"2024-09-14T11:38:30.077509+0000","last_active":"2024-09-14T11:38:30.077509+0000","last_peered":"2024-09-14T11:38:30.077509+0000","last_clean":"2024-09-14T11:38:30.077509+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:38:30.077509+0000","last_undegraded":"2024-09-14T11:38:30.077509+0000","last_fullsized":"2024-09-14T11:38:30.077509+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-14T11:38:30.077386+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-14T11:38:30.077386+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.077386+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:40.158786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.767373+0000","last_change":"2024-09-14T11:38:06.767276+0000","last_active":"2024-09-14T11:38:06.767373+0000","last_peered":"2024-09-14T11:38:06.767373+0000","last_clean":"2024-09-14T11:38:06.767373+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:38:06.767373+0000","last_undegraded":"2024-09-14T11:38:06.767373+0000","last_fullsized":"2024-09-14T11:38:06.767373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'91","last_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_deep_scrub":"264'91","last_deep_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.767184+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:58.705749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'360","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.987699+0000","last_change":"2024-09-14T11:37:58.987699+0000","last_active":"2024-09-14T11:37:58.987699+0000","last_peered":"2024-09-14T11:37:58.987699+0000","last_clean":"2024-09-14T11:37:58.987699+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:37:58.987699+0000","last_undegraded":"2024-09-14T11:37:58.987699+0000","last_fullsized":"2024-09-14T11:37:58.987699+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.987611+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:24.048610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":2982,"num_write":1169,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.911139+0000","last_change":"2024-09-14T11:38:14.911032+0000","last_active":"2024-09-14T11:38:14.911139+0000","last_peered":"2024-09-14T11:38:14.911139+0000","last_clean":"2024-09-14T11:38:14.911139+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:38:14.911139+0000","last_undegraded":"2024-09-14T11:38:14.911139+0000","last_fullsized":"2024-09-14T11:38:14.911139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.910937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:23.836659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'313","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.733467+0000","last_change":"2024-09-14T11:38:21.733467+0000","last_active":"2024-09-14T11:38:21.733467+0000","last_peered":"2024-09-14T11:38:21.733467+0000","last_clean":"2024-09-14T11:38:21.733467+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:38:21.733467+0000","last_undegraded":"2024-09-14T11:38:21.733467+0000","last_fullsized":"2024-09-14T11:38:21.733467+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-14T11:38:21.733349+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-14T11:38:21.733349+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.733349+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:23.471264+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1126,"num_write":414,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.050831+0000","last_change":"2024-09-14T11:38:14.050749+0000","last_active":"2024-09-14T11:38:14.050831+0000","last_peered":"2024-09-14T11:38:14.050831+0000","last_clean":"2024-09-14T11:38:14.050831+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:38:14.050831+0000","last_undegraded":"2024-09-14T11:38:14.050831+0000","last_fullsized":"2024-09-14T11:38:14.050831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.050668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:18.444772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'187","reported_seq":716,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.119616+0000","last_change":"2024-09-14T11:38:30.119616+0000","last_active":"2024-09-14T11:38:30.119616+0000","last_peered":"2024-09-14T11:38:30.119616+0000","last_clean":"2024-09-14T11:38:30.119616+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:38:30.119616+0000","last_undegraded":"2024-09-14T11:38:30.119616+0000","last_fullsized":"2024-09-14T11:38:30.119616+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-14T11:38:30.119513+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-14T11:38:30.119513+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.119513+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:36.864427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.724247+0000","last_change":"2024-09-14T11:38:05.724174+0000","last_active":"2024-09-14T11:38:05.724247+0000","last_peered":"2024-09-14T11:38:05.724247+0000","last_clean":"2024-09-14T11:38:05.724247+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:38:05.724247+0000","last_undegraded":"2024-09-14T11:38:05.724247+0000","last_fullsized":"2024-09-14T11:38:05.724247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.724091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.241278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'326","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.186499+0000","last_change":"2024-09-14T11:37:55.186499+0000","last_active":"2024-09-14T11:37:55.186499+0000","last_peered":"2024-09-14T11:37:55.186499+0000","last_clean":"2024-09-14T11:37:55.186499+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:37:55.186499+0000","last_undegraded":"2024-09-14T11:37:55.186499+0000","last_fullsized":"2024-09-14T11:37:55.186499+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.186430+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:21.808735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":4364,"num_write":956,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.110226+0000","last_change":"2024-09-14T11:38:10.110173+0000","last_active":"2024-09-14T11:38:10.110226+0000","last_peered":"2024-09-14T11:38:10.110226+0000","last_clean":"2024-09-14T11:38:10.110226+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:38:10.110226+0000","last_undegraded":"2024-09-14T11:38:10.110226+0000","last_fullsized":"2024-09-14T11:38:10.110226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.110089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:50.692474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'267","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.900199+0000","last_change":"2024-09-14T11:38:18.900199+0000","last_active":"2024-09-14T11:38:18.900199+0000","last_peered":"2024-09-14T11:38:18.900199+0000","last_clean":"2024-09-14T11:38:18.900199+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:38:18.900199+0000","last_undegraded":"2024-09-14T11:38:18.900199+0000","last_fullsized":"2024-09-14T11:38:18.900199+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-09-14T11:38:18.900110+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-09-14T11:38:18.900110+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.900110+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.833350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":429,"num_read_kb":979,"num_write":348,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.096135+0000","last_change":"2024-09-14T11:38:24.096135+0000","last_active":"2024-09-14T11:38:24.096135+0000","last_peered":"2024-09-14T11:38:24.096135+0000","last_clean":"2024-09-14T11:38:24.096135+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:38:24.096135+0000","last_undegraded":"2024-09-14T11:38:24.096135+0000","last_fullsized":"2024-09-14T11:38:24.096135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.096035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.096035+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.096035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:42.507339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.195176+0000","last_change":"2024-09-14T11:38:05.195176+0000","last_active":"2024-09-14T11:38:05.195176+0000","last_peered":"2024-09-14T11:38:05.195176+0000","last_clean":"2024-09-14T11:38:05.195176+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:38:05.195176+0000","last_undegraded":"2024-09-14T11:38:05.195176+0000","last_fullsized":"2024-09-14T11:38:05.195176+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.195090+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:58.870651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'316","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.760929+0000","last_change":"2024-09-14T11:38:00.760929+0000","last_active":"2024-09-14T11:38:00.760929+0000","last_peered":"2024-09-14T11:38:00.760929+0000","last_clean":"2024-09-14T11:38:00.760929+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:38:00.760929+0000","last_undegraded":"2024-09-14T11:38:00.760929+0000","last_fullsized":"2024-09-14T11:38:00.760929+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.760838+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.394615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":11665,"num_write":969,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.137854+0000","last_change":"2024-09-14T11:38:11.137775+0000","last_active":"2024-09-14T11:38:11.137854+0000","last_peered":"2024-09-14T11:38:11.137854+0000","last_clean":"2024-09-14T11:38:11.137854+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:38:11.137854+0000","last_undegraded":"2024-09-14T11:38:11.137854+0000","last_fullsized":"2024-09-14T11:38:11.137854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.137678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:29.267416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'484","reported_seq":1115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.562171+0000","last_change":"2024-09-14T11:38:13.562171+0000","last_active":"2024-09-14T11:38:13.562171+0000","last_peered":"2024-09-14T11:38:13.562171+0000","last_clean":"2024-09-14T11:38:13.562171+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:38:13.562171+0000","last_undegraded":"2024-09-14T11:38:13.562171+0000","last_fullsized":"2024-09-14T11:38:13.562171+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'484","last_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_deep_scrub":"264'484","last_deep_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.562082+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.434257+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192423,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":855,"num_read_kb":2213,"num_write":738,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.908074+0000","last_change":"2024-09-14T11:38:23.908074+0000","last_active":"2024-09-14T11:38:23.908074+0000","last_peered":"2024-09-14T11:38:23.908074+0000","last_clean":"2024-09-14T11:38:23.908074+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:38:23.908074+0000","last_undegraded":"2024-09-14T11:38:23.908074+0000","last_fullsized":"2024-09-14T11:38:23.908074+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.907981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.907981+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.907981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:03.109857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'183","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.734803+0000","last_change":"2024-09-14T11:38:33.734803+0000","last_active":"2024-09-14T11:38:33.734803+0000","last_peered":"2024-09-14T11:38:33.734803+0000","last_clean":"2024-09-14T11:38:33.734803+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:38:33.734803+0000","last_undegraded":"2024-09-14T11:38:33.734803+0000","last_fullsized":"2024-09-14T11:38:33.734803+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-09-14T11:38:33.734705+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-09-14T11:38:33.734705+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.734705+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:04.775181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.178795+0000","last_change":"2024-09-14T11:38:08.178711+0000","last_active":"2024-09-14T11:38:08.178795+0000","last_peered":"2024-09-14T11:38:08.178795+0000","last_clean":"2024-09-14T11:38:08.178795+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:38:08.178795+0000","last_undegraded":"2024-09-14T11:38:08.178795+0000","last_fullsized":"2024-09-14T11:38:08.178795+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.178627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:19.038119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'332","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.496892+0000","last_change":"2024-09-14T11:37:56.496892+0000","last_active":"2024-09-14T11:37:56.496892+0000","last_peered":"2024-09-14T11:37:56.496892+0000","last_clean":"2024-09-14T11:37:56.496892+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:56.496892+0000","last_undegraded":"2024-09-14T11:37:56.496892+0000","last_fullsized":"2024-09-14T11:37:56.496892+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.496799+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.399160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":3066,"num_write":996,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.126049+0000","last_change":"2024-09-14T11:38:09.126049+0000","last_active":"2024-09-14T11:38:09.126049+0000","last_peered":"2024-09-14T11:38:09.126049+0000","last_clean":"2024-09-14T11:38:09.126049+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:38:09.126049+0000","last_undegraded":"2024-09-14T11:38:09.126049+0000","last_fullsized":"2024-09-14T11:38:09.126049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.125953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:41.468504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'344","reported_seq":925,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.890980+0000","last_change":"2024-09-14T11:38:21.890980+0000","last_active":"2024-09-14T11:38:21.890980+0000","last_peered":"2024-09-14T11:38:21.890980+0000","last_clean":"2024-09-14T11:38:21.890980+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:38:21.890980+0000","last_undegraded":"2024-09-14T11:38:21.890980+0000","last_fullsized":"2024-09-14T11:38:21.890980+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-14T11:38:21.890811+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-14T11:38:21.890811+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.890811+0000","objects_scrubbed":8,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:01.928184+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":556,"num_read_kb":1258,"num_write":472,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.519873+0000","last_change":"2024-09-14T11:38:15.519873+0000","last_active":"2024-09-14T11:38:15.519873+0000","last_peered":"2024-09-14T11:38:15.519873+0000","last_clean":"2024-09-14T11:38:15.519873+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:38:15.519873+0000","last_undegraded":"2024-09-14T11:38:15.519873+0000","last_fullsized":"2024-09-14T11:38:15.519873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.519778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.519778+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.519778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:56.547275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'171","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.115873+0000","last_change":"2024-09-14T11:38:18.115813+0000","last_active":"2024-09-14T11:38:18.115873+0000","last_peered":"2024-09-14T11:38:18.115873+0000","last_clean":"2024-09-14T11:38:18.115873+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:38:18.115873+0000","last_undegraded":"2024-09-14T11:38:18.115873+0000","last_fullsized":"2024-09-14T11:38:18.115873+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-14T11:38:18.115725+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-14T11:38:18.115725+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.115725+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:16.833713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.796324+0000","last_change":"2024-09-14T11:38:10.796324+0000","last_active":"2024-09-14T11:38:10.796324+0000","last_peered":"2024-09-14T11:38:10.796324+0000","last_clean":"2024-09-14T11:38:10.796324+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:38:10.796324+0000","last_undegraded":"2024-09-14T11:38:10.796324+0000","last_fullsized":"2024-09-14T11:38:10.796324+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.796238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:26.034543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'368","reported_seq":1030,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.770978+0000","last_change":"2024-09-14T11:37:56.770978+0000","last_active":"2024-09-14T11:37:56.770978+0000","last_peered":"2024-09-14T11:37:56.770978+0000","last_clean":"2024-09-14T11:37:56.770978+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:37:56.770978+0000","last_undegraded":"2024-09-14T11:37:56.770978+0000","last_fullsized":"2024-09-14T11:37:56.770978+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.770888+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:59.783985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":69620,"num_write":1137,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.797145+0000","last_change":"2024-09-14T11:38:21.797145+0000","last_active":"2024-09-14T11:38:21.797145+0000","last_peered":"2024-09-14T11:38:21.797145+0000","last_clean":"2024-09-14T11:38:21.797145+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:38:21.797145+0000","last_undegraded":"2024-09-14T11:38:21.797145+0000","last_fullsized":"2024-09-14T11:38:21.797145+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:21.797056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:21.797056+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.797056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:56.877813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'275","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.689762+0000","last_change":"2024-09-14T11:38:24.689762+0000","last_active":"2024-09-14T11:38:24.689762+0000","last_peered":"2024-09-14T11:38:24.689762+0000","last_clean":"2024-09-14T11:38:24.689762+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:38:24.689762+0000","last_undegraded":"2024-09-14T11:38:24.689762+0000","last_fullsized":"2024-09-14T11:38:24.689762+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-09-14T11:38:24.689662+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-09-14T11:38:24.689662+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.689662+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:08.180187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52342,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1065,"num_write":374,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.512524+0000","last_change":"2024-09-14T11:38:16.512466+0000","last_active":"2024-09-14T11:38:16.512524+0000","last_peered":"2024-09-14T11:38:16.512524+0000","last_clean":"2024-09-14T11:38:16.512524+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:38:16.512524+0000","last_undegraded":"2024-09-14T11:38:16.512524+0000","last_fullsized":"2024-09-14T11:38:16.512524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:16.512384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:16.512384+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.512384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:10.329231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.034832+0000","last_change":"2024-09-14T11:38:28.034832+0000","last_active":"2024-09-14T11:38:28.034832+0000","last_peered":"2024-09-14T11:38:28.034832+0000","last_clean":"2024-09-14T11:38:28.034832+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:38:28.034832+0000","last_undegraded":"2024-09-14T11:38:28.034832+0000","last_fullsized":"2024-09-14T11:38:28.034832+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-14T11:38:28.034726+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-14T11:38:28.034726+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.034726+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:08.711735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":579,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.346691+0000","last_change":"2024-09-14T11:38:00.346691+0000","last_active":"2024-09-14T11:38:00.346691+0000","last_peered":"2024-09-14T11:38:00.346691+0000","last_clean":"2024-09-14T11:38:00.346691+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:38:00.346691+0000","last_undegraded":"2024-09-14T11:38:00.346691+0000","last_fullsized":"2024-09-14T11:38:00.346691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.346611+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.401615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'352","reported_seq":1010,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.200197+0000","last_change":"2024-09-14T11:37:57.200197+0000","last_active":"2024-09-14T11:37:57.200197+0000","last_peered":"2024-09-14T11:37:57.200197+0000","last_clean":"2024-09-14T11:37:57.200197+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:37:57.200197+0000","last_undegraded":"2024-09-14T11:37:57.200197+0000","last_fullsized":"2024-09-14T11:37:57.200197+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.200097+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:27.049496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":33947,"num_write":1155,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.530630+0000","last_change":"2024-09-14T11:38:10.530630+0000","last_active":"2024-09-14T11:38:10.530630+0000","last_peered":"2024-09-14T11:38:10.530630+0000","last_clean":"2024-09-14T11:38:10.530630+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:38:10.530630+0000","last_undegraded":"2024-09-14T11:38:10.530630+0000","last_fullsized":"2024-09-14T11:38:10.530630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.530538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:40.837743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'103","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.747782+0000","last_change":"2024-09-14T11:38:23.747782+0000","last_active":"2024-09-14T11:38:23.747782+0000","last_peered":"2024-09-14T11:38:23.747782+0000","last_clean":"2024-09-14T11:38:23.747782+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:38:23.747782+0000","last_undegraded":"2024-09-14T11:38:23.747782+0000","last_fullsized":"2024-09-14T11:38:23.747782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-14T11:38:23.747694+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-14T11:38:23.747694+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.747694+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:33.487506+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'754","reported_seq":4586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.050848+0000","last_change":"2024-09-14T11:38:16.050848+0000","last_active":"2024-09-14T11:38:16.050848+0000","last_peered":"2024-09-14T11:38:16.050848+0000","last_clean":"2024-09-14T11:38:16.050848+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:38:16.050848+0000","last_undegraded":"2024-09-14T11:38:16.050848+0000","last_fullsized":"2024-09-14T11:38:16.050848+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'754","last_scrub_stamp":"2024-09-14T11:38:16.050755+0000","last_deep_scrub":"264'754","last_deep_scrub_stamp":"2024-09-14T11:38:16.050755+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.050755+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:51.960047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'127","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.874483+0000","last_change":"2024-09-14T11:38:26.874483+0000","last_active":"2024-09-14T11:38:26.874483+0000","last_peered":"2024-09-14T11:38:26.874483+0000","last_clean":"2024-09-14T11:38:26.874483+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:38:26.874483+0000","last_undegraded":"2024-09-14T11:38:26.874483+0000","last_fullsized":"2024-09-14T11:38:26.874483+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:38:26.874398+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:38:26.874398+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.874398+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:31.390672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.896311+0000","last_change":"2024-09-14T11:38:07.896311+0000","last_active":"2024-09-14T11:38:07.896311+0000","last_peered":"2024-09-14T11:38:07.896311+0000","last_clean":"2024-09-14T11:38:07.896311+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:38:07.896311+0000","last_undegraded":"2024-09-14T11:38:07.896311+0000","last_fullsized":"2024-09-14T11:38:07.896311+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.896225+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:30.027652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'357","reported_seq":1041,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.971599+0000","last_change":"2024-09-14T11:37:59.971599+0000","last_active":"2024-09-14T11:37:59.971599+0000","last_peered":"2024-09-14T11:37:59.971599+0000","last_clean":"2024-09-14T11:37:59.971599+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:37:59.971599+0000","last_undegraded":"2024-09-14T11:37:59.971599+0000","last_fullsized":"2024-09-14T11:37:59.971599+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.971497+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:22.835652+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":780,"num_read_kb":7716,"num_write":1096,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.899729+0000","last_change":"2024-09-14T11:38:15.899729+0000","last_active":"2024-09-14T11:38:15.899729+0000","last_peered":"2024-09-14T11:38:15.899729+0000","last_clean":"2024-09-14T11:38:15.899729+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:38:15.899729+0000","last_undegraded":"2024-09-14T11:38:15.899729+0000","last_fullsized":"2024-09-14T11:38:15.899729+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.899639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.899639+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.899639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:54.243126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'329","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.906798+0000","last_change":"2024-09-14T11:38:21.906798+0000","last_active":"2024-09-14T11:38:21.906798+0000","last_peered":"2024-09-14T11:38:21.906798+0000","last_clean":"2024-09-14T11:38:21.906798+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:38:21.906798+0000","last_undegraded":"2024-09-14T11:38:21.906798+0000","last_fullsized":"2024-09-14T11:38:21.906798+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-14T11:38:21.906690+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-14T11:38:21.906690+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.906690+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.598087+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1178,"num_write":428,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.128390+0000","last_change":"2024-09-14T11:38:23.128390+0000","last_active":"2024-09-14T11:38:23.128390+0000","last_peered":"2024-09-14T11:38:23.128390+0000","last_clean":"2024-09-14T11:38:23.128390+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:38:23.128390+0000","last_undegraded":"2024-09-14T11:38:23.128390+0000","last_fullsized":"2024-09-14T11:38:23.128390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.128297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.128297+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.128297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:06.906757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.878297+0000","last_change":"2024-09-14T11:38:27.878297+0000","last_active":"2024-09-14T11:38:27.878297+0000","last_peered":"2024-09-14T11:38:27.878297+0000","last_clean":"2024-09-14T11:38:27.878297+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:38:27.878297+0000","last_undegraded":"2024-09-14T11:38:27.878297+0000","last_fullsized":"2024-09-14T11:38:27.878297+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:38:27.878181+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:38:27.878181+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.878181+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:51.588624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.879515+0000","last_change":"2024-09-14T11:38:06.879515+0000","last_active":"2024-09-14T11:38:06.879515+0000","last_peered":"2024-09-14T11:38:06.879515+0000","last_clean":"2024-09-14T11:38:06.879515+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:38:06.879515+0000","last_undegraded":"2024-09-14T11:38:06.879515+0000","last_fullsized":"2024-09-14T11:38:06.879515+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.879391+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:16.629096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'333","reported_seq":940,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.959619+0000","last_change":"2024-09-14T11:38:00.959619+0000","last_active":"2024-09-14T11:38:00.959619+0000","last_peered":"2024-09-14T11:38:00.959619+0000","last_clean":"2024-09-14T11:38:00.959619+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:38:00.959619+0000","last_undegraded":"2024-09-14T11:38:00.959619+0000","last_fullsized":"2024-09-14T11:38:00.959619+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.959518+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:02.829306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":36817,"num_write":973,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.885564+0000","last_change":"2024-09-14T11:38:17.885564+0000","last_active":"2024-09-14T11:38:17.885564+0000","last_peered":"2024-09-14T11:38:17.885564+0000","last_clean":"2024-09-14T11:38:17.885564+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:38:17.885564+0000","last_undegraded":"2024-09-14T11:38:17.885564+0000","last_fullsized":"2024-09-14T11:38:17.885564+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.885473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.885473+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.885473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:55.102829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'287","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.011793+0000","last_change":"2024-09-14T11:38:18.011793+0000","last_active":"2024-09-14T11:38:18.011793+0000","last_peered":"2024-09-14T11:38:18.011793+0000","last_clean":"2024-09-14T11:38:18.011793+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:38:18.011793+0000","last_undegraded":"2024-09-14T11:38:18.011793+0000","last_fullsized":"2024-09-14T11:38:18.011793+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'287","last_scrub_stamp":"2024-09-14T11:38:18.011686+0000","last_deep_scrub":"264'287","last_deep_scrub_stamp":"2024-09-14T11:38:18.011686+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.011686+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:06.174741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43010,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":1018,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.031252+0000","last_change":"2024-09-14T11:38:15.031252+0000","last_active":"2024-09-14T11:38:15.031252+0000","last_peered":"2024-09-14T11:38:15.031252+0000","last_clean":"2024-09-14T11:38:15.031252+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:38:15.031252+0000","last_undegraded":"2024-09-14T11:38:15.031252+0000","last_fullsized":"2024-09-14T11:38:15.031252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.031165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.031165+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.031165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:41.916463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'152","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.744575+0000","last_change":"2024-09-14T11:38:34.744575+0000","last_active":"2024-09-14T11:38:34.744575+0000","last_peered":"2024-09-14T11:38:34.744575+0000","last_clean":"2024-09-14T11:38:34.744575+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:38:34.744575+0000","last_undegraded":"2024-09-14T11:38:34.744575+0000","last_fullsized":"2024-09-14T11:38:34.744575+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:34.744484+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:34.744484+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.744484+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:53.145434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'126","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.808000+0000","last_change":"2024-09-14T11:38:09.808000+0000","last_active":"2024-09-14T11:38:09.808000+0000","last_peered":"2024-09-14T11:38:09.808000+0000","last_clean":"2024-09-14T11:38:09.808000+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:38:09.808000+0000","last_undegraded":"2024-09-14T11:38:09.808000+0000","last_fullsized":"2024-09-14T11:38:09.808000+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.807913+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:08.263690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'378","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.769777+0000","last_change":"2024-09-14T11:37:57.769714+0000","last_active":"2024-09-14T11:37:57.769777+0000","last_peered":"2024-09-14T11:37:57.769777+0000","last_clean":"2024-09-14T11:37:57.769777+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:37:57.769777+0000","last_undegraded":"2024-09-14T11:37:57.769777+0000","last_fullsized":"2024-09-14T11:37:57.769777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.769590+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:11.879615+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":618,"num_read_kb":16528,"num_write":1305,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.673206+0000","last_change":"2024-09-14T11:38:17.673206+0000","last_active":"2024-09-14T11:38:17.673206+0000","last_peered":"2024-09-14T11:38:17.673206+0000","last_clean":"2024-09-14T11:38:17.673206+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:38:17.673206+0000","last_undegraded":"2024-09-14T11:38:17.673206+0000","last_fullsized":"2024-09-14T11:38:17.673206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.673119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.673119+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.673119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:17.992154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'272","reported_seq":829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.730319+0000","last_change":"2024-09-14T11:38:23.730319+0000","last_active":"2024-09-14T11:38:23.730319+0000","last_peered":"2024-09-14T11:38:23.730319+0000","last_clean":"2024-09-14T11:38:23.730319+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:38:23.730319+0000","last_undegraded":"2024-09-14T11:38:23.730319+0000","last_fullsized":"2024-09-14T11:38:23.730319+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-14T11:38:23.730218+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-14T11:38:23.730218+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.730218+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:17.916005+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51357,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":1141,"num_write":384,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.765314+0000","last_change":"2024-09-14T11:38:26.765314+0000","last_active":"2024-09-14T11:38:26.765314+0000","last_peered":"2024-09-14T11:38:26.765314+0000","last_clean":"2024-09-14T11:38:26.765314+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:38:26.765314+0000","last_undegraded":"2024-09-14T11:38:26.765314+0000","last_fullsized":"2024-09-14T11:38:26.765314+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.765225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.765225+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.765225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:39.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'179","reported_seq":1647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.920451+0000","last_change":"2024-09-14T11:38:28.920451+0000","last_active":"2024-09-14T11:38:28.920451+0000","last_peered":"2024-09-14T11:38:28.920451+0000","last_clean":"2024-09-14T11:38:28.920451+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:38:28.920451+0000","last_undegraded":"2024-09-14T11:38:28.920451+0000","last_fullsized":"2024-09-14T11:38:28.920451+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:38:28.920367+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:38:28.920367+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.920367+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:21.692826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.844285+0000","last_change":"2024-09-14T11:38:05.844285+0000","last_active":"2024-09-14T11:38:05.844285+0000","last_peered":"2024-09-14T11:38:05.844285+0000","last_clean":"2024-09-14T11:38:05.844285+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:38:05.844285+0000","last_undegraded":"2024-09-14T11:38:05.844285+0000","last_fullsized":"2024-09-14T11:38:05.844285+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.844184+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:14.327154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'362","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.193415+0000","last_change":"2024-09-14T11:37:56.193415+0000","last_active":"2024-09-14T11:37:56.193415+0000","last_peered":"2024-09-14T11:37:56.193415+0000","last_clean":"2024-09-14T11:37:56.193415+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:37:56.193415+0000","last_undegraded":"2024-09-14T11:37:56.193415+0000","last_fullsized":"2024-09-14T11:37:56.193415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.193342+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:11.215563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":662,"num_read_kb":13580,"num_write":1124,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.513158+0000","last_change":"2024-09-14T11:38:09.513158+0000","last_active":"2024-09-14T11:38:09.513158+0000","last_peered":"2024-09-14T11:38:09.513158+0000","last_clean":"2024-09-14T11:38:09.513158+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:38:09.513158+0000","last_undegraded":"2024-09-14T11:38:09.513158+0000","last_fullsized":"2024-09-14T11:38:09.513158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.513031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:35.439168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'285","reported_seq":877,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.752499+0000","last_change":"2024-09-14T11:38:20.752499+0000","last_active":"2024-09-14T11:38:20.752499+0000","last_peered":"2024-09-14T11:38:20.752499+0000","last_clean":"2024-09-14T11:38:20.752499+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:38:20.752499+0000","last_undegraded":"2024-09-14T11:38:20.752499+0000","last_fullsized":"2024-09-14T11:38:20.752499+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-09-14T11:38:20.752317+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-09-14T11:38:20.752317+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.752317+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:45.897103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":1053,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.123597+0000","last_change":"2024-09-14T11:38:25.123597+0000","last_active":"2024-09-14T11:38:25.123597+0000","last_peered":"2024-09-14T11:38:25.123597+0000","last_clean":"2024-09-14T11:38:25.123597+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:38:25.123597+0000","last_undegraded":"2024-09-14T11:38:25.123597+0000","last_fullsized":"2024-09-14T11:38:25.123597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.123477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.123477+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.123477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:05.503469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.754713+0000","last_change":"2024-09-14T11:38:28.754713+0000","last_active":"2024-09-14T11:38:28.754713+0000","last_peered":"2024-09-14T11:38:28.754713+0000","last_clean":"2024-09-14T11:38:28.754713+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:38:28.754713+0000","last_undegraded":"2024-09-14T11:38:28.754713+0000","last_fullsized":"2024-09-14T11:38:28.754713+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-09-14T11:38:28.754621+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-09-14T11:38:28.754621+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.754621+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:57.271998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.549238+0000","last_change":"2024-09-14T11:38:05.549238+0000","last_active":"2024-09-14T11:38:05.549238+0000","last_peered":"2024-09-14T11:38:05.549238+0000","last_clean":"2024-09-14T11:38:05.549238+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:38:05.549238+0000","last_undegraded":"2024-09-14T11:38:05.549238+0000","last_fullsized":"2024-09-14T11:38:05.549238+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.549130+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:53.773608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'381","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.243905+0000","last_change":"2024-09-14T11:38:00.243905+0000","last_active":"2024-09-14T11:38:00.243905+0000","last_peered":"2024-09-14T11:38:00.243905+0000","last_clean":"2024-09-14T11:38:00.243905+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:38:00.243905+0000","last_undegraded":"2024-09-14T11:38:00.243905+0000","last_fullsized":"2024-09-14T11:38:00.243905+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.243785+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:58.476866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":8663,"num_write":1069,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.481794+0000","last_change":"2024-09-14T11:38:07.481794+0000","last_active":"2024-09-14T11:38:07.481794+0000","last_peered":"2024-09-14T11:38:07.481794+0000","last_clean":"2024-09-14T11:38:07.481794+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:38:07.481794+0000","last_undegraded":"2024-09-14T11:38:07.481794+0000","last_fullsized":"2024-09-14T11:38:07.481794+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.481689+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.494813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'448","reported_seq":1120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.257837+0000","last_change":"2024-09-14T11:37:54.257837+0000","last_active":"2024-09-14T11:37:54.257837+0000","last_peered":"2024-09-14T11:37:54.257837+0000","last_clean":"2024-09-14T11:37:54.257837+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:37:54.257837+0000","last_undegraded":"2024-09-14T11:37:54.257837+0000","last_fullsized":"2024-09-14T11:37:54.257837+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'448","last_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_deep_scrub":"264'448","last_deep_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.257768+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:31.063923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":16320,"num_write":1497,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.006241+0000","last_change":"2024-09-14T11:38:09.006241+0000","last_active":"2024-09-14T11:38:09.006241+0000","last_peered":"2024-09-14T11:38:09.006241+0000","last_clean":"2024-09-14T11:38:09.006241+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:38:09.006241+0000","last_undegraded":"2024-09-14T11:38:09.006241+0000","last_fullsized":"2024-09-14T11:38:09.006241+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.006154+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'302","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.929061+0000","last_change":"2024-09-14T11:38:01.929061+0000","last_active":"2024-09-14T11:38:01.929061+0000","last_peered":"2024-09-14T11:38:01.929061+0000","last_clean":"2024-09-14T11:38:01.929061+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:38:01.929061+0000","last_undegraded":"2024-09-14T11:38:01.929061+0000","last_fullsized":"2024-09-14T11:38:01.929061+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.928975+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:06.365261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":2695,"num_write":898,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.499069+0000","last_change":"2024-09-14T11:38:04.499069+0000","last_active":"2024-09-14T11:38:04.499069+0000","last_peered":"2024-09-14T11:38:04.499069+0000","last_clean":"2024-09-14T11:38:04.499069+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:38:04.499069+0000","last_undegraded":"2024-09-14T11:38:04.499069+0000","last_fullsized":"2024-09-14T11:38:04.499069+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.498989+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.862258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'356","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.167523+0000","last_change":"2024-09-14T11:37:58.167440+0000","last_active":"2024-09-14T11:37:58.167523+0000","last_peered":"2024-09-14T11:37:58.167523+0000","last_clean":"2024-09-14T11:37:58.167523+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:37:58.167523+0000","last_undegraded":"2024-09-14T11:37:58.167523+0000","last_fullsized":"2024-09-14T11:37:58.167523+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.167277+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.933166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":27796,"num_write":1160,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.787252+0000","last_change":"2024-09-14T11:38:12.787252+0000","last_active":"2024-09-14T11:38:12.787252+0000","last_peered":"2024-09-14T11:38:12.787252+0000","last_clean":"2024-09-14T11:38:12.787252+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:38:12.787252+0000","last_undegraded":"2024-09-14T11:38:12.787252+0000","last_fullsized":"2024-09-14T11:38:12.787252+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4160","last_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_deep_scrub":"264'4160","last_deep_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.787148+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:55.106908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'442","reported_seq":1223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.746470+0000","last_change":"2024-09-14T11:37:59.746470+0000","last_active":"2024-09-14T11:37:59.746470+0000","last_peered":"2024-09-14T11:37:59.746470+0000","last_clean":"2024-09-14T11:37:59.746470+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:37:59.746470+0000","last_undegraded":"2024-09-14T11:37:59.746470+0000","last_fullsized":"2024-09-14T11:37:59.746470+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'442","last_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_deep_scrub":"264'442","last_deep_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.746338+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:48.240361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1409,"num_read_kb":14785,"num_write":1267,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.908101+0000","last_change":"2024-09-14T11:38:08.908101+0000","last_active":"2024-09-14T11:38:08.908101+0000","last_peered":"2024-09-14T11:38:08.908101+0000","last_clean":"2024-09-14T11:38:08.908101+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:38:08.908101+0000","last_undegraded":"2024-09-14T11:38:08.908101+0000","last_fullsized":"2024-09-14T11:38:08.908101+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.908006+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:32.288213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'423","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.528878+0000","last_change":"2024-09-14T11:37:57.528878+0000","last_active":"2024-09-14T11:37:57.528878+0000","last_peered":"2024-09-14T11:37:57.528878+0000","last_clean":"2024-09-14T11:37:57.528878+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:37:57.528878+0000","last_undegraded":"2024-09-14T11:37:57.528878+0000","last_fullsized":"2024-09-14T11:37:57.528878+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.528772+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:11.066498+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":745,"num_read_kb":54735,"num_write":1248,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.754421+0000","last_change":"2024-09-14T11:38:11.754421+0000","last_active":"2024-09-14T11:38:11.754421+0000","last_peered":"2024-09-14T11:38:11.754421+0000","last_clean":"2024-09-14T11:38:11.754421+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:38:11.754421+0000","last_undegraded":"2024-09-14T11:38:11.754421+0000","last_fullsized":"2024-09-14T11:38:11.754421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'75","last_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_deep_scrub":"264'75","last_deep_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.754322+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:33.771510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'428","reported_seq":1211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.248925+0000","last_change":"2024-09-14T11:37:58.248925+0000","last_active":"2024-09-14T11:37:58.248925+0000","last_peered":"2024-09-14T11:37:58.248925+0000","last_clean":"2024-09-14T11:37:58.248925+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:37:58.248925+0000","last_undegraded":"2024-09-14T11:37:58.248925+0000","last_fullsized":"2024-09-14T11:37:58.248925+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.248799+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:09.244000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1142,"num_read_kb":46426,"num_write":1473,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'303","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.161512+0000","last_change":"2024-09-14T11:38:08.161512+0000","last_active":"2024-09-14T11:38:08.161512+0000","last_peered":"2024-09-14T11:38:08.161512+0000","last_clean":"2024-09-14T11:38:08.161512+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:38:08.161512+0000","last_undegraded":"2024-09-14T11:38:08.161512+0000","last_fullsized":"2024-09-14T11:38:08.161512+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.161420+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:54.808745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'323","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.727550+0000","last_change":"2024-09-14T11:37:58.727550+0000","last_active":"2024-09-14T11:37:58.727550+0000","last_peered":"2024-09-14T11:37:58.727550+0000","last_clean":"2024-09-14T11:37:58.727550+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:37:58.727550+0000","last_undegraded":"2024-09-14T11:37:58.727550+0000","last_fullsized":"2024-09-14T11:37:58.727550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.727456+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:23.797636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":5718,"num_write":986,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.210936+0000","last_change":"2024-09-14T11:38:07.210816+0000","last_active":"2024-09-14T11:38:07.210936+0000","last_peered":"2024-09-14T11:38:07.210936+0000","last_clean":"2024-09-14T11:38:07.210936+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:38:07.210936+0000","last_undegraded":"2024-09-14T11:38:07.210936+0000","last_fullsized":"2024-09-14T11:38:07.210936+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.210704+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:06.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'377","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.911007+0000","last_change":"2024-09-14T11:38:02.911007+0000","last_active":"2024-09-14T11:38:02.911007+0000","last_peered":"2024-09-14T11:38:02.911007+0000","last_clean":"2024-09-14T11:38:02.911007+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:38:02.911007+0000","last_undegraded":"2024-09-14T11:38:02.911007+0000","last_fullsized":"2024-09-14T11:38:02.911007+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.910912+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:21.469889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":8094,"num_write":1138,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.884396+0000","last_change":"2024-09-14T11:38:09.884320+0000","last_active":"2024-09-14T11:38:09.884396+0000","last_peered":"2024-09-14T11:38:09.884396+0000","last_clean":"2024-09-14T11:38:09.884396+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:38:09.884396+0000","last_undegraded":"2024-09-14T11:38:09.884396+0000","last_fullsized":"2024-09-14T11:38:09.884396+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.884229+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:38.099864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'368","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.724263+0000","last_change":"2024-09-14T11:38:01.724263+0000","last_active":"2024-09-14T11:38:01.724263+0000","last_peered":"2024-09-14T11:38:01.724263+0000","last_clean":"2024-09-14T11:38:01.724263+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:38:01.724263+0000","last_undegraded":"2024-09-14T11:38:01.724263+0000","last_fullsized":"2024-09-14T11:38:01.724263+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.724153+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.764518+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1962460,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":52898,"num_write":1154,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.305061+0000","last_change":"2024-09-14T11:38:01.305061+0000","last_active":"2024-09-14T11:38:01.305061+0000","last_peered":"2024-09-14T11:38:01.305061+0000","last_clean":"2024-09-14T11:38:01.305061+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:38:01.305061+0000","last_undegraded":"2024-09-14T11:38:01.305061+0000","last_fullsized":"2024-09-14T11:38:01.305061+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.304953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:28.747455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'368","reported_seq":1242,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.974983+0000","last_change":"2024-09-14T11:38:06.974983+0000","last_active":"2024-09-14T11:38:06.974983+0000","last_peered":"2024-09-14T11:38:06.974983+0000","last_clean":"2024-09-14T11:38:06.974983+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:38:06.974983+0000","last_undegraded":"2024-09-14T11:38:06.974983+0000","last_fullsized":"2024-09-14T11:38:06.974983+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.974873+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:16.281919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":34715,"num_write":1227,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'92","reported_seq":691,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.842850+0000","last_change":"2024-09-14T11:38:11.842850+0000","last_active":"2024-09-14T11:38:11.842850+0000","last_peered":"2024-09-14T11:38:11.842850+0000","last_clean":"2024-09-14T11:38:11.842850+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:38:11.842850+0000","last_undegraded":"2024-09-14T11:38:11.842850+0000","last_fullsized":"2024-09-14T11:38:11.842850+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.842773+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:45.306750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.126563+0000","last_change":"2024-09-14T11:37:59.126563+0000","last_active":"2024-09-14T11:37:59.126563+0000","last_peered":"2024-09-14T11:37:59.126563+0000","last_clean":"2024-09-14T11:37:59.126563+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:37:59.126563+0000","last_undegraded":"2024-09-14T11:37:59.126563+0000","last_fullsized":"2024-09-14T11:37:59.126563+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.126454+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:37.405483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":11879,"num_write":1239,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":896,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.016899+0000","last_change":"2024-09-14T11:38:10.016899+0000","last_active":"2024-09-14T11:38:10.016899+0000","last_peered":"2024-09-14T11:38:10.016899+0000","last_clean":"2024-09-14T11:38:10.016899+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:38:10.016899+0000","last_undegraded":"2024-09-14T11:38:10.016899+0000","last_fullsized":"2024-09-14T11:38:10.016899+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'280","last_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_deep_scrub":"264'280","last_deep_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.016803+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:19.537700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'406","reported_seq":1153,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.277763+0000","last_change":"2024-09-14T11:37:59.277763+0000","last_active":"2024-09-14T11:37:59.277763+0000","last_peered":"2024-09-14T11:37:59.277763+0000","last_clean":"2024-09-14T11:37:59.277763+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:37:59.277763+0000","last_undegraded":"2024-09-14T11:37:59.277763+0000","last_fullsized":"2024-09-14T11:37:59.277763+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.277645+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:27.504525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":733,"num_read_kb":26249,"num_write":1207,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.135737+0000","last_change":"2024-09-14T11:38:05.135737+0000","last_active":"2024-09-14T11:38:05.135737+0000","last_peered":"2024-09-14T11:38:05.135737+0000","last_clean":"2024-09-14T11:38:05.135737+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:38:05.135737+0000","last_undegraded":"2024-09-14T11:38:05.135737+0000","last_fullsized":"2024-09-14T11:38:05.135737+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.135630+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:24.161099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'368","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.002948+0000","last_change":"2024-09-14T11:38:09.002948+0000","last_active":"2024-09-14T11:38:09.002948+0000","last_peered":"2024-09-14T11:38:09.002948+0000","last_clean":"2024-09-14T11:38:09.002948+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:38:09.002948+0000","last_undegraded":"2024-09-14T11:38:09.002948+0000","last_fullsized":"2024-09-14T11:38:09.002948+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.002842+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.692925+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":666,"num_read_kb":46769,"num_write":1234,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.797439+0000","last_change":"2024-09-14T11:38:13.797439+0000","last_active":"2024-09-14T11:38:13.797439+0000","last_peered":"2024-09-14T11:38:13.797439+0000","last_clean":"2024-09-14T11:38:13.797439+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:38:13.797439+0000","last_undegraded":"2024-09-14T11:38:13.797439+0000","last_fullsized":"2024-09-14T11:38:13.797439+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.797343+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:13.340408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'368","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.257810+0000","last_change":"2024-09-14T11:37:55.257698+0000","last_active":"2024-09-14T11:37:55.257810+0000","last_peered":"2024-09-14T11:37:55.257810+0000","last_clean":"2024-09-14T11:37:55.257810+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:37:55.257810+0000","last_undegraded":"2024-09-14T11:37:55.257810+0000","last_fullsized":"2024-09-14T11:37:55.257810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.257597+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:19.080090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":4323,"num_write":1184,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.980463+0000","last_change":"2024-09-14T11:38:06.980463+0000","last_active":"2024-09-14T11:38:06.980463+0000","last_peered":"2024-09-14T11:38:06.980463+0000","last_clean":"2024-09-14T11:38:06.980463+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:38:06.980463+0000","last_undegraded":"2024-09-14T11:38:06.980463+0000","last_fullsized":"2024-09-14T11:38:06.980463+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'431","last_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_deep_scrub":"264'431","last_deep_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.980372+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:22.678230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.931945+0000","last_change":"2024-09-14T11:38:03.931886+0000","last_active":"2024-09-14T11:38:03.931945+0000","last_peered":"2024-09-14T11:38:03.931945+0000","last_clean":"2024-09-14T11:38:03.931945+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:38:03.931945+0000","last_undegraded":"2024-09-14T11:38:03.931945+0000","last_fullsized":"2024-09-14T11:38:03.931945+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.931780+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:42.380009+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655902,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":2905,"num_write":1051,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'366","reported_seq":990,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.253747+0000","last_change":"2024-09-14T11:37:56.253747+0000","last_active":"2024-09-14T11:37:56.253747+0000","last_peered":"2024-09-14T11:37:56.253747+0000","last_clean":"2024-09-14T11:37:56.253747+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:37:56.253747+0000","last_undegraded":"2024-09-14T11:37:56.253747+0000","last_fullsized":"2024-09-14T11:37:56.253747+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.253643+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:41.679508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":610,"num_read_kb":51615,"num_write":1215,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.160953+0000","last_change":"2024-09-14T11:38:10.160953+0000","last_active":"2024-09-14T11:38:10.160953+0000","last_peered":"2024-09-14T11:38:10.160953+0000","last_clean":"2024-09-14T11:38:10.160953+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:38:10.160953+0000","last_undegraded":"2024-09-14T11:38:10.160953+0000","last_fullsized":"2024-09-14T11:38:10.160953+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.160870+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:30.132911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'349","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.545383+0000","last_change":"2024-09-14T11:37:58.545303+0000","last_active":"2024-09-14T11:37:58.545383+0000","last_peered":"2024-09-14T11:37:58.545383+0000","last_clean":"2024-09-14T11:37:58.545383+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:37:58.545383+0000","last_undegraded":"2024-09-14T11:37:58.545383+0000","last_fullsized":"2024-09-14T11:37:58.545383+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.545209+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:58.985882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":18767,"num_write":1102,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.979868+0000","last_change":"2024-09-14T11:38:10.979868+0000","last_active":"2024-09-14T11:38:10.979868+0000","last_peered":"2024-09-14T11:38:10.979868+0000","last_clean":"2024-09-14T11:38:10.979868+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:38:10.979868+0000","last_undegraded":"2024-09-14T11:38:10.979868+0000","last_fullsized":"2024-09-14T11:38:10.979868+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.979770+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:08.122305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2521,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1769,"ondisk_log_size":1769,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1610275,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17487,"num_read_kb":37004,"num_write":14657,"num_write_kb":11695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":700984,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2016,"ondisk_log_size":2016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35465,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4177,"ondisk_log_size":4177,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":376,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":8,"ondisk_log_size":8,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33940714,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44010,"num_read_kb":2045437,"num_write":72918,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68894720,"data_stored":67881428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":206212,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193226,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509959,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279124,"kb_used_data":9156,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94092716,"statfs":{"total":96636764160,"available":96350941184,"internally_reserved":0,"allocated":9375744,"data_stored":7712300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509958,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226860,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94144980,"statfs":{"total":96636764160,"available":96404459520,"internally_reserved":0,"allocated":7041024,"data_stored":5465111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509957,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90888,"kb_used_data":15288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94280952,"statfs":{"total":96636764160,"available":96543694848,"internally_reserved":0,"allocated":15654912,"data_stored":14047867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509959,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267756,"kb_used_data":15836,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94104084,"statfs":{"total":96636764160,"available":96362582016,"internally_reserved":0,"allocated":16216064,"data_stored":14565484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509958,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56752,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315088,"statfs":{"total":96636764160,"available":96578650112,"internally_reserved":0,"allocated":11960320,"data_stored":10430814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542663,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115056,"kb_used_data":11744,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94256784,"statfs":{"total":96636764160,"available":96518946816,"internally_reserved":0,"allocated":12025856,"data_stored":10431815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542660,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255272,"kb_used_data":17304,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94116568,"statfs":{"total":96636764160,"available":96375365632,"internally_reserved":0,"allocated":17719296,"data_stored":15992953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575365,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116548,"kb_used_data":9076,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94255292,"statfs":{"total":96636764160,"available":96517419008,"internally_reserved":0,"allocated":9293824,"data_stored":7637406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13430784,"data_stored":13247355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8384512,"data_stored":8279522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8343552,"data_stored":8279343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12570624,"data_stored":12413553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12062720,"data_stored":11898009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":5483519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3403776,"data_stored":3312046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5099520,"data_stored":4968081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.526 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.527 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.528 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.529 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.530 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.531 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.532 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-14T11:10:12.478454+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=10, tm_sec=12, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.533 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.534 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.534 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.534 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.534 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-14T11:11:56.325556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=56, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.534 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.534 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.535 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-14T11:11:59.343699+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=11, tm_sec=59, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.537 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-14T10:56:15.854331+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=10, tm_min=56, tm_sec=15, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:36.538 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:38:56.539 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:38:56.890 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:38:56.901 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:38:56.903 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1551,"stamp":"2024-09-14T11:38:55.693321+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36158020,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":196655,"num_read_kb":2597552,"num_write":146051,"num_write_kb":2468367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740098,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13473,"ondisk_log_size":13473,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1408256,"kb_used_data":96960,"kb_used_omap":12,"kb_used_meta":1311155,"kb_avail":753566464,"statfs":{"total":773094113280,"available":771652059136,"internally_reserved":0,"allocated":99287040,"data_stored":86283750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1342623280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":752,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005010"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.097950+0000","last_change":"2024-09-14T11:38:42.097950+0000","last_active":"2024-09-14T11:38:42.097950+0000","last_peered":"2024-09-14T11:38:42.097950+0000","last_clean":"2024-09-14T11:38:42.097950+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:38:42.097950+0000","last_undegraded":"2024-09-14T11:38:42.097950+0000","last_fullsized":"2024-09-14T11:38:42.097950+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:42.097847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:42.097847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.097847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:50.735708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.185787+0000","last_change":"2024-09-14T11:38:39.185787+0000","last_active":"2024-09-14T11:38:39.185787+0000","last_peered":"2024-09-14T11:38:39.185787+0000","last_clean":"2024-09-14T11:38:39.185787+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:38:39.185787+0000","last_undegraded":"2024-09-14T11:38:39.185787+0000","last_fullsized":"2024-09-14T11:38:39.185787+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:39.185681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:39.185681+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.185681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:19.147291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.796177+0000","last_change":"2024-09-14T11:38:43.796177+0000","last_active":"2024-09-14T11:38:43.796177+0000","last_peered":"2024-09-14T11:38:43.796177+0000","last_clean":"2024-09-14T11:38:43.796177+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:38:43.796177+0000","last_undegraded":"2024-09-14T11:38:43.796177+0000","last_fullsized":"2024-09-14T11:38:43.796177+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:43.796089+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:43.796089+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.796089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:09.916173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:44.141292+0000","last_change":"2024-09-14T11:38:44.141292+0000","last_active":"2024-09-14T11:38:44.141292+0000","last_peered":"2024-09-14T11:38:44.141292+0000","last_clean":"2024-09-14T11:38:44.141292+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:38:44.141292+0000","last_undegraded":"2024-09-14T11:38:44.141292+0000","last_fullsized":"2024-09-14T11:38:44.141292+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-14T11:38:44.141188+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-14T11:38:44.141188+0000","last_clean_scrub_stamp":"2024-09-14T11:38:44.141188+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:49.574100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.169885+0000","last_change":"2024-09-14T11:38:24.169885+0000","last_active":"2024-09-14T11:38:24.169885+0000","last_peered":"2024-09-14T11:38:24.169885+0000","last_clean":"2024-09-14T11:38:24.169885+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:38:24.169885+0000","last_undegraded":"2024-09-14T11:38:24.169885+0000","last_fullsized":"2024-09-14T11:38:24.169885+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.169793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.169793+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.169793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:11.603144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.768362+0000","last_change":"2024-09-14T11:38:42.768362+0000","last_active":"2024-09-14T11:38:42.768362+0000","last_peered":"2024-09-14T11:38:42.768362+0000","last_clean":"2024-09-14T11:38:42.768362+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:38:42.768362+0000","last_undegraded":"2024-09-14T11:38:42.768362+0000","last_fullsized":"2024-09-14T11:38:42.768362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:42.768276+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:42.768276+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.768276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:32.158806+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.621483+0000","last_change":"2024-09-14T11:38:26.621483+0000","last_active":"2024-09-14T11:38:26.621483+0000","last_peered":"2024-09-14T11:38:26.621483+0000","last_clean":"2024-09-14T11:38:26.621483+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:38:26.621483+0000","last_undegraded":"2024-09-14T11:38:26.621483+0000","last_fullsized":"2024-09-14T11:38:26.621483+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:26.621386+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:26.621386+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.621386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:01.370036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.252305+0000","last_change":"2024-09-14T11:38:15.252181+0000","last_active":"2024-09-14T11:38:15.252305+0000","last_peered":"2024-09-14T11:38:15.252305+0000","last_clean":"2024-09-14T11:38:15.252305+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:38:15.252305+0000","last_undegraded":"2024-09-14T11:38:15.252305+0000","last_fullsized":"2024-09-14T11:38:15.252305+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-09-14T11:38:15.252053+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-09-14T11:38:15.252053+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.252053+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:49.934103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.029476+0000","last_change":"2024-09-14T11:38:32.029476+0000","last_active":"2024-09-14T11:38:32.029476+0000","last_peered":"2024-09-14T11:38:32.029476+0000","last_clean":"2024-09-14T11:38:32.029476+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:38:32.029476+0000","last_undegraded":"2024-09-14T11:38:32.029476+0000","last_fullsized":"2024-09-14T11:38:32.029476+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:32.029389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:32.029389+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.029389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.188681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'6","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:49.068649+0000","last_change":"2024-09-14T11:38:49.068649+0000","last_active":"2024-09-14T11:38:49.068649+0000","last_peered":"2024-09-14T11:38:49.068649+0000","last_clean":"2024-09-14T11:38:49.068649+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:38:49.068649+0000","last_undegraded":"2024-09-14T11:38:49.068649+0000","last_fullsized":"2024-09-14T11:38:49.068649+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:49.068535+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:49.068535+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.068535+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:07.098791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.155151+0000","last_change":"2024-09-14T11:38:20.155151+0000","last_active":"2024-09-14T11:38:20.155151+0000","last_peered":"2024-09-14T11:38:20.155151+0000","last_clean":"2024-09-14T11:38:20.155151+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:38:20.155151+0000","last_undegraded":"2024-09-14T11:38:20.155151+0000","last_fullsized":"2024-09-14T11:38:20.155151+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:20.155068+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:20.155068+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.155068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:17.930504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5122,"num_write":13,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.127005+0000","last_change":"2024-09-14T11:38:34.127005+0000","last_active":"2024-09-14T11:38:34.127005+0000","last_peered":"2024-09-14T11:38:34.127005+0000","last_clean":"2024-09-14T11:38:34.127005+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:38:34.127005+0000","last_undegraded":"2024-09-14T11:38:34.127005+0000","last_fullsized":"2024-09-14T11:38:34.127005+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-14T11:38:34.126914+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-14T11:38:34.126914+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.126914+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:00.673213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:54.771589+0000","last_change":"2024-09-14T11:38:54.771589+0000","last_active":"2024-09-14T11:38:54.771589+0000","last_peered":"2024-09-14T11:38:54.771589+0000","last_clean":"2024-09-14T11:38:54.771589+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:38:54.771589+0000","last_undegraded":"2024-09-14T11:38:54.771589+0000","last_fullsized":"2024-09-14T11:38:54.771589+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:54.771499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:54.771499+0000","last_clean_scrub_stamp":"2024-09-14T11:38:54.771499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:14.405573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:51.746297+0000","last_change":"2024-09-14T11:38:51.746297+0000","last_active":"2024-09-14T11:38:51.746297+0000","last_peered":"2024-09-14T11:38:51.746297+0000","last_clean":"2024-09-14T11:38:51.746297+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:38:51.746297+0000","last_undegraded":"2024-09-14T11:38:51.746297+0000","last_fullsized":"2024-09-14T11:38:51.746297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:51.746205+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:51.746205+0000","last_clean_scrub_stamp":"2024-09-14T11:38:51.746205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:12.962703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'9","reported_seq":66,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.718788+0000","last_change":"2024-09-14T11:38:37.718788+0000","last_active":"2024-09-14T11:38:37.718788+0000","last_peered":"2024-09-14T11:38:37.718788+0000","last_clean":"2024-09-14T11:38:37.718788+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:38:37.718788+0000","last_undegraded":"2024-09-14T11:38:37.718788+0000","last_fullsized":"2024-09-14T11:38:37.718788+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-14T11:38:37.718680+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-14T11:38:37.718680+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.718680+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:39.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.763052+0000","last_change":"2024-09-14T11:38:41.763052+0000","last_active":"2024-09-14T11:38:41.763052+0000","last_peered":"2024-09-14T11:38:41.763052+0000","last_clean":"2024-09-14T11:38:41.763052+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:38:41.763052+0000","last_undegraded":"2024-09-14T11:38:41.763052+0000","last_fullsized":"2024-09-14T11:38:41.763052+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-14T11:38:41.762948+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-14T11:38:41.762948+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.762948+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:13.436811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":21,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:36:40.620565+0000","last_change":"2024-09-14T11:22:38.562233+0000","last_active":"2024-09-14T11:36:40.620565+0000","last_peered":"2024-09-14T11:36:40.620565+0000","last_clean":"2024-09-14T11:36:40.620565+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:36:40.620565+0000","last_undegraded":"2024-09-14T11:36:40.620565+0000","last_fullsized":"2024-09-14T11:36:40.620565+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.131281+0000","last_change":"2024-09-14T11:38:37.131221+0000","last_active":"2024-09-14T11:38:37.131281+0000","last_peered":"2024-09-14T11:38:37.131281+0000","last_clean":"2024-09-14T11:38:37.131281+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:38:37.131281+0000","last_undegraded":"2024-09-14T11:38:37.131281+0000","last_fullsized":"2024-09-14T11:38:37.131281+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:37.131128+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:37.131128+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.131128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:33.117248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.100914+0000","last_change":"2024-09-14T11:38:39.100914+0000","last_active":"2024-09-14T11:38:39.100914+0000","last_peered":"2024-09-14T11:38:39.100914+0000","last_clean":"2024-09-14T11:38:39.100914+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:38:39.100914+0000","last_undegraded":"2024-09-14T11:38:39.100914+0000","last_fullsized":"2024-09-14T11:38:39.100914+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:38:39.100813+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:38:39.100813+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:28.583813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.766468+0000","last_change":"2024-09-14T11:38:39.766468+0000","last_active":"2024-09-14T11:38:39.766468+0000","last_peered":"2024-09-14T11:38:39.766468+0000","last_clean":"2024-09-14T11:38:39.766468+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:38:39.766468+0000","last_undegraded":"2024-09-14T11:38:39.766468+0000","last_fullsized":"2024-09-14T11:38:39.766468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-14T11:38:39.766342+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-14T11:38:39.766342+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.766342+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:46.627364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.644921+0000","last_change":"2024-09-14T11:38:33.644921+0000","last_active":"2024-09-14T11:38:33.644921+0000","last_peered":"2024-09-14T11:38:33.644921+0000","last_clean":"2024-09-14T11:38:33.644921+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:38:33.644921+0000","last_undegraded":"2024-09-14T11:38:33.644921+0000","last_fullsized":"2024-09-14T11:38:33.644921+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:33.644836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:33.644836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.644836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:52.935576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.949765+0000","last_change":"2024-09-14T11:38:29.949686+0000","last_active":"2024-09-14T11:38:29.949765+0000","last_peered":"2024-09-14T11:38:29.949765+0000","last_clean":"2024-09-14T11:38:29.949765+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:38:29.949765+0000","last_undegraded":"2024-09-14T11:38:29.949765+0000","last_fullsized":"2024-09-14T11:38:29.949765+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:38:29.949588+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:38:29.949588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.949588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:13.966792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.756620+0000","last_change":"2024-09-14T11:38:35.756620+0000","last_active":"2024-09-14T11:38:35.756620+0000","last_peered":"2024-09-14T11:38:35.756620+0000","last_clean":"2024-09-14T11:38:35.756620+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:38:35.756620+0000","last_undegraded":"2024-09-14T11:38:35.756620+0000","last_fullsized":"2024-09-14T11:38:35.756620+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.756536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.756536+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.756536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:52.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.100873+0000","last_change":"2024-09-14T11:38:24.100873+0000","last_active":"2024-09-14T11:38:24.100873+0000","last_peered":"2024-09-14T11:38:24.100873+0000","last_clean":"2024-09-14T11:38:24.100873+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:38:24.100873+0000","last_undegraded":"2024-09-14T11:38:24.100873+0000","last_fullsized":"2024-09-14T11:38:24.100873+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-14T11:38:24.100793+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-14T11:38:24.100793+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.100793+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:21.604899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.026348+0000","last_change":"2024-09-14T11:38:50.026348+0000","last_active":"2024-09-14T11:38:50.026348+0000","last_peered":"2024-09-14T11:38:50.026348+0000","last_clean":"2024-09-14T11:38:50.026348+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:38:50.026348+0000","last_undegraded":"2024-09-14T11:38:50.026348+0000","last_fullsized":"2024-09-14T11:38:50.026348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:50.026254+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:50.026254+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.026254+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:21.535537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.940825+0000","last_change":"2024-09-14T11:38:28.940825+0000","last_active":"2024-09-14T11:38:28.940825+0000","last_peered":"2024-09-14T11:38:28.940825+0000","last_clean":"2024-09-14T11:38:28.940825+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:38:28.940825+0000","last_undegraded":"2024-09-14T11:38:28.940825+0000","last_fullsized":"2024-09-14T11:38:28.940825+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-14T11:38:28.940735+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-14T11:38:28.940735+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.940735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:19.251022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.764918+0000","last_change":"2024-09-14T11:38:36.764918+0000","last_active":"2024-09-14T11:38:36.764918+0000","last_peered":"2024-09-14T11:38:36.764918+0000","last_clean":"2024-09-14T11:38:36.764918+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:38:36.764918+0000","last_undegraded":"2024-09-14T11:38:36.764918+0000","last_fullsized":"2024-09-14T11:38:36.764918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:36.764786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:36.764786+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.764786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:54.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.104154+0000","last_change":"2024-09-14T11:38:33.104154+0000","last_active":"2024-09-14T11:38:33.104154+0000","last_peered":"2024-09-14T11:38:33.104154+0000","last_clean":"2024-09-14T11:38:33.104154+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:38:33.104154+0000","last_undegraded":"2024-09-14T11:38:33.104154+0000","last_fullsized":"2024-09-14T11:38:33.104154+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:38:33.104000+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:38:33.104000+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.104000+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.817552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:51.940514+0000","last_change":"2024-09-14T11:38:51.940514+0000","last_active":"2024-09-14T11:38:51.940514+0000","last_peered":"2024-09-14T11:38:51.940514+0000","last_clean":"2024-09-14T11:38:51.940514+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:38:51.940514+0000","last_undegraded":"2024-09-14T11:38:51.940514+0000","last_fullsized":"2024-09-14T11:38:51.940514+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:51.940420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:51.940420+0000","last_clean_scrub_stamp":"2024-09-14T11:38:51.940420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:27.252944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.160829+0000","last_change":"2024-09-14T11:38:38.160829+0000","last_active":"2024-09-14T11:38:38.160829+0000","last_peered":"2024-09-14T11:38:38.160829+0000","last_clean":"2024-09-14T11:38:38.160829+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:38:38.160829+0000","last_undegraded":"2024-09-14T11:38:38.160829+0000","last_fullsized":"2024-09-14T11:38:38.160829+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:38.160746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:38.160746+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.160746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:38.303031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:46.110898+0000","last_change":"2024-09-14T11:38:46.110898+0000","last_active":"2024-09-14T11:38:46.110898+0000","last_peered":"2024-09-14T11:38:46.110898+0000","last_clean":"2024-09-14T11:38:46.110898+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:38:46.110898+0000","last_undegraded":"2024-09-14T11:38:46.110898+0000","last_fullsized":"2024-09-14T11:38:46.110898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-14T11:38:46.110800+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-14T11:38:46.110800+0000","last_clean_scrub_stamp":"2024-09-14T11:38:46.110800+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:02.904273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":105,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.560033+0000","last_change":"2024-09-14T11:38:23.560033+0000","last_active":"2024-09-14T11:38:23.560033+0000","last_peered":"2024-09-14T11:38:23.560033+0000","last_clean":"2024-09-14T11:38:23.560033+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:38:23.560033+0000","last_undegraded":"2024-09-14T11:38:23.560033+0000","last_fullsized":"2024-09-14T11:38:23.560033+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-14T11:38:23.559943+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-14T11:38:23.559943+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.559943+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:11.949125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.656687+0000","last_change":"2024-09-14T11:38:34.656687+0000","last_active":"2024-09-14T11:38:34.656687+0000","last_peered":"2024-09-14T11:38:34.656687+0000","last_clean":"2024-09-14T11:38:34.656687+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:38:34.656687+0000","last_undegraded":"2024-09-14T11:38:34.656687+0000","last_fullsized":"2024-09-14T11:38:34.656687+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:34.656595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:34.656595+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.656595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:07.716925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:49.772270+0000","last_change":"2024-09-14T11:38:49.772270+0000","last_active":"2024-09-14T11:38:49.772270+0000","last_peered":"2024-09-14T11:38:49.772270+0000","last_clean":"2024-09-14T11:38:49.772270+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:38:49.772270+0000","last_undegraded":"2024-09-14T11:38:49.772270+0000","last_fullsized":"2024-09-14T11:38:49.772270+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:49.772176+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:49.772176+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.772176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:41.288122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.137758+0000","last_change":"2024-09-14T11:38:36.137758+0000","last_active":"2024-09-14T11:38:36.137758+0000","last_peered":"2024-09-14T11:38:36.137758+0000","last_clean":"2024-09-14T11:38:36.137758+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:38:36.137758+0000","last_undegraded":"2024-09-14T11:38:36.137758+0000","last_fullsized":"2024-09-14T11:38:36.137758+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-14T11:38:36.137663+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-14T11:38:36.137663+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.137663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:49.565278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.141126+0000","last_change":"2024-09-14T11:38:37.141126+0000","last_active":"2024-09-14T11:38:37.141126+0000","last_peered":"2024-09-14T11:38:37.141126+0000","last_clean":"2024-09-14T11:38:37.141126+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:38:37.141126+0000","last_undegraded":"2024-09-14T11:38:37.141126+0000","last_fullsized":"2024-09-14T11:38:37.141126+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-14T11:38:37.140996+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-14T11:38:37.140996+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.140996+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:13.949410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.175779+0000","last_change":"2024-09-14T11:38:23.175779+0000","last_active":"2024-09-14T11:38:23.175779+0000","last_peered":"2024-09-14T11:38:23.175779+0000","last_clean":"2024-09-14T11:38:23.175779+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:38:23.175779+0000","last_undegraded":"2024-09-14T11:38:23.175779+0000","last_fullsized":"2024-09-14T11:38:23.175779+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:23.175677+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:23.175677+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.175677+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:09.393436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:48.753337+0000","last_change":"2024-09-14T11:38:48.753337+0000","last_active":"2024-09-14T11:38:48.753337+0000","last_peered":"2024-09-14T11:38:48.753337+0000","last_clean":"2024-09-14T11:38:48.753337+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:38:48.753337+0000","last_undegraded":"2024-09-14T11:38:48.753337+0000","last_fullsized":"2024-09-14T11:38:48.753337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:48.753244+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:48.753244+0000","last_clean_scrub_stamp":"2024-09-14T11:38:48.753244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:55.347726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.851544+0000","last_change":"2024-09-14T11:38:39.851544+0000","last_active":"2024-09-14T11:38:39.851544+0000","last_peered":"2024-09-14T11:38:39.851544+0000","last_clean":"2024-09-14T11:38:39.851544+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:38:39.851544+0000","last_undegraded":"2024-09-14T11:38:39.851544+0000","last_fullsized":"2024-09-14T11:38:39.851544+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:39.851460+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:39.851460+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.851460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:39.227384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":114,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.773498+0000","last_change":"2024-09-14T11:38:38.773498+0000","last_active":"2024-09-14T11:38:38.773498+0000","last_peered":"2024-09-14T11:38:38.773498+0000","last_clean":"2024-09-14T11:38:38.773498+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:38:38.773498+0000","last_undegraded":"2024-09-14T11:38:38.773498+0000","last_fullsized":"2024-09-14T11:38:38.773498+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-14T11:38:38.773406+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-14T11:38:38.773406+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.773406+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:57.025417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.984726+0000","last_change":"2024-09-14T11:38:50.984726+0000","last_active":"2024-09-14T11:38:50.984726+0000","last_peered":"2024-09-14T11:38:50.984726+0000","last_clean":"2024-09-14T11:38:50.984726+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:38:50.984726+0000","last_undegraded":"2024-09-14T11:38:50.984726+0000","last_fullsized":"2024-09-14T11:38:50.984726+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:50.984642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:50.984642+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.984642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.374648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.727656+0000","last_change":"2024-09-14T11:38:50.727656+0000","last_active":"2024-09-14T11:38:50.727656+0000","last_peered":"2024-09-14T11:38:50.727656+0000","last_clean":"2024-09-14T11:38:50.727656+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:38:50.727656+0000","last_undegraded":"2024-09-14T11:38:50.727656+0000","last_fullsized":"2024-09-14T11:38:50.727656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:50.727547+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:50.727547+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.727547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:46.668369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.194185+0000","last_change":"2024-09-14T11:38:19.194130+0000","last_active":"2024-09-14T11:38:19.194185+0000","last_peered":"2024-09-14T11:38:19.194185+0000","last_clean":"2024-09-14T11:38:19.194185+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:38:19.194185+0000","last_undegraded":"2024-09-14T11:38:19.194185+0000","last_fullsized":"2024-09-14T11:38:19.194185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:19.194040+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:19.194040+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.194040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:56.906130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":135,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.232395+0000","last_change":"2024-09-14T11:38:16.232395+0000","last_active":"2024-09-14T11:38:16.232395+0000","last_peered":"2024-09-14T11:38:16.232395+0000","last_clean":"2024-09-14T11:38:16.232395+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:38:16.232395+0000","last_undegraded":"2024-09-14T11:38:16.232395+0000","last_fullsized":"2024-09-14T11:38:16.232395+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:16.232320+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:16.232320+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.232320+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:12.306009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.124340+0000","last_change":"2024-09-14T11:38:41.124340+0000","last_active":"2024-09-14T11:38:41.124340+0000","last_peered":"2024-09-14T11:38:41.124340+0000","last_clean":"2024-09-14T11:38:41.124340+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:38:41.124340+0000","last_undegraded":"2024-09-14T11:38:41.124340+0000","last_fullsized":"2024-09-14T11:38:41.124340+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:41.124236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:41.124236+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.124236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:55.134702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.713156+0000","last_change":"2024-09-14T11:38:40.713156+0000","last_active":"2024-09-14T11:38:40.713156+0000","last_peered":"2024-09-14T11:38:40.713156+0000","last_clean":"2024-09-14T11:38:40.713156+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:38:40.713156+0000","last_undegraded":"2024-09-14T11:38:40.713156+0000","last_fullsized":"2024-09-14T11:38:40.713156+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:40.713044+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:40.713044+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.713044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:45.071585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:47.098138+0000","last_change":"2024-09-14T11:38:47.098138+0000","last_active":"2024-09-14T11:38:47.098138+0000","last_peered":"2024-09-14T11:38:47.098138+0000","last_clean":"2024-09-14T11:38:47.098138+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:38:47.098138+0000","last_undegraded":"2024-09-14T11:38:47.098138+0000","last_fullsized":"2024-09-14T11:38:47.098138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:47.098046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:47.098046+0000","last_clean_scrub_stamp":"2024-09-14T11:38:47.098046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:02.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.897864+0000","last_change":"2024-09-14T11:38:33.897864+0000","last_active":"2024-09-14T11:38:33.897864+0000","last_peered":"2024-09-14T11:38:33.897864+0000","last_clean":"2024-09-14T11:38:33.897864+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:38:33.897864+0000","last_undegraded":"2024-09-14T11:38:33.897864+0000","last_fullsized":"2024-09-14T11:38:33.897864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:33.897774+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:33.897774+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.897774+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:30.292702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:34:45.606019+0000","last_change":"2024-09-14T11:22:38.560634+0000","last_active":"2024-09-14T11:34:45.606019+0000","last_peered":"2024-09-14T11:34:45.606019+0000","last_clean":"2024-09-14T11:34:45.606019+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:34:45.606019+0000","last_undegraded":"2024-09-14T11:34:45.606019+0000","last_fullsized":"2024-09-14T11:34:45.606019+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:22:37.532912+0000","last_clean_scrub_stamp":"2024-09-14T11:22:37.532912+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:00:00.155051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.652356+0000","last_change":"2024-09-14T11:38:30.652356+0000","last_active":"2024-09-14T11:38:30.652356+0000","last_peered":"2024-09-14T11:38:30.652356+0000","last_clean":"2024-09-14T11:38:30.652356+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:38:30.652356+0000","last_undegraded":"2024-09-14T11:38:30.652356+0000","last_fullsized":"2024-09-14T11:38:30.652356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:30.652266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:30.652266+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.652266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.712630+0000","last_change":"2024-09-14T11:38:33.712630+0000","last_active":"2024-09-14T11:38:33.712630+0000","last_peered":"2024-09-14T11:38:33.712630+0000","last_clean":"2024-09-14T11:38:33.712630+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:38:33.712630+0000","last_undegraded":"2024-09-14T11:38:33.712630+0000","last_fullsized":"2024-09-14T11:38:33.712630+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:33.712531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:33.712531+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.712531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:40.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.874688+0000","last_change":"2024-09-14T11:38:32.874688+0000","last_active":"2024-09-14T11:38:32.874688+0000","last_peered":"2024-09-14T11:38:32.874688+0000","last_clean":"2024-09-14T11:38:32.874688+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:38:32.874688+0000","last_undegraded":"2024-09-14T11:38:32.874688+0000","last_fullsized":"2024-09-14T11:38:32.874688+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'14","last_scrub_stamp":"2024-09-14T11:38:32.874597+0000","last_deep_scrub":"261'14","last_deep_scrub_stamp":"2024-09-14T11:38:32.874597+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.874597+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:31.872512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:52.129888+0000","last_change":"2024-09-14T11:38:52.129888+0000","last_active":"2024-09-14T11:38:52.129888+0000","last_peered":"2024-09-14T11:38:52.129888+0000","last_clean":"2024-09-14T11:38:52.129888+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:38:52.129888+0000","last_undegraded":"2024-09-14T11:38:52.129888+0000","last_fullsized":"2024-09-14T11:38:52.129888+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:52.129774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:52.129774+0000","last_clean_scrub_stamp":"2024-09-14T11:38:52.129774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:59.767018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.700105+0000","last_change":"2024-09-14T11:38:29.700105+0000","last_active":"2024-09-14T11:38:29.700105+0000","last_peered":"2024-09-14T11:38:29.700105+0000","last_clean":"2024-09-14T11:38:29.700105+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:38:29.700105+0000","last_undegraded":"2024-09-14T11:38:29.700105+0000","last_fullsized":"2024-09-14T11:38:29.700105+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:38:29.700005+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:38:29.700005+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.700005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:00.423361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.796232+0000","last_change":"2024-09-14T11:38:42.796232+0000","last_active":"2024-09-14T11:38:42.796232+0000","last_peered":"2024-09-14T11:38:42.796232+0000","last_clean":"2024-09-14T11:38:42.796232+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:38:42.796232+0000","last_undegraded":"2024-09-14T11:38:42.796232+0000","last_fullsized":"2024-09-14T11:38:42.796232+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:42.796113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:42.796113+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.796113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:31.615287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.107301+0000","last_change":"2024-09-14T11:38:31.107301+0000","last_active":"2024-09-14T11:38:31.107301+0000","last_peered":"2024-09-14T11:38:31.107301+0000","last_clean":"2024-09-14T11:38:31.107301+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:38:31.107301+0000","last_undegraded":"2024-09-14T11:38:31.107301+0000","last_fullsized":"2024-09-14T11:38:31.107301+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-14T11:38:31.107207+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-14T11:38:31.107207+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.107207+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:38.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.096179+0000","last_change":"2024-09-14T11:38:50.096179+0000","last_active":"2024-09-14T11:38:50.096179+0000","last_peered":"2024-09-14T11:38:50.096179+0000","last_clean":"2024-09-14T11:38:50.096179+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:38:50.096179+0000","last_undegraded":"2024-09-14T11:38:50.096179+0000","last_fullsized":"2024-09-14T11:38:50.096179+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:50.096079+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:50.096079+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.096079+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:18.069826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:47.795286+0000","last_change":"2024-09-14T11:38:47.795286+0000","last_active":"2024-09-14T11:38:47.795286+0000","last_peered":"2024-09-14T11:38:47.795286+0000","last_clean":"2024-09-14T11:38:47.795286+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:38:47.795286+0000","last_undegraded":"2024-09-14T11:38:47.795286+0000","last_fullsized":"2024-09-14T11:38:47.795286+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:47.795181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:47.795181+0000","last_clean_scrub_stamp":"2024-09-14T11:38:47.795181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:42.498359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.052970+0000","last_change":"2024-09-14T11:38:26.052970+0000","last_active":"2024-09-14T11:38:26.052970+0000","last_peered":"2024-09-14T11:38:26.052970+0000","last_clean":"2024-09-14T11:38:26.052970+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:38:26.052970+0000","last_undegraded":"2024-09-14T11:38:26.052970+0000","last_fullsized":"2024-09-14T11:38:26.052970+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.052876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.052876+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.052876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:51.972093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.737204+0000","last_change":"2024-09-14T11:38:34.737204+0000","last_active":"2024-09-14T11:38:34.737204+0000","last_peered":"2024-09-14T11:38:34.737204+0000","last_clean":"2024-09-14T11:38:34.737204+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:38:34.737204+0000","last_undegraded":"2024-09-14T11:38:34.737204+0000","last_fullsized":"2024-09-14T11:38:34.737204+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-14T11:38:34.737118+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-14T11:38:34.737118+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.737118+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:26.158556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:52.779745+0000","last_change":"2024-09-14T11:38:52.779745+0000","last_active":"2024-09-14T11:38:52.779745+0000","last_peered":"2024-09-14T11:38:52.779745+0000","last_clean":"2024-09-14T11:38:52.779745+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:38:52.779745+0000","last_undegraded":"2024-09-14T11:38:52.779745+0000","last_fullsized":"2024-09-14T11:38:52.779745+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:52.779629+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:52.779629+0000","last_clean_scrub_stamp":"2024-09-14T11:38:52.779629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:01.969573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.006633+0000","last_change":"2024-09-14T11:38:27.006633+0000","last_active":"2024-09-14T11:38:27.006633+0000","last_peered":"2024-09-14T11:38:27.006633+0000","last_clean":"2024-09-14T11:38:27.006633+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:38:27.006633+0000","last_undegraded":"2024-09-14T11:38:27.006633+0000","last_fullsized":"2024-09-14T11:38:27.006633+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:27.006548+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:27.006548+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.006548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:31.802385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.092270+0000","last_change":"2024-09-14T11:38:34.092270+0000","last_active":"2024-09-14T11:38:34.092270+0000","last_peered":"2024-09-14T11:38:34.092270+0000","last_clean":"2024-09-14T11:38:34.092270+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:38:34.092270+0000","last_undegraded":"2024-09-14T11:38:34.092270+0000","last_fullsized":"2024-09-14T11:38:34.092270+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:34.092177+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:34.092177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.092177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:08.291763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.732933+0000","last_change":"2024-09-14T11:38:40.732933+0000","last_active":"2024-09-14T11:38:40.732933+0000","last_peered":"2024-09-14T11:38:40.732933+0000","last_clean":"2024-09-14T11:38:40.732933+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:38:40.732933+0000","last_undegraded":"2024-09-14T11:38:40.732933+0000","last_fullsized":"2024-09-14T11:38:40.732933+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:40.732847+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:40.732847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.732847+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:30.008861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.183553+0000","last_change":"2024-09-14T11:38:22.183553+0000","last_active":"2024-09-14T11:38:22.183553+0000","last_peered":"2024-09-14T11:38:22.183553+0000","last_clean":"2024-09-14T11:38:22.183553+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:38:22.183553+0000","last_undegraded":"2024-09-14T11:38:22.183553+0000","last_fullsized":"2024-09-14T11:38:22.183553+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.183443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.183443+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.183443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:12.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:45.819170+0000","last_change":"2024-09-14T11:38:45.819170+0000","last_active":"2024-09-14T11:38:45.819170+0000","last_peered":"2024-09-14T11:38:45.819170+0000","last_clean":"2024-09-14T11:38:45.819170+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:38:45.819170+0000","last_undegraded":"2024-09-14T11:38:45.819170+0000","last_fullsized":"2024-09-14T11:38:45.819170+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:45.819080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:45.819080+0000","last_clean_scrub_stamp":"2024-09-14T11:38:45.819080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:43.638573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.837864+0000","last_change":"2024-09-14T11:38:38.837864+0000","last_active":"2024-09-14T11:38:38.837864+0000","last_peered":"2024-09-14T11:38:38.837864+0000","last_clean":"2024-09-14T11:38:38.837864+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:38:38.837864+0000","last_undegraded":"2024-09-14T11:38:38.837864+0000","last_fullsized":"2024-09-14T11:38:38.837864+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:38.837771+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:38.837771+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.837771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:20.384241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.820148+0000","last_change":"2024-09-14T11:38:37.820148+0000","last_active":"2024-09-14T11:38:37.820148+0000","last_peered":"2024-09-14T11:38:37.820148+0000","last_clean":"2024-09-14T11:38:37.820148+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:38:37.820148+0000","last_undegraded":"2024-09-14T11:38:37.820148+0000","last_fullsized":"2024-09-14T11:38:37.820148+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:37.820054+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:37.820054+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.820054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:14.722092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:47.010061+0000","last_change":"2024-09-14T11:38:47.010061+0000","last_active":"2024-09-14T11:38:47.010061+0000","last_peered":"2024-09-14T11:38:47.010061+0000","last_clean":"2024-09-14T11:38:47.010061+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:38:47.010061+0000","last_undegraded":"2024-09-14T11:38:47.010061+0000","last_fullsized":"2024-09-14T11:38:47.010061+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:47.009971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:47.009971+0000","last_clean_scrub_stamp":"2024-09-14T11:38:47.009971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:50.468358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:44.846071+0000","last_change":"2024-09-14T11:38:44.846071+0000","last_active":"2024-09-14T11:38:44.846071+0000","last_peered":"2024-09-14T11:38:44.846071+0000","last_clean":"2024-09-14T11:38:44.846071+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:38:44.846071+0000","last_undegraded":"2024-09-14T11:38:44.846071+0000","last_fullsized":"2024-09-14T11:38:44.846071+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:44.845983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:44.845983+0000","last_clean_scrub_stamp":"2024-09-14T11:38:44.845983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:56.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":51,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.234039+0000","last_change":"2024-09-14T11:38:18.234039+0000","last_active":"2024-09-14T11:38:18.234039+0000","last_peered":"2024-09-14T11:38:18.234039+0000","last_clean":"2024-09-14T11:38:18.234039+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:38:18.234039+0000","last_undegraded":"2024-09-14T11:38:18.234039+0000","last_fullsized":"2024-09-14T11:38:18.234039+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:18.233937+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:18.233937+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.233937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:41.868662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.118317+0000","last_change":"2024-09-14T11:38:32.118317+0000","last_active":"2024-09-14T11:38:32.118317+0000","last_peered":"2024-09-14T11:38:32.118317+0000","last_clean":"2024-09-14T11:38:32.118317+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:38:32.118317+0000","last_undegraded":"2024-09-14T11:38:32.118317+0000","last_fullsized":"2024-09-14T11:38:32.118317+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-14T11:38:32.118235+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-14T11:38:32.118235+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.118235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:24.413407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.984804+0000","last_change":"2024-09-14T11:38:30.984804+0000","last_active":"2024-09-14T11:38:30.984804+0000","last_peered":"2024-09-14T11:38:30.984804+0000","last_clean":"2024-09-14T11:38:30.984804+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:38:30.984804+0000","last_undegraded":"2024-09-14T11:38:30.984804+0000","last_fullsized":"2024-09-14T11:38:30.984804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:30.984695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:30.984695+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.984695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:58.768775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.665049+0000","last_change":"2024-09-14T11:38:28.665049+0000","last_active":"2024-09-14T11:38:28.665049+0000","last_peered":"2024-09-14T11:38:28.665049+0000","last_clean":"2024-09-14T11:38:28.665049+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:38:28.665049+0000","last_undegraded":"2024-09-14T11:38:28.665049+0000","last_fullsized":"2024-09-14T11:38:28.665049+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:28.664961+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:28.664961+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.664961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:38.095566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.105946+0000","last_change":"2024-09-14T11:38:38.105946+0000","last_active":"2024-09-14T11:38:38.105946+0000","last_peered":"2024-09-14T11:38:38.105946+0000","last_clean":"2024-09-14T11:38:38.105946+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:38:38.105946+0000","last_undegraded":"2024-09-14T11:38:38.105946+0000","last_fullsized":"2024-09-14T11:38:38.105946+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:38.105851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:38.105851+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.105851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:45.296790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.069093+0000","last_change":"2024-09-14T11:38:22.069093+0000","last_active":"2024-09-14T11:38:22.069093+0000","last_peered":"2024-09-14T11:38:22.069093+0000","last_clean":"2024-09-14T11:38:22.069093+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:38:22.069093+0000","last_undegraded":"2024-09-14T11:38:22.069093+0000","last_fullsized":"2024-09-14T11:38:22.069093+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:22.069004+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:22.069004+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.069004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.390134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:45.986000+0000","last_change":"2024-09-14T11:38:45.986000+0000","last_active":"2024-09-14T11:38:45.986000+0000","last_peered":"2024-09-14T11:38:45.986000+0000","last_clean":"2024-09-14T11:38:45.986000+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:38:45.986000+0000","last_undegraded":"2024-09-14T11:38:45.986000+0000","last_fullsized":"2024-09-14T11:38:45.986000+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:45.985889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:45.985889+0000","last_clean_scrub_stamp":"2024-09-14T11:38:45.985889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:19.682136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:46.786992+0000","last_change":"2024-09-14T11:38:46.786992+0000","last_active":"2024-09-14T11:38:46.786992+0000","last_peered":"2024-09-14T11:38:46.786992+0000","last_clean":"2024-09-14T11:38:46.786992+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:38:46.786992+0000","last_undegraded":"2024-09-14T11:38:46.786992+0000","last_fullsized":"2024-09-14T11:38:46.786992+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:46.786892+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:46.786892+0000","last_clean_scrub_stamp":"2024-09-14T11:38:46.786892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:09.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'7","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.597707+0000","last_change":"2024-09-14T11:38:25.597707+0000","last_active":"2024-09-14T11:38:25.597707+0000","last_peered":"2024-09-14T11:38:25.597707+0000","last_clean":"2024-09-14T11:38:25.597707+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:38:25.597707+0000","last_undegraded":"2024-09-14T11:38:25.597707+0000","last_fullsized":"2024-09-14T11:38:25.597707+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T11:38:25.597618+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T11:38:25.597618+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.597618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:56.197704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5818,"num_write":12,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":239,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.232644+0000","last_change":"2024-09-14T11:38:14.232644+0000","last_active":"2024-09-14T11:38:14.232644+0000","last_peered":"2024-09-14T11:38:14.232644+0000","last_clean":"2024-09-14T11:38:14.232644+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:38:14.232644+0000","last_undegraded":"2024-09-14T11:38:14.232644+0000","last_fullsized":"2024-09-14T11:38:14.232644+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.232551+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:32.602593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:53.737203+0000","last_change":"2024-09-14T11:38:53.737203+0000","last_active":"2024-09-14T11:38:53.737203+0000","last_peered":"2024-09-14T11:38:53.737203+0000","last_clean":"2024-09-14T11:38:53.737203+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:38:53.737203+0000","last_undegraded":"2024-09-14T11:38:53.737203+0000","last_fullsized":"2024-09-14T11:38:53.737203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:53.737107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:53.737107+0000","last_clean_scrub_stamp":"2024-09-14T11:38:53.737107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.181636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.726725+0000","last_change":"2024-09-14T11:38:41.726725+0000","last_active":"2024-09-14T11:38:41.726725+0000","last_peered":"2024-09-14T11:38:41.726725+0000","last_clean":"2024-09-14T11:38:41.726725+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:38:41.726725+0000","last_undegraded":"2024-09-14T11:38:41.726725+0000","last_fullsized":"2024-09-14T11:38:41.726725+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:41.726621+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:41.726621+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.726621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:56.091990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.135997+0000","last_change":"2024-09-14T11:38:35.135997+0000","last_active":"2024-09-14T11:38:35.135997+0000","last_peered":"2024-09-14T11:38:35.135997+0000","last_clean":"2024-09-14T11:38:35.135997+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:38:35.135997+0000","last_undegraded":"2024-09-14T11:38:35.135997+0000","last_fullsized":"2024-09-14T11:38:35.135997+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.135900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.135900+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.135900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:54.513423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.082617+0000","last_change":"2024-09-14T11:38:40.082617+0000","last_active":"2024-09-14T11:38:40.082617+0000","last_peered":"2024-09-14T11:38:40.082617+0000","last_clean":"2024-09-14T11:38:40.082617+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:38:40.082617+0000","last_undegraded":"2024-09-14T11:38:40.082617+0000","last_fullsized":"2024-09-14T11:38:40.082617+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:38:40.082506+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:38:40.082506+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.082506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:13.540395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:49.008194+0000","last_change":"2024-09-14T11:38:49.008194+0000","last_active":"2024-09-14T11:38:49.008194+0000","last_peered":"2024-09-14T11:38:49.008194+0000","last_clean":"2024-09-14T11:38:49.008194+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:38:49.008194+0000","last_undegraded":"2024-09-14T11:38:49.008194+0000","last_fullsized":"2024-09-14T11:38:49.008194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.008099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.008099+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.008099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:14.513189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.881599+0000","last_change":"2024-09-14T11:38:41.881599+0000","last_active":"2024-09-14T11:38:41.881599+0000","last_peered":"2024-09-14T11:38:41.881599+0000","last_clean":"2024-09-14T11:38:41.881599+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:38:41.881599+0000","last_undegraded":"2024-09-14T11:38:41.881599+0000","last_fullsized":"2024-09-14T11:38:41.881599+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:41.881516+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:41.881516+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.881516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:15.002775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.584028+0000","last_change":"2024-09-14T11:38:24.584028+0000","last_active":"2024-09-14T11:38:24.584028+0000","last_peered":"2024-09-14T11:38:24.584028+0000","last_clean":"2024-09-14T11:38:24.584028+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:38:24.584028+0000","last_undegraded":"2024-09-14T11:38:24.584028+0000","last_fullsized":"2024-09-14T11:38:24.584028+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.583945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.583945+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.583945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:05.737365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.851533+0000","last_change":"2024-09-14T11:38:31.851533+0000","last_active":"2024-09-14T11:38:31.851533+0000","last_peered":"2024-09-14T11:38:31.851533+0000","last_clean":"2024-09-14T11:38:31.851533+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:38:31.851533+0000","last_undegraded":"2024-09-14T11:38:31.851533+0000","last_fullsized":"2024-09-14T11:38:31.851533+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:38:31.851446+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:38:31.851446+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.851446+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:51.295376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:48.039964+0000","last_change":"2024-09-14T11:38:48.039964+0000","last_active":"2024-09-14T11:38:48.039964+0000","last_peered":"2024-09-14T11:38:48.039964+0000","last_clean":"2024-09-14T11:38:48.039964+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:38:48.039964+0000","last_undegraded":"2024-09-14T11:38:48.039964+0000","last_fullsized":"2024-09-14T11:38:48.039964+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:48.039841+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:48.039841+0000","last_clean_scrub_stamp":"2024-09-14T11:38:48.039841+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:09.736521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.681807+0000","last_change":"2024-09-14T11:38:32.681807+0000","last_active":"2024-09-14T11:38:32.681807+0000","last_peered":"2024-09-14T11:38:32.681807+0000","last_clean":"2024-09-14T11:38:32.681807+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:38:32.681807+0000","last_undegraded":"2024-09-14T11:38:32.681807+0000","last_fullsized":"2024-09-14T11:38:32.681807+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:32.681671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:32.681671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.681671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:26.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.167877+0000","last_change":"2024-09-14T11:38:36.167877+0000","last_active":"2024-09-14T11:38:36.167877+0000","last_peered":"2024-09-14T11:38:36.167877+0000","last_clean":"2024-09-14T11:38:36.167877+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:38:36.167877+0000","last_undegraded":"2024-09-14T11:38:36.167877+0000","last_fullsized":"2024-09-14T11:38:36.167877+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:36.167789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:36.167789+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.167789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:16.012896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.770709+0000","last_change":"2024-09-14T11:38:36.770709+0000","last_active":"2024-09-14T11:38:36.770709+0000","last_peered":"2024-09-14T11:38:36.770709+0000","last_clean":"2024-09-14T11:38:36.770709+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:38:36.770709+0000","last_undegraded":"2024-09-14T11:38:36.770709+0000","last_fullsized":"2024-09-14T11:38:36.770709+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'248","last_scrub_stamp":"2024-09-14T11:38:36.770636+0000","last_deep_scrub":"264'248","last_deep_scrub_stamp":"2024-09-14T11:38:36.770636+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.770636+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:43.404316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:48.101352+0000","last_change":"2024-09-14T11:38:48.101352+0000","last_active":"2024-09-14T11:38:48.101352+0000","last_peered":"2024-09-14T11:38:48.101352+0000","last_clean":"2024-09-14T11:38:48.101352+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:38:48.101352+0000","last_undegraded":"2024-09-14T11:38:48.101352+0000","last_fullsized":"2024-09-14T11:38:48.101352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:48.101259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:48.101259+0000","last_clean_scrub_stamp":"2024-09-14T11:38:48.101259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:14.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.926582+0000","last_change":"2024-09-14T11:38:42.926582+0000","last_active":"2024-09-14T11:38:42.926582+0000","last_peered":"2024-09-14T11:38:42.926582+0000","last_clean":"2024-09-14T11:38:42.926582+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:38:42.926582+0000","last_undegraded":"2024-09-14T11:38:42.926582+0000","last_fullsized":"2024-09-14T11:38:42.926582+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:42.926493+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:42.926493+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.926493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:58.198895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.719094+0000","last_change":"2024-09-14T11:38:32.719094+0000","last_active":"2024-09-14T11:38:32.719094+0000","last_peered":"2024-09-14T11:38:32.719094+0000","last_clean":"2024-09-14T11:38:32.719094+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:38:32.719094+0000","last_undegraded":"2024-09-14T11:38:32.719094+0000","last_fullsized":"2024-09-14T11:38:32.719094+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:32.718994+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:32.718994+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.718994+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:41.459421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.083052+0000","last_change":"2024-09-14T11:38:23.082992+0000","last_active":"2024-09-14T11:38:23.083052+0000","last_peered":"2024-09-14T11:38:23.083052+0000","last_clean":"2024-09-14T11:38:23.083052+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:38:23.083052+0000","last_undegraded":"2024-09-14T11:38:23.083052+0000","last_fullsized":"2024-09-14T11:38:23.083052+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-14T11:38:23.082907+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-14T11:38:23.082907+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.082907+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:32.531355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.921568+0000","last_change":"2024-09-14T11:38:43.921568+0000","last_active":"2024-09-14T11:38:43.921568+0000","last_peered":"2024-09-14T11:38:43.921568+0000","last_clean":"2024-09-14T11:38:43.921568+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:38:43.921568+0000","last_undegraded":"2024-09-14T11:38:43.921568+0000","last_fullsized":"2024-09-14T11:38:43.921568+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:43.921483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:43.921483+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.921483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:47.997625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.081736+0000","last_change":"2024-09-14T11:38:42.081736+0000","last_active":"2024-09-14T11:38:42.081736+0000","last_peered":"2024-09-14T11:38:42.081736+0000","last_clean":"2024-09-14T11:38:42.081736+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:38:42.081736+0000","last_undegraded":"2024-09-14T11:38:42.081736+0000","last_fullsized":"2024-09-14T11:38:42.081736+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:38:42.081620+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:38:42.081620+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.081620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:30.371851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.914748+0000","last_change":"2024-09-14T11:38:36.914748+0000","last_active":"2024-09-14T11:38:36.914748+0000","last_peered":"2024-09-14T11:38:36.914748+0000","last_clean":"2024-09-14T11:38:36.914748+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:38:36.914748+0000","last_undegraded":"2024-09-14T11:38:36.914748+0000","last_fullsized":"2024-09-14T11:38:36.914748+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-14T11:38:36.914662+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-14T11:38:36.914662+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.914662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:34.076485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.129537+0000","last_change":"2024-09-14T11:38:43.129537+0000","last_active":"2024-09-14T11:38:43.129537+0000","last_peered":"2024-09-14T11:38:43.129537+0000","last_clean":"2024-09-14T11:38:43.129537+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:38:43.129537+0000","last_undegraded":"2024-09-14T11:38:43.129537+0000","last_fullsized":"2024-09-14T11:38:43.129537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:38:43.129443+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:38:43.129443+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.129443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:36.921182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.138591+0000","last_change":"2024-09-14T11:38:40.138591+0000","last_active":"2024-09-14T11:38:40.138591+0000","last_peered":"2024-09-14T11:38:40.138591+0000","last_clean":"2024-09-14T11:38:40.138591+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:38:40.138591+0000","last_undegraded":"2024-09-14T11:38:40.138591+0000","last_fullsized":"2024-09-14T11:38:40.138591+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:40.138501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:40.138501+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.138501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:46.107619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.057457+0000","last_change":"2024-09-14T11:38:41.057457+0000","last_active":"2024-09-14T11:38:41.057457+0000","last_peered":"2024-09-14T11:38:41.057457+0000","last_clean":"2024-09-14T11:38:41.057457+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:38:41.057457+0000","last_undegraded":"2024-09-14T11:38:41.057457+0000","last_fullsized":"2024-09-14T11:38:41.057457+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:41.057357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:41.057357+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.057357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:30.519904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'3","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.256752+0000","last_change":"2024-09-14T11:38:17.256752+0000","last_active":"2024-09-14T11:38:17.256752+0000","last_peered":"2024-09-14T11:38:17.256752+0000","last_clean":"2024-09-14T11:38:17.256752+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:38:17.256752+0000","last_undegraded":"2024-09-14T11:38:17.256752+0000","last_fullsized":"2024-09-14T11:38:17.256752+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:17.256651+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:17.256651+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.256651+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:48.299275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.106318+0000","last_change":"2024-09-14T11:38:21.106250+0000","last_active":"2024-09-14T11:38:21.106318+0000","last_peered":"2024-09-14T11:38:21.106318+0000","last_clean":"2024-09-14T11:38:21.106318+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:38:21.106318+0000","last_undegraded":"2024-09-14T11:38:21.106318+0000","last_fullsized":"2024-09-14T11:38:21.106318+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:21.106166+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:21.106166+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.106166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.598437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.688740+0000","last_change":"2024-09-14T11:38:31.688664+0000","last_active":"2024-09-14T11:38:31.688740+0000","last_peered":"2024-09-14T11:38:31.688740+0000","last_clean":"2024-09-14T11:38:31.688740+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:38:31.688740+0000","last_undegraded":"2024-09-14T11:38:31.688740+0000","last_fullsized":"2024-09-14T11:38:31.688740+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.688568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.688568+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.688568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:55.762970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.894110+0000","last_change":"2024-09-14T11:38:40.894110+0000","last_active":"2024-09-14T11:38:40.894110+0000","last_peered":"2024-09-14T11:38:40.894110+0000","last_clean":"2024-09-14T11:38:40.894110+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:38:40.894110+0000","last_undegraded":"2024-09-14T11:38:40.894110+0000","last_fullsized":"2024-09-14T11:38:40.894110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:40.894015+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:40.894015+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.894015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:16.069269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.113900+0000","last_change":"2024-09-14T11:38:33.113900+0000","last_active":"2024-09-14T11:38:33.113900+0000","last_peered":"2024-09-14T11:38:33.113900+0000","last_clean":"2024-09-14T11:38:33.113900+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:38:33.113900+0000","last_undegraded":"2024-09-14T11:38:33.113900+0000","last_fullsized":"2024-09-14T11:38:33.113900+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:33.113815+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:33.113815+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.113815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.192334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.876684+0000","last_change":"2024-09-14T11:38:30.876684+0000","last_active":"2024-09-14T11:38:30.876684+0000","last_peered":"2024-09-14T11:38:30.876684+0000","last_clean":"2024-09-14T11:38:30.876684+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:38:30.876684+0000","last_undegraded":"2024-09-14T11:38:30.876684+0000","last_fullsized":"2024-09-14T11:38:30.876684+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:30.876588+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:30.876588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.876588+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:46.926427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.736648+0000","last_change":"2024-09-14T11:38:43.736648+0000","last_active":"2024-09-14T11:38:43.736648+0000","last_peered":"2024-09-14T11:38:43.736648+0000","last_clean":"2024-09-14T11:38:43.736648+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:38:43.736648+0000","last_undegraded":"2024-09-14T11:38:43.736648+0000","last_fullsized":"2024-09-14T11:38:43.736648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:43.736561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:43.736561+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.736561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:33.826073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.743956+0000","last_change":"2024-09-14T11:38:39.743956+0000","last_active":"2024-09-14T11:38:39.743956+0000","last_peered":"2024-09-14T11:38:39.743956+0000","last_clean":"2024-09-14T11:38:39.743956+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:38:39.743956+0000","last_undegraded":"2024-09-14T11:38:39.743956+0000","last_fullsized":"2024-09-14T11:38:39.743956+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:39.743823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:39.743823+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.743823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:58.861276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.870952+0000","last_change":"2024-09-14T11:38:37.870952+0000","last_active":"2024-09-14T11:38:37.870952+0000","last_peered":"2024-09-14T11:38:37.870952+0000","last_clean":"2024-09-14T11:38:37.870952+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:38:37.870952+0000","last_undegraded":"2024-09-14T11:38:37.870952+0000","last_fullsized":"2024-09-14T11:38:37.870952+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:37.870849+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:37.870849+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.870849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:10.849434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.642390+0000","last_change":"2024-09-14T11:38:21.642390+0000","last_active":"2024-09-14T11:38:21.642390+0000","last_peered":"2024-09-14T11:38:21.642390+0000","last_clean":"2024-09-14T11:38:21.642390+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:38:21.642390+0000","last_undegraded":"2024-09-14T11:38:21.642390+0000","last_fullsized":"2024-09-14T11:38:21.642390+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-14T11:38:21.642290+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-14T11:38:21.642290+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.642290+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:06.797363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.160166+0000","last_change":"2024-09-14T11:38:21.160166+0000","last_active":"2024-09-14T11:38:21.160166+0000","last_peered":"2024-09-14T11:38:21.160166+0000","last_clean":"2024-09-14T11:38:21.160166+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:38:21.160166+0000","last_undegraded":"2024-09-14T11:38:21.160166+0000","last_fullsized":"2024-09-14T11:38:21.160166+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:21.160076+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:21.160076+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.160076+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:20.453418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.643397+0000","last_change":"2024-09-14T11:38:27.643397+0000","last_active":"2024-09-14T11:38:27.643397+0000","last_peered":"2024-09-14T11:38:27.643397+0000","last_clean":"2024-09-14T11:38:27.643397+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:38:27.643397+0000","last_undegraded":"2024-09-14T11:38:27.643397+0000","last_fullsized":"2024-09-14T11:38:27.643397+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:27.643298+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:27.643298+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.643298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:40.241405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15360,"num_write":13,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.929445+0000","last_change":"2024-09-14T11:38:34.929445+0000","last_active":"2024-09-14T11:38:34.929445+0000","last_peered":"2024-09-14T11:38:34.929445+0000","last_clean":"2024-09-14T11:38:34.929445+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:38:34.929445+0000","last_undegraded":"2024-09-14T11:38:34.929445+0000","last_fullsized":"2024-09-14T11:38:34.929445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:38:34.929324+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:38:34.929324+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.929324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:45.170707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.167744+0000","last_change":"2024-09-14T11:38:31.167744+0000","last_active":"2024-09-14T11:38:31.167744+0000","last_peered":"2024-09-14T11:38:31.167744+0000","last_clean":"2024-09-14T11:38:31.167744+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:38:31.167744+0000","last_undegraded":"2024-09-14T11:38:31.167744+0000","last_fullsized":"2024-09-14T11:38:31.167744+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-14T11:38:31.167653+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-14T11:38:31.167653+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.167653+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:09.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:51.119687+0000","last_change":"2024-09-14T11:38:51.119687+0000","last_active":"2024-09-14T11:38:51.119687+0000","last_peered":"2024-09-14T11:38:51.119687+0000","last_clean":"2024-09-14T11:38:51.119687+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:38:51.119687+0000","last_undegraded":"2024-09-14T11:38:51.119687+0000","last_fullsized":"2024-09-14T11:38:51.119687+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:51.119596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:51.119596+0000","last_clean_scrub_stamp":"2024-09-14T11:38:51.119596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:50.062227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.112467+0000","last_change":"2024-09-14T11:38:35.112467+0000","last_active":"2024-09-14T11:38:35.112467+0000","last_peered":"2024-09-14T11:38:35.112467+0000","last_clean":"2024-09-14T11:38:35.112467+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:38:35.112467+0000","last_undegraded":"2024-09-14T11:38:35.112467+0000","last_fullsized":"2024-09-14T11:38:35.112467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.112350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.112350+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.112350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:57.206879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.900633+0000","last_change":"2024-09-14T11:38:35.900633+0000","last_active":"2024-09-14T11:38:35.900633+0000","last_peered":"2024-09-14T11:38:35.900633+0000","last_clean":"2024-09-14T11:38:35.900633+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:38:35.900633+0000","last_undegraded":"2024-09-14T11:38:35.900633+0000","last_fullsized":"2024-09-14T11:38:35.900633+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.900549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.900549+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.900549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:34.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.773313+0000","last_change":"2024-09-14T11:38:30.773313+0000","last_active":"2024-09-14T11:38:30.773313+0000","last_peered":"2024-09-14T11:38:30.773313+0000","last_clean":"2024-09-14T11:38:30.773313+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:38:30.773313+0000","last_undegraded":"2024-09-14T11:38:30.773313+0000","last_fullsized":"2024-09-14T11:38:30.773313+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-14T11:38:30.773214+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-14T11:38:30.773214+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.773214+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:47.034372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:45.098197+0000","last_change":"2024-09-14T11:38:45.098197+0000","last_active":"2024-09-14T11:38:45.098197+0000","last_peered":"2024-09-14T11:38:45.098197+0000","last_clean":"2024-09-14T11:38:45.098197+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:38:45.098197+0000","last_undegraded":"2024-09-14T11:38:45.098197+0000","last_fullsized":"2024-09-14T11:38:45.098197+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:45.098109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:45.098109+0000","last_clean_scrub_stamp":"2024-09-14T11:38:45.098109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:17.010994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'5","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.960050+0000","last_change":"2024-09-14T11:38:27.960050+0000","last_active":"2024-09-14T11:38:27.960050+0000","last_peered":"2024-09-14T11:38:27.960050+0000","last_clean":"2024-09-14T11:38:27.960050+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:38:27.960050+0000","last_undegraded":"2024-09-14T11:38:27.960050+0000","last_fullsized":"2024-09-14T11:38:27.960050+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:27.959939+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:27.959939+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.959939+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:05.403275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.597102+0000","last_change":"2024-09-14T11:38:22.597102+0000","last_active":"2024-09-14T11:38:22.597102+0000","last_peered":"2024-09-14T11:38:22.597102+0000","last_clean":"2024-09-14T11:38:22.597102+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:38:22.597102+0000","last_undegraded":"2024-09-14T11:38:22.597102+0000","last_fullsized":"2024-09-14T11:38:22.597102+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.597007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.597007+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.597007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:05.834802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.087648+0000","last_change":"2024-09-14T11:38:20.087648+0000","last_active":"2024-09-14T11:38:20.087648+0000","last_peered":"2024-09-14T11:38:20.087648+0000","last_clean":"2024-09-14T11:38:20.087648+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:38:20.087648+0000","last_undegraded":"2024-09-14T11:38:20.087648+0000","last_fullsized":"2024-09-14T11:38:20.087648+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:38:20.087560+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:38:20.087560+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.087560+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:46.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:44.960733+0000","last_change":"2024-09-14T11:38:44.960733+0000","last_active":"2024-09-14T11:38:44.960733+0000","last_peered":"2024-09-14T11:38:44.960733+0000","last_clean":"2024-09-14T11:38:44.960733+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:38:44.960733+0000","last_undegraded":"2024-09-14T11:38:44.960733+0000","last_fullsized":"2024-09-14T11:38:44.960733+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:44.960645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:44.960645+0000","last_clean_scrub_stamp":"2024-09-14T11:38:44.960645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:02.550080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.694928+0000","last_change":"2024-09-14T11:38:38.694928+0000","last_active":"2024-09-14T11:38:38.694928+0000","last_peered":"2024-09-14T11:38:38.694928+0000","last_clean":"2024-09-14T11:38:38.694928+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:38:38.694928+0000","last_undegraded":"2024-09-14T11:38:38.694928+0000","last_fullsized":"2024-09-14T11:38:38.694928+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:38.694827+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:38.694827+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.694827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:06.537666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.082979+0000","last_change":"2024-09-14T11:38:25.082979+0000","last_active":"2024-09-14T11:38:25.082979+0000","last_peered":"2024-09-14T11:38:25.082979+0000","last_clean":"2024-09-14T11:38:25.082979+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:38:25.082979+0000","last_undegraded":"2024-09-14T11:38:25.082979+0000","last_fullsized":"2024-09-14T11:38:25.082979+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:25.082876+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:25.082876+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.082876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.073078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.918172+0000","last_change":"2024-09-14T11:38:29.918172+0000","last_active":"2024-09-14T11:38:29.918172+0000","last_peered":"2024-09-14T11:38:29.918172+0000","last_clean":"2024-09-14T11:38:29.918172+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:38:29.918172+0000","last_undegraded":"2024-09-14T11:38:29.918172+0000","last_fullsized":"2024-09-14T11:38:29.918172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-14T11:38:29.918087+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-14T11:38:29.918087+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.918087+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:05.376556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'354","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.994434+0000","last_change":"2024-09-14T11:38:03.994434+0000","last_active":"2024-09-14T11:38:03.994434+0000","last_peered":"2024-09-14T11:38:03.994434+0000","last_clean":"2024-09-14T11:38:03.994434+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:38:03.994434+0000","last_undegraded":"2024-09-14T11:38:03.994434+0000","last_fullsized":"2024-09-14T11:38:03.994434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.994337+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:32.808942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":710,"num_read_kb":163807,"num_write":1157,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.995380+0000","last_change":"2024-09-14T11:38:12.995303+0000","last_active":"2024-09-14T11:38:12.995380+0000","last_peered":"2024-09-14T11:38:12.995380+0000","last_clean":"2024-09-14T11:38:12.995380+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:38:12.995380+0000","last_undegraded":"2024-09-14T11:38:12.995380+0000","last_fullsized":"2024-09-14T11:38:12.995380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-14T11:38:12.995220+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-14T11:38:12.995220+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.995220+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:25.650124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'345","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.525749+0000","last_change":"2024-09-14T11:38:00.525749+0000","last_active":"2024-09-14T11:38:00.525749+0000","last_peered":"2024-09-14T11:38:00.525749+0000","last_clean":"2024-09-14T11:38:00.525749+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:38:00.525749+0000","last_undegraded":"2024-09-14T11:38:00.525749+0000","last_fullsized":"2024-09-14T11:38:00.525749+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.525650+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:10.105566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":38007,"num_write":1094,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.938542+0000","last_change":"2024-09-14T11:38:12.938486+0000","last_active":"2024-09-14T11:38:12.938542+0000","last_peered":"2024-09-14T11:38:12.938542+0000","last_clean":"2024-09-14T11:38:12.938542+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:38:12.938542+0000","last_undegraded":"2024-09-14T11:38:12.938542+0000","last_fullsized":"2024-09-14T11:38:12.938542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'80","last_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_deep_scrub":"264'80","last_deep_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.938395+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:21.819088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'358","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.091285+0000","last_change":"2024-09-14T11:38:03.091285+0000","last_active":"2024-09-14T11:38:03.091285+0000","last_peered":"2024-09-14T11:38:03.091285+0000","last_clean":"2024-09-14T11:38:03.091285+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:38:03.091285+0000","last_undegraded":"2024-09-14T11:38:03.091285+0000","last_fullsized":"2024-09-14T11:38:03.091285+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.091169+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:56.915196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":108632,"num_write":1075,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.782068+0000","last_change":"2024-09-14T11:38:14.781958+0000","last_active":"2024-09-14T11:38:14.782068+0000","last_peered":"2024-09-14T11:38:14.782068+0000","last_clean":"2024-09-14T11:38:14.782068+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:38:14.782068+0000","last_undegraded":"2024-09-14T11:38:14.782068+0000","last_fullsized":"2024-09-14T11:38:14.782068+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'576","last_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_deep_scrub":"264'576","last_deep_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.781853+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:29.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'362","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.332890+0000","last_change":"2024-09-14T11:37:58.332811+0000","last_active":"2024-09-14T11:37:58.332890+0000","last_peered":"2024-09-14T11:37:58.332890+0000","last_clean":"2024-09-14T11:37:58.332890+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:37:58.332890+0000","last_undegraded":"2024-09-14T11:37:58.332890+0000","last_fullsized":"2024-09-14T11:37:58.332890+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.332673+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.730339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":34002,"num_write":1219,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.136771+0000","last_change":"2024-09-14T11:38:09.136696+0000","last_active":"2024-09-14T11:38:09.136771+0000","last_peered":"2024-09-14T11:38:09.136771+0000","last_clean":"2024-09-14T11:38:09.136771+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:38:09.136771+0000","last_undegraded":"2024-09-14T11:38:09.136771+0000","last_fullsized":"2024-09-14T11:38:09.136771+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.136612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:07.052131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'371","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.973477+0000","last_change":"2024-09-14T11:38:07.973421+0000","last_active":"2024-09-14T11:38:07.973477+0000","last_peered":"2024-09-14T11:38:07.973477+0000","last_clean":"2024-09-14T11:38:07.973477+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:38:07.973477+0000","last_undegraded":"2024-09-14T11:38:07.973477+0000","last_fullsized":"2024-09-14T11:38:07.973477+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'371","last_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_deep_scrub":"264'371","last_deep_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.973335+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.083071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":613,"num_read_kb":21029,"num_write":1146,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.191435+0000","last_change":"2024-09-14T11:38:06.191360+0000","last_active":"2024-09-14T11:38:06.191435+0000","last_peered":"2024-09-14T11:38:06.191435+0000","last_clean":"2024-09-14T11:38:06.191435+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:38:06.191435+0000","last_undegraded":"2024-09-14T11:38:06.191435+0000","last_fullsized":"2024-09-14T11:38:06.191435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.191241+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'405","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.977470+0000","last_change":"2024-09-14T11:38:07.977410+0000","last_active":"2024-09-14T11:38:07.977470+0000","last_peered":"2024-09-14T11:38:07.977470+0000","last_clean":"2024-09-14T11:38:07.977470+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:38:07.977470+0000","last_undegraded":"2024-09-14T11:38:07.977470+0000","last_fullsized":"2024-09-14T11:38:07.977470+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.977308+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.168772+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":29480,"num_write":1192,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4188","reported_seq":4829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.832213+0000","last_change":"2024-09-14T11:38:13.832213+0000","last_active":"2024-09-14T11:38:13.832213+0000","last_peered":"2024-09-14T11:38:13.832213+0000","last_clean":"2024-09-14T11:38:13.832213+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:38:13.832213+0000","last_undegraded":"2024-09-14T11:38:13.832213+0000","last_fullsized":"2024-09-14T11:38:13.832213+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4188","last_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_deep_scrub":"264'4188","last_deep_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.832127+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:18.131503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2876,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'345","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.954563+0000","last_change":"2024-09-14T11:38:02.954476+0000","last_active":"2024-09-14T11:38:02.954563+0000","last_peered":"2024-09-14T11:38:02.954563+0000","last_clean":"2024-09-14T11:38:02.954563+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:38:02.954563+0000","last_undegraded":"2024-09-14T11:38:02.954563+0000","last_fullsized":"2024-09-14T11:38:02.954563+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.954347+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:07.261862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":8679,"num_write":1155,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.013337+0000","last_change":"2024-09-14T11:38:12.013337+0000","last_active":"2024-09-14T11:38:12.013337+0000","last_peered":"2024-09-14T11:38:12.013337+0000","last_clean":"2024-09-14T11:38:12.013337+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:38:12.013337+0000","last_undegraded":"2024-09-14T11:38:12.013337+0000","last_fullsized":"2024-09-14T11:38:12.013337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.013236+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.617466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'444","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.704148+0000","last_change":"2024-09-14T11:38:02.704052+0000","last_active":"2024-09-14T11:38:02.704148+0000","last_peered":"2024-09-14T11:38:02.704148+0000","last_clean":"2024-09-14T11:38:02.704148+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:38:02.704148+0000","last_undegraded":"2024-09-14T11:38:02.704148+0000","last_fullsized":"2024-09-14T11:38:02.704148+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'444","last_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_deep_scrub":"264'444","last_deep_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.703931+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.189735+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1027,"num_read_kb":48878,"num_write":1330,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.285228+0000","last_change":"2024-09-14T11:38:05.285228+0000","last_active":"2024-09-14T11:38:05.285228+0000","last_peered":"2024-09-14T11:38:05.285228+0000","last_clean":"2024-09-14T11:38:05.285228+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:38:05.285228+0000","last_undegraded":"2024-09-14T11:38:05.285228+0000","last_fullsized":"2024-09-14T11:38:05.285228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.285135+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:29.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.838913+0000","last_change":"2024-09-14T11:38:10.838913+0000","last_active":"2024-09-14T11:38:10.838913+0000","last_peered":"2024-09-14T11:38:10.838913+0000","last_clean":"2024-09-14T11:38:10.838913+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:38:10.838913+0000","last_undegraded":"2024-09-14T11:38:10.838913+0000","last_fullsized":"2024-09-14T11:38:10.838913+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.838796+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:42.132159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'355","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.289296+0000","last_change":"2024-09-14T11:37:57.289296+0000","last_active":"2024-09-14T11:37:57.289296+0000","last_peered":"2024-09-14T11:37:57.289296+0000","last_clean":"2024-09-14T11:37:57.289296+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:37:57.289296+0000","last_undegraded":"2024-09-14T11:37:57.289296+0000","last_fullsized":"2024-09-14T11:37:57.289296+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.289198+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:54.356710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":655,"num_read_kb":81454,"num_write":1158,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.996771+0000","last_change":"2024-09-14T11:38:10.996771+0000","last_active":"2024-09-14T11:38:10.996771+0000","last_peered":"2024-09-14T11:38:10.996771+0000","last_clean":"2024-09-14T11:38:10.996771+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:38:10.996771+0000","last_undegraded":"2024-09-14T11:38:10.996771+0000","last_fullsized":"2024-09-14T11:38:10.996771+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.996672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:38.298661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'372","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.204888+0000","last_change":"2024-09-14T11:38:02.204888+0000","last_active":"2024-09-14T11:38:02.204888+0000","last_peered":"2024-09-14T11:38:02.204888+0000","last_clean":"2024-09-14T11:38:02.204888+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:38:02.204888+0000","last_undegraded":"2024-09-14T11:38:02.204888+0000","last_fullsized":"2024-09-14T11:38:02.204888+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.204768+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:29.702067+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1102,"num_read_kb":13751,"num_write":1178,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.996363+0000","last_change":"2024-09-14T11:38:09.996296+0000","last_active":"2024-09-14T11:38:09.996363+0000","last_peered":"2024-09-14T11:38:09.996363+0000","last_clean":"2024-09-14T11:38:09.996363+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:38:09.996363+0000","last_undegraded":"2024-09-14T11:38:09.996363+0000","last_fullsized":"2024-09-14T11:38:09.996363+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.996212+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.770213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'324","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.247962+0000","last_change":"2024-09-14T11:38:01.247962+0000","last_active":"2024-09-14T11:38:01.247962+0000","last_peered":"2024-09-14T11:38:01.247962+0000","last_clean":"2024-09-14T11:38:01.247962+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:38:01.247962+0000","last_undegraded":"2024-09-14T11:38:01.247962+0000","last_fullsized":"2024-09-14T11:38:01.247962+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.247834+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:08.750152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":2147,"num_write":1090,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.263789+0000","last_change":"2024-09-14T11:38:02.263789+0000","last_active":"2024-09-14T11:38:02.263789+0000","last_peered":"2024-09-14T11:38:02.263789+0000","last_clean":"2024-09-14T11:38:02.263789+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:38:02.263789+0000","last_undegraded":"2024-09-14T11:38:02.263789+0000","last_fullsized":"2024-09-14T11:38:02.263789+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.263694+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:48.528551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'372","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.783570+0000","last_change":"2024-09-14T11:37:57.783570+0000","last_active":"2024-09-14T11:37:57.783570+0000","last_peered":"2024-09-14T11:37:57.783570+0000","last_clean":"2024-09-14T11:37:57.783570+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:57.783570+0000","last_undegraded":"2024-09-14T11:37:57.783570+0000","last_fullsized":"2024-09-14T11:37:57.783570+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.783470+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:52.425734+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655890,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":45139,"num_write":1131,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.254892+0000","last_change":"2024-09-14T11:38:03.254892+0000","last_active":"2024-09-14T11:38:03.254892+0000","last_peered":"2024-09-14T11:38:03.254892+0000","last_clean":"2024-09-14T11:38:03.254892+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:38:03.254892+0000","last_undegraded":"2024-09-14T11:38:03.254892+0000","last_fullsized":"2024-09-14T11:38:03.254892+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.254797+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:24.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'359","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.750138+0000","last_change":"2024-09-14T11:38:03.750138+0000","last_active":"2024-09-14T11:38:03.750138+0000","last_peered":"2024-09-14T11:38:03.750138+0000","last_clean":"2024-09-14T11:38:03.750138+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:38:03.750138+0000","last_undegraded":"2024-09-14T11:38:03.750138+0000","last_fullsized":"2024-09-14T11:38:03.750138+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.750052+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:22.099690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":91641,"num_write":1162,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.839755+0000","last_change":"2024-09-14T11:38:12.839755+0000","last_active":"2024-09-14T11:38:12.839755+0000","last_peered":"2024-09-14T11:38:12.839755+0000","last_clean":"2024-09-14T11:38:12.839755+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:38:12.839755+0000","last_undegraded":"2024-09-14T11:38:12.839755+0000","last_fullsized":"2024-09-14T11:38:12.839755+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.839644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:27.847410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'339","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.127997+0000","last_change":"2024-09-14T11:38:00.127943+0000","last_active":"2024-09-14T11:38:00.127997+0000","last_peered":"2024-09-14T11:38:00.127997+0000","last_clean":"2024-09-14T11:38:00.127997+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:38:00.127997+0000","last_undegraded":"2024-09-14T11:38:00.127997+0000","last_fullsized":"2024-09-14T11:38:00.127997+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.127836+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:41.934910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":12785,"num_write":1085,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'138","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.786566+0000","last_change":"2024-09-14T11:38:29.786566+0000","last_active":"2024-09-14T11:38:29.786566+0000","last_peered":"2024-09-14T11:38:29.786566+0000","last_clean":"2024-09-14T11:38:29.786566+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:38:29.786566+0000","last_undegraded":"2024-09-14T11:38:29.786566+0000","last_fullsized":"2024-09-14T11:38:29.786566+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:29.786476+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:29.786476+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.786476+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:15.053081+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.802655+0000","last_change":"2024-09-14T11:38:07.802553+0000","last_active":"2024-09-14T11:38:07.802655+0000","last_peered":"2024-09-14T11:38:07.802655+0000","last_clean":"2024-09-14T11:38:07.802655+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:38:07.802655+0000","last_undegraded":"2024-09-14T11:38:07.802655+0000","last_fullsized":"2024-09-14T11:38:07.802655+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.802440+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:22.163602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'369","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.971493+0000","last_change":"2024-09-14T11:38:01.971426+0000","last_active":"2024-09-14T11:38:01.971493+0000","last_peered":"2024-09-14T11:38:01.971493+0000","last_clean":"2024-09-14T11:38:01.971493+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:38:01.971493+0000","last_undegraded":"2024-09-14T11:38:01.971493+0000","last_fullsized":"2024-09-14T11:38:01.971493+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.971327+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:34.955599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":841,"num_read_kb":1723,"num_write":1205,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.915505+0000","last_change":"2024-09-14T11:38:14.915505+0000","last_active":"2024-09-14T11:38:14.915505+0000","last_peered":"2024-09-14T11:38:14.915505+0000","last_clean":"2024-09-14T11:38:14.915505+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:38:14.915505+0000","last_undegraded":"2024-09-14T11:38:14.915505+0000","last_fullsized":"2024-09-14T11:38:14.915505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.915421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.915421+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.915421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:26.590941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'369","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.048922+0000","last_change":"2024-09-14T11:38:17.048922+0000","last_active":"2024-09-14T11:38:17.048922+0000","last_peered":"2024-09-14T11:38:17.048922+0000","last_clean":"2024-09-14T11:38:17.048922+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:38:17.048922+0000","last_undegraded":"2024-09-14T11:38:17.048922+0000","last_fullsized":"2024-09-14T11:38:17.048922+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:17.048831+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:17.048831+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.048831+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:36.197526+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48907,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":593,"num_read_kb":1292,"num_write":484,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.865065+0000","last_change":"2024-09-14T11:38:25.865065+0000","last_active":"2024-09-14T11:38:25.865065+0000","last_peered":"2024-09-14T11:38:25.865065+0000","last_clean":"2024-09-14T11:38:25.865065+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:38:25.865065+0000","last_undegraded":"2024-09-14T11:38:25.865065+0000","last_fullsized":"2024-09-14T11:38:25.865065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.864975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.864975+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.864975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:21.699201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2491","reported_seq":4312,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.073340+0000","last_change":"2024-09-14T11:38:29.073340+0000","last_active":"2024-09-14T11:38:29.073340+0000","last_peered":"2024-09-14T11:38:29.073340+0000","last_clean":"2024-09-14T11:38:29.073340+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:38:29.073340+0000","last_undegraded":"2024-09-14T11:38:29.073340+0000","last_fullsized":"2024-09-14T11:38:29.073340+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2491","last_scrub_stamp":"2024-09-14T11:38:29.073250+0000","last_deep_scrub":"264'2491","last_deep_scrub_stamp":"2024-09-14T11:38:29.073250+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.073250+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":2400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:11.514402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.933553+0000","last_change":"2024-09-14T11:38:05.933553+0000","last_active":"2024-09-14T11:38:05.933553+0000","last_peered":"2024-09-14T11:38:05.933553+0000","last_clean":"2024-09-14T11:38:05.933553+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:38:05.933553+0000","last_undegraded":"2024-09-14T11:38:05.933553+0000","last_fullsized":"2024-09-14T11:38:05.933553+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'270","last_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_deep_scrub":"264'270","last_deep_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.933442+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:27.514791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'317","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.214481+0000","last_change":"2024-09-14T11:37:54.214379+0000","last_active":"2024-09-14T11:37:54.214481+0000","last_peered":"2024-09-14T11:37:54.214481+0000","last_clean":"2024-09-14T11:37:54.214481+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:37:54.214481+0000","last_undegraded":"2024-09-14T11:37:54.214481+0000","last_fullsized":"2024-09-14T11:37:54.214481+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.214277+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:04.066988+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":41365,"num_write":992,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.763743+0000","last_change":"2024-09-14T11:38:14.763679+0000","last_active":"2024-09-14T11:38:14.763743+0000","last_peered":"2024-09-14T11:38:14.763743+0000","last_clean":"2024-09-14T11:38:14.763743+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:38:14.763743+0000","last_undegraded":"2024-09-14T11:38:14.763743+0000","last_fullsized":"2024-09-14T11:38:14.763743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.763569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:12.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'92","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.791514+0000","last_change":"2024-09-14T11:38:22.791514+0000","last_active":"2024-09-14T11:38:22.791514+0000","last_peered":"2024-09-14T11:38:22.791514+0000","last_clean":"2024-09-14T11:38:22.791514+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:38:22.791514+0000","last_undegraded":"2024-09-14T11:38:22.791514+0000","last_fullsized":"2024-09-14T11:38:22.791514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:22.791422+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:22.791422+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.791422+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.156792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.769667+0000","last_change":"2024-09-14T11:38:24.769667+0000","last_active":"2024-09-14T11:38:24.769667+0000","last_peered":"2024-09-14T11:38:24.769667+0000","last_clean":"2024-09-14T11:38:24.769667+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:38:24.769667+0000","last_undegraded":"2024-09-14T11:38:24.769667+0000","last_fullsized":"2024-09-14T11:38:24.769667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.769582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.769582+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.769582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:27.142757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'130","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.059020+0000","last_change":"2024-09-14T11:38:29.058959+0000","last_active":"2024-09-14T11:38:29.059020+0000","last_peered":"2024-09-14T11:38:29.059020+0000","last_clean":"2024-09-14T11:38:29.059020+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:38:29.059020+0000","last_undegraded":"2024-09-14T11:38:29.059020+0000","last_fullsized":"2024-09-14T11:38:29.059020+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-14T11:38:29.058858+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-14T11:38:29.058858+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.058858+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:10.343975+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.169189+0000","last_change":"2024-09-14T11:38:06.169189+0000","last_active":"2024-09-14T11:38:06.169189+0000","last_peered":"2024-09-14T11:38:06.169189+0000","last_clean":"2024-09-14T11:38:06.169189+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:38:06.169189+0000","last_undegraded":"2024-09-14T11:38:06.169189+0000","last_fullsized":"2024-09-14T11:38:06.169189+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.169106+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:13.055830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'356","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.996393+0000","last_change":"2024-09-14T11:37:58.996323+0000","last_active":"2024-09-14T11:37:58.996393+0000","last_peered":"2024-09-14T11:37:58.996393+0000","last_clean":"2024-09-14T11:37:58.996393+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:37:58.996393+0000","last_undegraded":"2024-09-14T11:37:58.996393+0000","last_fullsized":"2024-09-14T11:37:58.996393+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.996219+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:49.905581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":14993,"num_write":1137,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.757556+0000","last_change":"2024-09-14T11:38:20.757556+0000","last_active":"2024-09-14T11:38:20.757556+0000","last_peered":"2024-09-14T11:38:20.757556+0000","last_clean":"2024-09-14T11:38:20.757556+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:38:20.757556+0000","last_undegraded":"2024-09-14T11:38:20.757556+0000","last_fullsized":"2024-09-14T11:38:20.757556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:20.757467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:20.757467+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.757467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:01.473105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'119","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.313893+0000","last_change":"2024-09-14T11:38:10.313797+0000","last_active":"2024-09-14T11:38:10.313893+0000","last_peered":"2024-09-14T11:38:10.313893+0000","last_clean":"2024-09-14T11:38:10.313893+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:38:10.313893+0000","last_undegraded":"2024-09-14T11:38:10.313893+0000","last_fullsized":"2024-09-14T11:38:10.313893+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.313671+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:12.772415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'761","reported_seq":2186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.840184+0000","last_change":"2024-09-14T11:38:24.840184+0000","last_active":"2024-09-14T11:38:24.840184+0000","last_peered":"2024-09-14T11:38:24.840184+0000","last_clean":"2024-09-14T11:38:24.840184+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:38:24.840184+0000","last_undegraded":"2024-09-14T11:38:24.840184+0000","last_fullsized":"2024-09-14T11:38:24.840184+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-14T11:38:24.840088+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-14T11:38:24.840088+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.840088+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:31.800651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'243","reported_seq":1120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.749120+0000","last_change":"2024-09-14T11:38:31.749031+0000","last_active":"2024-09-14T11:38:31.749120+0000","last_peered":"2024-09-14T11:38:31.749120+0000","last_clean":"2024-09-14T11:38:31.749120+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:38:31.749120+0000","last_undegraded":"2024-09-14T11:38:31.749120+0000","last_fullsized":"2024-09-14T11:38:31.749120+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'243","last_scrub_stamp":"2024-09-14T11:38:31.748925+0000","last_deep_scrub":"264'243","last_deep_scrub_stamp":"2024-09-14T11:38:31.748925+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.748925+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:11.249605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4157","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.796045+0000","last_change":"2024-09-14T11:38:08.796045+0000","last_active":"2024-09-14T11:38:08.796045+0000","last_peered":"2024-09-14T11:38:08.796045+0000","last_clean":"2024-09-14T11:38:08.796045+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:38:08.796045+0000","last_undegraded":"2024-09-14T11:38:08.796045+0000","last_fullsized":"2024-09-14T11:38:08.796045+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4157","last_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_deep_scrub":"264'4157","last_deep_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.795955+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":3000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:56.535050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'336","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.207574+0000","last_change":"2024-09-14T11:37:57.207516+0000","last_active":"2024-09-14T11:37:57.207574+0000","last_peered":"2024-09-14T11:37:57.207574+0000","last_clean":"2024-09-14T11:37:57.207574+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:37:57.207574+0000","last_undegraded":"2024-09-14T11:37:57.207574+0000","last_fullsized":"2024-09-14T11:37:57.207574+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.207427+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:13.344531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":30569,"num_write":1024,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.946969+0000","last_change":"2024-09-14T11:38:15.946969+0000","last_active":"2024-09-14T11:38:15.946969+0000","last_peered":"2024-09-14T11:38:15.946969+0000","last_clean":"2024-09-14T11:38:15.946969+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:38:15.946969+0000","last_undegraded":"2024-09-14T11:38:15.946969+0000","last_fullsized":"2024-09-14T11:38:15.946969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.946873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.946873+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.946873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:58.418213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'294","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.859838+0000","last_change":"2024-09-14T11:38:20.859838+0000","last_active":"2024-09-14T11:38:20.859838+0000","last_peered":"2024-09-14T11:38:20.859838+0000","last_clean":"2024-09-14T11:38:20.859838+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:38:20.859838+0000","last_undegraded":"2024-09-14T11:38:20.859838+0000","last_fullsized":"2024-09-14T11:38:20.859838+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'294","last_scrub_stamp":"2024-09-14T11:38:20.859741+0000","last_deep_scrub":"264'294","last_deep_scrub_stamp":"2024-09-14T11:38:20.859741+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.859741+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:51.310826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":1245,"num_write":424,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'795","reported_seq":2264,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.758262+0000","last_change":"2024-09-14T11:38:29.758262+0000","last_active":"2024-09-14T11:38:29.758262+0000","last_peered":"2024-09-14T11:38:29.758262+0000","last_clean":"2024-09-14T11:38:29.758262+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:38:29.758262+0000","last_undegraded":"2024-09-14T11:38:29.758262+0000","last_fullsized":"2024-09-14T11:38:29.758262+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:29.758152+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:29.758152+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.758152+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:58.242377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.901270+0000","last_change":"2024-09-14T11:38:04.901270+0000","last_active":"2024-09-14T11:38:04.901270+0000","last_peered":"2024-09-14T11:38:04.901270+0000","last_clean":"2024-09-14T11:38:04.901270+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:38:04.901270+0000","last_undegraded":"2024-09-14T11:38:04.901270+0000","last_fullsized":"2024-09-14T11:38:04.901270+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.901185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:34.668649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'335","reported_seq":953,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.980161+0000","last_change":"2024-09-14T11:37:59.980161+0000","last_active":"2024-09-14T11:37:59.980161+0000","last_peered":"2024-09-14T11:37:59.980161+0000","last_clean":"2024-09-14T11:37:59.980161+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:59.980161+0000","last_undegraded":"2024-09-14T11:37:59.980161+0000","last_fullsized":"2024-09-14T11:37:59.980161+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.980047+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:02.870696+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":515,"num_read_kb":9228,"num_write":1120,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.951810+0000","last_change":"2024-09-14T11:38:11.951810+0000","last_active":"2024-09-14T11:38:11.951810+0000","last_peered":"2024-09-14T11:38:11.951810+0000","last_clean":"2024-09-14T11:38:11.951810+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:38:11.951810+0000","last_undegraded":"2024-09-14T11:38:11.951810+0000","last_fullsized":"2024-09-14T11:38:11.951810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.951722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:21.559571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'369","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.854194+0000","last_change":"2024-09-14T11:38:19.854194+0000","last_active":"2024-09-14T11:38:19.854194+0000","last_peered":"2024-09-14T11:38:19.854194+0000","last_clean":"2024-09-14T11:38:19.854194+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:38:19.854194+0000","last_undegraded":"2024-09-14T11:38:19.854194+0000","last_fullsized":"2024-09-14T11:38:19.854194+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:19.854090+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:19.854090+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.854090+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:09.592302+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":1214,"num_write":460,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":492,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.514970+0000","last_change":"2024-09-14T11:38:14.514970+0000","last_active":"2024-09-14T11:38:14.514970+0000","last_peered":"2024-09-14T11:38:14.514970+0000","last_clean":"2024-09-14T11:38:14.514970+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:38:14.514970+0000","last_undegraded":"2024-09-14T11:38:14.514970+0000","last_fullsized":"2024-09-14T11:38:14.514970+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.514871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.514871+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.514871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.063754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'550","reported_seq":1371,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.993670+0000","last_change":"2024-09-14T11:38:25.993670+0000","last_active":"2024-09-14T11:38:25.993670+0000","last_peered":"2024-09-14T11:38:25.993670+0000","last_clean":"2024-09-14T11:38:25.993670+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:38:25.993670+0000","last_undegraded":"2024-09-14T11:38:25.993670+0000","last_fullsized":"2024-09-14T11:38:25.993670+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'550","last_scrub_stamp":"2024-09-14T11:38:25.993577+0000","last_deep_scrub":"264'550","last_deep_scrub_stamp":"2024-09-14T11:38:25.993577+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.993577+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:27.501103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.778887+0000","last_change":"2024-09-14T11:38:00.778887+0000","last_active":"2024-09-14T11:38:00.778887+0000","last_peered":"2024-09-14T11:38:00.778887+0000","last_clean":"2024-09-14T11:38:00.778887+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:38:00.778887+0000","last_undegraded":"2024-09-14T11:38:00.778887+0000","last_fullsized":"2024-09-14T11:38:00.778887+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.778798+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:57.572541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'264","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.924271+0000","last_change":"2024-09-14T11:37:56.924217+0000","last_active":"2024-09-14T11:37:56.924271+0000","last_peered":"2024-09-14T11:37:56.924271+0000","last_clean":"2024-09-14T11:37:56.924271+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:37:56.924271+0000","last_undegraded":"2024-09-14T11:37:56.924271+0000","last_fullsized":"2024-09-14T11:37:56.924271+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.924115+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:59.368338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":56700,"num_write":826,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.288085+0000","last_change":"2024-09-14T11:38:11.288085+0000","last_active":"2024-09-14T11:38:11.288085+0000","last_peered":"2024-09-14T11:38:11.288085+0000","last_clean":"2024-09-14T11:38:11.288085+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:38:11.288085+0000","last_undegraded":"2024-09-14T11:38:11.288085+0000","last_fullsized":"2024-09-14T11:38:11.288085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.287976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:47.086536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'273","reported_seq":842,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.735223+0000","last_change":"2024-09-14T11:38:18.735223+0000","last_active":"2024-09-14T11:38:18.735223+0000","last_peered":"2024-09-14T11:38:18.735223+0000","last_clean":"2024-09-14T11:38:18.735223+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:38:18.735223+0000","last_undegraded":"2024-09-14T11:38:18.735223+0000","last_fullsized":"2024-09-14T11:38:18.735223+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-14T11:38:18.735129+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-14T11:38:18.735129+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.735129+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:46.477399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71588,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1104,"num_write":366,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.770446+0000","last_change":"2024-09-14T11:38:27.770446+0000","last_active":"2024-09-14T11:38:27.770446+0000","last_peered":"2024-09-14T11:38:27.770446+0000","last_clean":"2024-09-14T11:38:27.770446+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:38:27.770446+0000","last_undegraded":"2024-09-14T11:38:27.770446+0000","last_fullsized":"2024-09-14T11:38:27.770446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:27.770352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:27.770352+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.770352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:00.433642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'115","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.100737+0000","last_change":"2024-09-14T11:38:17.100737+0000","last_active":"2024-09-14T11:38:17.100737+0000","last_peered":"2024-09-14T11:38:17.100737+0000","last_clean":"2024-09-14T11:38:17.100737+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:38:17.100737+0000","last_undegraded":"2024-09-14T11:38:17.100737+0000","last_fullsized":"2024-09-14T11:38:17.100737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-14T11:38:17.100644+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-14T11:38:17.100644+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.100644+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:44.325848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.211512+0000","last_change":"2024-09-14T11:38:04.211512+0000","last_active":"2024-09-14T11:38:04.211512+0000","last_peered":"2024-09-14T11:38:04.211512+0000","last_clean":"2024-09-14T11:38:04.211512+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:38:04.211512+0000","last_undegraded":"2024-09-14T11:38:04.211512+0000","last_fullsized":"2024-09-14T11:38:04.211512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.211394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:16.244988+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'451","reported_seq":1164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.971592+0000","last_change":"2024-09-14T11:38:04.971521+0000","last_active":"2024-09-14T11:38:04.971592+0000","last_peered":"2024-09-14T11:38:04.971592+0000","last_clean":"2024-09-14T11:38:04.971592+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:38:04.971592+0000","last_undegraded":"2024-09-14T11:38:04.971592+0000","last_fullsized":"2024-09-14T11:38:04.971592+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'451","last_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_deep_scrub":"264'451","last_deep_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.971423+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:55.099273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":972,"num_read_kb":28710,"num_write":1673,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.263318+0000","last_change":"2024-09-14T11:38:06.263318+0000","last_active":"2024-09-14T11:38:06.263318+0000","last_peered":"2024-09-14T11:38:06.263318+0000","last_clean":"2024-09-14T11:38:06.263318+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:38:06.263318+0000","last_undegraded":"2024-09-14T11:38:06.263318+0000","last_fullsized":"2024-09-14T11:38:06.263318+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.263219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:07.707286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'316","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.890125+0000","last_change":"2024-09-14T11:38:19.890125+0000","last_active":"2024-09-14T11:38:19.890125+0000","last_peered":"2024-09-14T11:38:19.890125+0000","last_clean":"2024-09-14T11:38:19.890125+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:38:19.890125+0000","last_undegraded":"2024-09-14T11:38:19.890125+0000","last_fullsized":"2024-09-14T11:38:19.890125+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:38:19.890027+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:38:19.890027+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.890027+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.306299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50445,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":514,"num_read_kb":1159,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'779","reported_seq":4232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.082544+0000","last_change":"2024-09-14T11:38:21.082544+0000","last_active":"2024-09-14T11:38:21.082544+0000","last_peered":"2024-09-14T11:38:21.082544+0000","last_clean":"2024-09-14T11:38:21.082544+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:38:21.082544+0000","last_undegraded":"2024-09-14T11:38:21.082544+0000","last_fullsized":"2024-09-14T11:38:21.082544+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'779","last_scrub_stamp":"2024-09-14T11:38:21.082455+0000","last_deep_scrub":"264'779","last_deep_scrub_stamp":"2024-09-14T11:38:21.082455+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.082455+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":701,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:06.177538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'102","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.092340+0000","last_change":"2024-09-14T11:38:26.092340+0000","last_active":"2024-09-14T11:38:26.092340+0000","last_peered":"2024-09-14T11:38:26.092340+0000","last_clean":"2024-09-14T11:38:26.092340+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:38:26.092340+0000","last_undegraded":"2024-09-14T11:38:26.092340+0000","last_fullsized":"2024-09-14T11:38:26.092340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-14T11:38:26.092240+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-14T11:38:26.092240+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.092240+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:03.281542+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.128330+0000","last_change":"2024-09-14T11:38:04.128232+0000","last_active":"2024-09-14T11:38:04.128330+0000","last_peered":"2024-09-14T11:38:04.128330+0000","last_clean":"2024-09-14T11:38:04.128330+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:38:04.128330+0000","last_undegraded":"2024-09-14T11:38:04.128330+0000","last_fullsized":"2024-09-14T11:38:04.128330+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.128119+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:06.336903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'318","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.011434+0000","last_change":"2024-09-14T11:37:58.011358+0000","last_active":"2024-09-14T11:37:58.011434+0000","last_peered":"2024-09-14T11:37:58.011434+0000","last_clean":"2024-09-14T11:37:58.011434+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:37:58.011434+0000","last_undegraded":"2024-09-14T11:37:58.011434+0000","last_fullsized":"2024-09-14T11:37:58.011434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.011270+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.504722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":39728,"num_write":960,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.272195+0000","last_change":"2024-09-14T11:38:07.272195+0000","last_active":"2024-09-14T11:38:07.272195+0000","last_peered":"2024-09-14T11:38:07.272195+0000","last_clean":"2024-09-14T11:38:07.272195+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:38:07.272195+0000","last_undegraded":"2024-09-14T11:38:07.272195+0000","last_fullsized":"2024-09-14T11:38:07.272195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.272107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:15.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'467","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.068187+0000","last_change":"2024-09-14T11:38:14.068187+0000","last_active":"2024-09-14T11:38:14.068187+0000","last_peered":"2024-09-14T11:38:14.068187+0000","last_clean":"2024-09-14T11:38:14.068187+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:38:14.068187+0000","last_undegraded":"2024-09-14T11:38:14.068187+0000","last_fullsized":"2024-09-14T11:38:14.068187+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'467","last_scrub_stamp":"2024-09-14T11:38:14.068086+0000","last_deep_scrub":"264'467","last_deep_scrub_stamp":"2024-09-14T11:38:14.068086+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.068086+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:09.633040+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91900,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":1934,"num_write":662,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.264563+0000","last_change":"2024-09-14T11:38:12.264563+0000","last_active":"2024-09-14T11:38:12.264563+0000","last_peered":"2024-09-14T11:38:12.264563+0000","last_clean":"2024-09-14T11:38:12.264563+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:38:12.264563+0000","last_undegraded":"2024-09-14T11:38:12.264563+0000","last_fullsized":"2024-09-14T11:38:12.264563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.264469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:48.042054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'107","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.622819+0000","last_change":"2024-09-14T11:38:19.622819+0000","last_active":"2024-09-14T11:38:19.622819+0000","last_peered":"2024-09-14T11:38:19.622819+0000","last_clean":"2024-09-14T11:38:19.622819+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:38:19.622819+0000","last_undegraded":"2024-09-14T11:38:19.622819+0000","last_fullsized":"2024-09-14T11:38:19.622819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-14T11:38:19.622715+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-14T11:38:19.622715+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.622715+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.552241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'257","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.818758+0000","last_change":"2024-09-14T11:38:01.818689+0000","last_active":"2024-09-14T11:38:01.818758+0000","last_peered":"2024-09-14T11:38:01.818758+0000","last_clean":"2024-09-14T11:38:01.818758+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:38:01.818758+0000","last_undegraded":"2024-09-14T11:38:01.818758+0000","last_fullsized":"2024-09-14T11:38:01.818758+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.818609+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.995103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'339","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.801331+0000","last_change":"2024-09-14T11:37:56.801227+0000","last_active":"2024-09-14T11:37:56.801331+0000","last_peered":"2024-09-14T11:37:56.801331+0000","last_clean":"2024-09-14T11:37:56.801331+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:37:56.801331+0000","last_undegraded":"2024-09-14T11:37:56.801331+0000","last_fullsized":"2024-09-14T11:37:56.801331+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.801100+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:49.585646+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":517,"num_read_kb":5559,"num_write":1004,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.269139+0000","last_change":"2024-09-14T11:38:09.269139+0000","last_active":"2024-09-14T11:38:09.269139+0000","last_peered":"2024-09-14T11:38:09.269139+0000","last_clean":"2024-09-14T11:38:09.269139+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:38:09.269139+0000","last_undegraded":"2024-09-14T11:38:09.269139+0000","last_fullsized":"2024-09-14T11:38:09.269139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:19.458046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'284","reported_seq":867,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.735737+0000","last_change":"2024-09-14T11:38:19.735737+0000","last_active":"2024-09-14T11:38:19.735737+0000","last_peered":"2024-09-14T11:38:19.735737+0000","last_clean":"2024-09-14T11:38:19.735737+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:38:19.735737+0000","last_undegraded":"2024-09-14T11:38:19.735737+0000","last_fullsized":"2024-09-14T11:38:19.735737+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:38:19.735634+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:38:19.735634+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.735634+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:56.780179+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43790,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1041,"num_write":430,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.117306+0000","last_change":"2024-09-14T11:38:22.117306+0000","last_active":"2024-09-14T11:38:22.117306+0000","last_peered":"2024-09-14T11:38:22.117306+0000","last_clean":"2024-09-14T11:38:22.117306+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:38:22.117306+0000","last_undegraded":"2024-09-14T11:38:22.117306+0000","last_fullsized":"2024-09-14T11:38:22.117306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.117215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.117215+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.117215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:53.881289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'109","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.752084+0000","last_change":"2024-09-14T11:38:31.752084+0000","last_active":"2024-09-14T11:38:31.752084+0000","last_peered":"2024-09-14T11:38:31.752084+0000","last_clean":"2024-09-14T11:38:31.752084+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:38:31.752084+0000","last_undegraded":"2024-09-14T11:38:31.752084+0000","last_fullsized":"2024-09-14T11:38:31.752084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-14T11:38:31.751994+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-14T11:38:31.751994+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.751994+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:48.273036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'105","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.801548+0000","last_change":"2024-09-14T11:38:02.801454+0000","last_active":"2024-09-14T11:38:02.801548+0000","last_peered":"2024-09-14T11:38:02.801548+0000","last_clean":"2024-09-14T11:38:02.801548+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:38:02.801548+0000","last_undegraded":"2024-09-14T11:38:02.801548+0000","last_fullsized":"2024-09-14T11:38:02.801548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.801328+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:52.213904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'384","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.201690+0000","last_change":"2024-09-14T11:37:56.201690+0000","last_active":"2024-09-14T11:37:56.201690+0000","last_peered":"2024-09-14T11:37:56.201690+0000","last_clean":"2024-09-14T11:37:56.201690+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:37:56.201690+0000","last_undegraded":"2024-09-14T11:37:56.201690+0000","last_fullsized":"2024-09-14T11:37:56.201690+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.201429+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:20.816954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":626,"num_read_kb":12205,"num_write":1169,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.514696+0000","last_change":"2024-09-14T11:38:06.514696+0000","last_active":"2024-09-14T11:38:06.514696+0000","last_peered":"2024-09-14T11:38:06.514696+0000","last_clean":"2024-09-14T11:38:06.514696+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:38:06.514696+0000","last_undegraded":"2024-09-14T11:38:06.514696+0000","last_fullsized":"2024-09-14T11:38:06.514696+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.514607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.514163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'297","reported_seq":885,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.303289+0000","last_change":"2024-09-14T11:38:08.303289+0000","last_active":"2024-09-14T11:38:08.303289+0000","last_peered":"2024-09-14T11:38:08.303289+0000","last_clean":"2024-09-14T11:38:08.303289+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:38:08.303289+0000","last_undegraded":"2024-09-14T11:38:08.303289+0000","last_fullsized":"2024-09-14T11:38:08.303289+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.303187+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:25.035256+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1133,"num_write":410,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'727","reported_seq":2202,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.270091+0000","last_change":"2024-09-14T11:38:13.270091+0000","last_active":"2024-09-14T11:38:13.270091+0000","last_peered":"2024-09-14T11:38:13.270091+0000","last_clean":"2024-09-14T11:38:13.270091+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:38:13.270091+0000","last_undegraded":"2024-09-14T11:38:13.270091+0000","last_fullsized":"2024-09-14T11:38:13.270091+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'727","last_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_deep_scrub":"264'727","last_deep_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.270000+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":701,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:03.387188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'142","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.555338+0000","last_change":"2024-09-14T11:38:17.555338+0000","last_active":"2024-09-14T11:38:17.555338+0000","last_peered":"2024-09-14T11:38:17.555338+0000","last_clean":"2024-09-14T11:38:17.555338+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:38:17.555338+0000","last_undegraded":"2024-09-14T11:38:17.555338+0000","last_fullsized":"2024-09-14T11:38:17.555338+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:38:17.555233+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:38:17.555233+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.555233+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:42.328664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'173","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.829070+0000","last_change":"2024-09-14T11:38:04.828980+0000","last_active":"2024-09-14T11:38:04.829070+0000","last_peered":"2024-09-14T11:38:04.829070+0000","last_clean":"2024-09-14T11:38:04.829070+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:38:04.829070+0000","last_undegraded":"2024-09-14T11:38:04.829070+0000","last_fullsized":"2024-09-14T11:38:04.829070+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.828885+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:49.181800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'330","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.801255+0000","last_change":"2024-09-14T11:37:55.801255+0000","last_active":"2024-09-14T11:37:55.801255+0000","last_peered":"2024-09-14T11:37:55.801255+0000","last_clean":"2024-09-14T11:37:55.801255+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:37:55.801255+0000","last_undegraded":"2024-09-14T11:37:55.801255+0000","last_fullsized":"2024-09-14T11:37:55.801255+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.801142+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:31.011642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":8777,"num_write":1001,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1452,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.923095+0000","last_change":"2024-09-14T11:38:16.923095+0000","last_active":"2024-09-14T11:38:16.923095+0000","last_peered":"2024-09-14T11:38:16.923095+0000","last_clean":"2024-09-14T11:38:16.923095+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:38:16.923095+0000","last_undegraded":"2024-09-14T11:38:16.923095+0000","last_fullsized":"2024-09-14T11:38:16.923095+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:38:16.923004+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:38:16.923004+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.923004+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.332168+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'83","reported_seq":601,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.740937+0000","last_change":"2024-09-14T11:38:19.740937+0000","last_active":"2024-09-14T11:38:19.740937+0000","last_peered":"2024-09-14T11:38:19.740937+0000","last_clean":"2024-09-14T11:38:19.740937+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:38:19.740937+0000","last_undegraded":"2024-09-14T11:38:19.740937+0000","last_fullsized":"2024-09-14T11:38:19.740937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-14T11:38:19.740836+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-14T11:38:19.740836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.740836+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:48.023795+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2182,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.096488+0000","last_change":"2024-09-14T11:38:13.096488+0000","last_active":"2024-09-14T11:38:13.096488+0000","last_peered":"2024-09-14T11:38:13.096488+0000","last_clean":"2024-09-14T11:38:13.096488+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:38:13.096488+0000","last_undegraded":"2024-09-14T11:38:13.096488+0000","last_fullsized":"2024-09-14T11:38:13.096488+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.096403+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.180002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'150","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.765041+0000","last_change":"2024-09-14T11:38:27.765041+0000","last_active":"2024-09-14T11:38:27.765041+0000","last_peered":"2024-09-14T11:38:27.765041+0000","last_clean":"2024-09-14T11:38:27.765041+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:38:27.765041+0000","last_undegraded":"2024-09-14T11:38:27.765041+0000","last_fullsized":"2024-09-14T11:38:27.765041+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-09-14T11:38:27.764956+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-09-14T11:38:27.764956+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.764956+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:47.323277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'626","reported_seq":1473,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.531675+0000","last_change":"2024-09-14T11:38:02.531675+0000","last_active":"2024-09-14T11:38:02.531675+0000","last_peered":"2024-09-14T11:38:02.531675+0000","last_clean":"2024-09-14T11:38:02.531675+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:38:02.531675+0000","last_undegraded":"2024-09-14T11:38:02.531675+0000","last_fullsized":"2024-09-14T11:38:02.531675+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.531585+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:49.257771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25760,"num_omap_keys":101,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'395","reported_seq":1169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.842500+0000","last_change":"2024-09-14T11:37:54.842500+0000","last_active":"2024-09-14T11:37:54.842500+0000","last_peered":"2024-09-14T11:37:54.842500+0000","last_clean":"2024-09-14T11:37:54.842500+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:37:54.842500+0000","last_undegraded":"2024-09-14T11:37:54.842500+0000","last_fullsized":"2024-09-14T11:37:54.842500+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.842395+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:06.443569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1140,"num_read_kb":48198,"num_write":1212,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":506,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.762326+0000","last_change":"2024-09-14T11:38:15.762326+0000","last_active":"2024-09-14T11:38:15.762326+0000","last_peered":"2024-09-14T11:38:15.762326+0000","last_clean":"2024-09-14T11:38:15.762326+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:38:15.762326+0000","last_undegraded":"2024-09-14T11:38:15.762326+0000","last_fullsized":"2024-09-14T11:38:15.762326+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.762229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.762229+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.762229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:13.575149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'357","reported_seq":961,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.896677+0000","last_change":"2024-09-14T11:38:20.896677+0000","last_active":"2024-09-14T11:38:20.896677+0000","last_peered":"2024-09-14T11:38:20.896677+0000","last_clean":"2024-09-14T11:38:20.896677+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:38:20.896677+0000","last_undegraded":"2024-09-14T11:38:20.896677+0000","last_fullsized":"2024-09-14T11:38:20.896677+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:38:20.896588+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:38:20.896588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.896588+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:51.367045+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46246,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1178,"num_read_kb":1754,"num_write":1698,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.096682+0000","last_change":"2024-09-14T11:38:12.096682+0000","last_active":"2024-09-14T11:38:12.096682+0000","last_peered":"2024-09-14T11:38:12.096682+0000","last_clean":"2024-09-14T11:38:12.096682+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:38:12.096682+0000","last_undegraded":"2024-09-14T11:38:12.096682+0000","last_fullsized":"2024-09-14T11:38:12.096682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.096566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:07.924703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'145","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.595814+0000","last_change":"2024-09-14T11:38:18.595814+0000","last_active":"2024-09-14T11:38:18.595814+0000","last_peered":"2024-09-14T11:38:18.595814+0000","last_clean":"2024-09-14T11:38:18.595814+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:38:18.595814+0000","last_undegraded":"2024-09-14T11:38:18.595814+0000","last_fullsized":"2024-09-14T11:38:18.595814+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-14T11:38:18.595731+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-14T11:38:18.595731+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.595731+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:54.957071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.215568+0000","last_change":"2024-09-14T11:38:03.215568+0000","last_active":"2024-09-14T11:38:03.215568+0000","last_peered":"2024-09-14T11:38:03.215568+0000","last_clean":"2024-09-14T11:38:03.215568+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:38:03.215568+0000","last_undegraded":"2024-09-14T11:38:03.215568+0000","last_fullsized":"2024-09-14T11:38:03.215568+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'521","last_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_deep_scrub":"264'521","last_deep_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.215480+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:27.895596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.940021+0000","last_change":"2024-09-14T11:37:55.940021+0000","last_active":"2024-09-14T11:37:55.940021+0000","last_peered":"2024-09-14T11:37:55.940021+0000","last_clean":"2024-09-14T11:37:55.940021+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:37:55.940021+0000","last_undegraded":"2024-09-14T11:37:55.940021+0000","last_fullsized":"2024-09-14T11:37:55.940021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.939912+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.966314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.962629+0000","last_change":"2024-09-14T11:37:56.962629+0000","last_active":"2024-09-14T11:37:56.962629+0000","last_peered":"2024-09-14T11:37:56.962629+0000","last_clean":"2024-09-14T11:37:56.962629+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:37:56.962629+0000","last_undegraded":"2024-09-14T11:37:56.962629+0000","last_fullsized":"2024-09-14T11:37:56.962629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.962512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:33.102357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'336","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.833750+0000","last_change":"2024-09-14T11:37:53.833750+0000","last_active":"2024-09-14T11:37:53.833750+0000","last_peered":"2024-09-14T11:37:53.833750+0000","last_clean":"2024-09-14T11:37:53.833750+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:37:53.833750+0000","last_undegraded":"2024-09-14T11:37:53.833750+0000","last_fullsized":"2024-09-14T11:37:53.833750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.833659+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:56.404049+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":634,"num_read_kb":14631,"num_write":972,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.952690+0000","last_change":"2024-09-14T11:38:13.952690+0000","last_active":"2024-09-14T11:38:13.952690+0000","last_peered":"2024-09-14T11:38:13.952690+0000","last_clean":"2024-09-14T11:38:13.952690+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:38:13.952690+0000","last_undegraded":"2024-09-14T11:38:13.952690+0000","last_fullsized":"2024-09-14T11:38:13.952690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.952561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:45.651254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'735","reported_seq":1437,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.888105+0000","last_change":"2024-09-14T11:38:18.888105+0000","last_active":"2024-09-14T11:38:18.888105+0000","last_peered":"2024-09-14T11:38:18.888105+0000","last_clean":"2024-09-14T11:38:18.888105+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:38:18.888105+0000","last_undegraded":"2024-09-14T11:38:18.888105+0000","last_fullsized":"2024-09-14T11:38:18.888105+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'735","last_scrub_stamp":"2024-09-14T11:38:18.888016+0000","last_deep_scrub":"264'735","last_deep_scrub_stamp":"2024-09-14T11:38:18.888016+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.888016+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.221845+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1412,"num_read_kb":3246,"num_write":1300,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89606,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.073078+0000","last_change":"2024-09-14T11:38:20.073078+0000","last_active":"2024-09-14T11:38:20.073078+0000","last_peered":"2024-09-14T11:38:20.073078+0000","last_clean":"2024-09-14T11:38:20.073078+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:38:20.073078+0000","last_undegraded":"2024-09-14T11:38:20.073078+0000","last_fullsized":"2024-09-14T11:38:20.073078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:20.072985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:20.072985+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.072985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:47.722256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'196","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.132211+0000","last_change":"2024-09-14T11:38:19.132211+0000","last_active":"2024-09-14T11:38:19.132211+0000","last_peered":"2024-09-14T11:38:19.132211+0000","last_clean":"2024-09-14T11:38:19.132211+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:38:19.132211+0000","last_undegraded":"2024-09-14T11:38:19.132211+0000","last_fullsized":"2024-09-14T11:38:19.132211+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-14T11:38:19.132128+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-14T11:38:19.132128+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.132128+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.839740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'189","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.105067+0000","last_change":"2024-09-14T11:38:02.105067+0000","last_active":"2024-09-14T11:38:02.105067+0000","last_peered":"2024-09-14T11:38:02.105067+0000","last_clean":"2024-09-14T11:38:02.105067+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:38:02.105067+0000","last_undegraded":"2024-09-14T11:38:02.105067+0000","last_fullsized":"2024-09-14T11:38:02.105067+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.104979+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:48.803647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.930011+0000","last_change":"2024-09-14T11:38:00.929927+0000","last_active":"2024-09-14T11:38:00.930011+0000","last_peered":"2024-09-14T11:38:00.930011+0000","last_clean":"2024-09-14T11:38:00.930011+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:38:00.930011+0000","last_undegraded":"2024-09-14T11:38:00.930011+0000","last_fullsized":"2024-09-14T11:38:00.930011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.929792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:40.514471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'398","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.259139+0000","last_change":"2024-09-14T11:37:52.259139+0000","last_active":"2024-09-14T11:37:52.259139+0000","last_peered":"2024-09-14T11:37:52.259139+0000","last_clean":"2024-09-14T11:37:52.259139+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:52.259139+0000","last_undegraded":"2024-09-14T11:37:52.259139+0000","last_fullsized":"2024-09-14T11:37:52.259139+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.259071+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:58.652972+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":799,"num_read_kb":83524,"num_write":1261,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"264'6","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.954241+0000","last_change":"2024-09-14T11:38:13.954241+0000","last_active":"2024-09-14T11:38:13.954241+0000","last_peered":"2024-09-14T11:38:13.954241+0000","last_clean":"2024-09-14T11:38:13.954241+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:38:13.954241+0000","last_undegraded":"2024-09-14T11:38:13.954241+0000","last_fullsized":"2024-09-14T11:38:13.954241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:13.954162+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:13.954162+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.954162+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:46.433894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1245","reported_seq":2684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.546235+0000","last_change":"2024-09-14T11:38:12.546235+0000","last_active":"2024-09-14T11:38:12.546235+0000","last_peered":"2024-09-14T11:38:12.546235+0000","last_clean":"2024-09-14T11:38:12.546235+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:38:12.546235+0000","last_undegraded":"2024-09-14T11:38:12.546235+0000","last_fullsized":"2024-09-14T11:38:12.546235+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1245","last_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_deep_scrub":"264'1245","last_deep_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.546141+0000","objects_scrubbed":12,"log_size":45,"log_dups_size":1200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:57.448650+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138368,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1980,"num_read_kb":3690,"num_write":1076,"num_write_kb":906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.864388+0000","last_change":"2024-09-14T11:38:22.864388+0000","last_active":"2024-09-14T11:38:22.864388+0000","last_peered":"2024-09-14T11:38:22.864388+0000","last_clean":"2024-09-14T11:38:22.864388+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:38:22.864388+0000","last_undegraded":"2024-09-14T11:38:22.864388+0000","last_fullsized":"2024-09-14T11:38:22.864388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.864302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.864302+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.864302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:46.032081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'244","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.641925+0000","last_change":"2024-09-14T11:38:20.641925+0000","last_active":"2024-09-14T11:38:20.641925+0000","last_peered":"2024-09-14T11:38:20.641925+0000","last_clean":"2024-09-14T11:38:20.641925+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:38:20.641925+0000","last_undegraded":"2024-09-14T11:38:20.641925+0000","last_fullsized":"2024-09-14T11:38:20.641925+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-14T11:38:20.641827+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-14T11:38:20.641827+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.641827+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:24.991277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.328415+0000","last_change":"2024-09-14T11:37:59.328415+0000","last_active":"2024-09-14T11:37:59.328415+0000","last_peered":"2024-09-14T11:37:59.328415+0000","last_clean":"2024-09-14T11:37:59.328415+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:37:59.328415+0000","last_undegraded":"2024-09-14T11:37:59.328415+0000","last_fullsized":"2024-09-14T11:37:59.328415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.328313+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:28.847997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.287608+0000","last_change":"2024-09-14T11:37:53.287608+0000","last_active":"2024-09-14T11:37:53.287608+0000","last_peered":"2024-09-14T11:37:53.287608+0000","last_clean":"2024-09-14T11:37:53.287608+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:37:53.287608+0000","last_undegraded":"2024-09-14T11:37:53.287608+0000","last_fullsized":"2024-09-14T11:37:53.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.287533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:08.352515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'364","reported_seq":1047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.503709+0000","last_change":"2024-09-14T11:37:52.503608+0000","last_active":"2024-09-14T11:37:52.503709+0000","last_peered":"2024-09-14T11:37:52.503709+0000","last_clean":"2024-09-14T11:37:52.503709+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:37:52.503709+0000","last_undegraded":"2024-09-14T11:37:52.503709+0000","last_fullsized":"2024-09-14T11:37:52.503709+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.503516+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:31.493522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":61657,"num_write":1199,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.245866+0000","last_change":"2024-09-14T11:38:04.245866+0000","last_active":"2024-09-14T11:38:04.245866+0000","last_peered":"2024-09-14T11:38:04.245866+0000","last_clean":"2024-09-14T11:38:04.245866+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:38:04.245866+0000","last_undegraded":"2024-09-14T11:38:04.245866+0000","last_fullsized":"2024-09-14T11:38:04.245866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.245779+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.323128+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'224","reported_seq":1266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.905401+0000","last_change":"2024-09-14T11:38:17.905401+0000","last_active":"2024-09-14T11:38:17.905401+0000","last_peered":"2024-09-14T11:38:17.905401+0000","last_clean":"2024-09-14T11:38:17.905401+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:38:17.905401+0000","last_undegraded":"2024-09-14T11:38:17.905401+0000","last_fullsized":"2024-09-14T11:38:17.905401+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-14T11:38:17.905265+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-14T11:38:17.905265+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.905265+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:17.873901+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.026536+0000","last_change":"2024-09-14T11:38:19.026536+0000","last_active":"2024-09-14T11:38:19.026536+0000","last_peered":"2024-09-14T11:38:19.026536+0000","last_clean":"2024-09-14T11:38:19.026536+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:38:19.026536+0000","last_undegraded":"2024-09-14T11:38:19.026536+0000","last_fullsized":"2024-09-14T11:38:19.026536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:19.026445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:19.026445+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.026445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:34.029834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'260","reported_seq":858,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.742271+0000","last_change":"2024-09-14T11:38:30.742271+0000","last_active":"2024-09-14T11:38:30.742271+0000","last_peered":"2024-09-14T11:38:30.742271+0000","last_clean":"2024-09-14T11:38:30.742271+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:38:30.742271+0000","last_undegraded":"2024-09-14T11:38:30.742271+0000","last_fullsized":"2024-09-14T11:38:30.742271+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'260","last_scrub_stamp":"2024-09-14T11:38:30.742182+0000","last_deep_scrub":"264'260","last_deep_scrub_stamp":"2024-09-14T11:38:30.742182+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.742182+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.028319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.489283+0000","last_change":"2024-09-14T11:38:01.489283+0000","last_active":"2024-09-14T11:38:01.489283+0000","last_peered":"2024-09-14T11:38:01.489283+0000","last_clean":"2024-09-14T11:38:01.489283+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:38:01.489283+0000","last_undegraded":"2024-09-14T11:38:01.489283+0000","last_fullsized":"2024-09-14T11:38:01.489283+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.489194+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:27.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.984029+0000","last_change":"2024-09-14T11:37:55.984029+0000","last_active":"2024-09-14T11:37:55.984029+0000","last_peered":"2024-09-14T11:37:55.984029+0000","last_clean":"2024-09-14T11:37:55.984029+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:37:55.984029+0000","last_undegraded":"2024-09-14T11:37:55.984029+0000","last_fullsized":"2024-09-14T11:37:55.984029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.983951+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:03.446110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'424","reported_seq":1181,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.799026+0000","last_change":"2024-09-14T11:37:54.799026+0000","last_active":"2024-09-14T11:37:54.799026+0000","last_peered":"2024-09-14T11:37:54.799026+0000","last_clean":"2024-09-14T11:37:54.799026+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:37:54.799026+0000","last_undegraded":"2024-09-14T11:37:54.799026+0000","last_fullsized":"2024-09-14T11:37:54.799026+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'424","last_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_deep_scrub":"264'424","last_deep_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.798918+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:41.369232+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":119862,"num_write":1308,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.097424+0000","last_change":"2024-09-14T11:38:12.097424+0000","last_active":"2024-09-14T11:38:12.097424+0000","last_peered":"2024-09-14T11:38:12.097424+0000","last_clean":"2024-09-14T11:38:12.097424+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:38:12.097424+0000","last_undegraded":"2024-09-14T11:38:12.097424+0000","last_fullsized":"2024-09-14T11:38:12.097424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.097323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:33.246260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'124","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.726429+0000","last_change":"2024-09-14T11:38:16.726429+0000","last_active":"2024-09-14T11:38:16.726429+0000","last_peered":"2024-09-14T11:38:16.726429+0000","last_clean":"2024-09-14T11:38:16.726429+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:38:16.726429+0000","last_undegraded":"2024-09-14T11:38:16.726429+0000","last_fullsized":"2024-09-14T11:38:16.726429+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:38:16.726333+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:38:16.726333+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.726333+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:25.360047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.130226+0000","last_change":"2024-09-14T11:38:11.130226+0000","last_active":"2024-09-14T11:38:11.130226+0000","last_peered":"2024-09-14T11:38:11.130226+0000","last_clean":"2024-09-14T11:38:11.130226+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:38:11.130226+0000","last_undegraded":"2024-09-14T11:38:11.130226+0000","last_fullsized":"2024-09-14T11:38:11.130226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.130127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:35.749033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.951242+0000","last_change":"2024-09-14T11:38:24.951242+0000","last_active":"2024-09-14T11:38:24.951242+0000","last_peered":"2024-09-14T11:38:24.951242+0000","last_clean":"2024-09-14T11:38:24.951242+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:38:24.951242+0000","last_undegraded":"2024-09-14T11:38:24.951242+0000","last_fullsized":"2024-09-14T11:38:24.951242+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-14T11:38:24.951134+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-14T11:38:24.951134+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.951134+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:37.022238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.536277+0000","last_change":"2024-09-14T11:37:59.536277+0000","last_active":"2024-09-14T11:37:59.536277+0000","last_peered":"2024-09-14T11:37:59.536277+0000","last_clean":"2024-09-14T11:37:59.536277+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:37:59.536277+0000","last_undegraded":"2024-09-14T11:37:59.536277+0000","last_fullsized":"2024-09-14T11:37:59.536277+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.536190+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.140324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'368","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.967810+0000","last_change":"2024-09-14T11:37:54.967810+0000","last_active":"2024-09-14T11:37:54.967810+0000","last_peered":"2024-09-14T11:37:54.967810+0000","last_clean":"2024-09-14T11:37:54.967810+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:37:54.967810+0000","last_undegraded":"2024-09-14T11:37:54.967810+0000","last_fullsized":"2024-09-14T11:37:54.967810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.967697+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:29.191346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":12538,"num_write":1147,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.521322+0000","last_change":"2024-09-14T11:37:53.521322+0000","last_active":"2024-09-14T11:37:53.521322+0000","last_peered":"2024-09-14T11:37:53.521322+0000","last_clean":"2024-09-14T11:37:53.521322+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:37:53.521322+0000","last_undegraded":"2024-09-14T11:37:53.521322+0000","last_fullsized":"2024-09-14T11:37:53.521322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.521249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:04.660477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"264'4","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.079368+0000","last_change":"2024-09-14T11:38:13.079368+0000","last_active":"2024-09-14T11:38:13.079368+0000","last_peered":"2024-09-14T11:38:13.079368+0000","last_clean":"2024-09-14T11:38:13.079368+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:38:13.079368+0000","last_undegraded":"2024-09-14T11:38:13.079368+0000","last_fullsized":"2024-09-14T11:38:13.079368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.079281+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:20.909629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'598","reported_seq":1261,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.053639+0000","last_change":"2024-09-14T11:38:15.053564+0000","last_active":"2024-09-14T11:38:15.053639+0000","last_peered":"2024-09-14T11:38:15.053639+0000","last_clean":"2024-09-14T11:38:15.053639+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:38:15.053639+0000","last_undegraded":"2024-09-14T11:38:15.053639+0000","last_fullsized":"2024-09-14T11:38:15.053639+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'598","last_scrub_stamp":"2024-09-14T11:38:15.053466+0000","last_deep_scrub":"264'598","last_deep_scrub_stamp":"2024-09-14T11:38:15.053466+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.053466+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:35.467956+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94043,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":992,"num_read_kb":2221,"num_write":850,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.804759+0000","last_change":"2024-09-14T11:38:25.804759+0000","last_active":"2024-09-14T11:38:25.804759+0000","last_peered":"2024-09-14T11:38:25.804759+0000","last_clean":"2024-09-14T11:38:25.804759+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:38:25.804759+0000","last_undegraded":"2024-09-14T11:38:25.804759+0000","last_fullsized":"2024-09-14T11:38:25.804759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.804671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.804671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.804671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:11.781801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":700,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.097173+0000","last_change":"2024-09-14T11:38:28.097173+0000","last_active":"2024-09-14T11:38:28.097173+0000","last_peered":"2024-09-14T11:38:28.097173+0000","last_clean":"2024-09-14T11:38:28.097173+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:38:28.097173+0000","last_undegraded":"2024-09-14T11:38:28.097173+0000","last_fullsized":"2024-09-14T11:38:28.097173+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-14T11:38:28.097076+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-14T11:38:28.097076+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.097076+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:42.736350+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.092950+0000","last_change":"2024-09-14T11:38:01.092950+0000","last_active":"2024-09-14T11:38:01.092950+0000","last_peered":"2024-09-14T11:38:01.092950+0000","last_clean":"2024-09-14T11:38:01.092950+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:38:01.092950+0000","last_undegraded":"2024-09-14T11:38:01.092950+0000","last_fullsized":"2024-09-14T11:38:01.092950+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.092847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:03.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'354","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.510047+0000","last_change":"2024-09-14T11:37:54.510047+0000","last_active":"2024-09-14T11:37:54.510047+0000","last_peered":"2024-09-14T11:37:54.510047+0000","last_clean":"2024-09-14T11:37:54.510047+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:37:54.510047+0000","last_undegraded":"2024-09-14T11:37:54.510047+0000","last_fullsized":"2024-09-14T11:37:54.510047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.509966+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:47.241897+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":702,"num_read_kb":48648,"num_write":1220,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.948139+0000","last_change":"2024-09-14T11:37:57.948139+0000","last_active":"2024-09-14T11:37:57.948139+0000","last_peered":"2024-09-14T11:37:57.948139+0000","last_clean":"2024-09-14T11:37:57.948139+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:37:57.948139+0000","last_undegraded":"2024-09-14T11:37:57.948139+0000","last_fullsized":"2024-09-14T11:37:57.948139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.948046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:12.046884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.171510+0000","last_change":"2024-09-14T11:38:07.171510+0000","last_active":"2024-09-14T11:38:07.171510+0000","last_peered":"2024-09-14T11:38:07.171510+0000","last_clean":"2024-09-14T11:38:07.171510+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:38:07.171510+0000","last_undegraded":"2024-09-14T11:38:07.171510+0000","last_fullsized":"2024-09-14T11:38:07.171510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.171423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:03.206894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'155","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.514380+0000","last_change":"2024-09-14T11:38:11.514380+0000","last_active":"2024-09-14T11:38:11.514380+0000","last_peered":"2024-09-14T11:38:11.514380+0000","last_clean":"2024-09-14T11:38:11.514380+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:38:11.514380+0000","last_undegraded":"2024-09-14T11:38:11.514380+0000","last_fullsized":"2024-09-14T11:38:11.514380+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.514295+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:27.234237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'795","reported_seq":2769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.899220+0000","last_change":"2024-09-14T11:38:22.899166+0000","last_active":"2024-09-14T11:38:22.899220+0000","last_peered":"2024-09-14T11:38:22.899220+0000","last_clean":"2024-09-14T11:38:22.899220+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:38:22.899220+0000","last_undegraded":"2024-09-14T11:38:22.899220+0000","last_fullsized":"2024-09-14T11:38:22.899220+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:22.899077+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:22.899077+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.899077+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:13.648060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'139","reported_seq":634,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.778039+0000","last_change":"2024-09-14T11:38:32.778039+0000","last_active":"2024-09-14T11:38:32.778039+0000","last_peered":"2024-09-14T11:38:32.778039+0000","last_clean":"2024-09-14T11:38:32.778039+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:38:32.778039+0000","last_undegraded":"2024-09-14T11:38:32.778039+0000","last_fullsized":"2024-09-14T11:38:32.778039+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-14T11:38:32.777947+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-14T11:38:32.777947+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.777947+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:40.532787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'112","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.767548+0000","last_change":"2024-09-14T11:38:04.767492+0000","last_active":"2024-09-14T11:38:04.767548+0000","last_peered":"2024-09-14T11:38:04.767548+0000","last_clean":"2024-09-14T11:38:04.767548+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:38:04.767548+0000","last_undegraded":"2024-09-14T11:38:04.767548+0000","last_fullsized":"2024-09-14T11:38:04.767548+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.767399+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:56.368702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'357","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.826736+0000","last_change":"2024-09-14T11:37:55.826736+0000","last_active":"2024-09-14T11:37:55.826736+0000","last_peered":"2024-09-14T11:37:55.826736+0000","last_clean":"2024-09-14T11:37:55.826736+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:37:55.826736+0000","last_undegraded":"2024-09-14T11:37:55.826736+0000","last_fullsized":"2024-09-14T11:37:55.826736+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.826653+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:51.541137+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":3889,"num_write":1053,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.473533+0000","last_change":"2024-09-14T11:37:55.473533+0000","last_active":"2024-09-14T11:37:55.473533+0000","last_peered":"2024-09-14T11:37:55.473533+0000","last_clean":"2024-09-14T11:37:55.473533+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:37:55.473533+0000","last_undegraded":"2024-09-14T11:37:55.473533+0000","last_fullsized":"2024-09-14T11:37:55.473533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.473461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:32.359228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.713342+0000","last_change":"2024-09-14T11:38:16.713342+0000","last_active":"2024-09-14T11:38:16.713342+0000","last_peered":"2024-09-14T11:38:16.713342+0000","last_clean":"2024-09-14T11:38:16.713342+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:38:16.713342+0000","last_undegraded":"2024-09-14T11:38:16.713342+0000","last_fullsized":"2024-09-14T11:38:16.713342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:16.713247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:16.713247+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.713247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:29.483002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'110","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.704146+0000","last_change":"2024-09-14T11:38:18.704146+0000","last_active":"2024-09-14T11:38:18.704146+0000","last_peered":"2024-09-14T11:38:18.704146+0000","last_clean":"2024-09-14T11:38:18.704146+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:38:18.704146+0000","last_undegraded":"2024-09-14T11:38:18.704146+0000","last_fullsized":"2024-09-14T11:38:18.704146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-14T11:38:18.704046+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-14T11:38:18.704046+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.704046+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:21.330859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'795","reported_seq":2394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.728439+0000","last_change":"2024-09-14T11:38:25.728439+0000","last_active":"2024-09-14T11:38:25.728439+0000","last_peered":"2024-09-14T11:38:25.728439+0000","last_clean":"2024-09-14T11:38:25.728439+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:38:25.728439+0000","last_undegraded":"2024-09-14T11:38:25.728439+0000","last_fullsized":"2024-09-14T11:38:25.728439+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:25.728353+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:25.728353+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.728353+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:54.580317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'256","reported_seq":750,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.133065+0000","last_change":"2024-09-14T11:38:27.133065+0000","last_active":"2024-09-14T11:38:27.133065+0000","last_peered":"2024-09-14T11:38:27.133065+0000","last_clean":"2024-09-14T11:38:27.133065+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:38:27.133065+0000","last_undegraded":"2024-09-14T11:38:27.133065+0000","last_fullsized":"2024-09-14T11:38:27.133065+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-14T11:38:27.132972+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-14T11:38:27.132972+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.132972+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:27.250869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.782130+0000","last_change":"2024-09-14T11:37:58.782130+0000","last_active":"2024-09-14T11:37:58.782130+0000","last_peered":"2024-09-14T11:37:58.782130+0000","last_clean":"2024-09-14T11:37:58.782130+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:37:58.782130+0000","last_undegraded":"2024-09-14T11:37:58.782130+0000","last_fullsized":"2024-09-14T11:37:58.782130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.782043+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:01.595371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.229148+0000","last_change":"2024-09-14T11:37:53.229148+0000","last_active":"2024-09-14T11:37:53.229148+0000","last_peered":"2024-09-14T11:37:53.229148+0000","last_clean":"2024-09-14T11:37:53.229148+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:53.229148+0000","last_undegraded":"2024-09-14T11:37:53.229148+0000","last_fullsized":"2024-09-14T11:37:53.229148+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.229076+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:27.683273+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":848,"num_read_kb":56309,"num_write":1145,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.238426+0000","last_change":"2024-09-14T11:37:55.238426+0000","last_active":"2024-09-14T11:37:55.238426+0000","last_peered":"2024-09-14T11:37:55.238426+0000","last_clean":"2024-09-14T11:37:55.238426+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:37:55.238426+0000","last_undegraded":"2024-09-14T11:37:55.238426+0000","last_fullsized":"2024-09-14T11:37:55.238426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.238331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:34.224317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.695781+0000","last_change":"2024-09-14T11:38:17.695711+0000","last_active":"2024-09-14T11:38:17.695781+0000","last_peered":"2024-09-14T11:38:17.695781+0000","last_clean":"2024-09-14T11:38:17.695781+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:38:17.695781+0000","last_undegraded":"2024-09-14T11:38:17.695781+0000","last_fullsized":"2024-09-14T11:38:17.695781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.695622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.695622+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.695622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.947854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'725","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.954032+0000","last_change":"2024-09-14T11:38:16.954032+0000","last_active":"2024-09-14T11:38:16.954032+0000","last_peered":"2024-09-14T11:38:16.954032+0000","last_clean":"2024-09-14T11:38:16.954032+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:38:16.954032+0000","last_undegraded":"2024-09-14T11:38:16.954032+0000","last_fullsized":"2024-09-14T11:38:16.954032+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'725","last_scrub_stamp":"2024-09-14T11:38:16.953943+0000","last_deep_scrub":"264'725","last_deep_scrub_stamp":"2024-09-14T11:38:16.953943+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.953943+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:19.345828+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1287,"num_read_kb":3017,"num_write":1048,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.770245+0000","last_change":"2024-09-14T11:38:26.770245+0000","last_active":"2024-09-14T11:38:26.770245+0000","last_peered":"2024-09-14T11:38:26.770245+0000","last_clean":"2024-09-14T11:38:26.770245+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:38:26.770245+0000","last_undegraded":"2024-09-14T11:38:26.770245+0000","last_fullsized":"2024-09-14T11:38:26.770245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.770152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.770152+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.770152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:45.323231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'138","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.987126+0000","last_change":"2024-09-14T11:38:26.987126+0000","last_active":"2024-09-14T11:38:26.987126+0000","last_peered":"2024-09-14T11:38:26.987126+0000","last_clean":"2024-09-14T11:38:26.987126+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:38:26.987126+0000","last_undegraded":"2024-09-14T11:38:26.987126+0000","last_fullsized":"2024-09-14T11:38:26.987126+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:26.987044+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:26.987044+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.987044+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:43.784515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'138","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.148211+0000","last_change":"2024-09-14T11:38:32.148211+0000","last_active":"2024-09-14T11:38:32.148211+0000","last_peered":"2024-09-14T11:38:32.148211+0000","last_clean":"2024-09-14T11:38:32.148211+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:38:32.148211+0000","last_undegraded":"2024-09-14T11:38:32.148211+0000","last_fullsized":"2024-09-14T11:38:32.148211+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:32.148113+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:32.148113+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.148113+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:52.963634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'296","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.799272+0000","last_change":"2024-09-14T11:38:03.799205+0000","last_active":"2024-09-14T11:38:03.799272+0000","last_peered":"2024-09-14T11:38:03.799272+0000","last_clean":"2024-09-14T11:38:03.799272+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:38:03.799272+0000","last_undegraded":"2024-09-14T11:38:03.799272+0000","last_fullsized":"2024-09-14T11:38:03.799272+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.799103+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:55.138113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'297","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.751853+0000","last_change":"2024-09-14T11:37:59.751795+0000","last_active":"2024-09-14T11:37:59.751853+0000","last_peered":"2024-09-14T11:37:59.751853+0000","last_clean":"2024-09-14T11:37:59.751853+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:37:59.751853+0000","last_undegraded":"2024-09-14T11:37:59.751853+0000","last_fullsized":"2024-09-14T11:37:59.751853+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.751710+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:08.154524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":2279,"num_write":913,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.527091+0000","last_change":"2024-09-14T11:38:08.527034+0000","last_active":"2024-09-14T11:38:08.527091+0000","last_peered":"2024-09-14T11:38:08.527091+0000","last_clean":"2024-09-14T11:38:08.527091+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:38:08.527091+0000","last_undegraded":"2024-09-14T11:38:08.527091+0000","last_fullsized":"2024-09-14T11:38:08.527091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.526942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:37.177668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'261","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.778607+0000","last_change":"2024-09-14T11:38:22.778607+0000","last_active":"2024-09-14T11:38:22.778607+0000","last_peered":"2024-09-14T11:38:22.778607+0000","last_clean":"2024-09-14T11:38:22.778607+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:38:22.778607+0000","last_undegraded":"2024-09-14T11:38:22.778607+0000","last_fullsized":"2024-09-14T11:38:22.778607+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'261","last_scrub_stamp":"2024-09-14T11:38:22.778510+0000","last_deep_scrub":"264'261","last_deep_scrub_stamp":"2024-09-14T11:38:22.778510+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.778510+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:42.834735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44234,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":907,"num_write":328,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.748230+0000","last_change":"2024-09-14T11:38:28.748230+0000","last_active":"2024-09-14T11:38:28.748230+0000","last_peered":"2024-09-14T11:38:28.748230+0000","last_clean":"2024-09-14T11:38:28.748230+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:38:28.748230+0000","last_undegraded":"2024-09-14T11:38:28.748230+0000","last_fullsized":"2024-09-14T11:38:28.748230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:28.748135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:28.748135+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.748135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.090625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'114","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.755952+0000","last_change":"2024-09-14T11:38:35.755952+0000","last_active":"2024-09-14T11:38:35.755952+0000","last_peered":"2024-09-14T11:38:35.755952+0000","last_clean":"2024-09-14T11:38:35.755952+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:38:35.755952+0000","last_undegraded":"2024-09-14T11:38:35.755952+0000","last_fullsized":"2024-09-14T11:38:35.755952+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-14T11:38:35.755869+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-14T11:38:35.755869+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.755869+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:33.563906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.520852+0000","last_change":"2024-09-14T11:38:03.520774+0000","last_active":"2024-09-14T11:38:03.520852+0000","last_peered":"2024-09-14T11:38:03.520852+0000","last_clean":"2024-09-14T11:38:03.520852+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:38:03.520852+0000","last_undegraded":"2024-09-14T11:38:03.520852+0000","last_fullsized":"2024-09-14T11:38:03.520852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.520673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:06.183047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.979596+0000","last_change":"2024-09-14T11:38:05.979596+0000","last_active":"2024-09-14T11:38:05.979596+0000","last_peered":"2024-09-14T11:38:05.979596+0000","last_clean":"2024-09-14T11:38:05.979596+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:38:05.979596+0000","last_undegraded":"2024-09-14T11:38:05.979596+0000","last_fullsized":"2024-09-14T11:38:05.979596+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.979504+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.259987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":9277,"num_write":976,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.739583+0000","last_change":"2024-09-14T11:38:15.739583+0000","last_active":"2024-09-14T11:38:15.739583+0000","last_peered":"2024-09-14T11:38:15.739583+0000","last_clean":"2024-09-14T11:38:15.739583+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:38:15.739583+0000","last_undegraded":"2024-09-14T11:38:15.739583+0000","last_fullsized":"2024-09-14T11:38:15.739583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.739488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.739488+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.739488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:31.954617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'60","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.018389+0000","last_change":"2024-09-14T11:38:16.018389+0000","last_active":"2024-09-14T11:38:16.018389+0000","last_peered":"2024-09-14T11:38:16.018389+0000","last_clean":"2024-09-14T11:38:16.018389+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:38:16.018389+0000","last_undegraded":"2024-09-14T11:38:16.018389+0000","last_fullsized":"2024-09-14T11:38:16.018389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'60","last_scrub_stamp":"2024-09-14T11:38:16.018327+0000","last_deep_scrub":"264'60","last_deep_scrub_stamp":"2024-09-14T11:38:16.018327+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.018327+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.609047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.873580+0000","last_change":"2024-09-14T11:38:23.873580+0000","last_active":"2024-09-14T11:38:23.873580+0000","last_peered":"2024-09-14T11:38:23.873580+0000","last_clean":"2024-09-14T11:38:23.873580+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:38:23.873580+0000","last_undegraded":"2024-09-14T11:38:23.873580+0000","last_fullsized":"2024-09-14T11:38:23.873580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.873490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.873490+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.873490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:31.278400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'187","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.077616+0000","last_change":"2024-09-14T11:38:30.077509+0000","last_active":"2024-09-14T11:38:30.077616+0000","last_peered":"2024-09-14T11:38:30.077616+0000","last_clean":"2024-09-14T11:38:30.077616+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:38:30.077616+0000","last_undegraded":"2024-09-14T11:38:30.077616+0000","last_fullsized":"2024-09-14T11:38:30.077616+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-14T11:38:30.077386+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-14T11:38:30.077386+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.077386+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:40.158786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.767373+0000","last_change":"2024-09-14T11:38:06.767276+0000","last_active":"2024-09-14T11:38:06.767373+0000","last_peered":"2024-09-14T11:38:06.767373+0000","last_clean":"2024-09-14T11:38:06.767373+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:38:06.767373+0000","last_undegraded":"2024-09-14T11:38:06.767373+0000","last_fullsized":"2024-09-14T11:38:06.767373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'91","last_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_deep_scrub":"264'91","last_deep_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.767184+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:58.705749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'360","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.987699+0000","last_change":"2024-09-14T11:37:58.987699+0000","last_active":"2024-09-14T11:37:58.987699+0000","last_peered":"2024-09-14T11:37:58.987699+0000","last_clean":"2024-09-14T11:37:58.987699+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:37:58.987699+0000","last_undegraded":"2024-09-14T11:37:58.987699+0000","last_fullsized":"2024-09-14T11:37:58.987699+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.987611+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:24.048610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":2982,"num_write":1169,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.911139+0000","last_change":"2024-09-14T11:38:14.911032+0000","last_active":"2024-09-14T11:38:14.911139+0000","last_peered":"2024-09-14T11:38:14.911139+0000","last_clean":"2024-09-14T11:38:14.911139+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:38:14.911139+0000","last_undegraded":"2024-09-14T11:38:14.911139+0000","last_fullsized":"2024-09-14T11:38:14.911139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.910937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:23.836659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'313","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.733467+0000","last_change":"2024-09-14T11:38:21.733467+0000","last_active":"2024-09-14T11:38:21.733467+0000","last_peered":"2024-09-14T11:38:21.733467+0000","last_clean":"2024-09-14T11:38:21.733467+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:38:21.733467+0000","last_undegraded":"2024-09-14T11:38:21.733467+0000","last_fullsized":"2024-09-14T11:38:21.733467+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-14T11:38:21.733349+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-14T11:38:21.733349+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.733349+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:23.471264+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1126,"num_write":414,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.050831+0000","last_change":"2024-09-14T11:38:14.050749+0000","last_active":"2024-09-14T11:38:14.050831+0000","last_peered":"2024-09-14T11:38:14.050831+0000","last_clean":"2024-09-14T11:38:14.050831+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:38:14.050831+0000","last_undegraded":"2024-09-14T11:38:14.050831+0000","last_fullsized":"2024-09-14T11:38:14.050831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.050668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:18.444772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'187","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.119674+0000","last_change":"2024-09-14T11:38:30.119616+0000","last_active":"2024-09-14T11:38:30.119674+0000","last_peered":"2024-09-14T11:38:30.119674+0000","last_clean":"2024-09-14T11:38:30.119674+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:38:30.119674+0000","last_undegraded":"2024-09-14T11:38:30.119674+0000","last_fullsized":"2024-09-14T11:38:30.119674+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-14T11:38:30.119513+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-14T11:38:30.119513+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.119513+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:36.864427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.724247+0000","last_change":"2024-09-14T11:38:05.724174+0000","last_active":"2024-09-14T11:38:05.724247+0000","last_peered":"2024-09-14T11:38:05.724247+0000","last_clean":"2024-09-14T11:38:05.724247+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:38:05.724247+0000","last_undegraded":"2024-09-14T11:38:05.724247+0000","last_fullsized":"2024-09-14T11:38:05.724247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.724091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.241278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'326","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.186499+0000","last_change":"2024-09-14T11:37:55.186499+0000","last_active":"2024-09-14T11:37:55.186499+0000","last_peered":"2024-09-14T11:37:55.186499+0000","last_clean":"2024-09-14T11:37:55.186499+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:37:55.186499+0000","last_undegraded":"2024-09-14T11:37:55.186499+0000","last_fullsized":"2024-09-14T11:37:55.186499+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.186430+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:21.808735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":4364,"num_write":956,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.110226+0000","last_change":"2024-09-14T11:38:10.110173+0000","last_active":"2024-09-14T11:38:10.110226+0000","last_peered":"2024-09-14T11:38:10.110226+0000","last_clean":"2024-09-14T11:38:10.110226+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:38:10.110226+0000","last_undegraded":"2024-09-14T11:38:10.110226+0000","last_fullsized":"2024-09-14T11:38:10.110226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.110089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:50.692474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'267","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.900199+0000","last_change":"2024-09-14T11:38:18.900199+0000","last_active":"2024-09-14T11:38:18.900199+0000","last_peered":"2024-09-14T11:38:18.900199+0000","last_clean":"2024-09-14T11:38:18.900199+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:38:18.900199+0000","last_undegraded":"2024-09-14T11:38:18.900199+0000","last_fullsized":"2024-09-14T11:38:18.900199+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-09-14T11:38:18.900110+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-09-14T11:38:18.900110+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.900110+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.833350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":429,"num_read_kb":979,"num_write":348,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.096135+0000","last_change":"2024-09-14T11:38:24.096135+0000","last_active":"2024-09-14T11:38:24.096135+0000","last_peered":"2024-09-14T11:38:24.096135+0000","last_clean":"2024-09-14T11:38:24.096135+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:38:24.096135+0000","last_undegraded":"2024-09-14T11:38:24.096135+0000","last_fullsized":"2024-09-14T11:38:24.096135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.096035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.096035+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.096035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:42.507339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.195176+0000","last_change":"2024-09-14T11:38:05.195176+0000","last_active":"2024-09-14T11:38:05.195176+0000","last_peered":"2024-09-14T11:38:05.195176+0000","last_clean":"2024-09-14T11:38:05.195176+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:38:05.195176+0000","last_undegraded":"2024-09-14T11:38:05.195176+0000","last_fullsized":"2024-09-14T11:38:05.195176+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.195090+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:58.870651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'316","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.760929+0000","last_change":"2024-09-14T11:38:00.760929+0000","last_active":"2024-09-14T11:38:00.760929+0000","last_peered":"2024-09-14T11:38:00.760929+0000","last_clean":"2024-09-14T11:38:00.760929+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:38:00.760929+0000","last_undegraded":"2024-09-14T11:38:00.760929+0000","last_fullsized":"2024-09-14T11:38:00.760929+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.760838+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.394615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":11665,"num_write":969,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.137854+0000","last_change":"2024-09-14T11:38:11.137775+0000","last_active":"2024-09-14T11:38:11.137854+0000","last_peered":"2024-09-14T11:38:11.137854+0000","last_clean":"2024-09-14T11:38:11.137854+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:38:11.137854+0000","last_undegraded":"2024-09-14T11:38:11.137854+0000","last_fullsized":"2024-09-14T11:38:11.137854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.137678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:29.267416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'484","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.562257+0000","last_change":"2024-09-14T11:38:13.562171+0000","last_active":"2024-09-14T11:38:13.562257+0000","last_peered":"2024-09-14T11:38:13.562257+0000","last_clean":"2024-09-14T11:38:13.562257+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:38:13.562257+0000","last_undegraded":"2024-09-14T11:38:13.562257+0000","last_fullsized":"2024-09-14T11:38:13.562257+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'484","last_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_deep_scrub":"264'484","last_deep_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.562082+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.434257+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192423,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":855,"num_read_kb":2213,"num_write":738,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.908180+0000","last_change":"2024-09-14T11:38:23.908074+0000","last_active":"2024-09-14T11:38:23.908180+0000","last_peered":"2024-09-14T11:38:23.908180+0000","last_clean":"2024-09-14T11:38:23.908180+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:38:23.908180+0000","last_undegraded":"2024-09-14T11:38:23.908180+0000","last_fullsized":"2024-09-14T11:38:23.908180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.907981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.907981+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.907981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:03.109857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'183","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.734803+0000","last_change":"2024-09-14T11:38:33.734803+0000","last_active":"2024-09-14T11:38:33.734803+0000","last_peered":"2024-09-14T11:38:33.734803+0000","last_clean":"2024-09-14T11:38:33.734803+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:38:33.734803+0000","last_undegraded":"2024-09-14T11:38:33.734803+0000","last_fullsized":"2024-09-14T11:38:33.734803+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-09-14T11:38:33.734705+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-09-14T11:38:33.734705+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.734705+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:04.775181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.178795+0000","last_change":"2024-09-14T11:38:08.178711+0000","last_active":"2024-09-14T11:38:08.178795+0000","last_peered":"2024-09-14T11:38:08.178795+0000","last_clean":"2024-09-14T11:38:08.178795+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:38:08.178795+0000","last_undegraded":"2024-09-14T11:38:08.178795+0000","last_fullsized":"2024-09-14T11:38:08.178795+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.178627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:19.038119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'332","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.496892+0000","last_change":"2024-09-14T11:37:56.496892+0000","last_active":"2024-09-14T11:37:56.496892+0000","last_peered":"2024-09-14T11:37:56.496892+0000","last_clean":"2024-09-14T11:37:56.496892+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:56.496892+0000","last_undegraded":"2024-09-14T11:37:56.496892+0000","last_fullsized":"2024-09-14T11:37:56.496892+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.496799+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.399160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":3066,"num_write":996,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.126049+0000","last_change":"2024-09-14T11:38:09.126049+0000","last_active":"2024-09-14T11:38:09.126049+0000","last_peered":"2024-09-14T11:38:09.126049+0000","last_clean":"2024-09-14T11:38:09.126049+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:38:09.126049+0000","last_undegraded":"2024-09-14T11:38:09.126049+0000","last_fullsized":"2024-09-14T11:38:09.126049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.125953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:41.468504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'344","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.891042+0000","last_change":"2024-09-14T11:38:21.890980+0000","last_active":"2024-09-14T11:38:21.891042+0000","last_peered":"2024-09-14T11:38:21.891042+0000","last_clean":"2024-09-14T11:38:21.891042+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:38:21.891042+0000","last_undegraded":"2024-09-14T11:38:21.891042+0000","last_fullsized":"2024-09-14T11:38:21.891042+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-14T11:38:21.890811+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-14T11:38:21.890811+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.890811+0000","objects_scrubbed":8,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:01.928184+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":556,"num_read_kb":1258,"num_write":472,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.519944+0000","last_change":"2024-09-14T11:38:15.519873+0000","last_active":"2024-09-14T11:38:15.519944+0000","last_peered":"2024-09-14T11:38:15.519944+0000","last_clean":"2024-09-14T11:38:15.519944+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:38:15.519944+0000","last_undegraded":"2024-09-14T11:38:15.519944+0000","last_fullsized":"2024-09-14T11:38:15.519944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.519778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.519778+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.519778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:56.547275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'171","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.115873+0000","last_change":"2024-09-14T11:38:18.115813+0000","last_active":"2024-09-14T11:38:18.115873+0000","last_peered":"2024-09-14T11:38:18.115873+0000","last_clean":"2024-09-14T11:38:18.115873+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:38:18.115873+0000","last_undegraded":"2024-09-14T11:38:18.115873+0000","last_fullsized":"2024-09-14T11:38:18.115873+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-14T11:38:18.115725+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-14T11:38:18.115725+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.115725+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:16.833713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.796385+0000","last_change":"2024-09-14T11:38:10.796324+0000","last_active":"2024-09-14T11:38:10.796385+0000","last_peered":"2024-09-14T11:38:10.796385+0000","last_clean":"2024-09-14T11:38:10.796385+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:38:10.796385+0000","last_undegraded":"2024-09-14T11:38:10.796385+0000","last_fullsized":"2024-09-14T11:38:10.796385+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.796238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:26.034543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'368","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.771047+0000","last_change":"2024-09-14T11:37:56.770978+0000","last_active":"2024-09-14T11:37:56.771047+0000","last_peered":"2024-09-14T11:37:56.771047+0000","last_clean":"2024-09-14T11:37:56.771047+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:37:56.771047+0000","last_undegraded":"2024-09-14T11:37:56.771047+0000","last_fullsized":"2024-09-14T11:37:56.771047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.770888+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:59.783985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":69620,"num_write":1137,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.797204+0000","last_change":"2024-09-14T11:38:21.797145+0000","last_active":"2024-09-14T11:38:21.797204+0000","last_peered":"2024-09-14T11:38:21.797204+0000","last_clean":"2024-09-14T11:38:21.797204+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:38:21.797204+0000","last_undegraded":"2024-09-14T11:38:21.797204+0000","last_fullsized":"2024-09-14T11:38:21.797204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:21.797056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:21.797056+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.797056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:56.877813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'275","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.689762+0000","last_change":"2024-09-14T11:38:24.689762+0000","last_active":"2024-09-14T11:38:24.689762+0000","last_peered":"2024-09-14T11:38:24.689762+0000","last_clean":"2024-09-14T11:38:24.689762+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:38:24.689762+0000","last_undegraded":"2024-09-14T11:38:24.689762+0000","last_fullsized":"2024-09-14T11:38:24.689762+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-09-14T11:38:24.689662+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-09-14T11:38:24.689662+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.689662+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:08.180187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52342,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1065,"num_write":374,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.512524+0000","last_change":"2024-09-14T11:38:16.512466+0000","last_active":"2024-09-14T11:38:16.512524+0000","last_peered":"2024-09-14T11:38:16.512524+0000","last_clean":"2024-09-14T11:38:16.512524+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:38:16.512524+0000","last_undegraded":"2024-09-14T11:38:16.512524+0000","last_fullsized":"2024-09-14T11:38:16.512524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:16.512384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:16.512384+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.512384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:10.329231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.034832+0000","last_change":"2024-09-14T11:38:28.034832+0000","last_active":"2024-09-14T11:38:28.034832+0000","last_peered":"2024-09-14T11:38:28.034832+0000","last_clean":"2024-09-14T11:38:28.034832+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:38:28.034832+0000","last_undegraded":"2024-09-14T11:38:28.034832+0000","last_fullsized":"2024-09-14T11:38:28.034832+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-14T11:38:28.034726+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-14T11:38:28.034726+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.034726+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:08.711735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.346807+0000","last_change":"2024-09-14T11:38:00.346691+0000","last_active":"2024-09-14T11:38:00.346807+0000","last_peered":"2024-09-14T11:38:00.346807+0000","last_clean":"2024-09-14T11:38:00.346807+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:38:00.346807+0000","last_undegraded":"2024-09-14T11:38:00.346807+0000","last_fullsized":"2024-09-14T11:38:00.346807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.346611+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.401615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'352","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.200282+0000","last_change":"2024-09-14T11:37:57.200197+0000","last_active":"2024-09-14T11:37:57.200282+0000","last_peered":"2024-09-14T11:37:57.200282+0000","last_clean":"2024-09-14T11:37:57.200282+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:37:57.200282+0000","last_undegraded":"2024-09-14T11:37:57.200282+0000","last_fullsized":"2024-09-14T11:37:57.200282+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.200097+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:27.049496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":33947,"num_write":1155,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.530691+0000","last_change":"2024-09-14T11:38:10.530630+0000","last_active":"2024-09-14T11:38:10.530691+0000","last_peered":"2024-09-14T11:38:10.530691+0000","last_clean":"2024-09-14T11:38:10.530691+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:38:10.530691+0000","last_undegraded":"2024-09-14T11:38:10.530691+0000","last_fullsized":"2024-09-14T11:38:10.530691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.530538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:40.837743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'103","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.747782+0000","last_change":"2024-09-14T11:38:23.747782+0000","last_active":"2024-09-14T11:38:23.747782+0000","last_peered":"2024-09-14T11:38:23.747782+0000","last_clean":"2024-09-14T11:38:23.747782+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:38:23.747782+0000","last_undegraded":"2024-09-14T11:38:23.747782+0000","last_fullsized":"2024-09-14T11:38:23.747782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-14T11:38:23.747694+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-14T11:38:23.747694+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.747694+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:33.487506+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'754","reported_seq":4586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.050848+0000","last_change":"2024-09-14T11:38:16.050848+0000","last_active":"2024-09-14T11:38:16.050848+0000","last_peered":"2024-09-14T11:38:16.050848+0000","last_clean":"2024-09-14T11:38:16.050848+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:38:16.050848+0000","last_undegraded":"2024-09-14T11:38:16.050848+0000","last_fullsized":"2024-09-14T11:38:16.050848+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'754","last_scrub_stamp":"2024-09-14T11:38:16.050755+0000","last_deep_scrub":"264'754","last_deep_scrub_stamp":"2024-09-14T11:38:16.050755+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.050755+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:51.960047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'127","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.874483+0000","last_change":"2024-09-14T11:38:26.874483+0000","last_active":"2024-09-14T11:38:26.874483+0000","last_peered":"2024-09-14T11:38:26.874483+0000","last_clean":"2024-09-14T11:38:26.874483+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:38:26.874483+0000","last_undegraded":"2024-09-14T11:38:26.874483+0000","last_fullsized":"2024-09-14T11:38:26.874483+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:38:26.874398+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:38:26.874398+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.874398+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:31.390672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.896375+0000","last_change":"2024-09-14T11:38:07.896311+0000","last_active":"2024-09-14T11:38:07.896375+0000","last_peered":"2024-09-14T11:38:07.896375+0000","last_clean":"2024-09-14T11:38:07.896375+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:38:07.896375+0000","last_undegraded":"2024-09-14T11:38:07.896375+0000","last_fullsized":"2024-09-14T11:38:07.896375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.896225+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:30.027652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'357","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.971671+0000","last_change":"2024-09-14T11:37:59.971599+0000","last_active":"2024-09-14T11:37:59.971671+0000","last_peered":"2024-09-14T11:37:59.971671+0000","last_clean":"2024-09-14T11:37:59.971671+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:37:59.971671+0000","last_undegraded":"2024-09-14T11:37:59.971671+0000","last_fullsized":"2024-09-14T11:37:59.971671+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.971497+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:22.835652+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":780,"num_read_kb":7716,"num_write":1096,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.899796+0000","last_change":"2024-09-14T11:38:15.899729+0000","last_active":"2024-09-14T11:38:15.899796+0000","last_peered":"2024-09-14T11:38:15.899796+0000","last_clean":"2024-09-14T11:38:15.899796+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:38:15.899796+0000","last_undegraded":"2024-09-14T11:38:15.899796+0000","last_fullsized":"2024-09-14T11:38:15.899796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.899639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.899639+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.899639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:54.243126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'329","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.906798+0000","last_change":"2024-09-14T11:38:21.906798+0000","last_active":"2024-09-14T11:38:21.906798+0000","last_peered":"2024-09-14T11:38:21.906798+0000","last_clean":"2024-09-14T11:38:21.906798+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:38:21.906798+0000","last_undegraded":"2024-09-14T11:38:21.906798+0000","last_fullsized":"2024-09-14T11:38:21.906798+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-14T11:38:21.906690+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-14T11:38:21.906690+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.906690+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.598087+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1178,"num_write":428,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.128390+0000","last_change":"2024-09-14T11:38:23.128390+0000","last_active":"2024-09-14T11:38:23.128390+0000","last_peered":"2024-09-14T11:38:23.128390+0000","last_clean":"2024-09-14T11:38:23.128390+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:38:23.128390+0000","last_undegraded":"2024-09-14T11:38:23.128390+0000","last_fullsized":"2024-09-14T11:38:23.128390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.128297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.128297+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.128297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:06.906757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.878297+0000","last_change":"2024-09-14T11:38:27.878297+0000","last_active":"2024-09-14T11:38:27.878297+0000","last_peered":"2024-09-14T11:38:27.878297+0000","last_clean":"2024-09-14T11:38:27.878297+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:38:27.878297+0000","last_undegraded":"2024-09-14T11:38:27.878297+0000","last_fullsized":"2024-09-14T11:38:27.878297+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:38:27.878181+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:38:27.878181+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.878181+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:51.588624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.879604+0000","last_change":"2024-09-14T11:38:06.879515+0000","last_active":"2024-09-14T11:38:06.879604+0000","last_peered":"2024-09-14T11:38:06.879604+0000","last_clean":"2024-09-14T11:38:06.879604+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:38:06.879604+0000","last_undegraded":"2024-09-14T11:38:06.879604+0000","last_fullsized":"2024-09-14T11:38:06.879604+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.879391+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:16.629096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'333","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.959714+0000","last_change":"2024-09-14T11:38:00.959619+0000","last_active":"2024-09-14T11:38:00.959714+0000","last_peered":"2024-09-14T11:38:00.959714+0000","last_clean":"2024-09-14T11:38:00.959714+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:38:00.959714+0000","last_undegraded":"2024-09-14T11:38:00.959714+0000","last_fullsized":"2024-09-14T11:38:00.959714+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.959518+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:02.829306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":36817,"num_write":973,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.885673+0000","last_change":"2024-09-14T11:38:17.885564+0000","last_active":"2024-09-14T11:38:17.885673+0000","last_peered":"2024-09-14T11:38:17.885673+0000","last_clean":"2024-09-14T11:38:17.885673+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:38:17.885673+0000","last_undegraded":"2024-09-14T11:38:17.885673+0000","last_fullsized":"2024-09-14T11:38:17.885673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.885473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.885473+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.885473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:55.102829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'287","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.011793+0000","last_change":"2024-09-14T11:38:18.011793+0000","last_active":"2024-09-14T11:38:18.011793+0000","last_peered":"2024-09-14T11:38:18.011793+0000","last_clean":"2024-09-14T11:38:18.011793+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:38:18.011793+0000","last_undegraded":"2024-09-14T11:38:18.011793+0000","last_fullsized":"2024-09-14T11:38:18.011793+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'287","last_scrub_stamp":"2024-09-14T11:38:18.011686+0000","last_deep_scrub":"264'287","last_deep_scrub_stamp":"2024-09-14T11:38:18.011686+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.011686+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:06.174741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43010,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":1018,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.031252+0000","last_change":"2024-09-14T11:38:15.031252+0000","last_active":"2024-09-14T11:38:15.031252+0000","last_peered":"2024-09-14T11:38:15.031252+0000","last_clean":"2024-09-14T11:38:15.031252+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:38:15.031252+0000","last_undegraded":"2024-09-14T11:38:15.031252+0000","last_fullsized":"2024-09-14T11:38:15.031252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.031165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.031165+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.031165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:41.916463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'152","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.744575+0000","last_change":"2024-09-14T11:38:34.744575+0000","last_active":"2024-09-14T11:38:34.744575+0000","last_peered":"2024-09-14T11:38:34.744575+0000","last_clean":"2024-09-14T11:38:34.744575+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:38:34.744575+0000","last_undegraded":"2024-09-14T11:38:34.744575+0000","last_fullsized":"2024-09-14T11:38:34.744575+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:34.744484+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:34.744484+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.744484+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:53.145434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'126","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.808000+0000","last_change":"2024-09-14T11:38:09.808000+0000","last_active":"2024-09-14T11:38:09.808000+0000","last_peered":"2024-09-14T11:38:09.808000+0000","last_clean":"2024-09-14T11:38:09.808000+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:38:09.808000+0000","last_undegraded":"2024-09-14T11:38:09.808000+0000","last_fullsized":"2024-09-14T11:38:09.808000+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.807913+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:08.263690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'378","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.769777+0000","last_change":"2024-09-14T11:37:57.769714+0000","last_active":"2024-09-14T11:37:57.769777+0000","last_peered":"2024-09-14T11:37:57.769777+0000","last_clean":"2024-09-14T11:37:57.769777+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:37:57.769777+0000","last_undegraded":"2024-09-14T11:37:57.769777+0000","last_fullsized":"2024-09-14T11:37:57.769777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.769590+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:11.879615+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":618,"num_read_kb":16528,"num_write":1305,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.673206+0000","last_change":"2024-09-14T11:38:17.673206+0000","last_active":"2024-09-14T11:38:17.673206+0000","last_peered":"2024-09-14T11:38:17.673206+0000","last_clean":"2024-09-14T11:38:17.673206+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:38:17.673206+0000","last_undegraded":"2024-09-14T11:38:17.673206+0000","last_fullsized":"2024-09-14T11:38:17.673206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.673119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.673119+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.673119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:17.992154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'272","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.730418+0000","last_change":"2024-09-14T11:38:23.730319+0000","last_active":"2024-09-14T11:38:23.730418+0000","last_peered":"2024-09-14T11:38:23.730418+0000","last_clean":"2024-09-14T11:38:23.730418+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:38:23.730418+0000","last_undegraded":"2024-09-14T11:38:23.730418+0000","last_fullsized":"2024-09-14T11:38:23.730418+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-14T11:38:23.730218+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-14T11:38:23.730218+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.730218+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:17.916005+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51357,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":1141,"num_write":384,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.765370+0000","last_change":"2024-09-14T11:38:26.765314+0000","last_active":"2024-09-14T11:38:26.765370+0000","last_peered":"2024-09-14T11:38:26.765370+0000","last_clean":"2024-09-14T11:38:26.765370+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:38:26.765370+0000","last_undegraded":"2024-09-14T11:38:26.765370+0000","last_fullsized":"2024-09-14T11:38:26.765370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.765225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.765225+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.765225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:39.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'179","reported_seq":1647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.920451+0000","last_change":"2024-09-14T11:38:28.920451+0000","last_active":"2024-09-14T11:38:28.920451+0000","last_peered":"2024-09-14T11:38:28.920451+0000","last_clean":"2024-09-14T11:38:28.920451+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:38:28.920451+0000","last_undegraded":"2024-09-14T11:38:28.920451+0000","last_fullsized":"2024-09-14T11:38:28.920451+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:38:28.920367+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:38:28.920367+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.920367+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:21.692826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.844285+0000","last_change":"2024-09-14T11:38:05.844285+0000","last_active":"2024-09-14T11:38:05.844285+0000","last_peered":"2024-09-14T11:38:05.844285+0000","last_clean":"2024-09-14T11:38:05.844285+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:38:05.844285+0000","last_undegraded":"2024-09-14T11:38:05.844285+0000","last_fullsized":"2024-09-14T11:38:05.844285+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.844184+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:14.327154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'362","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.193415+0000","last_change":"2024-09-14T11:37:56.193415+0000","last_active":"2024-09-14T11:37:56.193415+0000","last_peered":"2024-09-14T11:37:56.193415+0000","last_clean":"2024-09-14T11:37:56.193415+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:37:56.193415+0000","last_undegraded":"2024-09-14T11:37:56.193415+0000","last_fullsized":"2024-09-14T11:37:56.193415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.193342+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:11.215563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":662,"num_read_kb":13580,"num_write":1124,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.513158+0000","last_change":"2024-09-14T11:38:09.513158+0000","last_active":"2024-09-14T11:38:09.513158+0000","last_peered":"2024-09-14T11:38:09.513158+0000","last_clean":"2024-09-14T11:38:09.513158+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:38:09.513158+0000","last_undegraded":"2024-09-14T11:38:09.513158+0000","last_fullsized":"2024-09-14T11:38:09.513158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.513031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:35.439168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'285","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.752573+0000","last_change":"2024-09-14T11:38:20.752499+0000","last_active":"2024-09-14T11:38:20.752573+0000","last_peered":"2024-09-14T11:38:20.752573+0000","last_clean":"2024-09-14T11:38:20.752573+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:38:20.752573+0000","last_undegraded":"2024-09-14T11:38:20.752573+0000","last_fullsized":"2024-09-14T11:38:20.752573+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-09-14T11:38:20.752317+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-09-14T11:38:20.752317+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.752317+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:45.897103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":1053,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.123714+0000","last_change":"2024-09-14T11:38:25.123597+0000","last_active":"2024-09-14T11:38:25.123714+0000","last_peered":"2024-09-14T11:38:25.123714+0000","last_clean":"2024-09-14T11:38:25.123714+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:38:25.123714+0000","last_undegraded":"2024-09-14T11:38:25.123714+0000","last_fullsized":"2024-09-14T11:38:25.123714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.123477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.123477+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.123477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:05.503469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.754713+0000","last_change":"2024-09-14T11:38:28.754713+0000","last_active":"2024-09-14T11:38:28.754713+0000","last_peered":"2024-09-14T11:38:28.754713+0000","last_clean":"2024-09-14T11:38:28.754713+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:38:28.754713+0000","last_undegraded":"2024-09-14T11:38:28.754713+0000","last_fullsized":"2024-09-14T11:38:28.754713+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-09-14T11:38:28.754621+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-09-14T11:38:28.754621+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.754621+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:57.271998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.549238+0000","last_change":"2024-09-14T11:38:05.549238+0000","last_active":"2024-09-14T11:38:05.549238+0000","last_peered":"2024-09-14T11:38:05.549238+0000","last_clean":"2024-09-14T11:38:05.549238+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:38:05.549238+0000","last_undegraded":"2024-09-14T11:38:05.549238+0000","last_fullsized":"2024-09-14T11:38:05.549238+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.549130+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:53.773608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'381","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.243905+0000","last_change":"2024-09-14T11:38:00.243905+0000","last_active":"2024-09-14T11:38:00.243905+0000","last_peered":"2024-09-14T11:38:00.243905+0000","last_clean":"2024-09-14T11:38:00.243905+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:38:00.243905+0000","last_undegraded":"2024-09-14T11:38:00.243905+0000","last_fullsized":"2024-09-14T11:38:00.243905+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.243785+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:58.476866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":8663,"num_write":1069,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.481794+0000","last_change":"2024-09-14T11:38:07.481794+0000","last_active":"2024-09-14T11:38:07.481794+0000","last_peered":"2024-09-14T11:38:07.481794+0000","last_clean":"2024-09-14T11:38:07.481794+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:38:07.481794+0000","last_undegraded":"2024-09-14T11:38:07.481794+0000","last_fullsized":"2024-09-14T11:38:07.481794+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.481689+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.494813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'448","reported_seq":1120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.257837+0000","last_change":"2024-09-14T11:37:54.257837+0000","last_active":"2024-09-14T11:37:54.257837+0000","last_peered":"2024-09-14T11:37:54.257837+0000","last_clean":"2024-09-14T11:37:54.257837+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:37:54.257837+0000","last_undegraded":"2024-09-14T11:37:54.257837+0000","last_fullsized":"2024-09-14T11:37:54.257837+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'448","last_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_deep_scrub":"264'448","last_deep_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.257768+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:31.063923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":16320,"num_write":1497,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.006241+0000","last_change":"2024-09-14T11:38:09.006241+0000","last_active":"2024-09-14T11:38:09.006241+0000","last_peered":"2024-09-14T11:38:09.006241+0000","last_clean":"2024-09-14T11:38:09.006241+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:38:09.006241+0000","last_undegraded":"2024-09-14T11:38:09.006241+0000","last_fullsized":"2024-09-14T11:38:09.006241+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.006154+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'302","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.929061+0000","last_change":"2024-09-14T11:38:01.929061+0000","last_active":"2024-09-14T11:38:01.929061+0000","last_peered":"2024-09-14T11:38:01.929061+0000","last_clean":"2024-09-14T11:38:01.929061+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:38:01.929061+0000","last_undegraded":"2024-09-14T11:38:01.929061+0000","last_fullsized":"2024-09-14T11:38:01.929061+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.928975+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:06.365261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":2695,"num_write":898,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.499069+0000","last_change":"2024-09-14T11:38:04.499069+0000","last_active":"2024-09-14T11:38:04.499069+0000","last_peered":"2024-09-14T11:38:04.499069+0000","last_clean":"2024-09-14T11:38:04.499069+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:38:04.499069+0000","last_undegraded":"2024-09-14T11:38:04.499069+0000","last_fullsized":"2024-09-14T11:38:04.499069+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.498989+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.862258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'356","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.167523+0000","last_change":"2024-09-14T11:37:58.167440+0000","last_active":"2024-09-14T11:37:58.167523+0000","last_peered":"2024-09-14T11:37:58.167523+0000","last_clean":"2024-09-14T11:37:58.167523+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:37:58.167523+0000","last_undegraded":"2024-09-14T11:37:58.167523+0000","last_fullsized":"2024-09-14T11:37:58.167523+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.167277+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.933166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":27796,"num_write":1160,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.787252+0000","last_change":"2024-09-14T11:38:12.787252+0000","last_active":"2024-09-14T11:38:12.787252+0000","last_peered":"2024-09-14T11:38:12.787252+0000","last_clean":"2024-09-14T11:38:12.787252+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:38:12.787252+0000","last_undegraded":"2024-09-14T11:38:12.787252+0000","last_fullsized":"2024-09-14T11:38:12.787252+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4160","last_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_deep_scrub":"264'4160","last_deep_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.787148+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:55.106908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'442","reported_seq":1223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.746470+0000","last_change":"2024-09-14T11:37:59.746470+0000","last_active":"2024-09-14T11:37:59.746470+0000","last_peered":"2024-09-14T11:37:59.746470+0000","last_clean":"2024-09-14T11:37:59.746470+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:37:59.746470+0000","last_undegraded":"2024-09-14T11:37:59.746470+0000","last_fullsized":"2024-09-14T11:37:59.746470+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'442","last_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_deep_scrub":"264'442","last_deep_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.746338+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:48.240361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1409,"num_read_kb":14785,"num_write":1267,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.908101+0000","last_change":"2024-09-14T11:38:08.908101+0000","last_active":"2024-09-14T11:38:08.908101+0000","last_peered":"2024-09-14T11:38:08.908101+0000","last_clean":"2024-09-14T11:38:08.908101+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:38:08.908101+0000","last_undegraded":"2024-09-14T11:38:08.908101+0000","last_fullsized":"2024-09-14T11:38:08.908101+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.908006+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:32.288213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'423","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.528878+0000","last_change":"2024-09-14T11:37:57.528878+0000","last_active":"2024-09-14T11:37:57.528878+0000","last_peered":"2024-09-14T11:37:57.528878+0000","last_clean":"2024-09-14T11:37:57.528878+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:37:57.528878+0000","last_undegraded":"2024-09-14T11:37:57.528878+0000","last_fullsized":"2024-09-14T11:37:57.528878+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.528772+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:11.066498+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":745,"num_read_kb":54735,"num_write":1248,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.754421+0000","last_change":"2024-09-14T11:38:11.754421+0000","last_active":"2024-09-14T11:38:11.754421+0000","last_peered":"2024-09-14T11:38:11.754421+0000","last_clean":"2024-09-14T11:38:11.754421+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:38:11.754421+0000","last_undegraded":"2024-09-14T11:38:11.754421+0000","last_fullsized":"2024-09-14T11:38:11.754421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'75","last_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_deep_scrub":"264'75","last_deep_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.754322+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:33.771510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'428","reported_seq":1211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.248925+0000","last_change":"2024-09-14T11:37:58.248925+0000","last_active":"2024-09-14T11:37:58.248925+0000","last_peered":"2024-09-14T11:37:58.248925+0000","last_clean":"2024-09-14T11:37:58.248925+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:37:58.248925+0000","last_undegraded":"2024-09-14T11:37:58.248925+0000","last_fullsized":"2024-09-14T11:37:58.248925+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.248799+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:09.244000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1142,"num_read_kb":46426,"num_write":1473,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'303","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.161512+0000","last_change":"2024-09-14T11:38:08.161512+0000","last_active":"2024-09-14T11:38:08.161512+0000","last_peered":"2024-09-14T11:38:08.161512+0000","last_clean":"2024-09-14T11:38:08.161512+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:38:08.161512+0000","last_undegraded":"2024-09-14T11:38:08.161512+0000","last_fullsized":"2024-09-14T11:38:08.161512+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.161420+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:54.808745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'323","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.727550+0000","last_change":"2024-09-14T11:37:58.727550+0000","last_active":"2024-09-14T11:37:58.727550+0000","last_peered":"2024-09-14T11:37:58.727550+0000","last_clean":"2024-09-14T11:37:58.727550+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:37:58.727550+0000","last_undegraded":"2024-09-14T11:37:58.727550+0000","last_fullsized":"2024-09-14T11:37:58.727550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.727456+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:23.797636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":5718,"num_write":986,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.210936+0000","last_change":"2024-09-14T11:38:07.210816+0000","last_active":"2024-09-14T11:38:07.210936+0000","last_peered":"2024-09-14T11:38:07.210936+0000","last_clean":"2024-09-14T11:38:07.210936+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:38:07.210936+0000","last_undegraded":"2024-09-14T11:38:07.210936+0000","last_fullsized":"2024-09-14T11:38:07.210936+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.210704+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:06.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'377","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.911007+0000","last_change":"2024-09-14T11:38:02.911007+0000","last_active":"2024-09-14T11:38:02.911007+0000","last_peered":"2024-09-14T11:38:02.911007+0000","last_clean":"2024-09-14T11:38:02.911007+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:38:02.911007+0000","last_undegraded":"2024-09-14T11:38:02.911007+0000","last_fullsized":"2024-09-14T11:38:02.911007+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.910912+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:21.469889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":8094,"num_write":1138,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.884396+0000","last_change":"2024-09-14T11:38:09.884320+0000","last_active":"2024-09-14T11:38:09.884396+0000","last_peered":"2024-09-14T11:38:09.884396+0000","last_clean":"2024-09-14T11:38:09.884396+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:38:09.884396+0000","last_undegraded":"2024-09-14T11:38:09.884396+0000","last_fullsized":"2024-09-14T11:38:09.884396+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.884229+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:38.099864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'368","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.724348+0000","last_change":"2024-09-14T11:38:01.724263+0000","last_active":"2024-09-14T11:38:01.724348+0000","last_peered":"2024-09-14T11:38:01.724348+0000","last_clean":"2024-09-14T11:38:01.724348+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:38:01.724348+0000","last_undegraded":"2024-09-14T11:38:01.724348+0000","last_fullsized":"2024-09-14T11:38:01.724348+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.724153+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.764518+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1962460,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":52898,"num_write":1154,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":791,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.305061+0000","last_change":"2024-09-14T11:38:01.305061+0000","last_active":"2024-09-14T11:38:01.305061+0000","last_peered":"2024-09-14T11:38:01.305061+0000","last_clean":"2024-09-14T11:38:01.305061+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:38:01.305061+0000","last_undegraded":"2024-09-14T11:38:01.305061+0000","last_fullsized":"2024-09-14T11:38:01.305061+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.304953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:28.747455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'368","reported_seq":1243,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.975041+0000","last_change":"2024-09-14T11:38:06.974983+0000","last_active":"2024-09-14T11:38:06.975041+0000","last_peered":"2024-09-14T11:38:06.975041+0000","last_clean":"2024-09-14T11:38:06.975041+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:38:06.975041+0000","last_undegraded":"2024-09-14T11:38:06.975041+0000","last_fullsized":"2024-09-14T11:38:06.975041+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.974873+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:16.281919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":34715,"num_write":1227,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'92","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.842917+0000","last_change":"2024-09-14T11:38:11.842850+0000","last_active":"2024-09-14T11:38:11.842917+0000","last_peered":"2024-09-14T11:38:11.842917+0000","last_clean":"2024-09-14T11:38:11.842917+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:38:11.842917+0000","last_undegraded":"2024-09-14T11:38:11.842917+0000","last_fullsized":"2024-09-14T11:38:11.842917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.842773+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:45.306750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.126636+0000","last_change":"2024-09-14T11:37:59.126563+0000","last_active":"2024-09-14T11:37:59.126636+0000","last_peered":"2024-09-14T11:37:59.126636+0000","last_clean":"2024-09-14T11:37:59.126636+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:37:59.126636+0000","last_undegraded":"2024-09-14T11:37:59.126636+0000","last_fullsized":"2024-09-14T11:37:59.126636+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.126454+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:37.405483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":11879,"num_write":1239,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.016973+0000","last_change":"2024-09-14T11:38:10.016899+0000","last_active":"2024-09-14T11:38:10.016973+0000","last_peered":"2024-09-14T11:38:10.016973+0000","last_clean":"2024-09-14T11:38:10.016973+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:38:10.016973+0000","last_undegraded":"2024-09-14T11:38:10.016973+0000","last_fullsized":"2024-09-14T11:38:10.016973+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'280","last_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_deep_scrub":"264'280","last_deep_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.016803+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:19.537700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'406","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.277818+0000","last_change":"2024-09-14T11:37:59.277763+0000","last_active":"2024-09-14T11:37:59.277818+0000","last_peered":"2024-09-14T11:37:59.277818+0000","last_clean":"2024-09-14T11:37:59.277818+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:37:59.277818+0000","last_undegraded":"2024-09-14T11:37:59.277818+0000","last_fullsized":"2024-09-14T11:37:59.277818+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.277645+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:27.504525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":733,"num_read_kb":26249,"num_write":1207,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.135798+0000","last_change":"2024-09-14T11:38:05.135737+0000","last_active":"2024-09-14T11:38:05.135798+0000","last_peered":"2024-09-14T11:38:05.135798+0000","last_clean":"2024-09-14T11:38:05.135798+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:38:05.135798+0000","last_undegraded":"2024-09-14T11:38:05.135798+0000","last_fullsized":"2024-09-14T11:38:05.135798+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.135630+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:24.161099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'368","reported_seq":1024,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.002948+0000","last_change":"2024-09-14T11:38:09.002948+0000","last_active":"2024-09-14T11:38:09.002948+0000","last_peered":"2024-09-14T11:38:09.002948+0000","last_clean":"2024-09-14T11:38:09.002948+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:38:09.002948+0000","last_undegraded":"2024-09-14T11:38:09.002948+0000","last_fullsized":"2024-09-14T11:38:09.002948+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.002842+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.692925+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":666,"num_read_kb":46769,"num_write":1234,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.797537+0000","last_change":"2024-09-14T11:38:13.797439+0000","last_active":"2024-09-14T11:38:13.797537+0000","last_peered":"2024-09-14T11:38:13.797537+0000","last_clean":"2024-09-14T11:38:13.797537+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:38:13.797537+0000","last_undegraded":"2024-09-14T11:38:13.797537+0000","last_fullsized":"2024-09-14T11:38:13.797537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.797343+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:13.340408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'368","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.257810+0000","last_change":"2024-09-14T11:37:55.257698+0000","last_active":"2024-09-14T11:37:55.257810+0000","last_peered":"2024-09-14T11:37:55.257810+0000","last_clean":"2024-09-14T11:37:55.257810+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:37:55.257810+0000","last_undegraded":"2024-09-14T11:37:55.257810+0000","last_fullsized":"2024-09-14T11:37:55.257810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.257597+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:19.080090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":4323,"num_write":1184,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.980463+0000","last_change":"2024-09-14T11:38:06.980463+0000","last_active":"2024-09-14T11:38:06.980463+0000","last_peered":"2024-09-14T11:38:06.980463+0000","last_clean":"2024-09-14T11:38:06.980463+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:38:06.980463+0000","last_undegraded":"2024-09-14T11:38:06.980463+0000","last_fullsized":"2024-09-14T11:38:06.980463+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'431","last_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_deep_scrub":"264'431","last_deep_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.980372+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:22.678230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.931945+0000","last_change":"2024-09-14T11:38:03.931886+0000","last_active":"2024-09-14T11:38:03.931945+0000","last_peered":"2024-09-14T11:38:03.931945+0000","last_clean":"2024-09-14T11:38:03.931945+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:38:03.931945+0000","last_undegraded":"2024-09-14T11:38:03.931945+0000","last_fullsized":"2024-09-14T11:38:03.931945+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.931780+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:42.380009+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655902,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":2905,"num_write":1051,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'366","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.253803+0000","last_change":"2024-09-14T11:37:56.253747+0000","last_active":"2024-09-14T11:37:56.253803+0000","last_peered":"2024-09-14T11:37:56.253803+0000","last_clean":"2024-09-14T11:37:56.253803+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:37:56.253803+0000","last_undegraded":"2024-09-14T11:37:56.253803+0000","last_fullsized":"2024-09-14T11:37:56.253803+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.253643+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:41.679508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":610,"num_read_kb":51615,"num_write":1215,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.160953+0000","last_change":"2024-09-14T11:38:10.160953+0000","last_active":"2024-09-14T11:38:10.160953+0000","last_peered":"2024-09-14T11:38:10.160953+0000","last_clean":"2024-09-14T11:38:10.160953+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:38:10.160953+0000","last_undegraded":"2024-09-14T11:38:10.160953+0000","last_fullsized":"2024-09-14T11:38:10.160953+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.160870+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:30.132911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'349","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.545383+0000","last_change":"2024-09-14T11:37:58.545303+0000","last_active":"2024-09-14T11:37:58.545383+0000","last_peered":"2024-09-14T11:37:58.545383+0000","last_clean":"2024-09-14T11:37:58.545383+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:37:58.545383+0000","last_undegraded":"2024-09-14T11:37:58.545383+0000","last_fullsized":"2024-09-14T11:37:58.545383+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.545209+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:58.985882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":18767,"num_write":1102,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.979868+0000","last_change":"2024-09-14T11:38:10.979868+0000","last_active":"2024-09-14T11:38:10.979868+0000","last_peered":"2024-09-14T11:38:10.979868+0000","last_clean":"2024-09-14T11:38:10.979868+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:38:10.979868+0000","last_undegraded":"2024-09-14T11:38:10.979868+0000","last_fullsized":"2024-09-14T11:38:10.979868+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.979770+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:08.122305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2521,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1770,"ondisk_log_size":1770,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1610275,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17487,"num_read_kb":37004,"num_write":14657,"num_write_kb":11695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":700984,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2016,"ondisk_log_size":2016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35465,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4177,"ondisk_log_size":4177,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33940714,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44010,"num_read_kb":2045437,"num_write":72918,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68894720,"data_stored":67881428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":206212,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193226,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509963,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279124,"kb_used_data":9156,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94092716,"statfs":{"total":96636764160,"available":96350941184,"internally_reserved":0,"allocated":9375744,"data_stored":7712300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509962,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226860,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94144980,"statfs":{"total":96636764160,"available":96404459520,"internally_reserved":0,"allocated":7041024,"data_stored":5465111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509961,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90888,"kb_used_data":15288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94280952,"statfs":{"total":96636764160,"available":96543694848,"internally_reserved":0,"allocated":15654912,"data_stored":14047867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509963,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267756,"kb_used_data":15836,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94104084,"statfs":{"total":96636764160,"available":96362582016,"internally_reserved":0,"allocated":16216064,"data_stored":14565484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509962,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56752,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315088,"statfs":{"total":96636764160,"available":96578650112,"internally_reserved":0,"allocated":11960320,"data_stored":10430814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542667,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115056,"kb_used_data":11744,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94256784,"statfs":{"total":96636764160,"available":96518946816,"internally_reserved":0,"allocated":12025856,"data_stored":10431815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542664,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255272,"kb_used_data":17304,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94116568,"statfs":{"total":96636764160,"available":96375365632,"internally_reserved":0,"allocated":17719296,"data_stored":15992953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575369,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116548,"kb_used_data":9076,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94255292,"statfs":{"total":96636764160,"available":96517419008,"internally_reserved":0,"allocated":9293824,"data_stored":7637406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13430784,"data_stored":13247355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8384512,"data_stored":8279522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8343552,"data_stored":8279343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12570624,"data_stored":12413553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12062720,"data_stored":11898009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":5483519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3403776,"data_stored":3312046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5099520,"data_stored":4968081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:38:56.918 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:56.919 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-14T11:22:37.532912+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=22, tm_sec=37, tm_wday=5, tm_yday=258, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=14, tm_hour=11, tm_min=37, tm_sec=50, tm_wday=5, tm_yday=258, tm_isdst=0) 2024-09-14T11:38:56.922 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-14T11:39:16.923 DEBUG:teuthology.orchestra.run.smithi002:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-14T11:39:17.275 INFO:teuthology.orchestra.run.smithi002.stdout: 2024-09-14T11:39:17.286 INFO:teuthology.orchestra.run.smithi002.stderr:dumped all 2024-09-14T11:39:17.288 INFO:teuthology.orchestra.run.smithi002.stdout:{"pg_ready":true,"pg_map":{"version":1561,"stamp":"2024-09-14T11:39:15.701756+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":36158020,"num_objects":599,"num_object_clones":0,"num_object_copies":1198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":599,"num_whiteouts":0,"num_read":196655,"num_read_kb":2597552,"num_write":146051,"num_write_kb":2468367,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":59,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":740098,"num_omap_keys":1787,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13473,"ondisk_log_size":13473,"up":786,"acting":786,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":786,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1408256,"kb_used_data":96960,"kb_used_omap":12,"kb_used_meta":1311155,"kb_avail":753566464,"statfs":{"total":773094113280,"available":771652059136,"internally_reserved":0,"allocated":99287040,"data_stored":86283750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1342623280},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004765"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.097950+0000","last_change":"2024-09-14T11:38:42.097950+0000","last_active":"2024-09-14T11:38:42.097950+0000","last_peered":"2024-09-14T11:38:42.097950+0000","last_clean":"2024-09-14T11:38:42.097950+0000","last_became_active":"2024-09-14T11:22:38.554034+0000","last_became_peered":"2024-09-14T11:22:38.554034+0000","last_unstale":"2024-09-14T11:38:42.097950+0000","last_undegraded":"2024-09-14T11:38:42.097950+0000","last_fullsized":"2024-09-14T11:38:42.097950+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:42.097847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:42.097847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.097847+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:20:50.735708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1d","version":"0'0","reported_seq":41,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.185787+0000","last_change":"2024-09-14T11:38:39.185787+0000","last_active":"2024-09-14T11:38:39.185787+0000","last_peered":"2024-09-14T11:38:39.185787+0000","last_clean":"2024-09-14T11:38:39.185787+0000","last_became_active":"2024-09-14T11:12:00.370395+0000","last_became_peered":"2024-09-14T11:12:00.370395+0000","last_unstale":"2024-09-14T11:38:39.185787+0000","last_undegraded":"2024-09-14T11:38:39.185787+0000","last_fullsized":"2024-09-14T11:38:39.185787+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:39.185681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:39.185681+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.185681+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:49:19.147291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1c","version":"264'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.796177+0000","last_change":"2024-09-14T11:38:43.796177+0000","last_active":"2024-09-14T11:38:43.796177+0000","last_peered":"2024-09-14T11:38:43.796177+0000","last_clean":"2024-09-14T11:38:43.796177+0000","last_became_active":"2024-09-14T11:11:57.355100+0000","last_became_peered":"2024-09-14T11:11:57.355100+0000","last_unstale":"2024-09-14T11:38:43.796177+0000","last_undegraded":"2024-09-14T11:38:43.796177+0000","last_fullsized":"2024-09-14T11:38:43.796177+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:43.796089+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:43.796089+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.796089+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:09.916173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":15360,"num_write":5,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1f","version":"264'38","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:44.141292+0000","last_change":"2024-09-14T11:38:44.141292+0000","last_active":"2024-09-14T11:38:44.141292+0000","last_peered":"2024-09-14T11:38:44.141292+0000","last_clean":"2024-09-14T11:38:44.141292+0000","last_became_active":"2024-09-14T11:10:13.511192+0000","last_became_peered":"2024-09-14T11:10:13.511192+0000","last_unstale":"2024-09-14T11:38:44.141292+0000","last_undegraded":"2024-09-14T11:38:44.141292+0000","last_fullsized":"2024-09-14T11:38:44.141292+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-14T11:38:44.141188+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-14T11:38:44.141188+0000","last_clean_scrub_stamp":"2024-09-14T11:38:44.141188+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:49:49.574100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":312,"num_read_kb":212,"num_write":100,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.169885+0000","last_change":"2024-09-14T11:38:24.169885+0000","last_active":"2024-09-14T11:38:24.169885+0000","last_peered":"2024-09-14T11:38:24.169885+0000","last_clean":"2024-09-14T11:38:24.169885+0000","last_became_active":"2024-09-14T11:22:38.557608+0000","last_became_peered":"2024-09-14T11:22:38.557608+0000","last_unstale":"2024-09-14T11:38:24.169885+0000","last_undegraded":"2024-09-14T11:38:24.169885+0000","last_fullsized":"2024-09-14T11:38:24.169885+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.169793+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.169793+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.169793+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:11.603144+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1c","version":"264'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.768362+0000","last_change":"2024-09-14T11:38:42.768362+0000","last_active":"2024-09-14T11:38:42.768362+0000","last_peered":"2024-09-14T11:38:42.768362+0000","last_clean":"2024-09-14T11:38:42.768362+0000","last_became_active":"2024-09-14T11:12:00.364782+0000","last_became_peered":"2024-09-14T11:12:00.364782+0000","last_unstale":"2024-09-14T11:38:42.768362+0000","last_undegraded":"2024-09-14T11:38:42.768362+0000","last_fullsized":"2024-09-14T11:38:42.768362+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:42.768276+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:42.768276+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.768276+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:32.158806+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.1d","version":"264'5","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.621483+0000","last_change":"2024-09-14T11:38:26.621483+0000","last_active":"2024-09-14T11:38:26.621483+0000","last_peered":"2024-09-14T11:38:26.621483+0000","last_clean":"2024-09-14T11:38:26.621483+0000","last_became_active":"2024-09-14T11:11:57.352277+0000","last_became_peered":"2024-09-14T11:11:57.352277+0000","last_unstale":"2024-09-14T11:38:26.621483+0000","last_undegraded":"2024-09-14T11:38:26.621483+0000","last_fullsized":"2024-09-14T11:38:26.621483+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:26.621386+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:26.621386+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.621386+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:03:01.370036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":11264,"num_write":5,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1e","version":"264'19","reported_seq":111,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.252305+0000","last_change":"2024-09-14T11:38:15.252181+0000","last_active":"2024-09-14T11:38:15.252305+0000","last_peered":"2024-09-14T11:38:15.252305+0000","last_clean":"2024-09-14T11:38:15.252305+0000","last_became_active":"2024-09-14T11:10:13.500247+0000","last_became_peered":"2024-09-14T11:10:13.500247+0000","last_unstale":"2024-09-14T11:38:15.252305+0000","last_undegraded":"2024-09-14T11:38:15.252305+0000","last_fullsized":"2024-09-14T11:38:15.252305+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'19","last_scrub_stamp":"2024-09-14T11:38:15.252053+0000","last_deep_scrub":"264'19","last_deep_scrub_stamp":"2024-09-14T11:38:15.252053+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.252053+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:01:49.934103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":116,"num_write":44,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.029476+0000","last_change":"2024-09-14T11:38:32.029476+0000","last_active":"2024-09-14T11:38:32.029476+0000","last_peered":"2024-09-14T11:38:32.029476+0000","last_clean":"2024-09-14T11:38:32.029476+0000","last_became_active":"2024-09-14T11:22:38.555182+0000","last_became_peered":"2024-09-14T11:22:38.555182+0000","last_unstale":"2024-09-14T11:38:32.029476+0000","last_undegraded":"2024-09-14T11:38:32.029476+0000","last_fullsized":"2024-09-14T11:38:32.029476+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:32.029389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:32.029389+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.029389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:42.188681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1f","version":"264'6","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:49.068756+0000","last_change":"2024-09-14T11:38:49.068649+0000","last_active":"2024-09-14T11:38:49.068756+0000","last_peered":"2024-09-14T11:38:49.068756+0000","last_clean":"2024-09-14T11:38:49.068756+0000","last_became_active":"2024-09-14T11:12:00.696622+0000","last_became_peered":"2024-09-14T11:12:00.696622+0000","last_unstale":"2024-09-14T11:38:49.068756+0000","last_undegraded":"2024-09-14T11:38:49.068756+0000","last_fullsized":"2024-09-14T11:38:49.068756+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:49.068535+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:49.068535+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.068535+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:08:07.098791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":20480,"num_write":16,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.1e","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.155151+0000","last_change":"2024-09-14T11:38:20.155151+0000","last_active":"2024-09-14T11:38:20.155151+0000","last_peered":"2024-09-14T11:38:20.155151+0000","last_clean":"2024-09-14T11:38:20.155151+0000","last_became_active":"2024-09-14T11:11:57.355223+0000","last_became_peered":"2024-09-14T11:11:57.355223+0000","last_unstale":"2024-09-14T11:38:20.155151+0000","last_undegraded":"2024-09-14T11:38:20.155151+0000","last_fullsized":"2024-09-14T11:38:20.155151+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:20.155068+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:20.155068+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.155068+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:02:17.930504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":5122,"num_write":13,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.1d","version":"264'44","reported_seq":175,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.127005+0000","last_change":"2024-09-14T11:38:34.127005+0000","last_active":"2024-09-14T11:38:34.127005+0000","last_peered":"2024-09-14T11:38:34.127005+0000","last_clean":"2024-09-14T11:38:34.127005+0000","last_became_active":"2024-09-14T11:10:13.508455+0000","last_became_peered":"2024-09-14T11:10:13.508455+0000","last_unstale":"2024-09-14T11:38:34.127005+0000","last_undegraded":"2024-09-14T11:38:34.127005+0000","last_fullsized":"2024-09-14T11:38:34.127005+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'44","last_scrub_stamp":"2024-09-14T11:38:34.126914+0000","last_deep_scrub":"264'44","last_deep_scrub_stamp":"2024-09-14T11:38:34.126914+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.126914+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:45:00.673213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":371,"num_read_kb":255,"num_write":106,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:54.771589+0000","last_change":"2024-09-14T11:38:54.771589+0000","last_active":"2024-09-14T11:38:54.771589+0000","last_peered":"2024-09-14T11:38:54.771589+0000","last_clean":"2024-09-14T11:38:54.771589+0000","last_became_active":"2024-09-14T11:22:38.561092+0000","last_became_peered":"2024-09-14T11:22:38.561092+0000","last_unstale":"2024-09-14T11:38:54.771589+0000","last_undegraded":"2024-09-14T11:38:54.771589+0000","last_fullsized":"2024-09-14T11:38:54.771589+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:54.771499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:54.771499+0000","last_clean_scrub_stamp":"2024-09-14T11:38:54.771499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:18:14.405573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.1e","version":"264'5","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:51.746297+0000","last_change":"2024-09-14T11:38:51.746297+0000","last_active":"2024-09-14T11:38:51.746297+0000","last_peered":"2024-09-14T11:38:51.746297+0000","last_clean":"2024-09-14T11:38:51.746297+0000","last_became_active":"2024-09-14T11:12:00.695786+0000","last_became_peered":"2024-09-14T11:12:00.695786+0000","last_unstale":"2024-09-14T11:38:51.746297+0000","last_undegraded":"2024-09-14T11:38:51.746297+0000","last_fullsized":"2024-09-14T11:38:51.746297+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:51.746205+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:51.746205+0000","last_clean_scrub_stamp":"2024-09-14T11:38:51.746205+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:54:12.962703+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":11264,"num_write":10,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1f","version":"264'9","reported_seq":67,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.718856+0000","last_change":"2024-09-14T11:38:37.718788+0000","last_active":"2024-09-14T11:38:37.718856+0000","last_peered":"2024-09-14T11:38:37.718856+0000","last_clean":"2024-09-14T11:38:37.718856+0000","last_became_active":"2024-09-14T11:11:57.350069+0000","last_became_peered":"2024-09-14T11:11:57.350069+0000","last_unstale":"2024-09-14T11:38:37.718856+0000","last_undegraded":"2024-09-14T11:38:37.718856+0000","last_fullsized":"2024-09-14T11:38:37.718856+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-14T11:38:37.718680+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-14T11:38:37.718680+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.718680+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:16:39.709261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":17408,"num_write":14,"num_write_kb":17408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1c","version":"264'33","reported_seq":139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.763052+0000","last_change":"2024-09-14T11:38:41.763052+0000","last_active":"2024-09-14T11:38:41.763052+0000","last_peered":"2024-09-14T11:38:41.763052+0000","last_clean":"2024-09-14T11:38:41.763052+0000","last_became_active":"2024-09-14T11:10:13.511223+0000","last_became_peered":"2024-09-14T11:10:13.511223+0000","last_unstale":"2024-09-14T11:38:41.763052+0000","last_undegraded":"2024-09-14T11:38:41.763052+0000","last_fullsized":"2024-09-14T11:38:41.763052+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-14T11:38:41.762948+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-14T11:38:41.762948+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.762948+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:13.436811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":162,"num_write":78,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:56.792444+0000","last_change":"2024-09-14T11:38:56.792444+0000","last_active":"2024-09-14T11:38:56.792444+0000","last_peered":"2024-09-14T11:38:56.792444+0000","last_clean":"2024-09-14T11:38:56.792444+0000","last_became_active":"2024-09-14T11:22:38.561960+0000","last_became_peered":"2024-09-14T11:22:38.561960+0000","last_unstale":"2024-09-14T11:38:56.792444+0000","last_undegraded":"2024-09-14T11:38:56.792444+0000","last_fullsized":"2024-09-14T11:38:56.792444+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:56.792381+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:56.792381+0000","last_clean_scrub_stamp":"2024-09-14T11:38:56.792381+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:01:42.493881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.19","version":"261'5","reported_seq":57,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.131281+0000","last_change":"2024-09-14T11:38:37.131221+0000","last_active":"2024-09-14T11:38:37.131281+0000","last_peered":"2024-09-14T11:38:37.131281+0000","last_clean":"2024-09-14T11:38:37.131281+0000","last_became_active":"2024-09-14T11:12:00.372637+0000","last_became_peered":"2024-09-14T11:12:00.372637+0000","last_unstale":"2024-09-14T11:38:37.131281+0000","last_undegraded":"2024-09-14T11:38:37.131281+0000","last_fullsized":"2024-09-14T11:38:37.131281+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:37.131128+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:37.131128+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.131128+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:52:33.117248+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.18","version":"261'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.100914+0000","last_change":"2024-09-14T11:38:39.100914+0000","last_active":"2024-09-14T11:38:39.100914+0000","last_peered":"2024-09-14T11:38:39.100914+0000","last_clean":"2024-09-14T11:38:39.100914+0000","last_became_active":"2024-09-14T11:11:57.347461+0000","last_became_peered":"2024-09-14T11:11:57.347461+0000","last_unstale":"2024-09-14T11:38:39.100914+0000","last_undegraded":"2024-09-14T11:38:39.100914+0000","last_fullsized":"2024-09-14T11:38:39.100914+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:38:39.100813+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:38:39.100813+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.100813+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:28.583813+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.1b","version":"264'25","reported_seq":118,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.766468+0000","last_change":"2024-09-14T11:38:39.766468+0000","last_active":"2024-09-14T11:38:39.766468+0000","last_peered":"2024-09-14T11:38:39.766468+0000","last_clean":"2024-09-14T11:38:39.766468+0000","last_became_active":"2024-09-14T11:10:13.509796+0000","last_became_peered":"2024-09-14T11:10:13.509796+0000","last_unstale":"2024-09-14T11:38:39.766468+0000","last_undegraded":"2024-09-14T11:38:39.766468+0000","last_fullsized":"2024-09-14T11:38:39.766468+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'25","last_scrub_stamp":"2024-09-14T11:38:39.766342+0000","last_deep_scrub":"264'25","last_deep_scrub_stamp":"2024-09-14T11:38:39.766342+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.766342+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:46.627364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":178,"num_read_kb":119,"num_write":62,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.644921+0000","last_change":"2024-09-14T11:38:33.644921+0000","last_active":"2024-09-14T11:38:33.644921+0000","last_peered":"2024-09-14T11:38:33.644921+0000","last_clean":"2024-09-14T11:38:33.644921+0000","last_became_active":"2024-09-14T11:22:38.558422+0000","last_became_peered":"2024-09-14T11:22:38.558422+0000","last_unstale":"2024-09-14T11:38:33.644921+0000","last_undegraded":"2024-09-14T11:38:33.644921+0000","last_fullsized":"2024-09-14T11:38:33.644921+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:33.644836+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:33.644836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.644836+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:44:52.935576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.18","version":"261'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.949765+0000","last_change":"2024-09-14T11:38:29.949686+0000","last_active":"2024-09-14T11:38:29.949765+0000","last_peered":"2024-09-14T11:38:29.949765+0000","last_clean":"2024-09-14T11:38:29.949765+0000","last_became_active":"2024-09-14T11:12:00.372558+0000","last_became_peered":"2024-09-14T11:12:00.372558+0000","last_unstale":"2024-09-14T11:38:29.949765+0000","last_undegraded":"2024-09-14T11:38:29.949765+0000","last_fullsized":"2024-09-14T11:38:29.949765+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:38:29.949588+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:38:29.949588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.949588+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:13.966792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.19","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.756620+0000","last_change":"2024-09-14T11:38:35.756620+0000","last_active":"2024-09-14T11:38:35.756620+0000","last_peered":"2024-09-14T11:38:35.756620+0000","last_clean":"2024-09-14T11:38:35.756620+0000","last_became_active":"2024-09-14T11:11:57.351313+0000","last_became_peered":"2024-09-14T11:11:57.351313+0000","last_unstale":"2024-09-14T11:38:35.756620+0000","last_undegraded":"2024-09-14T11:38:35.756620+0000","last_fullsized":"2024-09-14T11:38:35.756620+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.756536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.756536+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.756536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:41:52.378912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.1a","version":"264'24","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.100873+0000","last_change":"2024-09-14T11:38:24.100873+0000","last_active":"2024-09-14T11:38:24.100873+0000","last_peered":"2024-09-14T11:38:24.100873+0000","last_clean":"2024-09-14T11:38:24.100873+0000","last_became_active":"2024-09-14T11:10:13.506715+0000","last_became_peered":"2024-09-14T11:10:13.506715+0000","last_unstale":"2024-09-14T11:38:24.100873+0000","last_undegraded":"2024-09-14T11:38:24.100873+0000","last_fullsized":"2024-09-14T11:38:24.100873+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'24","last_scrub_stamp":"2024-09-14T11:38:24.100793+0000","last_deep_scrub":"264'24","last_deep_scrub_stamp":"2024-09-14T11:38:24.100793+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.100793+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:21.604899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":175,"num_read_kb":117,"num_write":69,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1c","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.026348+0000","last_change":"2024-09-14T11:38:50.026348+0000","last_active":"2024-09-14T11:38:50.026348+0000","last_peered":"2024-09-14T11:38:50.026348+0000","last_clean":"2024-09-14T11:38:50.026348+0000","last_became_active":"2024-09-14T11:22:38.557749+0000","last_became_peered":"2024-09-14T11:22:38.557749+0000","last_unstale":"2024-09-14T11:38:50.026348+0000","last_undegraded":"2024-09-14T11:38:50.026348+0000","last_fullsized":"2024-09-14T11:38:50.026348+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:50.026254+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:50.026254+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.026254+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:12:21.535537+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1b","version":"261'12","reported_seq":71,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.940825+0000","last_change":"2024-09-14T11:38:28.940825+0000","last_active":"2024-09-14T11:38:28.940825+0000","last_peered":"2024-09-14T11:38:28.940825+0000","last_clean":"2024-09-14T11:38:28.940825+0000","last_became_active":"2024-09-14T11:12:00.366553+0000","last_became_peered":"2024-09-14T11:12:00.366553+0000","last_unstale":"2024-09-14T11:38:28.940825+0000","last_undegraded":"2024-09-14T11:38:28.940825+0000","last_fullsized":"2024-09-14T11:38:28.940825+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'12","last_scrub_stamp":"2024-09-14T11:38:28.940735+0000","last_deep_scrub":"261'12","last_deep_scrub_stamp":"2024-09-14T11:38:28.940735+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.940735+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:17:19.251022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":24582,"num_write":22,"num_write_kb":6146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.764918+0000","last_change":"2024-09-14T11:38:36.764918+0000","last_active":"2024-09-14T11:38:36.764918+0000","last_peered":"2024-09-14T11:38:36.764918+0000","last_clean":"2024-09-14T11:38:36.764918+0000","last_became_active":"2024-09-14T11:11:57.354849+0000","last_became_peered":"2024-09-14T11:11:57.354849+0000","last_unstale":"2024-09-14T11:38:36.764918+0000","last_undegraded":"2024-09-14T11:38:36.764918+0000","last_fullsized":"2024-09-14T11:38:36.764918+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:36.764786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:36.764786+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.764786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:26:54.615946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.19","version":"264'31","reported_seq":139,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.104154+0000","last_change":"2024-09-14T11:38:33.104154+0000","last_active":"2024-09-14T11:38:33.104154+0000","last_peered":"2024-09-14T11:38:33.104154+0000","last_clean":"2024-09-14T11:38:33.104154+0000","last_became_active":"2024-09-14T11:10:13.507669+0000","last_became_peered":"2024-09-14T11:10:13.507669+0000","last_unstale":"2024-09-14T11:38:33.104154+0000","last_undegraded":"2024-09-14T11:38:33.104154+0000","last_fullsized":"2024-09-14T11:38:33.104154+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'31","last_scrub_stamp":"2024-09-14T11:38:33.104000+0000","last_deep_scrub":"264'31","last_deep_scrub_stamp":"2024-09-14T11:38:33.104000+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.104000+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:10.817552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":153,"num_write":81,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:51.940514+0000","last_change":"2024-09-14T11:38:51.940514+0000","last_active":"2024-09-14T11:38:51.940514+0000","last_peered":"2024-09-14T11:38:51.940514+0000","last_clean":"2024-09-14T11:38:51.940514+0000","last_became_active":"2024-09-14T11:22:38.560860+0000","last_became_peered":"2024-09-14T11:22:38.560860+0000","last_unstale":"2024-09-14T11:38:51.940514+0000","last_undegraded":"2024-09-14T11:38:51.940514+0000","last_fullsized":"2024-09-14T11:38:51.940514+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:51.940420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:51.940420+0000","last_clean_scrub_stamp":"2024-09-14T11:38:51.940420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:23:27.252944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":35,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.160829+0000","last_change":"2024-09-14T11:38:38.160829+0000","last_active":"2024-09-14T11:38:38.160829+0000","last_peered":"2024-09-14T11:38:38.160829+0000","last_clean":"2024-09-14T11:38:38.160829+0000","last_became_active":"2024-09-14T11:12:43.313829+0000","last_became_peered":"2024-09-14T11:12:43.313829+0000","last_unstale":"2024-09-14T11:38:38.160829+0000","last_undegraded":"2024-09-14T11:38:38.160829+0000","last_fullsized":"2024-09-14T11:38:38.160829+0000","mapping_epoch":260,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":261,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:38.160746+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:38.160746+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.160746+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:00:38.303031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1b","version":"264'9","reported_seq":61,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:46.110898+0000","last_change":"2024-09-14T11:38:46.110898+0000","last_active":"2024-09-14T11:38:46.110898+0000","last_peered":"2024-09-14T11:38:46.110898+0000","last_clean":"2024-09-14T11:38:46.110898+0000","last_became_active":"2024-09-14T11:11:57.357732+0000","last_became_peered":"2024-09-14T11:11:57.357732+0000","last_unstale":"2024-09-14T11:38:46.110898+0000","last_undegraded":"2024-09-14T11:38:46.110898+0000","last_fullsized":"2024-09-14T11:38:46.110898+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'9","last_scrub_stamp":"2024-09-14T11:38:46.110800+0000","last_deep_scrub":"264'9","last_deep_scrub_stamp":"2024-09-14T11:38:46.110800+0000","last_clean_scrub_stamp":"2024-09-14T11:38:46.110800+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:02.904273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":19,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.18","version":"264'20","reported_seq":106,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.560103+0000","last_change":"2024-09-14T11:38:23.560033+0000","last_active":"2024-09-14T11:38:23.560103+0000","last_peered":"2024-09-14T11:38:23.560103+0000","last_clean":"2024-09-14T11:38:23.560103+0000","last_became_active":"2024-09-14T11:10:13.500948+0000","last_became_peered":"2024-09-14T11:10:13.500948+0000","last_unstale":"2024-09-14T11:38:23.560103+0000","last_undegraded":"2024-09-14T11:38:23.560103+0000","last_fullsized":"2024-09-14T11:38:23.560103+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'20","last_scrub_stamp":"2024-09-14T11:38:23.559943+0000","last_deep_scrub":"264'20","last_deep_scrub_stamp":"2024-09-14T11:38:23.559943+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.559943+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:46:11.949125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":149,"num_read_kb":97,"num_write":51,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.656771+0000","last_change":"2024-09-14T11:38:34.656687+0000","last_active":"2024-09-14T11:38:34.656771+0000","last_peered":"2024-09-14T11:38:34.656771+0000","last_clean":"2024-09-14T11:38:34.656771+0000","last_became_active":"2024-09-14T11:22:38.558805+0000","last_became_peered":"2024-09-14T11:22:38.558805+0000","last_unstale":"2024-09-14T11:38:34.656771+0000","last_undegraded":"2024-09-14T11:38:34.656771+0000","last_fullsized":"2024-09-14T11:38:34.656771+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:34.656595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:34.656595+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.656595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:19:07.716925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.15","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:49.772270+0000","last_change":"2024-09-14T11:38:49.772270+0000","last_active":"2024-09-14T11:38:49.772270+0000","last_peered":"2024-09-14T11:38:49.772270+0000","last_clean":"2024-09-14T11:38:49.772270+0000","last_became_active":"2024-09-14T11:12:00.695486+0000","last_became_peered":"2024-09-14T11:12:00.695486+0000","last_unstale":"2024-09-14T11:38:49.772270+0000","last_undegraded":"2024-09-14T11:38:49.772270+0000","last_fullsized":"2024-09-14T11:38:49.772270+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:49.772176+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:49.772176+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.772176+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:15:41.288122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.14","version":"261'8","reported_seq":68,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.137758+0000","last_change":"2024-09-14T11:38:36.137758+0000","last_active":"2024-09-14T11:38:36.137758+0000","last_peered":"2024-09-14T11:38:36.137758+0000","last_clean":"2024-09-14T11:38:36.137758+0000","last_became_active":"2024-09-14T11:11:57.352913+0000","last_became_peered":"2024-09-14T11:11:57.352913+0000","last_unstale":"2024-09-14T11:38:36.137758+0000","last_undegraded":"2024-09-14T11:38:36.137758+0000","last_fullsized":"2024-09-14T11:38:36.137758+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'8","last_scrub_stamp":"2024-09-14T11:38:36.137663+0000","last_deep_scrub":"261'8","last_deep_scrub_stamp":"2024-09-14T11:38:36.137663+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.137663+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:49.565278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":21506,"num_write":18,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.17","version":"264'38","reported_seq":155,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.141243+0000","last_change":"2024-09-14T11:38:37.141126+0000","last_active":"2024-09-14T11:38:37.141243+0000","last_peered":"2024-09-14T11:38:37.141243+0000","last_clean":"2024-09-14T11:38:37.141243+0000","last_became_active":"2024-09-14T11:10:13.506793+0000","last_became_peered":"2024-09-14T11:10:13.506793+0000","last_unstale":"2024-09-14T11:38:37.141243+0000","last_undegraded":"2024-09-14T11:38:37.141243+0000","last_fullsized":"2024-09-14T11:38:37.141243+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'38","last_scrub_stamp":"2024-09-14T11:38:37.140996+0000","last_deep_scrub":"264'38","last_deep_scrub_stamp":"2024-09-14T11:38:37.140996+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.140996+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:45:13.949410+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":266,"num_read_kb":181,"num_write":97,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.13","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.175843+0000","last_change":"2024-09-14T11:38:23.175779+0000","last_active":"2024-09-14T11:38:23.175843+0000","last_peered":"2024-09-14T11:38:23.175843+0000","last_clean":"2024-09-14T11:38:23.175843+0000","last_became_active":"2024-09-14T11:22:38.547429+0000","last_became_peered":"2024-09-14T11:22:38.547429+0000","last_unstale":"2024-09-14T11:38:23.175843+0000","last_undegraded":"2024-09-14T11:38:23.175843+0000","last_fullsized":"2024-09-14T11:38:23.175843+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:23.175677+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:23.175677+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.175677+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:09.393436+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.14","version":"264'3","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:48.753337+0000","last_change":"2024-09-14T11:38:48.753337+0000","last_active":"2024-09-14T11:38:48.753337+0000","last_peered":"2024-09-14T11:38:48.753337+0000","last_clean":"2024-09-14T11:38:48.753337+0000","last_became_active":"2024-09-14T11:12:00.696637+0000","last_became_peered":"2024-09-14T11:12:00.696637+0000","last_unstale":"2024-09-14T11:38:48.753337+0000","last_undegraded":"2024-09-14T11:38:48.753337+0000","last_fullsized":"2024-09-14T11:38:48.753337+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:48.753244+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:48.753244+0000","last_clean_scrub_stamp":"2024-09-14T11:38:48.753244+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:23:55.347726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.15","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.851544+0000","last_change":"2024-09-14T11:38:39.851544+0000","last_active":"2024-09-14T11:38:39.851544+0000","last_peered":"2024-09-14T11:38:39.851544+0000","last_clean":"2024-09-14T11:38:39.851544+0000","last_became_active":"2024-09-14T11:11:57.349272+0000","last_became_peered":"2024-09-14T11:11:57.349272+0000","last_unstale":"2024-09-14T11:38:39.851544+0000","last_undegraded":"2024-09-14T11:38:39.851544+0000","last_fullsized":"2024-09-14T11:38:39.851544+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:39.851460+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:39.851460+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.851460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:39.227384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":19456,"num_write":13,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.16","version":"264'23","reported_seq":115,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.773576+0000","last_change":"2024-09-14T11:38:38.773498+0000","last_active":"2024-09-14T11:38:38.773576+0000","last_peered":"2024-09-14T11:38:38.773576+0000","last_clean":"2024-09-14T11:38:38.773576+0000","last_became_active":"2024-09-14T11:10:13.509733+0000","last_became_peered":"2024-09-14T11:10:13.509733+0000","last_unstale":"2024-09-14T11:38:38.773576+0000","last_undegraded":"2024-09-14T11:38:38.773576+0000","last_fullsized":"2024-09-14T11:38:38.773576+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'23","last_scrub_stamp":"2024-09-14T11:38:38.773406+0000","last_deep_scrub":"264'23","last_deep_scrub_stamp":"2024-09-14T11:38:38.773406+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.773406+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:57.025417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":179,"num_read_kb":122,"num_write":57,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.984780+0000","last_change":"2024-09-14T11:38:50.984726+0000","last_active":"2024-09-14T11:38:50.984780+0000","last_peered":"2024-09-14T11:38:50.984780+0000","last_clean":"2024-09-14T11:38:50.984780+0000","last_became_active":"2024-09-14T11:22:38.557135+0000","last_became_peered":"2024-09-14T11:22:38.557135+0000","last_unstale":"2024-09-14T11:38:50.984780+0000","last_undegraded":"2024-09-14T11:38:50.984780+0000","last_fullsized":"2024-09-14T11:38:50.984780+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:50.984642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:50.984642+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.984642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:24.374648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.17","version":"264'2","reported_seq":45,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.727656+0000","last_change":"2024-09-14T11:38:50.727656+0000","last_active":"2024-09-14T11:38:50.727656+0000","last_peered":"2024-09-14T11:38:50.727656+0000","last_clean":"2024-09-14T11:38:50.727656+0000","last_became_active":"2024-09-14T11:12:00.697501+0000","last_became_peered":"2024-09-14T11:12:00.697501+0000","last_unstale":"2024-09-14T11:38:50.727656+0000","last_undegraded":"2024-09-14T11:38:50.727656+0000","last_fullsized":"2024-09-14T11:38:50.727656+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:50.727547+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:50.727547+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.727547+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:46.668369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.16","version":"261'5","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.194185+0000","last_change":"2024-09-14T11:38:19.194130+0000","last_active":"2024-09-14T11:38:19.194185+0000","last_peered":"2024-09-14T11:38:19.194185+0000","last_clean":"2024-09-14T11:38:19.194185+0000","last_became_active":"2024-09-14T11:11:57.353030+0000","last_became_peered":"2024-09-14T11:11:57.353030+0000","last_unstale":"2024-09-14T11:38:19.194185+0000","last_undegraded":"2024-09-14T11:38:19.194185+0000","last_fullsized":"2024-09-14T11:38:19.194185+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:19.194040+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:19.194040+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.194040+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:30:56.906130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.15","version":"264'29","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.232449+0000","last_change":"2024-09-14T11:38:16.232395+0000","last_active":"2024-09-14T11:38:16.232449+0000","last_peered":"2024-09-14T11:38:16.232449+0000","last_clean":"2024-09-14T11:38:16.232449+0000","last_became_active":"2024-09-14T11:10:13.499434+0000","last_became_peered":"2024-09-14T11:10:13.499434+0000","last_unstale":"2024-09-14T11:38:16.232449+0000","last_undegraded":"2024-09-14T11:38:16.232449+0000","last_fullsized":"2024-09-14T11:38:16.232449+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:16.232320+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:16.232320+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.232320+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:07:12.306009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":238,"num_read_kb":152,"num_write":73,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.124397+0000","last_change":"2024-09-14T11:38:41.124340+0000","last_active":"2024-09-14T11:38:41.124397+0000","last_peered":"2024-09-14T11:38:41.124397+0000","last_clean":"2024-09-14T11:38:41.124397+0000","last_became_active":"2024-09-14T11:22:38.555952+0000","last_became_peered":"2024-09-14T11:22:38.555952+0000","last_unstale":"2024-09-14T11:38:41.124397+0000","last_undegraded":"2024-09-14T11:38:41.124397+0000","last_fullsized":"2024-09-14T11:38:41.124397+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:41.124236+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:41.124236+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.124236+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:09:55.134702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.16","version":"264'3","reported_seq":47,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.713156+0000","last_change":"2024-09-14T11:38:40.713156+0000","last_active":"2024-09-14T11:38:40.713156+0000","last_peered":"2024-09-14T11:38:40.713156+0000","last_clean":"2024-09-14T11:38:40.713156+0000","last_became_active":"2024-09-14T11:12:00.370769+0000","last_became_peered":"2024-09-14T11:12:00.370769+0000","last_unstale":"2024-09-14T11:38:40.713156+0000","last_undegraded":"2024-09-14T11:38:40.713156+0000","last_fullsized":"2024-09-14T11:38:40.713156+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:40.713044+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:40.713044+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.713044+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:45.071585+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":5120,"num_write":3,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:47.098138+0000","last_change":"2024-09-14T11:38:47.098138+0000","last_active":"2024-09-14T11:38:47.098138+0000","last_peered":"2024-09-14T11:38:47.098138+0000","last_clean":"2024-09-14T11:38:47.098138+0000","last_became_active":"2024-09-14T11:11:57.355359+0000","last_became_peered":"2024-09-14T11:11:57.355359+0000","last_unstale":"2024-09-14T11:38:47.098138+0000","last_undegraded":"2024-09-14T11:38:47.098138+0000","last_fullsized":"2024-09-14T11:38:47.098138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:47.098046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:47.098046+0000","last_clean_scrub_stamp":"2024-09-14T11:38:47.098046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:02.692814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.14","version":"264'29","reported_seq":134,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.897864+0000","last_change":"2024-09-14T11:38:33.897864+0000","last_active":"2024-09-14T11:38:33.897864+0000","last_peered":"2024-09-14T11:38:33.897864+0000","last_clean":"2024-09-14T11:38:33.897864+0000","last_became_active":"2024-09-14T11:10:13.509375+0000","last_became_peered":"2024-09-14T11:10:13.509375+0000","last_unstale":"2024-09-14T11:38:33.897864+0000","last_undegraded":"2024-09-14T11:38:33.897864+0000","last_fullsized":"2024-09-14T11:38:33.897864+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:33.897774+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:33.897774+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.897774+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:30.292702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":224,"num_read_kb":143,"num_write":75,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:55.819749+0000","last_change":"2024-09-14T11:38:55.819749+0000","last_active":"2024-09-14T11:38:55.819749+0000","last_peered":"2024-09-14T11:38:55.819749+0000","last_clean":"2024-09-14T11:38:55.819749+0000","last_became_active":"2024-09-14T11:22:38.559139+0000","last_became_peered":"2024-09-14T11:22:38.559139+0000","last_unstale":"2024-09-14T11:38:55.819749+0000","last_undegraded":"2024-09-14T11:38:55.819749+0000","last_fullsized":"2024-09-14T11:38:55.819749+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:55.819643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:55.819643+0000","last_clean_scrub_stamp":"2024-09-14T11:38:55.819643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:22.665942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.11","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.652356+0000","last_change":"2024-09-14T11:38:30.652356+0000","last_active":"2024-09-14T11:38:30.652356+0000","last_peered":"2024-09-14T11:38:30.652356+0000","last_clean":"2024-09-14T11:38:30.652356+0000","last_became_active":"2024-09-14T11:12:00.369845+0000","last_became_peered":"2024-09-14T11:12:00.369845+0000","last_unstale":"2024-09-14T11:38:30.652356+0000","last_undegraded":"2024-09-14T11:38:30.652356+0000","last_fullsized":"2024-09-14T11:38:30.652356+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:30.652266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:30.652266+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.652266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:43.962945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.10","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.712630+0000","last_change":"2024-09-14T11:38:33.712630+0000","last_active":"2024-09-14T11:38:33.712630+0000","last_peered":"2024-09-14T11:38:33.712630+0000","last_clean":"2024-09-14T11:38:33.712630+0000","last_became_active":"2024-09-14T11:11:57.349068+0000","last_became_peered":"2024-09-14T11:11:57.349068+0000","last_unstale":"2024-09-14T11:38:33.712630+0000","last_undegraded":"2024-09-14T11:38:33.712630+0000","last_fullsized":"2024-09-14T11:38:33.712630+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:33.712531+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:33.712531+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.712531+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:40.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.13","version":"261'14","reported_seq":97,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.874688+0000","last_change":"2024-09-14T11:38:32.874688+0000","last_active":"2024-09-14T11:38:32.874688+0000","last_peered":"2024-09-14T11:38:32.874688+0000","last_clean":"2024-09-14T11:38:32.874688+0000","last_became_active":"2024-09-14T11:10:13.508605+0000","last_became_peered":"2024-09-14T11:10:13.508605+0000","last_unstale":"2024-09-14T11:38:32.874688+0000","last_undegraded":"2024-09-14T11:38:32.874688+0000","last_fullsized":"2024-09-14T11:38:32.874688+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'14","last_scrub_stamp":"2024-09-14T11:38:32.874597+0000","last_deep_scrub":"261'14","last_deep_scrub_stamp":"2024-09-14T11:38:32.874597+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.874597+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:17:31.872512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":74,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:52.129888+0000","last_change":"2024-09-14T11:38:52.129888+0000","last_active":"2024-09-14T11:38:52.129888+0000","last_peered":"2024-09-14T11:38:52.129888+0000","last_clean":"2024-09-14T11:38:52.129888+0000","last_became_active":"2024-09-14T11:22:38.562131+0000","last_became_peered":"2024-09-14T11:22:38.562131+0000","last_unstale":"2024-09-14T11:38:52.129888+0000","last_undegraded":"2024-09-14T11:38:52.129888+0000","last_fullsized":"2024-09-14T11:38:52.129888+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:52.129774+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:52.129774+0000","last_clean_scrub_stamp":"2024-09-14T11:38:52.129774+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:52:59.767018+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.10","version":"261'3","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.700105+0000","last_change":"2024-09-14T11:38:29.700105+0000","last_active":"2024-09-14T11:38:29.700105+0000","last_peered":"2024-09-14T11:38:29.700105+0000","last_clean":"2024-09-14T11:38:29.700105+0000","last_became_active":"2024-09-14T11:12:00.366477+0000","last_became_peered":"2024-09-14T11:12:00.366477+0000","last_unstale":"2024-09-14T11:38:29.700105+0000","last_undegraded":"2024-09-14T11:38:29.700105+0000","last_fullsized":"2024-09-14T11:38:29.700105+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'3","last_scrub_stamp":"2024-09-14T11:38:29.700005+0000","last_deep_scrub":"261'3","last_deep_scrub_stamp":"2024-09-14T11:38:29.700005+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.700005+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:16:00.423361+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.796232+0000","last_change":"2024-09-14T11:38:42.796232+0000","last_active":"2024-09-14T11:38:42.796232+0000","last_peered":"2024-09-14T11:38:42.796232+0000","last_clean":"2024-09-14T11:38:42.796232+0000","last_became_active":"2024-09-14T11:11:57.355117+0000","last_became_peered":"2024-09-14T11:11:57.355117+0000","last_unstale":"2024-09-14T11:38:42.796232+0000","last_undegraded":"2024-09-14T11:38:42.796232+0000","last_fullsized":"2024-09-14T11:38:42.796232+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:42.796113+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:42.796113+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.796113+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:31.615287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.12","version":"264'32","reported_seq":138,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.107301+0000","last_change":"2024-09-14T11:38:31.107301+0000","last_active":"2024-09-14T11:38:31.107301+0000","last_peered":"2024-09-14T11:38:31.107301+0000","last_clean":"2024-09-14T11:38:31.107301+0000","last_became_active":"2024-09-14T11:10:13.507732+0000","last_became_peered":"2024-09-14T11:10:13.507732+0000","last_unstale":"2024-09-14T11:38:31.107301+0000","last_undegraded":"2024-09-14T11:38:31.107301+0000","last_fullsized":"2024-09-14T11:38:31.107301+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'32","last_scrub_stamp":"2024-09-14T11:38:31.107207+0000","last_deep_scrub":"264'32","last_deep_scrub_stamp":"2024-09-14T11:38:31.107207+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.107207+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:26:38.841476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":165,"num_write":86,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.14","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:50.096304+0000","last_change":"2024-09-14T11:38:50.096179+0000","last_active":"2024-09-14T11:38:50.096304+0000","last_peered":"2024-09-14T11:38:50.096304+0000","last_clean":"2024-09-14T11:38:50.096304+0000","last_became_active":"2024-09-14T11:22:38.560523+0000","last_became_peered":"2024-09-14T11:22:38.560523+0000","last_unstale":"2024-09-14T11:38:50.096304+0000","last_undegraded":"2024-09-14T11:38:50.096304+0000","last_fullsized":"2024-09-14T11:38:50.096304+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:50.096079+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:50.096079+0000","last_clean_scrub_stamp":"2024-09-14T11:38:50.096079+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:29:18.069826+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:47.795286+0000","last_change":"2024-09-14T11:38:47.795286+0000","last_active":"2024-09-14T11:38:47.795286+0000","last_peered":"2024-09-14T11:38:47.795286+0000","last_clean":"2024-09-14T11:38:47.795286+0000","last_became_active":"2024-09-14T11:12:00.371458+0000","last_became_peered":"2024-09-14T11:12:00.371458+0000","last_unstale":"2024-09-14T11:38:47.795286+0000","last_undegraded":"2024-09-14T11:38:47.795286+0000","last_fullsized":"2024-09-14T11:38:47.795286+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:47.795181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:47.795181+0000","last_clean_scrub_stamp":"2024-09-14T11:38:47.795181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:42.498359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.12","version":"0'0","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.052970+0000","last_change":"2024-09-14T11:38:26.052970+0000","last_active":"2024-09-14T11:38:26.052970+0000","last_peered":"2024-09-14T11:38:26.052970+0000","last_clean":"2024-09-14T11:38:26.052970+0000","last_became_active":"2024-09-14T11:11:57.354742+0000","last_became_peered":"2024-09-14T11:11:57.354742+0000","last_unstale":"2024-09-14T11:38:26.052970+0000","last_undegraded":"2024-09-14T11:38:26.052970+0000","last_fullsized":"2024-09-14T11:38:26.052970+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.052876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.052876+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.052876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:04:51.972093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.11","version":"264'22","reported_seq":112,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.737204+0000","last_change":"2024-09-14T11:38:34.737204+0000","last_active":"2024-09-14T11:38:34.737204+0000","last_peered":"2024-09-14T11:38:34.737204+0000","last_clean":"2024-09-14T11:38:34.737204+0000","last_became_active":"2024-09-14T11:10:13.508910+0000","last_became_peered":"2024-09-14T11:10:13.508910+0000","last_unstale":"2024-09-14T11:38:34.737204+0000","last_undegraded":"2024-09-14T11:38:34.737204+0000","last_fullsized":"2024-09-14T11:38:34.737204+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'22","last_scrub_stamp":"2024-09-14T11:38:34.737118+0000","last_deep_scrub":"264'22","last_deep_scrub_stamp":"2024-09-14T11:38:34.737118+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.737118+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:19:26.158556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":93,"num_write":58,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.15","version":"264'2","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:52.779745+0000","last_change":"2024-09-14T11:38:52.779745+0000","last_active":"2024-09-14T11:38:52.779745+0000","last_peered":"2024-09-14T11:38:52.779745+0000","last_clean":"2024-09-14T11:38:52.779745+0000","last_became_active":"2024-09-14T11:22:38.549375+0000","last_became_peered":"2024-09-14T11:22:38.549375+0000","last_unstale":"2024-09-14T11:38:52.779745+0000","last_undegraded":"2024-09-14T11:38:52.779745+0000","last_fullsized":"2024-09-14T11:38:52.779745+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:52.779629+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:52.779629+0000","last_clean_scrub_stamp":"2024-09-14T11:38:52.779629+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:55:01.969573+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.12","version":"264'3","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.006633+0000","last_change":"2024-09-14T11:38:27.006633+0000","last_active":"2024-09-14T11:38:27.006633+0000","last_peered":"2024-09-14T11:38:27.006633+0000","last_clean":"2024-09-14T11:38:27.006633+0000","last_became_active":"2024-09-14T11:12:00.368409+0000","last_became_peered":"2024-09-14T11:12:00.368409+0000","last_unstale":"2024-09-14T11:38:27.006633+0000","last_undegraded":"2024-09-14T11:38:27.006633+0000","last_fullsized":"2024-09-14T11:38:27.006633+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:27.006548+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:27.006548+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.006548+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:31.802385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":12288,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.13","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.092270+0000","last_change":"2024-09-14T11:38:34.092270+0000","last_active":"2024-09-14T11:38:34.092270+0000","last_peered":"2024-09-14T11:38:34.092270+0000","last_clean":"2024-09-14T11:38:34.092270+0000","last_became_active":"2024-09-14T11:11:57.354740+0000","last_became_peered":"2024-09-14T11:11:57.354740+0000","last_unstale":"2024-09-14T11:38:34.092270+0000","last_undegraded":"2024-09-14T11:38:34.092270+0000","last_fullsized":"2024-09-14T11:38:34.092270+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:34.092177+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:34.092177+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.092177+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:18:08.291763+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.10","version":"264'29","reported_seq":136,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.732933+0000","last_change":"2024-09-14T11:38:40.732933+0000","last_active":"2024-09-14T11:38:40.732933+0000","last_peered":"2024-09-14T11:38:40.732933+0000","last_clean":"2024-09-14T11:38:40.732933+0000","last_became_active":"2024-09-14T11:10:13.506689+0000","last_became_peered":"2024-09-14T11:10:13.506689+0000","last_unstale":"2024-09-14T11:38:40.732933+0000","last_undegraded":"2024-09-14T11:38:40.732933+0000","last_fullsized":"2024-09-14T11:38:40.732933+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'29","last_scrub_stamp":"2024-09-14T11:38:40.732847+0000","last_deep_scrub":"264'29","last_deep_scrub_stamp":"2024-09-14T11:38:40.732847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.732847+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:30.008861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":240,"num_read_kb":145,"num_write":77,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.183553+0000","last_change":"2024-09-14T11:38:22.183553+0000","last_active":"2024-09-14T11:38:22.183553+0000","last_peered":"2024-09-14T11:38:22.183553+0000","last_clean":"2024-09-14T11:38:22.183553+0000","last_became_active":"2024-09-14T11:22:38.547369+0000","last_became_peered":"2024-09-14T11:22:38.547369+0000","last_unstale":"2024-09-14T11:38:22.183553+0000","last_undegraded":"2024-09-14T11:38:22.183553+0000","last_fullsized":"2024-09-14T11:38:22.183553+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.183443+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.183443+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.183443+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:20:12.330070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:45.819236+0000","last_change":"2024-09-14T11:38:45.819170+0000","last_active":"2024-09-14T11:38:45.819236+0000","last_peered":"2024-09-14T11:38:45.819236+0000","last_clean":"2024-09-14T11:38:45.819236+0000","last_became_active":"2024-09-14T11:12:00.369003+0000","last_became_peered":"2024-09-14T11:12:00.369003+0000","last_unstale":"2024-09-14T11:38:45.819236+0000","last_undegraded":"2024-09-14T11:38:45.819236+0000","last_fullsized":"2024-09-14T11:38:45.819236+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:45.819080+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:45.819080+0000","last_clean_scrub_stamp":"2024-09-14T11:38:45.819080+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:38:43.638573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.c","version":"261'5","reported_seq":64,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.837987+0000","last_change":"2024-09-14T11:38:38.837864+0000","last_active":"2024-09-14T11:38:38.837987+0000","last_peered":"2024-09-14T11:38:38.837987+0000","last_clean":"2024-09-14T11:38:38.837987+0000","last_became_active":"2024-09-14T11:11:57.356911+0000","last_became_peered":"2024-09-14T11:11:57.356911+0000","last_unstale":"2024-09-14T11:38:38.837987+0000","last_undegraded":"2024-09-14T11:38:38.837987+0000","last_fullsized":"2024-09-14T11:38:38.837987+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:38.837771+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:38.837771+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.837771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:57:20.384241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":20482,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.f","version":"264'12","reported_seq":85,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.820148+0000","last_change":"2024-09-14T11:38:37.820148+0000","last_active":"2024-09-14T11:38:37.820148+0000","last_peered":"2024-09-14T11:38:37.820148+0000","last_clean":"2024-09-14T11:38:37.820148+0000","last_became_active":"2024-09-14T11:10:13.511672+0000","last_became_peered":"2024-09-14T11:10:13.511672+0000","last_unstale":"2024-09-14T11:38:37.820148+0000","last_undegraded":"2024-09-14T11:38:37.820148+0000","last_fullsized":"2024-09-14T11:38:37.820148+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:37.820054+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:37.820054+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.820054+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:14.722092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":56,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:47.010061+0000","last_change":"2024-09-14T11:38:47.010061+0000","last_active":"2024-09-14T11:38:47.010061+0000","last_peered":"2024-09-14T11:38:47.010061+0000","last_clean":"2024-09-14T11:38:47.010061+0000","last_became_active":"2024-09-14T11:22:38.559572+0000","last_became_peered":"2024-09-14T11:22:38.559572+0000","last_unstale":"2024-09-14T11:38:47.010061+0000","last_undegraded":"2024-09-14T11:38:47.010061+0000","last_fullsized":"2024-09-14T11:38:47.010061+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:47.009971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:47.009971+0000","last_clean_scrub_stamp":"2024-09-14T11:38:47.009971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:45:50.468358+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:44.846142+0000","last_change":"2024-09-14T11:38:44.846071+0000","last_active":"2024-09-14T11:38:44.846142+0000","last_peered":"2024-09-14T11:38:44.846142+0000","last_clean":"2024-09-14T11:38:44.846142+0000","last_became_active":"2024-09-14T11:12:00.369244+0000","last_became_peered":"2024-09-14T11:12:00.369244+0000","last_unstale":"2024-09-14T11:38:44.846142+0000","last_undegraded":"2024-09-14T11:38:44.846142+0000","last_fullsized":"2024-09-14T11:38:44.846142+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:44.845983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:44.845983+0000","last_clean_scrub_stamp":"2024-09-14T11:38:44.845983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:06:56.731003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.d","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.234138+0000","last_change":"2024-09-14T11:38:18.234039+0000","last_active":"2024-09-14T11:38:18.234138+0000","last_peered":"2024-09-14T11:38:18.234138+0000","last_clean":"2024-09-14T11:38:18.234138+0000","last_became_active":"2024-09-14T11:11:57.357815+0000","last_became_peered":"2024-09-14T11:11:57.357815+0000","last_unstale":"2024-09-14T11:38:18.234138+0000","last_undegraded":"2024-09-14T11:38:18.234138+0000","last_fullsized":"2024-09-14T11:38:18.234138+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:18.233937+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:18.233937+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.233937+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:43:41.868662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4,"num_write":2,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.e","version":"264'130","reported_seq":440,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.118317+0000","last_change":"2024-09-14T11:38:32.118317+0000","last_active":"2024-09-14T11:38:32.118317+0000","last_peered":"2024-09-14T11:38:32.118317+0000","last_clean":"2024-09-14T11:38:32.118317+0000","last_became_active":"2024-09-14T11:10:13.508210+0000","last_became_peered":"2024-09-14T11:10:13.508210+0000","last_unstale":"2024-09-14T11:38:32.118317+0000","last_undegraded":"2024-09-14T11:38:32.118317+0000","last_fullsized":"2024-09-14T11:38:32.118317+0000","mapping_epoch":251,"log_start":"261'100","ondisk_log_start":"261'100","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-14T11:38:32.118235+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-14T11:38:32.118235+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.118235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:24.413407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1221,"num_read_kb":959,"num_write":280,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.984804+0000","last_change":"2024-09-14T11:38:30.984804+0000","last_active":"2024-09-14T11:38:30.984804+0000","last_peered":"2024-09-14T11:38:30.984804+0000","last_clean":"2024-09-14T11:38:30.984804+0000","last_became_active":"2024-09-14T11:22:38.554866+0000","last_became_peered":"2024-09-14T11:22:38.554866+0000","last_unstale":"2024-09-14T11:38:30.984804+0000","last_undegraded":"2024-09-14T11:38:30.984804+0000","last_fullsized":"2024-09-14T11:38:30.984804+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:30.984695+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:30.984695+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.984695+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:15:58.768775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.f","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.665112+0000","last_change":"2024-09-14T11:38:28.665049+0000","last_active":"2024-09-14T11:38:28.665112+0000","last_peered":"2024-09-14T11:38:28.665112+0000","last_clean":"2024-09-14T11:38:28.665112+0000","last_became_active":"2024-09-14T11:12:00.696629+0000","last_became_peered":"2024-09-14T11:12:00.696629+0000","last_unstale":"2024-09-14T11:38:28.665112+0000","last_undegraded":"2024-09-14T11:38:28.665112+0000","last_fullsized":"2024-09-14T11:38:28.665112+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:28.664961+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:28.664961+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.664961+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:20:38.095566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":9216,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.e","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.106016+0000","last_change":"2024-09-14T11:38:38.105946+0000","last_active":"2024-09-14T11:38:38.106016+0000","last_peered":"2024-09-14T11:38:38.106016+0000","last_clean":"2024-09-14T11:38:38.106016+0000","last_became_active":"2024-09-14T11:11:57.349233+0000","last_became_peered":"2024-09-14T11:11:57.349233+0000","last_unstale":"2024-09-14T11:38:38.106016+0000","last_undegraded":"2024-09-14T11:38:38.106016+0000","last_fullsized":"2024-09-14T11:38:38.106016+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:38.105851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:38.105851+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.105851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:45.296790+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.d","version":"264'8","reported_seq":77,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.069093+0000","last_change":"2024-09-14T11:38:22.069093+0000","last_active":"2024-09-14T11:38:22.069093+0000","last_peered":"2024-09-14T11:38:22.069093+0000","last_clean":"2024-09-14T11:38:22.069093+0000","last_became_active":"2024-09-14T11:10:13.511511+0000","last_became_peered":"2024-09-14T11:10:13.511511+0000","last_unstale":"2024-09-14T11:38:22.069093+0000","last_undegraded":"2024-09-14T11:38:22.069093+0000","last_fullsized":"2024-09-14T11:38:22.069093+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:22.069004+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:22.069004+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.069004+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.390134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":39,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:45.986000+0000","last_change":"2024-09-14T11:38:45.986000+0000","last_active":"2024-09-14T11:38:45.986000+0000","last_peered":"2024-09-14T11:38:45.986000+0000","last_clean":"2024-09-14T11:38:45.986000+0000","last_became_active":"2024-09-14T11:22:38.552522+0000","last_became_peered":"2024-09-14T11:22:38.552522+0000","last_unstale":"2024-09-14T11:38:45.986000+0000","last_undegraded":"2024-09-14T11:38:45.986000+0000","last_fullsized":"2024-09-14T11:38:45.986000+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:45.985889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:45.985889+0000","last_clean_scrub_stamp":"2024-09-14T11:38:45.985889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:16:19.682136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.e","version":"264'2","reported_seq":46,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:46.787100+0000","last_change":"2024-09-14T11:38:46.786992+0000","last_active":"2024-09-14T11:38:46.787100+0000","last_peered":"2024-09-14T11:38:46.787100+0000","last_clean":"2024-09-14T11:38:46.787100+0000","last_became_active":"2024-09-14T11:12:00.371657+0000","last_became_peered":"2024-09-14T11:12:00.371657+0000","last_unstale":"2024-09-14T11:38:46.787100+0000","last_undegraded":"2024-09-14T11:38:46.787100+0000","last_fullsized":"2024-09-14T11:38:46.787100+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:46.786892+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:46.786892+0000","last_clean_scrub_stamp":"2024-09-14T11:38:46.786892+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:49:09.955628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.f","version":"264'7","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.597776+0000","last_change":"2024-09-14T11:38:25.597707+0000","last_active":"2024-09-14T11:38:25.597776+0000","last_peered":"2024-09-14T11:38:25.597776+0000","last_clean":"2024-09-14T11:38:25.597776+0000","last_became_active":"2024-09-14T11:11:57.351235+0000","last_became_peered":"2024-09-14T11:11:57.351235+0000","last_unstale":"2024-09-14T11:38:25.597776+0000","last_undegraded":"2024-09-14T11:38:25.597776+0000","last_fullsized":"2024-09-14T11:38:25.597776+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'7","last_scrub_stamp":"2024-09-14T11:38:25.597618+0000","last_deep_scrub":"264'7","last_deep_scrub_stamp":"2024-09-14T11:38:25.597618+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.597618+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:22:56.197704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":5818,"num_write":12,"num_write_kb":4794,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.c","version":"264'67","reported_seq":239,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.232644+0000","last_change":"2024-09-14T11:38:14.232644+0000","last_active":"2024-09-14T11:38:14.232644+0000","last_peered":"2024-09-14T11:38:14.232644+0000","last_clean":"2024-09-14T11:38:14.232644+0000","last_became_active":"2024-09-14T11:10:13.506610+0000","last_became_peered":"2024-09-14T11:10:13.506610+0000","last_unstale":"2024-09-14T11:38:14.232644+0000","last_undegraded":"2024-09-14T11:38:14.232644+0000","last_fullsized":"2024-09-14T11:38:14.232644+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'67","last_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_deep_scrub":"264'67","last_deep_scrub_stamp":"2024-09-14T11:38:14.232551+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.232551+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:24:32.602593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":551,"num_read_kb":376,"num_write":164,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:53.737203+0000","last_change":"2024-09-14T11:38:53.737203+0000","last_active":"2024-09-14T11:38:53.737203+0000","last_peered":"2024-09-14T11:38:53.737203+0000","last_clean":"2024-09-14T11:38:53.737203+0000","last_became_active":"2024-09-14T11:22:38.560066+0000","last_became_peered":"2024-09-14T11:22:38.560066+0000","last_unstale":"2024-09-14T11:38:53.737203+0000","last_undegraded":"2024-09-14T11:38:53.737203+0000","last_fullsized":"2024-09-14T11:38:53.737203+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:53.737107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:53.737107+0000","last_clean_scrub_stamp":"2024-09-14T11:38:53.737107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:13.181636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.9","version":"264'6","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.726725+0000","last_change":"2024-09-14T11:38:41.726725+0000","last_active":"2024-09-14T11:38:41.726725+0000","last_peered":"2024-09-14T11:38:41.726725+0000","last_clean":"2024-09-14T11:38:41.726725+0000","last_became_active":"2024-09-14T11:12:00.368994+0000","last_became_peered":"2024-09-14T11:12:00.368994+0000","last_unstale":"2024-09-14T11:38:41.726725+0000","last_undegraded":"2024-09-14T11:38:41.726725+0000","last_fullsized":"2024-09-14T11:38:41.726725+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:41.726621+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:41.726621+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.726621+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:38:56.091990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12288,"num_write":6,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.135997+0000","last_change":"2024-09-14T11:38:35.135997+0000","last_active":"2024-09-14T11:38:35.135997+0000","last_peered":"2024-09-14T11:38:35.135997+0000","last_clean":"2024-09-14T11:38:35.135997+0000","last_became_active":"2024-09-14T11:11:57.357285+0000","last_became_peered":"2024-09-14T11:11:57.357285+0000","last_unstale":"2024-09-14T11:38:35.135997+0000","last_undegraded":"2024-09-14T11:38:35.135997+0000","last_fullsized":"2024-09-14T11:38:35.135997+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.135900+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.135900+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.135900+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:54.513423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.b","version":"264'34","reported_seq":145,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.082617+0000","last_change":"2024-09-14T11:38:40.082617+0000","last_active":"2024-09-14T11:38:40.082617+0000","last_peered":"2024-09-14T11:38:40.082617+0000","last_clean":"2024-09-14T11:38:40.082617+0000","last_became_active":"2024-09-14T11:10:13.505651+0000","last_became_peered":"2024-09-14T11:10:13.505651+0000","last_unstale":"2024-09-14T11:38:40.082617+0000","last_undegraded":"2024-09-14T11:38:40.082617+0000","last_fullsized":"2024-09-14T11:38:40.082617+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:38:40.082506+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:38:40.082506+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.082506+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:59:13.540395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":264,"num_read_kb":181,"num_write":95,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:49.008194+0000","last_change":"2024-09-14T11:38:49.008194+0000","last_active":"2024-09-14T11:38:49.008194+0000","last_peered":"2024-09-14T11:38:49.008194+0000","last_clean":"2024-09-14T11:38:49.008194+0000","last_became_active":"2024-09-14T11:22:38.557817+0000","last_became_peered":"2024-09-14T11:22:38.557817+0000","last_unstale":"2024-09-14T11:38:49.008194+0000","last_undegraded":"2024-09-14T11:38:49.008194+0000","last_fullsized":"2024-09-14T11:38:49.008194+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:49.008099+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:49.008099+0000","last_clean_scrub_stamp":"2024-09-14T11:38:49.008099+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:34:14.513189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.8","version":"264'6","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.881599+0000","last_change":"2024-09-14T11:38:41.881599+0000","last_active":"2024-09-14T11:38:41.881599+0000","last_peered":"2024-09-14T11:38:41.881599+0000","last_clean":"2024-09-14T11:38:41.881599+0000","last_became_active":"2024-09-14T11:12:00.694257+0000","last_became_peered":"2024-09-14T11:12:00.694257+0000","last_unstale":"2024-09-14T11:38:41.881599+0000","last_undegraded":"2024-09-14T11:38:41.881599+0000","last_fullsized":"2024-09-14T11:38:41.881599+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:41.881516+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:41.881516+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.881516+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:01:15.002775+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":11,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.9","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.584028+0000","last_change":"2024-09-14T11:38:24.584028+0000","last_active":"2024-09-14T11:38:24.584028+0000","last_peered":"2024-09-14T11:38:24.584028+0000","last_clean":"2024-09-14T11:38:24.584028+0000","last_became_active":"2024-09-14T11:11:57.352011+0000","last_became_peered":"2024-09-14T11:11:57.352011+0000","last_unstale":"2024-09-14T11:38:24.584028+0000","last_undegraded":"2024-09-14T11:38:24.584028+0000","last_fullsized":"2024-09-14T11:38:24.584028+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.583945+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.583945+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.583945+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:11:05.737365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.a","version":"264'34","reported_seq":152,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.851533+0000","last_change":"2024-09-14T11:38:31.851533+0000","last_active":"2024-09-14T11:38:31.851533+0000","last_peered":"2024-09-14T11:38:31.851533+0000","last_clean":"2024-09-14T11:38:31.851533+0000","last_became_active":"2024-09-14T11:10:13.511316+0000","last_became_peered":"2024-09-14T11:10:13.511316+0000","last_unstale":"2024-09-14T11:38:31.851533+0000","last_undegraded":"2024-09-14T11:38:31.851533+0000","last_fullsized":"2024-09-14T11:38:31.851533+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:38:31.851446+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:38:31.851446+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.851446+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:20:51.295376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":279,"num_read_kb":182,"num_write":85,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.c","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:48.039964+0000","last_change":"2024-09-14T11:38:48.039964+0000","last_active":"2024-09-14T11:38:48.039964+0000","last_peered":"2024-09-14T11:38:48.039964+0000","last_clean":"2024-09-14T11:38:48.039964+0000","last_became_active":"2024-09-14T11:22:38.556762+0000","last_became_peered":"2024-09-14T11:22:38.556762+0000","last_unstale":"2024-09-14T11:38:48.039964+0000","last_undegraded":"2024-09-14T11:38:48.039964+0000","last_fullsized":"2024-09-14T11:38:48.039964+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:48.039841+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:48.039841+0000","last_clean_scrub_stamp":"2024-09-14T11:38:48.039841+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:43:09.736521+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.b","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.681902+0000","last_change":"2024-09-14T11:38:32.681807+0000","last_active":"2024-09-14T11:38:32.681902+0000","last_peered":"2024-09-14T11:38:32.681902+0000","last_clean":"2024-09-14T11:38:32.681902+0000","last_became_active":"2024-09-14T11:12:00.368427+0000","last_became_peered":"2024-09-14T11:12:00.368427+0000","last_unstale":"2024-09-14T11:38:32.681902+0000","last_undegraded":"2024-09-14T11:38:32.681902+0000","last_fullsized":"2024-09-14T11:38:32.681902+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:32.681671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:32.681671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.681671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:30:26.412740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":49,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.167877+0000","last_change":"2024-09-14T11:38:36.167877+0000","last_active":"2024-09-14T11:38:36.167877+0000","last_peered":"2024-09-14T11:38:36.167877+0000","last_clean":"2024-09-14T11:38:36.167877+0000","last_became_active":"2024-09-14T11:11:57.350342+0000","last_became_peered":"2024-09-14T11:11:57.350342+0000","last_unstale":"2024-09-14T11:38:36.167877+0000","last_undegraded":"2024-09-14T11:38:36.167877+0000","last_fullsized":"2024-09-14T11:38:36.167877+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:36.167789+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:36.167789+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.167789+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:28:16.012896+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.9","version":"264'248","reported_seq":803,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.770709+0000","last_change":"2024-09-14T11:38:36.770709+0000","last_active":"2024-09-14T11:38:36.770709+0000","last_peered":"2024-09-14T11:38:36.770709+0000","last_clean":"2024-09-14T11:38:36.770709+0000","last_became_active":"2024-09-14T11:10:13.505030+0000","last_became_peered":"2024-09-14T11:10:13.505030+0000","last_unstale":"2024-09-14T11:38:36.770709+0000","last_undegraded":"2024-09-14T11:38:36.770709+0000","last_fullsized":"2024-09-14T11:38:36.770709+0000","mapping_epoch":251,"log_start":"261'200","ondisk_log_start":"261'200","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'248","last_scrub_stamp":"2024-09-14T11:38:36.770636+0000","last_deep_scrub":"264'248","last_deep_scrub_stamp":"2024-09-14T11:38:36.770636+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.770636+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:50:43.404316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2355,"num_read_kb":3173,"num_write":488,"num_write_kb":226,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:48.101352+0000","last_change":"2024-09-14T11:38:48.101352+0000","last_active":"2024-09-14T11:38:48.101352+0000","last_peered":"2024-09-14T11:38:48.101352+0000","last_clean":"2024-09-14T11:38:48.101352+0000","last_became_active":"2024-09-14T11:22:38.560512+0000","last_became_peered":"2024-09-14T11:22:38.560512+0000","last_unstale":"2024-09-14T11:38:48.101352+0000","last_undegraded":"2024-09-14T11:38:48.101352+0000","last_fullsized":"2024-09-14T11:38:48.101352+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:48.101259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:48.101259+0000","last_clean_scrub_stamp":"2024-09-14T11:38:48.101259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:44:14.331074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.a","version":"264'8","reported_seq":58,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.926582+0000","last_change":"2024-09-14T11:38:42.926582+0000","last_active":"2024-09-14T11:38:42.926582+0000","last_peered":"2024-09-14T11:38:42.926582+0000","last_clean":"2024-09-14T11:38:42.926582+0000","last_became_active":"2024-09-14T11:12:00.372549+0000","last_became_peered":"2024-09-14T11:12:00.372549+0000","last_unstale":"2024-09-14T11:38:42.926582+0000","last_undegraded":"2024-09-14T11:38:42.926582+0000","last_fullsized":"2024-09-14T11:38:42.926582+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:42.926493+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:42.926493+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.926493+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:59:58.198895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":8,"num_write_kb":14336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.b","version":"261'5","reported_seq":60,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.719183+0000","last_change":"2024-09-14T11:38:32.719094+0000","last_active":"2024-09-14T11:38:32.719183+0000","last_peered":"2024-09-14T11:38:32.719183+0000","last_clean":"2024-09-14T11:38:32.719183+0000","last_became_active":"2024-09-14T11:11:57.352607+0000","last_became_peered":"2024-09-14T11:11:57.352607+0000","last_unstale":"2024-09-14T11:38:32.719183+0000","last_undegraded":"2024-09-14T11:38:32.719183+0000","last_fullsized":"2024-09-14T11:38:32.719183+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'5","last_scrub_stamp":"2024-09-14T11:38:32.718994+0000","last_deep_scrub":"261'5","last_deep_scrub_stamp":"2024-09-14T11:38:32.718994+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.718994+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:40:41.459421+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":4098,"num_write":10,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.8","version":"264'27","reported_seq":131,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.083052+0000","last_change":"2024-09-14T11:38:23.082992+0000","last_active":"2024-09-14T11:38:23.083052+0000","last_peered":"2024-09-14T11:38:23.083052+0000","last_clean":"2024-09-14T11:38:23.083052+0000","last_became_active":"2024-09-14T11:10:13.506344+0000","last_became_peered":"2024-09-14T11:10:13.506344+0000","last_unstale":"2024-09-14T11:38:23.083052+0000","last_undegraded":"2024-09-14T11:38:23.083052+0000","last_fullsized":"2024-09-14T11:38:23.083052+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'27","last_scrub_stamp":"2024-09-14T11:38:23.082907+0000","last_deep_scrub":"264'27","last_deep_scrub_stamp":"2024-09-14T11:38:23.082907+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.082907+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:04:32.531355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":227,"num_read_kb":147,"num_write":70,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.921568+0000","last_change":"2024-09-14T11:38:43.921568+0000","last_active":"2024-09-14T11:38:43.921568+0000","last_peered":"2024-09-14T11:38:43.921568+0000","last_clean":"2024-09-14T11:38:43.921568+0000","last_became_active":"2024-09-14T11:22:38.555506+0000","last_became_peered":"2024-09-14T11:22:38.555506+0000","last_unstale":"2024-09-14T11:38:43.921568+0000","last_undegraded":"2024-09-14T11:38:43.921568+0000","last_fullsized":"2024-09-14T11:38:43.921568+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:43.921483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:43.921483+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.921483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:25:47.997625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.5","version":"261'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:42.081821+0000","last_change":"2024-09-14T11:38:42.081736+0000","last_active":"2024-09-14T11:38:42.081821+0000","last_peered":"2024-09-14T11:38:42.081821+0000","last_clean":"2024-09-14T11:38:42.081821+0000","last_became_active":"2024-09-14T11:12:00.367534+0000","last_became_peered":"2024-09-14T11:12:00.367534+0000","last_unstale":"2024-09-14T11:38:42.081821+0000","last_undegraded":"2024-09-14T11:38:42.081821+0000","last_fullsized":"2024-09-14T11:38:42.081821+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:38:42.081620+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:38:42.081620+0000","last_clean_scrub_stamp":"2024-09-14T11:38:42.081620+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:33:30.371851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.4","version":"261'6","reported_seq":62,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:36.914816+0000","last_change":"2024-09-14T11:38:36.914748+0000","last_active":"2024-09-14T11:38:36.914816+0000","last_peered":"2024-09-14T11:38:36.914816+0000","last_clean":"2024-09-14T11:38:36.914816+0000","last_became_active":"2024-09-14T11:11:57.350433+0000","last_became_peered":"2024-09-14T11:11:57.350433+0000","last_unstale":"2024-09-14T11:38:36.914816+0000","last_undegraded":"2024-09-14T11:38:36.914816+0000","last_fullsized":"2024-09-14T11:38:36.914816+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'6","last_scrub_stamp":"2024-09-14T11:38:36.914662+0000","last_deep_scrub":"261'6","last_deep_scrub_stamp":"2024-09-14T11:38:36.914662+0000","last_clean_scrub_stamp":"2024-09-14T11:38:36.914662+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:16:34.076485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11264,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.7","version":"264'34","reported_seq":146,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.129537+0000","last_change":"2024-09-14T11:38:43.129537+0000","last_active":"2024-09-14T11:38:43.129537+0000","last_peered":"2024-09-14T11:38:43.129537+0000","last_clean":"2024-09-14T11:38:43.129537+0000","last_became_active":"2024-09-14T11:10:13.507162+0000","last_became_peered":"2024-09-14T11:10:13.507162+0000","last_unstale":"2024-09-14T11:38:43.129537+0000","last_undegraded":"2024-09-14T11:38:43.129537+0000","last_fullsized":"2024-09-14T11:38:43.129537+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'34","last_scrub_stamp":"2024-09-14T11:38:43.129443+0000","last_deep_scrub":"264'34","last_deep_scrub_stamp":"2024-09-14T11:38:43.129443+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.129443+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:36.921182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":247,"num_read_kb":158,"num_write":90,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.138591+0000","last_change":"2024-09-14T11:38:40.138591+0000","last_active":"2024-09-14T11:38:40.138591+0000","last_peered":"2024-09-14T11:38:40.138591+0000","last_clean":"2024-09-14T11:38:40.138591+0000","last_became_active":"2024-09-14T11:22:38.559243+0000","last_became_peered":"2024-09-14T11:22:38.559243+0000","last_unstale":"2024-09-14T11:38:40.138591+0000","last_undegraded":"2024-09-14T11:38:40.138591+0000","last_fullsized":"2024-09-14T11:38:40.138591+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:40.138501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:40.138501+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.138501+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:51:46.107619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:41.057517+0000","last_change":"2024-09-14T11:38:41.057457+0000","last_active":"2024-09-14T11:38:41.057517+0000","last_peered":"2024-09-14T11:38:41.057517+0000","last_clean":"2024-09-14T11:38:41.057517+0000","last_became_active":"2024-09-14T11:12:00.695321+0000","last_became_peered":"2024-09-14T11:12:00.695321+0000","last_unstale":"2024-09-14T11:38:41.057517+0000","last_undegraded":"2024-09-14T11:38:41.057517+0000","last_fullsized":"2024-09-14T11:38:41.057517+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:41.057357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:41.057357+0000","last_clean_scrub_stamp":"2024-09-14T11:38:41.057357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:30.519904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.5","version":"264'3","reported_seq":53,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.256817+0000","last_change":"2024-09-14T11:38:17.256752+0000","last_active":"2024-09-14T11:38:17.256817+0000","last_peered":"2024-09-14T11:38:17.256817+0000","last_clean":"2024-09-14T11:38:17.256817+0000","last_became_active":"2024-09-14T11:11:57.356948+0000","last_became_peered":"2024-09-14T11:11:57.356948+0000","last_unstale":"2024-09-14T11:38:17.256817+0000","last_undegraded":"2024-09-14T11:38:17.256817+0000","last_fullsized":"2024-09-14T11:38:17.256817+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:17.256651+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:17.256651+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.256651+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:05:48.299275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.6","version":"264'12","reported_seq":89,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.106318+0000","last_change":"2024-09-14T11:38:21.106250+0000","last_active":"2024-09-14T11:38:21.106318+0000","last_peered":"2024-09-14T11:38:21.106318+0000","last_clean":"2024-09-14T11:38:21.106318+0000","last_became_active":"2024-09-14T11:10:13.507185+0000","last_became_peered":"2024-09-14T11:10:13.507185+0000","last_unstale":"2024-09-14T11:38:21.106318+0000","last_undegraded":"2024-09-14T11:38:21.106318+0000","last_fullsized":"2024-09-14T11:38:21.106318+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:21.106166+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:21.106166+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.106166+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:17:56.598437+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":94,"num_read_kb":52,"num_write":31,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.688740+0000","last_change":"2024-09-14T11:38:31.688664+0000","last_active":"2024-09-14T11:38:31.688740+0000","last_peered":"2024-09-14T11:38:31.688740+0000","last_clean":"2024-09-14T11:38:31.688740+0000","last_became_active":"2024-09-14T11:22:38.559064+0000","last_became_peered":"2024-09-14T11:22:38.559064+0000","last_unstale":"2024-09-14T11:38:31.688740+0000","last_undegraded":"2024-09-14T11:38:31.688740+0000","last_fullsized":"2024-09-14T11:38:31.688740+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:31.688568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:31.688568+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.688568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:12:55.762970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.7","version":"264'8","reported_seq":63,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:40.894110+0000","last_change":"2024-09-14T11:38:40.894110+0000","last_active":"2024-09-14T11:38:40.894110+0000","last_peered":"2024-09-14T11:38:40.894110+0000","last_clean":"2024-09-14T11:38:40.894110+0000","last_became_active":"2024-09-14T11:12:00.697487+0000","last_became_peered":"2024-09-14T11:12:00.697487+0000","last_unstale":"2024-09-14T11:38:40.894110+0000","last_undegraded":"2024-09-14T11:38:40.894110+0000","last_fullsized":"2024-09-14T11:38:40.894110+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:40.894015+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:40.894015+0000","last_clean_scrub_stamp":"2024-09-14T11:38:40.894015+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:19:16.069269+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":22530,"num_write":13,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.6","version":"264'2","reported_seq":52,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.113900+0000","last_change":"2024-09-14T11:38:33.113900+0000","last_active":"2024-09-14T11:38:33.113900+0000","last_peered":"2024-09-14T11:38:33.113900+0000","last_clean":"2024-09-14T11:38:33.113900+0000","last_became_active":"2024-09-14T11:11:57.356258+0000","last_became_peered":"2024-09-14T11:11:57.356258+0000","last_unstale":"2024-09-14T11:38:33.113900+0000","last_undegraded":"2024-09-14T11:38:33.113900+0000","last_fullsized":"2024-09-14T11:38:33.113900+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:33.113815+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:33.113815+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.113815+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:51:43.192334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":3072,"num_write":2,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.5","version":"264'12","reported_seq":90,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.876684+0000","last_change":"2024-09-14T11:38:30.876684+0000","last_active":"2024-09-14T11:38:30.876684+0000","last_peered":"2024-09-14T11:38:30.876684+0000","last_clean":"2024-09-14T11:38:30.876684+0000","last_became_active":"2024-09-14T11:10:13.509872+0000","last_became_peered":"2024-09-14T11:10:13.509872+0000","last_unstale":"2024-09-14T11:38:30.876684+0000","last_undegraded":"2024-09-14T11:38:30.876684+0000","last_fullsized":"2024-09-14T11:38:30.876684+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'12","last_scrub_stamp":"2024-09-14T11:38:30.876588+0000","last_deep_scrub":"264'12","last_deep_scrub_stamp":"2024-09-14T11:38:30.876588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.876588+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:46.926427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":98,"num_read_kb":57,"num_write":32,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:43.736648+0000","last_change":"2024-09-14T11:38:43.736648+0000","last_active":"2024-09-14T11:38:43.736648+0000","last_peered":"2024-09-14T11:38:43.736648+0000","last_clean":"2024-09-14T11:38:43.736648+0000","last_became_active":"2024-09-14T11:22:38.560544+0000","last_became_peered":"2024-09-14T11:22:38.560544+0000","last_unstale":"2024-09-14T11:38:43.736648+0000","last_undegraded":"2024-09-14T11:38:43.736648+0000","last_fullsized":"2024-09-14T11:38:43.736648+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:43.736561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:43.736561+0000","last_clean_scrub_stamp":"2024-09-14T11:38:43.736561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:04:33.826073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:39.743956+0000","last_change":"2024-09-14T11:38:39.743956+0000","last_active":"2024-09-14T11:38:39.743956+0000","last_peered":"2024-09-14T11:38:39.743956+0000","last_clean":"2024-09-14T11:38:39.743956+0000","last_became_active":"2024-09-14T11:12:00.368032+0000","last_became_peered":"2024-09-14T11:12:00.368032+0000","last_unstale":"2024-09-14T11:38:39.743956+0000","last_undegraded":"2024-09-14T11:38:39.743956+0000","last_fullsized":"2024-09-14T11:38:39.743956+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:39.743823+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:39.743823+0000","last_clean_scrub_stamp":"2024-09-14T11:38:39.743823+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:31:58.861276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.7","version":"264'3","reported_seq":56,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:37.870952+0000","last_change":"2024-09-14T11:38:37.870952+0000","last_active":"2024-09-14T11:38:37.870952+0000","last_peered":"2024-09-14T11:38:37.870952+0000","last_clean":"2024-09-14T11:38:37.870952+0000","last_became_active":"2024-09-14T11:11:57.352787+0000","last_became_peered":"2024-09-14T11:11:57.352787+0000","last_unstale":"2024-09-14T11:38:37.870952+0000","last_undegraded":"2024-09-14T11:38:37.870952+0000","last_fullsized":"2024-09-14T11:38:37.870952+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:37.870849+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:37.870849+0000","last_clean_scrub_stamp":"2024-09-14T11:38:37.870849+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:01:10.849434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":8,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.4","version":"264'78","reported_seq":266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.642390+0000","last_change":"2024-09-14T11:38:21.642390+0000","last_active":"2024-09-14T11:38:21.642390+0000","last_peered":"2024-09-14T11:38:21.642390+0000","last_clean":"2024-09-14T11:38:21.642390+0000","last_became_active":"2024-09-14T11:10:13.502778+0000","last_became_peered":"2024-09-14T11:10:13.502778+0000","last_unstale":"2024-09-14T11:38:21.642390+0000","last_undegraded":"2024-09-14T11:38:21.642390+0000","last_fullsized":"2024-09-14T11:38:21.642390+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'78","last_scrub_stamp":"2024-09-14T11:38:21.642290+0000","last_deep_scrub":"264'78","last_deep_scrub_stamp":"2024-09-14T11:38:21.642290+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.642290+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:48:06.797363+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":621,"num_read_kb":406,"num_write":195,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.6","version":"264'2","reported_seq":30,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.160166+0000","last_change":"2024-09-14T11:38:21.160166+0000","last_active":"2024-09-14T11:38:21.160166+0000","last_peered":"2024-09-14T11:38:21.160166+0000","last_clean":"2024-09-14T11:38:21.160166+0000","last_became_active":"2024-09-14T11:22:38.553237+0000","last_became_peered":"2024-09-14T11:22:38.553237+0000","last_unstale":"2024-09-14T11:38:21.160166+0000","last_undegraded":"2024-09-14T11:38:21.160166+0000","last_fullsized":"2024-09-14T11:38:21.160166+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:21.160076+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:21.160076+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.160076+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:22:20.453418+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1","version":"264'8","reported_seq":59,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.643500+0000","last_change":"2024-09-14T11:38:27.643397+0000","last_active":"2024-09-14T11:38:27.643500+0000","last_peered":"2024-09-14T11:38:27.643500+0000","last_clean":"2024-09-14T11:38:27.643500+0000","last_became_active":"2024-09-14T11:12:00.367589+0000","last_became_peered":"2024-09-14T11:12:00.367589+0000","last_unstale":"2024-09-14T11:38:27.643500+0000","last_undegraded":"2024-09-14T11:38:27.643500+0000","last_fullsized":"2024-09-14T11:38:27.643500+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'8","last_scrub_stamp":"2024-09-14T11:38:27.643298+0000","last_deep_scrub":"264'8","last_deep_scrub_stamp":"2024-09-14T11:38:27.643298+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.643298+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:40.241405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":15360,"num_write":13,"num_write_kb":15360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.0","version":"261'2","reported_seq":54,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.929445+0000","last_change":"2024-09-14T11:38:34.929445+0000","last_active":"2024-09-14T11:38:34.929445+0000","last_peered":"2024-09-14T11:38:34.929445+0000","last_clean":"2024-09-14T11:38:34.929445+0000","last_became_active":"2024-09-14T11:11:57.345668+0000","last_became_peered":"2024-09-14T11:11:57.345668+0000","last_unstale":"2024-09-14T11:38:34.929445+0000","last_undegraded":"2024-09-14T11:38:34.929445+0000","last_fullsized":"2024-09-14T11:38:34.929445+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"261'2","last_scrub_stamp":"2024-09-14T11:38:34.929324+0000","last_deep_scrub":"261'2","last_deep_scrub_stamp":"2024-09-14T11:38:34.929324+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.929324+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:45.170707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.3","version":"264'53","reported_seq":200,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.167744+0000","last_change":"2024-09-14T11:38:31.167744+0000","last_active":"2024-09-14T11:38:31.167744+0000","last_peered":"2024-09-14T11:38:31.167744+0000","last_clean":"2024-09-14T11:38:31.167744+0000","last_became_active":"2024-09-14T11:10:13.502445+0000","last_became_peered":"2024-09-14T11:10:13.502445+0000","last_unstale":"2024-09-14T11:38:31.167744+0000","last_undegraded":"2024-09-14T11:38:31.167744+0000","last_fullsized":"2024-09-14T11:38:31.167744+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'53","last_scrub_stamp":"2024-09-14T11:38:31.167653+0000","last_deep_scrub":"264'53","last_deep_scrub_stamp":"2024-09-14T11:38:31.167653+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.167653+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:25:09.151717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":437,"num_read_kb":318,"num_write":132,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:51.119687+0000","last_change":"2024-09-14T11:38:51.119687+0000","last_active":"2024-09-14T11:38:51.119687+0000","last_peered":"2024-09-14T11:38:51.119687+0000","last_clean":"2024-09-14T11:38:51.119687+0000","last_became_active":"2024-09-14T11:22:38.559554+0000","last_became_peered":"2024-09-14T11:22:38.559554+0000","last_unstale":"2024-09-14T11:38:51.119687+0000","last_undegraded":"2024-09-14T11:38:51.119687+0000","last_fullsized":"2024-09-14T11:38:51.119687+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:51.119596+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:51.119596+0000","last_clean_scrub_stamp":"2024-09-14T11:38:51.119596+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:50.062227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":44,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.112467+0000","last_change":"2024-09-14T11:38:35.112467+0000","last_active":"2024-09-14T11:38:35.112467+0000","last_peered":"2024-09-14T11:38:35.112467+0000","last_clean":"2024-09-14T11:38:35.112467+0000","last_became_active":"2024-09-14T11:12:00.369383+0000","last_became_peered":"2024-09-14T11:12:00.369383+0000","last_unstale":"2024-09-14T11:38:35.112467+0000","last_undegraded":"2024-09-14T11:38:35.112467+0000","last_fullsized":"2024-09-14T11:38:35.112467+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.112350+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.112350+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.112350+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:03:57.206879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.900684+0000","last_change":"2024-09-14T11:38:35.900633+0000","last_active":"2024-09-14T11:38:35.900684+0000","last_peered":"2024-09-14T11:38:35.900684+0000","last_clean":"2024-09-14T11:38:35.900684+0000","last_became_active":"2024-09-14T11:11:57.349376+0000","last_became_peered":"2024-09-14T11:11:57.349376+0000","last_unstale":"2024-09-14T11:38:35.900684+0000","last_undegraded":"2024-09-14T11:38:35.900684+0000","last_fullsized":"2024-09-14T11:38:35.900684+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:35.900549+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:35.900549+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.900549+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:58:34.208928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.2","version":"264'40","reported_seq":164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.773313+0000","last_change":"2024-09-14T11:38:30.773313+0000","last_active":"2024-09-14T11:38:30.773313+0000","last_peered":"2024-09-14T11:38:30.773313+0000","last_clean":"2024-09-14T11:38:30.773313+0000","last_became_active":"2024-09-14T11:10:13.510167+0000","last_became_peered":"2024-09-14T11:10:13.510167+0000","last_unstale":"2024-09-14T11:38:30.773313+0000","last_undegraded":"2024-09-14T11:38:30.773313+0000","last_fullsized":"2024-09-14T11:38:30.773313+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'40","last_scrub_stamp":"2024-09-14T11:38:30.773214+0000","last_deep_scrub":"264'40","last_deep_scrub_stamp":"2024-09-14T11:38:30.773214+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.773214+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:42:47.034372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":332,"num_read_kb":232,"num_write":94,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:45.098197+0000","last_change":"2024-09-14T11:38:45.098197+0000","last_active":"2024-09-14T11:38:45.098197+0000","last_peered":"2024-09-14T11:38:45.098197+0000","last_clean":"2024-09-14T11:38:45.098197+0000","last_became_active":"2024-09-14T11:22:38.558672+0000","last_became_peered":"2024-09-14T11:22:38.558672+0000","last_unstale":"2024-09-14T11:38:45.098197+0000","last_undegraded":"2024-09-14T11:38:45.098197+0000","last_fullsized":"2024-09-14T11:38:45.098197+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:45.098109+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:45.098109+0000","last_clean_scrub_stamp":"2024-09-14T11:38:45.098109+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:02:17.010994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.3","version":"264'5","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.960138+0000","last_change":"2024-09-14T11:38:27.960050+0000","last_active":"2024-09-14T11:38:27.960138+0000","last_peered":"2024-09-14T11:38:27.960138+0000","last_clean":"2024-09-14T11:38:27.960138+0000","last_became_active":"2024-09-14T11:12:00.372634+0000","last_became_peered":"2024-09-14T11:12:00.372634+0000","last_unstale":"2024-09-14T11:38:27.960138+0000","last_undegraded":"2024-09-14T11:38:27.960138+0000","last_fullsized":"2024-09-14T11:38:27.960138+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'5","last_scrub_stamp":"2024-09-14T11:38:27.959939+0000","last_deep_scrub":"264'5","last_deep_scrub_stamp":"2024-09-14T11:38:27.959939+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.959939+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:11:05.403275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.2","version":"0'0","reported_seq":50,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.597159+0000","last_change":"2024-09-14T11:38:22.597102+0000","last_active":"2024-09-14T11:38:22.597159+0000","last_peered":"2024-09-14T11:38:22.597159+0000","last_clean":"2024-09-14T11:38:22.597159+0000","last_became_active":"2024-09-14T11:11:57.347634+0000","last_became_peered":"2024-09-14T11:11:57.347634+0000","last_unstale":"2024-09-14T11:38:22.597159+0000","last_undegraded":"2024-09-14T11:38:22.597159+0000","last_fullsized":"2024-09-14T11:38:22.597159+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.597007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.597007+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.597007+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:58:05.834802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1","version":"264'17","reported_seq":104,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.087648+0000","last_change":"2024-09-14T11:38:20.087648+0000","last_active":"2024-09-14T11:38:20.087648+0000","last_peered":"2024-09-14T11:38:20.087648+0000","last_clean":"2024-09-14T11:38:20.087648+0000","last_became_active":"2024-09-14T11:10:13.512673+0000","last_became_peered":"2024-09-14T11:10:13.512673+0000","last_unstale":"2024-09-14T11:38:20.087648+0000","last_undegraded":"2024-09-14T11:38:20.087648+0000","last_fullsized":"2024-09-14T11:38:20.087648+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'17","last_scrub_stamp":"2024-09-14T11:38:20.087560+0000","last_deep_scrub":"264'17","last_deep_scrub_stamp":"2024-09-14T11:38:20.087560+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.087560+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:03:46.309977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":144,"num_read_kb":90,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:44.960733+0000","last_change":"2024-09-14T11:38:44.960733+0000","last_active":"2024-09-14T11:38:44.960733+0000","last_peered":"2024-09-14T11:38:44.960733+0000","last_clean":"2024-09-14T11:38:44.960733+0000","last_became_active":"2024-09-14T11:22:38.555551+0000","last_became_peered":"2024-09-14T11:22:38.555551+0000","last_unstale":"2024-09-14T11:38:44.960733+0000","last_undegraded":"2024-09-14T11:38:44.960733+0000","last_fullsized":"2024-09-14T11:38:44.960733+0000","mapping_epoch":262,"log_start":"0'0","ondisk_log_start":"0'0","created":262,"last_epoch_clean":263,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:44.960645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:44.960645+0000","last_clean_scrub_stamp":"2024-09-14T11:38:44.960645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:02.550080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.2","version":"264'2","reported_seq":48,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:38.694999+0000","last_change":"2024-09-14T11:38:38.694928+0000","last_active":"2024-09-14T11:38:38.694999+0000","last_peered":"2024-09-14T11:38:38.694999+0000","last_clean":"2024-09-14T11:38:38.694999+0000","last_became_active":"2024-09-14T11:12:00.368039+0000","last_became_peered":"2024-09-14T11:12:00.368039+0000","last_unstale":"2024-09-14T11:38:38.694999+0000","last_undegraded":"2024-09-14T11:38:38.694999+0000","last_fullsized":"2024-09-14T11:38:38.694999+0000","mapping_epoch":257,"log_start":"0'0","ondisk_log_start":"0'0","created":257,"last_epoch_clean":258,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:38.694827+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:38.694827+0000","last_clean_scrub_stamp":"2024-09-14T11:38:38.694827+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:06.537666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1396,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.3","version":"264'3","reported_seq":55,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.083048+0000","last_change":"2024-09-14T11:38:25.082979+0000","last_active":"2024-09-14T11:38:25.083048+0000","last_peered":"2024-09-14T11:38:25.083048+0000","last_clean":"2024-09-14T11:38:25.083048+0000","last_became_active":"2024-09-14T11:11:57.351352+0000","last_became_peered":"2024-09-14T11:11:57.351352+0000","last_unstale":"2024-09-14T11:38:25.083048+0000","last_undegraded":"2024-09-14T11:38:25.083048+0000","last_fullsized":"2024-09-14T11:38:25.083048+0000","mapping_epoch":254,"log_start":"0'0","ondisk_log_start":"0'0","created":254,"last_epoch_clean":255,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:38:25.082876+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:38:25.082876+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.082876+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:29.073078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":6144,"num_write":3,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.0","version":"264'45","reported_seq":171,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.918172+0000","last_change":"2024-09-14T11:38:29.918172+0000","last_active":"2024-09-14T11:38:29.918172+0000","last_peered":"2024-09-14T11:38:29.918172+0000","last_clean":"2024-09-14T11:38:29.918172+0000","last_became_active":"2024-09-14T11:10:13.507929+0000","last_became_peered":"2024-09-14T11:10:13.507929+0000","last_unstale":"2024-09-14T11:38:29.918172+0000","last_undegraded":"2024-09-14T11:38:29.918172+0000","last_fullsized":"2024-09-14T11:38:29.918172+0000","mapping_epoch":251,"log_start":"0'0","ondisk_log_start":"0'0","created":251,"last_epoch_clean":252,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'45","last_scrub_stamp":"2024-09-14T11:38:29.918087+0000","last_deep_scrub":"264'45","last_deep_scrub_stamp":"2024-09-14T11:38:29.918087+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.918087+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:49:05.376556+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":326,"num_read_kb":215,"num_write":116,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3f","version":"264'354","reported_seq":1084,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.994434+0000","last_change":"2024-09-14T11:38:03.994434+0000","last_active":"2024-09-14T11:38:03.994434+0000","last_peered":"2024-09-14T11:38:03.994434+0000","last_clean":"2024-09-14T11:38:03.994434+0000","last_became_active":"2024-09-14T10:56:06.840311+0000","last_became_peered":"2024-09-14T10:56:06.840311+0000","last_unstale":"2024-09-14T11:38:03.994434+0000","last_undegraded":"2024-09-14T11:38:03.994434+0000","last_fullsized":"2024-09-14T11:38:03.994434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:38:03.994337+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.994337+0000","objects_scrubbed":3,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:32.808942+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":710,"num_read_kb":163807,"num_write":1157,"num_write_kb":46459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"264'97","reported_seq":686,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.995380+0000","last_change":"2024-09-14T11:38:12.995303+0000","last_active":"2024-09-14T11:38:12.995380+0000","last_peered":"2024-09-14T11:38:12.995380+0000","last_clean":"2024-09-14T11:38:12.995380+0000","last_became_active":"2024-09-14T10:56:08.850385+0000","last_became_peered":"2024-09-14T10:56:08.850385+0000","last_unstale":"2024-09-14T11:38:12.995380+0000","last_undegraded":"2024-09-14T11:38:12.995380+0000","last_fullsized":"2024-09-14T11:38:12.995380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'97","last_scrub_stamp":"2024-09-14T11:38:12.995220+0000","last_deep_scrub":"264'97","last_deep_scrub_stamp":"2024-09-14T11:38:12.995220+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.995220+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":0,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:25.650124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":444,"num_read_kb":375,"num_write":147,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"264'345","reported_seq":987,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.525749+0000","last_change":"2024-09-14T11:38:00.525749+0000","last_active":"2024-09-14T11:38:00.525749+0000","last_peered":"2024-09-14T11:38:00.525749+0000","last_clean":"2024-09-14T11:38:00.525749+0000","last_became_active":"2024-09-14T10:56:06.829509+0000","last_became_peered":"2024-09-14T10:56:06.829509+0000","last_unstale":"2024-09-14T11:38:00.525749+0000","last_undegraded":"2024-09-14T11:38:00.525749+0000","last_fullsized":"2024-09-14T11:38:00.525749+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:00.525650+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.525650+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:10.105566+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":584,"num_read_kb":38007,"num_write":1094,"num_write_kb":16865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"264'80","reported_seq":703,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.938542+0000","last_change":"2024-09-14T11:38:12.938486+0000","last_active":"2024-09-14T11:38:12.938542+0000","last_peered":"2024-09-14T11:38:12.938542+0000","last_clean":"2024-09-14T11:38:12.938542+0000","last_became_active":"2024-09-14T10:56:08.846867+0000","last_became_peered":"2024-09-14T10:56:08.846867+0000","last_unstale":"2024-09-14T11:38:12.938542+0000","last_undegraded":"2024-09-14T11:38:12.938542+0000","last_fullsized":"2024-09-14T11:38:12.938542+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'80","last_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_deep_scrub":"264'80","last_deep_scrub_stamp":"2024-09-14T11:38:12.938395+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.938395+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:05:21.819088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":378,"num_write":122,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"264'358","reported_seq":1034,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.091285+0000","last_change":"2024-09-14T11:38:03.091285+0000","last_active":"2024-09-14T11:38:03.091285+0000","last_peered":"2024-09-14T11:38:03.091285+0000","last_clean":"2024-09-14T11:38:03.091285+0000","last_became_active":"2024-09-14T10:56:06.827522+0000","last_became_peered":"2024-09-14T10:56:06.827522+0000","last_unstale":"2024-09-14T11:38:03.091285+0000","last_undegraded":"2024-09-14T11:38:03.091285+0000","last_fullsized":"2024-09-14T11:38:03.091285+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'358","last_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_deep_scrub":"264'358","last_deep_scrub_stamp":"2024-09-14T11:38:03.091169+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.091169+0000","objects_scrubbed":7,"log_size":58,"log_dups_size":300,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:15:56.915196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":624,"num_read_kb":108632,"num_write":1075,"num_write_kb":51788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"264'576","reported_seq":1215,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.782068+0000","last_change":"2024-09-14T11:38:14.781958+0000","last_active":"2024-09-14T11:38:14.782068+0000","last_peered":"2024-09-14T11:38:14.782068+0000","last_clean":"2024-09-14T11:38:14.782068+0000","last_became_active":"2024-09-14T10:56:08.839493+0000","last_became_peered":"2024-09-14T10:56:08.839493+0000","last_unstale":"2024-09-14T11:38:14.782068+0000","last_undegraded":"2024-09-14T11:38:14.782068+0000","last_fullsized":"2024-09-14T11:38:14.782068+0000","mapping_epoch":25,"log_start":"261'500","ondisk_log_start":"261'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'576","last_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_deep_scrub":"264'576","last_deep_scrub_stamp":"2024-09-14T11:38:14.781853+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.781853+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:02:29.674631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4748,"num_read_kb":4367,"num_write":1067,"num_write_kb":532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"264'362","reported_seq":1113,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.332890+0000","last_change":"2024-09-14T11:37:58.332811+0000","last_active":"2024-09-14T11:37:58.332890+0000","last_peered":"2024-09-14T11:37:58.332890+0000","last_clean":"2024-09-14T11:37:58.332890+0000","last_became_active":"2024-09-14T10:56:42.459968+0000","last_became_peered":"2024-09-14T10:56:42.459968+0000","last_unstale":"2024-09-14T11:37:58.332890+0000","last_undegraded":"2024-09-14T11:37:58.332890+0000","last_fullsized":"2024-09-14T11:37:58.332890+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:58.332673+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.332673+0000","objects_scrubbed":7,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:50:30.730339+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655862,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":837,"num_read_kb":34002,"num_write":1219,"num_write_kb":31538,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"264'116","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.136771+0000","last_change":"2024-09-14T11:38:09.136696+0000","last_active":"2024-09-14T11:38:09.136771+0000","last_peered":"2024-09-14T11:38:09.136771+0000","last_clean":"2024-09-14T11:38:09.136771+0000","last_became_active":"2024-09-14T10:56:08.833713+0000","last_became_peered":"2024-09-14T10:56:08.833713+0000","last_unstale":"2024-09-14T11:38:09.136771+0000","last_undegraded":"2024-09-14T11:38:09.136771+0000","last_fullsized":"2024-09-14T11:38:09.136771+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-14T11:38:09.136612+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.136612+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:47:07.052131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":530,"num_read_kb":446,"num_write":176,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"264'371","reported_seq":1007,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.973477+0000","last_change":"2024-09-14T11:38:07.973421+0000","last_active":"2024-09-14T11:38:07.973477+0000","last_peered":"2024-09-14T11:38:07.973477+0000","last_clean":"2024-09-14T11:38:07.973477+0000","last_became_active":"2024-09-14T10:56:06.830304+0000","last_became_peered":"2024-09-14T10:56:06.830304+0000","last_unstale":"2024-09-14T11:38:07.973477+0000","last_undegraded":"2024-09-14T11:38:07.973477+0000","last_fullsized":"2024-09-14T11:38:07.973477+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'371","last_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_deep_scrub":"264'371","last_deep_scrub_stamp":"2024-09-14T11:38:07.973335+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.973335+0000","objects_scrubbed":1,"log_size":71,"log_dups_size":300,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:54:21.083071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":613,"num_read_kb":21029,"num_write":1146,"num_write_kb":38477,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"264'146","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.191435+0000","last_change":"2024-09-14T11:38:06.191360+0000","last_active":"2024-09-14T11:38:06.191435+0000","last_peered":"2024-09-14T11:38:06.191435+0000","last_clean":"2024-09-14T11:38:06.191435+0000","last_became_active":"2024-09-14T10:56:08.840928+0000","last_became_peered":"2024-09-14T10:56:08.840928+0000","last_unstale":"2024-09-14T11:38:06.191435+0000","last_undegraded":"2024-09-14T11:38:06.191435+0000","last_fullsized":"2024-09-14T11:38:06.191435+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.191241+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.191241+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:19:38.560557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":626,"num_read_kb":529,"num_write":231,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"264'405","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.977470+0000","last_change":"2024-09-14T11:38:07.977410+0000","last_active":"2024-09-14T11:38:07.977470+0000","last_peered":"2024-09-14T11:38:07.977470+0000","last_clean":"2024-09-14T11:38:07.977470+0000","last_became_active":"2024-09-14T10:56:06.831384+0000","last_became_peered":"2024-09-14T10:56:06.831384+0000","last_unstale":"2024-09-14T11:38:07.977470+0000","last_undegraded":"2024-09-14T11:38:07.977470+0000","last_fullsized":"2024-09-14T11:38:07.977470+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'405","last_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_deep_scrub":"264'405","last_deep_scrub_stamp":"2024-09-14T11:38:07.977308+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.977308+0000","objects_scrubbed":5,"log_size":105,"log_dups_size":300,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:43:07.168772+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":624,"num_read_kb":29480,"num_write":1192,"num_write_kb":55841,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"264'4188","reported_seq":4829,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.832213+0000","last_change":"2024-09-14T11:38:13.832213+0000","last_active":"2024-09-14T11:38:13.832213+0000","last_peered":"2024-09-14T11:38:13.832213+0000","last_clean":"2024-09-14T11:38:13.832213+0000","last_became_active":"2024-09-14T10:56:08.838800+0000","last_became_peered":"2024-09-14T10:56:08.838800+0000","last_unstale":"2024-09-14T11:38:13.832213+0000","last_undegraded":"2024-09-14T11:38:13.832213+0000","last_fullsized":"2024-09-14T11:38:13.832213+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4188","last_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_deep_scrub":"264'4188","last_deep_scrub_stamp":"2024-09-14T11:38:13.832127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.832127+0000","objects_scrubbed":1,"log_size":88,"log_dups_size":3000,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:35:18.131503+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16834,"num_read_kb":14064,"num_write":6282,"num_write_kb":3144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2876,"num_omap_keys":12,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"264'345","reported_seq":965,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.954563+0000","last_change":"2024-09-14T11:38:02.954476+0000","last_active":"2024-09-14T11:38:02.954563+0000","last_peered":"2024-09-14T11:38:02.954563+0000","last_clean":"2024-09-14T11:38:02.954563+0000","last_became_active":"2024-09-14T10:56:06.832956+0000","last_became_peered":"2024-09-14T10:56:06.832956+0000","last_unstale":"2024-09-14T11:38:02.954563+0000","last_undegraded":"2024-09-14T11:38:02.954563+0000","last_fullsized":"2024-09-14T11:38:02.954563+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'345","last_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_deep_scrub":"264'345","last_deep_scrub_stamp":"2024-09-14T11:38:02.954347+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.954347+0000","objects_scrubbed":4,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:07.261862+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":585,"num_read_kb":8679,"num_write":1155,"num_write_kb":35759,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"264'152","reported_seq":767,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.013337+0000","last_change":"2024-09-14T11:38:12.013337+0000","last_active":"2024-09-14T11:38:12.013337+0000","last_peered":"2024-09-14T11:38:12.013337+0000","last_clean":"2024-09-14T11:38:12.013337+0000","last_became_active":"2024-09-14T10:56:08.845087+0000","last_became_peered":"2024-09-14T10:56:08.845087+0000","last_unstale":"2024-09-14T11:38:12.013337+0000","last_undegraded":"2024-09-14T11:38:12.013337+0000","last_fullsized":"2024-09-14T11:38:12.013337+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:12.013236+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.013236+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:34:20.617466+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":701,"num_read_kb":581,"num_write":221,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"264'444","reported_seq":1184,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.704148+0000","last_change":"2024-09-14T11:38:02.704052+0000","last_active":"2024-09-14T11:38:02.704148+0000","last_peered":"2024-09-14T11:38:02.704148+0000","last_clean":"2024-09-14T11:38:02.704148+0000","last_became_active":"2024-09-14T10:56:06.822922+0000","last_became_peered":"2024-09-14T10:56:06.822922+0000","last_unstale":"2024-09-14T11:38:02.704148+0000","last_undegraded":"2024-09-14T11:38:02.704148+0000","last_fullsized":"2024-09-14T11:38:02.704148+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'444","last_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_deep_scrub":"264'444","last_deep_scrub_stamp":"2024-09-14T11:38:02.703931+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.703931+0000","objects_scrubbed":5,"log_size":44,"log_dups_size":400,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:19:06.189735+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1027,"num_read_kb":48878,"num_write":1330,"num_write_kb":47457,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"264'162","reported_seq":813,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.285228+0000","last_change":"2024-09-14T11:38:05.285228+0000","last_active":"2024-09-14T11:38:05.285228+0000","last_peered":"2024-09-14T11:38:05.285228+0000","last_clean":"2024-09-14T11:38:05.285228+0000","last_became_active":"2024-09-14T10:56:08.837189+0000","last_became_peered":"2024-09-14T10:56:08.837189+0000","last_unstale":"2024-09-14T11:38:05.285228+0000","last_undegraded":"2024-09-14T11:38:05.285228+0000","last_fullsized":"2024-09-14T11:38:05.285228+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'162","last_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_deep_scrub":"264'162","last_deep_scrub_stamp":"2024-09-14T11:38:05.285135+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.285135+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:48:29.574473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":714,"num_read_kb":597,"num_write":246,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"264'154","reported_seq":769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.838913+0000","last_change":"2024-09-14T11:38:10.838913+0000","last_active":"2024-09-14T11:38:10.838913+0000","last_peered":"2024-09-14T11:38:10.838913+0000","last_clean":"2024-09-14T11:38:10.838913+0000","last_became_active":"2024-09-14T10:56:08.838890+0000","last_became_peered":"2024-09-14T10:56:08.838890+0000","last_unstale":"2024-09-14T11:38:10.838913+0000","last_undegraded":"2024-09-14T11:38:10.838913+0000","last_fullsized":"2024-09-14T11:38:10.838913+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:10.838796+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.838796+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:09:42.132159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":686,"num_read_kb":570,"num_write":226,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"264'355","reported_seq":998,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.289296+0000","last_change":"2024-09-14T11:37:57.289296+0000","last_active":"2024-09-14T11:37:57.289296+0000","last_peered":"2024-09-14T11:37:57.289296+0000","last_clean":"2024-09-14T11:37:57.289296+0000","last_became_active":"2024-09-14T10:56:42.660861+0000","last_became_peered":"2024-09-14T10:56:42.660861+0000","last_unstale":"2024-09-14T11:37:57.289296+0000","last_undegraded":"2024-09-14T11:37:57.289296+0000","last_fullsized":"2024-09-14T11:37:57.289296+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'355","last_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_deep_scrub":"264'355","last_deep_scrub_stamp":"2024-09-14T11:37:57.289198+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.289198+0000","objects_scrubbed":2,"log_size":55,"log_dups_size":300,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:05:54.356710+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":655,"num_read_kb":81454,"num_write":1158,"num_write_kb":39618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"264'206","reported_seq":826,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.996771+0000","last_change":"2024-09-14T11:38:10.996771+0000","last_active":"2024-09-14T11:38:10.996771+0000","last_peered":"2024-09-14T11:38:10.996771+0000","last_clean":"2024-09-14T11:38:10.996771+0000","last_became_active":"2024-09-14T10:56:08.846517+0000","last_became_peered":"2024-09-14T10:56:08.846517+0000","last_unstale":"2024-09-14T11:38:10.996771+0000","last_undegraded":"2024-09-14T11:38:10.996771+0000","last_fullsized":"2024-09-14T11:38:10.996771+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'206","last_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_deep_scrub":"264'206","last_deep_scrub_stamp":"2024-09-14T11:38:10.996672+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.996672+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:38.298661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":936,"num_read_kb":767,"num_write":347,"num_write_kb":174,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"264'372","reported_seq":1148,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.204888+0000","last_change":"2024-09-14T11:38:02.204888+0000","last_active":"2024-09-14T11:38:02.204888+0000","last_peered":"2024-09-14T11:38:02.204888+0000","last_clean":"2024-09-14T11:38:02.204888+0000","last_became_active":"2024-09-14T10:56:06.835708+0000","last_became_peered":"2024-09-14T10:56:06.835708+0000","last_unstale":"2024-09-14T11:38:02.204888+0000","last_undegraded":"2024-09-14T11:38:02.204888+0000","last_fullsized":"2024-09-14T11:38:02.204888+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:02.204768+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.204768+0000","objects_scrubbed":5,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:08:29.702067+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1102,"num_read_kb":13751,"num_write":1178,"num_write_kb":37583,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"264'186","reported_seq":788,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.996363+0000","last_change":"2024-09-14T11:38:09.996296+0000","last_active":"2024-09-14T11:38:09.996363+0000","last_peered":"2024-09-14T11:38:09.996363+0000","last_clean":"2024-09-14T11:38:09.996363+0000","last_became_active":"2024-09-14T10:56:08.843840+0000","last_became_peered":"2024-09-14T10:56:08.843840+0000","last_unstale":"2024-09-14T11:38:09.996363+0000","last_undegraded":"2024-09-14T11:38:09.996363+0000","last_fullsized":"2024-09-14T11:38:09.996363+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'186","last_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_deep_scrub":"264'186","last_deep_scrub_stamp":"2024-09-14T11:38:09.996212+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.996212+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.770213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":836,"num_read_kb":678,"num_write":291,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"264'324","reported_seq":971,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.247962+0000","last_change":"2024-09-14T11:38:01.247962+0000","last_active":"2024-09-14T11:38:01.247962+0000","last_peered":"2024-09-14T11:38:01.247962+0000","last_clean":"2024-09-14T11:38:01.247962+0000","last_became_active":"2024-09-14T10:56:06.835793+0000","last_became_peered":"2024-09-14T10:56:06.835793+0000","last_unstale":"2024-09-14T11:38:01.247962+0000","last_undegraded":"2024-09-14T11:38:01.247962+0000","last_fullsized":"2024-09-14T11:38:01.247962+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'324","last_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_deep_scrub":"264'324","last_deep_scrub_stamp":"2024-09-14T11:38:01.247834+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.247834+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:10:08.750152+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":627,"num_read_kb":2147,"num_write":1090,"num_write_kb":23648,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"264'222","reported_seq":881,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.263789+0000","last_change":"2024-09-14T11:38:02.263789+0000","last_active":"2024-09-14T11:38:02.263789+0000","last_peered":"2024-09-14T11:38:02.263789+0000","last_clean":"2024-09-14T11:38:02.263789+0000","last_became_active":"2024-09-14T10:56:08.833705+0000","last_became_peered":"2024-09-14T10:56:08.833705+0000","last_unstale":"2024-09-14T11:38:02.263789+0000","last_undegraded":"2024-09-14T11:38:02.263789+0000","last_fullsized":"2024-09-14T11:38:02.263789+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'222","last_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_deep_scrub":"264'222","last_deep_scrub_stamp":"2024-09-14T11:38:02.263694+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.263694+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:00:48.528551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":976,"num_read_kb":805,"num_write":362,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"264'372","reported_seq":1037,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.783570+0000","last_change":"2024-09-14T11:37:57.783570+0000","last_active":"2024-09-14T11:37:57.783570+0000","last_peered":"2024-09-14T11:37:57.783570+0000","last_clean":"2024-09-14T11:37:57.783570+0000","last_became_active":"2024-09-14T10:56:06.830538+0000","last_became_peered":"2024-09-14T10:56:06.830538+0000","last_unstale":"2024-09-14T11:37:57.783570+0000","last_undegraded":"2024-09-14T11:37:57.783570+0000","last_fullsized":"2024-09-14T11:37:57.783570+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:37:57.783470+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.783470+0000","objects_scrubbed":6,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:52.425734+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655890,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":712,"num_read_kb":45139,"num_write":1131,"num_write_kb":53333,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"264'125","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.254892+0000","last_change":"2024-09-14T11:38:03.254892+0000","last_active":"2024-09-14T11:38:03.254892+0000","last_peered":"2024-09-14T11:38:03.254892+0000","last_clean":"2024-09-14T11:38:03.254892+0000","last_became_active":"2024-09-14T10:56:08.834606+0000","last_became_peered":"2024-09-14T10:56:08.834606+0000","last_unstale":"2024-09-14T11:38:03.254892+0000","last_undegraded":"2024-09-14T11:38:03.254892+0000","last_fullsized":"2024-09-14T11:38:03.254892+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'125","last_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_deep_scrub":"264'125","last_deep_scrub_stamp":"2024-09-14T11:38:03.254797+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.254797+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:24.262724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":568,"num_read_kb":473,"num_write":193,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"264'359","reported_seq":1050,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.750138+0000","last_change":"2024-09-14T11:38:03.750138+0000","last_active":"2024-09-14T11:38:03.750138+0000","last_peered":"2024-09-14T11:38:03.750138+0000","last_clean":"2024-09-14T11:38:03.750138+0000","last_became_active":"2024-09-14T10:56:06.825634+0000","last_became_peered":"2024-09-14T10:56:06.825634+0000","last_unstale":"2024-09-14T11:38:03.750138+0000","last_undegraded":"2024-09-14T11:38:03.750138+0000","last_fullsized":"2024-09-14T11:38:03.750138+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'359","last_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_deep_scrub":"264'359","last_deep_scrub_stamp":"2024-09-14T11:38:03.750052+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.750052+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":300,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:17:22.099690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":664,"num_read_kb":91641,"num_write":1162,"num_write_kb":30085,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"264'165","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.839755+0000","last_change":"2024-09-14T11:38:12.839755+0000","last_active":"2024-09-14T11:38:12.839755+0000","last_peered":"2024-09-14T11:38:12.839755+0000","last_clean":"2024-09-14T11:38:12.839755+0000","last_became_active":"2024-09-14T10:56:08.845911+0000","last_became_peered":"2024-09-14T10:56:08.845911+0000","last_unstale":"2024-09-14T11:38:12.839755+0000","last_undegraded":"2024-09-14T11:38:12.839755+0000","last_fullsized":"2024-09-14T11:38:12.839755+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'165","last_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_deep_scrub":"264'165","last_deep_scrub_stamp":"2024-09-14T11:38:12.839644+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.839644+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:30:27.847410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":691,"num_read_kb":561,"num_write":257,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"264'339","reported_seq":952,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.127997+0000","last_change":"2024-09-14T11:38:00.127943+0000","last_active":"2024-09-14T11:38:00.127997+0000","last_peered":"2024-09-14T11:38:00.127997+0000","last_clean":"2024-09-14T11:38:00.127997+0000","last_became_active":"2024-09-14T10:56:06.828444+0000","last_became_peered":"2024-09-14T10:56:06.828444+0000","last_unstale":"2024-09-14T11:38:00.127997+0000","last_undegraded":"2024-09-14T11:38:00.127997+0000","last_fullsized":"2024-09-14T11:38:00.127997+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:38:00.127836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.127836+0000","objects_scrubbed":4,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:41.934910+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":525,"num_read_kb":12785,"num_write":1085,"num_write_kb":21897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"264'138","reported_seq":653,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.786566+0000","last_change":"2024-09-14T11:38:29.786566+0000","last_active":"2024-09-14T11:38:29.786566+0000","last_peered":"2024-09-14T11:38:29.786566+0000","last_clean":"2024-09-14T11:38:29.786566+0000","last_became_active":"2024-09-14T10:56:16.876947+0000","last_became_peered":"2024-09-14T10:56:16.876947+0000","last_unstale":"2024-09-14T11:38:29.786566+0000","last_undegraded":"2024-09-14T11:38:29.786566+0000","last_fullsized":"2024-09-14T11:38:29.786566+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:29.786476+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:29.786476+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.786476+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:15.053081+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":160,"num_read_kb":150,"num_write":317,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"264'285","reported_seq":918,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.802655+0000","last_change":"2024-09-14T11:38:07.802553+0000","last_active":"2024-09-14T11:38:07.802655+0000","last_peered":"2024-09-14T11:38:07.802655+0000","last_clean":"2024-09-14T11:38:07.802655+0000","last_became_active":"2024-09-14T10:56:08.838853+0000","last_became_peered":"2024-09-14T10:56:08.838853+0000","last_unstale":"2024-09-14T11:38:07.802655+0000","last_undegraded":"2024-09-14T11:38:07.802655+0000","last_fullsized":"2024-09-14T11:38:07.802655+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-09-14T11:38:07.802440+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.802440+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:22.163602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1219,"num_read_kb":990,"num_write":434,"num_write_kb":220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"264'369","reported_seq":1073,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.971493+0000","last_change":"2024-09-14T11:38:01.971426+0000","last_active":"2024-09-14T11:38:01.971493+0000","last_peered":"2024-09-14T11:38:01.971493+0000","last_clean":"2024-09-14T11:38:01.971493+0000","last_became_active":"2024-09-14T10:56:06.835128+0000","last_became_peered":"2024-09-14T10:56:06.835128+0000","last_unstale":"2024-09-14T11:38:01.971493+0000","last_undegraded":"2024-09-14T11:38:01.971493+0000","last_fullsized":"2024-09-14T11:38:01.971493+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:01.971327+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.971327+0000","objects_scrubbed":2,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:31:34.955599+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":841,"num_read_kb":1723,"num_write":1205,"num_write_kb":23411,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.915505+0000","last_change":"2024-09-14T11:38:14.915505+0000","last_active":"2024-09-14T11:38:14.915505+0000","last_peered":"2024-09-14T11:38:14.915505+0000","last_clean":"2024-09-14T11:38:14.915505+0000","last_became_active":"2024-09-14T10:56:10.847885+0000","last_became_peered":"2024-09-14T10:56:10.847885+0000","last_unstale":"2024-09-14T11:38:14.915505+0000","last_undegraded":"2024-09-14T11:38:14.915505+0000","last_fullsized":"2024-09-14T11:38:14.915505+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.915421+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.915421+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.915421+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:55:26.590941+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"264'369","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.048922+0000","last_change":"2024-09-14T11:38:17.048922+0000","last_active":"2024-09-14T11:38:17.048922+0000","last_peered":"2024-09-14T11:38:17.048922+0000","last_clean":"2024-09-14T11:38:17.048922+0000","last_became_active":"2024-09-14T10:56:12.850308+0000","last_became_peered":"2024-09-14T10:56:12.850308+0000","last_unstale":"2024-09-14T11:38:17.048922+0000","last_undegraded":"2024-09-14T11:38:17.048922+0000","last_fullsized":"2024-09-14T11:38:17.048922+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:17.048831+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:17.048831+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.048831+0000","objects_scrubbed":5,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:36.197526+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48907,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":593,"num_read_kb":1292,"num_write":484,"num_write_kb":353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.865065+0000","last_change":"2024-09-14T11:38:25.865065+0000","last_active":"2024-09-14T11:38:25.865065+0000","last_peered":"2024-09-14T11:38:25.865065+0000","last_clean":"2024-09-14T11:38:25.865065+0000","last_became_active":"2024-09-14T10:56:14.867487+0000","last_became_peered":"2024-09-14T10:56:14.867487+0000","last_unstale":"2024-09-14T11:38:25.865065+0000","last_undegraded":"2024-09-14T11:38:25.865065+0000","last_fullsized":"2024-09-14T11:38:25.865065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.864975+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.864975+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.864975+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:11:21.699201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"264'2491","reported_seq":4312,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.073340+0000","last_change":"2024-09-14T11:38:29.073340+0000","last_active":"2024-09-14T11:38:29.073340+0000","last_peered":"2024-09-14T11:38:29.073340+0000","last_clean":"2024-09-14T11:38:29.073340+0000","last_became_active":"2024-09-14T10:56:16.878285+0000","last_became_peered":"2024-09-14T10:56:16.878285+0000","last_unstale":"2024-09-14T11:38:29.073340+0000","last_undegraded":"2024-09-14T11:38:29.073340+0000","last_fullsized":"2024-09-14T11:38:29.073340+0000","mapping_epoch":33,"log_start":"264'2400","ondisk_log_start":"264'2400","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2491","last_scrub_stamp":"2024-09-14T11:38:29.073250+0000","last_deep_scrub":"264'2491","last_deep_scrub_stamp":"2024-09-14T11:38:29.073250+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.073250+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":2400,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:59:11.514402+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":451,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":6180,"num_read_kb":6181,"num_write":5039,"num_write_kb":1850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":176,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"264'270","reported_seq":884,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.933553+0000","last_change":"2024-09-14T11:38:05.933553+0000","last_active":"2024-09-14T11:38:05.933553+0000","last_peered":"2024-09-14T11:38:05.933553+0000","last_clean":"2024-09-14T11:38:05.933553+0000","last_became_active":"2024-09-14T10:56:08.848946+0000","last_became_peered":"2024-09-14T10:56:08.848946+0000","last_unstale":"2024-09-14T11:38:05.933553+0000","last_undegraded":"2024-09-14T11:38:05.933553+0000","last_fullsized":"2024-09-14T11:38:05.933553+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'270","last_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_deep_scrub":"264'270","last_deep_scrub_stamp":"2024-09-14T11:38:05.933442+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.933442+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":200,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:23:27.514791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1149,"num_read_kb":926,"num_write":400,"num_write_kb":207,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"264'317","reported_seq":938,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.214481+0000","last_change":"2024-09-14T11:37:54.214379+0000","last_active":"2024-09-14T11:37:54.214481+0000","last_peered":"2024-09-14T11:37:54.214481+0000","last_clean":"2024-09-14T11:37:54.214481+0000","last_became_active":"2024-09-14T10:56:06.830362+0000","last_became_peered":"2024-09-14T10:56:06.830362+0000","last_unstale":"2024-09-14T11:37:54.214481+0000","last_undegraded":"2024-09-14T11:37:54.214481+0000","last_fullsized":"2024-09-14T11:37:54.214481+0000","mapping_epoch":23,"log_start":"264'301","ondisk_log_start":"264'301","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'317","last_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_deep_scrub":"264'317","last_deep_scrub_stamp":"2024-09-14T11:37:54.214277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.214277+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":301,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:51:04.066988+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":41365,"num_write":992,"num_write_kb":31056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.763743+0000","last_change":"2024-09-14T11:38:14.763679+0000","last_active":"2024-09-14T11:38:14.763743+0000","last_peered":"2024-09-14T11:38:14.763743+0000","last_clean":"2024-09-14T11:38:14.763743+0000","last_became_active":"2024-09-14T10:56:10.841759+0000","last_became_peered":"2024-09-14T10:56:10.841759+0000","last_unstale":"2024-09-14T11:38:14.763743+0000","last_undegraded":"2024-09-14T11:38:14.763743+0000","last_fullsized":"2024-09-14T11:38:14.763743+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.763569+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.763569+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:51:12.261341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"264'92","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.791514+0000","last_change":"2024-09-14T11:38:22.791514+0000","last_active":"2024-09-14T11:38:22.791514+0000","last_peered":"2024-09-14T11:38:22.791514+0000","last_clean":"2024-09-14T11:38:22.791514+0000","last_became_active":"2024-09-14T10:56:12.849860+0000","last_became_peered":"2024-09-14T10:56:12.849860+0000","last_unstale":"2024-09-14T11:38:22.791514+0000","last_undegraded":"2024-09-14T11:38:22.791514+0000","last_fullsized":"2024-09-14T11:38:22.791514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:22.791422+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:22.791422+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.791422+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:24:18.156792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":64,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.769667+0000","last_change":"2024-09-14T11:38:24.769667+0000","last_active":"2024-09-14T11:38:24.769667+0000","last_peered":"2024-09-14T11:38:24.769667+0000","last_clean":"2024-09-14T11:38:24.769667+0000","last_became_active":"2024-09-14T10:56:14.865280+0000","last_became_peered":"2024-09-14T10:56:14.865280+0000","last_unstale":"2024-09-14T11:38:24.769667+0000","last_undegraded":"2024-09-14T11:38:24.769667+0000","last_fullsized":"2024-09-14T11:38:24.769667+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.769582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.769582+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.769582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:37:27.142757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"264'130","reported_seq":629,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.059020+0000","last_change":"2024-09-14T11:38:29.058959+0000","last_active":"2024-09-14T11:38:29.059020+0000","last_peered":"2024-09-14T11:38:29.059020+0000","last_clean":"2024-09-14T11:38:29.059020+0000","last_became_active":"2024-09-14T10:56:16.878234+0000","last_became_peered":"2024-09-14T10:56:16.878234+0000","last_unstale":"2024-09-14T11:38:29.059020+0000","last_undegraded":"2024-09-14T11:38:29.059020+0000","last_fullsized":"2024-09-14T11:38:29.059020+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'130","last_scrub_stamp":"2024-09-14T11:38:29.058858+0000","last_deep_scrub":"264'130","last_deep_scrub_stamp":"2024-09-14T11:38:29.058858+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.058858+0000","objects_scrubbed":6,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:00:10.343975+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":880,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":132,"num_read_kb":130,"num_write":308,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"264'303","reported_seq":951,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.169189+0000","last_change":"2024-09-14T11:38:06.169189+0000","last_active":"2024-09-14T11:38:06.169189+0000","last_peered":"2024-09-14T11:38:06.169189+0000","last_clean":"2024-09-14T11:38:06.169189+0000","last_became_active":"2024-09-14T10:56:08.843069+0000","last_became_peered":"2024-09-14T10:56:08.843069+0000","last_unstale":"2024-09-14T11:38:06.169189+0000","last_undegraded":"2024-09-14T11:38:06.169189+0000","last_fullsized":"2024-09-14T11:38:06.169189+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:06.169106+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.169106+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:13.055830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1392,"num_read_kb":1160,"num_write":510,"num_write_kb":303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"264'356","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.996393+0000","last_change":"2024-09-14T11:37:58.996323+0000","last_active":"2024-09-14T11:37:58.996393+0000","last_peered":"2024-09-14T11:37:58.996393+0000","last_clean":"2024-09-14T11:37:58.996393+0000","last_became_active":"2024-09-14T10:56:06.833820+0000","last_became_peered":"2024-09-14T10:56:06.833820+0000","last_unstale":"2024-09-14T11:37:58.996393+0000","last_undegraded":"2024-09-14T11:37:58.996393+0000","last_fullsized":"2024-09-14T11:37:58.996393+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.996219+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.996219+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:05:49.905581+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":543,"num_read_kb":14993,"num_write":1137,"num_write_kb":41475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.757556+0000","last_change":"2024-09-14T11:38:20.757556+0000","last_active":"2024-09-14T11:38:20.757556+0000","last_peered":"2024-09-14T11:38:20.757556+0000","last_clean":"2024-09-14T11:38:20.757556+0000","last_became_active":"2024-09-14T10:56:10.847228+0000","last_became_peered":"2024-09-14T10:56:10.847228+0000","last_unstale":"2024-09-14T11:38:20.757556+0000","last_undegraded":"2024-09-14T11:38:20.757556+0000","last_fullsized":"2024-09-14T11:38:20.757556+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:20.757467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:20.757467+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.757467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:01.473105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"264'119","reported_seq":657,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.313893+0000","last_change":"2024-09-14T11:38:10.313797+0000","last_active":"2024-09-14T11:38:10.313893+0000","last_peered":"2024-09-14T11:38:10.313893+0000","last_clean":"2024-09-14T11:38:10.313893+0000","last_became_active":"2024-09-14T10:56:12.846715+0000","last_became_peered":"2024-09-14T10:56:12.846715+0000","last_unstale":"2024-09-14T11:38:10.313893+0000","last_undegraded":"2024-09-14T11:38:10.313893+0000","last_fullsized":"2024-09-14T11:38:10.313893+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'119","last_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_deep_scrub":"264'119","last_deep_scrub_stamp":"2024-09-14T11:38:10.313671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.313671+0000","objects_scrubbed":5,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:06:12.772415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":123,"num_read_kb":116,"num_write":82,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"264'761","reported_seq":2186,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.840184+0000","last_change":"2024-09-14T11:38:24.840184+0000","last_active":"2024-09-14T11:38:24.840184+0000","last_peered":"2024-09-14T11:38:24.840184+0000","last_clean":"2024-09-14T11:38:24.840184+0000","last_became_active":"2024-09-14T10:56:14.860806+0000","last_became_peered":"2024-09-14T10:56:14.860806+0000","last_unstale":"2024-09-14T11:38:24.840184+0000","last_undegraded":"2024-09-14T11:38:24.840184+0000","last_fullsized":"2024-09-14T11:38:24.840184+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'761","last_scrub_stamp":"2024-09-14T11:38:24.840088+0000","last_deep_scrub":"264'761","last_deep_scrub_stamp":"2024-09-14T11:38:24.840088+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.840088+0000","objects_scrubbed":1,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:40:31.800651+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"264'243","reported_seq":1120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.749120+0000","last_change":"2024-09-14T11:38:31.749031+0000","last_active":"2024-09-14T11:38:31.749120+0000","last_peered":"2024-09-14T11:38:31.749120+0000","last_clean":"2024-09-14T11:38:31.749120+0000","last_became_active":"2024-09-14T10:56:16.863970+0000","last_became_peered":"2024-09-14T10:56:16.863970+0000","last_unstale":"2024-09-14T11:38:31.749120+0000","last_undegraded":"2024-09-14T11:38:31.749120+0000","last_fullsized":"2024-09-14T11:38:31.749120+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'243","last_scrub_stamp":"2024-09-14T11:38:31.748925+0000","last_deep_scrub":"264'243","last_deep_scrub_stamp":"2024-09-14T11:38:31.748925+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.748925+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:35:11.249605+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":185,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":805,"num_read_kb":756,"num_write":534,"num_write_kb":135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"264'4157","reported_seq":4760,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.796045+0000","last_change":"2024-09-14T11:38:08.796045+0000","last_active":"2024-09-14T11:38:08.796045+0000","last_peered":"2024-09-14T11:38:08.796045+0000","last_clean":"2024-09-14T11:38:08.796045+0000","last_became_active":"2024-09-14T10:56:08.847858+0000","last_became_peered":"2024-09-14T10:56:08.847858+0000","last_unstale":"2024-09-14T11:38:08.796045+0000","last_undegraded":"2024-09-14T11:38:08.796045+0000","last_fullsized":"2024-09-14T11:38:08.796045+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4157","last_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_deep_scrub":"264'4157","last_deep_scrub_stamp":"2024-09-14T11:38:08.795955+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.795955+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":3000,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:23:56.535050+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16747,"num_read_kb":13956,"num_write":6223,"num_write_kb":3128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4001,"num_omap_keys":18,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"264'336","reported_seq":989,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.207574+0000","last_change":"2024-09-14T11:37:57.207516+0000","last_active":"2024-09-14T11:37:57.207574+0000","last_peered":"2024-09-14T11:37:57.207574+0000","last_clean":"2024-09-14T11:37:57.207574+0000","last_became_active":"2024-09-14T10:56:06.833477+0000","last_became_peered":"2024-09-14T10:56:06.833477+0000","last_unstale":"2024-09-14T11:37:57.207574+0000","last_undegraded":"2024-09-14T11:37:57.207574+0000","last_fullsized":"2024-09-14T11:37:57.207574+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:57.207427+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.207427+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:53:13.344531+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":639,"num_read_kb":30569,"num_write":1024,"num_write_kb":28757,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.946969+0000","last_change":"2024-09-14T11:38:15.946969+0000","last_active":"2024-09-14T11:38:15.946969+0000","last_peered":"2024-09-14T11:38:15.946969+0000","last_clean":"2024-09-14T11:38:15.946969+0000","last_became_active":"2024-09-14T10:56:10.839111+0000","last_became_peered":"2024-09-14T10:56:10.839111+0000","last_unstale":"2024-09-14T11:38:15.946969+0000","last_undegraded":"2024-09-14T11:38:15.946969+0000","last_fullsized":"2024-09-14T11:38:15.946969+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.946873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.946873+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.946873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:46:58.418213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"264'294","reported_seq":861,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.859838+0000","last_change":"2024-09-14T11:38:20.859838+0000","last_active":"2024-09-14T11:38:20.859838+0000","last_peered":"2024-09-14T11:38:20.859838+0000","last_clean":"2024-09-14T11:38:20.859838+0000","last_became_active":"2024-09-14T10:56:13.040983+0000","last_became_peered":"2024-09-14T10:56:13.040983+0000","last_unstale":"2024-09-14T11:38:20.859838+0000","last_undegraded":"2024-09-14T11:38:20.859838+0000","last_fullsized":"2024-09-14T11:38:20.859838+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'294","last_scrub_stamp":"2024-09-14T11:38:20.859741+0000","last_deep_scrub":"264'294","last_deep_scrub_stamp":"2024-09-14T11:38:20.859741+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.859741+0000","objects_scrubbed":4,"log_size":94,"log_dups_size":200,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:07:51.310826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48207,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":506,"num_read_kb":1245,"num_write":424,"num_write_kb":361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"264'795","reported_seq":2264,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:29.758262+0000","last_change":"2024-09-14T11:38:29.758262+0000","last_active":"2024-09-14T11:38:29.758262+0000","last_peered":"2024-09-14T11:38:29.758262+0000","last_clean":"2024-09-14T11:38:29.758262+0000","last_became_active":"2024-09-14T10:56:14.859061+0000","last_became_peered":"2024-09-14T10:56:14.859061+0000","last_unstale":"2024-09-14T11:38:29.758262+0000","last_undegraded":"2024-09-14T11:38:29.758262+0000","last_fullsized":"2024-09-14T11:38:29.758262+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:29.758152+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:29.758152+0000","last_clean_scrub_stamp":"2024-09-14T11:38:29.758152+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:58.242377+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"264'163","reported_seq":743,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.901270+0000","last_change":"2024-09-14T11:38:04.901270+0000","last_active":"2024-09-14T11:38:04.901270+0000","last_peered":"2024-09-14T11:38:04.901270+0000","last_clean":"2024-09-14T11:38:04.901270+0000","last_became_active":"2024-09-14T10:56:08.849088+0000","last_became_peered":"2024-09-14T10:56:08.849088+0000","last_unstale":"2024-09-14T11:38:04.901270+0000","last_undegraded":"2024-09-14T11:38:04.901270+0000","last_fullsized":"2024-09-14T11:38:04.901270+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'163","last_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_deep_scrub":"264'163","last_deep_scrub_stamp":"2024-09-14T11:38:04.901185+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.901185+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:20:34.668649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":700,"num_read_kb":572,"num_write":243,"num_write_kb":114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"264'335","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.980217+0000","last_change":"2024-09-14T11:37:59.980161+0000","last_active":"2024-09-14T11:37:59.980217+0000","last_peered":"2024-09-14T11:37:59.980217+0000","last_clean":"2024-09-14T11:37:59.980217+0000","last_became_active":"2024-09-14T10:56:06.836462+0000","last_became_peered":"2024-09-14T10:56:06.836462+0000","last_unstale":"2024-09-14T11:37:59.980217+0000","last_undegraded":"2024-09-14T11:37:59.980217+0000","last_fullsized":"2024-09-14T11:37:59.980217+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'335","last_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_deep_scrub":"264'335","last_deep_scrub_stamp":"2024-09-14T11:37:59.980047+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.980047+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":300,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:02.870696+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":515,"num_read_kb":9228,"num_write":1120,"num_write_kb":20864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.951810+0000","last_change":"2024-09-14T11:38:11.951810+0000","last_active":"2024-09-14T11:38:11.951810+0000","last_peered":"2024-09-14T11:38:11.951810+0000","last_clean":"2024-09-14T11:38:11.951810+0000","last_became_active":"2024-09-14T10:56:10.848634+0000","last_became_peered":"2024-09-14T10:56:10.848634+0000","last_unstale":"2024-09-14T11:38:11.951810+0000","last_undegraded":"2024-09-14T11:38:11.951810+0000","last_fullsized":"2024-09-14T11:38:11.951810+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.951722+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.951722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:21:21.559571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"264'369","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.854194+0000","last_change":"2024-09-14T11:38:19.854194+0000","last_active":"2024-09-14T11:38:19.854194+0000","last_peered":"2024-09-14T11:38:19.854194+0000","last_clean":"2024-09-14T11:38:19.854194+0000","last_became_active":"2024-09-14T10:56:13.040856+0000","last_became_peered":"2024-09-14T10:56:13.040856+0000","last_unstale":"2024-09-14T11:38:19.854194+0000","last_undegraded":"2024-09-14T11:38:19.854194+0000","last_fullsized":"2024-09-14T11:38:19.854194+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'369","last_scrub_stamp":"2024-09-14T11:38:19.854090+0000","last_deep_scrub":"264'369","last_deep_scrub_stamp":"2024-09-14T11:38:19.854090+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.854090+0000","objects_scrubbed":9,"log_size":69,"log_dups_size":300,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:18:09.592302+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46884,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":582,"num_read_kb":1214,"num_write":460,"num_write_kb":318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":493,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.515050+0000","last_change":"2024-09-14T11:38:14.514970+0000","last_active":"2024-09-14T11:38:14.515050+0000","last_peered":"2024-09-14T11:38:14.515050+0000","last_clean":"2024-09-14T11:38:14.515050+0000","last_became_active":"2024-09-14T10:56:14.866987+0000","last_became_peered":"2024-09-14T10:56:14.866987+0000","last_unstale":"2024-09-14T11:38:14.515050+0000","last_undegraded":"2024-09-14T11:38:14.515050+0000","last_fullsized":"2024-09-14T11:38:14.515050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.514871+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.514871+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.514871+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:05:01.063754+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"264'550","reported_seq":1371,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.993670+0000","last_change":"2024-09-14T11:38:25.993670+0000","last_active":"2024-09-14T11:38:25.993670+0000","last_peered":"2024-09-14T11:38:25.993670+0000","last_clean":"2024-09-14T11:38:25.993670+0000","last_became_active":"2024-09-14T10:56:16.873468+0000","last_became_peered":"2024-09-14T10:56:16.873468+0000","last_unstale":"2024-09-14T11:38:25.993670+0000","last_undegraded":"2024-09-14T11:38:25.993670+0000","last_fullsized":"2024-09-14T11:38:25.993670+0000","mapping_epoch":33,"log_start":"264'500","ondisk_log_start":"264'500","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'550","last_scrub_stamp":"2024-09-14T11:38:25.993577+0000","last_deep_scrub":"264'550","last_deep_scrub_stamp":"2024-09-14T11:38:25.993577+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.993577+0000","objects_scrubbed":4,"log_size":50,"log_dups_size":500,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:03:27.501103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":456,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1311,"num_read_kb":1297,"num_write":1141,"num_write_kb":389,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"264'218","reported_seq":848,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.778887+0000","last_change":"2024-09-14T11:38:00.778887+0000","last_active":"2024-09-14T11:38:00.778887+0000","last_peered":"2024-09-14T11:38:00.778887+0000","last_clean":"2024-09-14T11:38:00.778887+0000","last_became_active":"2024-09-14T10:56:08.844863+0000","last_became_peered":"2024-09-14T10:56:08.844863+0000","last_unstale":"2024-09-14T11:38:00.778887+0000","last_undegraded":"2024-09-14T11:38:00.778887+0000","last_fullsized":"2024-09-14T11:38:00.778887+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'218","last_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_deep_scrub":"264'218","last_deep_scrub_stamp":"2024-09-14T11:38:00.778798+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.778798+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:29:57.572541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":951,"num_read_kb":771,"num_write":346,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"264'264","reported_seq":908,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.924271+0000","last_change":"2024-09-14T11:37:56.924217+0000","last_active":"2024-09-14T11:37:56.924271+0000","last_peered":"2024-09-14T11:37:56.924271+0000","last_clean":"2024-09-14T11:37:56.924271+0000","last_became_active":"2024-09-14T10:56:06.834696+0000","last_became_peered":"2024-09-14T10:56:06.834696+0000","last_unstale":"2024-09-14T11:37:56.924271+0000","last_undegraded":"2024-09-14T11:37:56.924271+0000","last_fullsized":"2024-09-14T11:37:56.924271+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'264","last_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_deep_scrub":"264'264","last_deep_scrub_stamp":"2024-09-14T11:37:56.924115+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.924115+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:26:59.368338+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":513,"num_read_kb":56700,"num_write":826,"num_write_kb":19437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.288085+0000","last_change":"2024-09-14T11:38:11.288085+0000","last_active":"2024-09-14T11:38:11.288085+0000","last_peered":"2024-09-14T11:38:11.288085+0000","last_clean":"2024-09-14T11:38:11.288085+0000","last_became_active":"2024-09-14T10:56:10.848227+0000","last_became_peered":"2024-09-14T10:56:10.848227+0000","last_unstale":"2024-09-14T11:38:11.288085+0000","last_undegraded":"2024-09-14T11:38:11.288085+0000","last_fullsized":"2024-09-14T11:38:11.288085+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.287976+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.287976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:47.086536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"264'273","reported_seq":843,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.735307+0000","last_change":"2024-09-14T11:38:18.735223+0000","last_active":"2024-09-14T11:38:18.735307+0000","last_peered":"2024-09-14T11:38:18.735307+0000","last_clean":"2024-09-14T11:38:18.735307+0000","last_became_active":"2024-09-14T10:56:12.849611+0000","last_became_peered":"2024-09-14T10:56:12.849611+0000","last_unstale":"2024-09-14T11:38:18.735307+0000","last_undegraded":"2024-09-14T11:38:18.735307+0000","last_fullsized":"2024-09-14T11:38:18.735307+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'273","last_scrub_stamp":"2024-09-14T11:38:18.735129+0000","last_deep_scrub":"264'273","last_deep_scrub_stamp":"2024-09-14T11:38:18.735129+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.735129+0000","objects_scrubbed":4,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:46.477399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71588,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":448,"num_read_kb":1104,"num_write":366,"num_write_kb":324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.770446+0000","last_change":"2024-09-14T11:38:27.770446+0000","last_active":"2024-09-14T11:38:27.770446+0000","last_peered":"2024-09-14T11:38:27.770446+0000","last_clean":"2024-09-14T11:38:27.770446+0000","last_became_active":"2024-09-14T10:56:14.858828+0000","last_became_peered":"2024-09-14T10:56:14.858828+0000","last_unstale":"2024-09-14T11:38:27.770446+0000","last_undegraded":"2024-09-14T11:38:27.770446+0000","last_fullsized":"2024-09-14T11:38:27.770446+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:27.770352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:27.770352+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.770352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:45:00.433642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"264'115","reported_seq":611,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.100737+0000","last_change":"2024-09-14T11:38:17.100737+0000","last_active":"2024-09-14T11:38:17.100737+0000","last_peered":"2024-09-14T11:38:17.100737+0000","last_clean":"2024-09-14T11:38:17.100737+0000","last_became_active":"2024-09-14T10:56:16.872047+0000","last_became_peered":"2024-09-14T10:56:16.872047+0000","last_unstale":"2024-09-14T11:38:17.100737+0000","last_undegraded":"2024-09-14T11:38:17.100737+0000","last_fullsized":"2024-09-14T11:38:17.100737+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'115","last_scrub_stamp":"2024-09-14T11:38:17.100644+0000","last_deep_scrub":"264'115","last_deep_scrub_stamp":"2024-09-14T11:38:17.100644+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.100644+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:15:44.325848+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":423,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":135,"num_read_kb":125,"num_write":295,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"264'94","reported_seq":689,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.211512+0000","last_change":"2024-09-14T11:38:04.211512+0000","last_active":"2024-09-14T11:38:04.211512+0000","last_peered":"2024-09-14T11:38:04.211512+0000","last_clean":"2024-09-14T11:38:04.211512+0000","last_became_active":"2024-09-14T10:56:08.845510+0000","last_became_peered":"2024-09-14T10:56:08.845510+0000","last_unstale":"2024-09-14T11:38:04.211512+0000","last_undegraded":"2024-09-14T11:38:04.211512+0000","last_fullsized":"2024-09-14T11:38:04.211512+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'94","last_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_deep_scrub":"264'94","last_deep_scrub_stamp":"2024-09-14T11:38:04.211394+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.211394+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:18:16.244988+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":449,"num_read_kb":381,"num_write":141,"num_write_kb":62,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"264'451","reported_seq":1164,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.971592+0000","last_change":"2024-09-14T11:38:04.971521+0000","last_active":"2024-09-14T11:38:04.971592+0000","last_peered":"2024-09-14T11:38:04.971592+0000","last_clean":"2024-09-14T11:38:04.971592+0000","last_became_active":"2024-09-14T10:56:06.838721+0000","last_became_peered":"2024-09-14T10:56:06.838721+0000","last_unstale":"2024-09-14T11:38:04.971592+0000","last_undegraded":"2024-09-14T11:38:04.971592+0000","last_fullsized":"2024-09-14T11:38:04.971592+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'451","last_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_deep_scrub":"264'451","last_deep_scrub_stamp":"2024-09-14T11:38:04.971423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.971423+0000","objects_scrubbed":3,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:29:55.099273+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":972,"num_read_kb":28710,"num_write":1673,"num_write_kb":37959,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.263432+0000","last_change":"2024-09-14T11:38:06.263318+0000","last_active":"2024-09-14T11:38:06.263432+0000","last_peered":"2024-09-14T11:38:06.263432+0000","last_clean":"2024-09-14T11:38:06.263432+0000","last_became_active":"2024-09-14T10:56:10.847441+0000","last_became_peered":"2024-09-14T10:56:10.847441+0000","last_unstale":"2024-09-14T11:38:06.263432+0000","last_undegraded":"2024-09-14T11:38:06.263432+0000","last_fullsized":"2024-09-14T11:38:06.263432+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.263219+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.263219+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:24:07.707286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"264'316","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.890125+0000","last_change":"2024-09-14T11:38:19.890125+0000","last_active":"2024-09-14T11:38:19.890125+0000","last_peered":"2024-09-14T11:38:19.890125+0000","last_clean":"2024-09-14T11:38:19.890125+0000","last_became_active":"2024-09-14T10:56:12.847158+0000","last_became_peered":"2024-09-14T10:56:12.847158+0000","last_unstale":"2024-09-14T11:38:19.890125+0000","last_undegraded":"2024-09-14T11:38:19.890125+0000","last_fullsized":"2024-09-14T11:38:19.890125+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:38:19.890027+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:38:19.890027+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.890027+0000","objects_scrubbed":9,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:47:32.306299+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50445,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":514,"num_read_kb":1159,"num_write":420,"num_write_kb":322,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"264'779","reported_seq":4232,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.082544+0000","last_change":"2024-09-14T11:38:21.082544+0000","last_active":"2024-09-14T11:38:21.082544+0000","last_peered":"2024-09-14T11:38:21.082544+0000","last_clean":"2024-09-14T11:38:21.082544+0000","last_became_active":"2024-09-14T10:56:14.862894+0000","last_became_peered":"2024-09-14T10:56:14.862894+0000","last_unstale":"2024-09-14T11:38:21.082544+0000","last_undegraded":"2024-09-14T11:38:21.082544+0000","last_fullsized":"2024-09-14T11:38:21.082544+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'779","last_scrub_stamp":"2024-09-14T11:38:21.082455+0000","last_deep_scrub":"264'779","last_deep_scrub_stamp":"2024-09-14T11:38:21.082455+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.082455+0000","objects_scrubbed":1,"log_size":78,"log_dups_size":701,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:36:06.177538+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"264'102","reported_seq":605,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.092340+0000","last_change":"2024-09-14T11:38:26.092340+0000","last_active":"2024-09-14T11:38:26.092340+0000","last_peered":"2024-09-14T11:38:26.092340+0000","last_clean":"2024-09-14T11:38:26.092340+0000","last_became_active":"2024-09-14T10:56:16.877588+0000","last_became_peered":"2024-09-14T10:56:16.877588+0000","last_unstale":"2024-09-14T11:38:26.092340+0000","last_undegraded":"2024-09-14T11:38:26.092340+0000","last_fullsized":"2024-09-14T11:38:26.092340+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'102","last_scrub_stamp":"2024-09-14T11:38:26.092240+0000","last_deep_scrub":"264'102","last_deep_scrub_stamp":"2024-09-14T11:38:26.092240+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.092240+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:17:03.281542+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1264,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":96,"num_read_kb":83,"num_write":217,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"264'203","reported_seq":802,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.128330+0000","last_change":"2024-09-14T11:38:04.128232+0000","last_active":"2024-09-14T11:38:04.128330+0000","last_peered":"2024-09-14T11:38:04.128330+0000","last_clean":"2024-09-14T11:38:04.128330+0000","last_became_active":"2024-09-14T10:56:08.839962+0000","last_became_peered":"2024-09-14T10:56:08.839962+0000","last_unstale":"2024-09-14T11:38:04.128330+0000","last_undegraded":"2024-09-14T11:38:04.128330+0000","last_fullsized":"2024-09-14T11:38:04.128330+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'203","last_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_deep_scrub":"264'203","last_deep_scrub_stamp":"2024-09-14T11:38:04.128119+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.128119+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:06.336903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":874,"num_read_kb":705,"num_write":313,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"264'318","reported_seq":950,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.011434+0000","last_change":"2024-09-14T11:37:58.011358+0000","last_active":"2024-09-14T11:37:58.011434+0000","last_peered":"2024-09-14T11:37:58.011434+0000","last_clean":"2024-09-14T11:37:58.011434+0000","last_became_active":"2024-09-14T10:56:06.827327+0000","last_became_peered":"2024-09-14T10:56:06.827327+0000","last_unstale":"2024-09-14T11:37:58.011434+0000","last_undegraded":"2024-09-14T11:37:58.011434+0000","last_fullsized":"2024-09-14T11:37:58.011434+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'318","last_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_deep_scrub":"264'318","last_deep_scrub_stamp":"2024-09-14T11:37:58.011270+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.011270+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":300,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:15.504722+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":558,"num_read_kb":39728,"num_write":960,"num_write_kb":9693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.272195+0000","last_change":"2024-09-14T11:38:07.272195+0000","last_active":"2024-09-14T11:38:07.272195+0000","last_peered":"2024-09-14T11:38:07.272195+0000","last_clean":"2024-09-14T11:38:07.272195+0000","last_became_active":"2024-09-14T10:56:10.851127+0000","last_became_peered":"2024-09-14T10:56:10.851127+0000","last_unstale":"2024-09-14T11:38:07.272195+0000","last_undegraded":"2024-09-14T11:38:07.272195+0000","last_fullsized":"2024-09-14T11:38:07.272195+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.272107+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.272107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:15.504235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"264'467","reported_seq":1097,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.068187+0000","last_change":"2024-09-14T11:38:14.068187+0000","last_active":"2024-09-14T11:38:14.068187+0000","last_peered":"2024-09-14T11:38:14.068187+0000","last_clean":"2024-09-14T11:38:14.068187+0000","last_became_active":"2024-09-14T10:56:12.850343+0000","last_became_peered":"2024-09-14T10:56:12.850343+0000","last_unstale":"2024-09-14T11:38:14.068187+0000","last_undegraded":"2024-09-14T11:38:14.068187+0000","last_fullsized":"2024-09-14T11:38:14.068187+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'467","last_scrub_stamp":"2024-09-14T11:38:14.068086+0000","last_deep_scrub":"264'467","last_deep_scrub_stamp":"2024-09-14T11:38:14.068086+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.068086+0000","objects_scrubbed":6,"log_size":67,"log_dups_size":400,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:43:09.633040+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":91900,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":808,"num_read_kb":1934,"num_write":662,"num_write_kb":560,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":494,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.264563+0000","last_change":"2024-09-14T11:38:12.264563+0000","last_active":"2024-09-14T11:38:12.264563+0000","last_peered":"2024-09-14T11:38:12.264563+0000","last_clean":"2024-09-14T11:38:12.264563+0000","last_became_active":"2024-09-14T10:56:14.860651+0000","last_became_peered":"2024-09-14T10:56:14.860651+0000","last_unstale":"2024-09-14T11:38:12.264563+0000","last_undegraded":"2024-09-14T11:38:12.264563+0000","last_fullsized":"2024-09-14T11:38:12.264563+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.264469+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.264469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:24:48.042054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"264'107","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.622819+0000","last_change":"2024-09-14T11:38:19.622819+0000","last_active":"2024-09-14T11:38:19.622819+0000","last_peered":"2024-09-14T11:38:19.622819+0000","last_clean":"2024-09-14T11:38:19.622819+0000","last_became_active":"2024-09-14T10:56:16.874002+0000","last_became_peered":"2024-09-14T10:56:16.874002+0000","last_unstale":"2024-09-14T11:38:19.622819+0000","last_undegraded":"2024-09-14T11:38:19.622819+0000","last_fullsized":"2024-09-14T11:38:19.622819+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'107","last_scrub_stamp":"2024-09-14T11:38:19.622715+0000","last_deep_scrub":"264'107","last_deep_scrub_stamp":"2024-09-14T11:38:19.622715+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.622715+0000","objects_scrubbed":1,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:36:32.552241+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":126,"num_read_kb":117,"num_write":227,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"264'257","reported_seq":901,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.818758+0000","last_change":"2024-09-14T11:38:01.818689+0000","last_active":"2024-09-14T11:38:01.818758+0000","last_peered":"2024-09-14T11:38:01.818758+0000","last_clean":"2024-09-14T11:38:01.818758+0000","last_became_active":"2024-09-14T10:56:08.839740+0000","last_became_peered":"2024-09-14T10:56:08.839740+0000","last_unstale":"2024-09-14T11:38:01.818758+0000","last_undegraded":"2024-09-14T11:38:01.818758+0000","last_fullsized":"2024-09-14T11:38:01.818758+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'257","last_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_deep_scrub":"264'257","last_deep_scrub_stamp":"2024-09-14T11:38:01.818609+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.818609+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":200,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:33:14.995103+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1086,"num_read_kb":881,"num_write":396,"num_write_kb":184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"264'339","reported_seq":954,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.801331+0000","last_change":"2024-09-14T11:37:56.801227+0000","last_active":"2024-09-14T11:37:56.801331+0000","last_peered":"2024-09-14T11:37:56.801331+0000","last_clean":"2024-09-14T11:37:56.801331+0000","last_became_active":"2024-09-14T10:56:06.831509+0000","last_became_peered":"2024-09-14T10:56:06.831509+0000","last_unstale":"2024-09-14T11:37:56.801331+0000","last_undegraded":"2024-09-14T11:37:56.801331+0000","last_fullsized":"2024-09-14T11:37:56.801331+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'339","last_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_deep_scrub":"264'339","last_deep_scrub_stamp":"2024-09-14T11:37:56.801100+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.801100+0000","objects_scrubbed":8,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:54:49.585646+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3311779,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":517,"num_read_kb":5559,"num_write":1004,"num_write_kb":39683,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":502,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.269231+0000","last_change":"2024-09-14T11:38:09.269139+0000","last_active":"2024-09-14T11:38:09.269231+0000","last_peered":"2024-09-14T11:38:09.269231+0000","last_clean":"2024-09-14T11:38:09.269231+0000","last_became_active":"2024-09-14T10:56:10.850850+0000","last_became_peered":"2024-09-14T10:56:10.850850+0000","last_unstale":"2024-09-14T11:38:09.269231+0000","last_undegraded":"2024-09-14T11:38:09.269231+0000","last_fullsized":"2024-09-14T11:38:09.269231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.269043+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.269043+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:19.458046+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"264'284","reported_seq":868,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.735799+0000","last_change":"2024-09-14T11:38:19.735737+0000","last_active":"2024-09-14T11:38:19.735799+0000","last_peered":"2024-09-14T11:38:19.735799+0000","last_clean":"2024-09-14T11:38:19.735799+0000","last_became_active":"2024-09-14T10:56:12.851326+0000","last_became_peered":"2024-09-14T10:56:12.851326+0000","last_unstale":"2024-09-14T11:38:19.735799+0000","last_undegraded":"2024-09-14T11:38:19.735799+0000","last_fullsized":"2024-09-14T11:38:19.735799+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'284","last_scrub_stamp":"2024-09-14T11:38:19.735634+0000","last_deep_scrub":"264'284","last_deep_scrub_stamp":"2024-09-14T11:38:19.735634+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.735634+0000","objects_scrubbed":6,"log_size":84,"log_dups_size":200,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:30:56.780179+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43790,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":481,"num_read_kb":1041,"num_write":430,"num_write_kb":351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.117372+0000","last_change":"2024-09-14T11:38:22.117306+0000","last_active":"2024-09-14T11:38:22.117372+0000","last_peered":"2024-09-14T11:38:22.117372+0000","last_clean":"2024-09-14T11:38:22.117372+0000","last_became_active":"2024-09-14T10:56:14.861957+0000","last_became_peered":"2024-09-14T10:56:14.861957+0000","last_unstale":"2024-09-14T11:38:22.117372+0000","last_undegraded":"2024-09-14T11:38:22.117372+0000","last_fullsized":"2024-09-14T11:38:22.117372+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.117215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.117215+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.117215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:27:53.881289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"264'109","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:31.752084+0000","last_change":"2024-09-14T11:38:31.752084+0000","last_active":"2024-09-14T11:38:31.752084+0000","last_peered":"2024-09-14T11:38:31.752084+0000","last_clean":"2024-09-14T11:38:31.752084+0000","last_became_active":"2024-09-14T10:56:16.877031+0000","last_became_peered":"2024-09-14T10:56:16.877031+0000","last_unstale":"2024-09-14T11:38:31.752084+0000","last_undegraded":"2024-09-14T11:38:31.752084+0000","last_fullsized":"2024-09-14T11:38:31.752084+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'109","last_scrub_stamp":"2024-09-14T11:38:31.751994+0000","last_deep_scrub":"264'109","last_deep_scrub_stamp":"2024-09-14T11:38:31.751994+0000","last_clean_scrub_stamp":"2024-09-14T11:38:31.751994+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:53:48.273036+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":184,"num_read_kb":157,"num_write":251,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"264'105","reported_seq":722,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.801548+0000","last_change":"2024-09-14T11:38:02.801454+0000","last_active":"2024-09-14T11:38:02.801548+0000","last_peered":"2024-09-14T11:38:02.801548+0000","last_clean":"2024-09-14T11:38:02.801548+0000","last_became_active":"2024-09-14T10:56:08.839934+0000","last_became_peered":"2024-09-14T10:56:08.839934+0000","last_unstale":"2024-09-14T11:38:02.801548+0000","last_undegraded":"2024-09-14T11:38:02.801548+0000","last_fullsized":"2024-09-14T11:38:02.801548+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'105","last_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_deep_scrub":"264'105","last_deep_scrub_stamp":"2024-09-14T11:38:02.801328+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.801328+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:52.213904+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":486,"num_read_kb":412,"num_write":145,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"264'384","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.201690+0000","last_change":"2024-09-14T11:37:56.201690+0000","last_active":"2024-09-14T11:37:56.201690+0000","last_peered":"2024-09-14T11:37:56.201690+0000","last_clean":"2024-09-14T11:37:56.201690+0000","last_became_active":"2024-09-14T10:56:06.833718+0000","last_became_peered":"2024-09-14T10:56:06.833718+0000","last_unstale":"2024-09-14T11:37:56.201690+0000","last_undegraded":"2024-09-14T11:37:56.201690+0000","last_fullsized":"2024-09-14T11:37:56.201690+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'384","last_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_deep_scrub":"264'384","last_deep_scrub_stamp":"2024-09-14T11:37:56.201429+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.201429+0000","objects_scrubbed":12,"log_size":84,"log_dups_size":300,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:23:20.816954+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":626,"num_read_kb":12205,"num_write":1169,"num_write_kb":24943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.514772+0000","last_change":"2024-09-14T11:38:06.514696+0000","last_active":"2024-09-14T11:38:06.514772+0000","last_peered":"2024-09-14T11:38:06.514772+0000","last_clean":"2024-09-14T11:38:06.514772+0000","last_became_active":"2024-09-14T10:56:10.851715+0000","last_became_peered":"2024-09-14T10:56:10.851715+0000","last_unstale":"2024-09-14T11:38:06.514772+0000","last_undegraded":"2024-09-14T11:38:06.514772+0000","last_fullsized":"2024-09-14T11:38:06.514772+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:06.514607+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.514607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:16:54.514163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"264'297","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.303361+0000","last_change":"2024-09-14T11:38:08.303289+0000","last_active":"2024-09-14T11:38:08.303361+0000","last_peered":"2024-09-14T11:38:08.303361+0000","last_clean":"2024-09-14T11:38:08.303361+0000","last_became_active":"2024-09-14T10:56:12.856486+0000","last_became_peered":"2024-09-14T10:56:12.856486+0000","last_unstale":"2024-09-14T11:38:08.303361+0000","last_undegraded":"2024-09-14T11:38:08.303361+0000","last_fullsized":"2024-09-14T11:38:08.303361+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:38:08.303187+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.303187+0000","objects_scrubbed":7,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:57:25.035256+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43909,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":506,"num_read_kb":1133,"num_write":410,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"264'727","reported_seq":2203,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.270150+0000","last_change":"2024-09-14T11:38:13.270091+0000","last_active":"2024-09-14T11:38:13.270150+0000","last_peered":"2024-09-14T11:38:13.270150+0000","last_clean":"2024-09-14T11:38:13.270150+0000","last_became_active":"2024-09-14T10:56:14.866121+0000","last_became_peered":"2024-09-14T10:56:14.866121+0000","last_unstale":"2024-09-14T11:38:13.270150+0000","last_undegraded":"2024-09-14T11:38:13.270150+0000","last_fullsized":"2024-09-14T11:38:13.270150+0000","mapping_epoch":31,"log_start":"264'701","ondisk_log_start":"264'701","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'727","last_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_deep_scrub":"264'727","last_deep_scrub_stamp":"2024-09-14T11:38:13.270000+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.270000+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":701,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:03.387188+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"264'142","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.555338+0000","last_change":"2024-09-14T11:38:17.555338+0000","last_active":"2024-09-14T11:38:17.555338+0000","last_peered":"2024-09-14T11:38:17.555338+0000","last_clean":"2024-09-14T11:38:17.555338+0000","last_became_active":"2024-09-14T10:56:16.872949+0000","last_became_peered":"2024-09-14T10:56:16.872949+0000","last_unstale":"2024-09-14T11:38:17.555338+0000","last_undegraded":"2024-09-14T11:38:17.555338+0000","last_fullsized":"2024-09-14T11:38:17.555338+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:38:17.555233+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:38:17.555233+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.555233+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:17:42.328664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1681,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":332,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"264'173","reported_seq":790,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.829070+0000","last_change":"2024-09-14T11:38:04.828980+0000","last_active":"2024-09-14T11:38:04.829070+0000","last_peered":"2024-09-14T11:38:04.829070+0000","last_clean":"2024-09-14T11:38:04.829070+0000","last_became_active":"2024-09-14T10:56:08.843152+0000","last_became_peered":"2024-09-14T10:56:08.843152+0000","last_unstale":"2024-09-14T11:38:04.829070+0000","last_undegraded":"2024-09-14T11:38:04.829070+0000","last_fullsized":"2024-09-14T11:38:04.829070+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'173","last_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_deep_scrub":"264'173","last_deep_scrub_stamp":"2024-09-14T11:38:04.828885+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.828885+0000","objects_scrubbed":1,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:27:49.181800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":773,"num_read_kb":634,"num_write":271,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"264'330","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.801255+0000","last_change":"2024-09-14T11:37:55.801255+0000","last_active":"2024-09-14T11:37:55.801255+0000","last_peered":"2024-09-14T11:37:55.801255+0000","last_clean":"2024-09-14T11:37:55.801255+0000","last_became_active":"2024-09-14T10:56:06.830388+0000","last_became_peered":"2024-09-14T10:56:06.830388+0000","last_unstale":"2024-09-14T11:37:55.801255+0000","last_undegraded":"2024-09-14T11:37:55.801255+0000","last_fullsized":"2024-09-14T11:37:55.801255+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'330","last_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_deep_scrub":"264'330","last_deep_scrub_stamp":"2024-09-14T11:37:55.801142+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.801142+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":300,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:56:31.011642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":478,"num_read_kb":8777,"num_write":1001,"num_write_kb":36076,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"264'4","reported_seq":1453,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.923149+0000","last_change":"2024-09-14T11:38:16.923095+0000","last_active":"2024-09-14T11:38:16.923149+0000","last_peered":"2024-09-14T11:38:16.923149+0000","last_clean":"2024-09-14T11:38:16.923149+0000","last_became_active":"2024-09-14T10:56:10.848847+0000","last_became_peered":"2024-09-14T10:56:10.848847+0000","last_unstale":"2024-09-14T11:38:16.923149+0000","last_undegraded":"2024-09-14T11:38:16.923149+0000","last_fullsized":"2024-09-14T11:38:16.923149+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:38:16.923004+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:38:16.923004+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.923004+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:09:36.332168+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":952,"num_read_kb":952,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"264'83","reported_seq":602,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.741060+0000","last_change":"2024-09-14T11:38:19.740937+0000","last_active":"2024-09-14T11:38:19.741060+0000","last_peered":"2024-09-14T11:38:19.741060+0000","last_clean":"2024-09-14T11:38:19.741060+0000","last_became_active":"2024-09-14T10:56:13.040895+0000","last_became_peered":"2024-09-14T10:56:13.040895+0000","last_unstale":"2024-09-14T11:38:19.741060+0000","last_undegraded":"2024-09-14T11:38:19.741060+0000","last_fullsized":"2024-09-14T11:38:19.741060+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'83","last_scrub_stamp":"2024-09-14T11:38:19.740836+0000","last_deep_scrub":"264'83","last_deep_scrub_stamp":"2024-09-14T11:38:19.740836+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.740836+0000","objects_scrubbed":5,"log_size":83,"log_dups_size":0,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:02:48.023795+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":78,"num_read_kb":72,"num_write":54,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"264'753","reported_seq":2183,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.096548+0000","last_change":"2024-09-14T11:38:13.096488+0000","last_active":"2024-09-14T11:38:13.096548+0000","last_peered":"2024-09-14T11:38:13.096548+0000","last_clean":"2024-09-14T11:38:13.096548+0000","last_became_active":"2024-09-14T10:56:14.868665+0000","last_became_peered":"2024-09-14T10:56:14.868665+0000","last_unstale":"2024-09-14T11:38:13.096548+0000","last_undegraded":"2024-09-14T11:38:13.096548+0000","last_fullsized":"2024-09-14T11:38:13.096548+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'753","last_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_deep_scrub":"264'753","last_deep_scrub_stamp":"2024-09-14T11:38:13.096403+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.096403+0000","objects_scrubbed":1,"log_size":53,"log_dups_size":700,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:32:34.180002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"264'150","reported_seq":662,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.765041+0000","last_change":"2024-09-14T11:38:27.765041+0000","last_active":"2024-09-14T11:38:27.765041+0000","last_peered":"2024-09-14T11:38:27.765041+0000","last_clean":"2024-09-14T11:38:27.765041+0000","last_became_active":"2024-09-14T10:56:16.870592+0000","last_became_peered":"2024-09-14T10:56:16.870592+0000","last_unstale":"2024-09-14T11:38:27.765041+0000","last_undegraded":"2024-09-14T11:38:27.765041+0000","last_fullsized":"2024-09-14T11:38:27.765041+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'150","last_scrub_stamp":"2024-09-14T11:38:27.764956+0000","last_deep_scrub":"264'150","last_deep_scrub_stamp":"2024-09-14T11:38:27.764956+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.764956+0000","objects_scrubbed":1,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:31:47.323277+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":202,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":159,"num_read_kb":143,"num_write":349,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"264'626","reported_seq":1474,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.531754+0000","last_change":"2024-09-14T11:38:02.531675+0000","last_active":"2024-09-14T11:38:02.531754+0000","last_peered":"2024-09-14T11:38:02.531754+0000","last_clean":"2024-09-14T11:38:02.531754+0000","last_became_active":"2024-09-14T10:56:08.838946+0000","last_became_peered":"2024-09-14T10:56:08.838946+0000","last_unstale":"2024-09-14T11:38:02.531754+0000","last_undegraded":"2024-09-14T11:38:02.531754+0000","last_fullsized":"2024-09-14T11:38:02.531754+0000","mapping_epoch":25,"log_start":"264'600","ondisk_log_start":"264'600","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'626","last_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_deep_scrub":"264'626","last_deep_scrub_stamp":"2024-09-14T11:38:02.531585+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.531585+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":600,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:49.257771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3071,"num_read_kb":2592,"num_write":1075,"num_write_kb":686,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25760,"num_omap_keys":101,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"264'395","reported_seq":1169,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.842500+0000","last_change":"2024-09-14T11:37:54.842500+0000","last_active":"2024-09-14T11:37:54.842500+0000","last_peered":"2024-09-14T11:37:54.842500+0000","last_clean":"2024-09-14T11:37:54.842500+0000","last_became_active":"2024-09-14T10:56:06.822607+0000","last_became_peered":"2024-09-14T10:56:06.822607+0000","last_unstale":"2024-09-14T11:37:54.842500+0000","last_undegraded":"2024-09-14T11:37:54.842500+0000","last_fullsized":"2024-09-14T11:37:54.842500+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:54.842395+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.842395+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:07:06.443569+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1140,"num_read_kb":48198,"num_write":1212,"num_write_kb":22187,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":507,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.762416+0000","last_change":"2024-09-14T11:38:15.762326+0000","last_active":"2024-09-14T11:38:15.762416+0000","last_peered":"2024-09-14T11:38:15.762416+0000","last_clean":"2024-09-14T11:38:15.762416+0000","last_became_active":"2024-09-14T10:56:10.849280+0000","last_became_peered":"2024-09-14T10:56:10.849280+0000","last_unstale":"2024-09-14T11:38:15.762416+0000","last_undegraded":"2024-09-14T11:38:15.762416+0000","last_fullsized":"2024-09-14T11:38:15.762416+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.762229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.762229+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.762229+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:13.575149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"264'357","reported_seq":962,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.896744+0000","last_change":"2024-09-14T11:38:20.896677+0000","last_active":"2024-09-14T11:38:20.896744+0000","last_peered":"2024-09-14T11:38:20.896744+0000","last_clean":"2024-09-14T11:38:20.896744+0000","last_became_active":"2024-09-14T10:56:12.853486+0000","last_became_peered":"2024-09-14T10:56:12.853486+0000","last_unstale":"2024-09-14T11:38:20.896744+0000","last_undegraded":"2024-09-14T11:38:20.896744+0000","last_fullsized":"2024-09-14T11:38:20.896744+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:38:20.896588+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:38:20.896588+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.896588+0000","objects_scrubbed":9,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:51:51.367045+0000","scrub_duration":12,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46246,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1178,"num_read_kb":1754,"num_write":1698,"num_write_kb":1562,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":516250,"num_omap_keys":1186,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.096760+0000","last_change":"2024-09-14T11:38:12.096682+0000","last_active":"2024-09-14T11:38:12.096760+0000","last_peered":"2024-09-14T11:38:12.096760+0000","last_clean":"2024-09-14T11:38:12.096760+0000","last_became_active":"2024-09-14T10:56:14.865480+0000","last_became_peered":"2024-09-14T10:56:14.865480+0000","last_unstale":"2024-09-14T11:38:12.096760+0000","last_undegraded":"2024-09-14T11:38:12.096760+0000","last_fullsized":"2024-09-14T11:38:12.096760+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.096566+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.096566+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:12:07.924703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"264'145","reported_seq":648,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.595814+0000","last_change":"2024-09-14T11:38:18.595814+0000","last_active":"2024-09-14T11:38:18.595814+0000","last_peered":"2024-09-14T11:38:18.595814+0000","last_clean":"2024-09-14T11:38:18.595814+0000","last_became_active":"2024-09-14T10:56:16.874668+0000","last_became_peered":"2024-09-14T10:56:16.874668+0000","last_unstale":"2024-09-14T11:38:18.595814+0000","last_undegraded":"2024-09-14T11:38:18.595814+0000","last_fullsized":"2024-09-14T11:38:18.595814+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'145","last_scrub_stamp":"2024-09-14T11:38:18.595731+0000","last_deep_scrub":"264'145","last_deep_scrub_stamp":"2024-09-14T11:38:18.595731+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.595731+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:54.957071+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":170,"num_read_kb":161,"num_write":344,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"264'521","reported_seq":1130,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.215568+0000","last_change":"2024-09-14T11:38:03.215568+0000","last_active":"2024-09-14T11:38:03.215568+0000","last_peered":"2024-09-14T11:38:03.215568+0000","last_clean":"2024-09-14T11:38:03.215568+0000","last_became_active":"2024-09-14T10:56:08.844943+0000","last_became_peered":"2024-09-14T10:56:08.844943+0000","last_unstale":"2024-09-14T11:38:03.215568+0000","last_undegraded":"2024-09-14T11:38:03.215568+0000","last_fullsized":"2024-09-14T11:38:03.215568+0000","mapping_epoch":25,"log_start":"264'500","ondisk_log_start":"264'500","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'521","last_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_deep_scrub":"264'521","last_deep_scrub_stamp":"2024-09-14T11:38:03.215480+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.215480+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":500,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:57:27.895596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2257,"num_read_kb":1922,"num_write":906,"num_write_kb":451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"264'74","reported_seq":614,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.940021+0000","last_change":"2024-09-14T11:37:55.940021+0000","last_active":"2024-09-14T11:37:55.940021+0000","last_peered":"2024-09-14T11:37:55.940021+0000","last_clean":"2024-09-14T11:37:55.940021+0000","last_became_active":"2024-09-14T10:55:50.532866+0000","last_became_peered":"2024-09-14T10:55:50.532866+0000","last_unstale":"2024-09-14T11:37:55.940021+0000","last_undegraded":"2024-09-14T11:37:55.940021+0000","last_fullsized":"2024-09-14T11:37:55.940021+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:37:55.939912+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.939912+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:45.966314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"264'2","reported_seq":523,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.962629+0000","last_change":"2024-09-14T11:37:56.962629+0000","last_active":"2024-09-14T11:37:56.962629+0000","last_peered":"2024-09-14T11:37:56.962629+0000","last_clean":"2024-09-14T11:37:56.962629+0000","last_became_active":"2024-09-14T10:55:56.784316+0000","last_became_peered":"2024-09-14T10:55:56.784316+0000","last_unstale":"2024-09-14T11:37:56.962629+0000","last_undegraded":"2024-09-14T11:37:56.962629+0000","last_fullsized":"2024-09-14T11:37:56.962629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:37:56.962512+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.962512+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:33:33.102357+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00040790800000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"264'336","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.833750+0000","last_change":"2024-09-14T11:37:53.833750+0000","last_active":"2024-09-14T11:37:53.833750+0000","last_peered":"2024-09-14T11:37:53.833750+0000","last_clean":"2024-09-14T11:37:53.833750+0000","last_became_active":"2024-09-14T10:56:06.824296+0000","last_became_peered":"2024-09-14T10:56:06.824296+0000","last_unstale":"2024-09-14T11:37:53.833750+0000","last_undegraded":"2024-09-14T11:37:53.833750+0000","last_fullsized":"2024-09-14T11:37:53.833750+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'336","last_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_deep_scrub":"264'336","last_deep_scrub_stamp":"2024-09-14T11:37:53.833659+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.833659+0000","objects_scrubbed":4,"log_size":36,"log_dups_size":300,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:56:56.404049+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515583,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":634,"num_read_kb":14631,"num_write":972,"num_write_kb":35410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.952690+0000","last_change":"2024-09-14T11:38:13.952690+0000","last_active":"2024-09-14T11:38:13.952690+0000","last_peered":"2024-09-14T11:38:13.952690+0000","last_clean":"2024-09-14T11:38:13.952690+0000","last_became_active":"2024-09-14T10:56:10.847147+0000","last_became_peered":"2024-09-14T10:56:10.847147+0000","last_unstale":"2024-09-14T11:38:13.952690+0000","last_undegraded":"2024-09-14T11:38:13.952690+0000","last_fullsized":"2024-09-14T11:38:13.952690+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:13.952561+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.952561+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:20:45.651254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"264'735","reported_seq":1437,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.888105+0000","last_change":"2024-09-14T11:38:18.888105+0000","last_active":"2024-09-14T11:38:18.888105+0000","last_peered":"2024-09-14T11:38:18.888105+0000","last_clean":"2024-09-14T11:38:18.888105+0000","last_became_active":"2024-09-14T10:56:12.853371+0000","last_became_peered":"2024-09-14T10:56:12.853371+0000","last_unstale":"2024-09-14T11:38:18.888105+0000","last_undegraded":"2024-09-14T11:38:18.888105+0000","last_fullsized":"2024-09-14T11:38:18.888105+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'735","last_scrub_stamp":"2024-09-14T11:38:18.888016+0000","last_deep_scrub":"264'735","last_deep_scrub_stamp":"2024-09-14T11:38:18.888016+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.888016+0000","objects_scrubbed":6,"log_size":35,"log_dups_size":700,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:01:05.221845+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":143536,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1412,"num_read_kb":3246,"num_write":1300,"num_write_kb":1139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89606,"num_omap_keys":214,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.073078+0000","last_change":"2024-09-14T11:38:20.073078+0000","last_active":"2024-09-14T11:38:20.073078+0000","last_peered":"2024-09-14T11:38:20.073078+0000","last_clean":"2024-09-14T11:38:20.073078+0000","last_became_active":"2024-09-14T10:56:14.866577+0000","last_became_peered":"2024-09-14T10:56:14.866577+0000","last_unstale":"2024-09-14T11:38:20.073078+0000","last_undegraded":"2024-09-14T11:38:20.073078+0000","last_fullsized":"2024-09-14T11:38:20.073078+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:20.072985+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:20.072985+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.072985+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:49:47.722256+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"264'196","reported_seq":892,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.132211+0000","last_change":"2024-09-14T11:38:19.132211+0000","last_active":"2024-09-14T11:38:19.132211+0000","last_peered":"2024-09-14T11:38:19.132211+0000","last_clean":"2024-09-14T11:38:19.132211+0000","last_became_active":"2024-09-14T10:56:16.871756+0000","last_became_peered":"2024-09-14T10:56:16.871756+0000","last_unstale":"2024-09-14T11:38:19.132211+0000","last_undegraded":"2024-09-14T11:38:19.132211+0000","last_fullsized":"2024-09-14T11:38:19.132211+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-14T11:38:19.132128+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-14T11:38:19.132128+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.132128+0000","objects_scrubbed":2,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:06:36.839740+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":420,"num_read_kb":417,"num_write":391,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"264'189","reported_seq":860,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.105067+0000","last_change":"2024-09-14T11:38:02.105067+0000","last_active":"2024-09-14T11:38:02.105067+0000","last_peered":"2024-09-14T11:38:02.105067+0000","last_clean":"2024-09-14T11:38:02.105067+0000","last_became_active":"2024-09-14T10:56:08.839285+0000","last_became_peered":"2024-09-14T10:56:08.839285+0000","last_unstale":"2024-09-14T11:38:02.105067+0000","last_undegraded":"2024-09-14T11:38:02.105067+0000","last_fullsized":"2024-09-14T11:38:02.105067+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'189","last_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_deep_scrub":"264'189","last_deep_scrub_stamp":"2024-09-14T11:38:02.104979+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.104979+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:18:48.803647+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":945,"num_read_kb":815,"num_write":309,"num_write_kb":173,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":466,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":520,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.930011+0000","last_change":"2024-09-14T11:38:00.929927+0000","last_active":"2024-09-14T11:38:00.930011+0000","last_peered":"2024-09-14T11:38:00.930011+0000","last_clean":"2024-09-14T11:38:00.930011+0000","last_became_active":"2024-09-14T10:55:56.786981+0000","last_became_peered":"2024-09-14T10:55:56.786981+0000","last_unstale":"2024-09-14T11:38:00.930011+0000","last_undegraded":"2024-09-14T11:38:00.930011+0000","last_fullsized":"2024-09-14T11:38:00.930011+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:00.929792+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.929792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:34:40.514471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040246500000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"264'398","reported_seq":1098,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.259139+0000","last_change":"2024-09-14T11:37:52.259139+0000","last_active":"2024-09-14T11:37:52.259139+0000","last_peered":"2024-09-14T11:37:52.259139+0000","last_clean":"2024-09-14T11:37:52.259139+0000","last_became_active":"2024-09-14T10:56:06.832859+0000","last_became_peered":"2024-09-14T10:56:06.832859+0000","last_unstale":"2024-09-14T11:37:52.259139+0000","last_undegraded":"2024-09-14T11:37:52.259139+0000","last_fullsized":"2024-09-14T11:37:52.259139+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'398","last_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_deep_scrub":"264'398","last_deep_scrub_stamp":"2024-09-14T11:37:52.259071+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.259071+0000","objects_scrubbed":3,"log_size":98,"log_dups_size":300,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:23:58.652972+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":799,"num_read_kb":83524,"num_write":1261,"num_write_kb":34937,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"264'6","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.954241+0000","last_change":"2024-09-14T11:38:13.954241+0000","last_active":"2024-09-14T11:38:13.954241+0000","last_peered":"2024-09-14T11:38:13.954241+0000","last_clean":"2024-09-14T11:38:13.954241+0000","last_became_active":"2024-09-14T10:56:10.848582+0000","last_became_peered":"2024-09-14T10:56:10.848582+0000","last_unstale":"2024-09-14T11:38:13.954241+0000","last_undegraded":"2024-09-14T11:38:13.954241+0000","last_fullsized":"2024-09-14T11:38:13.954241+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'6","last_scrub_stamp":"2024-09-14T11:38:13.954162+0000","last_deep_scrub":"264'6","last_deep_scrub_stamp":"2024-09-14T11:38:13.954162+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.954162+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:46.433894+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":726,"num_read_kb":1189,"num_write":10,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"264'1245","reported_seq":2684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.546235+0000","last_change":"2024-09-14T11:38:12.546235+0000","last_active":"2024-09-14T11:38:12.546235+0000","last_peered":"2024-09-14T11:38:12.546235+0000","last_clean":"2024-09-14T11:38:12.546235+0000","last_became_active":"2024-09-14T10:56:12.856172+0000","last_became_peered":"2024-09-14T10:56:12.856172+0000","last_unstale":"2024-09-14T11:38:12.546235+0000","last_undegraded":"2024-09-14T11:38:12.546235+0000","last_fullsized":"2024-09-14T11:38:12.546235+0000","mapping_epoch":29,"log_start":"264'1200","ondisk_log_start":"264'1200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'1245","last_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_deep_scrub":"264'1245","last_deep_scrub_stamp":"2024-09-14T11:38:12.546141+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.546141+0000","objects_scrubbed":12,"log_size":45,"log_dups_size":1200,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:30:57.448650+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138368,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1980,"num_read_kb":3690,"num_write":1076,"num_write_kb":906,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.864388+0000","last_change":"2024-09-14T11:38:22.864388+0000","last_active":"2024-09-14T11:38:22.864388+0000","last_peered":"2024-09-14T11:38:22.864388+0000","last_clean":"2024-09-14T11:38:22.864388+0000","last_became_active":"2024-09-14T10:56:14.860465+0000","last_became_peered":"2024-09-14T10:56:14.860465+0000","last_unstale":"2024-09-14T11:38:22.864388+0000","last_undegraded":"2024-09-14T11:38:22.864388+0000","last_fullsized":"2024-09-14T11:38:22.864388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:22.864302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:22.864302+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.864302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:46.032081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"264'244","reported_seq":776,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.641925+0000","last_change":"2024-09-14T11:38:20.641925+0000","last_active":"2024-09-14T11:38:20.641925+0000","last_peered":"2024-09-14T11:38:20.641925+0000","last_clean":"2024-09-14T11:38:20.641925+0000","last_became_active":"2024-09-14T10:56:16.875695+0000","last_became_peered":"2024-09-14T10:56:16.875695+0000","last_unstale":"2024-09-14T11:38:20.641925+0000","last_undegraded":"2024-09-14T11:38:20.641925+0000","last_fullsized":"2024-09-14T11:38:20.641925+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'244","last_scrub_stamp":"2024-09-14T11:38:20.641827+0000","last_deep_scrub":"264'244","last_deep_scrub_stamp":"2024-09-14T11:38:20.641827+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.641827+0000","objects_scrubbed":4,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:15:24.991277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":373,"num_read_kb":365,"num_write":532,"num_write_kb":152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"264'342","reported_seq":957,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.328415+0000","last_change":"2024-09-14T11:37:59.328415+0000","last_active":"2024-09-14T11:37:59.328415+0000","last_peered":"2024-09-14T11:37:59.328415+0000","last_clean":"2024-09-14T11:37:59.328415+0000","last_became_active":"2024-09-14T10:56:42.661852+0000","last_became_peered":"2024-09-14T10:56:42.661852+0000","last_unstale":"2024-09-14T11:37:59.328415+0000","last_undegraded":"2024-09-14T11:37:59.328415+0000","last_fullsized":"2024-09-14T11:37:59.328415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'342","last_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_deep_scrub":"264'342","last_deep_scrub_stamp":"2024-09-14T11:37:59.328313+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.328313+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":300,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:45:28.847997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1492,"num_read_kb":1194,"num_write":577,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.287608+0000","last_change":"2024-09-14T11:37:53.287608+0000","last_active":"2024-09-14T11:37:53.287608+0000","last_peered":"2024-09-14T11:37:53.287608+0000","last_clean":"2024-09-14T11:37:53.287608+0000","last_became_active":"2024-09-14T10:55:56.864641+0000","last_became_peered":"2024-09-14T10:55:56.864641+0000","last_unstale":"2024-09-14T11:37:53.287608+0000","last_undegraded":"2024-09-14T11:37:53.287608+0000","last_fullsized":"2024-09-14T11:37:53.287608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.287533+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.287533+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:08.352515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00032551999999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"264'364","reported_seq":1047,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:52.503709+0000","last_change":"2024-09-14T11:37:52.503608+0000","last_active":"2024-09-14T11:37:52.503709+0000","last_peered":"2024-09-14T11:37:52.503709+0000","last_clean":"2024-09-14T11:37:52.503709+0000","last_became_active":"2024-09-14T10:56:06.820565+0000","last_became_peered":"2024-09-14T10:56:06.820565+0000","last_unstale":"2024-09-14T11:37:52.503709+0000","last_undegraded":"2024-09-14T11:37:52.503709+0000","last_fullsized":"2024-09-14T11:37:52.503709+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:52.503516+0000","last_clean_scrub_stamp":"2024-09-14T11:37:52.503516+0000","objects_scrubbed":3,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:31.493522+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":61657,"num_write":1199,"num_write_kb":44544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"264'2","reported_seq":504,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.245866+0000","last_change":"2024-09-14T11:38:04.245866+0000","last_active":"2024-09-14T11:38:04.245866+0000","last_peered":"2024-09-14T11:38:04.245866+0000","last_clean":"2024-09-14T11:38:04.245866+0000","last_became_active":"2024-09-14T10:56:10.851702+0000","last_became_peered":"2024-09-14T10:56:10.851702+0000","last_unstale":"2024-09-14T11:38:04.245866+0000","last_undegraded":"2024-09-14T11:38:04.245866+0000","last_fullsized":"2024-09-14T11:38:04.245866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:04.245779+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.245779+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:03:30.323128+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"264'224","reported_seq":1266,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.905401+0000","last_change":"2024-09-14T11:38:17.905401+0000","last_active":"2024-09-14T11:38:17.905401+0000","last_peered":"2024-09-14T11:38:17.905401+0000","last_clean":"2024-09-14T11:38:17.905401+0000","last_became_active":"2024-09-14T10:56:13.041379+0000","last_became_peered":"2024-09-14T10:56:13.041379+0000","last_unstale":"2024-09-14T11:38:17.905401+0000","last_undegraded":"2024-09-14T11:38:17.905401+0000","last_fullsized":"2024-09-14T11:38:17.905401+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'224","last_scrub_stamp":"2024-09-14T11:38:17.905265+0000","last_deep_scrub":"264'224","last_deep_scrub_stamp":"2024-09-14T11:38:17.905265+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.905265+0000","objects_scrubbed":9,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:08:17.873901+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":490,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:19.026536+0000","last_change":"2024-09-14T11:38:19.026536+0000","last_active":"2024-09-14T11:38:19.026536+0000","last_peered":"2024-09-14T11:38:19.026536+0000","last_clean":"2024-09-14T11:38:19.026536+0000","last_became_active":"2024-09-14T10:56:14.868816+0000","last_became_peered":"2024-09-14T10:56:14.868816+0000","last_unstale":"2024-09-14T11:38:19.026536+0000","last_undegraded":"2024-09-14T11:38:19.026536+0000","last_fullsized":"2024-09-14T11:38:19.026536+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:19.026445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:19.026445+0000","last_clean_scrub_stamp":"2024-09-14T11:38:19.026445+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:18:34.029834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"264'260","reported_seq":859,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.742337+0000","last_change":"2024-09-14T11:38:30.742271+0000","last_active":"2024-09-14T11:38:30.742337+0000","last_peered":"2024-09-14T11:38:30.742337+0000","last_clean":"2024-09-14T11:38:30.742337+0000","last_became_active":"2024-09-14T10:56:16.878661+0000","last_became_peered":"2024-09-14T10:56:16.878661+0000","last_unstale":"2024-09-14T11:38:30.742337+0000","last_undegraded":"2024-09-14T11:38:30.742337+0000","last_fullsized":"2024-09-14T11:38:30.742337+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'260","last_scrub_stamp":"2024-09-14T11:38:30.742182+0000","last_deep_scrub":"264'260","last_deep_scrub_stamp":"2024-09-14T11:38:30.742182+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.742182+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:14.028319+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":484,"num_read_kb":509,"num_write":573,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"264'178","reported_seq":797,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.489283+0000","last_change":"2024-09-14T11:38:01.489283+0000","last_active":"2024-09-14T11:38:01.489283+0000","last_peered":"2024-09-14T11:38:01.489283+0000","last_clean":"2024-09-14T11:38:01.489283+0000","last_became_active":"2024-09-14T10:56:08.844528+0000","last_became_peered":"2024-09-14T10:56:08.844528+0000","last_unstale":"2024-09-14T11:38:01.489283+0000","last_undegraded":"2024-09-14T11:38:01.489283+0000","last_fullsized":"2024-09-14T11:38:01.489283+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'178","last_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_deep_scrub":"264'178","last_deep_scrub_stamp":"2024-09-14T11:38:01.489194+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.489194+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:29:27.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":783,"num_read_kb":641,"num_write":290,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"264'3","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.984029+0000","last_change":"2024-09-14T11:37:55.984029+0000","last_active":"2024-09-14T11:37:55.984029+0000","last_peered":"2024-09-14T11:37:55.984029+0000","last_clean":"2024-09-14T11:37:55.984029+0000","last_became_active":"2024-09-14T10:55:56.783948+0000","last_became_peered":"2024-09-14T10:55:56.783948+0000","last_unstale":"2024-09-14T11:37:55.984029+0000","last_undegraded":"2024-09-14T11:37:55.984029+0000","last_fullsized":"2024-09-14T11:37:55.984029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'3","last_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_deep_scrub":"264'3","last_deep_scrub_stamp":"2024-09-14T11:37:55.983951+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.983951+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:03.446110+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.001038214,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"264'424","reported_seq":1181,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.799026+0000","last_change":"2024-09-14T11:37:54.799026+0000","last_active":"2024-09-14T11:37:54.799026+0000","last_peered":"2024-09-14T11:37:54.799026+0000","last_clean":"2024-09-14T11:37:54.799026+0000","last_became_active":"2024-09-14T10:56:06.832872+0000","last_became_peered":"2024-09-14T10:56:06.832872+0000","last_unstale":"2024-09-14T11:37:54.799026+0000","last_undegraded":"2024-09-14T11:37:54.799026+0000","last_fullsized":"2024-09-14T11:37:54.799026+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'424","last_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_deep_scrub":"264'424","last_deep_scrub_stamp":"2024-09-14T11:37:54.798918+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.798918+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":400,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:24:41.369232+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":884,"num_read_kb":119862,"num_write":1308,"num_write_kb":48532,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":498,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.097424+0000","last_change":"2024-09-14T11:38:12.097424+0000","last_active":"2024-09-14T11:38:12.097424+0000","last_peered":"2024-09-14T11:38:12.097424+0000","last_clean":"2024-09-14T11:38:12.097424+0000","last_became_active":"2024-09-14T10:56:10.848550+0000","last_became_peered":"2024-09-14T10:56:10.848550+0000","last_unstale":"2024-09-14T11:38:12.097424+0000","last_undegraded":"2024-09-14T11:38:12.097424+0000","last_fullsized":"2024-09-14T11:38:12.097424+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:12.097323+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.097323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:33:33.246260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"264'124","reported_seq":664,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.726429+0000","last_change":"2024-09-14T11:38:16.726429+0000","last_active":"2024-09-14T11:38:16.726429+0000","last_peered":"2024-09-14T11:38:16.726429+0000","last_clean":"2024-09-14T11:38:16.726429+0000","last_became_active":"2024-09-14T10:56:12.855329+0000","last_became_peered":"2024-09-14T10:56:12.855329+0000","last_unstale":"2024-09-14T11:38:16.726429+0000","last_undegraded":"2024-09-14T11:38:16.726429+0000","last_fullsized":"2024-09-14T11:38:16.726429+0000","mapping_epoch":29,"log_start":"264'100","ondisk_log_start":"264'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'124","last_scrub_stamp":"2024-09-14T11:38:16.726333+0000","last_deep_scrub":"264'124","last_deep_scrub_stamp":"2024-09-14T11:38:16.726333+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.726333+0000","objects_scrubbed":7,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:50:25.360047+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":143,"num_read_kb":135,"num_write":102,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3352,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.130226+0000","last_change":"2024-09-14T11:38:11.130226+0000","last_active":"2024-09-14T11:38:11.130226+0000","last_peered":"2024-09-14T11:38:11.130226+0000","last_clean":"2024-09-14T11:38:11.130226+0000","last_became_active":"2024-09-14T10:56:14.863946+0000","last_became_peered":"2024-09-14T10:56:14.863946+0000","last_unstale":"2024-09-14T11:38:11.130226+0000","last_undegraded":"2024-09-14T11:38:11.130226+0000","last_fullsized":"2024-09-14T11:38:11.130226+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.130127+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.130127+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:59:35.749033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"264'116","reported_seq":660,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.951242+0000","last_change":"2024-09-14T11:38:24.951242+0000","last_active":"2024-09-14T11:38:24.951242+0000","last_peered":"2024-09-14T11:38:24.951242+0000","last_clean":"2024-09-14T11:38:24.951242+0000","last_became_active":"2024-09-14T10:56:16.874734+0000","last_became_peered":"2024-09-14T10:56:16.874734+0000","last_unstale":"2024-09-14T11:38:24.951242+0000","last_undegraded":"2024-09-14T11:38:24.951242+0000","last_fullsized":"2024-09-14T11:38:24.951242+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'116","last_scrub_stamp":"2024-09-14T11:38:24.951134+0000","last_deep_scrub":"264'116","last_deep_scrub_stamp":"2024-09-14T11:38:24.951134+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.951134+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:33:37.022238+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":208,"num_read_kb":204,"num_write":281,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"264'131","reported_seq":730,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.536277+0000","last_change":"2024-09-14T11:37:59.536277+0000","last_active":"2024-09-14T11:37:59.536277+0000","last_peered":"2024-09-14T11:37:59.536277+0000","last_clean":"2024-09-14T11:37:59.536277+0000","last_became_active":"2024-09-14T10:56:08.846154+0000","last_became_peered":"2024-09-14T10:56:08.846154+0000","last_unstale":"2024-09-14T11:37:59.536277+0000","last_undegraded":"2024-09-14T11:37:59.536277+0000","last_fullsized":"2024-09-14T11:37:59.536277+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-09-14T11:37:59.536190+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.536190+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:46:52.140324+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":573,"num_read_kb":473,"num_write":181,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"264'368","reported_seq":1016,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.967810+0000","last_change":"2024-09-14T11:37:54.967810+0000","last_active":"2024-09-14T11:37:54.967810+0000","last_peered":"2024-09-14T11:37:54.967810+0000","last_clean":"2024-09-14T11:37:54.967810+0000","last_became_active":"2024-09-14T10:56:06.827399+0000","last_became_peered":"2024-09-14T10:56:06.827399+0000","last_unstale":"2024-09-14T11:37:54.967810+0000","last_undegraded":"2024-09-14T11:37:54.967810+0000","last_fullsized":"2024-09-14T11:37:54.967810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:54.967697+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.967697+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:29.191346+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":640,"num_read_kb":12538,"num_write":1147,"num_write_kb":43332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":525,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.521322+0000","last_change":"2024-09-14T11:37:53.521322+0000","last_active":"2024-09-14T11:37:53.521322+0000","last_peered":"2024-09-14T11:37:53.521322+0000","last_clean":"2024-09-14T11:37:53.521322+0000","last_became_active":"2024-09-14T10:55:57.506162+0000","last_became_peered":"2024-09-14T10:55:57.506162+0000","last_unstale":"2024-09-14T11:37:53.521322+0000","last_undegraded":"2024-09-14T11:37:53.521322+0000","last_fullsized":"2024-09-14T11:37:53.521322+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:53.521249+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.521249+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:21:04.660477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00058998199999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"264'4","reported_seq":979,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.079368+0000","last_change":"2024-09-14T11:38:13.079368+0000","last_active":"2024-09-14T11:38:13.079368+0000","last_peered":"2024-09-14T11:38:13.079368+0000","last_clean":"2024-09-14T11:38:13.079368+0000","last_became_active":"2024-09-14T10:56:10.848573+0000","last_became_peered":"2024-09-14T10:56:10.848573+0000","last_unstale":"2024-09-14T11:38:13.079368+0000","last_undegraded":"2024-09-14T11:38:13.079368+0000","last_fullsized":"2024-09-14T11:38:13.079368+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4","last_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_deep_scrub":"264'4","last_deep_scrub_stamp":"2024-09-14T11:38:13.079281+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.079281+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:42:20.909629+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":724,"num_read_kb":722,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"264'598","reported_seq":1261,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.053639+0000","last_change":"2024-09-14T11:38:15.053564+0000","last_active":"2024-09-14T11:38:15.053639+0000","last_peered":"2024-09-14T11:38:15.053639+0000","last_clean":"2024-09-14T11:38:15.053639+0000","last_became_active":"2024-09-14T10:56:12.857101+0000","last_became_peered":"2024-09-14T10:56:12.857101+0000","last_unstale":"2024-09-14T11:38:15.053639+0000","last_undegraded":"2024-09-14T11:38:15.053639+0000","last_fullsized":"2024-09-14T11:38:15.053639+0000","mapping_epoch":29,"log_start":"264'500","ondisk_log_start":"264'500","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'598","last_scrub_stamp":"2024-09-14T11:38:15.053466+0000","last_deep_scrub":"264'598","last_deep_scrub_stamp":"2024-09-14T11:38:15.053466+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.053466+0000","objects_scrubbed":9,"log_size":98,"log_dups_size":500,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:24:35.467956+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":94043,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":992,"num_read_kb":2221,"num_write":850,"num_write_kb":677,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9992,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.804759+0000","last_change":"2024-09-14T11:38:25.804759+0000","last_active":"2024-09-14T11:38:25.804759+0000","last_peered":"2024-09-14T11:38:25.804759+0000","last_clean":"2024-09-14T11:38:25.804759+0000","last_became_active":"2024-09-14T10:56:14.866604+0000","last_became_peered":"2024-09-14T10:56:14.866604+0000","last_unstale":"2024-09-14T11:38:25.804759+0000","last_undegraded":"2024-09-14T11:38:25.804759+0000","last_fullsized":"2024-09-14T11:38:25.804759+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.804671+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.804671+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.804671+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:07:11.781801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"264'185","reported_seq":701,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.097235+0000","last_change":"2024-09-14T11:38:28.097173+0000","last_active":"2024-09-14T11:38:28.097235+0000","last_peered":"2024-09-14T11:38:28.097235+0000","last_clean":"2024-09-14T11:38:28.097235+0000","last_became_active":"2024-09-14T10:56:16.873830+0000","last_became_peered":"2024-09-14T10:56:16.873830+0000","last_unstale":"2024-09-14T11:38:28.097235+0000","last_undegraded":"2024-09-14T11:38:28.097235+0000","last_fullsized":"2024-09-14T11:38:28.097235+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'185","last_scrub_stamp":"2024-09-14T11:38:28.097076+0000","last_deep_scrub":"264'185","last_deep_scrub_stamp":"2024-09-14T11:38:28.097076+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.097076+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:42.736350+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":225,"num_read_kb":206,"num_write":443,"num_write_kb":105,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":73,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"264'259","reported_seq":970,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.092950+0000","last_change":"2024-09-14T11:38:01.092950+0000","last_active":"2024-09-14T11:38:01.092950+0000","last_peered":"2024-09-14T11:38:01.092950+0000","last_clean":"2024-09-14T11:38:01.092950+0000","last_became_active":"2024-09-14T10:56:08.844356+0000","last_became_peered":"2024-09-14T10:56:08.844356+0000","last_unstale":"2024-09-14T11:38:01.092950+0000","last_undegraded":"2024-09-14T11:38:01.092950+0000","last_fullsized":"2024-09-14T11:38:01.092950+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'259","last_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_deep_scrub":"264'259","last_deep_scrub_stamp":"2024-09-14T11:38:01.092847+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.092847+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:19:03.144629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1239,"num_read_kb":1050,"num_write":410,"num_write_kb":197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"264'354","reported_seq":1014,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.510047+0000","last_change":"2024-09-14T11:37:54.510047+0000","last_active":"2024-09-14T11:37:54.510047+0000","last_peered":"2024-09-14T11:37:54.510047+0000","last_clean":"2024-09-14T11:37:54.510047+0000","last_became_active":"2024-09-14T10:56:06.820578+0000","last_became_peered":"2024-09-14T10:56:06.820578+0000","last_unstale":"2024-09-14T11:37:54.510047+0000","last_undegraded":"2024-09-14T11:37:54.510047+0000","last_fullsized":"2024-09-14T11:37:54.510047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'354","last_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_deep_scrub":"264'354","last_deep_scrub_stamp":"2024-09-14T11:37:54.509966+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.509966+0000","objects_scrubbed":6,"log_size":54,"log_dups_size":300,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:17:47.241897+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":702,"num_read_kb":48648,"num_write":1220,"num_write_kb":47517,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":519,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.948139+0000","last_change":"2024-09-14T11:37:57.948139+0000","last_active":"2024-09-14T11:37:57.948139+0000","last_peered":"2024-09-14T11:37:57.948139+0000","last_clean":"2024-09-14T11:37:57.948139+0000","last_became_active":"2024-09-14T10:55:57.506303+0000","last_became_peered":"2024-09-14T10:55:57.506303+0000","last_unstale":"2024-09-14T11:37:57.948139+0000","last_undegraded":"2024-09-14T11:37:57.948139+0000","last_fullsized":"2024-09-14T11:37:57.948139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:57.948046+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.948046+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:16:12.046884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00039173399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.171510+0000","last_change":"2024-09-14T11:38:07.171510+0000","last_active":"2024-09-14T11:38:07.171510+0000","last_peered":"2024-09-14T11:38:07.171510+0000","last_clean":"2024-09-14T11:38:07.171510+0000","last_became_active":"2024-09-14T10:56:10.846469+0000","last_became_peered":"2024-09-14T10:56:10.846469+0000","last_unstale":"2024-09-14T11:38:07.171510+0000","last_undegraded":"2024-09-14T11:38:07.171510+0000","last_fullsized":"2024-09-14T11:38:07.171510+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:07.171423+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.171423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:03.206894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"264'155","reported_seq":720,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.514380+0000","last_change":"2024-09-14T11:38:11.514380+0000","last_active":"2024-09-14T11:38:11.514380+0000","last_peered":"2024-09-14T11:38:11.514380+0000","last_clean":"2024-09-14T11:38:11.514380+0000","last_became_active":"2024-09-14T10:56:13.040946+0000","last_became_peered":"2024-09-14T10:56:13.040946+0000","last_unstale":"2024-09-14T11:38:11.514380+0000","last_undegraded":"2024-09-14T11:38:11.514380+0000","last_fullsized":"2024-09-14T11:38:11.514380+0000","mapping_epoch":29,"log_start":"261'100","ondisk_log_start":"261'100","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'155","last_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_deep_scrub":"264'155","last_deep_scrub_stamp":"2024-09-14T11:38:11.514295+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.514295+0000","objects_scrubbed":7,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:02:27.234237+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":193,"num_read_kb":186,"num_write":126,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"264'795","reported_seq":2769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.899220+0000","last_change":"2024-09-14T11:38:22.899166+0000","last_active":"2024-09-14T11:38:22.899220+0000","last_peered":"2024-09-14T11:38:22.899220+0000","last_clean":"2024-09-14T11:38:22.899220+0000","last_became_active":"2024-09-14T10:56:14.864397+0000","last_became_peered":"2024-09-14T10:56:14.864397+0000","last_unstale":"2024-09-14T11:38:22.899220+0000","last_undegraded":"2024-09-14T11:38:22.899220+0000","last_fullsized":"2024-09-14T11:38:22.899220+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:22.899077+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:22.899077+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.899077+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:13.648060+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"264'139","reported_seq":635,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.778100+0000","last_change":"2024-09-14T11:38:32.778039+0000","last_active":"2024-09-14T11:38:32.778100+0000","last_peered":"2024-09-14T11:38:32.778100+0000","last_clean":"2024-09-14T11:38:32.778100+0000","last_became_active":"2024-09-14T10:56:16.877519+0000","last_became_peered":"2024-09-14T10:56:16.877519+0000","last_unstale":"2024-09-14T11:38:32.778100+0000","last_undegraded":"2024-09-14T11:38:32.778100+0000","last_fullsized":"2024-09-14T11:38:32.778100+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'139","last_scrub_stamp":"2024-09-14T11:38:32.777947+0000","last_deep_scrub":"264'139","last_deep_scrub_stamp":"2024-09-14T11:38:32.777947+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.777947+0000","objects_scrubbed":3,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:38:40.532787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":521,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":327,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"264'112","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.767548+0000","last_change":"2024-09-14T11:38:04.767492+0000","last_active":"2024-09-14T11:38:04.767548+0000","last_peered":"2024-09-14T11:38:04.767548+0000","last_clean":"2024-09-14T11:38:04.767548+0000","last_became_active":"2024-09-14T10:56:08.849137+0000","last_became_peered":"2024-09-14T10:56:08.849137+0000","last_unstale":"2024-09-14T11:38:04.767548+0000","last_undegraded":"2024-09-14T11:38:04.767548+0000","last_fullsized":"2024-09-14T11:38:04.767548+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'112","last_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_deep_scrub":"264'112","last_deep_scrub_stamp":"2024-09-14T11:38:04.767399+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.767399+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:47:56.368702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":517,"num_read_kb":437,"num_write":170,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":719,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"264'357","reported_seq":978,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.826736+0000","last_change":"2024-09-14T11:37:55.826736+0000","last_active":"2024-09-14T11:37:55.826736+0000","last_peered":"2024-09-14T11:37:55.826736+0000","last_clean":"2024-09-14T11:37:55.826736+0000","last_became_active":"2024-09-14T10:56:06.831585+0000","last_became_peered":"2024-09-14T10:56:06.831585+0000","last_unstale":"2024-09-14T11:37:55.826736+0000","last_undegraded":"2024-09-14T11:37:55.826736+0000","last_fullsized":"2024-09-14T11:37:55.826736+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:55.826653+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.826653+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:51.541137+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655848,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":550,"num_read_kb":3889,"num_write":1053,"num_write_kb":41271,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.473533+0000","last_change":"2024-09-14T11:37:55.473533+0000","last_active":"2024-09-14T11:37:55.473533+0000","last_peered":"2024-09-14T11:37:55.473533+0000","last_clean":"2024-09-14T11:37:55.473533+0000","last_became_active":"2024-09-14T10:55:56.787633+0000","last_became_peered":"2024-09-14T10:55:56.787633+0000","last_unstale":"2024-09-14T11:37:55.473533+0000","last_undegraded":"2024-09-14T11:37:55.473533+0000","last_fullsized":"2024-09-14T11:37:55.473533+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.473461+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.473461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:06:32.359228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00047172799999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.713342+0000","last_change":"2024-09-14T11:38:16.713342+0000","last_active":"2024-09-14T11:38:16.713342+0000","last_peered":"2024-09-14T11:38:16.713342+0000","last_clean":"2024-09-14T11:38:16.713342+0000","last_became_active":"2024-09-14T10:56:10.845460+0000","last_became_peered":"2024-09-14T10:56:10.845460+0000","last_unstale":"2024-09-14T11:38:16.713342+0000","last_undegraded":"2024-09-14T11:38:16.713342+0000","last_fullsized":"2024-09-14T11:38:16.713342+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:16.713247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:16.713247+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.713247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:53:29.483002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"264'110","reported_seq":655,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.704146+0000","last_change":"2024-09-14T11:38:18.704146+0000","last_active":"2024-09-14T11:38:18.704146+0000","last_peered":"2024-09-14T11:38:18.704146+0000","last_clean":"2024-09-14T11:38:18.704146+0000","last_became_active":"2024-09-14T10:56:12.853597+0000","last_became_peered":"2024-09-14T10:56:12.853597+0000","last_unstale":"2024-09-14T11:38:18.704146+0000","last_undegraded":"2024-09-14T11:38:18.704146+0000","last_fullsized":"2024-09-14T11:38:18.704146+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'110","last_scrub_stamp":"2024-09-14T11:38:18.704046+0000","last_deep_scrub":"264'110","last_deep_scrub_stamp":"2024-09-14T11:38:18.704046+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.704046+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:36:21.330859+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":119,"num_read_kb":114,"num_write":78,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"264'795","reported_seq":2394,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.728439+0000","last_change":"2024-09-14T11:38:25.728439+0000","last_active":"2024-09-14T11:38:25.728439+0000","last_peered":"2024-09-14T11:38:25.728439+0000","last_clean":"2024-09-14T11:38:25.728439+0000","last_became_active":"2024-09-14T10:56:14.860922+0000","last_became_peered":"2024-09-14T10:56:14.860922+0000","last_unstale":"2024-09-14T11:38:25.728439+0000","last_undegraded":"2024-09-14T11:38:25.728439+0000","last_fullsized":"2024-09-14T11:38:25.728439+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'795","last_scrub_stamp":"2024-09-14T11:38:25.728353+0000","last_deep_scrub":"264'795","last_deep_scrub_stamp":"2024-09-14T11:38:25.728353+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.728353+0000","objects_scrubbed":1,"log_size":95,"log_dups_size":700,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:44:54.580317+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"264'256","reported_seq":751,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.133126+0000","last_change":"2024-09-14T11:38:27.133065+0000","last_active":"2024-09-14T11:38:27.133126+0000","last_peered":"2024-09-14T11:38:27.133126+0000","last_clean":"2024-09-14T11:38:27.133126+0000","last_became_active":"2024-09-14T10:56:16.874499+0000","last_became_peered":"2024-09-14T10:56:16.874499+0000","last_unstale":"2024-09-14T11:38:27.133126+0000","last_undegraded":"2024-09-14T11:38:27.133126+0000","last_fullsized":"2024-09-14T11:38:27.133126+0000","mapping_epoch":33,"log_start":"264'200","ondisk_log_start":"264'200","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'256","last_scrub_stamp":"2024-09-14T11:38:27.132972+0000","last_deep_scrub":"264'256","last_deep_scrub_stamp":"2024-09-14T11:38:27.132972+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.132972+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:26:27.250869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":124,"num_write":560,"num_write_kb":189,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"264'66","reported_seq":645,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.782130+0000","last_change":"2024-09-14T11:37:58.782130+0000","last_active":"2024-09-14T11:37:58.782130+0000","last_peered":"2024-09-14T11:37:58.782130+0000","last_clean":"2024-09-14T11:37:58.782130+0000","last_became_active":"2024-09-14T10:56:08.841412+0000","last_became_peered":"2024-09-14T10:56:08.841412+0000","last_unstale":"2024-09-14T11:37:58.782130+0000","last_undegraded":"2024-09-14T11:37:58.782130+0000","last_fullsized":"2024-09-14T11:37:58.782130+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'66","last_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_deep_scrub":"264'66","last_deep_scrub_stamp":"2024-09-14T11:37:58.782043+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.782043+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:07:01.595371+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":307,"num_read_kb":259,"num_write":90,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"264'364","reported_seq":1080,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:53.229148+0000","last_change":"2024-09-14T11:37:53.229148+0000","last_active":"2024-09-14T11:37:53.229148+0000","last_peered":"2024-09-14T11:37:53.229148+0000","last_clean":"2024-09-14T11:37:53.229148+0000","last_became_active":"2024-09-14T10:56:06.831024+0000","last_became_peered":"2024-09-14T10:56:06.831024+0000","last_unstale":"2024-09-14T11:37:53.229148+0000","last_undegraded":"2024-09-14T11:37:53.229148+0000","last_fullsized":"2024-09-14T11:37:53.229148+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'364","last_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_deep_scrub":"264'364","last_deep_scrub_stamp":"2024-09-14T11:37:53.229076+0000","last_clean_scrub_stamp":"2024-09-14T11:37:53.229076+0000","objects_scrubbed":5,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:08:27.683273+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":848,"num_read_kb":56309,"num_write":1145,"num_write_kb":39326,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":517,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.238426+0000","last_change":"2024-09-14T11:37:55.238426+0000","last_active":"2024-09-14T11:37:55.238426+0000","last_peered":"2024-09-14T11:37:55.238426+0000","last_clean":"2024-09-14T11:37:55.238426+0000","last_became_active":"2024-09-14T10:55:56.787300+0000","last_became_peered":"2024-09-14T10:55:56.787300+0000","last_unstale":"2024-09-14T11:37:55.238426+0000","last_undegraded":"2024-09-14T11:37:55.238426+0000","last_fullsized":"2024-09-14T11:37:55.238426+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:37:55.238331+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.238331+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:59:34.224317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00044121900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.695781+0000","last_change":"2024-09-14T11:38:17.695711+0000","last_active":"2024-09-14T11:38:17.695781+0000","last_peered":"2024-09-14T11:38:17.695781+0000","last_clean":"2024-09-14T11:38:17.695781+0000","last_became_active":"2024-09-14T10:56:10.847268+0000","last_became_peered":"2024-09-14T10:56:10.847268+0000","last_unstale":"2024-09-14T11:38:17.695781+0000","last_undegraded":"2024-09-14T11:38:17.695781+0000","last_fullsized":"2024-09-14T11:38:17.695781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.695622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.695622+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.695622+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:14:09.947854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"264'725","reported_seq":1442,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.954032+0000","last_change":"2024-09-14T11:38:16.954032+0000","last_active":"2024-09-14T11:38:16.954032+0000","last_peered":"2024-09-14T11:38:16.954032+0000","last_clean":"2024-09-14T11:38:16.954032+0000","last_became_active":"2024-09-14T10:56:13.040961+0000","last_became_peered":"2024-09-14T10:56:13.040961+0000","last_unstale":"2024-09-14T11:38:16.954032+0000","last_undegraded":"2024-09-14T11:38:16.954032+0000","last_fullsized":"2024-09-14T11:38:16.954032+0000","mapping_epoch":29,"log_start":"264'700","ondisk_log_start":"264'700","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'725","last_scrub_stamp":"2024-09-14T11:38:16.953943+0000","last_deep_scrub":"264'725","last_deep_scrub_stamp":"2024-09-14T11:38:16.953943+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.953943+0000","objects_scrubbed":8,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:00:19.345828+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":115154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1287,"num_read_kb":3017,"num_write":1048,"num_write_kb":870,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.770245+0000","last_change":"2024-09-14T11:38:26.770245+0000","last_active":"2024-09-14T11:38:26.770245+0000","last_peered":"2024-09-14T11:38:26.770245+0000","last_clean":"2024-09-14T11:38:26.770245+0000","last_became_active":"2024-09-14T10:56:14.855975+0000","last_became_peered":"2024-09-14T10:56:14.855975+0000","last_unstale":"2024-09-14T11:38:26.770245+0000","last_undegraded":"2024-09-14T11:38:26.770245+0000","last_fullsized":"2024-09-14T11:38:26.770245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.770152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.770152+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.770152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:45.323231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"264'138","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.987198+0000","last_change":"2024-09-14T11:38:26.987126+0000","last_active":"2024-09-14T11:38:26.987198+0000","last_peered":"2024-09-14T11:38:26.987198+0000","last_clean":"2024-09-14T11:38:26.987198+0000","last_became_active":"2024-09-14T10:56:16.875670+0000","last_became_peered":"2024-09-14T10:56:16.875670+0000","last_unstale":"2024-09-14T11:38:26.987198+0000","last_undegraded":"2024-09-14T11:38:26.987198+0000","last_fullsized":"2024-09-14T11:38:26.987198+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:26.987044+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:26.987044+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.987044+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:11:43.784515+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":147,"num_read_kb":142,"num_write":344,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"264'138","reported_seq":698,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:32.148211+0000","last_change":"2024-09-14T11:38:32.148211+0000","last_active":"2024-09-14T11:38:32.148211+0000","last_peered":"2024-09-14T11:38:32.148211+0000","last_clean":"2024-09-14T11:38:32.148211+0000","last_became_active":"2024-09-14T10:56:16.878310+0000","last_became_peered":"2024-09-14T10:56:16.878310+0000","last_unstale":"2024-09-14T11:38:32.148211+0000","last_undegraded":"2024-09-14T11:38:32.148211+0000","last_fullsized":"2024-09-14T11:38:32.148211+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:32.148113+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:32.148113+0000","last_clean_scrub_stamp":"2024-09-14T11:38:32.148113+0000","objects_scrubbed":1,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:52.963634+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":224,"num_read_kb":215,"num_write":313,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"264'296","reported_seq":869,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.799272+0000","last_change":"2024-09-14T11:38:03.799205+0000","last_active":"2024-09-14T11:38:03.799272+0000","last_peered":"2024-09-14T11:38:03.799272+0000","last_clean":"2024-09-14T11:38:03.799272+0000","last_became_active":"2024-09-14T10:56:08.840105+0000","last_became_peered":"2024-09-14T10:56:08.840105+0000","last_unstale":"2024-09-14T11:38:03.799272+0000","last_undegraded":"2024-09-14T11:38:03.799272+0000","last_fullsized":"2024-09-14T11:38:03.799272+0000","mapping_epoch":25,"log_start":"261'200","ondisk_log_start":"261'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'296","last_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_deep_scrub":"264'296","last_deep_scrub_stamp":"2024-09-14T11:38:03.799103+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.799103+0000","objects_scrubbed":1,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:55.138113+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1259,"num_read_kb":996,"num_write":492,"num_write_kb":272,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"264'297","reported_seq":915,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.751853+0000","last_change":"2024-09-14T11:37:59.751795+0000","last_active":"2024-09-14T11:37:59.751853+0000","last_peered":"2024-09-14T11:37:59.751853+0000","last_clean":"2024-09-14T11:37:59.751853+0000","last_became_active":"2024-09-14T10:56:06.831912+0000","last_became_peered":"2024-09-14T10:56:06.831912+0000","last_unstale":"2024-09-14T11:37:59.751853+0000","last_undegraded":"2024-09-14T11:37:59.751853+0000","last_fullsized":"2024-09-14T11:37:59.751853+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'297","last_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_deep_scrub":"264'297","last_deep_scrub_stamp":"2024-09-14T11:37:59.751710+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.751710+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":200,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:08.154524+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":499,"num_read_kb":2279,"num_write":913,"num_write_kb":22687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":500,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.527091+0000","last_change":"2024-09-14T11:38:08.527034+0000","last_active":"2024-09-14T11:38:08.527091+0000","last_peered":"2024-09-14T11:38:08.527091+0000","last_clean":"2024-09-14T11:38:08.527091+0000","last_became_active":"2024-09-14T10:56:10.850131+0000","last_became_peered":"2024-09-14T10:56:10.850131+0000","last_unstale":"2024-09-14T11:38:08.527091+0000","last_undegraded":"2024-09-14T11:38:08.527091+0000","last_fullsized":"2024-09-14T11:38:08.527091+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:08.526942+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.526942+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:56:37.177668+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"264'261","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:22.778607+0000","last_change":"2024-09-14T11:38:22.778607+0000","last_active":"2024-09-14T11:38:22.778607+0000","last_peered":"2024-09-14T11:38:22.778607+0000","last_clean":"2024-09-14T11:38:22.778607+0000","last_became_active":"2024-09-14T10:56:12.855203+0000","last_became_peered":"2024-09-14T10:56:12.855203+0000","last_unstale":"2024-09-14T11:38:22.778607+0000","last_undegraded":"2024-09-14T11:38:22.778607+0000","last_fullsized":"2024-09-14T11:38:22.778607+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'261","last_scrub_stamp":"2024-09-14T11:38:22.778510+0000","last_deep_scrub":"264'261","last_deep_scrub_stamp":"2024-09-14T11:38:22.778510+0000","last_clean_scrub_stamp":"2024-09-14T11:38:22.778510+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:42.834735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44234,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":907,"num_write":328,"num_write_kb":249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.748230+0000","last_change":"2024-09-14T11:38:28.748230+0000","last_active":"2024-09-14T11:38:28.748230+0000","last_peered":"2024-09-14T11:38:28.748230+0000","last_clean":"2024-09-14T11:38:28.748230+0000","last_became_active":"2024-09-14T10:56:14.859658+0000","last_became_peered":"2024-09-14T10:56:14.859658+0000","last_unstale":"2024-09-14T11:38:28.748230+0000","last_undegraded":"2024-09-14T11:38:28.748230+0000","last_fullsized":"2024-09-14T11:38:28.748230+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:28.748135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:28.748135+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.748135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:58:52.090625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"264'114","reported_seq":619,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:35.755952+0000","last_change":"2024-09-14T11:38:35.755952+0000","last_active":"2024-09-14T11:38:35.755952+0000","last_peered":"2024-09-14T11:38:35.755952+0000","last_clean":"2024-09-14T11:38:35.755952+0000","last_became_active":"2024-09-14T10:56:16.875921+0000","last_became_peered":"2024-09-14T10:56:16.875921+0000","last_unstale":"2024-09-14T11:38:35.755952+0000","last_undegraded":"2024-09-14T11:38:35.755952+0000","last_fullsized":"2024-09-14T11:38:35.755952+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'114","last_scrub_stamp":"2024-09-14T11:38:35.755869+0000","last_deep_scrub":"264'114","last_deep_scrub_stamp":"2024-09-14T11:38:35.755869+0000","last_clean_scrub_stamp":"2024-09-14T11:38:35.755869+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:48:33.563906+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":411,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":122,"num_write":269,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"264'81","reported_seq":623,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.520852+0000","last_change":"2024-09-14T11:38:03.520774+0000","last_active":"2024-09-14T11:38:03.520852+0000","last_peered":"2024-09-14T11:38:03.520852+0000","last_clean":"2024-09-14T11:38:03.520852+0000","last_became_active":"2024-09-14T10:56:08.846536+0000","last_became_peered":"2024-09-14T10:56:08.846536+0000","last_unstale":"2024-09-14T11:38:03.520852+0000","last_undegraded":"2024-09-14T11:38:03.520852+0000","last_fullsized":"2024-09-14T11:38:03.520852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'81","last_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_deep_scrub":"264'81","last_deep_scrub_stamp":"2024-09-14T11:38:03.520673+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.520673+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:43:06.183047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":340,"num_read_kb":274,"num_write":134,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"264'325","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.979596+0000","last_change":"2024-09-14T11:38:05.979596+0000","last_active":"2024-09-14T11:38:05.979596+0000","last_peered":"2024-09-14T11:38:05.979596+0000","last_clean":"2024-09-14T11:38:05.979596+0000","last_became_active":"2024-09-14T10:56:06.831751+0000","last_became_peered":"2024-09-14T10:56:06.831751+0000","last_unstale":"2024-09-14T11:38:05.979596+0000","last_undegraded":"2024-09-14T11:38:05.979596+0000","last_fullsized":"2024-09-14T11:38:05.979596+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'325","last_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_deep_scrub":"264'325","last_deep_scrub_stamp":"2024-09-14T11:38:05.979504+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.979504+0000","objects_scrubbed":1,"log_size":25,"log_dups_size":300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:58:54.259987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":610,"num_read_kb":9277,"num_write":976,"num_write_kb":28489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.739583+0000","last_change":"2024-09-14T11:38:15.739583+0000","last_active":"2024-09-14T11:38:15.739583+0000","last_peered":"2024-09-14T11:38:15.739583+0000","last_clean":"2024-09-14T11:38:15.739583+0000","last_became_active":"2024-09-14T10:56:10.846430+0000","last_became_peered":"2024-09-14T10:56:10.846430+0000","last_unstale":"2024-09-14T11:38:15.739583+0000","last_undegraded":"2024-09-14T11:38:15.739583+0000","last_fullsized":"2024-09-14T11:38:15.739583+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.739488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.739488+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.739488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:09:31.954617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"264'60","reported_seq":562,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.018389+0000","last_change":"2024-09-14T11:38:16.018389+0000","last_active":"2024-09-14T11:38:16.018389+0000","last_peered":"2024-09-14T11:38:16.018389+0000","last_clean":"2024-09-14T11:38:16.018389+0000","last_became_active":"2024-09-14T10:56:12.850836+0000","last_became_peered":"2024-09-14T10:56:12.850836+0000","last_unstale":"2024-09-14T11:38:16.018389+0000","last_undegraded":"2024-09-14T11:38:16.018389+0000","last_fullsized":"2024-09-14T11:38:16.018389+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'60","last_scrub_stamp":"2024-09-14T11:38:16.018327+0000","last_deep_scrub":"264'60","last_deep_scrub_stamp":"2024-09-14T11:38:16.018327+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.018327+0000","objects_scrubbed":3,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:50:44.609047+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":32,"num_read_kb":30,"num_write":24,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.873580+0000","last_change":"2024-09-14T11:38:23.873580+0000","last_active":"2024-09-14T11:38:23.873580+0000","last_peered":"2024-09-14T11:38:23.873580+0000","last_clean":"2024-09-14T11:38:23.873580+0000","last_became_active":"2024-09-14T10:56:14.869099+0000","last_became_peered":"2024-09-14T10:56:14.869099+0000","last_unstale":"2024-09-14T11:38:23.873580+0000","last_undegraded":"2024-09-14T11:38:23.873580+0000","last_fullsized":"2024-09-14T11:38:23.873580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.873490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.873490+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.873490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:31.278400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"264'187","reported_seq":705,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.077616+0000","last_change":"2024-09-14T11:38:30.077509+0000","last_active":"2024-09-14T11:38:30.077616+0000","last_peered":"2024-09-14T11:38:30.077616+0000","last_clean":"2024-09-14T11:38:30.077616+0000","last_became_active":"2024-09-14T10:56:16.870033+0000","last_became_peered":"2024-09-14T10:56:16.870033+0000","last_unstale":"2024-09-14T11:38:30.077616+0000","last_undegraded":"2024-09-14T11:38:30.077616+0000","last_fullsized":"2024-09-14T11:38:30.077616+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-14T11:38:30.077386+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-14T11:38:30.077386+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.077386+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:40.158786+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":284,"num_read_kb":275,"num_write":414,"num_write_kb":116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"264'91","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.767373+0000","last_change":"2024-09-14T11:38:06.767276+0000","last_active":"2024-09-14T11:38:06.767373+0000","last_peered":"2024-09-14T11:38:06.767373+0000","last_clean":"2024-09-14T11:38:06.767373+0000","last_became_active":"2024-09-14T10:56:08.846646+0000","last_became_peered":"2024-09-14T10:56:08.846646+0000","last_unstale":"2024-09-14T11:38:06.767373+0000","last_undegraded":"2024-09-14T11:38:06.767373+0000","last_fullsized":"2024-09-14T11:38:06.767373+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'91","last_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_deep_scrub":"264'91","last_deep_scrub_stamp":"2024-09-14T11:38:06.767184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.767184+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:48:58.705749+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":422,"num_read_kb":356,"num_write":137,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"264'360","reported_seq":1003,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.987699+0000","last_change":"2024-09-14T11:37:58.987699+0000","last_active":"2024-09-14T11:37:58.987699+0000","last_peered":"2024-09-14T11:37:58.987699+0000","last_clean":"2024-09-14T11:37:58.987699+0000","last_became_active":"2024-09-14T10:56:06.836432+0000","last_became_peered":"2024-09-14T10:56:06.836432+0000","last_unstale":"2024-09-14T11:37:58.987699+0000","last_undegraded":"2024-09-14T11:37:58.987699+0000","last_fullsized":"2024-09-14T11:37:58.987699+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'360","last_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_deep_scrub":"264'360","last_deep_scrub_stamp":"2024-09-14T11:37:58.987611+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.987611+0000","objects_scrubbed":2,"log_size":60,"log_dups_size":300,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:59:24.048610+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":626,"num_read_kb":2982,"num_write":1169,"num_write_kb":23004,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":496,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.911139+0000","last_change":"2024-09-14T11:38:14.911032+0000","last_active":"2024-09-14T11:38:14.911139+0000","last_peered":"2024-09-14T11:38:14.911139+0000","last_clean":"2024-09-14T11:38:14.911139+0000","last_became_active":"2024-09-14T10:56:10.849716+0000","last_became_peered":"2024-09-14T10:56:10.849716+0000","last_unstale":"2024-09-14T11:38:14.911139+0000","last_undegraded":"2024-09-14T11:38:14.911139+0000","last_fullsized":"2024-09-14T11:38:14.911139+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.910937+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.910937+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:15:23.836659+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"264'313","reported_seq":903,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.733467+0000","last_change":"2024-09-14T11:38:21.733467+0000","last_active":"2024-09-14T11:38:21.733467+0000","last_peered":"2024-09-14T11:38:21.733467+0000","last_clean":"2024-09-14T11:38:21.733467+0000","last_became_active":"2024-09-14T10:56:12.855741+0000","last_became_peered":"2024-09-14T10:56:12.855741+0000","last_unstale":"2024-09-14T11:38:21.733467+0000","last_undegraded":"2024-09-14T11:38:21.733467+0000","last_fullsized":"2024-09-14T11:38:21.733467+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'313","last_scrub_stamp":"2024-09-14T11:38:21.733349+0000","last_deep_scrub":"264'313","last_deep_scrub_stamp":"2024-09-14T11:38:21.733349+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.733349+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:14:23.471264+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":47075,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":518,"num_read_kb":1126,"num_write":414,"num_write_kb":305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:14.050831+0000","last_change":"2024-09-14T11:38:14.050749+0000","last_active":"2024-09-14T11:38:14.050831+0000","last_peered":"2024-09-14T11:38:14.050831+0000","last_clean":"2024-09-14T11:38:14.050831+0000","last_became_active":"2024-09-14T10:56:14.869162+0000","last_became_peered":"2024-09-14T10:56:14.869162+0000","last_unstale":"2024-09-14T11:38:14.050831+0000","last_undegraded":"2024-09-14T11:38:14.050831+0000","last_fullsized":"2024-09-14T11:38:14.050831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:14.050668+0000","last_clean_scrub_stamp":"2024-09-14T11:38:14.050668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:18:18.444772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"264'187","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:30.119674+0000","last_change":"2024-09-14T11:38:30.119616+0000","last_active":"2024-09-14T11:38:30.119674+0000","last_peered":"2024-09-14T11:38:30.119674+0000","last_clean":"2024-09-14T11:38:30.119674+0000","last_became_active":"2024-09-14T10:56:16.875542+0000","last_became_peered":"2024-09-14T10:56:16.875542+0000","last_unstale":"2024-09-14T11:38:30.119674+0000","last_undegraded":"2024-09-14T11:38:30.119674+0000","last_fullsized":"2024-09-14T11:38:30.119674+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'187","last_scrub_stamp":"2024-09-14T11:38:30.119513+0000","last_deep_scrub":"264'187","last_deep_scrub_stamp":"2024-09-14T11:38:30.119513+0000","last_clean_scrub_stamp":"2024-09-14T11:38:30.119513+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:04:36.864427+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":255,"num_read_kb":230,"num_write":388,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"264'106","reported_seq":717,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.724247+0000","last_change":"2024-09-14T11:38:05.724174+0000","last_active":"2024-09-14T11:38:05.724247+0000","last_peered":"2024-09-14T11:38:05.724247+0000","last_clean":"2024-09-14T11:38:05.724247+0000","last_became_active":"2024-09-14T10:56:08.838886+0000","last_became_peered":"2024-09-14T10:56:08.838886+0000","last_unstale":"2024-09-14T11:38:05.724247+0000","last_undegraded":"2024-09-14T11:38:05.724247+0000","last_fullsized":"2024-09-14T11:38:05.724247+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'106","last_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_deep_scrub":"264'106","last_deep_scrub_stamp":"2024-09-14T11:38:05.724091+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.724091+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:23:22.241278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":472,"num_read_kb":402,"num_write":142,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"264'326","reported_seq":935,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.186499+0000","last_change":"2024-09-14T11:37:55.186499+0000","last_active":"2024-09-14T11:37:55.186499+0000","last_peered":"2024-09-14T11:37:55.186499+0000","last_clean":"2024-09-14T11:37:55.186499+0000","last_became_active":"2024-09-14T10:56:06.837598+0000","last_became_peered":"2024-09-14T10:56:06.837598+0000","last_unstale":"2024-09-14T11:37:55.186499+0000","last_undegraded":"2024-09-14T11:37:55.186499+0000","last_fullsized":"2024-09-14T11:37:55.186499+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'326","last_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_deep_scrub":"264'326","last_deep_scrub_stamp":"2024-09-14T11:37:55.186430+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.186430+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":300,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:06:21.808735+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":4364,"num_write":956,"num_write_kb":23282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.110226+0000","last_change":"2024-09-14T11:38:10.110173+0000","last_active":"2024-09-14T11:38:10.110226+0000","last_peered":"2024-09-14T11:38:10.110226+0000","last_clean":"2024-09-14T11:38:10.110226+0000","last_became_active":"2024-09-14T10:56:10.851912+0000","last_became_peered":"2024-09-14T10:56:10.851912+0000","last_unstale":"2024-09-14T11:38:10.110226+0000","last_undegraded":"2024-09-14T11:38:10.110226+0000","last_fullsized":"2024-09-14T11:38:10.110226+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.110089+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.110089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:28:50.692474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"264'267","reported_seq":835,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.900199+0000","last_change":"2024-09-14T11:38:18.900199+0000","last_active":"2024-09-14T11:38:18.900199+0000","last_peered":"2024-09-14T11:38:18.900199+0000","last_clean":"2024-09-14T11:38:18.900199+0000","last_became_active":"2024-09-14T10:56:12.848110+0000","last_became_peered":"2024-09-14T10:56:12.848110+0000","last_unstale":"2024-09-14T11:38:18.900199+0000","last_undegraded":"2024-09-14T11:38:18.900199+0000","last_fullsized":"2024-09-14T11:38:18.900199+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'267","last_scrub_stamp":"2024-09-14T11:38:18.900110+0000","last_deep_scrub":"264'267","last_deep_scrub_stamp":"2024-09-14T11:38:18.900110+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.900110+0000","objects_scrubbed":4,"log_size":67,"log_dups_size":200,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:22:40.833350+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48603,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":429,"num_read_kb":979,"num_write":348,"num_write_kb":278,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":488,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.096135+0000","last_change":"2024-09-14T11:38:24.096135+0000","last_active":"2024-09-14T11:38:24.096135+0000","last_peered":"2024-09-14T11:38:24.096135+0000","last_clean":"2024-09-14T11:38:24.096135+0000","last_became_active":"2024-09-14T10:56:14.863572+0000","last_became_peered":"2024-09-14T10:56:14.863572+0000","last_unstale":"2024-09-14T11:38:24.096135+0000","last_undegraded":"2024-09-14T11:38:24.096135+0000","last_fullsized":"2024-09-14T11:38:24.096135+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:24.096035+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:24.096035+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.096035+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:42.507339+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"264'242","reported_seq":924,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.195176+0000","last_change":"2024-09-14T11:38:05.195176+0000","last_active":"2024-09-14T11:38:05.195176+0000","last_peered":"2024-09-14T11:38:05.195176+0000","last_clean":"2024-09-14T11:38:05.195176+0000","last_became_active":"2024-09-14T10:56:08.840100+0000","last_became_peered":"2024-09-14T10:56:08.840100+0000","last_unstale":"2024-09-14T11:38:05.195176+0000","last_undegraded":"2024-09-14T11:38:05.195176+0000","last_fullsized":"2024-09-14T11:38:05.195176+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'242","last_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_deep_scrub":"264'242","last_deep_scrub_stamp":"2024-09-14T11:38:05.195090+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.195090+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:10:58.870651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1170,"num_read_kb":990,"num_write":413,"num_write_kb":227,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"264'316","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.760929+0000","last_change":"2024-09-14T11:38:00.760929+0000","last_active":"2024-09-14T11:38:00.760929+0000","last_peered":"2024-09-14T11:38:00.760929+0000","last_clean":"2024-09-14T11:38:00.760929+0000","last_became_active":"2024-09-14T10:56:06.829107+0000","last_became_peered":"2024-09-14T10:56:06.829107+0000","last_unstale":"2024-09-14T11:38:00.760929+0000","last_undegraded":"2024-09-14T11:38:00.760929+0000","last_fullsized":"2024-09-14T11:38:00.760929+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'316","last_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_deep_scrub":"264'316","last_deep_scrub_stamp":"2024-09-14T11:38:00.760838+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.760838+0000","objects_scrubbed":3,"log_size":16,"log_dups_size":300,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:24:06.394615+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":492,"num_read_kb":11665,"num_write":969,"num_write_kb":26436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.137854+0000","last_change":"2024-09-14T11:38:11.137775+0000","last_active":"2024-09-14T11:38:11.137854+0000","last_peered":"2024-09-14T11:38:11.137854+0000","last_clean":"2024-09-14T11:38:11.137854+0000","last_became_active":"2024-09-14T10:56:10.845456+0000","last_became_peered":"2024-09-14T10:56:10.845456+0000","last_unstale":"2024-09-14T11:38:11.137854+0000","last_undegraded":"2024-09-14T11:38:11.137854+0000","last_fullsized":"2024-09-14T11:38:11.137854+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:11.137678+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.137678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:14:29.267416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"264'484","reported_seq":1116,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.562257+0000","last_change":"2024-09-14T11:38:13.562171+0000","last_active":"2024-09-14T11:38:13.562257+0000","last_peered":"2024-09-14T11:38:13.562257+0000","last_clean":"2024-09-14T11:38:13.562257+0000","last_became_active":"2024-09-14T10:56:12.856749+0000","last_became_peered":"2024-09-14T10:56:12.856749+0000","last_unstale":"2024-09-14T11:38:13.562257+0000","last_undegraded":"2024-09-14T11:38:13.562257+0000","last_fullsized":"2024-09-14T11:38:13.562257+0000","mapping_epoch":29,"log_start":"264'400","ondisk_log_start":"264'400","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'484","last_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_deep_scrub":"264'484","last_deep_scrub_stamp":"2024-09-14T11:38:13.562082+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.562082+0000","objects_scrubbed":7,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:34:41.434257+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":192423,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":855,"num_read_kb":2213,"num_write":738,"num_write_kb":749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.908180+0000","last_change":"2024-09-14T11:38:23.908074+0000","last_active":"2024-09-14T11:38:23.908180+0000","last_peered":"2024-09-14T11:38:23.908180+0000","last_clean":"2024-09-14T11:38:23.908180+0000","last_became_active":"2024-09-14T10:56:14.866297+0000","last_became_peered":"2024-09-14T10:56:14.866297+0000","last_unstale":"2024-09-14T11:38:23.908180+0000","last_undegraded":"2024-09-14T11:38:23.908180+0000","last_fullsized":"2024-09-14T11:38:23.908180+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.907981+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.907981+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.907981+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:03.109857+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"264'183","reported_seq":682,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:33.734803+0000","last_change":"2024-09-14T11:38:33.734803+0000","last_active":"2024-09-14T11:38:33.734803+0000","last_peered":"2024-09-14T11:38:33.734803+0000","last_clean":"2024-09-14T11:38:33.734803+0000","last_became_active":"2024-09-14T10:56:16.877533+0000","last_became_peered":"2024-09-14T10:56:16.877533+0000","last_unstale":"2024-09-14T11:38:33.734803+0000","last_undegraded":"2024-09-14T11:38:33.734803+0000","last_fullsized":"2024-09-14T11:38:33.734803+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'183","last_scrub_stamp":"2024-09-14T11:38:33.734705+0000","last_deep_scrub":"264'183","last_deep_scrub_stamp":"2024-09-14T11:38:33.734705+0000","last_clean_scrub_stamp":"2024-09-14T11:38:33.734705+0000","objects_scrubbed":3,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:38:04.775181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1061,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":186,"num_read_kb":198,"num_write":401,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"264'372","reported_seq":1027,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.178795+0000","last_change":"2024-09-14T11:38:08.178711+0000","last_active":"2024-09-14T11:38:08.178795+0000","last_peered":"2024-09-14T11:38:08.178795+0000","last_clean":"2024-09-14T11:38:08.178795+0000","last_became_active":"2024-09-14T10:56:08.843231+0000","last_became_peered":"2024-09-14T10:56:08.843231+0000","last_unstale":"2024-09-14T11:38:08.178795+0000","last_undegraded":"2024-09-14T11:38:08.178795+0000","last_fullsized":"2024-09-14T11:38:08.178795+0000","mapping_epoch":25,"log_start":"264'300","ondisk_log_start":"264'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'372","last_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_deep_scrub":"264'372","last_deep_scrub_stamp":"2024-09-14T11:38:08.178627+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.178627+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":300,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:08:19.038119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1592,"num_read_kb":1278,"num_write":572,"num_write_kb":280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"264'332","reported_seq":943,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.496892+0000","last_change":"2024-09-14T11:37:56.496892+0000","last_active":"2024-09-14T11:37:56.496892+0000","last_peered":"2024-09-14T11:37:56.496892+0000","last_clean":"2024-09-14T11:37:56.496892+0000","last_became_active":"2024-09-14T10:56:06.824392+0000","last_became_peered":"2024-09-14T10:56:06.824392+0000","last_unstale":"2024-09-14T11:37:56.496892+0000","last_undegraded":"2024-09-14T11:37:56.496892+0000","last_fullsized":"2024-09-14T11:37:56.496892+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'332","last_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_deep_scrub":"264'332","last_deep_scrub_stamp":"2024-09-14T11:37:56.496799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.496799+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":300,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:47:54.399160+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655863,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":493,"num_read_kb":3066,"num_write":996,"num_write_kb":38791,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.126049+0000","last_change":"2024-09-14T11:38:09.126049+0000","last_active":"2024-09-14T11:38:09.126049+0000","last_peered":"2024-09-14T11:38:09.126049+0000","last_clean":"2024-09-14T11:38:09.126049+0000","last_became_active":"2024-09-14T10:56:10.851325+0000","last_became_peered":"2024-09-14T10:56:10.851325+0000","last_unstale":"2024-09-14T11:38:09.126049+0000","last_undegraded":"2024-09-14T11:38:09.126049+0000","last_fullsized":"2024-09-14T11:38:09.126049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:09.125953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.125953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:34:41.468504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"264'344","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.891042+0000","last_change":"2024-09-14T11:38:21.890980+0000","last_active":"2024-09-14T11:38:21.891042+0000","last_peered":"2024-09-14T11:38:21.891042+0000","last_clean":"2024-09-14T11:38:21.891042+0000","last_became_active":"2024-09-14T10:56:12.850237+0000","last_became_peered":"2024-09-14T10:56:12.850237+0000","last_unstale":"2024-09-14T11:38:21.891042+0000","last_undegraded":"2024-09-14T11:38:21.891042+0000","last_fullsized":"2024-09-14T11:38:21.891042+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'344","last_scrub_stamp":"2024-09-14T11:38:21.890811+0000","last_deep_scrub":"264'344","last_deep_scrub_stamp":"2024-09-14T11:38:21.890811+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.890811+0000","objects_scrubbed":8,"log_size":44,"log_dups_size":300,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:50:01.928184+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54268,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":556,"num_read_kb":1258,"num_write":472,"num_write_kb":372,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.519944+0000","last_change":"2024-09-14T11:38:15.519873+0000","last_active":"2024-09-14T11:38:15.519944+0000","last_peered":"2024-09-14T11:38:15.519944+0000","last_clean":"2024-09-14T11:38:15.519944+0000","last_became_active":"2024-09-14T10:56:14.863236+0000","last_became_peered":"2024-09-14T10:56:14.863236+0000","last_unstale":"2024-09-14T11:38:15.519944+0000","last_undegraded":"2024-09-14T11:38:15.519944+0000","last_fullsized":"2024-09-14T11:38:15.519944+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.519778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.519778+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.519778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:28:56.547275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"264'171","reported_seq":704,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.115873+0000","last_change":"2024-09-14T11:38:18.115813+0000","last_active":"2024-09-14T11:38:18.115873+0000","last_peered":"2024-09-14T11:38:18.115873+0000","last_clean":"2024-09-14T11:38:18.115873+0000","last_became_active":"2024-09-14T10:56:16.872967+0000","last_became_peered":"2024-09-14T10:56:16.872967+0000","last_unstale":"2024-09-14T11:38:18.115873+0000","last_undegraded":"2024-09-14T11:38:18.115873+0000","last_fullsized":"2024-09-14T11:38:18.115873+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'171","last_scrub_stamp":"2024-09-14T11:38:18.115725+0000","last_deep_scrub":"264'171","last_deep_scrub_stamp":"2024-09-14T11:38:18.115725+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.115725+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":100,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:49:16.833713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":332,"num_read_kb":295,"num_write":521,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"264'235","reported_seq":928,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.796385+0000","last_change":"2024-09-14T11:38:10.796324+0000","last_active":"2024-09-14T11:38:10.796385+0000","last_peered":"2024-09-14T11:38:10.796385+0000","last_clean":"2024-09-14T11:38:10.796385+0000","last_became_active":"2024-09-14T10:56:08.840672+0000","last_became_peered":"2024-09-14T10:56:08.840672+0000","last_unstale":"2024-09-14T11:38:10.796385+0000","last_undegraded":"2024-09-14T11:38:10.796385+0000","last_fullsized":"2024-09-14T11:38:10.796385+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'235","last_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_deep_scrub":"264'235","last_deep_scrub_stamp":"2024-09-14T11:38:10.796238+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.796238+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:17:26.034543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1288,"num_read_kb":1162,"num_write":389,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"264'368","reported_seq":1031,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.771047+0000","last_change":"2024-09-14T11:37:56.770978+0000","last_active":"2024-09-14T11:37:56.771047+0000","last_peered":"2024-09-14T11:37:56.771047+0000","last_clean":"2024-09-14T11:37:56.771047+0000","last_became_active":"2024-09-14T10:56:06.830315+0000","last_became_peered":"2024-09-14T10:56:06.830315+0000","last_unstale":"2024-09-14T11:37:56.771047+0000","last_undegraded":"2024-09-14T11:37:56.771047+0000","last_fullsized":"2024-09-14T11:37:56.771047+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:56.770888+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.770888+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:27:59.783985+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":576,"num_read_kb":69620,"num_write":1137,"num_write_kb":39866,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.797204+0000","last_change":"2024-09-14T11:38:21.797145+0000","last_active":"2024-09-14T11:38:21.797204+0000","last_peered":"2024-09-14T11:38:21.797204+0000","last_clean":"2024-09-14T11:38:21.797204+0000","last_became_active":"2024-09-14T10:56:10.847839+0000","last_became_peered":"2024-09-14T10:56:10.847839+0000","last_unstale":"2024-09-14T11:38:21.797204+0000","last_undegraded":"2024-09-14T11:38:21.797204+0000","last_fullsized":"2024-09-14T11:38:21.797204+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:21.797056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:21.797056+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.797056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:07:56.877813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"264'275","reported_seq":851,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:24.689762+0000","last_change":"2024-09-14T11:38:24.689762+0000","last_active":"2024-09-14T11:38:24.689762+0000","last_peered":"2024-09-14T11:38:24.689762+0000","last_clean":"2024-09-14T11:38:24.689762+0000","last_became_active":"2024-09-14T10:56:13.040986+0000","last_became_peered":"2024-09-14T10:56:13.040986+0000","last_unstale":"2024-09-14T11:38:24.689762+0000","last_undegraded":"2024-09-14T11:38:24.689762+0000","last_fullsized":"2024-09-14T11:38:24.689762+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'275","last_scrub_stamp":"2024-09-14T11:38:24.689662+0000","last_deep_scrub":"264'275","last_deep_scrub_stamp":"2024-09-14T11:38:24.689662+0000","last_clean_scrub_stamp":"2024-09-14T11:38:24.689662+0000","objects_scrubbed":5,"log_size":75,"log_dups_size":200,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:10:08.180187+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52342,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":461,"num_read_kb":1065,"num_write":374,"num_write_kb":300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.512524+0000","last_change":"2024-09-14T11:38:16.512466+0000","last_active":"2024-09-14T11:38:16.512524+0000","last_peered":"2024-09-14T11:38:16.512524+0000","last_clean":"2024-09-14T11:38:16.512524+0000","last_became_active":"2024-09-14T10:56:14.862371+0000","last_became_peered":"2024-09-14T10:56:14.862371+0000","last_unstale":"2024-09-14T11:38:16.512524+0000","last_undegraded":"2024-09-14T11:38:16.512524+0000","last_fullsized":"2024-09-14T11:38:16.512524+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:16.512384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:16.512384+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.512384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:16:10.329231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"264'117","reported_seq":603,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.034832+0000","last_change":"2024-09-14T11:38:28.034832+0000","last_active":"2024-09-14T11:38:28.034832+0000","last_peered":"2024-09-14T11:38:28.034832+0000","last_clean":"2024-09-14T11:38:28.034832+0000","last_became_active":"2024-09-14T10:56:16.874403+0000","last_became_peered":"2024-09-14T10:56:16.874403+0000","last_unstale":"2024-09-14T11:38:28.034832+0000","last_undegraded":"2024-09-14T11:38:28.034832+0000","last_fullsized":"2024-09-14T11:38:28.034832+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'117","last_scrub_stamp":"2024-09-14T11:38:28.034726+0000","last_deep_scrub":"264'117","last_deep_scrub_stamp":"2024-09-14T11:38:28.034726+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.034726+0000","objects_scrubbed":4,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:08.711735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":585,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":90,"num_read_kb":89,"num_write":260,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"264'33","reported_seq":580,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.346807+0000","last_change":"2024-09-14T11:38:00.346691+0000","last_active":"2024-09-14T11:38:00.346807+0000","last_peered":"2024-09-14T11:38:00.346807+0000","last_clean":"2024-09-14T11:38:00.346807+0000","last_became_active":"2024-09-14T10:56:08.842302+0000","last_became_peered":"2024-09-14T10:56:08.842302+0000","last_unstale":"2024-09-14T11:38:00.346807+0000","last_undegraded":"2024-09-14T11:38:00.346807+0000","last_fullsized":"2024-09-14T11:38:00.346807+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'33","last_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_deep_scrub":"264'33","last_deep_scrub_stamp":"2024-09-14T11:38:00.346611+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.346611+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:35.401615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":147,"num_read_kb":129,"num_write":53,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"264'352","reported_seq":1011,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.200282+0000","last_change":"2024-09-14T11:37:57.200197+0000","last_active":"2024-09-14T11:37:57.200282+0000","last_peered":"2024-09-14T11:37:57.200282+0000","last_clean":"2024-09-14T11:37:57.200282+0000","last_became_active":"2024-09-14T10:56:06.832639+0000","last_became_peered":"2024-09-14T10:56:06.832639+0000","last_unstale":"2024-09-14T11:37:57.200282+0000","last_undegraded":"2024-09-14T11:37:57.200282+0000","last_fullsized":"2024-09-14T11:37:57.200282+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'352","last_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_deep_scrub":"264'352","last_deep_scrub_stamp":"2024-09-14T11:37:57.200097+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.200097+0000","objects_scrubbed":4,"log_size":52,"log_dups_size":300,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:21:27.049496+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":631,"num_read_kb":33947,"num_write":1155,"num_write_kb":41827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":499,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.530691+0000","last_change":"2024-09-14T11:38:10.530630+0000","last_active":"2024-09-14T11:38:10.530691+0000","last_peered":"2024-09-14T11:38:10.530691+0000","last_clean":"2024-09-14T11:38:10.530691+0000","last_became_active":"2024-09-14T10:56:10.849149+0000","last_became_peered":"2024-09-14T10:56:10.849149+0000","last_unstale":"2024-09-14T11:38:10.530691+0000","last_undegraded":"2024-09-14T11:38:10.530691+0000","last_fullsized":"2024-09-14T11:38:10.530691+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:10.530538+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.530538+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:37:40.837743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"264'103","reported_seq":633,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.747782+0000","last_change":"2024-09-14T11:38:23.747782+0000","last_active":"2024-09-14T11:38:23.747782+0000","last_peered":"2024-09-14T11:38:23.747782+0000","last_clean":"2024-09-14T11:38:23.747782+0000","last_became_active":"2024-09-14T10:56:13.040793+0000","last_became_peered":"2024-09-14T10:56:13.040793+0000","last_unstale":"2024-09-14T11:38:23.747782+0000","last_undegraded":"2024-09-14T11:38:23.747782+0000","last_fullsized":"2024-09-14T11:38:23.747782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'103","last_scrub_stamp":"2024-09-14T11:38:23.747694+0000","last_deep_scrub":"264'103","last_deep_scrub_stamp":"2024-09-14T11:38:23.747694+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.747694+0000","objects_scrubbed":7,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:09:33.487506+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":112,"num_read_kb":107,"num_write":124,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"264'754","reported_seq":4586,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:16.050848+0000","last_change":"2024-09-14T11:38:16.050848+0000","last_active":"2024-09-14T11:38:16.050848+0000","last_peered":"2024-09-14T11:38:16.050848+0000","last_clean":"2024-09-14T11:38:16.050848+0000","last_became_active":"2024-09-14T10:56:14.868769+0000","last_became_peered":"2024-09-14T10:56:14.868769+0000","last_unstale":"2024-09-14T11:38:16.050848+0000","last_undegraded":"2024-09-14T11:38:16.050848+0000","last_fullsized":"2024-09-14T11:38:16.050848+0000","mapping_epoch":31,"log_start":"264'700","ondisk_log_start":"264'700","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'754","last_scrub_stamp":"2024-09-14T11:38:16.050755+0000","last_deep_scrub":"264'754","last_deep_scrub_stamp":"2024-09-14T11:38:16.050755+0000","last_clean_scrub_stamp":"2024-09-14T11:38:16.050755+0000","objects_scrubbed":1,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:33:51.960047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"264'127","reported_seq":624,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.874483+0000","last_change":"2024-09-14T11:38:26.874483+0000","last_active":"2024-09-14T11:38:26.874483+0000","last_peered":"2024-09-14T11:38:26.874483+0000","last_clean":"2024-09-14T11:38:26.874483+0000","last_became_active":"2024-09-14T10:56:16.876765+0000","last_became_peered":"2024-09-14T10:56:16.876765+0000","last_unstale":"2024-09-14T11:38:26.874483+0000","last_undegraded":"2024-09-14T11:38:26.874483+0000","last_fullsized":"2024-09-14T11:38:26.874483+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'127","last_scrub_stamp":"2024-09-14T11:38:26.874398+0000","last_deep_scrub":"264'127","last_deep_scrub_stamp":"2024-09-14T11:38:26.874398+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.874398+0000","objects_scrubbed":1,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:06:31.390672+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":426,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":127,"num_read_kb":124,"num_write":309,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"264'74","reported_seq":649,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.896375+0000","last_change":"2024-09-14T11:38:07.896311+0000","last_active":"2024-09-14T11:38:07.896375+0000","last_peered":"2024-09-14T11:38:07.896375+0000","last_clean":"2024-09-14T11:38:07.896375+0000","last_became_active":"2024-09-14T10:56:08.838955+0000","last_became_peered":"2024-09-14T10:56:08.838955+0000","last_unstale":"2024-09-14T11:38:07.896375+0000","last_undegraded":"2024-09-14T11:38:07.896375+0000","last_fullsized":"2024-09-14T11:38:07.896375+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'74","last_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_deep_scrub":"264'74","last_deep_scrub_stamp":"2024-09-14T11:38:07.896225+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.896225+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:31:30.027652+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":338,"num_read_kb":284,"num_write":109,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"264'357","reported_seq":1042,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.971671+0000","last_change":"2024-09-14T11:37:59.971599+0000","last_active":"2024-09-14T11:37:59.971671+0000","last_peered":"2024-09-14T11:37:59.971671+0000","last_clean":"2024-09-14T11:37:59.971671+0000","last_became_active":"2024-09-14T10:56:06.834572+0000","last_became_peered":"2024-09-14T10:56:06.834572+0000","last_unstale":"2024-09-14T11:37:59.971671+0000","last_undegraded":"2024-09-14T11:37:59.971671+0000","last_fullsized":"2024-09-14T11:37:59.971671+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'357","last_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_deep_scrub":"264'357","last_deep_scrub_stamp":"2024-09-14T11:37:59.971497+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.971497+0000","objects_scrubbed":6,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:41:22.835652+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":84,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":780,"num_read_kb":7716,"num_write":1096,"num_write_kb":29634,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.899796+0000","last_change":"2024-09-14T11:38:15.899729+0000","last_active":"2024-09-14T11:38:15.899796+0000","last_peered":"2024-09-14T11:38:15.899796+0000","last_clean":"2024-09-14T11:38:15.899796+0000","last_became_active":"2024-09-14T10:56:10.850609+0000","last_became_peered":"2024-09-14T10:56:10.850609+0000","last_unstale":"2024-09-14T11:38:15.899796+0000","last_undegraded":"2024-09-14T11:38:15.899796+0000","last_fullsized":"2024-09-14T11:38:15.899796+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.899639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.899639+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.899639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:56:54.243126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"264'329","reported_seq":911,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:21.906798+0000","last_change":"2024-09-14T11:38:21.906798+0000","last_active":"2024-09-14T11:38:21.906798+0000","last_peered":"2024-09-14T11:38:21.906798+0000","last_clean":"2024-09-14T11:38:21.906798+0000","last_became_active":"2024-09-14T10:56:12.852996+0000","last_became_peered":"2024-09-14T10:56:12.852996+0000","last_unstale":"2024-09-14T11:38:21.906798+0000","last_undegraded":"2024-09-14T11:38:21.906798+0000","last_fullsized":"2024-09-14T11:38:21.906798+0000","mapping_epoch":29,"log_start":"264'300","ondisk_log_start":"264'300","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'329","last_scrub_stamp":"2024-09-14T11:38:21.906690+0000","last_deep_scrub":"264'329","last_deep_scrub_stamp":"2024-09-14T11:38:21.906690+0000","last_clean_scrub_stamp":"2024-09-14T11:38:21.906690+0000","objects_scrubbed":8,"log_size":29,"log_dups_size":300,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:54:01.598087+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48681,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":522,"num_read_kb":1178,"num_write":428,"num_write_kb":328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.128390+0000","last_change":"2024-09-14T11:38:23.128390+0000","last_active":"2024-09-14T11:38:23.128390+0000","last_peered":"2024-09-14T11:38:23.128390+0000","last_clean":"2024-09-14T11:38:23.128390+0000","last_became_active":"2024-09-14T10:56:14.869217+0000","last_became_peered":"2024-09-14T10:56:14.869217+0000","last_unstale":"2024-09-14T11:38:23.128390+0000","last_undegraded":"2024-09-14T11:38:23.128390+0000","last_fullsized":"2024-09-14T11:38:23.128390+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:23.128297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:23.128297+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.128297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:37:06.906757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"264'128","reported_seq":636,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:27.878297+0000","last_change":"2024-09-14T11:38:27.878297+0000","last_active":"2024-09-14T11:38:27.878297+0000","last_peered":"2024-09-14T11:38:27.878297+0000","last_clean":"2024-09-14T11:38:27.878297+0000","last_became_active":"2024-09-14T10:56:16.871777+0000","last_became_peered":"2024-09-14T10:56:16.871777+0000","last_unstale":"2024-09-14T11:38:27.878297+0000","last_undegraded":"2024-09-14T11:38:27.878297+0000","last_fullsized":"2024-09-14T11:38:27.878297+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'128","last_scrub_stamp":"2024-09-14T11:38:27.878181+0000","last_deep_scrub":"264'128","last_deep_scrub_stamp":"2024-09-14T11:38:27.878181+0000","last_clean_scrub_stamp":"2024-09-14T11:38:27.878181+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:29:51.588624+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":838,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":171,"num_read_kb":152,"num_write":288,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"264'146","reported_seq":762,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.879604+0000","last_change":"2024-09-14T11:38:06.879515+0000","last_active":"2024-09-14T11:38:06.879604+0000","last_peered":"2024-09-14T11:38:06.879604+0000","last_clean":"2024-09-14T11:38:06.879604+0000","last_became_active":"2024-09-14T10:56:41.920300+0000","last_became_peered":"2024-09-14T10:56:41.920300+0000","last_unstale":"2024-09-14T11:38:06.879604+0000","last_undegraded":"2024-09-14T11:38:06.879604+0000","last_fullsized":"2024-09-14T11:38:06.879604+0000","mapping_epoch":36,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'146","last_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_deep_scrub":"264'146","last_deep_scrub_stamp":"2024-09-14T11:38:06.879391+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.879391+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:16.629096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":654,"num_read_kb":541,"num_write":214,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"264'333","reported_seq":941,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.959714+0000","last_change":"2024-09-14T11:38:00.959619+0000","last_active":"2024-09-14T11:38:00.959714+0000","last_peered":"2024-09-14T11:38:00.959714+0000","last_clean":"2024-09-14T11:38:00.959714+0000","last_became_active":"2024-09-14T10:56:06.828780+0000","last_became_peered":"2024-09-14T10:56:06.828780+0000","last_unstale":"2024-09-14T11:38:00.959714+0000","last_undegraded":"2024-09-14T11:38:00.959714+0000","last_fullsized":"2024-09-14T11:38:00.959714+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'333","last_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_deep_scrub":"264'333","last_deep_scrub_stamp":"2024-09-14T11:38:00.959518+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.959518+0000","objects_scrubbed":3,"log_size":33,"log_dups_size":300,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:45:02.829306+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":488,"num_read_kb":36817,"num_write":973,"num_write_kb":44051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":495,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.885673+0000","last_change":"2024-09-14T11:38:17.885564+0000","last_active":"2024-09-14T11:38:17.885673+0000","last_peered":"2024-09-14T11:38:17.885673+0000","last_clean":"2024-09-14T11:38:17.885673+0000","last_became_active":"2024-09-14T10:56:10.846222+0000","last_became_peered":"2024-09-14T10:56:10.846222+0000","last_unstale":"2024-09-14T11:38:17.885673+0000","last_undegraded":"2024-09-14T11:38:17.885673+0000","last_fullsized":"2024-09-14T11:38:17.885673+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.885473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.885473+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.885473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:14:55.102829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"264'287","reported_seq":854,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:18.011793+0000","last_change":"2024-09-14T11:38:18.011793+0000","last_active":"2024-09-14T11:38:18.011793+0000","last_peered":"2024-09-14T11:38:18.011793+0000","last_clean":"2024-09-14T11:38:18.011793+0000","last_became_active":"2024-09-14T10:56:12.853657+0000","last_became_peered":"2024-09-14T10:56:12.853657+0000","last_unstale":"2024-09-14T11:38:18.011793+0000","last_undegraded":"2024-09-14T11:38:18.011793+0000","last_fullsized":"2024-09-14T11:38:18.011793+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'287","last_scrub_stamp":"2024-09-14T11:38:18.011686+0000","last_deep_scrub":"264'287","last_deep_scrub_stamp":"2024-09-14T11:38:18.011686+0000","last_clean_scrub_stamp":"2024-09-14T11:38:18.011686+0000","objects_scrubbed":4,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T15:46:06.174741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43010,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":446,"num_read_kb":1018,"num_write":368,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":486,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:15.031252+0000","last_change":"2024-09-14T11:38:15.031252+0000","last_active":"2024-09-14T11:38:15.031252+0000","last_peered":"2024-09-14T11:38:15.031252+0000","last_clean":"2024-09-14T11:38:15.031252+0000","last_became_active":"2024-09-14T10:56:14.866372+0000","last_became_peered":"2024-09-14T10:56:14.866372+0000","last_unstale":"2024-09-14T11:38:15.031252+0000","last_undegraded":"2024-09-14T11:38:15.031252+0000","last_fullsized":"2024-09-14T11:38:15.031252+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:15.031165+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:15.031165+0000","last_clean_scrub_stamp":"2024-09-14T11:38:15.031165+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:42:41.916463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"264'152","reported_seq":684,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:34.744575+0000","last_change":"2024-09-14T11:38:34.744575+0000","last_active":"2024-09-14T11:38:34.744575+0000","last_peered":"2024-09-14T11:38:34.744575+0000","last_clean":"2024-09-14T11:38:34.744575+0000","last_became_active":"2024-09-14T10:56:16.877027+0000","last_became_peered":"2024-09-14T10:56:16.877027+0000","last_unstale":"2024-09-14T11:38:34.744575+0000","last_undegraded":"2024-09-14T11:38:34.744575+0000","last_fullsized":"2024-09-14T11:38:34.744575+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:34.744484+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:34.744484+0000","last_clean_scrub_stamp":"2024-09-14T11:38:34.744484+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:45:53.145434+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":539,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":256,"num_read_kb":235,"num_write":384,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"264'126","reported_seq":707,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.808000+0000","last_change":"2024-09-14T11:38:09.808000+0000","last_active":"2024-09-14T11:38:09.808000+0000","last_peered":"2024-09-14T11:38:09.808000+0000","last_clean":"2024-09-14T11:38:09.808000+0000","last_became_active":"2024-09-14T10:56:08.836712+0000","last_became_peered":"2024-09-14T10:56:08.836712+0000","last_unstale":"2024-09-14T11:38:09.808000+0000","last_undegraded":"2024-09-14T11:38:09.808000+0000","last_fullsized":"2024-09-14T11:38:09.808000+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'126","last_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_deep_scrub":"264'126","last_deep_scrub_stamp":"2024-09-14T11:38:09.807913+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.807913+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:44:08.263690+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":539,"num_read_kb":439,"num_write":194,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"264'378","reported_seq":1009,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.769777+0000","last_change":"2024-09-14T11:37:57.769714+0000","last_active":"2024-09-14T11:37:57.769777+0000","last_peered":"2024-09-14T11:37:57.769777+0000","last_clean":"2024-09-14T11:37:57.769777+0000","last_became_active":"2024-09-14T10:56:06.830481+0000","last_became_peered":"2024-09-14T10:56:06.830481+0000","last_unstale":"2024-09-14T11:37:57.769777+0000","last_undegraded":"2024-09-14T11:37:57.769777+0000","last_fullsized":"2024-09-14T11:37:57.769777+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'378","last_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_deep_scrub":"264'378","last_deep_scrub_stamp":"2024-09-14T11:37:57.769590+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.769590+0000","objects_scrubbed":8,"log_size":78,"log_dups_size":300,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:32:11.879615+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":43,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":618,"num_read_kb":16528,"num_write":1305,"num_write_kb":42747,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":505,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:17.673206+0000","last_change":"2024-09-14T11:38:17.673206+0000","last_active":"2024-09-14T11:38:17.673206+0000","last_peered":"2024-09-14T11:38:17.673206+0000","last_clean":"2024-09-14T11:38:17.673206+0000","last_became_active":"2024-09-14T10:56:10.848915+0000","last_became_peered":"2024-09-14T10:56:10.848915+0000","last_unstale":"2024-09-14T11:38:17.673206+0000","last_undegraded":"2024-09-14T11:38:17.673206+0000","last_fullsized":"2024-09-14T11:38:17.673206+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:17.673119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:17.673119+0000","last_clean_scrub_stamp":"2024-09-14T11:38:17.673119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:42:17.992154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"264'272","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:23.730418+0000","last_change":"2024-09-14T11:38:23.730319+0000","last_active":"2024-09-14T11:38:23.730418+0000","last_peered":"2024-09-14T11:38:23.730418+0000","last_clean":"2024-09-14T11:38:23.730418+0000","last_became_active":"2024-09-14T10:56:12.853201+0000","last_became_peered":"2024-09-14T10:56:12.853201+0000","last_unstale":"2024-09-14T11:38:23.730418+0000","last_undegraded":"2024-09-14T11:38:23.730418+0000","last_fullsized":"2024-09-14T11:38:23.730418+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'272","last_scrub_stamp":"2024-09-14T11:38:23.730218+0000","last_deep_scrub":"264'272","last_deep_scrub_stamp":"2024-09-14T11:38:23.730218+0000","last_clean_scrub_stamp":"2024-09-14T11:38:23.730218+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:21:17.916005+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":51357,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":456,"num_read_kb":1141,"num_write":384,"num_write_kb":340,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":497,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:26.765370+0000","last_change":"2024-09-14T11:38:26.765314+0000","last_active":"2024-09-14T11:38:26.765370+0000","last_peered":"2024-09-14T11:38:26.765370+0000","last_clean":"2024-09-14T11:38:26.765370+0000","last_became_active":"2024-09-14T10:56:14.870027+0000","last_became_peered":"2024-09-14T10:56:14.870027+0000","last_unstale":"2024-09-14T11:38:26.765370+0000","last_undegraded":"2024-09-14T11:38:26.765370+0000","last_fullsized":"2024-09-14T11:38:26.765370+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:26.765225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:26.765225+0000","last_clean_scrub_stamp":"2024-09-14T11:38:26.765225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:16:39.746853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"264'179","reported_seq":1647,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.920451+0000","last_change":"2024-09-14T11:38:28.920451+0000","last_active":"2024-09-14T11:38:28.920451+0000","last_peered":"2024-09-14T11:38:28.920451+0000","last_clean":"2024-09-14T11:38:28.920451+0000","last_became_active":"2024-09-14T10:56:16.873978+0000","last_became_peered":"2024-09-14T10:56:16.873978+0000","last_unstale":"2024-09-14T11:38:28.920451+0000","last_undegraded":"2024-09-14T11:38:28.920451+0000","last_fullsized":"2024-09-14T11:38:28.920451+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:38:28.920367+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:38:28.920367+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.920367+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T20:14:21.692826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":239,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1217,"num_read_kb":1207,"num_write":421,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"264'196","reported_seq":862,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.844285+0000","last_change":"2024-09-14T11:38:05.844285+0000","last_active":"2024-09-14T11:38:05.844285+0000","last_peered":"2024-09-14T11:38:05.844285+0000","last_clean":"2024-09-14T11:38:05.844285+0000","last_became_active":"2024-09-14T10:56:08.843131+0000","last_became_peered":"2024-09-14T10:56:08.843131+0000","last_unstale":"2024-09-14T11:38:05.844285+0000","last_undegraded":"2024-09-14T11:38:05.844285+0000","last_fullsized":"2024-09-14T11:38:05.844285+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'196","last_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_deep_scrub":"264'196","last_deep_scrub_stamp":"2024-09-14T11:38:05.844184+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.844184+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:33:14.327154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":837,"num_read_kb":695,"num_write":293,"num_write_kb":125,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"264'362","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.193415+0000","last_change":"2024-09-14T11:37:56.193415+0000","last_active":"2024-09-14T11:37:56.193415+0000","last_peered":"2024-09-14T11:37:56.193415+0000","last_clean":"2024-09-14T11:37:56.193415+0000","last_became_active":"2024-09-14T10:56:41.921192+0000","last_became_peered":"2024-09-14T10:56:41.921192+0000","last_unstale":"2024-09-14T11:37:56.193415+0000","last_undegraded":"2024-09-14T11:37:56.193415+0000","last_fullsized":"2024-09-14T11:37:56.193415+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'362","last_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_deep_scrub":"264'362","last_deep_scrub_stamp":"2024-09-14T11:37:56.193342+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.193342+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":300,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:06:11.215563+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655850,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":662,"num_read_kb":13580,"num_write":1124,"num_write_kb":28941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"264'2","reported_seq":501,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.513158+0000","last_change":"2024-09-14T11:38:09.513158+0000","last_active":"2024-09-14T11:38:09.513158+0000","last_peered":"2024-09-14T11:38:09.513158+0000","last_clean":"2024-09-14T11:38:09.513158+0000","last_became_active":"2024-09-14T10:56:10.850150+0000","last_became_peered":"2024-09-14T10:56:10.850150+0000","last_unstale":"2024-09-14T11:38:09.513158+0000","last_undegraded":"2024-09-14T11:38:09.513158+0000","last_fullsized":"2024-09-14T11:38:09.513158+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'2","last_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_deep_scrub":"264'2","last_deep_scrub_stamp":"2024-09-14T11:38:09.513031+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.513031+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:20:35.439168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"264'285","reported_seq":878,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:20.752573+0000","last_change":"2024-09-14T11:38:20.752499+0000","last_active":"2024-09-14T11:38:20.752573+0000","last_peered":"2024-09-14T11:38:20.752573+0000","last_clean":"2024-09-14T11:38:20.752573+0000","last_became_active":"2024-09-14T10:56:12.850351+0000","last_became_peered":"2024-09-14T10:56:12.850351+0000","last_unstale":"2024-09-14T11:38:20.752573+0000","last_undegraded":"2024-09-14T11:38:20.752573+0000","last_fullsized":"2024-09-14T11:38:20.752573+0000","mapping_epoch":29,"log_start":"264'200","ondisk_log_start":"264'200","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'285","last_scrub_stamp":"2024-09-14T11:38:20.752317+0000","last_deep_scrub":"264'285","last_deep_scrub_stamp":"2024-09-14T11:38:20.752317+0000","last_clean_scrub_stamp":"2024-09-14T11:38:20.752317+0000","objects_scrubbed":4,"log_size":85,"log_dups_size":200,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:04:45.897103+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":45151,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":477,"num_read_kb":1053,"num_write":380,"num_write_kb":288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":487,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:25.123714+0000","last_change":"2024-09-14T11:38:25.123597+0000","last_active":"2024-09-14T11:38:25.123714+0000","last_peered":"2024-09-14T11:38:25.123714+0000","last_clean":"2024-09-14T11:38:25.123714+0000","last_became_active":"2024-09-14T10:56:14.863869+0000","last_became_peered":"2024-09-14T10:56:14.863869+0000","last_unstale":"2024-09-14T11:38:25.123714+0000","last_undegraded":"2024-09-14T11:38:25.123714+0000","last_fullsized":"2024-09-14T11:38:25.123714+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-14T11:38:25.123477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-14T11:38:25.123477+0000","last_clean_scrub_stamp":"2024-09-14T11:38:25.123477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T21:10:05.503469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"264'131","reported_seq":637,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:28.754713+0000","last_change":"2024-09-14T11:38:28.754713+0000","last_active":"2024-09-14T11:38:28.754713+0000","last_peered":"2024-09-14T11:38:28.754713+0000","last_clean":"2024-09-14T11:38:28.754713+0000","last_became_active":"2024-09-14T10:56:16.869910+0000","last_became_peered":"2024-09-14T10:56:16.869910+0000","last_unstale":"2024-09-14T11:38:28.754713+0000","last_undegraded":"2024-09-14T11:38:28.754713+0000","last_fullsized":"2024-09-14T11:38:28.754713+0000","mapping_epoch":33,"log_start":"264'100","ondisk_log_start":"264'100","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'131","last_scrub_stamp":"2024-09-14T11:38:28.754621+0000","last_deep_scrub":"264'131","last_deep_scrub_stamp":"2024-09-14T11:38:28.754621+0000","last_clean_scrub_stamp":"2024-09-14T11:38:28.754621+0000","objects_scrubbed":3,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:26:57.271998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":222,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":148,"num_read_kb":131,"num_write":306,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"264'154","reported_seq":770,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.549238+0000","last_change":"2024-09-14T11:38:05.549238+0000","last_active":"2024-09-14T11:38:05.549238+0000","last_peered":"2024-09-14T11:38:05.549238+0000","last_clean":"2024-09-14T11:38:05.549238+0000","last_became_active":"2024-09-14T10:56:08.840574+0000","last_became_peered":"2024-09-14T10:56:08.840574+0000","last_unstale":"2024-09-14T11:38:05.549238+0000","last_undegraded":"2024-09-14T11:38:05.549238+0000","last_fullsized":"2024-09-14T11:38:05.549238+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'154","last_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_deep_scrub":"264'154","last_deep_scrub_stamp":"2024-09-14T11:38:05.549130+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.549130+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:50:53.773608+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":717,"num_read_kb":597,"num_write":270,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"264'381","reported_seq":1006,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:00.243905+0000","last_change":"2024-09-14T11:38:00.243905+0000","last_active":"2024-09-14T11:38:00.243905+0000","last_peered":"2024-09-14T11:38:00.243905+0000","last_clean":"2024-09-14T11:38:00.243905+0000","last_became_active":"2024-09-14T10:56:06.833084+0000","last_became_peered":"2024-09-14T10:56:06.833084+0000","last_unstale":"2024-09-14T11:38:00.243905+0000","last_undegraded":"2024-09-14T11:38:00.243905+0000","last_fullsized":"2024-09-14T11:38:00.243905+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'381","last_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_deep_scrub":"264'381","last_deep_scrub_stamp":"2024-09-14T11:38:00.243785+0000","last_clean_scrub_stamp":"2024-09-14T11:38:00.243785+0000","objects_scrubbed":8,"log_size":81,"log_dups_size":300,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:39:58.476866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":101,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":630,"num_read_kb":8663,"num_write":1069,"num_write_kb":30079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"264'179","reported_seq":758,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.481794+0000","last_change":"2024-09-14T11:38:07.481794+0000","last_active":"2024-09-14T11:38:07.481794+0000","last_peered":"2024-09-14T11:38:07.481794+0000","last_clean":"2024-09-14T11:38:07.481794+0000","last_became_active":"2024-09-14T10:56:08.850507+0000","last_became_peered":"2024-09-14T10:56:08.850507+0000","last_unstale":"2024-09-14T11:38:07.481794+0000","last_undegraded":"2024-09-14T11:38:07.481794+0000","last_fullsized":"2024-09-14T11:38:07.481794+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'179","last_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_deep_scrub":"264'179","last_deep_scrub_stamp":"2024-09-14T11:38:07.481689+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.481689+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:46:21.494813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":806,"num_read_kb":646,"num_write":302,"num_write_kb":146,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"264'448","reported_seq":1120,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:54.257837+0000","last_change":"2024-09-14T11:37:54.257837+0000","last_active":"2024-09-14T11:37:54.257837+0000","last_peered":"2024-09-14T11:37:54.257837+0000","last_clean":"2024-09-14T11:37:54.257837+0000","last_became_active":"2024-09-14T10:56:06.822543+0000","last_became_peered":"2024-09-14T10:56:06.822543+0000","last_unstale":"2024-09-14T11:37:54.257837+0000","last_undegraded":"2024-09-14T11:37:54.257837+0000","last_fullsized":"2024-09-14T11:37:54.257837+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'448","last_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_deep_scrub":"264'448","last_deep_scrub_stamp":"2024-09-14T11:37:54.257768+0000","last_clean_scrub_stamp":"2024-09-14T11:37:54.257768+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:46:31.063923+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655837,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":758,"num_read_kb":16320,"num_write":1497,"num_write_kb":48158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"264'140","reported_seq":731,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.006241+0000","last_change":"2024-09-14T11:38:09.006241+0000","last_active":"2024-09-14T11:38:09.006241+0000","last_peered":"2024-09-14T11:38:09.006241+0000","last_clean":"2024-09-14T11:38:09.006241+0000","last_became_active":"2024-09-14T10:56:08.848228+0000","last_became_peered":"2024-09-14T10:56:08.848228+0000","last_unstale":"2024-09-14T11:38:09.006241+0000","last_undegraded":"2024-09-14T11:38:09.006241+0000","last_fullsized":"2024-09-14T11:38:09.006241+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'140","last_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_deep_scrub":"264'140","last_deep_scrub_stamp":"2024-09-14T11:38:09.006154+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.006154+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":100,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:37:03.937417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":622,"num_read_kb":512,"num_write":207,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"264'302","reported_seq":930,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.929061+0000","last_change":"2024-09-14T11:38:01.929061+0000","last_active":"2024-09-14T11:38:01.929061+0000","last_peered":"2024-09-14T11:38:01.929061+0000","last_clean":"2024-09-14T11:38:01.929061+0000","last_became_active":"2024-09-14T10:56:06.827231+0000","last_became_peered":"2024-09-14T10:56:06.827231+0000","last_unstale":"2024-09-14T11:38:01.929061+0000","last_undegraded":"2024-09-14T11:38:01.929061+0000","last_fullsized":"2024-09-14T11:38:01.929061+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'302","last_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_deep_scrub":"264'302","last_deep_scrub_stamp":"2024-09-14T11:38:01.928975+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.928975+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":200,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:11:06.365261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":545,"num_read_kb":2695,"num_write":898,"num_write_kb":19549,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"264'138","reported_seq":754,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:04.499069+0000","last_change":"2024-09-14T11:38:04.499069+0000","last_active":"2024-09-14T11:38:04.499069+0000","last_peered":"2024-09-14T11:38:04.499069+0000","last_clean":"2024-09-14T11:38:04.499069+0000","last_became_active":"2024-09-14T10:56:08.844909+0000","last_became_peered":"2024-09-14T10:56:08.844909+0000","last_unstale":"2024-09-14T11:38:04.499069+0000","last_undegraded":"2024-09-14T11:38:04.499069+0000","last_fullsized":"2024-09-14T11:38:04.499069+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:04.498989+0000","last_clean_scrub_stamp":"2024-09-14T11:38:04.498989+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T11:53:01.862258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":635,"num_read_kb":528,"num_write":204,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"264'356","reported_seq":1066,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.167523+0000","last_change":"2024-09-14T11:37:58.167440+0000","last_active":"2024-09-14T11:37:58.167523+0000","last_peered":"2024-09-14T11:37:58.167523+0000","last_clean":"2024-09-14T11:37:58.167523+0000","last_became_active":"2024-09-14T10:56:41.921677+0000","last_became_peered":"2024-09-14T10:56:41.921677+0000","last_unstale":"2024-09-14T11:37:58.167523+0000","last_undegraded":"2024-09-14T11:37:58.167523+0000","last_fullsized":"2024-09-14T11:37:58.167523+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'356","last_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_deep_scrub":"264'356","last_deep_scrub_stamp":"2024-09-14T11:37:58.167277+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.167277+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":300,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:58:06.933166+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655871,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":820,"num_read_kb":27796,"num_write":1160,"num_write_kb":44695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"264'4160","reported_seq":4769,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:12.787252+0000","last_change":"2024-09-14T11:38:12.787252+0000","last_active":"2024-09-14T11:38:12.787252+0000","last_peered":"2024-09-14T11:38:12.787252+0000","last_clean":"2024-09-14T11:38:12.787252+0000","last_became_active":"2024-09-14T10:56:08.847586+0000","last_became_peered":"2024-09-14T10:56:08.847586+0000","last_unstale":"2024-09-14T11:38:12.787252+0000","last_undegraded":"2024-09-14T11:38:12.787252+0000","last_fullsized":"2024-09-14T11:38:12.787252+0000","mapping_epoch":25,"log_start":"264'4100","ondisk_log_start":"264'4100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'4160","last_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_deep_scrub":"264'4160","last_deep_scrub_stamp":"2024-09-14T11:38:12.787148+0000","last_clean_scrub_stamp":"2024-09-14T11:38:12.787148+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":3000,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:14:55.106908+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16701,"num_read_kb":13929,"num_write":6221,"num_write_kb":3106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"264'442","reported_seq":1223,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.746470+0000","last_change":"2024-09-14T11:37:59.746470+0000","last_active":"2024-09-14T11:37:59.746470+0000","last_peered":"2024-09-14T11:37:59.746470+0000","last_clean":"2024-09-14T11:37:59.746470+0000","last_became_active":"2024-09-14T10:56:06.833268+0000","last_became_peered":"2024-09-14T10:56:06.833268+0000","last_unstale":"2024-09-14T11:37:59.746470+0000","last_undegraded":"2024-09-14T11:37:59.746470+0000","last_fullsized":"2024-09-14T11:37:59.746470+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'442","last_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_deep_scrub":"264'442","last_deep_scrub_stamp":"2024-09-14T11:37:59.746338+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.746338+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:19:48.240361+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655852,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1409,"num_read_kb":14785,"num_write":1267,"num_write_kb":23569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"264'209","reported_seq":886,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.908101+0000","last_change":"2024-09-14T11:38:08.908101+0000","last_active":"2024-09-14T11:38:08.908101+0000","last_peered":"2024-09-14T11:38:08.908101+0000","last_clean":"2024-09-14T11:38:08.908101+0000","last_became_active":"2024-09-14T10:56:08.842747+0000","last_became_peered":"2024-09-14T10:56:08.842747+0000","last_unstale":"2024-09-14T11:38:08.908101+0000","last_undegraded":"2024-09-14T11:38:08.908101+0000","last_fullsized":"2024-09-14T11:38:08.908101+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'209","last_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_deep_scrub":"264'209","last_deep_scrub_stamp":"2024-09-14T11:38:08.908006+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.908006+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:12:32.288213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":968,"num_read_kb":805,"num_write":331,"num_write_kb":158,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"264'423","reported_seq":1095,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:57.528878+0000","last_change":"2024-09-14T11:37:57.528878+0000","last_active":"2024-09-14T11:37:57.528878+0000","last_peered":"2024-09-14T11:37:57.528878+0000","last_clean":"2024-09-14T11:37:57.528878+0000","last_became_active":"2024-09-14T10:56:06.822520+0000","last_became_peered":"2024-09-14T10:56:06.822520+0000","last_unstale":"2024-09-14T11:37:57.528878+0000","last_undegraded":"2024-09-14T11:37:57.528878+0000","last_fullsized":"2024-09-14T11:37:57.528878+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'423","last_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_deep_scrub":"264'423","last_deep_scrub_stamp":"2024-09-14T11:37:57.528772+0000","last_clean_scrub_stamp":"2024-09-14T11:37:57.528772+0000","objects_scrubbed":6,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:13:11.066498+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":55,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":745,"num_read_kb":54735,"num_write":1248,"num_write_kb":51810,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"264'75","reported_seq":643,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.754421+0000","last_change":"2024-09-14T11:38:11.754421+0000","last_active":"2024-09-14T11:38:11.754421+0000","last_peered":"2024-09-14T11:38:11.754421+0000","last_clean":"2024-09-14T11:38:11.754421+0000","last_became_active":"2024-09-14T10:56:08.842549+0000","last_became_peered":"2024-09-14T10:56:08.842549+0000","last_unstale":"2024-09-14T11:38:11.754421+0000","last_undegraded":"2024-09-14T11:38:11.754421+0000","last_fullsized":"2024-09-14T11:38:11.754421+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'75","last_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_deep_scrub":"264'75","last_deep_scrub_stamp":"2024-09-14T11:38:11.754322+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.754322+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:33.771510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":335,"num_read_kb":279,"num_write":112,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"264'428","reported_seq":1211,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.248925+0000","last_change":"2024-09-14T11:37:58.248925+0000","last_active":"2024-09-14T11:37:58.248925+0000","last_peered":"2024-09-14T11:37:58.248925+0000","last_clean":"2024-09-14T11:37:58.248925+0000","last_became_active":"2024-09-14T10:56:06.831128+0000","last_became_peered":"2024-09-14T10:56:06.831128+0000","last_unstale":"2024-09-14T11:37:58.248925+0000","last_undegraded":"2024-09-14T11:37:58.248925+0000","last_fullsized":"2024-09-14T11:37:58.248925+0000","mapping_epoch":23,"log_start":"264'400","ondisk_log_start":"264'400","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'428","last_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_deep_scrub":"264'428","last_deep_scrub_stamp":"2024-09-14T11:37:58.248799+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.248799+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:09:09.244000+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1142,"num_read_kb":46426,"num_write":1473,"num_write_kb":28461,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"264'303","reported_seq":942,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:08.161512+0000","last_change":"2024-09-14T11:38:08.161512+0000","last_active":"2024-09-14T11:38:08.161512+0000","last_peered":"2024-09-14T11:38:08.161512+0000","last_clean":"2024-09-14T11:38:08.161512+0000","last_became_active":"2024-09-14T10:56:08.845801+0000","last_became_peered":"2024-09-14T10:56:08.845801+0000","last_unstale":"2024-09-14T11:38:08.161512+0000","last_undegraded":"2024-09-14T11:38:08.161512+0000","last_fullsized":"2024-09-14T11:38:08.161512+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'303","last_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_deep_scrub":"264'303","last_deep_scrub_stamp":"2024-09-14T11:38:08.161420+0000","last_clean_scrub_stamp":"2024-09-14T11:38:08.161420+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:26:54.808745+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1303,"num_read_kb":1058,"num_write":468,"num_write_kb":258,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":684,"num_omap_keys":3,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"264'323","reported_seq":927,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.727550+0000","last_change":"2024-09-14T11:37:58.727550+0000","last_active":"2024-09-14T11:37:58.727550+0000","last_peered":"2024-09-14T11:37:58.727550+0000","last_clean":"2024-09-14T11:37:58.727550+0000","last_became_active":"2024-09-14T10:56:06.834041+0000","last_became_peered":"2024-09-14T10:56:06.834041+0000","last_unstale":"2024-09-14T11:37:58.727550+0000","last_undegraded":"2024-09-14T11:37:58.727550+0000","last_fullsized":"2024-09-14T11:37:58.727550+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'323","last_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_deep_scrub":"264'323","last_deep_scrub_stamp":"2024-09-14T11:37:58.727456+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.727456+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":300,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:35:23.797636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":476,"num_read_kb":5718,"num_write":986,"num_write_kb":22737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"264'199","reported_seq":830,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:07.210936+0000","last_change":"2024-09-14T11:38:07.210816+0000","last_active":"2024-09-14T11:38:07.210936+0000","last_peered":"2024-09-14T11:38:07.210936+0000","last_clean":"2024-09-14T11:38:07.210936+0000","last_became_active":"2024-09-14T10:56:08.835157+0000","last_became_peered":"2024-09-14T10:56:08.835157+0000","last_unstale":"2024-09-14T11:38:07.210936+0000","last_undegraded":"2024-09-14T11:38:07.210936+0000","last_fullsized":"2024-09-14T11:38:07.210936+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'199","last_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_deep_scrub":"264'199","last_deep_scrub_stamp":"2024-09-14T11:38:07.210704+0000","last_clean_scrub_stamp":"2024-09-14T11:38:07.210704+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T23:09:06.603186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":907,"num_read_kb":750,"num_write":330,"num_write_kb":191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"264'377","reported_seq":982,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:02.911007+0000","last_change":"2024-09-14T11:38:02.911007+0000","last_active":"2024-09-14T11:38:02.911007+0000","last_peered":"2024-09-14T11:38:02.911007+0000","last_clean":"2024-09-14T11:38:02.911007+0000","last_became_active":"2024-09-14T10:56:06.829242+0000","last_became_peered":"2024-09-14T10:56:06.829242+0000","last_unstale":"2024-09-14T11:38:02.911007+0000","last_undegraded":"2024-09-14T11:38:02.911007+0000","last_fullsized":"2024-09-14T11:38:02.911007+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'377","last_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_deep_scrub":"264'377","last_deep_scrub_stamp":"2024-09-14T11:38:02.910912+0000","last_clean_scrub_stamp":"2024-09-14T11:38:02.910912+0000","objects_scrubbed":4,"log_size":77,"log_dups_size":300,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:22:21.469889+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":518,"num_read_kb":8094,"num_write":1138,"num_write_kb":45529,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"264'184","reported_seq":820,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.884396+0000","last_change":"2024-09-14T11:38:09.884320+0000","last_active":"2024-09-14T11:38:09.884396+0000","last_peered":"2024-09-14T11:38:09.884396+0000","last_clean":"2024-09-14T11:38:09.884396+0000","last_became_active":"2024-09-14T10:56:08.842085+0000","last_became_peered":"2024-09-14T10:56:08.842085+0000","last_unstale":"2024-09-14T11:38:09.884396+0000","last_undegraded":"2024-09-14T11:38:09.884396+0000","last_fullsized":"2024-09-14T11:38:09.884396+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:09.884229+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.884229+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:45:38.099864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":775,"num_read_kb":646,"num_write":251,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"264'368","reported_seq":1026,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.724348+0000","last_change":"2024-09-14T11:38:01.724263+0000","last_active":"2024-09-14T11:38:01.724348+0000","last_peered":"2024-09-14T11:38:01.724348+0000","last_clean":"2024-09-14T11:38:01.724348+0000","last_became_active":"2024-09-14T10:56:06.834184+0000","last_became_peered":"2024-09-14T10:56:06.834184+0000","last_unstale":"2024-09-14T11:38:01.724348+0000","last_undegraded":"2024-09-14T11:38:01.724348+0000","last_fullsized":"2024-09-14T11:38:01.724348+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:01.724153+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.724153+0000","objects_scrubbed":9,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T14:06:06.764518+0000","scrub_duration":9,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1962460,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":671,"num_read_kb":52898,"num_write":1154,"num_write_kb":19748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"264'184","reported_seq":792,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:01.305175+0000","last_change":"2024-09-14T11:38:01.305061+0000","last_active":"2024-09-14T11:38:01.305175+0000","last_peered":"2024-09-14T11:38:01.305175+0000","last_clean":"2024-09-14T11:38:01.305175+0000","last_became_active":"2024-09-14T10:56:08.840964+0000","last_became_peered":"2024-09-14T10:56:08.840964+0000","last_unstale":"2024-09-14T11:38:01.305175+0000","last_undegraded":"2024-09-14T11:38:01.305175+0000","last_fullsized":"2024-09-14T11:38:01.305175+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'184","last_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_deep_scrub":"264'184","last_deep_scrub_stamp":"2024-09-14T11:38:01.304953+0000","last_clean_scrub_stamp":"2024-09-14T11:38:01.304953+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:57:28.747455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":800,"num_read_kb":667,"num_write":262,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"264'368","reported_seq":1243,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.975041+0000","last_change":"2024-09-14T11:38:06.974983+0000","last_active":"2024-09-14T11:38:06.975041+0000","last_peered":"2024-09-14T11:38:06.975041+0000","last_clean":"2024-09-14T11:38:06.975041+0000","last_became_active":"2024-09-14T10:56:06.835702+0000","last_became_peered":"2024-09-14T10:56:06.835702+0000","last_unstale":"2024-09-14T11:38:06.975041+0000","last_undegraded":"2024-09-14T11:38:06.975041+0000","last_fullsized":"2024-09-14T11:38:06.975041+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:06.974873+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.974873+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T12:02:16.281919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1310,"num_read_kb":34715,"num_write":1227,"num_write_kb":19199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"264'92","reported_seq":692,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:11.842917+0000","last_change":"2024-09-14T11:38:11.842850+0000","last_active":"2024-09-14T11:38:11.842917+0000","last_peered":"2024-09-14T11:38:11.842917+0000","last_clean":"2024-09-14T11:38:11.842917+0000","last_became_active":"2024-09-14T10:56:08.842687+0000","last_became_peered":"2024-09-14T10:56:08.842687+0000","last_unstale":"2024-09-14T11:38:11.842917+0000","last_undegraded":"2024-09-14T11:38:11.842917+0000","last_fullsized":"2024-09-14T11:38:11.842917+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:11.842773+0000","last_clean_scrub_stamp":"2024-09-14T11:38:11.842773+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:04:45.306750+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":447,"num_read_kb":381,"num_write":127,"num_write_kb":55,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"264'395","reported_seq":1033,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.126636+0000","last_change":"2024-09-14T11:37:59.126563+0000","last_active":"2024-09-14T11:37:59.126636+0000","last_peered":"2024-09-14T11:37:59.126636+0000","last_clean":"2024-09-14T11:37:59.126636+0000","last_became_active":"2024-09-14T10:56:06.832191+0000","last_became_peered":"2024-09-14T10:56:06.832191+0000","last_unstale":"2024-09-14T11:37:59.126636+0000","last_undegraded":"2024-09-14T11:37:59.126636+0000","last_fullsized":"2024-09-14T11:37:59.126636+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'395","last_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_deep_scrub":"264'395","last_deep_scrub_stamp":"2024-09-14T11:37:59.126454+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.126454+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:35:37.405483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":652,"num_read_kb":11879,"num_write":1239,"num_write_kb":28071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"264'280","reported_seq":897,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.016973+0000","last_change":"2024-09-14T11:38:10.016899+0000","last_active":"2024-09-14T11:38:10.016973+0000","last_peered":"2024-09-14T11:38:10.016973+0000","last_clean":"2024-09-14T11:38:10.016973+0000","last_became_active":"2024-09-14T10:56:08.848397+0000","last_became_peered":"2024-09-14T10:56:08.848397+0000","last_unstale":"2024-09-14T11:38:10.016973+0000","last_undegraded":"2024-09-14T11:38:10.016973+0000","last_fullsized":"2024-09-14T11:38:10.016973+0000","mapping_epoch":25,"log_start":"264'200","ondisk_log_start":"264'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'280","last_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_deep_scrub":"264'280","last_deep_scrub_stamp":"2024-09-14T11:38:10.016803+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.016803+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T19:21:19.537700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1217,"num_read_kb":992,"num_write":422,"num_write_kb":203,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"264'406","reported_seq":1154,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:59.277818+0000","last_change":"2024-09-14T11:37:59.277763+0000","last_active":"2024-09-14T11:37:59.277818+0000","last_peered":"2024-09-14T11:37:59.277818+0000","last_clean":"2024-09-14T11:37:59.277818+0000","last_became_active":"2024-09-14T10:56:06.832125+0000","last_became_peered":"2024-09-14T10:56:06.832125+0000","last_unstale":"2024-09-14T11:37:59.277818+0000","last_undegraded":"2024-09-14T11:37:59.277818+0000","last_fullsized":"2024-09-14T11:37:59.277818+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'406","last_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_deep_scrub":"264'406","last_deep_scrub_stamp":"2024-09-14T11:37:59.277645+0000","last_clean_scrub_stamp":"2024-09-14T11:37:59.277645+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:31:27.504525+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":733,"num_read_kb":26249,"num_write":1207,"num_write_kb":24472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"264'142","reported_seq":761,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:05.135798+0000","last_change":"2024-09-14T11:38:05.135737+0000","last_active":"2024-09-14T11:38:05.135798+0000","last_peered":"2024-09-14T11:38:05.135798+0000","last_clean":"2024-09-14T11:38:05.135798+0000","last_became_active":"2024-09-14T10:56:08.839094+0000","last_became_peered":"2024-09-14T10:56:08.839094+0000","last_unstale":"2024-09-14T11:38:05.135798+0000","last_undegraded":"2024-09-14T11:38:05.135798+0000","last_fullsized":"2024-09-14T11:38:05.135798+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'142","last_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_deep_scrub":"264'142","last_deep_scrub_stamp":"2024-09-14T11:38:05.135630+0000","last_clean_scrub_stamp":"2024-09-14T11:38:05.135630+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:48:24.161099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":666,"num_read_kb":557,"num_write":215,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"264'368","reported_seq":1025,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:09.003022+0000","last_change":"2024-09-14T11:38:09.002948+0000","last_active":"2024-09-14T11:38:09.003022+0000","last_peered":"2024-09-14T11:38:09.003022+0000","last_clean":"2024-09-14T11:38:09.003022+0000","last_became_active":"2024-09-14T10:56:06.830590+0000","last_became_peered":"2024-09-14T10:56:06.830590+0000","last_unstale":"2024-09-14T11:38:09.003022+0000","last_undegraded":"2024-09-14T11:38:09.003022+0000","last_fullsized":"2024-09-14T11:38:09.003022+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:38:09.002842+0000","last_clean_scrub_stamp":"2024-09-14T11:38:09.002842+0000","objects_scrubbed":4,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T16:43:46.692925+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":666,"num_read_kb":46769,"num_write":1234,"num_write_kb":57650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"264'92","reported_seq":683,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:13.797537+0000","last_change":"2024-09-14T11:38:13.797439+0000","last_active":"2024-09-14T11:38:13.797537+0000","last_peered":"2024-09-14T11:38:13.797537+0000","last_clean":"2024-09-14T11:38:13.797537+0000","last_became_active":"2024-09-14T10:56:08.833581+0000","last_became_peered":"2024-09-14T10:56:08.833581+0000","last_unstale":"2024-09-14T11:38:13.797537+0000","last_undegraded":"2024-09-14T11:38:13.797537+0000","last_fullsized":"2024-09-14T11:38:13.797537+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'92","last_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_deep_scrub":"264'92","last_deep_scrub_stamp":"2024-09-14T11:38:13.797343+0000","last_clean_scrub_stamp":"2024-09-14T11:38:13.797343+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:15:13.340408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":426,"num_read_kb":365,"num_write":133,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"264'368","reported_seq":1032,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:55.257810+0000","last_change":"2024-09-14T11:37:55.257698+0000","last_active":"2024-09-14T11:37:55.257810+0000","last_peered":"2024-09-14T11:37:55.257810+0000","last_clean":"2024-09-14T11:37:55.257810+0000","last_became_active":"2024-09-14T10:56:06.832110+0000","last_became_peered":"2024-09-14T10:56:06.832110+0000","last_unstale":"2024-09-14T11:37:55.257810+0000","last_undegraded":"2024-09-14T11:37:55.257810+0000","last_fullsized":"2024-09-14T11:37:55.257810+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'368","last_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_deep_scrub":"264'368","last_deep_scrub_stamp":"2024-09-14T11:37:55.257597+0000","last_clean_scrub_stamp":"2024-09-14T11:37:55.257597+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:57:19.080090+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":696,"num_read_kb":4323,"num_write":1184,"num_write_kb":29987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"264'431","reported_seq":1161,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:06.980463+0000","last_change":"2024-09-14T11:38:06.980463+0000","last_active":"2024-09-14T11:38:06.980463+0000","last_peered":"2024-09-14T11:38:06.980463+0000","last_clean":"2024-09-14T11:38:06.980463+0000","last_became_active":"2024-09-14T10:56:08.851727+0000","last_became_peered":"2024-09-14T10:56:08.851727+0000","last_unstale":"2024-09-14T11:38:06.980463+0000","last_undegraded":"2024-09-14T11:38:06.980463+0000","last_fullsized":"2024-09-14T11:38:06.980463+0000","mapping_epoch":25,"log_start":"264'400","ondisk_log_start":"264'400","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'431","last_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_deep_scrub":"264'431","last_deep_scrub_stamp":"2024-09-14T11:38:06.980372+0000","last_clean_scrub_stamp":"2024-09-14T11:38:06.980372+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":400,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:20:22.678230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2079,"num_read_kb":1776,"num_write":766,"num_write_kb":505,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"264'306","reported_seq":926,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:03.931945+0000","last_change":"2024-09-14T11:38:03.931886+0000","last_active":"2024-09-14T11:38:03.931945+0000","last_peered":"2024-09-14T11:38:03.931945+0000","last_clean":"2024-09-14T11:38:03.931945+0000","last_became_active":"2024-09-14T10:56:06.834741+0000","last_became_peered":"2024-09-14T10:56:06.834741+0000","last_unstale":"2024-09-14T11:38:03.931945+0000","last_undegraded":"2024-09-14T11:38:03.931945+0000","last_fullsized":"2024-09-14T11:38:03.931945+0000","mapping_epoch":23,"log_start":"264'200","ondisk_log_start":"264'200","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'306","last_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_deep_scrub":"264'306","last_deep_scrub_stamp":"2024-09-14T11:38:03.931780+0000","last_clean_scrub_stamp":"2024-09-14T11:38:03.931780+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":200,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:48:42.380009+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655902,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":595,"num_read_kb":2905,"num_write":1051,"num_write_kb":12508,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"264'366","reported_seq":991,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:56.253803+0000","last_change":"2024-09-14T11:37:56.253747+0000","last_active":"2024-09-14T11:37:56.253803+0000","last_peered":"2024-09-14T11:37:56.253803+0000","last_clean":"2024-09-14T11:37:56.253803+0000","last_became_active":"2024-09-14T10:56:41.920824+0000","last_became_peered":"2024-09-14T10:56:41.920824+0000","last_unstale":"2024-09-14T11:37:56.253803+0000","last_undegraded":"2024-09-14T11:37:56.253803+0000","last_fullsized":"2024-09-14T11:37:56.253803+0000","mapping_epoch":36,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'366","last_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_deep_scrub":"264'366","last_deep_scrub_stamp":"2024-09-14T11:37:56.253643+0000","last_clean_scrub_stamp":"2024-09-14T11:37:56.253643+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":300,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T13:37:41.679508+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":610,"num_read_kb":51615,"num_write":1215,"num_write_kb":38907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"264'138","reported_seq":695,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.160953+0000","last_change":"2024-09-14T11:38:10.160953+0000","last_active":"2024-09-14T11:38:10.160953+0000","last_peered":"2024-09-14T11:38:10.160953+0000","last_clean":"2024-09-14T11:38:10.160953+0000","last_became_active":"2024-09-14T10:56:08.837074+0000","last_became_peered":"2024-09-14T10:56:08.837074+0000","last_unstale":"2024-09-14T11:38:10.160953+0000","last_undegraded":"2024-09-14T11:38:10.160953+0000","last_fullsized":"2024-09-14T11:38:10.160953+0000","mapping_epoch":25,"log_start":"261'100","ondisk_log_start":"261'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'138","last_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_deep_scrub":"264'138","last_deep_scrub_stamp":"2024-09-14T11:38:10.160870+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.160870+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T18:40:30.132911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":584,"num_read_kb":469,"num_write":211,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"264'349","reported_seq":984,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:37:58.545383+0000","last_change":"2024-09-14T11:37:58.545303+0000","last_active":"2024-09-14T11:37:58.545383+0000","last_peered":"2024-09-14T11:37:58.545383+0000","last_clean":"2024-09-14T11:37:58.545383+0000","last_became_active":"2024-09-14T10:56:06.832431+0000","last_became_peered":"2024-09-14T10:56:06.832431+0000","last_unstale":"2024-09-14T11:37:58.545383+0000","last_undegraded":"2024-09-14T11:37:58.545383+0000","last_fullsized":"2024-09-14T11:37:58.545383+0000","mapping_epoch":23,"log_start":"264'300","ondisk_log_start":"264'300","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'349","last_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_deep_scrub":"264'349","last_deep_scrub_stamp":"2024-09-14T11:37:58.545209+0000","last_clean_scrub_stamp":"2024-09-14T11:37:58.545209+0000","objects_scrubbed":2,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T17:40:58.985882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1655822,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":605,"num_read_kb":18767,"num_write":1102,"num_write_kb":24665,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"264'152","reported_seq":737,"reported_epoch":264,"state":"active+clean","last_fresh":"2024-09-14T11:38:10.979868+0000","last_change":"2024-09-14T11:38:10.979868+0000","last_active":"2024-09-14T11:38:10.979868+0000","last_peered":"2024-09-14T11:38:10.979868+0000","last_clean":"2024-09-14T11:38:10.979868+0000","last_became_active":"2024-09-14T10:56:08.840989+0000","last_became_peered":"2024-09-14T10:56:08.840989+0000","last_unstale":"2024-09-14T11:38:10.979868+0000","last_undegraded":"2024-09-14T11:38:10.979868+0000","last_fullsized":"2024-09-14T11:38:10.979868+0000","mapping_epoch":25,"log_start":"264'100","ondisk_log_start":"264'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'152","last_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_deep_scrub":"264'152","last_deep_scrub_stamp":"2024-09-14T11:38:10.979770+0000","last_clean_scrub_stamp":"2024-09-14T11:38:10.979770+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-15T22:49:08.122305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":648,"num_read_kb":529,"num_write":245,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10839,"num_read_kb":8947,"num_write":3117,"num_write_kb":1010,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1001,"ondisk_log_size":1001,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":14851,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":0,"num_read":15138,"num_read_kb":14802,"num_write":17079,"num_write_kb":4983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2521,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":29702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1770,"ondisk_log_size":1770,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":557,"ondisk_log_size":557,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":1610275,"num_objects":199,"num_object_clones":0,"num_object_copies":398,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":199,"num_whiteouts":0,"num_read":17487,"num_read_kb":37004,"num_write":14657,"num_write_kb":11695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":22,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":700984,"num_omap_keys":1616,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2016,"ondisk_log_size":2016,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2402,"num_read_kb":2863,"num_write":22,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":106420,"num_read_kb":88994,"num_write":37817,"num_write_kb":19016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":35465,"num_omap_keys":143,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4177,"ondisk_log_size":4177,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":33940714,"num_objects":277,"num_object_clones":0,"num_object_copies":554,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":277,"num_whiteouts":0,"num_read":44010,"num_read_kb":2045437,"num_write":72918,"num_write_kb":2160307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":68894720,"data_stored":67881428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3643,"ondisk_log_size":3643,"up":128,"acting":128,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":143,"num_read_kb":206212,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":138,"num_read_kb":193226,"num_write":160,"num_write_kb":134850,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":100,"ondisk_log_size":100,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509967,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":279124,"kb_used_data":9156,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94092716,"statfs":{"total":96636764160,"available":96350941184,"internally_reserved":0,"allocated":9375744,"data_stored":7712300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":276429258},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509966,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226860,"kb_used_data":6876,"kb_used_omap":1,"kb_used_meta":219966,"kb_avail":94144980,"statfs":{"total":96636764160,"available":96404459520,"internally_reserved":0,"allocated":7041024,"data_stored":5465111,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":225245638},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509965,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":90888,"kb_used_data":15288,"kb_used_omap":1,"kb_used_meta":75582,"kb_avail":94280952,"statfs":{"total":96636764160,"available":96543694848,"internally_reserved":0,"allocated":15654912,"data_stored":14047867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":77396421},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509967,"num_pgs":118,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":267756,"kb_used_data":15836,"kb_used_omap":1,"kb_used_meta":251902,"kb_avail":94104084,"statfs":{"total":96636764160,"available":96362582016,"internally_reserved":0,"allocated":16216064,"data_stored":14565484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":257948103},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509966,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":56752,"kb_used_data":11680,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94315088,"statfs":{"total":96636764160,"available":96578650112,"internally_reserved":0,"allocated":11960320,"data_stored":10430814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542671,"num_pgs":100,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":115056,"kb_used_data":11744,"kb_used_omap":1,"kb_used_meta":103294,"kb_avail":94256784,"statfs":{"total":96636764160,"available":96518946816,"internally_reserved":0,"allocated":12025856,"data_stored":10431815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105773509},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542668,"num_pgs":102,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255272,"kb_used_data":17304,"kb_used_omap":1,"kb_used_meta":237950,"kb_avail":94116568,"statfs":{"total":96636764160,"available":96375365632,"internally_reserved":0,"allocated":17719296,"data_stored":15992953,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":243661253},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575373,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":116548,"kb_used_data":9076,"kb_used_omap":1,"kb_used_meta":107454,"kb_avail":94255292,"statfs":{"total":96636764160,"available":96517419008,"internally_reserved":0,"allocated":9293824,"data_stored":7637406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":110033349},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13430784,"data_stored":13247355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8384512,"data_stored":8279522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8343552,"data_stored":8279343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12570624,"data_stored":12413553,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12062720,"data_stored":11898009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":5599232,"data_stored":5483519,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":3403776,"data_stored":3312046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":5099520,"data_stored":4968081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":1185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":6273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2464,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":3480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":4770,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-14T11:39:17.305 DEBUG:teuthology.orchestra.run.smithi002:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-14T11:39:17.654 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-14T11:39:17.654 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-14T11:39:17.655 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-14T11:39:17.655 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:17.706 INFO:tasks.ceph.osd.0:Stopped 2024-09-14T11:39:17.706 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-14T11:39:17.706 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:17.750 INFO:tasks.ceph.osd.1:Stopped 2024-09-14T11:39:17.750 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-14T11:39:17.750 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:17.796 INFO:tasks.ceph.osd.2:Stopped 2024-09-14T11:39:17.796 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-14T11:39:17.796 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:17.846 INFO:tasks.ceph.osd.3:Stopped 2024-09-14T11:39:17.846 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-14T11:39:17.846 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:17.885 INFO:tasks.ceph.osd.4:Stopped 2024-09-14T11:39:17.886 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-14T11:39:17.886 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:17.958 INFO:tasks.ceph.osd.5:Stopped 2024-09-14T11:39:17.958 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-14T11:39:17.958 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:18.046 INFO:tasks.ceph.osd.6:Stopped 2024-09-14T11:39:18.047 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-14T11:39:18.047 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:18.093 INFO:tasks.ceph.osd.7:Stopped 2024-09-14T11:39:18.093 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-14T11:39:18.093 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-14T11:39:18.094 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:18.119 INFO:tasks.ceph.mgr.y:Stopped 2024-09-14T11:39:18.120 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-14T11:39:18.120 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:18.149 INFO:tasks.ceph.mgr.x:Stopped 2024-09-14T11:39:18.149 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-14T11:39:18.150 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-14T11:39:18.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:18.175 INFO:tasks.ceph.mon.a:Stopped 2024-09-14T11:39:18.175 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-14T11:39:18.175 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:18.228 INFO:tasks.ceph.mon.c:Stopped 2024-09-14T11:39:18.228 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-14T11:39:18.229 INFO:teuthology.orchestra.run:waiting for 300 2024-09-14T11:39:18.241 INFO:tasks.ceph.mon.b:Stopped 2024-09-14T11:39:18.241 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-14T11:39:18.242 DEBUG:teuthology.orchestra.run.smithi002:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-14T11:39:18.312 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T11:39:18.312 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-14T11:39:18.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T11:39:18.547 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-14T11:39:18.720 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T11:39:18.720 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-14T11:39:18.809 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T11:39:18.809 DEBUG:teuthology.orchestra.run.smithi002:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-14T11:39:18.904 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T11:39:18.904 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-14T11:39:19.103 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T11:39:19.103 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-14T11:39:19.195 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T11:39:19.195 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-14T11:39:19.274 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T11:39:19.274 DEBUG:teuthology.orchestra.run.smithi086:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-14T11:39:19.338 INFO:tasks.ceph:Archiving mon data... 2024-09-14T11:39:19.339 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/data/mon.a.tgz 2024-09-14T11:39:19.340 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-14T11:39:19.371 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.w4LZJLtwFY 2024-09-14T11:39:19.372 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.w4LZJLtwFY 2024-09-14T11:39:19.559 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.w4LZJLtwFY 2024-09-14T11:39:19.671 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.w4LZJLtwFY is 431KB 2024-09-14T11:39:19.755 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.w4LZJLtwFY 2024-09-14T11:39:19.785 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/data/mon.c.tgz 2024-09-14T11:39:19.785 DEBUG:teuthology.orchestra.run.smithi002:> mktemp 2024-09-14T11:39:19.854 INFO:teuthology.orchestra.run.smithi002.stdout:/tmp/tmp.Hobqphi8NW 2024-09-14T11:39:19.854 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Hobqphi8NW 2024-09-14T11:39:20.025 DEBUG:teuthology.orchestra.run.smithi002:> sudo chmod 0666 /tmp/tmp.Hobqphi8NW 2024-09-14T11:39:20.136 DEBUG:teuthology.orchestra.remote:smithi002:/tmp/tmp.Hobqphi8NW is 433KB 2024-09-14T11:39:20.231 DEBUG:teuthology.orchestra.run.smithi002:> rm -fr /tmp/tmp.Hobqphi8NW 2024-09-14T11:39:20.260 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/data/mon.b.tgz 2024-09-14T11:39:20.260 DEBUG:teuthology.orchestra.run.smithi086:> mktemp 2024-09-14T11:39:20.294 INFO:teuthology.orchestra.run.smithi086.stdout:/tmp/tmp.WlUkcaCxB3 2024-09-14T11:39:20.295 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.WlUkcaCxB3 2024-09-14T11:39:20.494 DEBUG:teuthology.orchestra.run.smithi086:> sudo chmod 0666 /tmp/tmp.WlUkcaCxB3 2024-09-14T11:39:20.604 DEBUG:teuthology.orchestra.remote:smithi086:/tmp/tmp.WlUkcaCxB3 is 433KB 2024-09-14T11:39:20.684 DEBUG:teuthology.orchestra.run.smithi086:> rm -fr /tmp/tmp.WlUkcaCxB3 2024-09-14T11:39:20.712 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-14T11:39:20.712 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:39:20.714 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-14T11:39:20.825 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:39:20.859 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-14T11:39:20.859 INFO:tasks.ceph:Archiving crash dumps... 2024-09-14T11:39:20.861 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/remote/smithi002/crash 2024-09-14T11:39:20.862 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:39:20.906 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/remote/smithi086/crash 2024-09-14T11:39:20.907 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-14T11:39:20.944 INFO:tasks.ceph:Compressing logs... 2024-09-14T11:39:20.945 DEBUG:teuthology.orchestra.run.smithi002:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:39:20.950 DEBUG:teuthology.orchestra.run.smithi086:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-14T11:39:20.987 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-14T11:39:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157395.log 2024-09-14T11:39:20.988 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101434.log 2024-09-14T11:39:20.989 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.157395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189819.log 2024-09-14T11:39:21.013 INFO:teuthology.orchestra.run.smithi002.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.157395.log.gz 2024-09-14T11:39:21.013 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.101434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163355.log 2024-09-14T11:39:21.013 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.101434.log.gz 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127352.log 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189819.log.gz 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60750.log 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163355.log.gz 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147380.log 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.127352.log.gz 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81997.log 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr: 56.7% -- replaced with /var/log/ceph/ceph-client.admin.60750.log.gz 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.147380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109092.log 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.147380.log.gz 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.81997.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75808.log 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.81997.log.gz 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37358.log 2024-09-14T11:39:21.014 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.75808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124996.log 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.109092.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105557.log 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37358.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.124996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74264.log 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124996.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.105557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52991.log 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.74264.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37981.log 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 24.2% -- replaced with /var/log/ceph/ceph-client.admin.74264.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115571.log 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.52991.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175270.log 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37981.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 91.9% -- replaced with /var/log/ceph/ceph-client.0.75808.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.105557.log.gz 2024-09-14T11:39:21.015 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.115571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111448.log 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.115571.log.gz 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.175270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152681.log 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.175270.log.gz 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.111448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186159.log 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.111448.log.gz 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37615.log 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87887.log 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186159.log.gz 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130297.log 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37615.log.gz 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.87887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.87887.log.gz 2024-09-14T11:39:21.016 INFO:teuthology.orchestra.run.smithi002.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.152681.log.gz 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.130297.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189957.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.130297.log.gz 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.32781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63978.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gz 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189957.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26701.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189957.log.gz 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72492.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.tmp-client.admin.26701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178317.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26701.log.gz 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.72492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100256.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.178317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145024.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.72492.log.gz 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr: 80.4% -- replaced with /var/log/ceph/ceph-client.0.178317.log.gz 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.100256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58977.log 2024-09-14T11:39:21.017 INFO:teuthology.orchestra.run.smithi002.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.100256.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112626.log 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.145024.log: /var/log/ceph/ceph-client.admin.58977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133242.log 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.112626.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.58977.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.112626.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163992.log 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.133242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169945.log 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.133242.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47642.log 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.145024.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.169945.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.163992.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61322.log 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47642.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.169945.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.47642.log.gz 2024-09-14T11:39:21.018 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116160.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 54.2% -- replaced with /var/log/ceph/ceph-client.admin.61322.log.gz 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190141.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.116160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164581.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.116160.log.gz 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.190141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58340.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190141.log.gz 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.164581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.187612.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.164581.log.gz 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/ceph-client.admin.63978.log.gz 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186843.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58340.log.gz 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.187612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139132.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.187612.log.gz 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186843.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-14T11:39:21.019 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186843.log.gz 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84942.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ops-log-ceph-client.0.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.139132.log.gz 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163379.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.84942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55347.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.84942.log.gz 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163379.log.gz 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118516.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90832.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.55347.log.gz 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.118516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80819.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.90832.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.118516.log.gz 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181362.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90832.log.gz 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.80819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106735.log 2024-09-14T11:39:21.020 INFO:teuthology.orchestra.run.smithi002.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.80819.log.gz 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62740.log 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.181362.log: /var/log/ceph/ceph-client.admin.106735.log: gzip -5 --verbose -- 84.2% /var/log/ceph/ceph-client.admin.189635.log 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.0.181362.log.gz 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.106735.log.gz 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189589.log 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124407.log 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189635.log.gz 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189589.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189589.log.gz -5 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.81408.log 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.124407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93188.log 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.81408.log: 87.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154450.log 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.124407.log.gz 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.81408.log.gz 2024-09-14T11:39:21.021 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.93188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50022.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr: 80.9%/var/log/ceph/ceph-client.admin.154450.log: -- replaced with /var/log/ceph/ceph-client.admin.93188.log.gz 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169337.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.154450.log.gz 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89654.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50022.log.gz 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.169337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67076.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.169337.log.gz 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117927.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.89654.log: 81.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188318.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.89654.log.gz/var/log/ceph/ceph-client.admin.67076.log: 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37266.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117927.log.gz 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113215.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.188318.log: /var/log/ceph/ceph-client.admin.37266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93777.log 2024-09-14T11:39:21.022 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37266.log.gz 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186207.log 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.113215.log.gz 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.93777.log: gzip -5 --verbose -- 87.3% -- replaced with /var/log/ceph/ceph-client.admin.93777.log.gz 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.136187.log 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185547.log 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.186207.log.gz 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.136187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37610.log 2024-09-14T11:39:21.023 INFO:teuthology.orchestra.run.smithi002.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.136187.log.gz 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32773.log 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32905.log 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32773.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32773.log.gz 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32905.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32905.log.gz 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32817.log 2024-09-14T11:39:21.042 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32685.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32817.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32817.log.gz 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32861.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32685.log.gz 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32861.log.gz 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-osd.5.log: 91.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32641.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32641.log: gzip -5 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32641.log.gz 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr: --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32597.log 2024-09-14T11:39:21.043 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32729.log 2024-09-14T11:39:21.044 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32597.log.gz 2024-09-14T11:39:21.044 INFO:teuthology.orchestra.run.smithi086.stderr:/var/log/ceph/ceph-client.admin.32729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32729.log.gz 2024-09-14T11:39:21.044 INFO:teuthology.orchestra.run.smithi086.stderr: 87.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-14T11:39:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.185547.log: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.185547.log.gz 2024-09-14T11:39:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122051.log 2024-09-14T11:39:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37610.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37610.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102612.log 2024-09-14T11:39:21.102 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189543.log 2024-09-14T11:39:21.102 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.122051.log: /var/log/ceph/ceph-client.admin.102612.log: 82.0% 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122051.log.gz 2024-09-14T11:39:21.102 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.102612.log.gz 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76417.log 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189543.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189543.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.41756.log 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.76417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189727.log 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.76417.log.gz 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39935.log 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.41756.log: 43.2% -- replaced with /var/log/ceph/ceph-client.0.41756.log.gz 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189727.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189727.log.gz 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61386.log 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106146.log 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.39935.log: /var/log/ceph/ceph-client.admin.61386.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.39935.log.gz 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.61386.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33119.log 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.106146.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.106146.log.gz 2024-09-14T11:39:21.103 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158574.log 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179535.log 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.33119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33119.log.gz 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.158574.log: 93.9% -- replaced with /var/log/ceph/ceph-client.admin.62740.log.gz 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158574.log.gz 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190003.log 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.0.179535.log: /var/log/ceph/ceph-client.admin.190188.log 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.190003.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.179535.log.gz 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33214.log 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.190003.log.gz 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75042.log 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.190188.log: /var/log/ceph/ceph-client.admin.33214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90243.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33214.log.gz 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.75042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190188.log.gz 2024-09-14T11:39:21.104 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102023.log 84.4% -- replaced with /var/log/ceph/ceph-client.0.75042.log.gz 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.90243.log: gzip -5 --verbose 81.2% -- replaced with /var/log/ceph/ceph-client.admin.90243.log.gz 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.119694.log 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.102023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162177.log 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102023.log.gz 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.119694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47618.log 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119694.log.gz 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.162177.log: -- /var/log/ceph/ceph-client.admin.37207.log 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47618.log: 82.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162177.log.gz 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47618.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146202.log 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189497.log 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37207.log: /var/log/ceph/ceph-client.admin.146202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37207.log.gz 2024-09-14T11:39:21.105 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132064.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189497.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.146202.log.gz 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53580.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189497.log.gz 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.132064.log: -- /var/log/ceph/ceph-client.admin.56573.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.53580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151503.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132064.log.gz 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.53580.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49409.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.56573.log: /var/log/ceph/ceph-client.admin.151503.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.56573.log.gz 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr: 82.6% -- replaced with /var/log/ceph/ceph-client.admin.151503.log.gz 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149736.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51813.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.49409.log.gz 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171309.log 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.149736.log.gz 2024-09-14T11:39:21.106 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120283.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.51813.log: gzip 80.8% -- replaced with /var/log/ceph/ceph-client.admin.51813.log.gz 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.181971.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.120283.log: /var/log/ceph/ceph-client.admin.171309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104968.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.181971.log: 92.3% 80.6% -- replaced with /var/log/ceph/ceph-client.0.181971.log.gz 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.171309.log.gz 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69552.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104968.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.120283.log.gz 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38602.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104968.log.gz 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38556.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.69552.log: /var/log/ceph/ceph-client.admin.38602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39332.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38602.log.gz 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38556.log.gz 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47594.log 2024-09-14T11:39:21.107 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.39332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55960.log 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.39332.log.gz 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47594.log.gz 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42962.log 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55960.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr: 95.1% -- replaced with /var/log/ceph/ceph-client.admin.67076.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55960.log.gz 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.42962.log: gzip 42.5% -- replaced with /var/log/ceph/ceph-client.0.42962.log.gz 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.129119.log 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170701.log 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.129119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113804.log 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.129119.log.gz 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.170701.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.69552.log.gz 2024-09-14T11:39:21.108 INFO:teuthology.orchestra.run.smithi002.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.admin.170701.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37404.log 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.113804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37978.log 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr: 86.9%/var/log/ceph/ceph-client.admin.37404.log: -- replaced with /var/log/ceph/ceph-client.admin.113804.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37404.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77284.log 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr: 94.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37613.log 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37978.log: 86.9% -- replaced with /var/log/ceph/ceph-client.0.188318.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37978.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.77284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50635.log 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.77284.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180144.log 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37613.log.gz 2024-09-14T11:39:21.109 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41147.log 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.180144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60476.log 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.50635.log.gz 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.180144.log.gz 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.41147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68933.log 80.6% -- replaced with /var/log/ceph/ceph-client.0.41147.log.gz 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.60476.log: 59.1% -- replaced with /var/log/ceph/ceph-client.admin.60476.log.gz 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157984.log 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.68933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186819.log 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.157984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68314.log 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.157984.log.gz 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186183.log 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186819.log.gz 2024-09-14T11:39:21.110 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.68314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153270.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.68933.log.gz 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96133.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186183.log.gz 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.153270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37312.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9%/var/log/ceph/ceph-client.admin.96133.log: -- replaced with /var/log/ceph/ceph-client.admin.153270.log.gz 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155628.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.68314.log.gz 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.96133.log.gz 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37312.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37312.log.gz 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.155628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182580.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.155628.log.gz 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156217.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.182580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98489.log 2024-09-14T11:39:21.111 INFO:teuthology.orchestra.run.smithi002.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.182580.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.156217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61192.log 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.98489.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.156217.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139721.log 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.98489.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.61192.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107325.log 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.139721.log: gzip -5 --verbose -- 81.9% -- replaced with /var/log/ceph/ceph-client.admin.139721.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.126763.log 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.107325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96722.log 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126763.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.107325.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose 82.0% -- replaced with /var/log/ceph/ceph-client.admin.126763.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr: -- /var/log/ceph/ceph-client.admin.143846.log 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.96722.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.96722.log.gz 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189865.log 2024-09-14T11:39:21.112 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153859.log 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.143846.log: 94.3% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.143846.log.gz 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189865.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.189865.log.gz -- 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.143257.log 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.153859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40544.log 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.153859.log.gz 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.143257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161564.log 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.143257.log.gz 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.40544.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.40544.log.gz 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88476.log 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80230.log 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161564.log.gz 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.88476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138543.log 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.88476.log.gz 2024-09-14T11:39:21.113 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.80230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190049.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.80230.log.gz 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.138543.log: gzip -5 --verbose -- 81.8% -- replaced with /var/log/ceph/ceph-client.admin.138543.log.gz 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.58388.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.190049.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190049.log.gz 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37979.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65836.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.58388.log.gz 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77873.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37979.log.gz 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38186.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65836.log: /var/log/ceph/ceph-client.admin.77873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100845.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.77873.log.gz 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149147.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38186.log.gz 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.100845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86709.log 2024-09-14T11:39:21.114 INFO:teuthology.orchestra.run.smithi002.stderr: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.100845.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.149147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74433.log 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.86709.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.65836.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.86709.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.74433.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.74433.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145613.log 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.149147.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91421.log 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103790.log 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.145613.log: /var/log/ceph/ceph-client.admin.91421.log: gzip -5 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145613.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.37118.log 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.91421.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.103790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57162.log 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.103790.log.gz 2024-09-14T11:39:21.115 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172525.log 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37118.log.gz 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120872.log 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.57162.log.gz 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.172525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60869.log 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5/var/log/ceph/ceph-client.admin.120872.log: --verbose -- 92.3% -- replaced with /var/log/ceph/ceph-client.admin.172525.log.gz 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.116749.log 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0%/var/log/ceph/ceph-client.admin.60869.log: -- replaced with /var/log/ceph/ceph-client.admin.120872.log.gz 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr: 53.7% -- replaced with /var/log/ceph/ceph-client.admin.60869.log.gz 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37983.log 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161540.log 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.116749.log: /var/log/ceph/ceph-client.admin.37983.log: gzip -5 87.2% -- replaced with /var/log/ceph/ceph-client.admin.116749.log.gz 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37983.log.gz 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38692.log 2024-09-14T11:39:21.116 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.161540.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.189359.log -- replaced with /var/log/ceph/ceph-client.admin.161540.log.gz 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38646.log 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38692.log.gz 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45238.log 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189359.log.gz 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42359.log 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38646.log.gz 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.45238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121462.log 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.45238.log.gz 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.42359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186892.log 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: 43.5% -- replaced with /var/log/ceph/ceph-client.0.42359.log.gz 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.121462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95544.log 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186892.log: gzip 87.3% -- replaced with /var/log/ceph/ceph-client.admin.121462.log.gz 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.142668.log 2024-09-14T11:39:21.117 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.186892.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.95544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78462.log 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.142668.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.95544.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123818.log 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.142668.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.78462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123229.log 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.78462.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159184.log 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.123818.log: /var/log/ceph/ceph-client.admin.123229.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.123818.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92599.log 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.123229.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.159184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37841.log 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 86.6% -- replaced with /var/log/ceph/ceph-client.admin.159184.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.92599.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.130886.log 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37841.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.92599.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37841.log.gz 2024-09-14T11:39:21.118 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112037.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82586.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.130886.log: /var/log/ceph/ceph-client.admin.112037.log: gzip -5 87.3% --verbose -- /var/log/ceph/ceph-client.admin.67695.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.130886.log.gz 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.82586.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89065.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 87.9% -- replaced with /var/log/ceph/ceph-client.admin.82586.log.gz -5 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.67695.log: gzip/var/log/ceph/ceph-client.admin.89065.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.158595.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mon.a.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.112037.log.gz 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75752.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.158595.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.89065.log.gz 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.158595.log.gz 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49998.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.75752.log: gzip 50.5% -5 --verbose -- /var/log/ceph/ceph-client.admin.132653.log 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.67695.log.gz 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75752.log.gz 2024-09-14T11:39:21.119 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.49998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49998.log.gz 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62151.log 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.132653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37608.log 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103201.log 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.62151.log.gz 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37608.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37608.log.gz 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114982.log 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.132653.log.gz 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.103201.log: /var/log/ceph/ceph-client.admin.45827.log 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114982.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.103201.log.gz 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54758.log 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.114982.log.gz 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:gzip/var/log/ceph/ceph-client.admin.45827.log: -5 --verbose -- /var/log/ceph/ceph-client.0.180753.log 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7%/var/log/ceph/ceph-client.admin.54758.log: -- replaced with /var/log/ceph/ceph-client.admin.45827.log.gz 2024-09-14T11:39:21.120 INFO:teuthology.orchestra.run.smithi002.stderr:gzip 80.6% -- replaced with /var/log/ceph/ceph-client.admin.54758.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.141488.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.180753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166576.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.180753.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.141488.log: gzip -5 --verbose -- 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141488.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.189405.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.166576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140310.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189405.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129708.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140310.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.140310.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61256.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.175881.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.129708.log: /var/log/ceph/ceph-client.admin.61256.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.129708.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136776.log 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.175881.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.175881.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.166576.log.gz 2024-09-14T11:39:21.121 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73673.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66457.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.73673.log: /var/log/ceph/ceph-client.admin.136776.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.136776.log.gz 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.73673.log.gz 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.66457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107914.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.2.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.66457.log.gz 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159773.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.107914.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.107914.log.gz 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37986.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.159773.log: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.159773.log.gz 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37182.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37986.log.gz 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190232.log 2024-09-14T11:39:21.122 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37182.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190095.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.190232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190232.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189175.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.190095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190095.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71311.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189175.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173414.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.71311.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.71311.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.184958.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.173414.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.61256.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.173414.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87298.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.184958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155039.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.184958.log.gz 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.87298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186867.log 2024-09-14T11:39:21.123 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.155039.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.87298.log.gz 2024-09-14T11:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr: 82.5% -- replaced with /var/log/ceph/ceph-client.admin.155039.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38232.log 2024-09-14T11:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.186867.log.gz 2024-09-14T11:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-14T11:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38232.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109681.log 2024-09-14T11:39:21.124 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38232.log.gz 2024-09-14T11:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.165927.log 2024-09-14T11:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.109681.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.109681.log.gz 2024-09-14T11:39:21.125 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57751.log 2024-09-14T11:39:21.126 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.165927.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.165927.log.gz 2024-09-14T11:39:21.130 INFO:teuthology.orchestra.run.smithi002.stderr: 94.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-14T11:39:21.131 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156806.log 2024-09-14T11:39:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.57751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61111.log 2024-09-14T11:39:21.132 INFO:teuthology.orchestra.run.smithi002.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.57751.log.gz 2024-09-14T11:39:21.132 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.156806.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.156806.log.gz 2024-09-14T11:39:21.132 INFO:teuthology.orchestra.run.smithi002.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-14T11:39:21.137 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135598.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125585.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61111.log: gzip/var/log/ceph/ceph-client.admin.135598.log: -5 --verbose -- 89.5% -- replaced with /var/log/ceph/ceph-client.admin.61111.log.gz 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr: /var/log/ceph/ceph-client.admin.146791.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135598.log.gz 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50046.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.125585.log: /var/log/ceph/ceph-client.admin.146791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61971.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr: 82.1% 81.8% -- replaced with /var/log/ceph/ceph-client.admin.125585.log.gz 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.50046.log: -- replaced with /var/log/ceph/ceph-client.admin.146791.log.gz 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.50046.log.gz 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178926.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152092.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.61971.log: gzip -5 --verbose/var/log/ceph/ceph-client.0.178926.log: -- /var/log/ceph/ceph-client.admin.94955.log 2024-09-14T11:39:21.138 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.152092.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.61971.log.gz 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.178926.log.gz 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.152092.log.gz 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65216.log 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94366.log 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.94955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79051.log 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.65216.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94955.log.gz 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.94366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83175.log 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.79051.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94366.log.gz 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.79051.log.gzgzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-14T11:39:21.139 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.83175.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.83175.log.gz 2024-09-14T11:39:21.143 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189129.log 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph.log: -- /var/log/ceph/ceph-client.admin.37614.log 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189129.log.gz 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37025.log 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37614.log.gz 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186137.log 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr: 93.0% -- replaced with /var/log/ceph/ceph-client.admin.65216.log.gz 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37025.log.gz 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48231.log 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177708.log 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186137.log: 23.4% -- replaced with /var/log/ceph/ceph-client.admin.186137.log.gz 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48231.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70218.log 2024-09-14T11:39:21.144 INFO:teuthology.orchestra.run.smithi002.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.admin.48231.log.gz 2024-09-14T11:39:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.177708.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.177708.log.gz 2024-09-14T11:39:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97900.log 2024-09-14T11:39:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37606.log 2024-09-14T11:39:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.70218.log: /var/log/ceph/ceph-client.admin.97900.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.70218.log.gz 2024-09-14T11:39:21.146 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.97900.log.gz 2024-09-14T11:39:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62037.log 2024-09-14T11:39:21.146 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37606.log.gz 2024-09-14T11:39:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71900.log 2024-09-14T11:39:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108503.log 2024-09-14T11:39:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.62037.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.62037.log.gz 2024-09-14T11:39:21.148 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.71900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168121.log 2024-09-14T11:39:21.148 INFO:teuthology.orchestra.run.smithi002.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.71900.log.gz 2024-09-14T11:39:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.108503.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.108503.log.gz 2024-09-14T11:39:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183189.log 2024-09-14T11:39:21.149 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/ceph.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189221.log 2024-09-14T11:39:21.149 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.149 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.168121.log: /var/log/ceph/ceph-client.0.183189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104379.log 2024-09-14T11:39:21.151 INFO:teuthology.orchestra.run.smithi002.stderr: 84.1%/var/log/ceph/ceph-client.admin.189221.log: -- replaced with /var/log/ceph/ceph-client.0.183189.log.gz 2024-09-14T11:39:21.151 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189221.log.gz 2024-09-14T11:39:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140899.log 2024-09-14T11:39:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.104379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127941.log 2024-09-14T11:39:21.151 INFO:teuthology.orchestra.run.smithi002.stderr: 81.6% 93.2% -- replaced with /var/log/ceph/ceph-client.admin.168121.log.gz 2024-09-14T11:39:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.140899.log: -- replaced with /var/log/ceph/ceph-client.admin.104379.log.gz 2024-09-14T11:39:21.151 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131475.log 2024-09-14T11:39:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92010.log 2024-09-14T11:39:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.127941.log: /var/log/ceph/ceph-client.admin.131475.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.127941.log.gz 2024-09-14T11:39:21.159 INFO:teuthology.orchestra.run.smithi002.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.131475.log.gz 86.2% -- replaced with /var/log/ceph/ceph-client.admin.140899.log.gz 2024-09-14T11:39:21.159 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55936.log 2024-09-14T11:39:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167184.log 2024-09-14T11:39:21.159 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.92010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48820.log 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.92010.log.gz 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55936.log: 0.0%/var/log/ceph/ceph-client.admin.167184.log: -- replaced with /var/log/ceph/ceph-client.admin.55936.log.gz 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133831.log 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.167184.log.gz 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.48820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128530.log 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.48820.log.gz 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148558.log 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.133831.log: /var/log/ceph/ceph-client.admin.128530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51224.log 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.133831.log.gz 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.128530.log.gz 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.148558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83764.log 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8%/var/log/ceph/ceph-client.admin.51224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174661.log 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.148558.log.gz 2024-09-14T11:39:21.160 INFO:teuthology.orchestra.run.smithi002.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.51224.log.gz 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186916.log 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.83764.log: /var/log/ceph/ceph-client.0.174661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37985.log 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.83764.log.gz 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186916.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174661.log.gz 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142077.log 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.186916.log.gz 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122640.log 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37985.log.gz 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.142077.log: /var/log/ceph/ceph-client.admin.122640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189083.log 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.142077.log.gz 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/rgw.ceph.client.0.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.122640.log.gz 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64597.log 2024-09-14T11:39:21.161 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58364.log 2024-09-14T11:39:21.162 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189083.log.gz 2024-09-14T11:39:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.64597.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52402.log 2024-09-14T11:39:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.58364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2024-09-14T11:39:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38715.log 2024-09-14T11:39:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.52402.log: 80.6% -- replaced with /var/log/ceph/ceph-client.admin.52402.log.gz 2024-09-14T11:39:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79640.log 2024-09-14T11:39:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.38715.log: 95.8% -- replaced with /var/log/ceph/ceph-client.0.38715.log.gz 2024-09-14T11:39:21.163 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174022.log 2024-09-14T11:39:21.164 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.79640.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79640.log.gz 2024-09-14T11:39:21.164 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137954.log 2024-09-14T11:39:21.166 INFO:teuthology.orchestra.run.smithi002.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.64597.log.gz/var/log/ceph/ceph-client.admin.174022.log: 2024-09-14T11:39:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168729.log 2024-09-14T11:39:21.166 INFO:teuthology.orchestra.run.smithi002.stderr: 92.3%/var/log/ceph/ceph-client.admin.137954.log: -- replaced with /var/log/ceph/ceph-client.admin.174022.log.gz 2024-09-14T11:39:21.166 INFO:teuthology.orchestra.run.smithi002.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.137954.log.gz 2024-09-14T11:39:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99078.log 2024-09-14T11:39:21.166 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176490.log 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.168729.log: /var/log/ceph/ceph-client.admin.99078.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.168729.log.gz 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.99078.log.gz 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47005.log 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.0.176490.log: -- /var/log/ceph/ceph-client.admin.55984.log 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr: 80.1% -- replaced with /var/log/ceph/ceph-client.0.176490.log.gz 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.47005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54169.log 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.55984.log: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.47005.log.gz 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.admin.55984.log.gz 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161588.log 2024-09-14T11:39:21.170 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59566.log 2024-09-14T11:39:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.54169.log: /var/log/ceph/ceph-client.admin.161588.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.54169.log.gz 2024-09-14T11:39:21.172 INFO:teuthology.orchestra.run.smithi002.stderr: 82.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150914.log 2024-09-14T11:39:21.172 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.161588.log.gz 2024-09-14T11:39:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.59566.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.59566.log.gz 2024-09-14T11:39:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189451.log 2024-09-14T11:39:21.172 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63359.log 2024-09-14T11:39:21.173 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150914.log: /var/log/ceph/ceph-client.admin.189451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189451.log.gz 2024-09-14T11:39:21.173 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110859.log 2024-09-14T11:39:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.63359.log: 86.0% 85.8% -- replaced with /var/log/ceph/ceph-client.admin.150914.log.gz 2024-09-14T11:39:21.175 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63359.log.gz 2024-09-14T11:39:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73082.log 2024-09-14T11:39:21.175 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.110859.log: -- /var/log/ceph/ceph-client.admin.86120.log 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110859.log.gz 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.73082.log: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.73082.log.gz 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189267.log 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.86120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110270.log 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86120.log.gz 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144435.log 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.110270.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189267.log.gz 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43565.log 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.110270.log.gz 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.144435.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189773.log 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.43565.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.144435.log.gz 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.43565.log.gz 2024-09-14T11:39:21.179 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38278.log 2024-09-14T11:39:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37618.log 2024-09-14T11:39:21.182 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189773.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189773.log.gz 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.38278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38278.log.gz 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147969.log 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117338.log 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.147969.log: /var/log/ceph/ceph-client.admin.37618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37618.log.gz 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.147969.log.gz 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189911.log 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186797.log 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.117338.log: /var/log/ceph/ceph-client.admin.189911.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.117338.log.gz 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189911.log.gz 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189313.log 2024-09-14T11:39:21.183 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135009.log 2024-09-14T11:39:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.186797.log: 23.9% -- replaced with /var/log/ceph/ceph-client.admin.186797.log.gz 2024-09-14T11:39:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189313.log.gz 2024-09-14T11:39:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85531.log 2024-09-14T11:39:21.186 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97311.log 2024-09-14T11:39:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.135009.log: /var/log/ceph/ceph-client.admin.85531.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.135009.log.gz 2024-09-14T11:39:21.187 INFO:teuthology.orchestra.run.smithi002.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162766.log 2024-09-14T11:39:21.187 INFO:teuthology.orchestra.run.smithi002.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85531.log.gz 2024-09-14T11:39:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-14T11:39:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.97311.log: /var/log/ceph/ceph-client.admin.162766.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.162766.log.gz 2024-09-14T11:39:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163403.log 2024-09-14T11:39:21.187 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-osd.3.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.97311.log.gz 2024-09-14T11:39:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171917.log 2024-09-14T11:39:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.163403.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163403.log.gz 2024-09-14T11:39:21.188 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119105.log 2024-09-14T11:39:21.189 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.171917.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171917.log.gz 2024-09-14T11:39:21.189 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126174.log 2024-09-14T11:39:21.190 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.119105.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.119105.log.gz 2024-09-14T11:39:21.190 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150325.log 2024-09-14T11:39:21.192 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.126174.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.126174.log.gz 2024-09-14T11:39:21.193 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160362.log 2024-09-14T11:39:21.193 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.150325.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.150325.log.gz 2024-09-14T11:39:21.194 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84353.log 2024-09-14T11:39:21.194 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.160362.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.160362.log.gz 2024-09-14T11:39:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177099.log 2024-09-14T11:39:21.195 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.84353.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.84353.log.gz 2024-09-14T11:39:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183798.log 2024-09-14T11:39:21.196 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.177099.log: 83.9% -- replaced with /var/log/ceph/ceph-client.0.177099.log.gz 2024-09-14T11:39:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46416.log 2024-09-14T11:39:21.197 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.0.183798.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.183798.log.gz 2024-09-14T11:39:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134420.log 2024-09-14T11:39:21.198 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.46416.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.46416.log.gz 2024-09-14T11:39:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160951.log 2024-09-14T11:39:21.199 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.134420.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.134420.log.gz 2024-09-14T11:39:21.200 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137365.log 2024-09-14T11:39:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.160951.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.160951.log.gz 2024-09-14T11:39:21.201 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99667.log 2024-09-14T11:39:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.137365.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.137365.log.gz 2024-09-14T11:39:21.202 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37617.log 2024-09-14T11:39:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.99667.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.99667.log.gz 2024-09-14T11:39:21.203 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189681.log 2024-09-14T11:39:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37617.log.gz 2024-09-14T11:39:21.204 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114393.log 2024-09-14T11:39:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.189681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189681.log.gz 2024-09-14T11:39:21.205 INFO:teuthology.orchestra.run.smithi002.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37842.log 2024-09-14T11:39:21.206 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.114393.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.114393.log.gz 2024-09-14T11:39:21.207 INFO:teuthology.orchestra.run.smithi002.stderr:/var/log/ceph/ceph-client.admin.37842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37842.log.gz 2024-09-14T11:39:21.346 INFO:teuthology.orchestra.run.smithi086.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-14T11:39:21.623 INFO:teuthology.orchestra.run.smithi002.stderr: 92.7% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-14T11:39:22.071 INFO:teuthology.orchestra.run.smithi086.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-14T11:39:22.792 INFO:teuthology.orchestra.run.smithi002.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-14T11:39:24.586 INFO:teuthology.orchestra.run.smithi002.stderr: 93.6% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-14T11:39:26.399 INFO:teuthology.orchestra.run.smithi002.stderr: 93.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-14T11:39:28.708 INFO:teuthology.orchestra.run.smithi086.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-14T11:39:28.733 INFO:teuthology.orchestra.run.smithi002.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-14T11:39:28.783 INFO:teuthology.orchestra.run.smithi086.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-14T11:39:29.417 INFO:teuthology.orchestra.run.smithi086.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-14T11:39:35.233 INFO:teuthology.orchestra.run.smithi002.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-14T11:39:36.019 INFO:teuthology.orchestra.run.smithi086.stderr: 95.2% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-14T11:39:36.021 INFO:teuthology.orchestra.run.smithi086.stderr: 2024-09-14T11:39:36.021 INFO:teuthology.orchestra.run.smithi086.stderr:real 0m15.006s 2024-09-14T11:39:36.021 INFO:teuthology.orchestra.run.smithi086.stderr:user 0m38.744s 2024-09-14T11:39:36.021 INFO:teuthology.orchestra.run.smithi086.stderr:sys 0m1.404s 2024-09-14T11:39:42.020 INFO:teuthology.orchestra.run.smithi002.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-14T11:39:42.022 INFO:teuthology.orchestra.run.smithi002.stderr: 2024-09-14T11:39:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:real 0m21.045s 2024-09-14T11:39:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:user 0m52.472s 2024-09-14T11:39:42.022 INFO:teuthology.orchestra.run.smithi002.stderr:sys 0m1.930s 2024-09-14T11:39:42.022 INFO:tasks.ceph:Archiving logs... 2024-09-14T11:39:42.022 DEBUG:teuthology.misc:Transferring archived files from smithi002:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/remote/smithi002/log 2024-09-14T11:39:42.024 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:39:48.806 DEBUG:teuthology.misc:Transferring archived files from smithi086:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/remote/smithi086/log 2024-09-14T11:39:48.807 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-14T11:39:54.079 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-14T11:39:54.090 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-14T11:39:54.090 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:39:54.093 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-14T11:39:54.196 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-14T11:39:54.208 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-14T11:39:54.209 DEBUG:teuthology.orchestra.run.smithi002:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:39:54.211 DEBUG:teuthology.orchestra.run.smithi086:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-14T11:39:54.241 INFO:teuthology.orchestra.run.smithi086.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:39:54.241 INFO:teuthology.orchestra.run.smithi002.stderr:bash: line 1: ntpq: command not found 2024-09-14T11:39:54.245 INFO:teuthology.orchestra.run.smithi086.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:39:54.245 INFO:teuthology.orchestra.run.smithi086.stdout:=============================================================================== 2024-09-14T11:39:54.245 INFO:teuthology.orchestra.run.smithi086.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 +2423us[+2401us] +/- 56ms 2024-09-14T11:39:54.245 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 +2401us[+2401us] +/- 56ms 2024-09-14T11:39:54.245 INFO:teuthology.orchestra.run.smithi086.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 18 -9971us[-9993us] +/- 104ms 2024-09-14T11:39:54.245 INFO:teuthology.orchestra.run.smithi086.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:39:54.247 INFO:teuthology.orchestra.run.smithi002.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-14T11:39:54.247 INFO:teuthology.orchestra.run.smithi002.stdout:=============================================================================== 2024-09-14T11:39:54.247 INFO:teuthology.orchestra.run.smithi002.stdout:^* hv01.front.sepia.ceph.com 3 6 377 14 +2366us[+2519us] +/- 56ms 2024-09-14T11:39:54.247 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 +2343us[+2343us] +/- 56ms 2024-09-14T11:39:54.247 INFO:teuthology.orchestra.run.smithi002.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 14 -10ms[ -10ms] +/- 104ms 2024-09-14T11:39:54.247 INFO:teuthology.orchestra.run.smithi002.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-14T11:39:54.247 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-14T11:39:54.257 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-14T11:39:54.257 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-14T11:39:54.267 DEBUG:teuthology.orchestra.run.smithi002:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:39:54.373 DEBUG:teuthology.orchestra.run.smithi086:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-14T11:39:54.446 DEBUG:teuthology.orchestra.run.smithi002:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:39:54.490 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:39:54.491 DEBUG:teuthology.orchestra.run.smithi086:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-14T11:39:54.532 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:39:54.532 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-14T11:39:54.542 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-14T11:39:54.553 INFO:teuthology.task.internal:Duration was 3097.476367 seconds 2024-09-14T11:39:54.553 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-14T11:39:54.563 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-14T11:39:54.563 DEBUG:teuthology.orchestra.run.smithi002:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:39:54.565 DEBUG:teuthology.orchestra.run.smithi086:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-14T11:39:54.620 INFO:teuthology.orchestra.run.smithi002.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:39:54.625 INFO:teuthology.orchestra.run.smithi086.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-14T11:39:54.841 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-14T11:39:54.841 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi002.front.sepia.ceph.com 2024-09-14T11:39:54.842 DEBUG:teuthology.orchestra.run.smithi002:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:39:54.877 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi086.front.sepia.ceph.com 2024-09-14T11:39:54.877 DEBUG:teuthology.orchestra.run.smithi086:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-14T11:39:54.916 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-14T11:39:54.916 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:39:54.920 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-14T11:39:54.995 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-14T11:39:54.995 DEBUG:teuthology.orchestra.run.smithi002:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:39:55.001 DEBUG:teuthology.orchestra.run.smithi086:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-14T11:39:55.148 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-14T11:39:55.159 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-14T11:39:55.159 DEBUG:teuthology.orchestra.run.smithi002:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:39:55.198 DEBUG:teuthology.orchestra.run.smithi086:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-14T11:39:55.236 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-14T11:39:55.247 DEBUG:teuthology.orchestra.run.smithi002:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:39:55.249 DEBUG:teuthology.orchestra.run.smithi086:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:39:55.285 INFO:teuthology.orchestra.run.smithi002.stdout:kernel.core_pattern = core 2024-09-14T11:39:55.312 INFO:teuthology.orchestra.run.smithi086.stdout:kernel.core_pattern = core 2024-09-14T11:39:55.342 DEBUG:teuthology.orchestra.run.smithi002:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:39:55.370 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:39:55.371 DEBUG:teuthology.orchestra.run.smithi086:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-14T11:39:55.410 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-14T11:39:55.410 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-14T11:39:55.420 INFO:teuthology.task.internal:Transferring archived files... 2024-09-14T11:39:55.421 DEBUG:teuthology.misc:Transferring archived files from smithi002:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/remote/smithi002 2024-09-14T11:39:55.421 DEBUG:teuthology.orchestra.run.smithi002:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:39:55.472 DEBUG:teuthology.misc:Transferring archived files from smithi086:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_20:40:18-rgw-main-distro-default-smithi/7904141/remote/smithi086 2024-09-14T11:39:55.472 DEBUG:teuthology.orchestra.run.smithi086:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-14T11:39:55.518 INFO:teuthology.task.internal:Removing archive directory... 2024-09-14T11:39:55.519 DEBUG:teuthology.orchestra.run.smithi002:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:39:55.521 DEBUG:teuthology.orchestra.run.smithi086:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-14T11:39:55.581 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-14T11:39:55.593 INFO:teuthology.task.internal:Not uploading archives. 2024-09-14T11:39:55.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-14T11:39:55.604 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-14T11:39:55.604 DEBUG:teuthology.orchestra.run.smithi002:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:39:55.607 DEBUG:teuthology.orchestra.run.smithi086:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-14T11:39:55.633 INFO:teuthology.orchestra.run.smithi002.stdout: 265602 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:39 /home/ubuntu/cephtest 2024-09-14T11:39:55.649 INFO:teuthology.orchestra.run.smithi086.stdout: 265970 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 14 11:39 /home/ubuntu/cephtest 2024-09-14T11:39:55.650 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-14T11:39:55.661 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-14T11:39:55.686 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{tenant} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{off} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/replicated s3tests-branch sharding$/{single} striping$/{stripe-greater-than-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3097.4763667583466 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-14T11:39:55.686 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-14T11:39:55.765 INFO:teuthology.run:pass